[2025-10-15T17:00:02.127354] [INFO ] [MAIN ] Using last completed trading day: 2025-10-15 [2025-10-15T17:00:02.328873] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-15T17:00:02.329170] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-15T17:00:02.638177] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-15T17:00:02.638685] [WARN ] [STATE ] State set to: RUNNING [2025-10-15T17:00:02.638767] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-15T17:00:02.638818] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-15T17:00:02.638982] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-15T17:00:02.639061] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-15T17:00:04.472977] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-15T17:00:04.473188] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-15T17:00:04.473413] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-15T17:00:04.474053] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-15T17:00:04.474111] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-15T17:00:04.474145] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-15T17:00:04.474206] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-15T17:00:04.474243] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-15T17:00:04.474274] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-15T17:00:04.474685] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-15T17:00:04.474744] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-15T17:00:04.474933] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-15T17:00:04.475001] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-15T17:00:04.475043] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-15T17:00:04.475083] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-15T17:00:04.482951] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ARIS.csv (symbol ARIS no longer active). [2025-10-15T17:00:04.501434] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-15T17:00:04.507225] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/ARIS.csv (symbol ARIS no longer active). [2025-10-15T17:00:04.525623] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-10-15T17:00:04.525921] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-15T17:00:04.525965] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-15T17:00:04.525998] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-15T17:00:04.526062] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-15T17:00:04.526436] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-15T17:00:04.526473] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-15T17:00:04.526506] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-10-15T17:00:04.526536] [INFO ] [MAIN ] Running in parallel mode [2025-10-15T17:00:04.526775] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-10-15T17:00:05.387036] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.382711] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.408766] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.432023] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-15T17:00:05.431185] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.427046] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-15T17:00:05.432461] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-15T17:00:05.432762] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-15T17:00:05.434065] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-15T17:00:05.434207] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-15T17:00:05.434124] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-15T17:00:05.434349] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-15T17:00:05.434418] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-15T17:00:05.434493] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-15T17:00:05.458277] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-15T17:00:05.484241] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-15T17:00:05.926448] [DEBUG] [LOCAL ] A: Loaded 50803 existing records from primary storage. [2025-10-15T17:00:05.984238] [INFO ] [MAIN ] A: Loaded 50803 existing records. [2025-10-15T17:00:06.024700] [DEBUG] [LOCAL ] AA: Loaded 53621 existing records from primary storage. [2025-10-15T17:00:06.145123] [INFO ] [MAIN ] AA: Loaded 53621 existing records. [2025-10-15T17:00:06.483110] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:06.513866] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-15T17:00:06.671516] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:06.665825] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:06.677084] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-15T17:00:06.699426] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-15T17:00:06.712999] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-15T17:00:06.755903] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:06.755993] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-15T17:00:06.756306] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-15T17:00:06.756445] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-15T17:00:06.779049] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-15T17:00:06.824219] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-15T17:00:06.836204] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-15T17:00:06.940437] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:00:06.977808] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-15T17:00:07.037381] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:00:07.068889] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-15T17:00:07.131530] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:00:07.206001] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-15T17:00:07.279636] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-15T17:00:07.290279] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:00:07.330563] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-15T17:00:07.352796] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-15T17:00:07.342116] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-15T17:00:07.376812] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 52m 29s. Rate: 21.1 symbols/min [2025-10-15T17:00:07.609830] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:07.703796] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-15T17:00:07.740545] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:07.742301] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-15T17:00:07.824470] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:07.829597] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T17:00:07.831827] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-15T17:00:07.910435] [DEBUG] [LOCAL ] AAP: Loaded 51878 existing records from primary storage. [2025-10-15T17:00:07.911246] [INFO ] [MAIN ] AAP: Loaded 51878 existing records. [2025-10-15T17:00:08.114558] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:08.114886] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-15T17:00:08.114961] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-15T17:00:08.116150] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-15T17:00:08.116210] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-15T17:00:08.177467] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T17:00:08.194260] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-15T17:00:08.500554] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:08.501016] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-15T17:00:08.548178] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-15T17:00:08.549371] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-15T17:00:08.909503] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-15T17:00:08.911420] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-15T17:00:09.173769] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-15T17:00:09.174862] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-15T17:00:09.395595] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-15T17:00:09.396625] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-15T17:00:10.125748] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T17:00:10.136664] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-15T17:00:10.705716] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-15T17:00:10.717141] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-15T17:00:10.859091] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T17:00:10.860332] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-15T17:00:10.980943] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (3.24 seconds). [2025-10-15T17:00:10.992701] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-15T17:00:11.136818] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-15T17:00:11.138456] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-15T17:00:11.538218] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T17:00:11.539544] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-15T17:00:11.544560] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T17:00:11.561526] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-15T17:00:11.905088] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-15T17:00:11.906033] [INFO ] [REMOTE ] AAM: Full fetch complete (930 records). [2025-10-15T17:00:11.906149] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-15T17:00:11.906737] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:11.906827] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:11.906873] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:11.906915] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-15T17:00:11.906979] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-15T17:00:11.907019] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-15T17:00:11.907060] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-15T17:00:11.907155] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AAM took 7.3s. Estimated remaining: 2h 25m 35s. Rate: 16.3 symbols/min [2025-10-15T17:00:12.099182] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:12.099484] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-15T17:00:12.099562] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-15T17:00:12.099747] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-15T17:00:12.099803] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-15T17:00:12.099847] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-15T17:00:12.099881] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-15T17:00:12.496713] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:12.527974] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-15T17:00:12.531907] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T17:00:12.543245] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-15T17:00:13.085134] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:00:13.095522] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-15T17:00:13.208542] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-15T17:00:13.218953] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-15T17:00:13.959252] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T17:00:13.969904] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-15T17:00:14.041174] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:00:14.047382] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-15T17:00:14.493434] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T17:00:14.505622] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-15T17:00:14.863531] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T17:00:14.869628] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-15T17:00:15.068617] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-15T17:00:15.079843] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-15T17:00:15.423386] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:00:15.436238] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-15T17:00:16.660405] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-15T17:00:16.671467] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-15T17:00:16.807419] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:00:16.818572] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-15T17:00:17.611494] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T17:00:17.622511] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-15T17:00:18.421229] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (3.55 seconds). [2025-10-15T17:00:18.427373] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-15T17:00:18.622544] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T17:00:18.635425] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-15T17:00:18.730505] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T17:00:18.742979] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-15T17:00:19.670298] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:00:19.682712] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:00:19.690757] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-15T17:00:19.690412] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-15T17:00:19.872166] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:00:19.883159] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-15T17:00:20.558217] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:00:20.570639] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-15T17:00:21.212186] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:00:21.220428] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-15T17:00:21.452088] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:00:21.462755] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-15T17:00:21.541208] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T17:00:21.553680] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-15T17:00:22.162472] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:00:22.176065] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-15T17:00:22.518120] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T17:00:22.525277] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-15T17:00:23.427523] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T17:00:23.440193] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T17:00:23.453120] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-15T17:00:23.454942] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-15T17:00:23.483831] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T17:00:23.490292] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-15T17:00:23.578422] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:00:23.590798] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-15T17:00:24.471157] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T17:00:24.478300] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-15T17:00:24.748374] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T17:00:24.759237] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-15T17:00:24.869839] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T17:00:24.880975] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-15T17:00:25.228891] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:00:25.241566] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-15T17:00:25.409361] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:00:25.415924] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-15T17:00:26.234829] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T17:00:26.241141] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-15T17:00:26.396604] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:00:26.407210] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-15T17:00:26.604386] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T17:00:26.610891] [INFO ] [REMOTE ] A: Full fetch complete (73363 records). [2025-10-15T17:00:26.611022] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-15T17:00:26.909577] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T17:00:26.968943] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-15T17:00:27.077301] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-15T17:00:27.077521] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-15T17:00:27.078341] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-15T17:00:27.078413] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-15T17:00:27.080911] [DEBUG] [LOCAL ] A: Trimmed 73363 records to 50779 (keeping 200 days of data) [2025-10-15T17:00:27.411336] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T17:00:27.426235] [INFO ] [REMOTE ] AAT: Full fetch complete (42950 records). [2025-10-15T17:00:27.442325] [DEBUG] [LOCAL ] A: Primary data saved (50779 records). [2025-10-15T17:00:27.442537] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-15T17:00:27.442870] [INFO ] [MAIN ] A: Full history saved. [2025-10-15T17:00:27.443386] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. A took 22.9s. Estimated remaining: 5h 1m 14s. Rate: 7.9 symbols/min [2025-10-15T17:00:27.929920] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:27.958244] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-15T17:00:27.968928] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-15T17:00:27.969695] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-15T17:00:27.975195] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-15T17:00:27.990814] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-15T17:00:28.008439] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-15T17:00:28.139507] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-15T17:00:28.161200] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-15T17:00:28.165385] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-15T17:00:28.165515] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-15T17:00:28.246959] [DEBUG] [LOCAL ] AAT: Trimmed 42950 records to 30450 (keeping 200 days of data) [2025-10-15T17:00:28.333204] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-15T17:00:28.430204] [INFO ] [REMOTE ] AAP: Full fetch complete (75202 records). [2025-10-15T17:00:28.431929] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-15T17:00:28.604282] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:28.617988] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-15T17:00:28.871760] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:00:28.877093] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-15T17:00:28.877924] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:00:28.913432] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-15T17:00:28.951047] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:00:28.960925] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T17:00:28.978236] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-15T17:00:29.011087] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-15T17:00:29.012126] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-15T17:00:29.013754] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-15T17:00:29.014686] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-15T17:00:29.013986] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-15T17:00:29.021780] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-15T17:00:29.022258] [INFO ] [REMOTE ] AA: Full fetch complete (77324 records). [2025-10-15T17:00:29.053613] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-15T17:00:29.053804] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-15T17:00:29.072998] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. AAUC took 1.6s. Estimated remaining: 4h 1m 53s. Rate: 9.8 symbols/min [2025-10-15T17:00:29.074970] [DEBUG] [LOCAL ] AAP: Trimmed 75202 records to 51846 (keeping 200 days of data) [2025-10-15T17:00:29.074191] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:29.082215] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:29.199011] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:29.225599] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-15T17:00:29.270845] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-15T17:00:29.287011] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-10-15T17:00:29.295933] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-10-15T17:00:29.298363] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AA took 24.7s. Estimated remaining: 3h 15m 12s. Rate: 12.1 symbols/min [2025-10-15T17:00:29.426250] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:29.500918] [DEBUG] [LOCAL ] AAT: Primary data saved (30450 records). [2025-10-15T17:00:29.501134] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-15T17:00:29.505441] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAT took 17.6s. Estimated remaining: 2h 43m 57s. Rate: 14.4 symbols/min [2025-10-15T17:00:29.782836] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:29.784526] [DEBUG] [LOCAL ] AB: Loaded 25669 existing records from primary storage. [2025-10-15T17:00:29.799704] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-15T17:00:29.806471] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-15T17:00:29.805862] [INFO ] [MAIN ] AB: Loaded 25669 existing records. [2025-10-15T17:00:29.810548] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-15T17:00:29.835431] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-15T17:00:29.913013] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-15T17:00:29.935231] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-15T17:00:29.944206] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:30.381870] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:30.399445] [DEBUG] [LOCAL ] ABCB: Loaded 30529 existing records from primary storage. [2025-10-15T17:00:30.395213] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-15T17:00:30.438567] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-15T17:00:30.444294] [INFO ] [MAIN ] ABCB: Loaded 30529 existing records. [2025-10-15T17:00:30.450418] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-15T17:00:30.461457] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-15T17:00:30.931712] [DEBUG] [LOCAL ] AAP: Primary data saved (51846 records). [2025-10-15T17:00:30.966963] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-15T17:00:30.935886] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:30.968710] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAP took 23.6s. Estimated remaining: 2h 28m 42s. Rate: 15.9 symbols/min [2025-10-15T17:00:31.053781] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:30.990450] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-15T17:00:31.069470] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-15T17:00:31.069622] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-15T17:00:31.212373] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-15T17:00:31.240464] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-15T17:00:31.461192] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:31.653613] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:31.683222] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-15T17:00:31.911728] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:31.912916] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-15T17:00:31.913217] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-15T17:00:31.914500] [INFO ] [MAIN ] ABEV: Loaded 53279 existing records. [2025-10-15T17:00:32.094602] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:32.094894] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-15T17:00:32.094945] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-15T17:00:32.095888] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-15T17:00:32.095947] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-15T17:00:32.449312] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:32.449742] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-15T17:00:33.208415] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:00:33.215938] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-15T17:00:33.373795] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-15T17:00:33.374843] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:00:33.386606] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-15T17:00:33.392888] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-15T17:00:34.505025] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T17:00:34.513461] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-15T17:00:34.570148] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T17:00:34.581174] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-15T17:00:34.657909] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:00:34.666336] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-15T17:00:35.390962] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-15T17:00:35.402186] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-15T17:00:35.812864] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T17:00:35.819390] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-15T17:00:36.253553] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:00:36.262902] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-15T17:00:36.414883] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:00:36.425298] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-15T17:00:37.067992] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T17:00:37.075634] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-15T17:00:37.518478] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T17:00:37.528979] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-15T17:00:37.836239] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:00:37.845940] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-15T17:00:38.014138] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:00:38.024052] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-15T17:00:38.516712] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:00:38.525969] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-15T17:00:39.274099] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T17:00:39.285535] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-15T17:00:39.529771] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:00:39.538558] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-15T17:00:39.645301] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:00:39.656787] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-15T17:00:40.087538] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T17:00:40.093836] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-15T17:00:40.859065] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:00:40.865388] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-15T17:00:41.106090] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T17:00:41.111705] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-15T17:00:41.222778] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T17:00:41.234281] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-15T17:00:41.542585] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T17:00:41.553706] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-15T17:00:41.930127] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T17:00:41.934959] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-15T17:00:42.289310] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:00:42.296526] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-15T17:00:43.035044] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T17:00:43.048040] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-15T17:00:43.064384] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:00:43.070510] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-15T17:00:43.283340] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:00:43.295141] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-15T17:00:43.619215] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:00:43.625983] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-15T17:00:44.202371] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T17:00:44.207605] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-15T17:00:44.807131] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T17:00:44.822537] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:00:44.823540] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-15T17:00:44.839526] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-15T17:00:44.944288] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T17:00:44.962714] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-15T17:00:45.037840] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:00:45.047161] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-15T17:00:45.921362] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:00:45.925433] [INFO ] [REMOTE ] ABCB: Full fetch complete (44709 records). [2025-10-15T17:00:45.925548] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-15T17:00:46.108290] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:00:46.132889] [INFO ] [REMOTE ] AB: Full fetch complete (44398 records). [2025-10-15T17:00:46.174156] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-15T17:00:46.217839] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:46.241141] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:46.245706] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:46.246090] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-15T17:00:46.251622] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-15T17:00:46.256894] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-15T17:00:46.272394] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-15T17:00:46.289749] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AB took 17.2s. Estimated remaining: 3h 25m 25s. Rate: 11.5 symbols/min [2025-10-15T17:00:46.366873] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-15T17:00:46.398162] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-15T17:00:46.415524] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-15T17:00:46.426150] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-15T17:00:46.490202] [DEBUG] [LOCAL ] ABCB: Trimmed 44709 records to 30489 (keeping 200 days of data) [2025-10-15T17:00:46.508835] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:46.509328] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-15T17:00:46.509606] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-15T17:00:46.509749] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-15T17:00:46.509792] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-15T17:00:46.509834] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-15T17:00:46.509867] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-15T17:00:47.076846] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T17:00:47.119471] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:47.132745] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-15T17:00:47.138879] [DEBUG] [LOCAL ] ABCB: Primary data saved (30489 records). [2025-10-15T17:00:47.139231] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-15T17:00:47.140338] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. ABCB took 17.6s. Estimated remaining: 3h 6m 14s. Rate: 12.7 symbols/min [2025-10-15T17:00:47.141753] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-15T17:00:47.327626] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:47.372297] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T17:00:47.384753] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-15T17:00:47.395960] [DEBUG] [LOCAL ] ABM: Loaded 32100 existing records from primary storage. [2025-10-15T17:00:47.396259] [INFO ] [MAIN ] ABM: Loaded 32100 existing records. [2025-10-15T17:00:47.595885] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:47.596533] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-15T17:00:47.596624] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-15T17:00:47.597299] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-15T17:00:47.597362] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-15T17:00:47.947768] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:47.948081] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-15T17:00:48.293925] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:00:48.297556] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-15T17:00:48.727341] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:00:48.741860] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-15T17:00:49.033877] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:00:49.045715] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-15T17:00:49.159231] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T17:00:49.165312] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-15T17:00:49.393063] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T17:00:49.397870] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-15T17:00:50.038214] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T17:00:50.043965] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-15T17:00:50.199278] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:00:50.203216] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-15T17:00:50.311900] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T17:00:50.325625] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-15T17:00:50.929284] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:00:50.953338] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-15T17:00:50.954287] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T17:00:50.960455] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-15T17:00:51.291521] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T17:00:51.296443] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-15T17:00:51.637406] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:00:51.643268] [INFO ] [REMOTE ] ABBV: Full fetch complete (77454 records). [2025-10-15T17:00:51.643387] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-15T17:00:51.644182] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:51.644272] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:51.644315] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:51.644379] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-15T17:00:51.644459] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-15T17:00:51.644497] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-15T17:00:51.644535] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-15T17:00:51.644591] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABBV took 22.3s. Estimated remaining: 3h 5m 15s. Rate: 12.7 symbols/min [2025-10-15T17:00:51.810661] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:51.861335] [DEBUG] [LOCAL ] ABR: Loaded 51964 existing records from primary storage. [2025-10-15T17:00:51.861679] [INFO ] [MAIN ] ABR: Loaded 51964 existing records. [2025-10-15T17:00:52.040453] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:52.040805] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-15T17:00:52.040861] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-15T17:00:52.041770] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-15T17:00:52.041829] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-15T17:00:52.375677] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T17:00:52.424067] [INFO ] [REMOTE ] ABEV: Full fetch complete (77353 records). [2025-10-15T17:00:52.436790] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-15T17:00:52.489882] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:52.530806] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-15T17:00:52.702008] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T17:00:52.820531] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-15T17:00:52.864998] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:00:52.897225] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-15T17:00:52.975988] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-15T17:00:52.976154] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-15T17:00:52.976955] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-15T17:00:52.977095] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-15T17:00:52.978819] [DEBUG] [LOCAL ] ABEV: Trimmed 77353 records to 53278 (keeping 200 days of data) [2025-10-15T17:00:53.283461] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-10-15T17:00:53.283614] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-15T17:00:53.283731] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABEV took 22.3s. Estimated remaining: 2h 54m 12s. Rate: 13.5 symbols/min [2025-10-15T17:00:53.449250] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:53.449417] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-15T17:00:53.449454] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-15T17:00:53.449562] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-15T17:00:53.449603] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-15T17:00:53.449669] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-15T17:00:53.449724] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-15T17:00:53.812418] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:53.812976] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-15T17:00:54.023839] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T17:00:54.028946] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-15T17:00:54.107912] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:00:54.119837] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-15T17:00:54.141209] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T17:00:54.149112] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-15T17:00:54.969821] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:00:54.973784] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-15T17:00:55.293155] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:00:55.304063] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-15T17:00:55.320682] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:00:55.326304] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-15T17:00:55.823389] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T17:00:55.833688] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-15T17:00:55.885569] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T17:00:55.890441] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-15T17:00:56.353194] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T17:00:56.360279] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-15T17:00:56.816797] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:00:56.822052] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-15T17:00:56.994115] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:00:57.004460] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-15T17:00:57.720215] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T17:00:57.730453] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-15T17:00:57.779817] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T17:00:57.783881] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-15T17:00:57.822899] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T17:00:57.830951] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-15T17:00:58.617684] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T17:00:58.620042] [INFO ] [REMOTE ] ABG: Full fetch complete (26679 records). [2025-10-15T17:00:58.620120] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-15T17:00:58.918179] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T17:00:58.956034] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-15T17:00:59.040050] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-15T17:00:59.040210] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-15T17:00:59.040607] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-15T17:00:59.040716] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-15T17:00:59.059311] [DEBUG] [LOCAL ] ABG: Trimmed 26679 records to 18383 (keeping 200 days of data) [2025-10-15T17:00:59.060993] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T17:00:59.145836] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-15T17:00:59.177677] [DEBUG] [LOCAL ] ABG: Primary data saved (18383 records). [2025-10-15T17:00:59.178464] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-15T17:00:59.178604] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 12.9s. Estimated remaining: 2h 58m 55s. Rate: 13.2 symbols/min [2025-10-15T17:00:59.349505] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:59.369994] [DEBUG] [LOCAL ] ACA: Loaded 22976 existing records from primary storage. [2025-10-15T17:00:59.370267] [INFO ] [MAIN ] ACA: Loaded 22976 existing records. [2025-10-15T17:00:59.554774] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:59.555082] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-15T17:00:59.555164] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-15T17:00:59.555799] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-15T17:00:59.555959] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-15T17:00:59.777152] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T17:00:59.857891] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-15T17:00:59.976058] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:59.976363] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-15T17:01:00.849172] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T17:01:00.857485] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-15T17:01:00.888829] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T17:01:00.900000] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-15T17:01:01.246116] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:01:01.251200] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-15T17:01:02.081952] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T17:01:02.101192] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-15T17:01:02.102774] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:01:02.106535] [INFO ] [REMOTE ] ABM: Full fetch complete (44672 records). [2025-10-15T17:01:02.106616] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-15T17:01:02.107167] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:01:02.107246] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:01:02.107314] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:01:02.107387] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-15T17:01:02.107446] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-15T17:01:02.107482] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-15T17:01:02.107690] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-15T17:01:02.109205] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABM took 15.0s. Estimated remaining: 2h 53m 56s. Rate: 13.5 symbols/min [2025-10-15T17:01:02.292702] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:02.292959] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-15T17:01:02.293024] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-15T17:01:02.293210] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-15T17:01:02.293252] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-15T17:01:02.293293] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-15T17:01:02.293325] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-15T17:01:02.588495] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T17:01:02.633360] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-15T17:01:02.698953] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:02.699531] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-15T17:01:02.747075] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T17:01:02.758558] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-15T17:01:03.840069] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T17:01:03.845301] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-15T17:01:04.021043] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T17:01:04.032204] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-15T17:01:04.219926] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:01:04.227141] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-15T17:01:04.732003] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T17:01:04.743885] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-15T17:01:05.210352] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:01:05.217038] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-15T17:01:05.352011] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T17:01:05.361038] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-15T17:01:05.798962] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:01:05.809582] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-15T17:01:06.371752] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T17:01:06.379342] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-15T17:01:06.505268] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:01:06.511404] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-15T17:01:06.600275] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T17:01:06.612392] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-15T17:01:07.795517] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T17:01:07.805749] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-15T17:01:07.888011] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:01:07.899820] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-15T17:01:08.086329] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T17:01:08.114018] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-15T17:01:08.705357] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-15T17:01:08.914011] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-15T17:01:09.227719] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T17:01:09.305558] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:01:09.723211] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-15T17:01:09.728790] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:01:10.514028] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-15T17:01:10.970039] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T17:01:11.029473] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:01:11.314037] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-15T17:01:12.113977] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-15T17:01:12.211758] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T17:01:12.704016] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:01:12.914065] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-15T17:01:13.366671] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:01:13.714034] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-15T17:01:14.514036] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-15T17:01:14.535949] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:01:14.542048] [INFO ] [REMOTE ] ABR: Full fetch complete (75402 records). [2025-10-15T17:01:14.542165] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-15T17:01:14.940202] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-15T17:01:14.940288] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-15T17:01:14.941014] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-15T17:01:14.941105] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-15T17:01:14.942547] [DEBUG] [LOCAL ] ABR: Trimmed 75402 records to 51966 (keeping 200 days of data) [2025-10-15T17:01:15.252283] [DEBUG] [LOCAL ] ABR: Primary data saved (51966 records). [2025-10-15T17:01:15.252507] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-15T17:01:15.252612] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABR took 23.6s. Estimated remaining: 3h 18m 17s. Rate: 11.9 symbols/min [2025-10-15T17:01:15.317396] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-15T17:01:15.431158] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:15.431549] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-15T17:01:15.431768] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-15T17:01:15.431881] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-15T17:01:15.431924] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-15T17:01:15.431966] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-15T17:01:15.431998] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-15T17:01:15.721139] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T17:01:15.830227] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:15.862064] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-15T17:01:16.114017] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-15T17:01:16.895357] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:01:16.913959] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-15T17:01:17.074259] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:01:17.077227] [INFO ] [REMOTE ] ACA: Full fetch complete (34207 records). [2025-10-15T17:01:17.077311] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-15T17:01:17.447568] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-15T17:01:17.447690] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-15T17:01:17.448141] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-15T17:01:17.448186] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-15T17:01:17.449178] [DEBUG] [LOCAL ] ACA: Trimmed 34207 records to 22955 (keeping 200 days of data) [2025-10-15T17:01:17.583622] [DEBUG] [LOCAL ] ACA: Primary data saved (22955 records). [2025-10-15T17:01:17.583778] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-15T17:01:17.583861] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ACA took 18.4s. Estimated remaining: 3h 11m 5s. Rate: 12.3 symbols/min [2025-10-15T17:01:17.721790] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-15T17:01:17.753296] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:17.753465] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-15T17:01:17.753510] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-15T17:01:17.753619] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-15T17:01:17.753698] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-15T17:01:17.753755] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-15T17:01:17.753796] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-15T17:01:18.144013] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T17:01:18.142620] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:18.317633] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:01:18.324591] [INFO ] [REMOTE ] ABT: Full fetch complete (77762 records). [2025-10-15T17:01:18.324948] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-15T17:01:18.527202] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-15T17:01:18.759132] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-15T17:01:18.759220] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-15T17:01:18.759962] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-15T17:01:18.760029] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-15T17:01:18.761591] [DEBUG] [LOCAL ] ABT: Trimmed 77762 records to 53621 (keeping 200 days of data) [2025-10-15T17:01:19.100141] [DEBUG] [LOCAL ] ABT: Primary data saved (53621 records). [2025-10-15T17:01:19.100288] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-15T17:01:19.100366] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ABT took 25.8s. Estimated remaining: 3h 2m 47s. Rate: 12.9 symbols/min [2025-10-15T17:01:19.278198] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:19.320373] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-15T17:01:19.342887] [DEBUG] [LOCAL ] ACI: Loaded 53280 existing records from primary storage. [2025-10-15T17:01:19.343249] [INFO ] [MAIN ] ACI: Loaded 53280 existing records. [2025-10-15T17:01:19.532087] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:19.532307] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-15T17:01:19.532354] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-15T17:01:19.532789] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-15T17:01:19.532848] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-15T17:01:19.908659] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:20.061929] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:01:20.114142] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-15T17:01:20.456135] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:01:20.914054] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-15T17:01:21.714039] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-15T17:01:22.022970] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:01:22.514036] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-15T17:01:22.927284] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:01:23.314040] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-15T17:01:23.736215] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:01:23.779555] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-15T17:01:24.114087] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-15T17:01:24.656522] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:01:24.914011] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-15T17:01:25.391499] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:01:25.714048] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-15T17:01:26.514047] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-15T17:01:27.230803] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:01:27.313983] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-15T17:01:27.455399] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-15T17:01:27.556997] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:01:28.114070] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-15T17:01:28.601232] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T17:01:28.605810] [INFO ] [REMOTE ] ACCO: Full fetch complete (54086 records). [2025-10-15T17:01:28.605921] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-15T17:01:28.919093] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-15T17:01:29.005515] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-15T17:01:29.005606] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-15T17:01:29.006175] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-15T17:01:29.006238] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-15T17:01:29.007306] [DEBUG] [LOCAL ] ACCO: Trimmed 54086 records to 37070 (keeping 200 days of data) [2025-10-15T17:01:29.217921] [DEBUG] [LOCAL ] ACCO: Primary data saved (37070 records). [2025-10-15T17:01:29.218071] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-15T17:01:29.218150] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 27.1s. Estimated remaining: 3h 15m 17s. Rate: 12.0 symbols/min [2025-10-15T17:01:29.394293] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:29.439331] [DEBUG] [LOCAL ] ACM: Loaded 43037 existing records from primary storage. [2025-10-15T17:01:29.439712] [INFO ] [MAIN ] ACM: Loaded 43037 existing records. [2025-10-15T17:01:29.654685] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:29.654905] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-15T17:01:29.654955] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-15T17:01:29.655437] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-15T17:01:29.655496] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-15T17:01:29.724388] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-15T17:01:30.036944] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:30.068254] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T17:01:30.514001] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-15T17:01:31.229738] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:01:31.313987] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-15T17:01:32.093150] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-10-15T17:01:32.119080] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-15T17:01:32.146577] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:01:32.691569] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T17:01:32.913999] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-15T17:01:33.714042] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-15T17:01:34.337593] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T17:01:34.494050] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-15T17:01:34.513983] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-15T17:01:35.163741] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T17:01:35.314019] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-15T17:01:36.113990] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-15T17:01:36.163736] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T17:01:36.830340] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T17:01:36.914036] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-15T17:01:37.714139] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-15T17:01:37.793604] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T17:01:38.365114] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:01:38.514021] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-15T17:01:39.314026] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-15T17:01:39.651226] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T17:01:40.113972] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-15T17:01:40.402070] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:01:40.462226] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T17:01:40.914059] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-15T17:01:41.714017] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-15T17:01:42.359282] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-15T17:01:42.463639] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T17:01:42.513973] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-15T17:01:42.791244] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:01:43.314015] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-15T17:01:44.114030] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-15T17:01:44.351581] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T17:01:44.914013] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-15T17:01:45.682940] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T17:01:45.713999] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-15T17:01:46.197130] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-15T17:01:46.513978] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-15T17:01:46.790579] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T17:01:46.797252] [INFO ] [REMOTE ] ACI: Full fetch complete (77221 records). [2025-10-15T17:01:46.797428] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-15T17:01:47.256063] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-15T17:01:47.256678] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-15T17:01:47.257773] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-15T17:01:47.257868] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-15T17:01:47.275374] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T17:01:47.274445] [DEBUG] [LOCAL ] ACI: Trimmed 77221 records to 53282 (keeping 200 days of data) [2025-10-15T17:01:47.343216] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-15T17:01:47.425780] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T17:01:47.649629] [DEBUG] [LOCAL ] ACI: Primary data saved (53282 records). [2025-10-15T17:01:47.649815] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-15T17:01:47.649926] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACI took 28.5s. Estimated remaining: 3h 44m 29s. Rate: 10.5 symbols/min [2025-10-15T17:01:47.825818] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:47.826008] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-15T17:01:47.826057] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-15T17:01:47.826182] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-15T17:01:47.826223] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-15T17:01:47.826265] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-15T17:01:47.826298] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-15T17:01:48.119068] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-15T17:01:48.180456] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:48.246385] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:01:48.249903] [INFO ] [REMOTE ] ACEL: Full fetch complete (38849 records). [2025-10-15T17:01:48.250008] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-15T17:01:48.631749] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-15T17:01:48.631843] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-15T17:01:48.632258] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-15T17:01:48.632302] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-15T17:01:48.633355] [DEBUG] [LOCAL ] ACEL: Trimmed 38849 records to 26736 (keeping 200 days of data) [2025-10-15T17:01:48.787046] [DEBUG] [LOCAL ] ACEL: Primary data saved (26736 records). [2025-10-15T17:01:48.787190] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-15T17:01:48.787264] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACEL took 33.5s. Estimated remaining: 3h 34m 55s. Rate: 10.9 symbols/min [2025-10-15T17:01:48.928377] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-15T17:01:48.961797] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:48.992567] [DEBUG] [LOCAL ] ACP: Loaded 30979 existing records from primary storage. [2025-10-15T17:01:48.992938] [INFO ] [MAIN ] ACP: Loaded 30979 existing records. [2025-10-15T17:01:49.178450] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:49.178735] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-15T17:01:49.178794] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-15T17:01:49.179152] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-15T17:01:49.179211] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-15T17:01:49.546836] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:49.623286] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:01:49.713987] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-15T17:01:50.514030] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-15T17:01:51.135784] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T17:01:51.314025] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-15T17:01:51.676491] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-15T17:01:52.114001] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-15T17:01:52.648874] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T17:01:52.846003] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T17:01:52.914054] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-15T17:01:53.714016] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-15T17:01:54.513972] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-15T17:01:54.556358] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-15T17:01:54.785679] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T17:01:54.964974] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T17:01:55.314001] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-15T17:01:55.906714] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:01:56.114020] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-15T17:01:56.629669] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:01:56.914034] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-15T17:01:57.714063] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-15T17:01:58.513985] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-15T17:01:58.620307] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T17:01:58.706437] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:01:58.818214] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-15T17:01:58.824638] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-15T17:01:58.824854] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-15T17:01:58.825717] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:01:58.825821] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:01:58.825866] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:01:58.825932] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-15T17:01:58.825998] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-15T17:01:58.826035] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-15T17:01:58.826076] [DEBUG] [LOCAL ] ACHR: No derivative data file found to delete. [2025-10-15T17:01:58.826157] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACHR took 41.2s. Estimated remaining: 3h 43m 44s. Rate: 10.5 symbols/min [2025-10-15T17:01:59.033977] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:59.041263] [DEBUG] [LOCAL ] ACR: Loaded 5471 existing records from primary storage. [2025-10-15T17:01:59.041431] [INFO ] [MAIN ] ACR: Loaded 5471 existing records. [2025-10-15T17:01:59.215482] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:59.215715] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-15T17:01:59.215772] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-15T17:01:59.215911] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-15T17:01:59.215949] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-15T17:01:59.319091] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-15T17:01:59.611049] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:59.921749] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T17:02:00.114076] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-15T17:02:00.518307] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T17:02:00.914034] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-15T17:02:01.035205] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T17:02:01.714053] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-15T17:02:02.514028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-15T17:02:02.704075] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T17:02:02.974697] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:02:03.028860] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T17:02:03.314040] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-15T17:02:03.970036] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T17:02:04.114010] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-15T17:02:04.914146] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-15T17:02:05.230968] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T17:02:05.714003] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-15T17:02:06.448289] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:02:06.453526] [INFO ] [REMOTE ] ACM: Full fetch complete (63074 records). [2025-10-15T17:02:06.453634] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-15T17:02:06.518031] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-15T17:02:06.564622] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T17:02:06.863944] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-15T17:02:06.864033] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-15T17:02:06.864722] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-15T17:02:06.864790] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-15T17:02:06.866124] [DEBUG] [LOCAL ] ACM: Trimmed 63074 records to 42993 (keeping 200 days of data) [2025-10-15T17:02:07.139996] [DEBUG] [LOCAL ] ACM: Primary data saved (42993 records). [2025-10-15T17:02:07.140125] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-15T17:02:07.141492] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACM took 37.9s. Estimated remaining: 3h 48m 30s. Rate: 10.3 symbols/min [2025-10-15T17:02:07.318713] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-15T17:02:07.318619] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:07.318929] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-15T17:02:07.319001] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-15T17:02:07.319132] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-15T17:02:07.319196] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-15T17:02:07.319281] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-15T17:02:07.320135] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-15T17:02:07.675185] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:07.750348] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:02:08.113999] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-15T17:02:08.828209] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T17:02:08.914040] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-15T17:02:09.220766] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:02:09.714093] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-15T17:02:10.445340] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:02:10.471911] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:02:10.513982] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-15T17:02:11.314046] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-15T17:02:11.683764] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T17:02:12.114023] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-15T17:02:12.144161] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T17:02:12.914021] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-15T17:02:13.295821] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:02:13.510582] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T17:02:13.714055] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-15T17:02:14.514028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-15T17:02:14.911518] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:02:14.982826] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T17:02:15.314003] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-15T17:02:16.114030] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-15T17:02:16.756141] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:02:16.914014] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-15T17:02:17.006407] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:02:17.714112] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-15T17:02:18.358285] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T17:02:18.514122] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-15T17:02:19.314017] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-15T17:02:19.688185] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T17:02:19.699741] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T17:02:20.114009] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-15T17:02:20.696520] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T17:02:20.914031] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-15T17:02:21.631234] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T17:02:21.714034] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-15T17:02:21.987974] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T17:02:21.993351] [INFO ] [REMOTE ] ACP: Full fetch complete (46550 records). [2025-10-15T17:02:21.993526] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-15T17:02:22.325435] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T17:02:22.417824] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-15T17:02:22.417913] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-15T17:02:22.418382] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-15T17:02:22.418425] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-15T17:02:22.419863] [DEBUG] [LOCAL ] ACP: Trimmed 46550 records to 30939 (keeping 200 days of data) [2025-10-15T17:02:22.519109] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-15T17:02:22.606357] [DEBUG] [LOCAL ] ACP: Primary data saved (30939 records). [2025-10-15T17:02:22.606472] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-15T17:02:22.606550] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACP took 33.8s. Estimated remaining: 4h 5m 31s. Rate: 9.6 symbols/min [2025-10-15T17:02:22.771113] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:22.780362] [DEBUG] [LOCAL ] ACV: Loaded 7641 existing records from primary storage. [2025-10-15T17:02:22.780561] [INFO ] [MAIN ] ACV: Loaded 7641 existing records. [2025-10-15T17:02:22.956630] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:22.956902] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-15T17:02:22.956949] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-15T17:02:22.957099] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-15T17:02:22.957137] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-15T17:02:23.320700] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-15T17:02:23.320604] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:23.577199] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T17:02:23.833615] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T17:02:23.834629] [INFO ] [REMOTE ] ACR: Full fetch complete (8534 records). [2025-10-15T17:02:23.834732] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-15T17:02:24.119162] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-15T17:02:24.194722] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-15T17:02:24.195168] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-15T17:02:24.195441] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-15T17:02:24.195490] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-15T17:02:24.195969] [DEBUG] [LOCAL ] ACR: Trimmed 8534 records to 5445 (keeping 200 days of data) [2025-10-15T17:02:24.231570] [DEBUG] [LOCAL ] ACR: Primary data saved (5445 records). [2025-10-15T17:02:24.231746] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-15T17:02:24.231856] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACR took 25.4s. Estimated remaining: 3h 57m 30s. Rate: 9.9 symbols/min [2025-10-15T17:02:24.401565] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:24.452122] [DEBUG] [LOCAL ] ACVA: Loaded 49301 existing records from primary storage. [2025-10-15T17:02:24.452449] [INFO ] [MAIN ] ACVA: Loaded 49301 existing records. [2025-10-15T17:02:24.630614] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:24.630875] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-15T17:02:24.630934] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-15T17:02:24.631442] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-15T17:02:24.631484] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-15T17:02:24.919185] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-15T17:02:24.988160] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:25.416286] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T17:02:25.503111] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T17:02:25.714023] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-15T17:02:26.514020] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-15T17:02:27.122482] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:02:27.314013] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-15T17:02:28.114103] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-15T17:02:28.779247] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T17:02:28.824135] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-15T17:02:28.914058] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-15T17:02:29.396940] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T17:02:29.714030] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-15T17:02:30.272217] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:02:30.514001] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-15T17:02:31.095779] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:02:31.275757] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:02:31.313963] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-15T17:02:31.915360] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T17:02:32.114008] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-15T17:02:32.710894] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T17:02:32.914043] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-15T17:02:33.714007] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-15T17:02:34.514006] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-15T17:02:35.094369] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T17:02:35.159597] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T17:02:35.218522] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T17:02:35.313994] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-15T17:02:36.114062] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-15T17:02:36.913983] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-15T17:02:36.954908] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:02:37.139386] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:02:37.714011] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-15T17:02:38.426240] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:02:38.514003] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-15T17:02:39.313998] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-15T17:02:39.821145] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:02:40.042015] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-15T17:02:40.048781] [INFO ] [REMOTE ] ACN: Full fetch complete (77352 records). [2025-10-15T17:02:40.048953] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-15T17:02:40.119179] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-15T17:02:40.452829] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-15T17:02:40.452991] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-15T17:02:40.453748] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-15T17:02:40.453833] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-15T17:02:40.455370] [DEBUG] [LOCAL ] ACN: Trimmed 77352 records to 53439 (keeping 200 days of data) [2025-10-15T17:02:40.772383] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:02:40.795253] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T17:02:40.822025] [DEBUG] [LOCAL ] ACN: Primary data saved (53439 records). [2025-10-15T17:02:40.822149] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-15T17:02:40.822213] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACN took 53.2s. Estimated remaining: 4h 14m 31s. Rate: 9.2 symbols/min [2025-10-15T17:02:40.920451] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-15T17:02:41.011756] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:41.011915] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-15T17:02:41.011952] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-15T17:02:41.012061] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-15T17:02:41.012104] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-15T17:02:41.012147] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-15T17:02:41.012180] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-15T17:02:41.376104] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:41.713990] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-15T17:02:42.280128] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T17:02:42.513981] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-15T17:02:42.755255] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:02:42.755573] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-15T17:02:42.755691] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:02:42.755766] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-15T17:02:42.755837] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:02:42.755910] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-15T17:02:42.755976] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-15T17:02:42.756015] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-15T17:02:42.756057] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-15T17:02:42.756108] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. AD took 1.9s. Estimated remaining: 4h 7m 16s. Rate: 9.5 symbols/min [2025-10-15T17:02:42.948768] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:42.989237] [DEBUG] [LOCAL ] ADC: Loaded 46340 existing records from primary storage. [2025-10-15T17:02:42.989628] [INFO ] [MAIN ] ADC: Loaded 46340 existing records. [2025-10-15T17:02:43.122368] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:02:43.169729] [INFO ] [REMOTE ] ACRE: Full fetch complete (49965 records). [2025-10-15T17:02:43.186906] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-15T17:02:43.199002] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:43.199445] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-15T17:02:43.199557] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-15T17:02:43.233536] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-15T17:02:43.281067] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-15T17:02:43.320674] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-15T17:02:43.959026] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T17:02:43.989008] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:43.989370] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-15T17:02:43.991292] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-15T17:02:43.992204] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-15T17:02:43.992518] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-15T17:02:43.994108] [DEBUG] [LOCAL ] ACRE: Trimmed 49965 records to 33640 (keeping 200 days of data) [2025-10-15T17:02:44.138984] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-15T17:02:44.186181] [DEBUG] [LOCAL ] ACRE: Primary data saved (33640 records). [2025-10-15T17:02:44.186334] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-15T17:02:44.186412] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACRE took 37.0s. Estimated remaining: 3h 59m 48s. Rate: 9.8 symbols/min [2025-10-15T17:02:44.356788] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:44.388422] [DEBUG] [LOCAL ] ADCT: Loaded 35199 existing records from primary storage. [2025-10-15T17:02:44.388747] [INFO ] [MAIN ] ADCT: Loaded 35199 existing records. [2025-10-15T17:02:44.563095] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:44.563297] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-15T17:02:44.563343] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-15T17:02:44.564344] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-15T17:02:44.564404] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-15T17:02:44.921796] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:44.918069] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-15T17:02:45.481386] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T17:02:45.541726] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T17:02:45.713996] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-15T17:02:46.514017] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-15T17:02:47.191275] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:02:47.314001] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-15T17:02:48.114089] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-15T17:02:48.114008] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:02:48.823785] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T17:02:48.914019] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-15T17:02:49.714010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-15T17:02:49.964283] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:02:50.453606] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T17:02:50.472148] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T17:02:50.513958] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-15T17:02:51.314041] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-15T17:02:51.963211] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:02:51.970272] [INFO ] [REMOTE ] ACVA: Full fetch complete (70873 records). [2025-10-15T17:02:51.970409] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-15T17:02:52.122372] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-15T17:02:52.367084] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-15T17:02:52.367238] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-15T17:02:52.367978] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-15T17:02:52.368121] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-15T17:02:52.369564] [DEBUG] [LOCAL ] ACVA: Trimmed 70873 records to 49299 (keeping 200 days of data) [2025-10-15T17:02:52.601920] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:02:52.695049] [DEBUG] [LOCAL ] ACVA: Primary data saved (49299 records). [2025-10-15T17:02:52.695224] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-15T17:02:52.696383] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACVA took 28.5s. Estimated remaining: 4h 3m 7s. Rate: 9.6 symbols/min [2025-10-15T17:02:52.909071] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:02:52.908846] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:52.911442] [INFO ] [REMOTE ] ACV: Full fetch complete (10422 records). [2025-10-15T17:02:52.911575] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-15T17:02:52.922584] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-15T17:02:53.275013] [DEBUG] [LOCAL ] ADM: Loaded 53395 existing records from primary storage. [2025-10-15T17:02:53.287979] [INFO ] [MAIN ] ADM: Loaded 53395 existing records. [2025-10-15T17:02:53.401926] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-15T17:02:53.409933] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-15T17:02:53.412325] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-15T17:02:53.412398] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-15T17:02:53.428721] [DEBUG] [LOCAL ] ACV: Trimmed 10422 records to 7659 (keeping 200 days of data) [2025-10-15T17:02:53.530531] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:53.531745] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-15T17:02:53.532831] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-15T17:02:53.534386] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-15T17:02:53.534692] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-15T17:02:53.730781] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-15T17:02:53.767220] [DEBUG] [LOCAL ] ACV: Primary data saved (7659 records). [2025-10-15T17:02:53.800715] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-15T17:02:53.800963] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ACV took 31.2s. Estimated remaining: 3h 55m 53s. Rate: 9.9 symbols/min [2025-10-15T17:02:54.109795] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:54.146178] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:54.181537] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T17:02:54.229266] [DEBUG] [LOCAL ] ADNT: Loaded 46912 existing records from primary storage. [2025-10-15T17:02:54.229607] [INFO ] [MAIN ] ADNT: Loaded 46912 existing records. [2025-10-15T17:02:54.410198] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:54.410434] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-15T17:02:54.410483] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-15T17:02:54.411893] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-15T17:02:54.411958] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-15T17:02:54.519108] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-15T17:02:54.791864] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:55.301636] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T17:02:55.313942] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-15T17:02:55.845426] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T17:02:56.113995] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-15T17:02:56.914059] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-15T17:02:57.721510] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-15T17:02:57.742895] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:02:58.513997] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-15T17:02:58.760068] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:02:58.974017] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-10-15T17:02:59.314041] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-15T17:02:59.545152] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:02:59.656380] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:03:00.114044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-15T17:03:00.913985] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-15T17:03:01.714043] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-15T17:03:01.764767] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:03:02.514059] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-15T17:03:03.038132] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (3.72 seconds). [2025-10-15T17:03:03.317951] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-15T17:03:03.319989] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-15T17:03:03.957457] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-15T17:03:04.113989] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-15T17:03:04.180890] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:03:04.683037] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T17:03:04.914010] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-15T17:03:05.714054] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-15T17:03:05.864569] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T17:03:06.369792] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T17:03:06.513997] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-15T17:03:07.314017] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-15T17:03:07.711393] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-15T17:03:08.113989] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-15T17:03:08.316009] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:03:08.577165] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T17:03:08.914049] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-15T17:03:09.713968] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-15T17:03:10.514050] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-15T17:03:10.573776] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T17:03:11.314055] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-15T17:03:11.995523] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:03:12.114024] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-15T17:03:12.185662] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (4.07 seconds). [2025-10-15T17:03:12.920510] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-15T17:03:12.934049] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-15T17:03:13.592635] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:03:13.713961] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-15T17:03:13.790196] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T17:03:14.513980] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-15T17:03:14.768702] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T17:03:15.314063] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-15T17:03:16.114060] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-15T17:03:17.442038] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (3.73 seconds). [2025-10-15T17:03:17.452164] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-15T17:03:17.851469] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (3.34 seconds). [2025-10-15T17:03:17.856616] [INFO ] [REMOTE ] ADCT: Full fetch complete (51210 records). [2025-10-15T17:03:17.856811] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-15T17:03:17.857539] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:03:17.857632] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:03:17.857712] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:03:17.857758] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-15T17:03:17.857833] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-15T17:03:17.857888] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-15T17:03:17.858054] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-15T17:03:17.858148] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ADCT took 33.7s. Estimated remaining: 4h 19m 60s. Rate: 9.0 symbols/min [2025-10-15T17:03:18.052217] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:18.107111] [DEBUG] [LOCAL ] ADT: Loaded 53444 existing records from primary storage. [2025-10-15T17:03:18.107458] [INFO ] [MAIN ] ADT: Loaded 53444 existing records. [2025-10-15T17:03:18.288784] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:18.289364] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-15T17:03:18.289518] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-15T17:03:18.289847] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-15T17:03:18.289903] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-15T17:03:18.644225] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:18.644879] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-15T17:03:18.749001] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (3.43 seconds). [2025-10-15T17:03:18.760618] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-15T17:03:18.923627] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-15T17:03:19.222285] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:03:19.314000] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-15T17:03:20.114074] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-15T17:03:20.553429] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:03:20.619375] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T17:03:20.625923] [INFO ] [REMOTE ] ADC: Full fetch complete (66456 records). [2025-10-15T17:03:20.626070] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-15T17:03:20.921669] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-15T17:03:21.024848] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-15T17:03:21.129548] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-15T17:03:21.129677] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-15T17:03:21.130401] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-15T17:03:21.130470] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-15T17:03:21.132337] [DEBUG] [LOCAL ] ADC: Trimmed 66456 records to 46389 (keeping 200 days of data) [2025-10-15T17:03:21.441982] [DEBUG] [LOCAL ] ADC: Primary data saved (46389 records). [2025-10-15T17:03:21.442108] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-15T17:03:21.442187] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 38.7s. Estimated remaining: 4h 15m 53s. Rate: 9.1 symbols/min [2025-10-15T17:03:21.614468] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:21.641994] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:03:21.673938] [DEBUG] [LOCAL ] ADX: Loaded 27690 existing records from primary storage. [2025-10-15T17:03:21.674199] [INFO ] [MAIN ] ADX: Loaded 27690 existing records. [2025-10-15T17:03:21.719087] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-15T17:03:21.851927] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:21.852126] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-15T17:03:21.852173] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-15T17:03:21.852363] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-15T17:03:21.852401] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-15T17:03:22.222702] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:22.306826] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T17:03:22.514009] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-15T17:03:23.313994] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-15T17:03:24.119704] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-15T17:03:24.133763] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T17:03:24.171113] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T17:03:24.476547] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:03:24.914008] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-15T17:03:25.713986] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-15T17:03:26.041627] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T17:03:26.264479] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:03:26.514008] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-15T17:03:27.314004] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-15T17:03:28.114048] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-15T17:03:28.254287] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:03:28.382298] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-15T17:03:28.913986] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-15T17:03:29.099434] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T17:03:29.714007] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-15T17:03:30.259606] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-15T17:03:30.264814] [INFO ] [REMOTE ] ADNT: Full fetch complete (68013 records). [2025-10-15T17:03:30.264942] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-15T17:03:30.519259] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-15T17:03:30.694161] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-15T17:03:30.694277] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-15T17:03:30.695112] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-15T17:03:30.695186] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-15T17:03:30.696785] [DEBUG] [LOCAL ] ADNT: Trimmed 68013 records to 46787 (keeping 200 days of data) [2025-10-15T17:03:30.919570] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T17:03:31.000971] [DEBUG] [LOCAL ] ADNT: Primary data saved (46787 records). [2025-10-15T17:03:31.001125] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-15T17:03:31.001229] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADNT took 37.2s. Estimated remaining: 4h 19m 32s. Rate: 9.0 symbols/min [2025-10-15T17:03:31.192856] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:31.241987] [DEBUG] [LOCAL ] AEE: Loaded 50168 existing records from primary storage. [2025-10-15T17:03:31.242321] [INFO ] [MAIN ] AEE: Loaded 50168 existing records. [2025-10-15T17:03:31.318334] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-15T17:03:31.413234] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-15T17:03:31.496823] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:31.497033] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-15T17:03:31.497081] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-15T17:03:31.497530] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-15T17:03:31.497603] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-15T17:03:31.866989] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:32.113963] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-15T17:03:32.577223] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:03:32.913968] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-15T17:03:33.578853] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-15T17:03:33.714022] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-15T17:03:34.345589] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-15T17:03:34.513993] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-15T17:03:34.613142] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:03:34.619709] [INFO ] [REMOTE ] ADM: Full fetch complete (77436 records). [2025-10-15T17:03:34.619840] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-15T17:03:35.067087] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-15T17:03:35.067333] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-15T17:03:35.068424] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-15T17:03:35.068501] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-15T17:03:35.070782] [DEBUG] [LOCAL ] ADM: Trimmed 77436 records to 53398 (keeping 200 days of data) [2025-10-15T17:03:35.314796] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-15T17:03:35.432702] [DEBUG] [LOCAL ] ADM: Primary data saved (53398 records). [2025-10-15T17:03:35.432930] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-15T17:03:35.434601] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 42.7s. Estimated remaining: 4h 16m 43s. Rate: 9.1 symbols/min [2025-10-15T17:03:35.620110] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:35.634055] [DEBUG] [LOCAL ] AEFC: Loaded 8406 existing records from primary storage. [2025-10-15T17:03:35.634418] [INFO ] [MAIN ] AEFC: Loaded 8406 existing records. [2025-10-15T17:03:35.785306] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-15T17:03:35.889026] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:35.891699] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:03:35.892280] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-15T17:03:35.898107] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-15T17:03:35.899363] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-15T17:03:35.899433] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-15T17:03:36.119248] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-15T17:03:36.286967] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:36.914031] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-15T17:03:37.053962] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T17:03:37.563796] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T17:03:37.714011] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-15T17:03:37.741723] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T17:03:38.514023] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-15T17:03:39.028168] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:03:39.106169] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T17:03:39.313994] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-15T17:03:39.834594] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:03:40.113988] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-15T17:03:40.914002] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-15T17:03:41.554991] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:03:41.723573] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-15T17:03:41.755927] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:03:42.514070] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-15T17:03:42.618935] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:03:43.314029] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-15T17:03:44.114049] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-15T17:03:44.286059] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T17:03:44.914086] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-15T17:03:45.714075] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-15T17:03:47.059713] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-15T17:03:47.065760] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-15T17:03:47.336280] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (4.02 seconds). [2025-10-15T17:03:47.347248] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-15T17:03:47.535284] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T17:03:48.113970] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-15T17:03:48.449573] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:03:48.451219] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-15T17:03:48.465029] [INFO ] [REMOTE ] ADX: Full fetch complete (41877 records). [2025-10-15T17:03:48.465485] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-15T17:03:48.840526] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-15T17:03:48.840628] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-15T17:03:48.841193] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-15T17:03:48.841250] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-15T17:03:48.842127] [DEBUG] [LOCAL ] ADX: Trimmed 41877 records to 27657 (keeping 200 days of data) [2025-10-15T17:03:48.928784] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-15T17:03:49.013419] [DEBUG] [LOCAL ] ADX: Primary data saved (27657 records). [2025-10-15T17:03:49.013550] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-15T17:03:49.013631] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADX took 27.6s. Estimated remaining: 4h 24m 51s. Rate: 8.8 symbols/min [2025-10-15T17:03:49.082034] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T17:03:49.207583] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:49.207781] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-15T17:03:49.207826] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-15T17:03:49.207935] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-15T17:03:49.207976] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-15T17:03:49.208016] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-15T17:03:49.208047] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-15T17:03:49.577902] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:49.714019] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-15T17:03:50.514076] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-15T17:03:50.752112] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (3.40 seconds). [2025-10-15T17:03:51.314089] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-15T17:03:52.764310] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:03:52.776263] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-15T17:03:54.476705] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T17:03:54.488585] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-15T17:03:55.912113] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (5.40 seconds). [2025-10-15T17:03:55.914440] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-15T17:03:56.047062] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:03:56.053943] [INFO ] [REMOTE ] ADT: Full fetch complete (77365 records). [2025-10-15T17:03:56.054130] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-15T17:03:56.448070] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-15T17:03:56.448171] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-15T17:03:56.449037] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-15T17:03:56.449121] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-15T17:03:56.450803] [DEBUG] [LOCAL ] ADT: Trimmed 77365 records to 53443 (keeping 200 days of data) [2025-10-15T17:03:56.772174] [DEBUG] [LOCAL ] ADT: Primary data saved (53443 records). [2025-10-15T17:03:56.772375] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-15T17:03:56.772507] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 38.9s. Estimated remaining: 4h 25m 50s. Rate: 8.8 symbols/min [2025-10-15T17:03:56.941115] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:56.994576] [DEBUG] [LOCAL ] AEM: Loaded 53476 existing records from primary storage. [2025-10-15T17:03:56.994905] [INFO ] [MAIN ] AEM: Loaded 53476 existing records. [2025-10-15T17:03:57.166986] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:57.167206] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-15T17:03:57.167252] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-15T17:03:57.167871] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-15T17:03:57.167928] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-15T17:03:57.554818] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (8.63 seconds). [2025-10-15T17:03:57.559607] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:57.570632] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-15T17:03:57.571043] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-15T17:03:59.326422] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:03:59.336975] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-15T17:03:59.685880] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T17:03:59.696585] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-15T17:04:01.281539] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T17:04:01.292234] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-15T17:04:03.118189] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T17:04:03.128823] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-15T17:04:05.845013] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (9.93 seconds). [2025-10-15T17:04:05.847212] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-15T17:04:06.692160] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T17:04:06.694602] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-15T17:04:07.181988] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T17:04:07.184024] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-15T17:04:07.866142] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:04:07.867309] [INFO ] [REMOTE ] AEFC: Full fetch complete (11851 records). [2025-10-15T17:04:07.867377] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-15T17:04:07.867856] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:04:07.867936] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:04:07.867978] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:04:07.868039] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-15T17:04:07.868101] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-15T17:04:07.868135] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-15T17:04:07.868269] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-10-15T17:04:07.868362] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 32.4s. Estimated remaining: 4h 30m 27s. Rate: 8.6 symbols/min [2025-10-15T17:04:08.032431] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:08.093024] [DEBUG] [LOCAL ] AEO: Loaded 53566 existing records from primary storage. [2025-10-15T17:04:08.093388] [INFO ] [MAIN ] AEO: Loaded 53566 existing records. [2025-10-15T17:04:08.273012] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:08.273221] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-15T17:04:08.273270] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-15T17:04:08.273495] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-15T17:04:08.273551] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-15T17:04:08.637860] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:04:08.638348] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-15T17:04:10.541100] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T17:04:10.551901] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-15T17:04:11.914612] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T17:04:11.925511] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-15T17:04:13.762368] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T17:04:13.772765] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-15T17:04:18.275165] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (28.56 seconds). [2025-10-15T17:04:18.284421] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-15T17:04:21.180065] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-10-15T17:04:21.189346] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-15T17:04:22.655764] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:04:22.665341] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-15T17:04:23.681211] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (24.34 seconds). [2025-10-15T17:04:23.692598] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-15T17:04:24.469268] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (21.34 seconds). [2025-10-15T17:04:24.480991] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-15T17:04:25.428473] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (11.66 seconds). [2025-10-15T17:04:25.439958] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-15T17:04:26.298535] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (3.63 seconds). [2025-10-15T17:04:26.309054] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-15T17:04:26.581797] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-15T17:04:26.592463] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-15T17:04:26.844844] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-15T17:04:26.856262] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-15T17:04:27.856992] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:04:27.868909] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-15T17:04:28.125240] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-15T17:04:28.137352] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-15T17:04:28.972980] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-15T17:04:28.985109] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-15T17:04:30.359475] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (4.05 seconds). [2025-10-15T17:04:30.371005] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-15T17:04:30.533542] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-15T17:04:30.539969] [INFO ] [REMOTE ] AEE: Full fetch complete (72947 records). [2025-10-15T17:04:30.540096] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-15T17:04:30.959206] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-15T17:04:30.959323] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-15T17:04:30.960130] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-15T17:04:30.960290] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-15T17:04:30.961754] [DEBUG] [LOCAL ] AEE: Trimmed 72947 records to 50164 (keeping 200 days of data) [2025-10-15T17:04:31.081440] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T17:04:31.104993] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-15T17:04:31.312427] [DEBUG] [LOCAL ] AEE: Primary data saved (50164 records). [2025-10-15T17:04:31.312568] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-15T17:04:31.312671] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. AEE took 1m 0s. Estimated remaining: 4h 48m 9s. Rate: 8.1 symbols/min [2025-10-15T17:04:31.486897] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:31.536043] [DEBUG] [LOCAL ] AER: Loaded 48175 existing records from primary storage. [2025-10-15T17:04:31.536331] [INFO ] [MAIN ] AER: Loaded 48175 existing records. [2025-10-15T17:04:31.728982] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (3.59 seconds). [2025-10-15T17:04:31.747843] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:31.758185] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-15T17:04:31.758554] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-15T17:04:31.758933] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-15T17:04:31.758994] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-15T17:04:31.759780] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-15T17:04:32.131889] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:04:32.132312] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-15T17:04:33.265625] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T17:04:33.277830] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-15T17:04:33.587091] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T17:04:33.598378] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-15T17:04:34.166388] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (3.80 seconds). [2025-10-15T17:04:34.178583] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-15T17:04:35.451684] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (3.32 seconds). [2025-10-15T17:04:35.462670] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-15T17:04:35.588241] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T17:04:35.599756] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-15T17:04:35.658331] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T17:04:35.668754] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-15T17:04:36.417532] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-10-15T17:04:36.429154] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-15T17:04:37.146890] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T17:04:37.156522] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-15T17:04:37.433252] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:04:37.443879] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-15T17:04:38.765970] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:04:38.775537] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-15T17:04:38.845989] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T17:04:38.884915] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-15T17:04:38.887374] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-15T17:04:38.899603] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-15T17:04:39.306449] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (3.71 seconds). [2025-10-15T17:04:39.317869] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-15T17:04:40.264747] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:04:40.275573] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-15T17:04:40.896305] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T17:04:40.907090] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-15T17:04:41.066984] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-15T17:04:41.074768] [INFO ] [REMOTE ] AEM: Full fetch complete (77423 records). [2025-10-15T17:04:41.074959] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-15T17:04:41.474493] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-15T17:04:41.474710] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-15T17:04:41.475511] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-15T17:04:41.491419] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-15T17:04:41.512710] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T17:04:41.524387] [DEBUG] [LOCAL ] AEM: Trimmed 77423 records to 53478 (keeping 200 days of data) [2025-10-15T17:04:41.526240] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-15T17:04:41.891919] [DEBUG] [LOCAL ] AEM: Primary data saved (53478 records). [2025-10-15T17:04:41.892104] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-15T17:04:41.892201] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEM took 45.1s. Estimated remaining: 4h 51m 22s. Rate: 8.0 symbols/min [2025-10-15T17:04:42.453983] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T17:04:42.459860] [INFO ] [REMOTE ] AEG: Full fetch complete (70490 records). [2025-10-15T17:04:42.460039] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-15T17:04:42.845214] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-15T17:04:42.845318] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-15T17:04:42.846033] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-15T17:04:42.846203] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-15T17:04:42.876961] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T17:04:42.877111] [DEBUG] [LOCAL ] AEG: Trimmed 70490 records to 49572 (keeping 200 days of data) [2025-10-15T17:04:42.891867] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-15T17:04:43.169555] [DEBUG] [LOCAL ] AEG: Primary data saved (49572 records). [2025-10-15T17:04:43.169715] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-15T17:04:43.169796] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 54.2s. Estimated remaining: 4h 44m 53s. Rate: 8.2 symbols/min [2025-10-15T17:04:43.848805] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-15T17:04:43.854684] [INFO ] [REMOTE ] AEO: Full fetch complete (77246 records). [2025-10-15T17:04:43.854794] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-15T17:04:43.855558] [FATAL] [VALIDATOR ] AEO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:04:43.855664] [FATAL] [MAIN ] AEO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:04:43.855729] [WARN ] [MAIN ] AEO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:04:43.855782] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-15T17:04:43.855879] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-15T17:04:43.855968] [INFO ] [LOCAL ] AEO: Starting deletion of derivative data. [2025-10-15T17:04:43.856172] [DEBUG] [LOCAL ] AEO: Deleted derivative data file. [2025-10-15T17:04:43.857059] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEO took 36.0s. Estimated remaining: 4h 38m 8s. Rate: 8.4 symbols/min [2025-10-15T17:04:45.934496] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-10-15T17:04:45.945843] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-15T17:04:47.448806] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:04:47.458026] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-15T17:04:48.874365] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T17:04:48.884800] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-15T17:04:51.953016] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-15T17:04:51.963682] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-15T17:04:55.457407] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (3.49 seconds). [2025-10-15T17:04:55.467839] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-15T17:04:57.200487] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T17:04:57.206212] [INFO ] [REMOTE ] AER: Full fetch complete (69863 records). [2025-10-15T17:04:57.206380] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-15T17:04:57.628934] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-15T17:04:57.629083] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-15T17:04:57.630015] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-15T17:04:57.630087] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-15T17:04:57.632059] [DEBUG] [LOCAL ] AER: Trimmed 69863 records to 48137 (keeping 200 days of data) [2025-10-15T17:04:57.947160] [DEBUG] [LOCAL ] AER: Primary data saved (48137 records). [2025-10-15T17:04:57.947369] [INFO ] [MAIN ] AER: Full history saved. [2025-10-15T17:04:57.947985] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AER took 26.6s. Estimated remaining: 4h 44m 44s. Rate: 8.2 symbols/min [2025-10-15T17:04:58.674819] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.670462] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.726264] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-15T17:04:58.726050] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.734345] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-15T17:04:58.755243] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.755718] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-15T17:04:58.756183] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-15T17:04:58.756266] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-15T17:04:58.756310] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-15T17:04:58.885465] [DEBUG] [LOCAL ] AFB: Loaded 11214 existing records from primary storage. [2025-10-15T17:04:58.896388] [INFO ] [MAIN ] AFB: Loaded 11214 existing records. [2025-10-15T17:04:59.231511] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-15T17:04:59.312902] [INFO ] [MAIN ] AES: Loaded 53669 existing records. [2025-10-15T17:04:59.296270] [DEBUG] [LOCAL ] AESI: Loaded 49736 existing records from primary storage. [2025-10-15T17:04:59.366144] [INFO ] [MAIN ] AESI: Loaded 49736 existing records. [2025-10-15T17:04:59.382511] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:59.450473] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-15T17:04:59.512318] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-15T17:04:59.586335] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-15T17:04:59.615241] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-15T17:04:59.693067] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:04:59.717370] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-15T17:04:59.922368] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:59.977941] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:59.999999] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-15T17:05:00.006027] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-15T17:05:00.000261] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-15T17:05:00.011387] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-15T17:05:00.027200] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-15T17:05:00.027418] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-15T17:05:00.021879] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-15T17:05:00.065311] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-15T17:05:00.185226] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:05:00.287760] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-15T17:05:00.379709] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:05:00.401571] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-15T17:05:00.490380] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:05:00.500913] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-15T17:05:00.501070] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-15T17:05:00.528679] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-15T17:05:00.561771] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:00.614439] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-15T17:05:00.636449] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AEXA took 2.7s. Estimated remaining: 4h 40m 13s. Rate: 8.3 symbols/min [2025-10-15T17:05:00.634041] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-15T17:05:01.159114] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:01.170141] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-15T17:05:01.284293] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:01.287159] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:01.287848] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-15T17:05:01.368741] [DEBUG] [LOCAL ] AFG: Loaded 32274 existing records from primary storage. [2025-10-15T17:05:01.369073] [INFO ] [MAIN ] AFG: Loaded 32274 existing records. [2025-10-15T17:05:01.580410] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:01.580697] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-15T17:05:01.580757] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-15T17:05:01.581082] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-15T17:05:01.581140] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-15T17:05:01.956890] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:01.957320] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-15T17:05:02.112475] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:05:02.115452] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-15T17:05:03.332032] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-15T17:05:03.343442] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-15T17:05:03.381340] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T17:05:03.386898] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-15T17:05:04.533831] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T17:05:04.539227] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-15T17:05:04.876516] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-10-15T17:05:04.885575] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-15T17:05:05.139775] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-10-15T17:05:05.143036] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-15T17:05:06.009947] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:05:06.017864] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-15T17:05:06.110016] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:05:06.119232] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-15T17:05:06.160211] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-15T17:05:06.171488] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-15T17:05:06.296870] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T17:05:06.299693] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-15T17:05:07.618674] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:05:07.626824] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-15T17:05:07.653910] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:05:07.663837] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-15T17:05:07.941753] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T17:05:07.953379] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-15T17:05:08.070792] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T17:05:08.074098] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-15T17:05:08.695412] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:05:08.702400] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-15T17:05:09.012257] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T17:05:09.015894] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-15T17:05:09.272116] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T17:05:09.286051] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-15T17:05:09.622225] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T17:05:09.625329] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-15T17:05:10.173370] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:05:10.183427] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-15T17:05:10.321799] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T17:05:10.325975] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-15T17:05:10.730398] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:05:10.746173] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-15T17:05:10.757604] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-15T17:05:10.759311] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-15T17:05:11.090622] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T17:05:11.094071] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-15T17:05:11.817400] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:05:11.820170] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-15T17:05:12.811310] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-15T17:05:12.819057] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-15T17:05:14.181248] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (3.42 seconds). [2025-10-15T17:05:14.191976] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-15T17:05:14.364078] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:05:14.371834] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-15T17:05:15.060748] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (4.30 seconds). [2025-10-15T17:05:15.072176] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-15T17:05:15.202924] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (3.38 seconds). [2025-10-15T17:05:15.206057] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-15T17:05:15.688138] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:05:15.695171] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-15T17:05:16.883785] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:05:16.885473] [INFO ] [REMOTE ] AFB: Full fetch complete (16479 records). [2025-10-15T17:05:16.885542] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-15T17:05:16.885961] [FATAL] [VALIDATOR ] AFB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:05:16.886441] [FATAL] [MAIN ] AFB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:05:16.886484] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:05:16.886523] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-15T17:05:16.886576] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-15T17:05:16.886611] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-10-15T17:05:16.886814] [DEBUG] [LOCAL ] AFB: Deleted derivative data file. [2025-10-15T17:05:16.886902] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AFB took 18.9s. Estimated remaining: 4h 48m 26s. Rate: 8.1 symbols/min [2025-10-15T17:05:17.084257] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:17.086667] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T17:05:17.095872] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-15T17:05:17.098944] [DEBUG] [LOCAL ] AFGB: Loaded 2269 existing records from primary storage. [2025-10-15T17:05:17.099195] [INFO ] [MAIN ] AFGB: Loaded 2269 existing records. [2025-10-15T17:05:17.261201] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-10-15T17:05:17.332792] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:17.333167] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-15T17:05:17.333369] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-15T17:05:17.334337] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-15T17:05:17.335003] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-15T17:05:17.335094] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-15T17:05:17.476494] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T17:05:17.537457] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-15T17:05:17.737055] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:17.737363] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-15T17:05:18.215150] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T17:05:18.216391] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-15T17:05:18.613721] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-15T17:05:18.615041] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-15T17:05:18.628752] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:05:18.633193] [INFO ] [REMOTE ] AFG: Full fetch complete (46618 records). [2025-10-15T17:05:18.633305] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-15T17:05:19.051729] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T17:05:19.063547] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-15T17:05:19.063788] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-15T17:05:19.064380] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-15T17:05:19.066031] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-15T17:05:19.065967] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-15T17:05:19.068064] [DEBUG] [LOCAL ] AFG: Trimmed 46618 records to 32218 (keeping 200 days of data) [2025-10-15T17:05:19.268349] [DEBUG] [LOCAL ] AFG: Primary data saved (32218 records). [2025-10-15T17:05:19.268544] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-15T17:05:19.268637] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AFG took 18.6s. Estimated remaining: 4h 43m 45s. Rate: 8.2 symbols/min [2025-10-15T17:05:19.409967] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:05:19.493881] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-15T17:05:19.493515] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:19.526329] [DEBUG] [LOCAL ] AFGC: Loaded 2554 existing records from primary storage. [2025-10-15T17:05:19.527605] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T17:05:19.537825] [INFO ] [MAIN ] AFGC: Loaded 2554 existing records. [2025-10-15T17:05:19.583530] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-15T17:05:19.724170] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:19.724404] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-15T17:05:19.724453] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-15T17:05:19.724606] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-15T17:05:19.724696] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-15T17:05:19.820460] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T17:05:19.836526] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-15T17:05:20.136198] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:20.136598] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-15T17:05:20.347844] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-15T17:05:20.349201] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-15T17:05:20.677324] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T17:05:20.678595] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-15T17:05:20.774829] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T17:05:20.776064] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-15T17:05:21.038330] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T17:05:21.049139] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-15T17:05:21.067192] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T17:05:21.068525] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-15T17:05:22.637399] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-15T17:05:22.650166] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-15T17:05:22.656151] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T17:05:22.657763] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-15T17:05:22.706253] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:05:22.709337] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:05:22.708081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-15T17:05:22.722403] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-15T17:05:23.081011] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-15T17:05:23.082177] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-15T17:05:23.121520] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T17:05:23.122791] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-15T17:05:23.547189] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T17:05:23.548820] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-15T17:05:23.631402] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-15T17:05:23.632976] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-15T17:05:24.072339] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T17:05:24.074044] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-15T17:05:24.113747] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T17:05:24.114963] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-15T17:05:24.295416] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T17:05:24.302479] [INFO ] [REMOTE ] AESI: Full fetch complete (71165 records). [2025-10-15T17:05:24.302882] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-15T17:05:24.498865] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-15T17:05:24.506267] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T17:05:24.507968] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-15T17:05:24.556019] [INFO ] [REMOTE ] AFGB: Full fetch complete (3556 records). [2025-10-15T17:05:24.583198] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-15T17:05:24.598341] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:05:24.633372] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:05:24.644292] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:05:24.665374] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-15T17:05:24.758878] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-15T17:05:24.780791] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-15T17:05:24.780598] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-15T17:05:24.780986] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-15T17:05:24.783065] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-15T17:05:24.782592] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-15T17:05:24.785676] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-15T17:05:24.785827] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AFGB took 7.9s. Estimated remaining: 4h 42m 3s. Rate: 8.2 symbols/min [2025-10-15T17:05:24.785450] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T17:05:24.885307] [DEBUG] [LOCAL ] AESI: Trimmed 71165 records to 49739 (keeping 200 days of data) [2025-10-15T17:05:24.919119] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-15T17:05:25.080348] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:25.095510] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T17:05:25.102719] [DEBUG] [LOCAL ] AFGD: Loaded 1770 existing records from primary storage. [2025-10-15T17:05:25.104045] [INFO ] [MAIN ] AFGD: Loaded 1770 existing records. [2025-10-15T17:05:25.313670] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:25.315538] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-15T17:05:25.315610] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-15T17:05:25.316038] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-15T17:05:25.316117] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-15T17:05:25.720703] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-15T17:05:25.818003] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:25.890852] [DEBUG] [LOCAL ] AESI: Primary data saved (49739 records). [2025-10-15T17:05:25.891004] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-15T17:05:25.891087] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AESI took 27.9s. Estimated remaining: 4h 36m 37s. Rate: 8.4 symbols/min [2025-10-15T17:05:26.058479] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:26.063437] [DEBUG] [LOCAL ] AFGE: Loaded 2396 existing records from primary storage. [2025-10-15T17:05:26.063614] [INFO ] [MAIN ] AFGE: Loaded 2396 existing records. [2025-10-15T17:05:26.236990] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:26.237202] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-15T17:05:26.237251] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-15T17:05:26.238231] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-15T17:05:26.238292] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-15T17:05:26.355026] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T17:05:26.520202] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-15T17:05:26.613604] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:27.187318] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T17:05:27.314097] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-15T17:05:27.788178] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T17:05:28.114030] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-15T17:05:28.584947] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T17:05:28.914067] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-15T17:05:29.166526] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (4.25 seconds). [2025-10-15T17:05:29.342708] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T17:05:29.714018] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-15T17:05:30.040428] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T17:05:30.514003] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-15T17:05:31.131299] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T17:05:31.314053] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-15T17:05:31.666540] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T17:05:32.113997] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-15T17:05:32.474890] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T17:05:32.914003] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-15T17:05:33.336504] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:05:33.714004] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-15T17:05:34.168864] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T17:05:34.514006] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-15T17:05:35.116694] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:05:35.117554] [INFO ] [REMOTE ] AFGC: Full fetch complete (3682 records). [2025-10-15T17:05:35.117624] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-15T17:05:35.323437] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-15T17:05:35.475519] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-15T17:05:35.475594] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-15T17:05:35.475736] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-15T17:05:35.475798] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-15T17:05:35.476140] [DEBUG] [LOCAL ] AFGC: Trimmed 3682 records to 2561 (keeping 200 days of data) [2025-10-15T17:05:35.491773] [DEBUG] [LOCAL ] AFGC: Primary data saved (2561 records). [2025-10-15T17:05:35.491850] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-15T17:05:35.491932] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 16.2s. Estimated remaining: 4h 38m 34s. Rate: 8.3 symbols/min [2025-10-15T17:05:35.664315] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:35.717404] [DEBUG] [LOCAL ] AFL: Loaded 53189 existing records from primary storage. [2025-10-15T17:05:35.717899] [INFO ] [MAIN ] AFL: Loaded 53189 existing records. [2025-10-15T17:05:35.909211] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:05:35.915330] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:35.917687] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-15T17:05:35.917794] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-15T17:05:35.918828] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-15T17:05:35.918886] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-15T17:05:36.123029] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-15T17:05:36.271564] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:36.573102] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T17:05:36.913997] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-15T17:05:37.354601] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T17:05:37.713991] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-15T17:05:38.514019] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-15T17:05:39.053427] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T17:05:39.314017] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-15T17:05:39.584969] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:05:39.766710] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T17:05:40.114079] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-15T17:05:40.673379] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T17:05:40.914070] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-15T17:05:41.338950] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T17:05:41.714007] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-15T17:05:42.514033] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-15T17:05:42.948101] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T17:05:43.136798] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T17:05:43.313987] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-15T17:05:44.113990] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-15T17:05:44.601761] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T17:05:44.922915] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-15T17:05:44.942533] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:05:45.301491] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T17:05:45.302375] [INFO ] [REMOTE ] AFGE: Full fetch complete (3442 records). [2025-10-15T17:05:45.302477] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-15T17:05:45.663478] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-15T17:05:45.663561] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-15T17:05:45.663754] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-15T17:05:45.663817] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-15T17:05:45.664198] [DEBUG] [LOCAL ] AFGE: Trimmed 3442 records to 2374 (keeping 200 days of data) [2025-10-15T17:05:45.679721] [DEBUG] [LOCAL ] AFGE: Primary data saved (2374 records). [2025-10-15T17:05:45.679873] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-15T17:05:45.679987] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGE took 19.8s. Estimated remaining: 4h 40m 54s. Rate: 8.3 symbols/min [2025-10-15T17:05:45.719112] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-15T17:05:45.876093] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:45.933131] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-15T17:05:45.933616] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-15T17:05:46.109113] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:46.109387] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-15T17:05:46.109453] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-15T17:05:46.110350] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-15T17:05:46.110416] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-15T17:05:46.458767] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:46.514018] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-15T17:05:47.313977] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-15T17:05:47.563892] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T17:05:47.722762] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-15T17:05:48.114009] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-15T17:05:48.570000] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T17:05:48.913981] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-15T17:05:49.447163] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T17:05:49.447979] [INFO ] [REMOTE ] AFGD: Full fetch complete (3030 records). [2025-10-15T17:05:49.448047] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-15T17:05:49.722511] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-15T17:05:49.804497] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-15T17:05:49.804569] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-15T17:05:49.804699] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-15T17:05:49.804759] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-15T17:05:49.805087] [DEBUG] [LOCAL ] AFGD: Trimmed 3030 records to 1772 (keeping 200 days of data) [2025-10-15T17:05:49.815914] [DEBUG] [LOCAL ] AFGD: Primary data saved (1772 records). [2025-10-15T17:05:49.815975] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-15T17:05:49.816040] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGD took 25.0s. Estimated remaining: 4h 38m 16s. Rate: 8.3 symbols/min [2025-10-15T17:05:49.981486] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:50.028873] [DEBUG] [LOCAL ] AGCO: Loaded 42456 existing records from primary storage. [2025-10-15T17:05:50.029151] [INFO ] [MAIN ] AGCO: Loaded 42456 existing records. [2025-10-15T17:05:50.202732] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:50.202979] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-15T17:05:50.203101] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-15T17:05:50.203941] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-15T17:05:50.203998] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-15T17:05:50.514546] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-15T17:05:50.556843] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:50.588161] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (4.07 seconds). [2025-10-15T17:05:51.313984] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-15T17:05:51.651176] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T17:05:52.114004] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-15T17:05:52.886521] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T17:05:52.913947] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-15T17:05:53.404807] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T17:05:53.714025] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-15T17:05:54.026140] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (3.51 seconds). [2025-10-15T17:05:54.032688] [INFO ] [REMOTE ] AES: Full fetch complete (77847 records). [2025-10-15T17:05:54.032866] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-15T17:05:54.425711] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-15T17:05:54.426035] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-15T17:05:54.426850] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-15T17:05:54.426915] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-15T17:05:54.428476] [DEBUG] [LOCAL ] AES: Trimmed 77847 records to 53669 (keeping 200 days of data) [2025-10-15T17:05:54.515981] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-15T17:05:54.745734] [DEBUG] [LOCAL ] AES: Primary data saved (53669 records). [2025-10-15T17:05:54.745862] [INFO ] [MAIN ] AES: Full history saved. [2025-10-15T17:05:54.745940] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AES took 56.8s. Estimated remaining: 4h 36m 22s. Rate: 8.4 symbols/min [2025-10-15T17:05:54.915614] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:54.935999] [DEBUG] [LOCAL ] AGD: Loaded 19218 existing records from primary storage. [2025-10-15T17:05:54.946436] [INFO ] [MAIN ] AGD: Loaded 19218 existing records. [2025-10-15T17:05:55.059085] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-15T17:05:55.169061] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:55.169316] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-15T17:05:55.169363] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-15T17:05:55.169856] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-15T17:05:55.169917] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-15T17:05:55.372126] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-15T17:05:55.533822] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:55.573620] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T17:05:56.028913] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T17:05:56.114064] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-15T17:05:56.914027] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-15T17:05:57.101951] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T17:05:57.714000] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-15T17:05:58.514033] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-15T17:05:58.578305] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:05:58.748166] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T17:05:59.314038] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-15T17:06:00.034016] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:06:00.114052] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-15T17:06:00.913990] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-15T17:06:01.007379] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T17:06:01.713993] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-15T17:06:02.551637] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T17:06:02.555401] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-15T17:06:39.502330] [DEBUG] [REMOTE ] AG: Error fetching primary data for 2025-03: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-15T17:06:39.502515] [WARN ] [REMOTE ] AG: No data returned for month 2025-03 [2025-10-15T17:06:39.502593] [FATAL] [REMOTE ] AG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:06:39.502674] [FATAL] [MAIN ] AG: Failed to fetch primary data. [2025-10-15T17:06:39.502744] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:06:39.502828] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-15T17:06:39.502925] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-15T17:06:39.502981] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-10-15T17:06:39.503099] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-10-15T17:06:39.503198] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AG took 53.8s. Estimated remaining: 5h 5m 19s. Rate: 7.6 symbols/min [2025-10-15T17:06:39.672853] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:39.723152] [DEBUG] [LOCAL ] AGI: Loaded 53424 existing records from primary storage. [2025-10-15T17:06:39.723519] [INFO ] [MAIN ] AGI: Loaded 53424 existing records. [2025-10-15T17:06:39.902269] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:39.902496] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-15T17:06:39.902545] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-15T17:06:39.903566] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-15T17:06:39.903626] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-15T17:06:40.255921] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:40.256259] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-15T17:06:41.020732] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (38.47 seconds). [2025-10-15T17:06:41.024618] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-15T17:06:41.973378] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T17:06:41.978194] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-15T17:06:42.049015] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T17:06:42.059955] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-15T17:06:42.252928] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (41.34 seconds). [2025-10-15T17:06:42.262364] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-15T17:06:43.072830] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:06:43.077445] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-15T17:06:44.483423] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (45.17 seconds). [2025-10-15T17:06:44.495982] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-15T17:06:45.494968] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (3.44 seconds). [2025-10-15T17:06:45.505433] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-15T17:06:46.129740] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (3.87 seconds). [2025-10-15T17:06:46.140237] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-15T17:06:46.777597] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (3.70 seconds). [2025-10-15T17:06:46.782708] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-15T17:06:47.711551] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:06:47.716048] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-15T17:06:47.761062] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-15T17:06:47.772447] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-15T17:06:48.376939] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-15T17:06:48.386792] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-15T17:06:48.735524] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (4.24 seconds). [2025-10-15T17:06:48.747478] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-15T17:06:48.824114] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T17:06:48.831387] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-15T17:06:49.676703] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T17:06:49.688013] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-15T17:06:49.817602] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:06:49.829357] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-15T17:06:50.311323] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:06:50.314860] [INFO ] [REMOTE ] AGD: Full fetch complete (26591 records). [2025-10-15T17:06:50.314930] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-15T17:06:50.660147] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T17:06:50.756385] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-15T17:06:50.768483] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-15T17:06:50.768574] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-15T17:06:50.769035] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-15T17:06:50.769099] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-15T17:06:50.769969] [DEBUG] [LOCAL ] AGD: Trimmed 26591 records to 19317 (keeping 200 days of data) [2025-10-15T17:06:50.887301] [DEBUG] [LOCAL ] AGD: Primary data saved (19317 records). [2025-10-15T17:06:50.887456] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-15T17:06:50.887573] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGD took 56.1s. Estimated remaining: 5h 7m 50s. Rate: 7.5 symbols/min [2025-10-15T17:06:51.053686] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:51.102620] [DEBUG] [LOCAL ] AGL: Loaded 52562 existing records from primary storage. [2025-10-15T17:06:51.102961] [INFO ] [MAIN ] AGL: Loaded 52562 existing records. [2025-10-15T17:06:51.280030] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:51.280237] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-15T17:06:51.280284] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-15T17:06:51.280606] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-15T17:06:51.280683] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-15T17:06:51.634712] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:51.635034] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-15T17:06:51.897672] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T17:06:51.907251] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-15T17:06:52.701624] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-15T17:06:52.717518] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-15T17:06:52.739535] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T17:06:52.749585] [INFO ] [REMOTE ] AFL: Full fetch complete (77070 records). [2025-10-15T17:06:52.749849] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-15T17:06:53.187059] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-15T17:06:53.196777] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-15T17:06:53.198161] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-15T17:06:53.212378] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-15T17:06:53.217457] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:06:53.228949] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-15T17:06:53.230953] [DEBUG] [LOCAL ] AFL: Trimmed 77070 records to 53190 (keeping 200 days of data) [2025-10-15T17:06:53.603856] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T17:06:53.607295] [DEBUG] [LOCAL ] AFL: Primary data saved (53190 records). [2025-10-15T17:06:53.616153] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-15T17:06:53.617605] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AFL took 1m 18s. Estimated remaining: 5h 3m 48s. Rate: 7.6 symbols/min [2025-10-15T17:06:53.651776] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-15T17:06:53.803769] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:53.818298] [DEBUG] [LOCAL ] AGM: Loaded 10669 existing records from primary storage. [2025-10-15T17:06:53.818548] [INFO ] [MAIN ] AGM: Loaded 10669 existing records. [2025-10-15T17:06:54.005632] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:54.005879] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-15T17:06:54.005929] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-15T17:06:54.006099] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-15T17:06:54.006139] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-15T17:06:54.381368] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:54.382030] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-15T17:06:54.859865] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T17:06:54.870040] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-15T17:06:55.115265] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T17:06:55.126180] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-15T17:06:55.161856] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:06:55.163887] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-15T17:06:55.560781] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-15T17:06:55.562607] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-15T17:06:56.088457] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-10-15T17:06:56.092943] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T17:06:56.101187] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-15T17:06:56.103399] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-15T17:06:56.394366] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T17:06:56.400320] [INFO ] [REMOTE ] AGCO: Full fetch complete (61714 records). [2025-10-15T17:06:56.400500] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-15T17:06:56.757841] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T17:06:56.795063] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-15T17:06:56.870830] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T17:06:56.880401] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-15T17:06:56.881509] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-15T17:06:56.881886] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-15T17:06:56.883083] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-15T17:06:56.883816] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-15T17:06:56.885483] [DEBUG] [LOCAL ] AGCO: Trimmed 61714 records to 42395 (keeping 200 days of data) [2025-10-15T17:06:57.153225] [DEBUG] [LOCAL ] AGCO: Primary data saved (42395 records). [2025-10-15T17:06:57.153347] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-15T17:06:57.154066] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGCO took 1m 7s. Estimated remaining: 5h 0m 31s. Rate: 7.7 symbols/min [2025-10-15T17:06:57.323892] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:57.352548] [DEBUG] [LOCAL ] AGO: Loaded 27878 existing records from primary storage. [2025-10-15T17:06:57.352968] [INFO ] [MAIN ] AGO: Loaded 27878 existing records. [2025-10-15T17:06:57.476486] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T17:06:57.490041] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-15T17:06:57.561835] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:57.562265] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-15T17:06:57.562337] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-15T17:06:57.563108] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-15T17:06:57.563169] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-15T17:06:57.974276] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:57.974941] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-15T17:06:58.121681] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T17:06:58.123688] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-15T17:06:58.186986] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T17:06:58.197844] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-15T17:06:58.526098] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:06:58.537261] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-15T17:06:59.032926] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T17:06:59.038417] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-15T17:06:59.731752] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:06:59.736430] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-15T17:07:00.260076] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T17:07:00.293938] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T17:07:00.292790] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-15T17:07:00.307335] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-15T17:07:00.516600] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T17:07:00.523054] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-15T17:07:00.614372] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:07:00.617591] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-15T17:07:01.235087] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T17:07:01.237625] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-15T17:07:01.667669] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T17:07:01.673876] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-15T17:07:01.927490] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T17:07:01.930347] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-15T17:07:02.230690] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:07:02.242833] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-15T17:07:03.617147] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T17:07:03.625839] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-15T17:07:03.660119] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-10-15T17:07:03.671255] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-15T17:07:03.793145] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T17:07:03.797037] [INFO ] [REMOTE ] AGM: Full fetch complete (13242 records). [2025-10-15T17:07:03.797146] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-15T17:07:04.242829] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-15T17:07:04.243057] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-15T17:07:04.243482] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-15T17:07:04.243538] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-15T17:07:04.244811] [DEBUG] [LOCAL ] AGM: Trimmed 13242 records to 10719 (keeping 200 days of data) [2025-10-15T17:07:04.324133] [DEBUG] [LOCAL ] AGM: Primary data saved (10719 records). [2025-10-15T17:07:04.324350] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-15T17:07:04.324455] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 10.7s. Estimated remaining: 4h 59m 57s. Rate: 7.7 symbols/min [2025-10-15T17:07:04.533858] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:04.570737] [DEBUG] [LOCAL ] AGRO: Loaded 33181 existing records from primary storage. [2025-10-15T17:07:04.571208] [INFO ] [MAIN ] AGRO: Loaded 33181 existing records. [2025-10-15T17:07:04.773843] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:04.774181] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-15T17:07:04.774244] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-15T17:07:04.775005] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-15T17:07:04.775067] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-15T17:07:05.084157] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-15T17:07:05.128029] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-15T17:07:05.187182] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T17:07:05.236969] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-15T17:07:05.281787] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:05.282420] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-15T17:07:05.680585] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T17:07:05.691071] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-15T17:07:06.578355] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T17:07:06.587562] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-15T17:07:07.047004] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T17:07:07.056047] [INFO ] [REMOTE ] AGI: Full fetch complete (77212 records). [2025-10-15T17:07:07.056333] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-15T17:07:07.467043] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-15T17:07:07.518283] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-15T17:07:07.542904] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-15T17:07:07.543055] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-15T17:07:07.544273] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-15T17:07:07.544627] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-15T17:07:07.547025] [DEBUG] [LOCAL ] AGI: Trimmed 77212 records to 53424 (keeping 200 days of data) [2025-10-15T17:07:07.801170] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T17:07:07.802628] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:07:07.850774] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-15T17:07:07.854784] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-15T17:07:07.973923] [DEBUG] [LOCAL ] AGI: Primary data saved (53424 records). [2025-10-15T17:07:07.974152] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-15T17:07:07.974266] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGI took 28.5s. Estimated remaining: 4h 56m 56s. Rate: 7.8 symbols/min [2025-10-15T17:07:08.154571] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:08.192044] [DEBUG] [LOCAL ] AGX: Loaded 33019 existing records from primary storage. [2025-10-15T17:07:08.192404] [INFO ] [MAIN ] AGX: Loaded 33019 existing records. [2025-10-15T17:07:08.386782] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:08.387086] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-15T17:07:08.387139] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-15T17:07:08.387710] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-15T17:07:08.387773] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-15T17:07:08.781786] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:07:08.806107] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-15T17:07:08.823127] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:08.823670] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-15T17:07:09.327214] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:07:09.334522] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-15T17:07:09.815419] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-15T17:07:09.829113] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-15T17:07:10.259226] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T17:07:10.266115] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-15T17:07:10.304609] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:07:10.310787] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-15T17:07:10.488270] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T17:07:10.496185] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-15T17:07:11.662884] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T17:07:11.672249] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T17:07:11.688254] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-15T17:07:11.691581] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-15T17:07:11.733453] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:07:11.743243] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-15T17:07:12.018520] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:07:12.027251] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-15T17:07:12.740405] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T17:07:12.746981] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-15T17:07:13.058252] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:07:13.067092] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-15T17:07:13.424858] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T17:07:13.432733] [INFO ] [REMOTE ] AGL: Full fetch complete (75876 records). [2025-10-15T17:07:13.446083] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-15T17:07:13.515227] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T17:07:13.574624] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-15T17:07:13.705871] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:07:13.774573] [INFO ] [REMOTE ] AGO: Full fetch complete (39637 records). [2025-10-15T17:07:13.809706] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-15T17:07:14.050950] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-15T17:07:14.054403] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-15T17:07:14.056108] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-15T17:07:14.066755] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-15T17:07:14.196066] [DEBUG] [LOCAL ] AGL: Trimmed 75876 records to 52580 (keeping 200 days of data) [2025-10-15T17:07:14.331893] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:07:14.435947] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-15T17:07:14.487726] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-15T17:07:14.491682] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-15T17:07:14.502221] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-15T17:07:14.504137] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-15T17:07:14.511085] [DEBUG] [LOCAL ] AGO: Trimmed 39637 records to 27929 (keeping 200 days of data) [2025-10-15T17:07:14.885244] [DEBUG] [LOCAL ] AGL: Primary data saved (52580 records). [2025-10-15T17:07:14.898185] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-15T17:07:14.898085] [DEBUG] [LOCAL ] AGO: Primary data saved (27929 records). [2025-10-15T17:07:14.898385] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGL took 24.0s. Estimated remaining: 4h 56m 16s. Rate: 7.8 symbols/min [2025-10-15T17:07:14.898481] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-15T17:07:14.898783] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGO took 17.7s. Estimated remaining: 4h 50m 56s. Rate: 7.9 symbols/min [2025-10-15T17:07:15.244337] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:15.296849] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:15.297245] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-15T17:07:15.297292] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-15T17:07:15.297418] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-15T17:07:15.297460] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-15T17:07:15.297532] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-15T17:07:15.297589] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-15T17:07:15.617697] [DEBUG] [LOCAL ] AHH: Loaded 40550 existing records from primary storage. [2025-10-15T17:07:15.645229] [INFO ] [MAIN ] AHH: Loaded 40550 existing records. [2025-10-15T17:07:15.915214] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:15.944520] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-15T17:07:15.992676] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:15.993333] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-15T17:07:15.993390] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-15T17:07:15.994181] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-15T17:07:15.994245] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-15T17:07:16.233262] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:07:16.282416] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-15T17:07:16.319551] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:07:16.327850] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-15T17:07:16.351854] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:07:16.415367] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-15T17:07:16.413428] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:16.409260] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-15T17:07:16.422797] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-15T17:07:16.423181] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-15T17:07:16.424827] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-15T17:07:16.425135] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-15T17:07:16.425879] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-15T17:07:16.426134] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AHL took 1.5s. Estimated remaining: 4h 46m 49s. Rate: 8.1 symbols/min [2025-10-15T17:07:16.595371] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:16.638154] [DEBUG] [LOCAL ] AHR: Loaded 49074 existing records from primary storage. [2025-10-15T17:07:16.638527] [INFO ] [MAIN ] AHR: Loaded 49074 existing records. [2025-10-15T17:07:16.816011] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:16.816337] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-15T17:07:16.816387] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-15T17:07:16.816752] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-15T17:07:16.816809] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-15T17:07:17.010857] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-15T17:07:17.099986] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-15T17:07:17.205958] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:17.206284] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-15T17:07:17.951798] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:07:17.959309] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-15T17:07:18.283161] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T17:07:18.292549] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-15T17:07:18.462483] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:07:18.472618] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-15T17:07:18.743926] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:07:18.751237] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-15T17:07:19.020139] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T17:07:19.027376] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-15T17:07:19.817629] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T17:07:19.826301] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-15T17:07:20.519743] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T17:07:20.529168] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-15T17:07:20.640495] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:07:20.648498] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-15T17:07:21.032366] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T17:07:21.039468] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-15T17:07:21.245131] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T17:07:21.252999] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-15T17:07:21.794574] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:07:21.803579] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-15T17:07:21.904208] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:07:21.908133] [INFO ] [REMOTE ] AGRO: Full fetch complete (49105 records). [2025-10-15T17:07:21.908237] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-15T17:07:22.308881] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T17:07:22.353064] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-15T17:07:22.366706] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-15T17:07:22.366839] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-15T17:07:22.367578] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-15T17:07:22.367822] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-15T17:07:22.369570] [DEBUG] [LOCAL ] AGRO: Trimmed 49105 records to 33087 (keeping 200 days of data) [2025-10-15T17:07:22.583102] [DEBUG] [LOCAL ] AGRO: Primary data saved (33087 records). [2025-10-15T17:07:22.583318] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-15T17:07:22.584347] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGRO took 18.3s. Estimated remaining: 4h 45m 51s. Rate: 8.1 symbols/min [2025-10-15T17:07:22.783472] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:22.818236] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:07:22.832620] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-15T17:07:22.847047] [DEBUG] [LOCAL ] AHT: Loaded 6353 existing records from primary storage. [2025-10-15T17:07:22.849816] [INFO ] [MAIN ] AHT: Loaded 6353 existing records. [2025-10-15T17:07:22.885985] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:07:22.953621] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-15T17:07:23.044503] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:23.044750] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-15T17:07:23.044806] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-15T17:07:23.045013] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-15T17:07:23.045070] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-15T17:07:23.392174] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:23.392489] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-15T17:07:23.720597] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:07:23.731242] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-15T17:07:24.054429] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T17:07:24.057170] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-15T17:07:24.463750] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T17:07:24.470981] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-15T17:07:24.639964] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:07:24.641994] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-15T17:07:24.979914] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T17:07:24.990310] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-15T17:07:25.117810] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-15T17:07:25.128049] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-15T17:07:25.378153] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:07:25.380238] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-15T17:07:25.820734] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T17:07:25.824356] [INFO ] [REMOTE ] AGX: Full fetch complete (48911 records). [2025-10-15T17:07:25.824456] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-15T17:07:25.945575] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:07:25.982322] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-15T17:07:26.229106] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-15T17:07:26.229212] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-15T17:07:26.229797] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-15T17:07:26.229860] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-15T17:07:26.231750] [DEBUG] [LOCAL ] AGX: Trimmed 48911 records to 32884 (keeping 200 days of data) [2025-10-15T17:07:26.452090] [DEBUG] [LOCAL ] AGX: Primary data saved (32884 records). [2025-10-15T17:07:26.452272] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-15T17:07:26.452375] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AGX took 18.5s. Estimated remaining: 4h 43m 27s. Rate: 8.1 symbols/min [2025-10-15T17:07:26.632739] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:26.668410] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T17:07:26.669393] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:07:26.682283] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-15T17:07:26.683939] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-15T17:07:26.712551] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:07:26.722812] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-15T17:07:26.768842] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-15T17:07:26.769165] [INFO ] [MAIN ] AI: Loaded 53764 existing records. [2025-10-15T17:07:26.941840] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:26.942079] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-15T17:07:26.942128] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-15T17:07:26.942524] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-15T17:07:26.942581] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-15T17:07:27.300466] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T17:07:27.306257] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:27.308572] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-15T17:07:27.309731] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-15T17:07:27.782302] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T17:07:27.784442] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-15T17:07:28.284606] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T17:07:28.294840] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-15T17:07:28.525570] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:07:28.914013] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-15T17:07:29.384748] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-15T17:07:29.555552] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:07:29.713974] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-15T17:07:29.922178] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:07:30.145947] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T17:07:30.514058] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-15T17:07:30.843338] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (3.53 seconds). [2025-10-15T17:07:31.314020] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-15T17:07:32.113974] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-15T17:07:32.913958] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-15T17:07:33.224794] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-15T17:07:33.568103] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T17:07:33.569702] [INFO ] [REMOTE ] AHT: Full fetch complete (9163 records). [2025-10-15T17:07:33.569776] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-15T17:07:33.718310] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-15T17:07:33.943542] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:07:34.002380] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-15T17:07:34.017125] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-15T17:07:34.017405] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-15T17:07:34.028674] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-15T17:07:34.029951] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-15T17:07:34.031514] [DEBUG] [LOCAL ] AHT: Trimmed 9163 records to 6362 (keeping 200 days of data) [2025-10-15T17:07:34.065757] [DEBUG] [LOCAL ] AHT: Primary data saved (6362 records). [2025-10-15T17:07:34.065843] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-15T17:07:34.065924] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHT took 11.5s. Estimated remaining: 4h 43m 29s. Rate: 8.1 symbols/min [2025-10-15T17:07:34.232265] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:34.282694] [DEBUG] [LOCAL ] AIG: Loaded 53470 existing records from primary storage. [2025-10-15T17:07:34.283005] [INFO ] [MAIN ] AIG: Loaded 53470 existing records. [2025-10-15T17:07:34.462806] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:34.463101] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-15T17:07:34.463154] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-15T17:07:34.464021] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-15T17:07:34.464249] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-15T17:07:34.526391] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-15T17:07:34.836995] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:35.112123] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T17:07:35.314056] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-15T17:07:36.114033] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-15T17:07:36.766786] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:07:36.771605] [INFO ] [REMOTE ] AHH: Full fetch complete (59748 records). [2025-10-15T17:07:36.771744] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-15T17:07:36.921956] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-15T17:07:37.171767] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-15T17:07:37.171848] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-15T17:07:37.172440] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-15T17:07:37.172481] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-15T17:07:37.173725] [DEBUG] [LOCAL ] AHH: Trimmed 59748 records to 40527 (keeping 200 days of data) [2025-10-15T17:07:37.404894] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-15T17:07:37.441333] [DEBUG] [LOCAL ] AHH: Primary data saved (40527 records). [2025-10-15T17:07:37.441446] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-15T17:07:37.441516] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHH took 22.5s. Estimated remaining: 4h 40m 53s. Rate: 8.2 symbols/min [2025-10-15T17:07:37.615194] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:37.615472] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-15T17:07:37.615544] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-15T17:07:37.615687] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-15T17:07:37.615754] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-15T17:07:37.615807] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-15T17:07:37.615841] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-15T17:07:37.717175] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-15T17:07:38.014900] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T17:07:38.018551] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:38.513965] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-15T17:07:38.955174] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T17:07:39.314043] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-15T17:07:40.114011] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-15T17:07:40.175316] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:07:40.180212] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-15T17:07:40.358439] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:07:40.358788] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-15T17:07:40.358874] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:07:40.358920] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-15T17:07:40.358979] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:07:40.359049] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-15T17:07:40.359110] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-15T17:07:40.359146] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-15T17:07:40.359184] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-15T17:07:40.359228] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AII took 2.9s. Estimated remaining: 4h 38m 5s. Rate: 8.3 symbols/min [2025-10-15T17:07:40.522148] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:40.545716] [DEBUG] [LOCAL ] AIN: Loaded 24467 existing records from primary storage. [2025-10-15T17:07:40.546023] [INFO ] [MAIN ] AIN: Loaded 24467 existing records. [2025-10-15T17:07:40.721014] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:40.721201] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-15T17:07:40.721270] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-15T17:07:40.721553] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-15T17:07:40.721611] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-15T17:07:40.919116] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-15T17:07:41.083898] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:41.113170] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:07:41.714029] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-15T17:07:42.514001] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-15T17:07:43.316880] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-15T17:07:43.322340] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:07:44.084463] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (3.17 seconds). [2025-10-15T17:07:44.113962] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-15T17:07:44.222047] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T17:07:44.227823] [INFO ] [REMOTE ] AHR: Full fetch complete (70822 records). [2025-10-15T17:07:44.227936] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-15T17:07:44.607701] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T17:07:44.634242] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-15T17:07:44.634297] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-15T17:07:44.634977] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-15T17:07:44.635038] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-15T17:07:44.636250] [DEBUG] [LOCAL ] AHR: Trimmed 70822 records to 49077 (keeping 200 days of data) [2025-10-15T17:07:44.918595] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-15T17:07:44.936556] [DEBUG] [LOCAL ] AHR: Primary data saved (49077 records). [2025-10-15T17:07:44.936733] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-15T17:07:44.936847] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AHR took 28.5s. Estimated remaining: 4h 36m 22s. Rate: 8.3 symbols/min [2025-10-15T17:07:45.108187] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:45.122813] [DEBUG] [LOCAL ] AIO: Loaded 13374 existing records from primary storage. [2025-10-15T17:07:45.123029] [INFO ] [MAIN ] AIO: Loaded 13374 existing records. [2025-10-15T17:07:45.306025] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:45.306304] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-15T17:07:45.306369] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-15T17:07:45.306737] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-15T17:07:45.306804] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-15T17:07:45.657352] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:45.713959] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-15T17:07:46.514022] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-15T17:07:46.646211] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:07:47.313985] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-15T17:07:47.514381] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T17:07:48.114009] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-15T17:07:48.472908] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (4.36 seconds). [2025-10-15T17:07:48.913976] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-15T17:07:48.969958] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (3.26 seconds). [2025-10-15T17:07:48.985629] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T17:07:49.713997] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-15T17:07:49.860290] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-15T17:07:50.513983] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-15T17:07:50.551065] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:07:51.313984] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-15T17:07:51.477454] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T17:07:52.114045] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-15T17:07:52.476512] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-10-15T17:07:52.845195] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:07:52.914014] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-15T17:07:53.353553] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:07:53.714064] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-15T17:07:54.514004] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-15T17:07:54.700896] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T17:07:55.313989] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-15T17:07:55.462957] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-15T17:07:56.113997] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-15T17:07:56.914000] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-15T17:07:57.650902] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-10-15T17:07:57.713960] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-15T17:07:58.015476] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-15T17:07:58.124234] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T17:07:58.474828] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-15T17:07:58.513966] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-15T17:07:59.313985] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-15T17:07:59.374963] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T17:08:00.114067] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-15T17:08:00.262389] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-15T17:08:00.914086] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-15T17:08:01.309712] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T17:08:01.714023] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-15T17:08:02.245984] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-15T17:08:02.502247] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T17:08:02.513945] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-15T17:08:02.629445] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T17:08:03.314568] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T17:08:03.314024] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-15T17:08:04.113993] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-15T17:08:04.914022] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-15T17:08:05.671511] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-15T17:08:05.678062] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-15T17:08:05.678215] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-15T17:08:05.721561] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-15T17:08:06.090394] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-15T17:08:06.090590] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-15T17:08:06.091410] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-15T17:08:06.091565] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-15T17:08:06.093261] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53765 (keeping 200 days of data) [2025-10-15T17:08:06.238795] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T17:08:06.451907] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-10-15T17:08:06.452051] [INFO ] [MAIN ] AI: Full history saved. [2025-10-15T17:08:06.452143] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AI took 40.0s. Estimated remaining: 4h 44m 42s. Rate: 8.1 symbols/min [2025-10-15T17:08:06.516982] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-15T17:08:06.618849] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:08:06.649614] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:06.673920] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:08:06.706092] [DEBUG] [LOCAL ] AIR: Loaded 29018 existing records from primary storage. [2025-10-15T17:08:06.706379] [INFO ] [MAIN ] AIR: Loaded 29018 existing records. [2025-10-15T17:08:06.902174] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:06.902407] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-15T17:08:06.902453] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-15T17:08:06.902842] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-15T17:08:06.902901] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-15T17:08:07.264144] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:07.313983] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-15T17:08:08.123890] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T17:08:08.114263] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-15T17:08:08.805849] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T17:08:08.913996] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-15T17:08:09.400618] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T17:08:09.714071] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-15T17:08:09.774588] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:08:09.786449] [INFO ] [REMOTE ] AIG: Full fetch complete (77559 records). [2025-10-15T17:08:09.786589] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-15T17:08:10.179236] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-15T17:08:10.179315] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-15T17:08:10.180057] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-15T17:08:10.180119] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-15T17:08:10.181504] [DEBUG] [LOCAL ] AIG: Trimmed 77559 records to 53470 (keeping 200 days of data) [2025-10-15T17:08:10.510994] [DEBUG] [LOCAL ] AIG: Primary data saved (53470 records). [2025-10-15T17:08:10.511141] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-15T17:08:10.511898] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AIG took 36.4s. Estimated remaining: 4h 42m 38s. Rate: 8.1 symbols/min [2025-10-15T17:08:10.523104] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-15T17:08:10.683230] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:10.711246] [DEBUG] [LOCAL ] AIT: Loaded 26970 existing records from primary storage. [2025-10-15T17:08:10.711508] [INFO ] [MAIN ] AIT: Loaded 26970 existing records. [2025-10-15T17:08:10.890888] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:10.891115] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-15T17:08:10.891300] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-15T17:08:10.891717] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-15T17:08:10.891818] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-15T17:08:11.217033] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T17:08:11.284823] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:11.313959] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-15T17:08:11.565461] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:08:12.114076] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-15T17:08:12.610840] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T17:08:12.913968] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-15T17:08:13.155541] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:08:13.713995] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-15T17:08:14.257548] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T17:08:14.451578] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:08:14.514019] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-15T17:08:15.313999] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-15T17:08:15.772167] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:08:16.053575] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T17:08:16.055811] [INFO ] [REMOTE ] AIO: Full fetch complete (20163 records). [2025-10-15T17:08:16.055909] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-15T17:08:16.119128] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-15T17:08:16.424192] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-15T17:08:16.424274] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-15T17:08:16.424575] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-15T17:08:16.424616] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-15T17:08:16.425242] [DEBUG] [LOCAL ] AIO: Trimmed 20163 records to 13371 (keeping 200 days of data) [2025-10-15T17:08:16.504866] [DEBUG] [LOCAL ] AIO: Primary data saved (13371 records). [2025-10-15T17:08:16.505016] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-15T17:08:16.505134] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIO took 31.6s. Estimated remaining: 4h 41m 44s. Rate: 8.2 symbols/min [2025-10-15T17:08:16.672746] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:16.707337] [DEBUG] [LOCAL ] AIV: Loaded 41269 existing records from primary storage. [2025-10-15T17:08:16.707700] [INFO ] [MAIN ] AIV: Loaded 41269 existing records. [2025-10-15T17:08:16.881786] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:16.882016] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-15T17:08:16.882063] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-15T17:08:16.882748] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-15T17:08:16.882806] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-15T17:08:16.919166] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-15T17:08:17.260495] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T17:08:17.290071] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:17.713997] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-15T17:08:18.219534] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T17:08:18.514036] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-15T17:08:18.929946] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T17:08:19.314030] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-15T17:08:19.603111] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T17:08:20.113999] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-15T17:08:20.262331] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T17:08:20.266316] [INFO ] [REMOTE ] AIN: Full fetch complete (33546 records). [2025-10-15T17:08:20.266425] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-15T17:08:20.631897] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-15T17:08:20.631974] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-15T17:08:20.632366] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-15T17:08:20.632407] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-15T17:08:20.633196] [DEBUG] [LOCAL ] AIN: Trimmed 33546 records to 24434 (keeping 200 days of data) [2025-10-15T17:08:20.781254] [DEBUG] [LOCAL ] AIN: Primary data saved (24434 records). [2025-10-15T17:08:20.781397] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-15T17:08:20.781484] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIN took 40.4s. Estimated remaining: 4h 39m 52s. Rate: 8.2 symbols/min [2025-10-15T17:08:20.926234] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-15T17:08:20.960383] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:20.992422] [DEBUG] [LOCAL ] AIZ: Loaded 29563 existing records from primary storage. [2025-10-15T17:08:20.992800] [INFO ] [MAIN ] AIZ: Loaded 29563 existing records. [2025-10-15T17:08:21.111582] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:08:21.199548] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:21.199840] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-15T17:08:21.199895] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-15T17:08:21.200271] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-15T17:08:21.200329] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-15T17:08:21.552235] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:21.714000] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-15T17:08:22.083802] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:08:22.514005] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-15T17:08:23.290279] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:08:23.314038] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-15T17:08:23.817242] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T17:08:24.114078] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-15T17:08:24.475023] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:08:24.913970] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-15T17:08:25.634398] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:08:25.714003] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-15T17:08:26.153313] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T17:08:26.514000] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-15T17:08:26.991397] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:08:27.314004] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-15T17:08:27.936002] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:08:28.114036] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-15T17:08:28.630008] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:08:28.913965] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-15T17:08:29.461437] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:08:29.713987] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-15T17:08:30.370802] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:08:30.375631] [INFO ] [REMOTE ] AIR: Full fetch complete (40163 records). [2025-10-15T17:08:30.375794] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-15T17:08:30.523191] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-15T17:08:30.745550] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-15T17:08:30.745624] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-15T17:08:30.746102] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-15T17:08:30.746154] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-15T17:08:30.747036] [DEBUG] [LOCAL ] AIR: Trimmed 40163 records to 28874 (keeping 200 days of data) [2025-10-15T17:08:30.922392] [DEBUG] [LOCAL ] AIR: Primary data saved (28874 records). [2025-10-15T17:08:30.922638] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-15T17:08:30.922794] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 24.5s. Estimated remaining: 4h 41m 20s. Rate: 8.2 symbols/min [2025-10-15T17:08:31.102056] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:31.120761] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T17:08:31.131840] [DEBUG] [LOCAL ] AIZN: Loaded 4043 existing records from primary storage. [2025-10-15T17:08:31.132051] [INFO ] [MAIN ] AIZN: Loaded 4043 existing records. [2025-10-15T17:08:31.325482] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-15T17:08:31.331559] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:31.333249] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-15T17:08:31.333324] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-15T17:08:31.333499] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-15T17:08:31.333559] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-15T17:08:31.735261] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:31.737543] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T17:08:32.114038] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-15T17:08:32.859980] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:08:32.913993] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-15T17:08:33.678388] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T17:08:33.713964] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-15T17:08:34.261970] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:08:34.514058] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-15T17:08:35.201542] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T17:08:35.313959] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-15T17:08:35.825457] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:08:36.114034] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-15T17:08:36.288871] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T17:08:36.745415] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T17:08:36.914034] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-15T17:08:37.587966] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T17:08:37.713982] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-15T17:08:38.514011] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-15T17:08:39.129703] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T17:08:39.313998] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-15T17:08:40.052260] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:08:40.113965] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-15T17:08:40.395242] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:08:40.914010] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-15T17:08:41.292861] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T17:08:41.388709] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:08:41.714016] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-15T17:08:42.514008] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-15T17:08:43.023059] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:08:43.186531] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:08:43.313972] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-15T17:08:44.113971] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-15T17:08:44.195597] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T17:08:44.199678] [INFO ] [REMOTE ] AIT: Full fetch complete (39187 records). [2025-10-15T17:08:44.199788] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-15T17:08:44.587760] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-15T17:08:44.587873] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-15T17:08:44.588388] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-15T17:08:44.588434] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-15T17:08:44.589507] [DEBUG] [LOCAL ] AIT: Trimmed 39187 records to 26971 (keeping 200 days of data) [2025-10-15T17:08:44.684627] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:08:44.763806] [DEBUG] [LOCAL ] AIT: Primary data saved (26971 records). [2025-10-15T17:08:44.763956] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-15T17:08:44.764037] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIT took 34.3s. Estimated remaining: 4h 44m 46s. Rate: 8.1 symbols/min [2025-10-15T17:08:44.927539] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-15T17:08:44.931087] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:44.977558] [DEBUG] [LOCAL ] AJG: Loaded 46548 existing records from primary storage. [2025-10-15T17:08:44.977928] [INFO ] [MAIN ] AJG: Loaded 46548 existing records. [2025-10-15T17:08:45.150036] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:45.150279] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-15T17:08:45.150345] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-15T17:08:45.150745] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-15T17:08:45.150830] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-15T17:08:45.503463] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:45.714004] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-15T17:08:46.224844] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T17:08:46.513988] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-15T17:08:47.068792] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T17:08:47.314016] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-15T17:08:47.742075] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T17:08:47.879490] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-15T17:08:48.114014] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-15T17:08:48.684798] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T17:08:48.914068] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-15T17:08:49.714013] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-15T17:08:50.445323] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T17:08:50.513982] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-15T17:08:51.314064] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-15T17:08:51.550544] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:08:51.806714] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T17:08:52.022967] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T17:08:52.113970] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-15T17:08:52.914003] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-15T17:08:53.713967] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-15T17:08:53.793742] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:08:54.160360] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T17:08:54.513998] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-15T17:08:55.314043] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-15T17:08:55.355441] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:08:55.594934] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T17:08:55.598160] [INFO ] [REMOTE ] AIZ: Full fetch complete (42813 records). [2025-10-15T17:08:55.598253] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-15T17:08:55.970825] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-15T17:08:55.970925] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-15T17:08:55.971427] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-15T17:08:55.971511] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-15T17:08:55.972414] [DEBUG] [LOCAL ] AIZ: Trimmed 42813 records to 29532 (keeping 200 days of data) [2025-10-15T17:08:56.118072] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-15T17:08:56.152481] [DEBUG] [LOCAL ] AIZ: Primary data saved (29532 records). [2025-10-15T17:08:56.152578] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-15T17:08:56.152679] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIZ took 35.4s. Estimated remaining: 4h 46m 47s. Rate: 8.0 symbols/min [2025-10-15T17:08:56.317467] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:56.317669] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-15T17:08:56.317725] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-15T17:08:56.317832] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-15T17:08:56.317884] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-15T17:08:56.317950] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-15T17:08:56.317984] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-15T17:08:56.662264] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:56.756569] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:08:56.913968] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-15T17:08:57.180064] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T17:08:57.714001] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-15T17:08:58.347536] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T17:08:58.353149] [INFO ] [REMOTE ] AIV: Full fetch complete (60270 records). [2025-10-15T17:08:58.353268] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-15T17:08:58.524844] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-15T17:08:58.740071] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-15T17:08:58.740177] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-15T17:08:58.740831] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-15T17:08:58.740893] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-15T17:08:58.742256] [DEBUG] [LOCAL ] AIV: Trimmed 60270 records to 41436 (keeping 200 days of data) [2025-10-15T17:08:58.970238] [DEBUG] [LOCAL ] AIV: Primary data saved (41436 records). [2025-10-15T17:08:58.970355] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-15T17:08:58.970433] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIV took 42.5s. Estimated remaining: 4h 44m 10s. Rate: 8.1 symbols/min [2025-10-15T17:08:59.146538] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T17:08:59.176013] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:59.227252] [DEBUG] [LOCAL ] AKR: Loaded 46079 existing records from primary storage. [2025-10-15T17:08:59.227788] [INFO ] [MAIN ] AKR: Loaded 46079 existing records. [2025-10-15T17:08:59.321361] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-15T17:08:59.418265] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:59.418562] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-15T17:08:59.418615] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-15T17:08:59.419029] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-15T17:08:59.419083] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-15T17:08:59.806456] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:59.838497] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T17:08:59.994972] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:09:00.114058] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-15T17:09:00.914005] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-15T17:09:01.307274] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T17:09:01.714141] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-15T17:09:01.956149] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:09:02.316424] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:09:02.317860] [INFO ] [REMOTE ] AIZN: Full fetch complete (5903 records). [2025-10-15T17:09:02.317933] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-15T17:09:02.523954] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-15T17:09:02.713200] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-15T17:09:02.713303] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-15T17:09:02.713575] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-15T17:09:02.713719] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-15T17:09:02.714329] [DEBUG] [LOCAL ] AIZN: Trimmed 5903 records to 3961 (keeping 200 days of data) [2025-10-15T17:09:02.741677] [DEBUG] [LOCAL ] AIZN: Primary data saved (3961 records). [2025-10-15T17:09:02.741875] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-15T17:09:02.741985] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZN took 31.8s. Estimated remaining: 4h 42m 8s. Rate: 8.1 symbols/min [2025-10-15T17:09:02.926603] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:02.979998] [DEBUG] [LOCAL ] AL: Loaded 44659 existing records from primary storage. [2025-10-15T17:09:02.980438] [INFO ] [MAIN ] AL: Loaded 44659 existing records. [2025-10-15T17:09:03.095627] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T17:09:03.178751] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:03.179024] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-15T17:09:03.179076] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-15T17:09:03.179430] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-15T17:09:03.179472] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-15T17:09:03.319170] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-15T17:09:03.563034] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:03.788730] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T17:09:04.114021] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-15T17:09:04.914014] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-15T17:09:05.585436] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T17:09:05.714023] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-15T17:09:06.379270] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T17:09:06.514010] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-15T17:09:06.822035] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T17:09:07.314003] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-15T17:09:07.979742] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:09:08.114064] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-15T17:09:08.752555] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:09:08.914004] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-15T17:09:09.445130] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T17:09:09.719109] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-15T17:09:09.733803] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:09:10.514007] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-15T17:09:11.313970] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-15T17:09:11.352270] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:09:12.113992] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-15T17:09:12.330755] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:09:12.659372] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T17:09:12.913981] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-15T17:09:13.126457] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T17:09:13.329065] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T17:09:13.714013] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-15T17:09:14.514001] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-15T17:09:15.314000] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-15T17:09:15.353179] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T17:09:15.952334] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T17:09:16.114053] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-15T17:09:16.922414] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-15T17:09:16.931040] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T17:09:17.197451] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-15T17:09:17.713987] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-15T17:09:17.832400] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:09:17.964042] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-15T17:09:18.514014] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-15T17:09:19.313989] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-15T17:09:19.829812] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T17:09:20.113999] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-15T17:09:20.672216] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T17:09:20.913996] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-15T17:09:21.459494] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T17:09:21.473566] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T17:09:21.714029] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-15T17:09:22.514008] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-15T17:09:23.313978] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-15T17:09:23.466008] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T17:09:23.856739] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:09:24.114021] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-15T17:09:24.913980] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-15T17:09:25.016380] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:09:25.712092] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:09:25.721019] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-15T17:09:26.504849] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T17:09:26.519017] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-15T17:09:27.293561] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:09:27.313959] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-15T17:09:28.114010] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-15T17:09:28.181606] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:09:28.657697] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:09:28.658726] [INFO ] [REMOTE ] AKA: Full fetch complete (2606 records). [2025-10-15T17:09:28.658798] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-15T17:09:28.841023] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T17:09:28.841250] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:09:28.841365] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:09:28.841583] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-15T17:09:28.841755] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-15T17:09:28.841886] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-15T17:09:28.841953] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-15T17:09:28.842020] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 32.7s. Estimated remaining: 4h 51m 41s. Rate: 7.9 symbols/min [2025-10-15T17:09:28.918432] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-15T17:09:29.018700] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:29.046366] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T17:09:29.103010] [DEBUG] [LOCAL ] ALB: Loaded 53335 existing records from primary storage. [2025-10-15T17:09:29.103312] [INFO ] [MAIN ] ALB: Loaded 53335 existing records. [2025-10-15T17:09:29.276432] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:29.276692] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-15T17:09:29.276751] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-15T17:09:29.277208] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-15T17:09:29.277265] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-15T17:09:29.626407] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:29.713978] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-15T17:09:30.509328] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:09:30.513970] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-15T17:09:30.515427] [INFO ] [REMOTE ] AJG: Full fetch complete (69053 records). [2025-10-15T17:09:30.515520] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-15T17:09:30.901164] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-15T17:09:30.901248] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-15T17:09:30.901972] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-15T17:09:30.902035] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-15T17:09:30.903404] [DEBUG] [LOCAL ] AJG: Trimmed 69053 records to 46536 (keeping 200 days of data) [2025-10-15T17:09:31.193698] [DEBUG] [LOCAL ] AJG: Primary data saved (46536 records). [2025-10-15T17:09:31.193824] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-15T17:09:31.194553] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 46.4s. Estimated remaining: 4h 48m 52s. Rate: 7.9 symbols/min [2025-10-15T17:09:31.319078] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-15T17:09:31.369442] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:31.419087] [DEBUG] [LOCAL ] ALC: Loaded 51170 existing records from primary storage. [2025-10-15T17:09:31.419439] [INFO ] [MAIN ] ALC: Loaded 51170 existing records. [2025-10-15T17:09:31.623585] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:31.623891] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-15T17:09:31.623998] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-15T17:09:31.624274] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-15T17:09:31.624332] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-15T17:09:32.003837] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:32.034627] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-15T17:09:32.121331] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-15T17:09:32.126421] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T17:09:32.133218] [INFO ] [REMOTE ] AKR: Full fetch complete (65429 records). [2025-10-15T17:09:32.133440] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-15T17:09:32.567770] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-15T17:09:32.567927] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-15T17:09:32.568795] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-15T17:09:32.568863] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-15T17:09:32.570689] [DEBUG] [LOCAL ] AKR: Trimmed 65429 records to 46096 (keeping 200 days of data) [2025-10-15T17:09:32.874433] [DEBUG] [LOCAL ] AKR: Primary data saved (46096 records). [2025-10-15T17:09:32.874769] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-15T17:09:32.874884] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 33.9s. Estimated remaining: 4h 45m 48s. Rate: 8.0 symbols/min [2025-10-15T17:09:32.921198] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-15T17:09:33.059451] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:33.076939] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T17:09:33.083354] [INFO ] [REMOTE ] AL: Full fetch complete (63313 records). [2025-10-15T17:09:33.083551] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-15T17:09:33.333674] [DEBUG] [LOCAL ] ALE: Loaded 31799 existing records from primary storage. [2025-10-15T17:09:33.367462] [INFO ] [MAIN ] ALE: Loaded 31799 existing records. [2025-10-15T17:09:33.636760] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-15T17:09:33.656433] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-15T17:09:33.676087] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-15T17:09:33.678954] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-15T17:09:33.702332] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:33.702991] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-15T17:09:33.703208] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-15T17:09:33.703885] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-15T17:09:33.704152] [DEBUG] [LOCAL ] AL: Trimmed 63313 records to 44699 (keeping 200 days of data) [2025-10-15T17:09:33.703997] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-15T17:09:33.995075] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:09:34.019576] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-15T17:09:34.264355] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:34.430901] [DEBUG] [LOCAL ] AL: Primary data saved (44699 records). [2025-10-15T17:09:34.431187] [INFO ] [MAIN ] AL: Full history saved. [2025-10-15T17:09:34.431404] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AL took 31.7s. Estimated remaining: 4h 42m 44s. Rate: 8.1 symbols/min [2025-10-15T17:09:34.513983] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-15T17:09:34.730223] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T17:09:35.314032] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-15T17:09:35.535281] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:09:35.697103] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T17:09:36.113986] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-15T17:09:36.913994] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-15T17:09:37.224414] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T17:09:37.581836] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:09:37.714010] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-15T17:09:37.931508] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:09:38.514042] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-15T17:09:39.313998] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-15T17:09:39.412881] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:09:39.489887] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T17:09:40.114037] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-15T17:09:40.914041] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-15T17:09:41.202292] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:09:41.713997] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-15T17:09:41.848075] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T17:09:41.871106] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T17:09:42.514080] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-15T17:09:43.314032] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-15T17:09:43.630944] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T17:09:43.896927] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T17:09:44.114053] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-15T17:09:44.913972] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-15T17:09:45.111360] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T17:09:45.155860] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T17:09:45.713999] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-15T17:09:46.513981] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-15T17:09:46.897485] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T17:09:47.194282] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T17:09:47.313958] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-15T17:09:47.650394] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:09:48.114007] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-15T17:09:48.914012] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-15T17:09:49.103629] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T17:09:49.384845] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T17:09:49.714010] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-15T17:09:50.513997] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-15T17:09:50.801915] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T17:09:50.896343] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T17:09:51.314006] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-15T17:09:52.113998] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-15T17:09:52.352430] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T17:09:52.537588] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T17:09:52.914006] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-15T17:09:53.714016] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-15T17:09:54.255353] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T17:09:54.513970] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-15T17:09:54.722853] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T17:09:54.967695] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:09:54.972350] [INFO ] [REMOTE ] ALE: Full fetch complete (43808 records). [2025-10-15T17:09:54.972429] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-15T17:09:55.325737] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-15T17:09:55.379755] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-15T17:09:55.379871] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-15T17:09:55.380440] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-15T17:09:55.380488] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-15T17:09:55.381956] [DEBUG] [LOCAL ] ALE: Trimmed 43808 records to 31952 (keeping 200 days of data) [2025-10-15T17:09:55.587744] [DEBUG] [LOCAL ] ALE: Primary data saved (31952 records). [2025-10-15T17:09:55.587952] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-15T17:09:55.588057] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALE took 22.7s. Estimated remaining: 4h 49m 21s. Rate: 7.9 symbols/min [2025-10-15T17:09:56.741748] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T17:09:56.753542] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-15T17:09:57.017210] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T17:09:57.024039] [INFO ] [REMOTE ] ALC: Full fetch complete (73570 records). [2025-10-15T17:09:57.024242] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-15T17:09:57.409984] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-15T17:09:57.410078] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-15T17:09:57.410810] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-15T17:09:57.410872] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-15T17:09:57.412221] [DEBUG] [LOCAL ] ALC: Trimmed 73570 records to 51181 (keeping 200 days of data) [2025-10-15T17:09:57.706404] [DEBUG] [LOCAL ] ALC: Primary data saved (51181 records). [2025-10-15T17:09:57.706534] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-15T17:09:57.707153] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALC took 26.5s. Estimated remaining: 4h 46m 35s. Rate: 8.0 symbols/min [2025-10-15T17:09:58.933220] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T17:09:58.945331] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-15T17:10:01.333183] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-15T17:10:01.339899] [INFO ] [REMOTE ] ALB: Full fetch complete (77045 records). [2025-10-15T17:10:01.340082] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-15T17:10:01.753906] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-15T17:10:01.754006] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-15T17:10:01.754797] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-15T17:10:01.754868] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-15T17:10:01.756564] [DEBUG] [LOCAL ] ALB: Trimmed 77045 records to 53343 (keeping 200 days of data) [2025-10-15T17:10:02.104307] [DEBUG] [LOCAL ] ALB: Primary data saved (53343 records). [2025-10-15T17:10:02.104514] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-15T17:10:02.104618] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALB took 33.3s. Estimated remaining: 4h 44m 58s. Rate: 8.0 symbols/min [2025-10-15T17:10:02.756010] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.828740] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.827766] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.829723] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.830599] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-15T17:10:02.830846] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-15T17:10:02.831072] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-15T17:10:02.831119] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-15T17:10:02.831162] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-15T17:10:02.831193] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-15T17:10:02.970012] [DEBUG] [LOCAL ] ALG: Loaded 9741 existing records from primary storage. [2025-10-15T17:10:02.970264] [INFO ] [MAIN ] ALG: Loaded 9741 existing records. [2025-10-15T17:10:03.230148] [DEBUG] [LOCAL ] ALEX: Loaded 31123 existing records from primary storage. [2025-10-15T17:10:03.364607] [INFO ] [MAIN ] ALEX: Loaded 31123 existing records. [2025-10-15T17:10:03.415294] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:03.421847] [DEBUG] [LOCAL ] ALIT: Loaded 52792 existing records from primary storage. [2025-10-15T17:10:03.432951] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-15T17:10:03.456864] [INFO ] [MAIN ] ALIT: Loaded 52792 existing records. [2025-10-15T17:10:03.456937] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-15T17:10:03.488363] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-15T17:10:03.512471] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-15T17:10:03.787148] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:03.845330] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-15T17:10:04.007066] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:04.040295] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:04.065688] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-15T17:10:04.067173] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-15T17:10:04.074191] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-15T17:10:04.081143] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-15T17:10:04.100309] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-15T17:10:04.112227] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-15T17:10:04.112160] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-15T17:10:04.123118] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-15T17:10:04.249937] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:10:04.316470] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-15T17:10:04.364535] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:10:04.532221] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-15T17:10:04.594040] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:10:04.593981] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:04.604404] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-15T17:10:04.615283] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-15T17:10:04.640672] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-15T17:10:04.674864] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-15T17:10:04.751343] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-15T17:10:04.813178] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALH took 2.7s. Estimated remaining: 4h 42m 36s. Rate: 8.1 symbols/min [2025-10-15T17:10:05.090419] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:05.126347] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-15T17:10:05.131144] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:05.136189] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-15T17:10:05.210232] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:05.263001] [DEBUG] [LOCAL ] ALK: Loaded 53079 existing records from primary storage. [2025-10-15T17:10:05.263324] [INFO ] [MAIN ] ALK: Loaded 53079 existing records. [2025-10-15T17:10:05.436179] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:05.436461] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-15T17:10:05.436516] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-15T17:10:05.437052] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-15T17:10:05.437108] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-15T17:10:05.786429] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:05.786836] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-15T17:10:05.806318] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T17:10:05.809265] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-15T17:10:06.693832] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:10:06.697585] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-15T17:10:06.766565] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:10:06.773412] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-15T17:10:07.120227] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T17:10:07.131003] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-15T17:10:07.621549] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T17:10:07.632414] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-15T17:10:07.722903] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T17:10:07.725741] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-15T17:10:08.007022] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T17:10:08.013377] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-15T17:10:08.701027] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T17:10:08.705120] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-15T17:10:08.799469] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T17:10:08.823862] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-15T17:10:08.825939] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T17:10:08.913999] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-15T17:10:09.299015] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T17:10:09.369830] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T17:10:09.713977] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-15T17:10:09.954725] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T17:10:10.415025] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:10:10.513976] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-15T17:10:11.314013] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-15T17:10:11.449268] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T17:10:11.852106] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T17:10:11.869572] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T17:10:12.114018] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-15T17:10:12.913993] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-15T17:10:13.606086] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T17:10:13.713964] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-15T17:10:13.768126] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:10:14.496056] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T17:10:14.513952] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-15T17:10:15.198948] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:10:15.314013] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-15T17:10:16.114025] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-15T17:10:16.913998] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-15T17:10:17.311002] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T17:10:17.714003] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-15T17:10:17.955342] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-15T17:10:18.513968] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-15T17:10:18.769468] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T17:10:18.818146] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T17:10:19.036402] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:10:19.314001] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-15T17:10:20.114011] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-15T17:10:20.914064] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-15T17:10:20.981085] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T17:10:21.686389] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:10:21.713959] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-15T17:10:22.310372] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:10:22.495592] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T17:10:22.496997] [INFO ] [REMOTE ] ALG: Full fetch complete (15345 records). [2025-10-15T17:10:22.497068] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-15T17:10:22.519196] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-15T17:10:22.867137] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-15T17:10:22.867289] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-15T17:10:22.867863] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-15T17:10:22.867935] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-15T17:10:22.869045] [DEBUG] [LOCAL ] ALG: Trimmed 15345 records to 9756 (keeping 200 days of data) [2025-10-15T17:10:22.939859] [DEBUG] [LOCAL ] ALG: Primary data saved (9756 records). [2025-10-15T17:10:22.940103] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-15T17:10:22.940216] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALG took 20.8s. Estimated remaining: 4h 47m 28s. Rate: 8.0 symbols/min [2025-10-15T17:10:23.127107] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:23.182193] [DEBUG] [LOCAL ] ALL: Loaded 49767 existing records from primary storage. [2025-10-15T17:10:23.182707] [INFO ] [MAIN ] ALL: Loaded 49767 existing records. [2025-10-15T17:10:23.328631] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-15T17:10:23.437385] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:23.438002] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-15T17:10:23.438054] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-15T17:10:23.438615] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-15T17:10:23.438754] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-15T17:10:23.805974] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:23.823098] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T17:10:24.113993] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-15T17:10:24.914007] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-15T17:10:24.952425] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T17:10:25.161206] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T17:10:25.714012] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-15T17:10:26.514103] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-15T17:10:26.722969] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:10:27.161386] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:10:27.165613] [INFO ] [REMOTE ] ALEX: Full fetch complete (44637 records). [2025-10-15T17:10:27.165754] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-15T17:10:27.319295] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-15T17:10:27.542071] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-15T17:10:27.542155] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-15T17:10:27.542672] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-15T17:10:27.542735] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-15T17:10:27.543780] [DEBUG] [LOCAL ] ALEX: Trimmed 44637 records to 31156 (keeping 200 days of data) [2025-10-15T17:10:27.728083] [DEBUG] [LOCAL ] ALEX: Primary data saved (31156 records). [2025-10-15T17:10:27.728226] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-15T17:10:27.728311] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALEX took 25.6s. Estimated remaining: 4h 46m 4s. Rate: 8.0 symbols/min [2025-10-15T17:10:27.902360] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:27.947621] [DEBUG] [LOCAL ] ALLE: Loaded 44314 existing records from primary storage. [2025-10-15T17:10:27.948059] [INFO ] [MAIN ] ALLE: Loaded 44314 existing records. [2025-10-15T17:10:28.115518] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-15T17:10:28.156376] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:28.174165] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-15T17:10:28.174322] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-15T17:10:28.176421] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-15T17:10:28.177678] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-15T17:10:28.177569] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T17:10:28.548952] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:28.870949] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:10:28.913959] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-15T17:10:29.713978] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-15T17:10:30.025697] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T17:10:30.521118] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-15T17:10:30.525877] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:10:31.314020] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-15T17:10:31.656738] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T17:10:32.104546] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:10:32.114566] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-15T17:10:32.914021] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-15T17:10:33.148466] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T17:10:33.669871] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T17:10:33.713961] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-15T17:10:34.513972] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-15T17:10:34.700368] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T17:10:35.096729] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:10:35.103171] [INFO ] [REMOTE ] ALIT: Full fetch complete (76611 records). [2025-10-15T17:10:35.103286] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-15T17:10:35.319160] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-15T17:10:35.491153] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-15T17:10:35.491239] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-15T17:10:35.491992] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-15T17:10:35.492055] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-15T17:10:35.493544] [DEBUG] [LOCAL ] ALIT: Trimmed 76611 records to 52788 (keeping 200 days of data) [2025-10-15T17:10:35.813029] [DEBUG] [LOCAL ] ALIT: Primary data saved (52788 records). [2025-10-15T17:10:35.813197] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-15T17:10:35.813330] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 33.7s. Estimated remaining: 4h 46m 13s. Rate: 8.0 symbols/min [2025-10-15T17:10:36.009908] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:36.062563] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-15T17:10:36.062964] [INFO ] [MAIN ] ALLY: Loaded 53223 existing records. [2025-10-15T17:10:36.135279] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-15T17:10:36.257388] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:36.257833] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-15T17:10:36.257903] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-15T17:10:36.258409] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-15T17:10:36.258459] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-15T17:10:36.637926] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T17:10:36.720775] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:36.913999] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-15T17:10:37.242925] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:10:37.590453] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:10:37.713964] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-15T17:10:38.412882] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:10:38.513994] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-15T17:10:39.081367] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:10:39.314066] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-15T17:10:40.122556] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-15T17:10:40.125049] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:10:40.913967] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-15T17:10:41.029742] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T17:10:41.714004] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-15T17:10:42.176708] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:10:42.437142] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T17:10:42.514041] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-15T17:10:43.051854] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T17:10:43.314071] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-15T17:10:44.113993] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-15T17:10:44.395811] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T17:10:44.402096] [INFO ] [REMOTE ] ALK: Full fetch complete (76998 records). [2025-10-15T17:10:44.402404] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-15T17:10:44.797416] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-15T17:10:44.797609] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-15T17:10:44.798491] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-15T17:10:44.798570] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-15T17:10:44.800150] [DEBUG] [LOCAL ] ALK: Trimmed 76998 records to 53081 (keeping 200 days of data) [2025-10-15T17:10:44.914713] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-15T17:10:44.917535] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:10:45.147310] [DEBUG] [LOCAL ] ALK: Primary data saved (53081 records). [2025-10-15T17:10:45.147455] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-15T17:10:45.148049] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALK took 40.3s. Estimated remaining: 4h 46m 54s. Rate: 8.0 symbols/min [2025-10-15T17:10:45.323361] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:45.374180] [DEBUG] [LOCAL ] ALSN: Loaded 43460 existing records from primary storage. [2025-10-15T17:10:45.375064] [INFO ] [MAIN ] ALSN: Loaded 43460 existing records. [2025-10-15T17:10:45.574758] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:45.595784] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-15T17:10:45.595870] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-15T17:10:45.610870] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-15T17:10:45.610972] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-15T17:10:45.714940] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-15T17:10:45.717951] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:10:45.997920] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:46.311158] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T17:10:46.514028] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-15T17:10:47.323886] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-15T17:10:47.330549] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T17:10:48.019937] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:10:48.114073] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-15T17:10:48.913976] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-15T17:10:49.212199] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T17:10:49.306876] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T17:10:49.714062] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-15T17:10:50.448676] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:10:50.454771] [INFO ] [REMOTE ] ALL: Full fetch complete (72504 records). [2025-10-15T17:10:50.454919] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-15T17:10:50.528067] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-15T17:10:50.905306] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-15T17:10:50.905561] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-15T17:10:50.906432] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-15T17:10:50.906599] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-15T17:10:50.908243] [DEBUG] [LOCAL ] ALL: Trimmed 72504 records to 49786 (keeping 200 days of data) [2025-10-15T17:10:51.179755] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:10:51.278708] [DEBUG] [LOCAL ] ALL: Primary data saved (49786 records). [2025-10-15T17:10:51.278855] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-15T17:10:51.279457] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALL took 28.3s. Estimated remaining: 4h 46m 9s. Rate: 8.0 symbols/min [2025-10-15T17:10:51.319172] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-15T17:10:51.476016] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:51.507670] [DEBUG] [LOCAL ] ALTG: Loaded 23430 existing records from primary storage. [2025-10-15T17:10:51.507963] [INFO ] [MAIN ] ALTG: Loaded 23430 existing records. [2025-10-15T17:10:51.717804] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:51.718171] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-15T17:10:51.718229] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-15T17:10:51.718460] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-15T17:10:51.718517] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-15T17:10:52.085717] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:52.119069] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-15T17:10:52.132037] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T17:10:52.914029] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-15T17:10:53.028884] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T17:10:53.713975] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-15T17:10:53.767055] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:10:53.872707] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:10:54.513996] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-15T17:10:55.314006] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-15T17:10:55.418637] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:10:56.114047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-15T17:10:56.237689] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:10:56.578639] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:10:56.914000] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-15T17:10:57.122973] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:10:57.714006] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-15T17:10:58.513981] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-15T17:10:58.544146] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T17:10:59.268440] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T17:10:59.313957] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-15T17:10:59.443991] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:11:00.113982] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-15T17:11:00.604037] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T17:11:00.914024] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-15T17:11:01.419081] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:11:01.714026] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-15T17:11:02.429910] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:11:02.513997] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-15T17:11:02.592569] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:11:03.314051] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-15T17:11:03.952576] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T17:11:03.957601] [INFO ] [REMOTE ] ALLE: Full fetch complete (64755 records). [2025-10-15T17:11:03.957776] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-15T17:11:04.119350] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-15T17:11:04.368932] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-15T17:11:04.369025] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-15T17:11:04.369714] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-15T17:11:04.369778] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-15T17:11:04.371335] [DEBUG] [LOCAL ] ALLE: Trimmed 64755 records to 44203 (keeping 200 days of data) [2025-10-15T17:11:04.641818] [DEBUG] [LOCAL ] ALLE: Primary data saved (44203 records). [2025-10-15T17:11:04.641944] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-15T17:11:04.642021] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALLE took 36.9s. Estimated remaining: 4h 48m 35s. Rate: 7.9 symbols/min [2025-10-15T17:11:04.814809] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:04.847536] [DEBUG] [LOCAL ] ALUR: Loaded 9637 existing records from primary storage. [2025-10-15T17:11:04.847822] [INFO ] [MAIN ] ALUR: Loaded 9637 existing records. [2025-10-15T17:11:04.913969] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-15T17:11:05.043623] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:05.061020] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-15T17:11:05.065025] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-15T17:11:05.065781] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-15T17:11:05.068503] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T17:11:05.068764] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-15T17:11:05.430934] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:05.689151] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T17:11:05.713953] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-15T17:11:05.923283] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:11:06.513988] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-15T17:11:06.910898] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T17:11:07.314028] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-15T17:11:07.963986] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:11:08.113976] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-15T17:11:08.798128] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T17:11:08.913990] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-15T17:11:09.713986] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-15T17:11:09.885006] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:11:10.436257] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:11:10.513963] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-15T17:11:10.565532] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:11:11.314013] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-15T17:11:12.114013] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-15T17:11:12.401508] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T17:11:12.801044] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:11:12.806606] [INFO ] [REMOTE ] ALSN: Full fetch complete (62474 records). [2025-10-15T17:11:12.806753] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-15T17:11:12.919145] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-15T17:11:13.230863] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-15T17:11:13.231102] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-15T17:11:13.232089] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-15T17:11:13.232208] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-15T17:11:13.251007] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:11:13.257106] [DEBUG] [LOCAL ] ALSN: Trimmed 62474 records to 43474 (keeping 200 days of data) [2025-10-15T17:11:13.519511] [DEBUG] [LOCAL ] ALSN: Primary data saved (43474 records). [2025-10-15T17:11:13.519668] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-15T17:11:13.520422] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 28.4s. Estimated remaining: 4h 49m 1s. Rate: 7.9 symbols/min [2025-10-15T17:11:13.684424] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:13.713995] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-15T17:11:13.727946] [DEBUG] [LOCAL ] ALV: Loaded 42132 existing records from primary storage. [2025-10-15T17:11:13.728307] [INFO ] [MAIN ] ALV: Loaded 42132 existing records. [2025-10-15T17:11:13.946243] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:13.946490] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-15T17:11:13.946553] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-15T17:11:13.946905] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-15T17:11:13.946962] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-15T17:11:14.340399] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:14.514072] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-15T17:11:14.565622] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T17:11:15.093680] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T17:11:15.314083] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-15T17:11:16.113981] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-15T17:11:16.246254] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:11:16.271366] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T17:11:16.914021] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-15T17:11:17.714004] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-15T17:11:17.820006] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T17:11:17.951190] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T17:11:17.958268] [INFO ] [REMOTE ] ALLY: Full fetch complete (77179 records). [2025-10-15T17:11:17.958404] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-15T17:11:18.349692] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-15T17:11:18.349781] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-15T17:11:18.350578] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-15T17:11:18.350618] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-15T17:11:18.352057] [DEBUG] [LOCAL ] ALLY: Trimmed 77179 records to 53221 (keeping 200 days of data) [2025-10-15T17:11:18.526113] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-15T17:11:18.673988] [DEBUG] [LOCAL ] ALLY: Primary data saved (53221 records). [2025-10-15T17:11:18.674105] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-15T17:11:18.674184] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 42.9s. Estimated remaining: 4h 47m 50s. Rate: 7.9 symbols/min [2025-10-15T17:11:18.878066] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:18.907963] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T17:11:18.920385] [DEBUG] [LOCAL ] ALX: Loaded 6886 existing records from primary storage. [2025-10-15T17:11:18.920701] [INFO ] [MAIN ] ALX: Loaded 6886 existing records. [2025-10-15T17:11:19.133728] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:19.134073] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-15T17:11:19.134144] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-15T17:11:19.134375] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-15T17:11:19.134443] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-15T17:11:19.316012] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-15T17:11:19.660757] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:11:19.688910] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:20.114011] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-15T17:11:20.545581] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T17:11:20.785277] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T17:11:20.914063] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-15T17:11:21.714053] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-15T17:11:22.394894] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T17:11:22.513985] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-15T17:11:22.845709] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T17:11:22.848808] [INFO ] [REMOTE ] ALTG: Full fetch complete (33489 records). [2025-10-15T17:11:22.848887] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-15T17:11:23.237081] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-15T17:11:23.237182] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-15T17:11:23.237777] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-15T17:11:23.237844] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-15T17:11:23.238819] [DEBUG] [LOCAL ] ALTG: Trimmed 33489 records to 23330 (keeping 200 days of data) [2025-10-15T17:11:23.331459] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-15T17:11:23.390964] [DEBUG] [LOCAL ] ALTG: Primary data saved (23330 records). [2025-10-15T17:11:23.391129] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-15T17:11:23.391258] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALTG took 32.1s. Estimated remaining: 4h 46m 30s. Rate: 8.0 symbols/min [2025-10-15T17:11:23.618598] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:23.680614] [DEBUG] [LOCAL ] AM: Loaded 51955 existing records from primary storage. [2025-10-15T17:11:23.681172] [INFO ] [MAIN ] AM: Loaded 51955 existing records. [2025-10-15T17:11:23.852815] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T17:11:23.871598] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:23.873058] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-15T17:11:23.873217] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-15T17:11:23.873744] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-15T17:11:23.873803] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-15T17:11:24.076305] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:11:24.127336] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-15T17:11:24.330871] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:24.914016] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-15T17:11:25.275839] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T17:11:25.713997] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-15T17:11:26.513967] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-15T17:11:26.614582] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:11:27.010455] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:11:27.314039] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-15T17:11:27.557996] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:11:28.114046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-15T17:11:28.842422] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:11:28.913991] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-15T17:11:29.573226] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T17:11:29.713986] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-15T17:11:30.270570] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T17:11:30.513988] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-15T17:11:31.104633] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:11:31.255916] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:11:31.314035] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-15T17:11:32.113994] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-15T17:11:32.913983] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-15T17:11:32.923559] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T17:11:33.158417] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T17:11:33.714020] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-15T17:11:34.280630] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:11:34.514036] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-15T17:11:34.674214] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T17:11:35.313989] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-15T17:11:36.032704] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T17:11:36.113983] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-15T17:11:36.256778] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:11:36.593506] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T17:11:36.914025] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-15T17:11:37.644413] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T17:11:37.713963] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-15T17:11:38.407605] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T17:11:38.514002] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-15T17:11:39.141471] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T17:11:39.314019] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-15T17:11:39.829797] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T17:11:40.114054] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-15T17:11:40.914000] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-15T17:11:41.713980] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-15T17:11:41.805388] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:11:41.855342] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:11:42.514066] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-15T17:11:42.601868] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T17:11:42.603583] [INFO ] [REMOTE ] ALUR: Full fetch complete (19260 records). [2025-10-15T17:11:42.603693] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-15T17:11:42.990306] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-15T17:11:42.990384] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-15T17:11:42.990703] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-15T17:11:42.990764] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-15T17:11:42.991258] [DEBUG] [LOCAL ] ALUR: Trimmed 19260 records to 9544 (keeping 200 days of data) [2025-10-15T17:11:43.044175] [DEBUG] [LOCAL ] ALUR: Primary data saved (9544 records). [2025-10-15T17:11:43.044298] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-15T17:11:43.044375] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALUR took 38.4s. Estimated remaining: 4h 51m 26s. Rate: 7.8 symbols/min [2025-10-15T17:11:43.209359] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:43.245279] [DEBUG] [LOCAL ] AMBC: Loaded 36259 existing records from primary storage. [2025-10-15T17:11:43.245543] [INFO ] [MAIN ] AMBC: Loaded 36259 existing records. [2025-10-15T17:11:43.318562] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-15T17:11:43.359882] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T17:11:43.435597] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:43.435827] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-15T17:11:43.435889] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-15T17:11:43.436235] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-15T17:11:43.436295] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-15T17:11:43.775968] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:44.114002] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-15T17:11:44.914040] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-15T17:11:45.117677] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T17:11:45.402415] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T17:11:45.536600] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T17:11:45.714001] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-15T17:11:46.513988] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-15T17:11:46.564901] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:11:47.314014] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-15T17:11:47.725525] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:11:48.114024] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-15T17:11:48.816428] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:11:48.914001] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-15T17:11:49.634401] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T17:11:49.714020] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-15T17:11:50.149338] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T17:11:50.514035] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-15T17:11:51.314016] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-15T17:11:51.565973] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:11:51.978979] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:11:51.984804] [INFO ] [REMOTE ] ALV: Full fetch complete (62012 records). [2025-10-15T17:11:51.985082] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-15T17:11:52.119245] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-15T17:11:52.326254] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:11:52.339809] [INFO ] [REMOTE ] ALX: Full fetch complete (7781 records). [2025-10-15T17:11:52.345098] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-15T17:11:52.580435] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-15T17:11:52.598402] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-15T17:11:52.604416] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-15T17:11:52.609842] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-15T17:11:52.716386] [DEBUG] [LOCAL ] ALV: Trimmed 62012 records to 42121 (keeping 200 days of data) [2025-10-15T17:11:52.919922] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-15T17:11:52.930013] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-15T17:11:52.931766] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-15T17:11:52.932124] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-15T17:11:52.932204] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-15T17:11:52.939738] [DEBUG] [LOCAL ] ALX: Trimmed 7781 records to 6965 (keeping 200 days of data) [2025-10-15T17:11:53.136789] [DEBUG] [LOCAL ] ALX: Primary data saved (6965 records). [2025-10-15T17:11:53.140841] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-15T17:11:53.151811] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALX took 34.5s. Estimated remaining: 4h 52m 18s. Rate: 7.8 symbols/min [2025-10-15T17:11:53.205414] [DEBUG] [LOCAL ] ALV: Primary data saved (42121 records). [2025-10-15T17:11:53.263826] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-15T17:11:53.296273] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALV took 39.8s. Estimated remaining: 4h 49m 6s. Rate: 7.9 symbols/min [2025-10-15T17:11:53.297751] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:11:53.522545] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:53.619521] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:53.619758] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-15T17:11:53.619846] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-15T17:11:53.620053] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-15T17:11:53.620098] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-15T17:11:53.620140] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-15T17:11:53.620171] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-15T17:11:53.724059] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-15T17:11:53.915140] [DEBUG] [LOCAL ] AMBP: Loaded 44612 existing records from primary storage. [2025-10-15T17:11:53.941151] [INFO ] [MAIN ] AMBP: Loaded 44612 existing records. [2025-10-15T17:11:54.153179] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:54.231760] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:54.231960] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-15T17:11:54.232008] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-15T17:11:54.232372] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-15T17:11:54.232411] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-15T17:11:54.521217] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-15T17:11:54.609885] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:54.641458] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T17:11:54.749387] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:11:54.749752] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-15T17:11:54.749834] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:11:54.749880] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-15T17:11:54.749914] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:11:54.749951] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-15T17:11:54.750008] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-15T17:11:54.750042] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-15T17:11:54.750081] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-15T17:11:54.750128] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBQ took 1.4s. Estimated remaining: 4h 46m 29s. Rate: 7.9 symbols/min [2025-10-15T17:11:54.926553] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:54.979209] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-15T17:11:54.979551] [INFO ] [MAIN ] AMC: Loaded 53762 existing records. [2025-10-15T17:11:55.173617] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:55.174079] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-15T17:11:55.174223] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-15T17:11:55.174907] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-15T17:11:55.174969] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-15T17:11:55.316905] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-15T17:11:55.609811] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:11:55.616357] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:56.114024] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-15T17:11:56.817352] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:11:56.914052] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-15T17:11:57.714022] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-15T17:11:57.876551] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:11:58.006132] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T17:11:58.514046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-15T17:11:59.226167] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:11:59.314019] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-15T17:12:00.119751] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-15T17:12:00.136964] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:12:00.147143] [INFO ] [REMOTE ] AM: Full fetch complete (75712 records). [2025-10-15T17:12:00.147331] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-15T17:12:00.596754] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-15T17:12:00.597127] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-15T17:12:00.598143] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-15T17:12:00.598237] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-15T17:12:00.627289] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:12:00.627494] [DEBUG] [LOCAL ] AM: Trimmed 75712 records to 51939 (keeping 200 days of data) [2025-10-15T17:12:00.928405] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-15T17:12:00.973279] [DEBUG] [LOCAL ] AM: Primary data saved (51939 records). [2025-10-15T17:12:00.973479] [INFO ] [MAIN ] AM: Full history saved. [2025-10-15T17:12:00.973576] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 37.6s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-10-15T17:12:01.155354] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:01.213431] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-15T17:12:01.213957] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-15T17:12:01.418556] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:01.419197] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-15T17:12:01.419282] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-15T17:12:01.419860] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-15T17:12:01.419951] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-15T17:12:01.642364] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:12:01.714260] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-15T17:12:01.885878] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:02.084260] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T17:12:02.513979] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-15T17:12:03.314047] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-15T17:12:04.114059] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-15T17:12:04.454023] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T17:12:04.526208] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-15T17:12:04.900576] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:12:04.913961] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-15T17:12:05.377243] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T17:12:05.714043] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-15T17:12:06.259197] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:12:06.514092] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-15T17:12:07.314038] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-15T17:12:07.662812] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T17:12:07.916240] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T17:12:08.114023] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-15T17:12:08.914073] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-15T17:12:09.142672] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:12:09.714045] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-15T17:12:10.156857] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-15T17:12:10.513990] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-15T17:12:10.758568] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T17:12:10.825975] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T17:12:11.314063] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-15T17:12:12.114018] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-15T17:12:12.575540] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:12:12.899215] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-15T17:12:12.913965] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-15T17:12:13.669131] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:12:13.714121] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-15T17:12:14.514090] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-15T17:12:15.241995] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:12:15.247840] [INFO ] [REMOTE ] AMBC: Full fetch complete (51759 records). [2025-10-15T17:12:15.247984] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-15T17:12:15.314083] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-15T17:12:15.725369] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-15T17:12:15.725190] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-15T17:12:15.725544] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-15T17:12:15.726457] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-15T17:12:15.737305] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-15T17:12:15.740054] [DEBUG] [LOCAL ] AMBC: Trimmed 51759 records to 36270 (keeping 200 days of data) [2025-10-15T17:12:15.955754] [DEBUG] [LOCAL ] AMBC: Primary data saved (36270 records). [2025-10-15T17:12:15.955967] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-15T17:12:15.956072] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBC took 32.9s. Estimated remaining: 4h 48m 38s. Rate: 7.9 symbols/min [2025-10-15T17:12:16.119282] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-15T17:12:16.147370] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:16.210489] [DEBUG] [LOCAL ] AME: Loaded 48682 existing records from primary storage. [2025-10-15T17:12:16.210981] [INFO ] [MAIN ] AME: Loaded 48682 existing records. [2025-10-15T17:12:16.413359] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:16.413847] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-15T17:12:16.413922] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-15T17:12:16.414882] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-15T17:12:16.414974] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-15T17:12:16.566541] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T17:12:16.875607] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:16.915707] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-15T17:12:16.923335] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T17:12:17.714021] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-15T17:12:18.297579] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T17:12:18.512764] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-15T17:12:18.523540] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-15T17:12:19.056055] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:12:19.314033] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-15T17:12:20.113995] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-15T17:12:20.438105] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T17:12:20.914028] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-15T17:12:21.339487] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-15T17:12:21.530718] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:12:21.714018] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-15T17:12:22.428191] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T17:12:22.514002] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-15T17:12:23.180568] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T17:12:23.186308] [INFO ] [REMOTE ] AMBP: Full fetch complete (65369 records). [2025-10-15T17:12:23.186518] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-15T17:12:23.319168] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-15T17:12:23.613470] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-15T17:12:23.613600] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-15T17:12:23.614529] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-15T17:12:23.614604] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-15T17:12:23.616916] [DEBUG] [LOCAL ] AMBP: Trimmed 65369 records to 44639 (keeping 200 days of data) [2025-10-15T17:12:23.908718] [DEBUG] [LOCAL ] AMBP: Primary data saved (44639 records). [2025-10-15T17:12:23.908908] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-15T17:12:23.909050] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMBP took 30.7s. Estimated remaining: 4h 48m 38s. Rate: 7.9 symbols/min [2025-10-15T17:12:24.095156] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:24.095571] [DEBUG] [LOCAL ] AMG: No existing data file found in primary storage. [2025-10-15T17:12:24.095702] [WARN ] [MAIN ] AMG: No existing data found, performing full refresh instead. [2025-10-15T17:12:24.095830] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-15T17:12:24.095873] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-15T17:12:24.095915] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-10-15T17:12:24.095950] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-15T17:12:24.129388] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-15T17:12:24.526510] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T17:12:24.533814] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:24.914016] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-15T17:12:25.179049] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:12:25.714017] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-15T17:12:26.418775] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:12:26.487383] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:12:26.513951] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-15T17:12:27.267324] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T17:12:27.313978] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-15T17:12:28.114020] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-15T17:12:28.249158] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:12:28.836198] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:12:28.914108] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-15T17:12:29.714043] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-15T17:12:30.486053] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-15T17:12:30.513994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-15T17:12:30.665707] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T17:12:31.145634] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T17:12:31.314069] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-15T17:12:31.663791] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:12:32.114013] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-15T17:12:32.904267] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T17:12:32.914876] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-15T17:12:33.099928] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:12:33.714032] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-15T17:12:34.514050] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-15T17:12:34.746888] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T17:12:34.753721] [INFO ] [REMOTE ] AMCR: Full fetch complete (77840 records). [2025-10-15T17:12:34.753874] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-15T17:12:35.174825] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-15T17:12:35.174934] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-15T17:12:35.175788] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-15T17:12:35.175856] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-15T17:12:35.177878] [DEBUG] [LOCAL ] AMCR: Trimmed 77840 records to 53669 (keeping 200 days of data) [2025-10-15T17:12:35.354208] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-15T17:12:35.516807] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-15T17:12:35.517036] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-15T17:12:35.517637] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 34.5s. Estimated remaining: 4h 50m 3s. Rate: 7.8 symbols/min [2025-10-15T17:12:35.695412] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:35.761161] [DEBUG] [LOCAL ] AMH: Loaded 51797 existing records from primary storage. [2025-10-15T17:12:35.761572] [INFO ] [MAIN ] AMH: Loaded 51797 existing records. [2025-10-15T17:12:35.955726] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:35.956484] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-15T17:12:35.957196] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-15T17:12:35.957964] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-15T17:12:35.958033] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-15T17:12:36.261333] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T17:12:36.312706] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-15T17:12:36.367772] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-15T17:12:36.398978] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:12:36.484274] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:36.914053] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-15T17:12:37.713970] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-15T17:12:37.953938] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T17:12:38.514063] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-15T17:12:39.071263] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-15T17:12:39.078233] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-15T17:12:39.078420] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-15T17:12:39.325517] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-15T17:12:39.526383] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-15T17:12:39.526580] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-15T17:12:39.527634] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-15T17:12:39.527754] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-15T17:12:39.561881] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:12:39.559626] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53762 (keeping 200 days of data) [2025-10-15T17:12:39.901689] [DEBUG] [LOCAL ] AMC: Primary data saved (53762 records). [2025-10-15T17:12:39.901895] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-15T17:12:39.901995] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AMC took 45.2s. Estimated remaining: 4h 48m 40s. Rate: 7.9 symbols/min [2025-10-15T17:12:40.079994] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:40.123005] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-15T17:12:40.127301] [DEBUG] [LOCAL ] AMN: Loaded 41804 existing records from primary storage. [2025-10-15T17:12:40.127950] [INFO ] [MAIN ] AMN: Loaded 41804 existing records. [2025-10-15T17:12:40.324299] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:40.325184] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-15T17:12:40.352690] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-15T17:12:40.357708] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-15T17:12:40.359324] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-15T17:12:40.359079] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T17:12:40.684149] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T17:12:40.796151] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:40.914038] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-15T17:12:41.572279] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T17:12:41.714049] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-15T17:12:42.514108] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T17:12:42.514184] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-15T17:12:43.224555] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T17:12:43.314032] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-15T17:12:44.114011] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-15T17:12:44.276536] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:12:44.483860] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:12:44.913996] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-15T17:12:45.714054] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-15T17:12:45.781784] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:12:45.877845] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T17:12:46.514085] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-15T17:12:47.314009] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-15T17:12:47.382580] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T17:12:47.389477] [INFO ] [REMOTE ] AME: Full fetch complete (70065 records). [2025-10-15T17:12:47.389719] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-15T17:12:47.850977] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-15T17:12:47.851181] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-15T17:12:47.852079] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-15T17:12:47.852162] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-15T17:12:47.879382] [DEBUG] [LOCAL ] AME: Trimmed 70065 records to 48691 (keeping 200 days of data) [2025-10-15T17:12:47.879223] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T17:12:48.123163] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-15T17:12:48.226758] [DEBUG] [LOCAL ] AME: Primary data saved (48691 records). [2025-10-15T17:12:48.226965] [INFO ] [MAIN ] AME: Full history saved. [2025-10-15T17:12:48.229058] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AME took 32.3s. Estimated remaining: 4h 48m 48s. Rate: 7.9 symbols/min [2025-10-15T17:12:48.419737] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:48.459906] [DEBUG] [LOCAL ] AMP: Loaded 32028 existing records from primary storage. [2025-10-15T17:12:48.460252] [INFO ] [MAIN ] AMP: Loaded 32028 existing records. [2025-10-15T17:12:48.648717] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:48.648974] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-15T17:12:48.649042] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-15T17:12:48.649926] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-15T17:12:48.649988] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-15T17:12:48.918603] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-15T17:12:49.026439] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:49.064938] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:12:49.702373] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:12:49.714005] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-15T17:12:49.776759] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T17:12:50.514042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-15T17:12:51.105543] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:12:51.314003] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-15T17:12:51.877046] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T17:12:52.114044] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-15T17:12:52.898601] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:12:52.913961] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-15T17:12:53.107060] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T17:12:53.714045] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-15T17:12:53.980666] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T17:12:54.514106] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-15T17:12:55.134461] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T17:12:55.314080] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-15T17:12:55.950160] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:12:56.114044] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-15T17:12:56.175225] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T17:12:56.914040] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-15T17:12:57.384352] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:12:57.634427] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T17:12:57.714053] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-15T17:12:58.514047] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-15T17:12:58.899785] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T17:12:59.314017] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-15T17:13:00.044564] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:13:00.113996] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-15T17:13:00.388128] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T17:13:00.390819] [INFO ] [REMOTE ] AMG: Full fetch complete (29577 records). [2025-10-15T17:13:00.390903] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-15T17:13:00.766275] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-15T17:13:00.766381] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-15T17:13:00.766867] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-15T17:13:00.766933] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-15T17:13:00.767979] [DEBUG] [LOCAL ] AMG: Trimmed 29577 records to 20143 (keeping 200 days of data) [2025-10-15T17:13:00.900480] [DEBUG] [LOCAL ] AMG: Primary data saved (20143 records). [2025-10-15T17:13:00.900639] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-15T17:13:00.900759] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMG took 37.0s. Estimated remaining: 4h 50m 34s. Rate: 7.8 symbols/min [2025-10-15T17:13:00.921611] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-15T17:13:01.093504] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:01.156148] [DEBUG] [LOCAL ] AMPX: Loaded 52326 existing records from primary storage. [2025-10-15T17:13:01.156609] [INFO ] [MAIN ] AMPX: Loaded 52326 existing records. [2025-10-15T17:13:01.351201] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:01.351471] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-15T17:13:01.351616] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-15T17:13:01.352152] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-15T17:13:01.352214] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-15T17:13:01.748843] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:01.744811] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-15T17:13:01.785314] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:13:02.514103] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-15T17:13:02.628115] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:13:03.293108] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:13:03.314021] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-15T17:13:04.114002] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-15T17:13:04.323339] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:13:04.771310] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T17:13:04.914012] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-15T17:13:05.557808] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T17:13:05.714076] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-15T17:13:06.519206] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-15T17:13:06.540961] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T17:13:07.108757] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:13:07.314081] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-15T17:13:08.113978] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-15T17:13:08.466491] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T17:13:08.649147] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:13:08.914031] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-15T17:13:09.138319] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T17:13:09.714086] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-15T17:13:10.492012] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T17:13:10.497802] [INFO ] [REMOTE ] AMN: Full fetch complete (60390 records). [2025-10-15T17:13:10.498032] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-15T17:13:10.520467] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-15T17:13:10.922740] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-15T17:13:10.922856] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-15T17:13:10.923704] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-15T17:13:10.923820] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-15T17:13:10.925848] [DEBUG] [LOCAL ] AMN: Trimmed 60390 records to 41839 (keeping 200 days of data) [2025-10-15T17:13:11.183765] [DEBUG] [LOCAL ] AMN: Primary data saved (41839 records). [2025-10-15T17:13:11.184000] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-15T17:13:11.184220] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMN took 31.3s. Estimated remaining: 4h 51m 24s. Rate: 7.8 symbols/min [2025-10-15T17:13:11.315985] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-15T17:13:11.372783] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:11.373291] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-10-15T17:13:11.373370] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-10-15T17:13:11.373708] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-15T17:13:11.373791] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-15T17:13:11.373985] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-15T17:13:11.374059] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-15T17:13:11.573755] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T17:13:11.815376] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:12.114008] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-15T17:13:12.171299] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:13:12.766975] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:13:12.914029] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-15T17:13:12.983059] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T17:13:13.714085] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-15T17:13:14.255284] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:13:14.514044] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-15T17:13:15.314016] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-15T17:13:15.802993] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T17:13:16.057398] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:13:16.061556] [INFO ] [REMOTE ] AMP: Full fetch complete (47451 records). [2025-10-15T17:13:16.061708] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-15T17:13:16.124076] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-15T17:13:16.439082] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-15T17:13:16.439163] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-15T17:13:16.439742] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-15T17:13:16.439804] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-15T17:13:16.440795] [DEBUG] [LOCAL ] AMP: Trimmed 47451 records to 32020 (keeping 200 days of data) [2025-10-15T17:13:16.644186] [DEBUG] [LOCAL ] AMP: Primary data saved (32020 records). [2025-10-15T17:13:16.644384] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-15T17:13:16.644503] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 28.4s. Estimated remaining: 4h 50m 27s. Rate: 7.8 symbols/min [2025-10-15T17:13:16.815673] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:16.850553] [DEBUG] [LOCAL ] AMR: Loaded 28850 existing records from primary storage. [2025-10-15T17:13:16.850880] [INFO ] [MAIN ] AMR: Loaded 28850 existing records. [2025-10-15T17:13:16.919832] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-15T17:13:17.039428] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:17.040389] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-15T17:13:17.040770] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-15T17:13:17.042020] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-15T17:13:17.073473] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-15T17:13:17.125400] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T17:13:17.167978] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:13:17.517420] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:17.714003] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-15T17:13:18.514003] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-15T17:13:18.552799] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T17:13:18.657276] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T17:13:19.314049] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-15T17:13:20.114015] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-15T17:13:20.913986] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-15T17:13:21.102457] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:13:21.714013] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-15T17:13:21.789337] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (3.28 seconds). [2025-10-15T17:13:21.798372] [INFO ] [REMOTE ] AMH: Full fetch complete (75052 records). [2025-10-15T17:13:21.798709] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-15T17:13:22.256208] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-15T17:13:22.256355] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-15T17:13:22.257332] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-15T17:13:22.257406] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-15T17:13:22.259416] [DEBUG] [LOCAL ] AMH: Trimmed 75052 records to 51831 (keeping 200 days of data) [2025-10-15T17:13:22.599542] [DEBUG] [LOCAL ] AMH: Primary data saved (51831 records). [2025-10-15T17:13:22.599742] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-15T17:13:22.599854] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMH took 47.1s. Estimated remaining: 4h 49m 41s. Rate: 7.8 symbols/min [2025-10-15T17:13:22.768212] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:22.803479] [DEBUG] [LOCAL ] AMRC: Loaded 38369 existing records from primary storage. [2025-10-15T17:13:22.803790] [INFO ] [MAIN ] AMRC: Loaded 38369 existing records. [2025-10-15T17:13:23.024496] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:23.025914] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-15T17:13:23.028173] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-15T17:13:23.028060] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (3.71 seconds). [2025-10-15T17:13:23.038934] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-15T17:13:23.039597] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-15T17:13:23.054379] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-15T17:13:23.076188] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T17:13:23.328785] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-15T17:13:23.379425] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-15T17:13:23.443979] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:24.114020] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-15T17:13:24.648981] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T17:13:24.922246] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-15T17:13:24.941791] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T17:13:25.089513] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T17:13:25.714082] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-15T17:13:26.339208] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:13:26.514006] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-15T17:13:26.915175] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T17:13:27.314007] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-15T17:13:28.114011] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-15T17:13:28.439516] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T17:13:28.913988] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-15T17:13:28.948247] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T17:13:29.620455] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:13:29.714045] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-15T17:13:30.201706] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:13:30.514083] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-15T17:13:31.314050] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-15T17:13:31.996662] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:13:32.113994] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-15T17:13:32.363090] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T17:13:32.689504] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:13:32.914011] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-15T17:13:33.349512] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:13:33.714009] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-15T17:13:34.515208] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-15T17:13:34.516992] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:13:35.299440] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:13:35.313953] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-15T17:13:35.632472] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T17:13:36.114076] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-15T17:13:36.914042] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-15T17:13:37.604221] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-15T17:13:37.714035] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-15T17:13:38.200465] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T17:13:38.479025] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:13:38.514026] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-15T17:13:39.194460] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:13:39.313967] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-15T17:13:39.434216] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T17:13:40.114008] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-15T17:13:40.914022] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-15T17:13:41.431887] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T17:13:41.435701] [INFO ] [REMOTE ] AMR: Full fetch complete (40534 records). [2025-10-15T17:13:41.435807] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-15T17:13:41.718309] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-15T17:13:41.830007] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-15T17:13:41.870795] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-15T17:13:41.871544] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-15T17:13:41.872170] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-15T17:13:41.872357] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-15T17:13:41.872757] [INFO ] [REMOTE ] AMPX: Full fetch complete (75205 records). [2025-10-15T17:13:41.873122] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-15T17:13:41.873791] [DEBUG] [LOCAL ] AMR: Trimmed 40534 records to 28956 (keeping 200 days of data) [2025-10-15T17:13:42.307639] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:13:42.514114] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-15T17:13:42.516785] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-15T17:13:42.516574] [DEBUG] [LOCAL ] AMR: Primary data saved (28956 records). [2025-10-15T17:13:42.517321] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-15T17:13:42.518737] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-15T17:13:42.518680] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMR took 25.9s. Estimated remaining: 4h 53m 57s. Rate: 7.7 symbols/min [2025-10-15T17:13:42.525943] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-15T17:13:42.537461] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-15T17:13:42.638632] [DEBUG] [LOCAL ] AMPX: Trimmed 75205 records to 52338 (keeping 200 days of data) [2025-10-15T17:13:42.795009] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:42.796785] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-15T17:13:42.797765] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-15T17:13:42.798262] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-15T17:13:42.798696] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-15T17:13:42.799042] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-15T17:13:42.800894] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-15T17:13:43.249009] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:43.314043] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-15T17:13:43.396267] [DEBUG] [LOCAL ] AMPX: Primary data saved (52338 records). [2025-10-15T17:13:43.396412] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-15T17:13:43.396497] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMPX took 42.5s. Estimated remaining: 4h 51m 22s. Rate: 7.8 symbols/min [2025-10-15T17:13:43.575371] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:43.627308] [DEBUG] [LOCAL ] AMT: Loaded 52466 existing records from primary storage. [2025-10-15T17:13:43.627737] [INFO ] [MAIN ] AMT: Loaded 52466 existing records. [2025-10-15T17:13:43.807254] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:43.807479] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-15T17:13:43.807723] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-15T17:13:43.808292] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-15T17:13:43.808332] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-15T17:13:44.118731] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:13:44.130074] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-15T17:13:44.140983] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:13:44.151444] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-15T17:13:44.172555] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:13:44.177957] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-15T17:13:44.183988] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-15T17:13:44.193958] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-15T17:13:44.212506] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-15T17:13:44.215697] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMRZ took 1.7s. Estimated remaining: 4h 48m 48s. Rate: 7.8 symbols/min [2025-10-15T17:13:44.215619] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:44.274423] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-15T17:13:44.409367] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:44.431105] [DEBUG] [LOCAL ] AMTB: Loaded 20513 existing records from primary storage. [2025-10-15T17:13:44.431379] [INFO ] [MAIN ] AMTB: Loaded 20513 existing records. [2025-10-15T17:13:44.606694] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:44.606889] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-15T17:13:44.606936] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-15T17:13:44.607247] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-15T17:13:44.607309] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-15T17:13:44.942739] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-10-15T17:13:44.986261] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-15T17:13:44.992339] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:45.623230] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-10-15T17:13:45.714071] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-15T17:13:46.412814] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:13:46.514034] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-15T17:13:46.935232] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T17:13:47.314028] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-15T17:13:47.637683] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T17:13:47.815819] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (3.54 seconds). [2025-10-15T17:13:48.114058] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-15T17:13:48.641706] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:13:48.647431] [INFO ] [REMOTE ] AMPY: Full fetch complete (52861 records). [2025-10-15T17:13:48.647554] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-15T17:13:48.927248] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-15T17:13:48.958845] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:13:49.054386] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-15T17:13:49.054465] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-15T17:13:49.055048] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-15T17:13:49.055110] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-15T17:13:49.056268] [DEBUG] [LOCAL ] AMPY: Trimmed 52861 records to 39159 (keeping 200 days of data) [2025-10-15T17:13:49.270671] [DEBUG] [LOCAL ] AMPY: Primary data saved (39159 records). [2025-10-15T17:13:49.270824] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-15T17:13:49.270906] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMPY took 38.1s. Estimated remaining: 4h 47m 46s. Rate: 7.9 symbols/min [2025-10-15T17:13:49.441801] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:49.447356] [DEBUG] [LOCAL ] AMTD: Loaded 3790 existing records from primary storage. [2025-10-15T17:13:49.447497] [INFO ] [MAIN ] AMTD: Loaded 3790 existing records. [2025-10-15T17:13:49.624593] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:49.624817] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-15T17:13:49.624867] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-15T17:13:49.625011] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-15T17:13:49.625051] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-15T17:13:49.722795] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-15T17:13:49.983863] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:50.513994] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-15T17:13:50.769205] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T17:13:51.313978] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-15T17:13:51.446836] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:13:51.511086] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T17:13:51.833894] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-15T17:13:52.114062] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-15T17:13:52.914044] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-15T17:13:53.714007] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-15T17:13:54.089702] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-15T17:13:54.410965] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T17:13:54.438532] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:13:54.513957] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-15T17:13:55.314058] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-15T17:13:55.907059] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T17:13:56.003354] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:13:56.008758] [INFO ] [REMOTE ] AMRC: Full fetch complete (54124 records). [2025-10-15T17:13:56.008864] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-15T17:13:56.119130] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-15T17:13:56.396329] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-15T17:13:56.396408] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-15T17:13:56.397023] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-15T17:13:56.397085] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-15T17:13:56.398266] [DEBUG] [LOCAL ] AMRC: Trimmed 54124 records to 38459 (keeping 200 days of data) [2025-10-15T17:13:56.625924] [DEBUG] [LOCAL ] AMRC: Primary data saved (38459 records). [2025-10-15T17:13:56.626091] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-15T17:13:56.626182] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMRC took 34.0s. Estimated remaining: 4h 47m 33s. Rate: 7.9 symbols/min [2025-10-15T17:13:56.707018] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:13:56.802225] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:56.802402] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-10-15T17:13:56.802440] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-10-15T17:13:56.802558] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-15T17:13:56.802598] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-15T17:13:56.802639] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-15T17:13:56.802718] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-15T17:13:56.919121] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-15T17:13:57.175518] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:57.714060] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-15T17:13:58.514019] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-15T17:13:59.313979] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-15T17:13:59.381332] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-15T17:13:59.620594] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:13:59.655535] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T17:13:59.818038] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T17:14:00.114007] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-15T17:14:00.914003] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-15T17:14:01.714103] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-15T17:14:02.206473] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T17:14:02.385345] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-15T17:14:02.514054] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-15T17:14:03.089221] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T17:14:03.314003] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-15T17:14:04.113974] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-15T17:14:04.214046] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T17:14:04.429848] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T17:14:04.914005] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-15T17:14:05.714099] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-15T17:14:05.769345] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:14:06.480605] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T17:14:06.513960] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-15T17:14:06.738985] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T17:14:07.314026] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-15T17:14:07.966848] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:14:08.113977] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-15T17:14:08.360238] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:14:08.913974] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-15T17:14:09.714022] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-15T17:14:09.828171] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T17:14:10.314740] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T17:14:10.514006] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-15T17:14:11.187270] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T17:14:11.190228] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:14:11.314003] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-15T17:14:12.114023] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-15T17:14:12.417887] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T17:14:12.914000] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-15T17:14:13.713984] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-15T17:14:13.771914] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:14:14.513971] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-15T17:14:14.632608] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T17:14:15.189975] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-15T17:14:15.313974] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-15T17:14:15.474714] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T17:14:15.958048] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T17:14:15.959637] [INFO ] [REMOTE ] AMTD: Full fetch complete (5588 records). [2025-10-15T17:14:15.959741] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-15T17:14:16.119115] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-15T17:14:16.463432] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-15T17:14:16.463529] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-15T17:14:16.463740] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-15T17:14:16.463803] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-15T17:14:16.464459] [DEBUG] [LOCAL ] AMTD: Trimmed 5588 records to 3789 (keeping 200 days of data) [2025-10-15T17:14:16.489203] [DEBUG] [LOCAL ] AMTD: Primary data saved (3789 records). [2025-10-15T17:14:16.489361] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-15T17:14:16.489452] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMTD took 27.2s. Estimated remaining: 4h 51m 36s. Rate: 7.7 symbols/min [2025-10-15T17:14:16.726789] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:16.740917] [DEBUG] [LOCAL ] AMWL: Loaded 9471 existing records from primary storage. [2025-10-15T17:14:16.741199] [INFO ] [MAIN ] AMWL: Loaded 9471 existing records. [2025-10-15T17:14:16.919154] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-15T17:14:17.010214] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:17.010954] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-15T17:14:17.011006] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-15T17:14:17.011269] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-15T17:14:17.011345] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-15T17:14:17.418764] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:17.713963] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-15T17:14:17.982199] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:14:17.985416] [INFO ] [REMOTE ] AMTB: Full fetch complete (29594 records). [2025-10-15T17:14:17.985579] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-15T17:14:18.144669] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T17:14:18.201851] [INFO ] [REMOTE ] AMT: Full fetch complete (76190 records). [2025-10-15T17:14:18.203830] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-15T17:14:18.520224] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-15T17:14:18.703142] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-15T17:14:18.733114] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-15T17:14:18.741473] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-15T17:14:18.751755] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-15T17:14:18.752567] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T17:14:18.813002] [DEBUG] [LOCAL ] AMTB: Trimmed 29594 records to 20526 (keeping 200 days of data) [2025-10-15T17:14:18.910390] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-15T17:14:18.910832] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-15T17:14:18.936590] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-15T17:14:18.937248] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-15T17:14:18.941837] [DEBUG] [LOCAL ] AMT: Trimmed 76190 records to 52475 (keeping 200 days of data) [2025-10-15T17:14:19.082339] [DEBUG] [LOCAL ] AMTB: Primary data saved (20526 records). [2025-10-15T17:14:19.082947] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-15T17:14:19.083289] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTB took 34.9s. Estimated remaining: 4h 49m 44s. Rate: 7.8 symbols/min [2025-10-15T17:14:19.265391] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:19.323228] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-15T17:14:19.484938] [DEBUG] [LOCAL ] AMX: Loaded 49095 existing records from primary storage. [2025-10-15T17:14:19.486766] [INFO ] [MAIN ] AMX: Loaded 49095 existing records. [2025-10-15T17:14:19.685375] [DEBUG] [LOCAL ] AMT: Primary data saved (52475 records). [2025-10-15T17:14:19.685496] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-15T17:14:19.680187] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:19.685632] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMT took 36.3s. Estimated remaining: 4h 47m 13s. Rate: 7.9 symbols/min [2025-10-15T17:14:19.754767] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-15T17:14:19.784609] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-15T17:14:19.792707] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-15T17:14:19.808160] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-15T17:14:19.924592] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:20.263442] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:14:20.270242] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-15T17:14:20.262205] [DEBUG] [LOCAL ] AN: Loaded 31479 existing records from primary storage. [2025-10-15T17:14:20.267216] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:20.271308] [INFO ] [MAIN ] AN: Loaded 31479 existing records. [2025-10-15T17:14:20.461639] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:20.461858] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-15T17:14:20.461920] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-15T17:14:20.462274] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-15T17:14:20.462328] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-15T17:14:20.808785] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:20.913966] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-15T17:14:21.714020] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-15T17:14:22.153910] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (3.63 seconds). [2025-10-15T17:14:22.251548] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T17:14:22.372241] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T17:14:22.514060] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-15T17:14:23.313982] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-15T17:14:23.928728] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-15T17:14:24.113986] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-15T17:14:24.324127] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:14:24.512411] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:14:24.914000] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-15T17:14:25.462742] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:14:25.672083] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T17:14:25.713974] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-15T17:14:26.309791] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T17:14:26.513982] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-15T17:14:27.137731] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T17:14:27.313986] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-15T17:14:28.069469] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T17:14:28.113948] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-15T17:14:28.913977] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-15T17:14:28.933846] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:14:29.714017] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-15T17:14:30.184907] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:14:30.496801] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:14:30.513962] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-15T17:14:31.313983] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-15T17:14:31.368271] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T17:14:31.370722] [INFO ] [REMOTE ] AMWL: Full fetch complete (14490 records). [2025-10-15T17:14:31.370799] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-15T17:14:31.732350] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-15T17:14:31.732450] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-15T17:14:31.732795] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-15T17:14:31.732856] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-15T17:14:31.733552] [DEBUG] [LOCAL ] AMWL: Trimmed 14490 records to 9542 (keeping 200 days of data) [2025-10-15T17:14:31.788438] [DEBUG] [LOCAL ] AMWL: Primary data saved (9542 records). [2025-10-15T17:14:31.788584] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-15T17:14:31.788705] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMWL took 15.3s. Estimated remaining: 4h 48m 35s. Rate: 7.8 symbols/min [2025-10-15T17:14:31.960920] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:32.016336] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-15T17:14:32.016719] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-15T17:14:32.117488] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-15T17:14:32.197133] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:32.197395] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-15T17:14:32.197444] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-15T17:14:32.197983] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-15T17:14:32.198040] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-15T17:14:32.562901] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:32.916046] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-15T17:14:32.915872] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:14:33.708768] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:14:33.716224] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-15T17:14:34.514046] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-15T17:14:35.205364] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-15T17:14:35.313998] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-15T17:14:36.078808] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T17:14:36.113996] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-15T17:14:36.211516] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-15T17:14:36.914026] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-15T17:14:37.296764] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-15T17:14:37.507874] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:14:37.714000] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-15T17:14:38.513970] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-15T17:14:38.587174] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:14:39.177105] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T17:14:39.314013] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-15T17:14:40.114046] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-15T17:14:40.735602] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T17:14:40.882475] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-15T17:14:40.913950] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-15T17:14:41.713970] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-15T17:14:42.021930] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:14:42.514000] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-15T17:14:42.854117] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T17:14:43.313974] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-15T17:14:43.411605] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-15T17:14:44.114037] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-15T17:14:44.231473] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T17:14:44.709027] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T17:14:44.914049] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-15T17:14:45.714008] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-15T17:14:46.514023] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-15T17:14:46.900473] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-15T17:14:46.915196] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T17:14:47.245330] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T17:14:47.313956] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-15T17:14:48.114095] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-15T17:14:48.143607] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:14:48.913974] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-15T17:14:49.145766] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T17:14:49.149633] [INFO ] [REMOTE ] AN: Full fetch complete (47159 records). [2025-10-15T17:14:49.149843] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-15T17:14:49.530807] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-15T17:14:49.530893] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-15T17:14:49.531461] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-15T17:14:49.531503] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-15T17:14:49.532528] [DEBUG] [LOCAL ] AN: Trimmed 47159 records to 31439 (keeping 200 days of data) [2025-10-15T17:14:49.716842] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-15T17:14:49.725630] [DEBUG] [LOCAL ] AN: Primary data saved (31439 records). [2025-10-15T17:14:49.725747] [INFO ] [MAIN ] AN: Full history saved. [2025-10-15T17:14:49.725829] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 30.0s. Estimated remaining: 4h 51m 50s. Rate: 7.7 symbols/min [2025-10-15T17:14:49.902417] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:49.954614] [DEBUG] [LOCAL ] ANF: Loaded 52075 existing records from primary storage. [2025-10-15T17:14:49.954968] [INFO ] [MAIN ] ANF: Loaded 52075 existing records. [2025-10-15T17:14:50.155722] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:50.156004] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-15T17:14:50.156065] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-15T17:14:50.156626] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-15T17:14:50.156741] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-15T17:14:50.447257] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-15T17:14:50.487673] [INFO ] [REMOTE ] AMTM: Full fetch complete (73927 records). [2025-10-15T17:14:50.493615] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-15T17:14:50.648241] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:50.683747] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-15T17:14:51.010119] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-15T17:14:51.010290] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-15T17:14:51.011163] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-15T17:14:51.011276] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-15T17:14:51.013075] [DEBUG] [LOCAL ] AMTM: Trimmed 73927 records to 50564 (keeping 200 days of data) [2025-10-15T17:14:51.334942] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T17:14:51.349972] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-15T17:14:51.355397] [DEBUG] [LOCAL ] AMTM: Primary data saved (50564 records). [2025-10-15T17:14:51.355705] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-15T17:14:51.355814] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMTM took 54.7s. Estimated remaining: 4h 49m 42s. Rate: 7.8 symbols/min [2025-10-15T17:14:51.497239] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-15T17:14:51.571845] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:51.572039] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-15T17:14:51.572095] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-15T17:14:51.572205] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-15T17:14:51.572259] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-15T17:14:51.572325] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-15T17:14:51.572359] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-15T17:14:51.940562] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:52.114023] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-15T17:14:52.306463] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:14:52.306895] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-15T17:14:52.306984] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:14:52.307031] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-15T17:14:52.307066] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:14:52.307130] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-15T17:14:52.307197] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-15T17:14:52.307232] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-15T17:14:52.307270] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-15T17:14:52.307317] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 47m 23s. Rate: 7.8 symbols/min [2025-10-15T17:14:52.477742] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:52.498719] [DEBUG] [LOCAL ] ANRO: Loaded 19308 existing records from primary storage. [2025-10-15T17:14:52.498939] [INFO ] [MAIN ] ANRO: Loaded 19308 existing records. [2025-10-15T17:14:52.686855] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:52.687130] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-15T17:14:52.687184] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-15T17:14:52.687414] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-15T17:14:52.687453] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-15T17:14:52.918775] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-15T17:14:53.074553] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:53.106190] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T17:14:53.714158] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-15T17:14:54.164683] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (3.48 seconds). [2025-10-15T17:14:54.513999] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-15T17:14:55.007792] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T17:14:55.313970] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-15T17:14:55.428788] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-15T17:14:56.048495] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:14:56.113987] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-15T17:14:56.913974] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-15T17:14:57.016870] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T17:14:57.714011] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-15T17:14:58.466455] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:14:58.513958] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-15T17:14:58.677932] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T17:14:59.313981] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-15T17:14:59.428752] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-10-15T17:15:00.120793] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-15T17:15:00.126908] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T17:15:00.810388] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:15:00.913957] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-15T17:15:01.714019] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-15T17:15:01.811318] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:15:02.453234] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T17:15:02.514018] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-15T17:15:03.314023] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-15T17:15:03.594302] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:15:04.114010] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-15T17:15:04.586301] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-15T17:15:04.913994] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-15T17:15:04.970611] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:15:05.714016] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-15T17:15:06.234167] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T17:15:06.513992] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-15T17:15:06.937790] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T17:15:07.313986] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-15T17:15:07.425786] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-15T17:15:08.114031] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-15T17:15:08.549746] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:15:08.556566] [INFO ] [REMOTE ] AMX: Full fetch complete (70935 records). [2025-10-15T17:15:08.556850] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-15T17:15:08.915988] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-15T17:15:08.929500] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T17:15:09.040486] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-15T17:15:09.036122] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-15T17:15:09.040980] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-15T17:15:09.042028] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-15T17:15:09.041103] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-15T17:15:09.042440] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-15T17:15:09.118029] [DEBUG] [LOCAL ] AMX: Trimmed 70935 records to 49144 (keeping 200 days of data) [2025-10-15T17:15:09.702805] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-15T17:15:09.708228] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-15T17:15:09.733537] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-15T17:15:09.734298] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-15T17:15:09.742506] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-15T17:15:09.750154] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-15T17:15:09.766690] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-15T17:15:10.170427] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:15:10.307761] [DEBUG] [LOCAL ] AMX: Primary data saved (49144 records). [2025-10-15T17:15:10.313393] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-15T17:15:10.314822] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. AMX took 51.2s. Estimated remaining: 4h 50m 34s. Rate: 7.8 symbols/min [2025-10-15T17:15:10.435833] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-15T17:15:10.436023] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-15T17:15:10.436138] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANET took 38.6s. Estimated remaining: 4h 48m 1s. Rate: 7.8 symbols/min [2025-10-15T17:15:10.514003] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-15T17:15:11.409733] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T17:15:11.413922] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-15T17:15:11.753826] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T17:15:11.923847] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-15T17:15:12.114075] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-15T17:15:12.914001] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-15T17:15:13.923627] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T17:15:13.934530] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-15T17:15:13.951561] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:15:14.514011] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-15T17:15:15.721967] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T17:15:15.725456] [INFO ] [REMOTE ] ANRO: Full fetch complete (29598 records). [2025-10-15T17:15:15.725560] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-15T17:15:15.726135] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:15:15.726230] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:15:15.726273] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:15:15.726368] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-15T17:15:15.726433] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-15T17:15:15.726468] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-15T17:15:15.726683] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-15T17:15:15.726782] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANRO took 23.4s. Estimated remaining: 4h 47m 9s. Rate: 7.8 symbols/min [2025-10-15T17:15:16.452373] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-15T17:15:16.463565] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-15T17:15:18.383569] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:15:18.394663] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-15T17:15:20.638747] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-15T17:15:20.649941] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-15T17:15:22.647101] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-15T17:15:22.653502] [INFO ] [REMOTE ] ANF: Full fetch complete (75754 records). [2025-10-15T17:15:22.653617] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-15T17:15:23.061841] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-15T17:15:23.061937] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-15T17:15:23.062737] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-15T17:15:23.062803] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-15T17:15:23.064371] [DEBUG] [LOCAL ] ANF: Trimmed 75754 records to 52079 (keeping 200 days of data) [2025-10-15T17:15:23.367935] [DEBUG] [LOCAL ] ANF: Primary data saved (52079 records). [2025-10-15T17:15:23.368076] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-15T17:15:23.368159] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANF took 33.6s. Estimated remaining: 4h 47m 1s. Rate: 7.8 symbols/min [2025-10-15T17:15:23.934396] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.105252] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.117190] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.145888] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.146606] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-15T17:15:24.146690] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-15T17:15:24.146794] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-15T17:15:24.146834] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-15T17:15:24.146976] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-15T17:15:24.147020] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-15T17:15:24.264798] [DEBUG] [LOCAL ] ANVS: Loaded 23680 existing records from primary storage. [2025-10-15T17:15:24.311114] [DEBUG] [LOCAL ] AOMR: Loaded 16470 existing records from primary storage. [2025-10-15T17:15:24.311494] [INFO ] [MAIN ] ANVS: Loaded 23680 existing records. [2025-10-15T17:15:24.317194] [INFO ] [MAIN ] AOMR: Loaded 16470 existing records. [2025-10-15T17:15:24.438282] [DEBUG] [LOCAL ] AOD: Loaded 30776 existing records from primary storage. [2025-10-15T17:15:24.535549] [INFO ] [MAIN ] AOD: Loaded 30776 existing records. [2025-10-15T17:15:24.995816] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:25.066674] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:25.103415] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-15T17:15:25.111877] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:25.127810] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-15T17:15:25.149817] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:25.150418] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-15T17:15:25.127765] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-15T17:15:25.150710] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-15T17:15:25.150777] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-15T17:15:25.151212] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-15T17:15:25.151321] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-15T17:15:25.152374] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-15T17:15:25.163119] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-15T17:15:25.172510] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-15T17:15:25.181679] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-15T17:15:25.228589] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-15T17:15:25.467379] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:15:25.670231] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-15T17:15:25.779386] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:15:25.848540] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-15T17:15:25.884312] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:15:25.939174] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-15T17:15:26.044861] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-15T17:15:26.060939] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-15T17:15:26.152351] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-15T17:15:26.227095] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 2.9s. Estimated remaining: 4h 45m 24s. Rate: 7.9 symbols/min [2025-10-15T17:15:26.209033] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:26.238166] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-15T17:15:26.241609] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:26.314053] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-15T17:15:26.357932] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:26.370022] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-15T17:15:26.497638] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:26.542736] [DEBUG] [LOCAL ] AON: Loaded 45116 existing records from primary storage. [2025-10-15T17:15:26.543058] [INFO ] [MAIN ] AON: Loaded 45116 existing records. [2025-10-15T17:15:26.720189] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:26.720435] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-15T17:15:26.720484] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-15T17:15:26.720956] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-15T17:15:26.721012] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-15T17:15:27.070980] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:27.071284] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-15T17:15:27.453708] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:15:27.456768] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-15T17:15:27.759983] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:15:27.766132] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-15T17:15:27.795272] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:15:27.801634] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-15T17:15:28.390090] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T17:15:28.393253] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-15T17:15:28.573299] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:15:28.581941] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-15T17:15:28.781896] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:15:28.789022] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-15T17:15:29.375989] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T17:15:29.381822] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-15T17:15:29.778297] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T17:15:29.784035] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-15T17:15:29.828097] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T17:15:29.832084] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-15T17:15:30.230125] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T17:15:30.244388] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-15T17:15:30.913303] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:15:30.922165] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-15T17:15:31.192059] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T17:15:31.196050] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-15T17:15:31.625758] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T17:15:31.632456] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-15T17:15:31.858618] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:15:31.933302] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:15:32.035468] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T17:15:32.113986] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-15T17:15:32.816244] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T17:15:32.914067] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-15T17:15:33.714092] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-15T17:15:34.527867] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-15T17:15:34.529400] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-15T17:15:34.865911] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T17:15:35.260085] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T17:15:35.313966] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-15T17:15:35.486433] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T17:15:36.113988] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-15T17:15:36.914001] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-15T17:15:37.085017] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:15:37.348430] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T17:15:37.713965] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-15T17:15:37.755077] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T17:15:38.514054] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-15T17:15:39.313977] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-15T17:15:39.353780] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T17:15:39.489235] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T17:15:40.114021] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-15T17:15:40.625216] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:15:40.914068] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-15T17:15:41.108820] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T17:15:41.714012] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-15T17:15:42.084122] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T17:15:42.514010] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-15T17:15:42.842963] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T17:15:43.313979] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-15T17:15:44.110132] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:15:44.119409] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-15T17:15:44.913958] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-15T17:15:45.599238] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:15:45.714073] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-15T17:15:46.415722] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-15T17:15:46.519440] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-15T17:15:46.532047] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:15:46.747280] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:15:47.314003] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-15T17:15:47.879202] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T17:15:48.114001] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-15T17:15:48.913977] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-15T17:15:48.942868] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T17:15:49.423584] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T17:15:49.430873] [INFO ] [REMOTE ] AOD: Full fetch complete (44673 records). [2025-10-15T17:15:49.430992] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-15T17:15:49.720563] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-15T17:15:49.814143] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T17:15:49.829563] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-15T17:15:49.829806] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-15T17:15:49.830438] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-15T17:15:49.830519] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-15T17:15:49.831783] [DEBUG] [LOCAL ] AOD: Trimmed 44673 records to 30814 (keeping 200 days of data) [2025-10-15T17:15:50.016877] [DEBUG] [LOCAL ] AOD: Primary data saved (30814 records). [2025-10-15T17:15:50.017038] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-15T17:15:50.017128] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOD took 26.6s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-15T17:15:50.189011] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:50.222720] [DEBUG] [LOCAL ] AORT: Loaded 29205 existing records from primary storage. [2025-10-15T17:15:50.223053] [INFO ] [MAIN ] AORT: Loaded 29205 existing records. [2025-10-15T17:15:50.397954] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:50.398178] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-15T17:15:50.398225] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-15T17:15:50.398988] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-15T17:15:50.399047] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-15T17:15:50.519075] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-15T17:15:50.799404] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:50.824638] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T17:15:51.314052] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-15T17:15:51.978599] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:15:51.982935] [INFO ] [REMOTE ] ANVS: Full fetch complete (36691 records). [2025-10-15T17:15:51.983067] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-15T17:15:52.126573] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-15T17:15:52.375393] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-15T17:15:52.375469] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-15T17:15:52.376070] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-15T17:15:52.376135] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-15T17:15:52.377178] [DEBUG] [LOCAL ] ANVS: Trimmed 36691 records to 23750 (keeping 200 days of data) [2025-10-15T17:15:52.513276] [DEBUG] [LOCAL ] ANVS: Primary data saved (23750 records). [2025-10-15T17:15:52.513447] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-15T17:15:52.513542] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. ANVS took 29.1s. Estimated remaining: 4h 48m 30s. Rate: 7.8 symbols/min [2025-10-15T17:15:52.656008] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T17:15:52.708119] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:52.755050] [DEBUG] [LOCAL ] AOS: Loaded 48722 existing records from primary storage. [2025-10-15T17:15:52.755361] [INFO ] [MAIN ] AOS: Loaded 48722 existing records. [2025-10-15T17:15:52.930483] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-15T17:15:52.935530] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:52.941083] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-15T17:15:52.941804] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T17:15:52.943707] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-15T17:15:52.943810] [INFO ] [REMOTE ] AOMR: Full fetch complete (23217 records). [2025-10-15T17:15:52.943942] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-15T17:15:52.974548] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-15T17:15:52.986302] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-15T17:15:53.716616] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-15T17:15:53.751069] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:53.751771] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-15T17:15:53.752732] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-15T17:15:53.753360] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-15T17:15:53.753520] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-15T17:15:53.754804] [DEBUG] [LOCAL ] AOMR: Trimmed 23217 records to 16461 (keeping 200 days of data) [2025-10-15T17:15:53.883140] [DEBUG] [LOCAL ] AOMR: Primary data saved (16461 records). [2025-10-15T17:15:53.883315] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-15T17:15:53.883439] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOMR took 30.5s. Estimated remaining: 4h 46m 28s. Rate: 7.8 symbols/min [2025-10-15T17:15:54.086146] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:54.096216] [DEBUG] [LOCAL ] AP: Loaded 7321 existing records from primary storage. [2025-10-15T17:15:54.096487] [INFO ] [MAIN ] AP: Loaded 7321 existing records. [2025-10-15T17:15:54.256155] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T17:15:54.318678] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:54.318904] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-15T17:15:54.318953] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-15T17:15:54.319107] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-15T17:15:54.319145] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-15T17:15:54.523628] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-15T17:15:54.667669] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:55.314000] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-15T17:15:55.715994] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T17:15:56.114029] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-15T17:15:56.189631] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T17:15:56.913973] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-15T17:15:56.965681] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:15:57.713984] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-15T17:15:57.750034] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:15:57.757776] [INFO ] [REMOTE ] AON: Full fetch complete (64842 records). [2025-10-15T17:15:57.757979] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-15T17:15:58.169191] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-15T17:15:58.169387] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-15T17:15:58.170137] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-15T17:15:58.170201] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-15T17:15:58.171569] [DEBUG] [LOCAL ] AON: Trimmed 64842 records to 45133 (keeping 200 days of data) [2025-10-15T17:15:58.323550] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:15:58.490918] [DEBUG] [LOCAL ] AON: Primary data saved (45133 records). [2025-10-15T17:15:58.491050] [INFO ] [MAIN ] AON: Full history saved. [2025-10-15T17:15:58.491733] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AON took 32.2s. Estimated remaining: 4h 45m 26s. Rate: 7.9 symbols/min [2025-10-15T17:15:58.521721] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-15T17:15:58.669101] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:58.706845] [DEBUG] [LOCAL ] APAM: Loaded 36060 existing records from primary storage. [2025-10-15T17:15:58.707241] [INFO ] [MAIN ] APAM: Loaded 36060 existing records. [2025-10-15T17:15:58.889790] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:58.890037] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-15T17:15:58.890107] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-15T17:15:58.890535] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-15T17:15:58.890593] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-15T17:15:59.248414] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:59.274853] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:15:59.313952] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-15T17:15:59.943400] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:16:00.114001] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-15T17:16:00.914058] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-15T17:16:01.083957] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T17:16:01.574773] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T17:16:01.714076] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-15T17:16:01.884467] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T17:16:02.514109] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-15T17:16:03.310040] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:16:03.314383] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-15T17:16:03.926790] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T17:16:04.114029] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-15T17:16:04.819327] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T17:16:04.914012] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-15T17:16:05.714003] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-15T17:16:06.223071] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:16:06.264860] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-15T17:16:06.310874] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T17:16:06.514014] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-15T17:16:07.314025] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-15T17:16:07.899757] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:16:08.113997] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-15T17:16:08.893592] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:16:08.913992] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-15T17:16:09.532496] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:16:09.714023] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-15T17:16:10.155711] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:16:10.397452] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T17:16:10.513982] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-15T17:16:11.314013] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-15T17:16:11.851765] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T17:16:11.854830] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:16:12.114069] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-15T17:16:12.914019] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-15T17:16:13.714024] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-15T17:16:13.885308] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:16:13.932156] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T17:16:13.935805] [INFO ] [REMOTE ] AORT: Full fetch complete (42278 records). [2025-10-15T17:16:13.935897] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-15T17:16:14.306565] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:16:14.342166] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-15T17:16:14.342256] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-15T17:16:14.342901] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-15T17:16:14.342967] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-15T17:16:14.344189] [DEBUG] [LOCAL ] AORT: Trimmed 42278 records to 29190 (keeping 200 days of data) [2025-10-15T17:16:14.515226] [DEBUG] [LOCAL ] AORT: Primary data saved (29190 records). [2025-10-15T17:16:14.515518] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-15T17:16:14.515680] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AORT took 24.5s. Estimated remaining: 4h 47m 47s. Rate: 7.8 symbols/min [2025-10-15T17:16:14.514044] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-15T17:16:14.693010] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:14.737066] [DEBUG] [LOCAL ] APD: Loaded 45380 existing records from primary storage. [2025-10-15T17:16:14.737531] [INFO ] [MAIN ] APD: Loaded 45380 existing records. [2025-10-15T17:16:14.945094] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:14.945347] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-15T17:16:14.945396] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-15T17:16:14.945969] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-15T17:16:14.946026] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-15T17:16:15.290374] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:15.313959] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-15T17:16:16.113988] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-15T17:16:16.253340] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T17:16:16.779911] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T17:16:16.919119] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-15T17:16:16.937949] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:16:17.713983] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-15T17:16:18.374665] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:16:18.513964] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-15T17:16:18.687798] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:16:19.313995] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-15T17:16:20.086499] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T17:16:20.113956] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-15T17:16:20.663277] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:16:20.914007] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-15T17:16:21.713976] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-15T17:16:22.054427] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T17:16:22.396266] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T17:16:22.513980] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-15T17:16:22.916393] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T17:16:23.314017] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-15T17:16:23.952772] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:16:24.114006] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-15T17:16:24.914022] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-15T17:16:25.086301] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T17:16:25.529173] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T17:16:25.714004] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-15T17:16:25.856574] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:16:26.373796] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T17:16:26.514011] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-15T17:16:27.314007] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-15T17:16:27.992278] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T17:16:28.113988] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-15T17:16:28.914002] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-15T17:16:29.714004] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-15T17:16:29.737580] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:16:29.743730] [INFO ] [REMOTE ] AOS: Full fetch complete (70897 records). [2025-10-15T17:16:29.743853] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-15T17:16:30.131392] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-15T17:16:30.131465] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-15T17:16:30.132209] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-15T17:16:30.132279] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-15T17:16:30.133634] [DEBUG] [LOCAL ] AOS: Trimmed 70897 records to 48761 (keeping 200 days of data) [2025-10-15T17:16:30.365003] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-15T17:16:30.460103] [DEBUG] [LOCAL ] AOS: Primary data saved (48761 records). [2025-10-15T17:16:30.460256] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-15T17:16:30.462863] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AOS took 37.9s. Estimated remaining: 4h 50m 5s. Rate: 7.7 symbols/min [2025-10-15T17:16:30.521753] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-15T17:16:30.542741] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:16:30.640609] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:30.697168] [DEBUG] [LOCAL ] APG: Loaded 50586 existing records from primary storage. [2025-10-15T17:16:30.697464] [INFO ] [MAIN ] APG: Loaded 50586 existing records. [2025-10-15T17:16:30.868960] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:30.869179] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-15T17:16:30.869233] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-15T17:16:30.869890] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-15T17:16:30.869948] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-15T17:16:31.219796] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:31.313958] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-15T17:16:31.535789] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:16:31.564096] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:16:32.114004] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-15T17:16:32.811906] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:16:32.913981] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-15T17:16:33.598691] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:16:33.600451] [INFO ] [REMOTE ] AP: Full fetch complete (9062 records). [2025-10-15T17:16:33.600570] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-15T17:16:33.719224] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-15T17:16:33.978460] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-15T17:16:33.978565] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-15T17:16:33.978894] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-15T17:16:33.979114] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-15T17:16:33.994374] [DEBUG] [LOCAL ] AP: Trimmed 9062 records to 7352 (keeping 200 days of data) [2025-10-15T17:16:34.022709] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T17:16:34.059019] [DEBUG] [LOCAL ] AP: Primary data saved (7352 records). [2025-10-15T17:16:34.059173] [INFO ] [MAIN ] AP: Full history saved. [2025-10-15T17:16:34.059271] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. AP took 40.2s. Estimated remaining: 4h 48m 45s. Rate: 7.8 symbols/min [2025-10-15T17:16:34.226897] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:34.227106] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-15T17:16:34.227151] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-15T17:16:34.227283] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-15T17:16:34.227324] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-15T17:16:34.227387] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-15T17:16:34.227421] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-15T17:16:34.519215] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-15T17:16:34.593161] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:35.314009] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-15T17:16:35.425536] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:16:36.109584] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:16:36.121745] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-15T17:16:36.628537] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T17:16:36.632470] [INFO ] [REMOTE ] APAM: Full fetch complete (51797 records). [2025-10-15T17:16:36.632592] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-15T17:16:36.633326] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:16:36.633411] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:16:36.633455] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:16:36.633519] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-15T17:16:36.633584] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-15T17:16:36.633619] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-15T17:16:36.633870] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-15T17:16:36.633964] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APAM took 38.1s. Estimated remaining: 4h 47m 7s. Rate: 7.8 symbols/min [2025-10-15T17:16:36.811853] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:36.865750] [DEBUG] [LOCAL ] APLE: Loaded 51970 existing records from primary storage. [2025-10-15T17:16:36.866148] [INFO ] [MAIN ] APLE: Loaded 51970 existing records. [2025-10-15T17:16:36.922495] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-15T17:16:37.055227] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:37.055460] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-15T17:16:37.055526] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-15T17:16:37.056060] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-15T17:16:37.056116] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-15T17:16:37.405700] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:37.713989] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-15T17:16:38.120047] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T17:16:38.513994] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-15T17:16:38.704249] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T17:16:39.174597] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:16:39.313994] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-15T17:16:40.113975] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-15T17:16:40.205848] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T17:16:40.866139] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:16:40.913966] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-15T17:16:41.600782] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T17:16:41.713965] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-15T17:16:42.513973] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-15T17:16:42.809491] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T17:16:43.314094] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-15T17:16:43.494248] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T17:16:44.114006] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-15T17:16:44.160627] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:16:44.913993] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-15T17:16:45.397352] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T17:16:45.713962] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-15T17:16:46.144137] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T17:16:46.503477] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:16:46.509119] [INFO ] [REMOTE ] APD: Full fetch complete (67217 records). [2025-10-15T17:16:46.509236] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-15T17:16:46.521174] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-15T17:16:46.900124] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-15T17:16:46.900210] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-15T17:16:46.900937] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-15T17:16:46.901000] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-15T17:16:46.902403] [DEBUG] [LOCAL ] APD: Trimmed 67217 records to 45470 (keeping 200 days of data) [2025-10-15T17:16:47.203269] [DEBUG] [LOCAL ] APD: Primary data saved (45470 records). [2025-10-15T17:16:47.203439] [INFO ] [MAIN ] APD: Full history saved. [2025-10-15T17:16:47.203551] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APD took 32.7s. Estimated remaining: 4h 47m 49s. Rate: 7.8 symbols/min [2025-10-15T17:16:47.319085] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-15T17:16:47.378389] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:47.433490] [DEBUG] [LOCAL ] APO: Loaded 53390 existing records from primary storage. [2025-10-15T17:16:47.433949] [INFO ] [MAIN ] APO: Loaded 53390 existing records. [2025-10-15T17:16:47.619402] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:47.619773] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-15T17:16:47.619880] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-15T17:16:47.620463] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-15T17:16:47.620519] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-15T17:16:47.848435] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T17:16:48.042109] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:48.100162] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:16:48.113959] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-15T17:16:48.913974] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-15T17:16:49.253388] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T17:16:49.713983] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-15T17:16:49.812996] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:16:50.513968] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-15T17:16:50.892219] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T17:16:51.313973] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-15T17:16:51.514914] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T17:16:51.961811] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:16:52.113979] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-15T17:16:52.913984] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-15T17:16:52.972589] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:16:53.713998] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-15T17:16:53.787293] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T17:16:54.513984] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-15T17:16:54.735640] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:16:55.314071] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-15T17:16:55.553430] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T17:16:56.114033] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-15T17:16:56.314378] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T17:16:56.913987] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-15T17:16:57.156183] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:16:57.714032] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-15T17:16:57.945555] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:16:58.514005] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-15T17:16:58.978856] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:16:59.068540] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T17:16:59.314037] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-15T17:17:00.114001] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-15T17:17:00.149845] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:17:00.914008] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-15T17:17:01.384130] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T17:17:01.713986] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-15T17:17:01.769568] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:17:02.514026] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-15T17:17:03.150356] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T17:17:03.156155] [INFO ] [REMOTE ] APLE: Full fetch complete (74296 records). [2025-10-15T17:17:03.156296] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-15T17:17:03.157143] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:17:03.157243] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:17:03.157285] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:17:03.157354] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-15T17:17:03.157412] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-15T17:17:03.157447] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-15T17:17:03.157672] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-15T17:17:03.157767] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APLE took 26.5s. Estimated remaining: 4h 50m 2s. Rate: 7.7 symbols/min [2025-10-15T17:17:03.328104] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-15T17:17:03.330508] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:03.330691] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-15T17:17:03.330762] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-15T17:17:03.331628] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-15T17:17:03.331707] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-15T17:17:03.331760] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-15T17:17:03.331793] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-15T17:17:03.691591] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:04.113998] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-15T17:17:04.208483] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-10-15T17:17:04.571532] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:17:04.915030] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-15T17:17:04.915751] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:17:05.064068] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T17:17:05.070201] [INFO ] [REMOTE ] APG: Full fetch complete (72106 records). [2025-10-15T17:17:05.070314] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-15T17:17:05.484845] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-15T17:17:05.484948] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-15T17:17:05.485952] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-15T17:17:05.486018] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-15T17:17:05.488221] [DEBUG] [LOCAL ] APG: Trimmed 72106 records to 50584 (keeping 200 days of data) [2025-10-15T17:17:05.714149] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-15T17:17:05.793825] [DEBUG] [LOCAL ] APG: Primary data saved (50584 records). [2025-10-15T17:17:05.793963] [INFO ] [MAIN ] APG: Full history saved. [2025-10-15T17:17:05.795896] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APG took 35.3s. Estimated remaining: 4h 48m 27s. Rate: 7.8 symbols/min [2025-10-15T17:17:05.966368] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:06.026791] [DEBUG] [LOCAL ] APTV: Loaded 51980 existing records from primary storage. [2025-10-15T17:17:06.027164] [INFO ] [MAIN ] APTV: Loaded 51980 existing records. [2025-10-15T17:17:06.215012] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:06.215470] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-15T17:17:06.215541] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-15T17:17:06.215985] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-15T17:17:06.216042] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-15T17:17:06.336171] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:17:06.515545] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-15T17:17:06.600246] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:07.048209] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T17:17:07.314131] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-15T17:17:07.314055] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:17:08.114003] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-15T17:17:08.914057] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-15T17:17:09.091517] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T17:17:09.713970] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-15T17:17:10.149266] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T17:17:10.513981] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-15T17:17:11.036531] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-15T17:17:11.313972] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-15T17:17:11.532612] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T17:17:12.036251] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T17:17:12.114023] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-15T17:17:12.293781] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T17:17:12.914000] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-15T17:17:13.713982] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-15T17:17:14.049226] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T17:17:14.206736] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-15T17:17:14.513979] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-15T17:17:14.829297] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T17:17:15.313994] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-15T17:17:16.113979] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-15T17:17:16.124580] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T17:17:16.508562] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T17:17:16.914031] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-15T17:17:17.714135] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-15T17:17:17.918517] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T17:17:18.225196] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-15T17:17:18.513977] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-15T17:17:18.637860] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:17:19.314023] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-15T17:17:19.912933] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T17:17:20.113980] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-15T17:17:20.573939] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T17:17:20.914000] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-15T17:17:21.714009] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-15T17:17:21.882264] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:17:22.514023] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-15T17:17:23.177054] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-15T17:17:23.183889] [INFO ] [REMOTE ] APH: Full fetch complete (77867 records). [2025-10-15T17:17:23.184064] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-15T17:17:23.321840] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-15T17:17:23.606767] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-15T17:17:23.606899] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-15T17:17:23.607816] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-15T17:17:23.607966] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-15T17:17:23.609790] [DEBUG] [LOCAL ] APH: Trimmed 77867 records to 53691 (keeping 200 days of data) [2025-10-15T17:17:23.731104] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T17:17:23.910638] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T17:17:24.031277] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-15T17:17:24.031437] [INFO ] [MAIN ] APH: Full history saved. [2025-10-15T17:17:24.031517] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APH took 50.0s. Estimated remaining: 4h 51m 16s. Rate: 7.7 symbols/min [2025-10-15T17:17:24.116466] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-15T17:17:24.218780] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:24.219089] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-15T17:17:24.219135] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-15T17:17:24.219250] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-15T17:17:24.219295] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-15T17:17:24.219346] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-15T17:17:24.219384] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-15T17:17:24.574865] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T17:17:24.621900] [INFO ] [REMOTE ] APO: Full fetch complete (77460 records). [2025-10-15T17:17:24.642044] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:24.642318] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-15T17:17:24.919251] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-15T17:17:25.045532] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-15T17:17:25.045611] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-15T17:17:25.046422] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-15T17:17:25.046483] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-15T17:17:25.048027] [DEBUG] [LOCAL ] APO: Trimmed 77460 records to 53389 (keeping 200 days of data) [2025-10-15T17:17:25.376611] [DEBUG] [LOCAL ] APO: Primary data saved (53389 records). [2025-10-15T17:17:25.376878] [INFO ] [MAIN ] APO: Full history saved. [2025-10-15T17:17:25.376977] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 38.2s. Estimated remaining: 4h 49m 20s. Rate: 7.7 symbols/min [2025-10-15T17:17:25.542254] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:25.548332] [DEBUG] [LOCAL ] AQNB: Loaded 4087 existing records from primary storage. [2025-10-15T17:17:25.548492] [INFO ] [MAIN ] AQNB: Loaded 4087 existing records. [2025-10-15T17:17:25.720998] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:25.721198] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-15T17:17:25.722178] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-15T17:17:25.722391] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-15T17:17:25.722728] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-15T17:17:25.722787] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-15T17:17:26.078778] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:26.110009] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T17:17:26.514033] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-15T17:17:26.707165] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T17:17:26.738464] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T17:17:27.313976] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-15T17:17:28.112299] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:17:28.112112] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:17:28.116063] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-15T17:17:28.913996] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-15T17:17:29.582966] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T17:17:29.584136] [INFO ] [REMOTE ] APOS: Full fetch complete (10354 records). [2025-10-15T17:17:29.584206] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-15T17:17:29.725842] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-15T17:17:29.952458] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:17:29.992333] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-15T17:17:29.992402] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-15T17:17:29.992729] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-15T17:17:29.992791] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-15T17:17:29.993203] [DEBUG] [LOCAL ] APOS: Trimmed 10354 records to 7314 (keeping 200 days of data) [2025-10-15T17:17:30.036068] [DEBUG] [LOCAL ] APOS: Primary data saved (7314 records). [2025-10-15T17:17:30.036195] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-15T17:17:30.036268] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APOS took 26.9s. Estimated remaining: 4h 48m 21s. Rate: 7.7 symbols/min [2025-10-15T17:17:30.201537] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:30.215888] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T17:17:30.255037] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-15T17:17:30.255349] [INFO ] [MAIN ] AR: Loaded 53587 existing records. [2025-10-15T17:17:30.455611] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:30.455897] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-15T17:17:30.455955] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-15T17:17:30.456386] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-15T17:17:30.456443] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-15T17:17:30.519127] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-15T17:17:30.814280] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:31.314041] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-15T17:17:31.691503] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-15T17:17:32.077059] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:17:32.113979] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-15T17:17:32.914045] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-15T17:17:33.713966] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-15T17:17:33.897250] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T17:17:34.286406] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:17:34.513989] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-15T17:17:34.808290] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:17:35.314065] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-15T17:17:36.114026] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-15T17:17:36.288939] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T17:17:36.723034] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T17:17:36.913974] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-15T17:17:37.019486] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T17:17:37.714019] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-15T17:17:38.480701] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:17:38.513964] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-15T17:17:39.307740] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:17:39.317425] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-15T17:17:39.777166] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T17:17:40.114004] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-15T17:17:40.815024] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T17:17:40.913965] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-15T17:17:41.027549] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:17:41.357020] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T17:17:41.713993] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-15T17:17:42.514020] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-15T17:17:43.314079] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-15T17:17:43.518540] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T17:17:43.689192] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T17:17:44.113977] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-15T17:17:44.335497] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:17:44.914010] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-15T17:17:45.700366] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:17:45.713945] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-15T17:17:46.514059] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-15T17:17:46.555044] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:17:46.565432] [INFO ] [REMOTE ] APTV: Full fetch complete (75564 records). [2025-10-15T17:17:46.565570] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-15T17:17:46.566440] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:17:46.566533] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:17:46.566575] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:17:46.566615] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-15T17:17:46.566705] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-15T17:17:46.566755] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-15T17:17:46.566959] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-15T17:17:46.568353] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. APTV took 40.8s. Estimated remaining: 4h 50m 38s. Rate: 7.7 symbols/min [2025-10-15T17:17:46.732631] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:46.780753] [DEBUG] [LOCAL ] ARCO: Loaded 44536 existing records from primary storage. [2025-10-15T17:17:46.781077] [INFO ] [MAIN ] ARCO: Loaded 44536 existing records. [2025-10-15T17:17:46.958399] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:46.958820] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-15T17:17:46.958879] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-15T17:17:46.959352] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-15T17:17:46.959390] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-15T17:17:47.065795] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T17:17:47.316413] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-15T17:17:47.322447] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:47.353607] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T17:17:48.114024] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-15T17:17:48.914024] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-15T17:17:49.085565] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:17:49.713974] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-15T17:17:50.513980] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-15T17:17:50.586464] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-15T17:17:51.193240] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T17:17:51.267293] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-15T17:17:51.313955] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-15T17:17:51.400684] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:17:52.114007] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-15T17:17:52.859483] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:17:52.913969] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-15T17:17:53.289542] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T17:17:53.290493] [INFO ] [REMOTE ] AQNB: Full fetch complete (5518 records). [2025-10-15T17:17:53.290585] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-15T17:17:53.686501] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-15T17:17:53.686600] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-15T17:17:53.686905] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-15T17:17:53.687050] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-15T17:17:53.687733] [DEBUG] [LOCAL ] AQNB: Trimmed 5518 records to 4069 (keeping 200 days of data) [2025-10-15T17:17:53.712158] [DEBUG] [LOCAL ] AQNB: Primary data saved (4069 records). [2025-10-15T17:17:53.712250] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-15T17:17:53.712331] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQNB took 28.3s. Estimated remaining: 4h 50m 19s. Rate: 7.7 symbols/min [2025-10-15T17:17:53.723434] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-15T17:17:53.899700] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:17:53.929450] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:53.957292] [DEBUG] [LOCAL ] ARDC: Loaded 15257 existing records from primary storage. [2025-10-15T17:17:53.957576] [INFO ] [MAIN ] ARDC: Loaded 15257 existing records. [2025-10-15T17:17:54.128482] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:54.128724] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-15T17:17:54.128782] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-15T17:17:54.128981] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-15T17:17:54.129037] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-15T17:17:54.514873] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-15T17:17:54.514757] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:55.313981] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-15T17:17:55.409202] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:17:56.013049] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T17:17:56.020628] [INFO ] [REMOTE ] AQN: Full fetch complete (75024 records). [2025-10-15T17:17:56.020836] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-15T17:17:56.021817] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:17:56.021925] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:17:56.022011] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:17:56.022102] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-15T17:17:56.022179] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-15T17:17:56.022256] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-15T17:17:56.022372] [DEBUG] [LOCAL ] AQN: No derivative data file found to delete. [2025-10-15T17:17:56.022487] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AQN took 32.0s. Estimated remaining: 4h 48m 43s. Rate: 7.7 symbols/min [2025-10-15T17:17:56.119084] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-15T17:17:56.227220] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:56.255494] [DEBUG] [LOCAL ] ARDT: Loaded 27735 existing records from primary storage. [2025-10-15T17:17:56.255837] [INFO ] [MAIN ] ARDT: Loaded 27735 existing records. [2025-10-15T17:17:56.432122] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:56.432372] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-15T17:17:56.432421] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-15T17:17:56.432834] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-15T17:17:56.432889] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-15T17:17:56.773516] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:56.913961] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-15T17:17:57.169662] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T17:17:57.714001] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-15T17:17:57.763625] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:17:58.063517] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:17:58.514092] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-15T17:17:59.293158] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:17:59.313980] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-15T17:17:59.660874] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T17:18:00.114023] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-15T17:18:00.914005] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-15T17:18:01.210611] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:18:01.373757] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:18:01.714043] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-15T17:18:02.513971] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-15T17:18:02.771455] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T17:18:02.932113] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:18:03.313993] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-15T17:18:03.323417] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T17:18:04.114012] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-15T17:18:04.910319] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T17:18:04.919400] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-15T17:18:05.714106] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-15T17:18:05.946133] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:18:06.323777] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T17:18:06.514037] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-15T17:18:07.186967] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:18:07.314050] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-15T17:18:08.113975] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-15T17:18:08.172779] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:18:08.260315] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:18:08.266121] [INFO ] [REMOTE ] AR: Full fetch complete (77337 records). [2025-10-15T17:18:08.266237] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-15T17:18:08.267052] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:18:08.267143] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:18:08.267208] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:18:08.267322] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-15T17:18:08.267394] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-15T17:18:08.267431] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-15T17:18:08.267691] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-15T17:18:08.267786] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. AR took 38.2s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-15T17:18:08.436278] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:08.483908] [DEBUG] [LOCAL ] ARE: Loaded 50917 existing records from primary storage. [2025-10-15T17:18:08.484204] [INFO ] [MAIN ] ARE: Loaded 50917 existing records. [2025-10-15T17:18:08.660753] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:08.660993] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-15T17:18:08.661042] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-15T17:18:08.661745] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-15T17:18:08.661802] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-15T17:18:08.923214] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-15T17:18:09.011866] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:09.501318] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:18:09.714015] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-15T17:18:09.879805] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T17:18:10.514015] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-15T17:18:11.066395] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:18:11.314051] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-15T17:18:12.045945] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:18:12.113999] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-15T17:18:12.913987] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-15T17:18:13.034660] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T17:18:13.618249] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T17:18:13.680904] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:18:13.713972] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-15T17:18:14.313701] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T17:18:14.514025] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-15T17:18:15.321783] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-15T17:18:15.325493] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T17:18:16.114002] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-15T17:18:16.248015] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:18:16.914008] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-15T17:18:17.566535] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:18:17.571699] [INFO ] [REMOTE ] ARCO: Full fetch complete (65171 records). [2025-10-15T17:18:17.571796] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-15T17:18:17.719124] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-15T17:18:17.991772] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-15T17:18:17.991929] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-15T17:18:17.992773] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-15T17:18:17.992925] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-15T17:18:17.994274] [DEBUG] [LOCAL ] ARCO: Trimmed 65171 records to 44501 (keeping 200 days of data) [2025-10-15T17:18:18.135407] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:18:18.284355] [DEBUG] [LOCAL ] ARCO: Primary data saved (44501 records). [2025-10-15T17:18:18.284500] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-15T17:18:18.284580] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. ARCO took 31.7s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-15T17:18:18.450472] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:18.497418] [DEBUG] [LOCAL ] ARES: Loaded 49704 existing records from primary storage. [2025-10-15T17:18:18.497879] [INFO ] [MAIN ] ARES: Loaded 49704 existing records. [2025-10-15T17:18:18.519238] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-15T17:18:18.681682] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:18.682094] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-15T17:18:18.682157] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-15T17:18:18.683153] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-15T17:18:18.683211] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-15T17:18:18.811775] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:18:19.074466] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:19.314061] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-15T17:18:20.114017] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-15T17:18:20.215359] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T17:18:20.792284] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:18:20.833006] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:18:20.913964] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-15T17:18:21.670978] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T17:18:21.713971] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-15T17:18:22.514010] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-15T17:18:23.291943] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:18:23.313952] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-15T17:18:23.570497] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:18:23.573578] [INFO ] [REMOTE ] ARDC: Full fetch complete (21450 records). [2025-10-15T17:18:23.573693] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-15T17:18:23.940545] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-15T17:18:23.940627] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-15T17:18:23.941045] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-15T17:18:23.941095] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-15T17:18:23.941799] [DEBUG] [LOCAL ] ARDC: Trimmed 21450 records to 15318 (keeping 200 days of data) [2025-10-15T17:18:24.031476] [DEBUG] [LOCAL ] ARDC: Primary data saved (15318 records). [2025-10-15T17:18:24.031620] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-15T17:18:24.031747] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDC took 30.3s. Estimated remaining: 4h 49m 34s. Rate: 7.7 symbols/min [2025-10-15T17:18:24.123716] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-15T17:18:24.209124] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:24.246913] [DEBUG] [LOCAL ] ARI: Loaded 43778 existing records from primary storage. [2025-10-15T17:18:24.247207] [INFO ] [MAIN ] ARI: Loaded 43778 existing records. [2025-10-15T17:18:24.452166] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:24.452385] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-15T17:18:24.452436] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-15T17:18:24.453276] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-15T17:18:24.453338] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-15T17:18:24.809945] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:24.913972] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-15T17:18:24.961759] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T17:18:25.481512] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:18:25.714049] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-15T17:18:26.513966] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-15T17:18:26.626936] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T17:18:27.313975] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-15T17:18:27.419906] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T17:18:28.019102] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T17:18:28.113971] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-15T17:18:28.260885] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:18:28.914042] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-15T17:18:29.714025] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-15T17:18:29.943224] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T17:18:30.389083] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T17:18:30.513975] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-15T17:18:30.736487] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:18:31.314086] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-15T17:18:32.114034] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-15T17:18:32.365455] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T17:18:32.671484] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:18:32.675429] [INFO ] [REMOTE ] ARDT: Full fetch complete (41693 records). [2025-10-15T17:18:32.675530] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-15T17:18:32.923124] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-15T17:18:33.060047] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-15T17:18:33.060135] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-15T17:18:33.060708] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-15T17:18:33.060772] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-15T17:18:33.061899] [DEBUG] [LOCAL ] ARDT: Trimmed 41693 records to 27721 (keeping 200 days of data) [2025-10-15T17:18:33.220943] [DEBUG] [LOCAL ] ARDT: Primary data saved (27721 records). [2025-10-15T17:18:33.221081] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-15T17:18:33.221162] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARDT took 37.2s. Estimated remaining: 4h 49m 48s. Rate: 7.7 symbols/min [2025-10-15T17:18:33.388404] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:33.429321] [DEBUG] [LOCAL ] ARLO: Loaded 43765 existing records from primary storage. [2025-10-15T17:18:33.429612] [INFO ] [MAIN ] ARLO: Loaded 43765 existing records. [2025-10-15T17:18:33.632372] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:33.632617] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-15T17:18:33.632746] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-15T17:18:33.633259] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-15T17:18:33.633316] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-15T17:18:33.716689] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-15T17:18:34.013873] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:34.141143] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-15T17:18:34.513981] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-15T17:18:34.781620] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T17:18:35.236931] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:18:35.314020] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-15T17:18:35.985956] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:18:36.113996] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-15T17:18:36.732220] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T17:18:36.913981] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-15T17:18:37.496530] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:18:37.714049] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-15T17:18:38.482780] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T17:18:38.513967] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-15T17:18:39.238913] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T17:18:39.313997] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-15T17:18:39.789498] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T17:18:40.114047] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-15T17:18:40.914008] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-15T17:18:40.949176] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T17:18:41.355967] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:18:41.714042] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-15T17:18:42.263542] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:18:42.514010] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-15T17:18:43.120351] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:18:43.314026] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-15T17:18:44.103041] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:18:44.113961] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-15T17:18:44.914051] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-15T17:18:45.155735] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T17:18:45.622868] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:18:45.714020] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-15T17:18:46.513981] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-15T17:18:46.558899] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:18:47.105333] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:18:47.314004] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-15T17:18:47.870364] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:18:48.113991] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-15T17:18:48.686540] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:18:48.913994] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-15T17:18:49.684595] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T17:18:49.714004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-15T17:18:50.254987] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:18:50.514009] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-15T17:18:51.314075] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-15T17:18:51.431608] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:18:51.437877] [INFO ] [REMOTE ] ARES: Full fetch complete (70955 records). [2025-10-15T17:18:51.438084] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-15T17:18:51.438971] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:18:51.439083] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:18:51.439156] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:18:51.439261] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-15T17:18:51.439347] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-15T17:18:51.439392] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-15T17:18:51.439680] [DEBUG] [LOCAL ] ARES: Deleted derivative data file. [2025-10-15T17:18:51.440881] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARES took 33.2s. Estimated remaining: 4h 52m 22s. Rate: 7.6 symbols/min [2025-10-15T17:18:51.618340] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:51.674112] [DEBUG] [LOCAL ] ARMK: Loaded 50356 existing records from primary storage. [2025-10-15T17:18:51.683320] [INFO ] [MAIN ] ARMK: Loaded 50356 existing records. [2025-10-15T17:18:51.798763] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T17:18:51.889174] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:51.889408] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-15T17:18:51.889457] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-15T17:18:51.889949] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-15T17:18:51.890009] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-15T17:18:52.121436] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-15T17:18:52.241088] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:52.914082] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-15T17:18:53.713962] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-15T17:18:53.896281] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:18:54.308381] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-15T17:18:54.514045] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-15T17:18:55.285446] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-15T17:18:55.313949] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-15T17:18:55.623847] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-15T17:18:55.634752] [INFO ] [REMOTE ] ARE: Full fetch complete (72990 records). [2025-10-15T17:18:55.634897] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-15T17:18:56.063283] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-15T17:18:56.063387] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-15T17:18:56.064150] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-15T17:18:56.064213] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-15T17:18:56.065717] [DEBUG] [LOCAL ] ARE: Trimmed 72990 records to 50973 (keeping 200 days of data) [2025-10-15T17:18:56.120693] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-15T17:18:56.227572] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:18:56.431114] [DEBUG] [LOCAL ] ARE: Primary data saved (50973 records). [2025-10-15T17:18:56.431353] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-15T17:18:56.431903] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARE took 48.2s. Estimated remaining: 4h 51m 30s. Rate: 7.6 symbols/min [2025-10-15T17:18:56.616203] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:56.652566] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:18:56.696104] [DEBUG] [LOCAL ] AROC: Loaded 49037 existing records from primary storage. [2025-10-15T17:18:56.696488] [INFO ] [MAIN ] AROC: Loaded 49037 existing records. [2025-10-15T17:18:56.871940] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:56.872158] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-15T17:18:56.872206] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-15T17:18:56.872588] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-15T17:18:56.872626] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-15T17:18:56.925215] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-15T17:18:57.224388] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:57.714043] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-15T17:18:57.808733] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:18:58.467889] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T17:18:58.514051] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-15T17:18:58.995785] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:18:59.314031] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-15T17:19:00.056860] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:19:00.113966] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-15T17:19:00.869729] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:19:00.874986] [INFO ] [REMOTE ] ARLO: Full fetch complete (63192 records). [2025-10-15T17:19:00.875080] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-15T17:19:00.919153] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-15T17:19:01.294048] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-15T17:19:01.294141] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-15T17:19:01.294839] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-15T17:19:01.294907] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-15T17:19:01.296286] [DEBUG] [LOCAL ] ARLO: Trimmed 63192 records to 43803 (keeping 200 days of data) [2025-10-15T17:19:01.549579] [DEBUG] [LOCAL ] ARLO: Primary data saved (43803 records). [2025-10-15T17:19:01.549755] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-15T17:19:01.549843] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARLO took 28.3s. Estimated remaining: 4h 50m 40s. Rate: 7.7 symbols/min [2025-10-15T17:19:01.723268] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:01.719704] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-15T17:19:01.783697] [DEBUG] [LOCAL ] ARR: Loaded 52116 existing records from primary storage. [2025-10-15T17:19:01.784175] [INFO ] [MAIN ] ARR: Loaded 52116 existing records. [2025-10-15T17:19:01.999091] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:01.999374] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-15T17:19:01.999979] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-15T17:19:02.001319] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:19:02.011220] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-15T17:19:02.011410] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-15T17:19:02.382258] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:02.514000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-15T17:19:02.704093] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T17:19:03.259061] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:19:03.264450] [INFO ] [REMOTE ] ARI: Full fetch complete (62583 records). [2025-10-15T17:19:03.264602] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-15T17:19:03.320606] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-15T17:19:03.681726] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-15T17:19:03.681915] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-15T17:19:03.682748] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-15T17:19:03.682829] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-15T17:19:03.685000] [DEBUG] [LOCAL ] ARI: Trimmed 62583 records to 43733 (keeping 200 days of data) [2025-10-15T17:19:03.975625] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T17:19:03.990758] [DEBUG] [LOCAL ] ARI: Primary data saved (43733 records). [2025-10-15T17:19:03.991225] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-15T17:19:03.991321] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARI took 40.0s. Estimated remaining: 4h 49m 10s. Rate: 7.7 symbols/min [2025-10-15T17:19:04.126564] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-15T17:19:04.159071] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:04.190289] [DEBUG] [LOCAL ] ARW: Loaded 33043 existing records from primary storage. [2025-10-15T17:19:04.190565] [INFO ] [MAIN ] ARW: Loaded 33043 existing records. [2025-10-15T17:19:04.365987] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:04.366193] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-15T17:19:04.366241] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-15T17:19:04.366920] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-15T17:19:04.366980] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-15T17:19:04.720583] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:04.914007] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-15T17:19:04.965333] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T17:19:05.714002] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-15T17:19:06.513984] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-15T17:19:06.643070] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:19:07.065082] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-15T17:19:07.253853] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:19:07.313961] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-15T17:19:07.948206] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T17:19:08.114000] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-15T17:19:08.914044] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-15T17:19:09.013461] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:19:09.714019] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-15T17:19:09.962128] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T17:19:10.057856] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:19:10.514012] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-15T17:19:11.314039] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-15T17:19:11.403133] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T17:19:12.114057] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-15T17:19:12.328017] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T17:19:12.913993] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-15T17:19:13.269701] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T17:19:13.656488] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T17:19:13.713991] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-15T17:19:14.514029] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-15T17:19:14.729371] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:19:15.314004] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-15T17:19:15.997703] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T17:19:16.113982] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-15T17:19:16.914058] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-15T17:19:18.113208] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:19:18.124378] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-15T17:19:18.491986] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:19:18.513958] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-15T17:19:19.997557] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T17:19:20.005567] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-15T17:19:20.592263] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (6.88 seconds). [2025-10-15T17:19:20.602910] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-15T17:19:22.241053] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:19:22.251676] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-15T17:19:22.550697] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (4.43 seconds). [2025-10-15T17:19:22.561470] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-15T17:19:23.924308] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (8.61 seconds). [2025-10-15T17:19:23.934305] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-15T17:19:24.324386] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:19:24.335587] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-15T17:19:25.199914] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-15T17:19:25.210953] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-15T17:19:25.299886] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (5.29 seconds). [2025-10-15T17:19:25.306601] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-15T17:19:25.521426] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:19:25.713997] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-15T17:19:26.361265] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-15T17:19:26.513973] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-15T17:19:26.805239] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:19:26.811174] [INFO ] [REMOTE ] ARMK: Full fetch complete (72533 records). [2025-10-15T17:19:26.811299] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-15T17:19:26.812212] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:19:26.812321] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:19:26.812368] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:19:26.812422] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-15T17:19:26.812502] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-15T17:19:26.812539] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-10-15T17:19:26.812705] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-10-15T17:19:26.813638] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARMK took 35.4s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-15T17:19:27.005270] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:27.002022] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:19:27.005518] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-15T17:19:27.011606] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-15T17:19:27.012127] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-15T17:19:27.012289] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-15T17:19:27.012357] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-15T17:19:27.012396] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-15T17:19:27.319096] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-15T17:19:27.378574] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:28.113977] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-15T17:19:28.315553] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:19:28.315893] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-15T17:19:28.315991] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:19:28.316058] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-15T17:19:28.316123] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:19:28.316195] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-15T17:19:28.316295] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-15T17:19:28.316339] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-15T17:19:28.316380] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-15T17:19:28.316425] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARX took 1.5s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-10-15T17:19:28.485744] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:28.539733] [DEBUG] [LOCAL ] AS: Loaded 53174 existing records from primary storage. [2025-10-15T17:19:28.540183] [INFO ] [MAIN ] AS: Loaded 53174 existing records. [2025-10-15T17:19:28.661210] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T17:19:28.768384] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:28.768825] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-15T17:19:28.768957] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-15T17:19:28.775381] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-15T17:19:28.786153] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-15T17:19:28.819684] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:19:28.919084] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-15T17:19:29.159096] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:29.728222] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-15T17:19:29.730869] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (4.02 seconds). [2025-10-15T17:19:30.513963] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-15T17:19:30.674523] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:19:31.313998] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-15T17:19:32.065028] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-15T17:19:32.113958] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-15T17:19:32.545239] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T17:19:32.763162] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:19:32.767906] [INFO ] [REMOTE ] ARW: Full fetch complete (48373 records). [2025-10-15T17:19:32.768028] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-15T17:19:32.921874] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-15T17:19:33.161689] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-15T17:19:33.161796] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-15T17:19:33.162443] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-15T17:19:33.162485] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-15T17:19:33.163702] [DEBUG] [LOCAL ] ARW: Trimmed 48373 records to 33090 (keeping 200 days of data) [2025-10-15T17:19:33.374499] [DEBUG] [LOCAL ] ARW: Primary data saved (33090 records). [2025-10-15T17:19:33.374705] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-15T17:19:33.374818] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARW took 29.4s. Estimated remaining: 4h 50m 15s. Rate: 7.6 symbols/min [2025-10-15T17:19:33.556999] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:33.576912] [DEBUG] [LOCAL ] ASA: Loaded 15119 existing records from primary storage. [2025-10-15T17:19:33.577237] [INFO ] [MAIN ] ASA: Loaded 15119 existing records. [2025-10-15T17:19:33.722950] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-15T17:19:33.770500] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:33.771245] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-15T17:19:33.771435] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-15T17:19:33.771919] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-15T17:19:33.772055] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-15T17:19:33.911355] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:19:34.191914] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:34.514037] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-15T17:19:35.041285] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T17:19:35.049050] [INFO ] [REMOTE ] ARR: Full fetch complete (75452 records). [2025-10-15T17:19:35.049242] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-15T17:19:35.326697] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-15T17:19:35.369038] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:19:35.518877] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-15T17:19:35.518981] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-15T17:19:35.519913] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-15T17:19:35.519995] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-15T17:19:35.522006] [DEBUG] [LOCAL ] ARR: Trimmed 75452 records to 52115 (keeping 200 days of data) [2025-10-15T17:19:35.869186] [DEBUG] [LOCAL ] ARR: Primary data saved (52115 records). [2025-10-15T17:19:35.869596] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-15T17:19:35.869770] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARR took 34.3s. Estimated remaining: 4h 48m 48s. Rate: 7.7 symbols/min [2025-10-15T17:19:36.057297] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:36.057558] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-15T17:19:36.057613] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-15T17:19:36.057758] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-15T17:19:36.057824] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-15T17:19:36.057868] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-15T17:19:36.057904] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-15T17:19:36.120768] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-15T17:19:36.207890] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:19:36.306111] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T17:19:36.503518] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:36.914002] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-15T17:19:37.714055] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-15T17:19:37.954637] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:19:38.514081] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-15T17:19:39.314021] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-15T17:19:40.231587] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (3.32 seconds). [2025-10-15T17:19:40.243274] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-15T17:19:40.710905] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-15T17:19:40.759262] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-10-15T17:19:40.914025] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-15T17:19:41.728364] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-15T17:19:41.734001] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-15T17:19:41.741091] [INFO ] [REMOTE ] AROC: Full fetch complete (71189 records). [2025-10-15T17:19:41.741279] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-15T17:19:42.223638] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-15T17:19:42.223903] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-15T17:19:42.224870] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-15T17:19:42.224938] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-15T17:19:42.226820] [DEBUG] [LOCAL ] AROC: Trimmed 71189 records to 49062 (keeping 200 days of data) [2025-10-15T17:19:42.547029] [DEBUG] [LOCAL ] AROC: Primary data saved (49062 records). [2025-10-15T17:19:42.547249] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-15T17:19:42.547385] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. AROC took 46.1s. Estimated remaining: 4h 48m 24s. Rate: 7.7 symbols/min [2025-10-15T17:19:42.761769] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:42.790094] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:19:42.810006] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-15T17:19:42.812760] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T17:19:42.871911] [DEBUG] [LOCAL ] ASB: Loaded 49600 existing records from primary storage. [2025-10-15T17:19:42.872347] [INFO ] [MAIN ] ASB: Loaded 49600 existing records. [2025-10-15T17:19:43.020806] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-15T17:19:43.116158] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:43.116927] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-15T17:19:43.117009] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-15T17:19:43.117423] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-15T17:19:43.117502] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-15T17:19:43.319230] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-15T17:19:43.491686] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:43.686411] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:19:44.114020] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-15T17:19:44.914009] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-15T17:19:45.142336] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T17:19:45.185285] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T17:19:45.714058] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-15T17:19:46.513971] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-15T17:19:46.645253] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:19:46.688994] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T17:19:47.313996] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-15T17:19:48.113970] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-15T17:19:48.167583] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T17:19:48.797230] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T17:19:48.838455] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:19:48.913990] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-15T17:19:49.714013] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-15T17:19:50.514095] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-15T17:19:50.712808] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T17:19:51.036410] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T17:19:51.314081] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-15T17:19:51.776116] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T17:19:51.847032] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T17:19:52.114094] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-15T17:19:52.914043] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-15T17:19:53.682038] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:19:53.713971] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-15T17:19:54.514063] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-15T17:19:55.080821] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T17:19:55.314091] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-15T17:19:55.415809] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:19:56.099008] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:19:56.113958] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-15T17:19:56.602614] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T17:19:56.914006] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-15T17:19:57.713981] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-15T17:19:57.907955] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T17:19:58.169047] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:19:58.514011] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-15T17:19:59.281839] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T17:19:59.288535] [INFO ] [REMOTE ] AS: Full fetch complete (76862 records). [2025-10-15T17:19:59.288718] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-15T17:19:59.322116] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-15T17:19:59.679370] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-15T17:19:59.679450] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-15T17:19:59.680229] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-15T17:19:59.680292] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-15T17:19:59.681691] [DEBUG] [LOCAL ] AS: Trimmed 76862 records to 53174 (keeping 200 days of data) [2025-10-15T17:19:59.986322] [DEBUG] [LOCAL ] AS: Primary data saved (53174 records). [2025-10-15T17:19:59.986467] [INFO ] [MAIN ] AS: Full history saved. [2025-10-15T17:19:59.987548] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. AS took 31.7s. Estimated remaining: 4h 50m 36s. Rate: 7.6 symbols/min [2025-10-15T17:20:00.127205] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-15T17:20:00.158857] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:00.164780] [DEBUG] [LOCAL ] ASBA: Loaded 3448 existing records from primary storage. [2025-10-15T17:20:00.164976] [INFO ] [MAIN ] ASBA: Loaded 3448 existing records. [2025-10-15T17:20:00.347793] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:00.348831] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-15T17:20:00.348969] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-15T17:20:00.349634] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-15T17:20:00.360901] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-15T17:20:00.482585] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T17:20:00.631603] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:20:00.780399] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:00.913978] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-15T17:20:01.714067] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-15T17:20:01.770057] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T17:20:01.875133] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T17:20:02.513991] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-15T17:20:02.776926] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:20:02.780998] [INFO ] [REMOTE ] ASA: Full fetch complete (20115 records). [2025-10-15T17:20:02.781196] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-15T17:20:03.217500] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T17:20:03.219718] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-15T17:20:03.219840] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-15T17:20:03.220315] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-15T17:20:03.220367] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-15T17:20:03.221567] [DEBUG] [LOCAL ] ASA: Trimmed 20115 records to 15215 (keeping 200 days of data) [2025-10-15T17:20:03.320923] [DEBUG] [LOCAL ] ASA: Primary data saved (15215 records). [2025-10-15T17:20:03.321128] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-15T17:20:03.321484] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-15T17:20:03.322751] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASA took 29.9s. Estimated remaining: 4h 49m 23s. Rate: 7.7 symbols/min [2025-10-15T17:20:03.514966] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:03.554729] [DEBUG] [LOCAL ] ASC: Loaded 37331 existing records from primary storage. [2025-10-15T17:20:03.555087] [INFO ] [MAIN ] ASC: Loaded 37331 existing records. [2025-10-15T17:20:03.736048] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:03.736270] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-15T17:20:03.736319] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-15T17:20:03.736761] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-15T17:20:03.736819] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-15T17:20:03.840602] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:20:04.093459] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:04.113988] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-15T17:20:04.913999] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-15T17:20:05.567743] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T17:20:05.714007] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-15T17:20:06.042459] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T17:20:06.131446] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T17:20:06.514027] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-15T17:20:07.313979] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-15T17:20:08.074341] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:20:08.113985] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-15T17:20:08.913975] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-15T17:20:08.986610] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:20:09.714022] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-15T17:20:10.123418] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T17:20:10.513988] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-15T17:20:11.286902] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-15T17:20:11.313952] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-15T17:20:11.731294] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T17:20:12.114000] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-15T17:20:12.328142] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:20:12.608383] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T17:20:12.646564] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T17:20:12.913987] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-15T17:20:13.282474] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-15T17:20:13.714056] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-15T17:20:14.513999] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-15T17:20:15.313974] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-15T17:20:15.399189] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T17:20:16.009453] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T17:20:16.033069] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:20:16.113990] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-15T17:20:16.914044] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-15T17:20:17.281341] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-15T17:20:17.297590] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:20:17.714006] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-15T17:20:18.514007] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-15T17:20:19.313984] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-15T17:20:19.471689] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T17:20:20.114003] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-15T17:20:20.227201] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T17:20:20.693985] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:20:20.914002] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-15T17:20:21.480939] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T17:20:21.713969] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-15T17:20:22.092376] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T17:20:22.513990] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-15T17:20:23.090394] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T17:20:23.091832] [INFO ] [REMOTE ] ASBA: Full fetch complete (5224 records). [2025-10-15T17:20:23.091918] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-15T17:20:23.317665] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-15T17:20:23.311278] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T17:20:23.532182] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-15T17:20:23.532260] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-15T17:20:23.532411] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-15T17:20:23.532451] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-15T17:20:23.532835] [DEBUG] [LOCAL ] ASBA: Trimmed 5224 records to 3459 (keeping 200 days of data) [2025-10-15T17:20:23.554044] [DEBUG] [LOCAL ] ASBA: Primary data saved (3459 records). [2025-10-15T17:20:23.554113] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-15T17:20:23.554183] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASBA took 23.6s. Estimated remaining: 4h 52m 13s. Rate: 7.6 symbols/min [2025-10-15T17:20:23.718748] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:23.739298] [DEBUG] [LOCAL ] ASG: Loaded 19552 existing records from primary storage. [2025-10-15T17:20:23.739538] [INFO ] [MAIN ] ASG: Loaded 19552 existing records. [2025-10-15T17:20:23.913731] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:23.913927] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-15T17:20:23.913977] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-15T17:20:23.914175] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-15T17:20:23.914213] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-15T17:20:24.119146] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-15T17:20:24.264182] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:24.886712] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T17:20:24.893108] [INFO ] [REMOTE ] ASB: Full fetch complete (72061 records). [2025-10-15T17:20:24.893258] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-15T17:20:24.924846] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-15T17:20:25.308218] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-15T17:20:25.308304] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-15T17:20:25.309177] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-15T17:20:25.309242] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-15T17:20:25.310808] [DEBUG] [LOCAL ] ASB: Trimmed 72061 records to 49632 (keeping 200 days of data) [2025-10-15T17:20:25.617805] [DEBUG] [LOCAL ] ASB: Primary data saved (49632 records). [2025-10-15T17:20:25.617963] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-15T17:20:25.618052] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASB took 43.1s. Estimated remaining: 4h 50m 42s. Rate: 7.6 symbols/min [2025-10-15T17:20:25.722834] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-15T17:20:25.799882] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:25.821914] [DEBUG] [LOCAL ] ASGI: Loaded 22862 existing records from primary storage. [2025-10-15T17:20:25.822183] [INFO ] [MAIN ] ASGI: Loaded 22862 existing records. [2025-10-15T17:20:25.994104] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:25.994325] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-15T17:20:25.994372] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-15T17:20:25.994793] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-15T17:20:25.994851] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-15T17:20:26.334121] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:20:26.398494] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:26.513991] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-15T17:20:26.595621] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-15T17:20:26.602067] [INFO ] [REMOTE ] ASAN: Full fetch complete (76647 records). [2025-10-15T17:20:26.602227] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-15T17:20:26.987946] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-15T17:20:26.988038] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-15T17:20:26.988870] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-15T17:20:26.988935] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-15T17:20:26.990397] [DEBUG] [LOCAL ] ASAN: Trimmed 76647 records to 52733 (keeping 200 days of data) [2025-10-15T17:20:27.298968] [DEBUG] [LOCAL ] ASAN: Primary data saved (52733 records). [2025-10-15T17:20:27.299238] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-15T17:20:27.299386] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASAN took 51.4s. Estimated remaining: 4h 49m 6s. Rate: 7.7 symbols/min [2025-10-15T17:20:27.320487] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-15T17:20:27.483010] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:27.505389] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T17:20:27.542184] [DEBUG] [LOCAL ] ASGN: Loaded 36558 existing records from primary storage. [2025-10-15T17:20:27.542477] [INFO ] [MAIN ] ASGN: Loaded 36558 existing records. [2025-10-15T17:20:27.720039] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:27.720380] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-15T17:20:27.720463] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-15T17:20:27.721159] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-15T17:20:27.721257] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-15T17:20:27.921861] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T17:20:28.102197] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:28.113945] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-15T17:20:28.707150] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:20:28.913993] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-15T17:20:29.580398] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T17:20:29.714000] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-15T17:20:29.972062] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:20:30.514032] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-15T17:20:31.042784] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T17:20:31.314069] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-15T17:20:31.822541] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:20:32.114078] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-15T17:20:32.608178] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T17:20:32.914065] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-15T17:20:33.271337] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T17:20:33.275772] [INFO ] [REMOTE ] ASC: Full fetch complete (56216 records). [2025-10-15T17:20:33.275866] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-15T17:20:33.652456] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-15T17:20:33.652533] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-15T17:20:33.653388] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-15T17:20:33.653449] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-15T17:20:33.654516] [DEBUG] [LOCAL ] ASC: Trimmed 56216 records to 37348 (keeping 200 days of data) [2025-10-15T17:20:33.714497] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-15T17:20:33.874918] [DEBUG] [LOCAL ] ASC: Primary data saved (37348 records). [2025-10-15T17:20:33.875051] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-15T17:20:33.875129] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASC took 30.6s. Estimated remaining: 4h 48m 41s. Rate: 7.7 symbols/min [2025-10-15T17:20:33.888522] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T17:20:34.514035] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-15T17:20:35.198825] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:20:35.314045] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-15T17:20:35.734023] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:20:36.114040] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-15T17:20:36.420701] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T17:20:36.914000] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-15T17:20:37.095214] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T17:20:37.714008] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-15T17:20:38.388183] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T17:20:38.513991] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-15T17:20:38.595869] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T17:20:39.313980] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-15T17:20:39.572342] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:20:40.114010] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-15T17:20:40.718926] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T17:20:40.883436] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T17:20:40.913972] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-15T17:20:41.713977] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-15T17:20:41.822621] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T17:20:42.513974] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-15T17:20:42.543319] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T17:20:43.313980] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-15T17:20:43.488504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T17:20:44.114057] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-15T17:20:44.359970] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T17:20:44.914066] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-15T17:20:45.105621] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T17:20:45.110572] [INFO ] [REMOTE ] ASG: Full fetch complete (30993 records). [2025-10-15T17:20:45.110875] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-15T17:20:45.516329] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-15T17:20:45.516712] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-15T17:20:45.517248] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-15T17:20:45.517295] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-15T17:20:45.518256] [DEBUG] [LOCAL ] ASG: Trimmed 30993 records to 19561 (keeping 200 days of data) [2025-10-15T17:20:45.630175] [DEBUG] [LOCAL ] ASG: Primary data saved (19561 records). [2025-10-15T17:20:45.630326] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-15T17:20:45.630408] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASG took 22.1s. Estimated remaining: 4h 49m 28s. Rate: 7.6 symbols/min [2025-10-15T17:20:45.713981] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-15T17:20:46.140676] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:20:46.514044] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-15T17:20:47.289937] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:20:47.314008] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-15T17:20:47.861268] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:20:48.113991] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-15T17:20:48.800295] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:20:48.913963] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-15T17:20:49.185770] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T17:20:49.713966] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-15T17:20:50.274572] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:20:50.513984] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-15T17:20:50.624118] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T17:20:51.314045] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-15T17:20:51.967192] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T17:20:52.113996] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-15T17:20:52.525462] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T17:20:52.914065] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-15T17:20:53.340690] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T17:20:53.345547] [INFO ] [REMOTE ] ASGN: Full fetch complete (53167 records). [2025-10-15T17:20:53.345631] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-15T17:20:53.759274] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-15T17:20:53.759425] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-15T17:20:53.760234] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-15T17:20:53.760315] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-15T17:20:53.761670] [DEBUG] [LOCAL ] ASGN: Trimmed 53167 records to 36578 (keeping 200 days of data) [2025-10-15T17:20:53.988020] [DEBUG] [LOCAL ] ASGN: Primary data saved (36578 records). [2025-10-15T17:20:53.988174] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-15T17:20:53.988276] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGN took 26.7s. Estimated remaining: 4h 49m 27s. Rate: 7.6 symbols/min [2025-10-15T17:20:54.064389] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T17:20:54.067699] [INFO ] [REMOTE ] ASGI: Full fetch complete (33327 records). [2025-10-15T17:20:54.067799] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-15T17:20:54.497232] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-15T17:20:54.497335] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-15T17:20:54.497928] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-15T17:20:54.497993] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-15T17:20:54.498908] [DEBUG] [LOCAL ] ASGI: Trimmed 33327 records to 22951 (keeping 200 days of data) [2025-10-15T17:20:54.644619] [DEBUG] [LOCAL ] ASGI: Primary data saved (22951 records). [2025-10-15T17:20:54.644803] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-15T17:20:54.644996] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGI took 29.0s. Estimated remaining: 4h 47m 39s. Rate: 7.7 symbols/min [2025-10-15T17:20:55.269231] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.347160] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.346403] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.352488] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-10-15T17:20:55.375404] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-10-15T17:20:55.399355] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.399614] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-15T17:20:55.400109] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-15T17:20:55.400263] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-15T17:20:55.400314] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-15T17:20:55.512835] [DEBUG] [LOCAL ] ASR: Loaded 9384 existing records from primary storage. [2025-10-15T17:20:55.518723] [INFO ] [MAIN ] ASR: Loaded 9384 existing records. [2025-10-15T17:20:55.807684] [DEBUG] [LOCAL ] ASH: Loaded 37552 existing records from primary storage. [2025-10-15T17:20:55.879933] [INFO ] [MAIN ] ASH: Loaded 37552 existing records. [2025-10-15T17:20:55.958089] [DEBUG] [LOCAL ] ASPN: Loaded 49874 existing records from primary storage. [2025-10-15T17:20:55.952535] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:55.982253] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-15T17:20:56.008231] [INFO ] [MAIN ] ASPN: Loaded 49874 existing records. [2025-10-15T17:20:56.008411] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-15T17:20:56.158265] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-15T17:20:56.121377] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:56.158699] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-15T17:20:56.169937] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-15T17:20:56.396156] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:56.411324] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-15T17:20:56.422007] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-15T17:20:56.489112] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-15T17:20:56.554372] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-15T17:20:56.541342] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:56.658707] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-15T17:20:56.730801] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-15T17:20:56.755896] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-15T17:20:56.764730] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-15T17:20:57.117742] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:57.132143] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-15T17:20:57.467356] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:57.492236] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-15T17:20:57.510487] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T17:20:57.572213] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-15T17:20:57.577163] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:57.577485] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-15T17:20:57.816342] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T17:20:57.818391] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-15T17:20:58.612127] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:20:58.616483] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-15T17:20:58.622371] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:20:58.991986] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:20:59.314005] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-15T17:20:59.478360] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T17:20:59.567448] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T17:21:00.044234] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T17:21:00.114014] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-15T17:21:00.913975] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-15T17:21:01.292049] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T17:21:01.713995] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-15T17:21:02.429422] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:21:02.514003] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-15T17:21:03.314064] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-15T17:21:03.345800] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T17:21:03.800498] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-15T17:21:03.823344] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:21:04.114000] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-15T17:21:04.914050] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-15T17:21:05.621127] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:21:05.714008] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-15T17:21:05.829234] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T17:21:06.481081] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:21:06.513997] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-15T17:21:07.246043] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:21:07.314023] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-15T17:21:08.113922] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T17:21:08.113998] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-15T17:21:08.914001] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-15T17:21:09.713969] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-15T17:21:09.760045] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T17:21:10.514005] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-15T17:21:11.314003] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-15T17:21:11.409377] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-15T17:21:11.477238] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T17:21:12.113980] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-15T17:21:12.309565] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:21:12.638740] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-10-15T17:21:12.914046] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-15T17:21:13.458198] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:21:13.713976] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-15T17:21:13.940918] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T17:21:14.514033] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-15T17:21:15.065451] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:21:15.314016] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-15T17:21:16.113959] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-15T17:21:16.211147] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:21:16.513338] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T17:21:16.914026] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-15T17:21:17.513431] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:21:17.714023] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-15T17:21:18.513964] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-15T17:21:18.746739] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:21:18.786691] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T17:21:19.159936] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:21:19.314001] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-15T17:21:20.113988] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-15T17:21:20.914191] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-15T17:21:21.169265] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T17:21:21.555883] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T17:21:21.713985] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-15T17:21:21.804325] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T17:21:22.293042] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:21:22.514075] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-15T17:21:23.314012] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-15T17:21:23.988788] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:21:24.114054] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-15T17:21:24.671244] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:21:24.678773] [INFO ] [REMOTE ] ASH: Full fetch complete (55489 records). [2025-10-15T17:21:24.678966] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-15T17:21:24.919090] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-15T17:21:25.085542] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T17:21:25.107489] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-15T17:21:25.107281] [INFO ] [REMOTE ] ASIX: Full fetch complete (30856 records). [2025-10-15T17:21:25.107830] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-15T17:21:25.107734] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-15T17:21:25.108967] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-15T17:21:25.109154] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-15T17:21:25.219623] [DEBUG] [LOCAL ] ASH: Trimmed 55489 records to 37552 (keeping 200 days of data) [2025-10-15T17:21:25.615337] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-15T17:21:25.615717] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-15T17:21:25.617293] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-15T17:21:25.617682] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-15T17:21:25.627840] [DEBUG] [LOCAL ] ASIX: Trimmed 30856 records to 23077 (keeping 200 days of data) [2025-10-15T17:21:25.717283] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-15T17:21:25.848712] [DEBUG] [LOCAL ] ASH: Primary data saved (37552 records). [2025-10-15T17:21:25.849954] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-15T17:21:25.850083] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASH took 31.2s. Estimated remaining: 4h 52m 52s. Rate: 7.5 symbols/min [2025-10-15T17:21:26.071104] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:26.072029] [DEBUG] [LOCAL ] ASIX: Primary data saved (23077 records). [2025-10-15T17:21:26.072624] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-15T17:21:26.072839] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASIX took 31.4s. Estimated remaining: 4h 50m 59s. Rate: 7.6 symbols/min [2025-10-15T17:21:26.253392] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:26.298470] [DEBUG] [LOCAL ] ASX: Loaded 52873 existing records from primary storage. [2025-10-15T17:21:26.308541] [INFO ] [MAIN ] ASX: Loaded 52873 existing records. [2025-10-15T17:21:26.427775] [DEBUG] [LOCAL ] ATEN: Loaded 38394 existing records from primary storage. [2025-10-15T17:21:26.444337] [INFO ] [MAIN ] ATEN: Loaded 38394 existing records. [2025-10-15T17:21:26.578756] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:26.620904] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-15T17:21:26.621071] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-15T17:21:26.627211] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-15T17:21:26.642972] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-15T17:21:26.730054] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:21:26.819867] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:26.824501] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-15T17:21:26.824202] [INFO ] [REMOTE ] ASR: Full fetch complete (12376 records). [2025-10-15T17:21:26.824874] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-15T17:21:26.825507] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-15T17:21:26.831520] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-15T17:21:26.889498] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-15T17:21:27.326493] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T17:21:27.462088] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-15T17:21:27.826283] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:27.862560] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-15T17:21:27.902000] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-15T17:21:27.902450] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-15T17:21:27.908200] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-15T17:21:27.908294] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-15T17:21:27.954262] [DEBUG] [LOCAL ] ASR: Trimmed 12376 records to 9379 (keeping 200 days of data) [2025-10-15T17:21:28.018014] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:28.064936] [DEBUG] [LOCAL ] ASR: Primary data saved (9379 records). [2025-10-15T17:21:28.065193] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-15T17:21:28.065385] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASR took 33.4s. Estimated remaining: 4h 49m 31s. Rate: 7.6 symbols/min [2025-10-15T17:21:28.122330] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-15T17:21:28.262499] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:28.300621] [DEBUG] [LOCAL ] ATGE: Loaded 31110 existing records from primary storage. [2025-10-15T17:21:28.301134] [INFO ] [MAIN ] ATGE: Loaded 31110 existing records. [2025-10-15T17:21:28.490248] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:28.490530] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-15T17:21:28.490580] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-15T17:21:28.491057] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-15T17:21:28.491115] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-15T17:21:28.858817] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:28.913993] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-15T17:21:29.362535] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T17:21:29.639784] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:21:29.713979] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-15T17:21:29.790585] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T17:21:30.260325] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T17:21:30.513992] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-15T17:21:30.777104] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T17:21:31.314010] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-15T17:21:32.113989] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-15T17:21:32.369747] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:21:32.496820] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T17:21:32.914058] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-15T17:21:33.299867] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T17:21:33.714050] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-15T17:21:34.500118] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:21:34.513961] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-15T17:21:35.147410] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:21:35.314009] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-15T17:21:36.113990] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-15T17:21:36.294074] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T17:21:36.772323] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T17:21:36.913967] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-15T17:21:37.292104] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:21:37.714000] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-15T17:21:38.514045] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-15T17:21:39.314083] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-15T17:21:39.400097] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T17:21:39.406531] [INFO ] [REMOTE ] ASPN: Full fetch complete (72635 records). [2025-10-15T17:21:39.406710] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-15T17:21:39.807950] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-15T17:21:39.808084] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-15T17:21:39.809154] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-15T17:21:39.809223] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-15T17:21:39.811252] [DEBUG] [LOCAL ] ASPN: Trimmed 72635 records to 49893 (keeping 200 days of data) [2025-10-15T17:21:40.107150] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (3.19 seconds). [2025-10-15T17:21:40.153540] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-15T17:21:40.158905] [DEBUG] [LOCAL ] ASPN: Primary data saved (49893 records). [2025-10-15T17:21:40.159977] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-15T17:21:40.160107] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASPN took 45.5s. Estimated remaining: 4h 50m 20s. Rate: 7.6 symbols/min [2025-10-15T17:21:40.348296] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:40.380892] [DEBUG] [LOCAL ] ATHM: Loaded 31560 existing records from primary storage. [2025-10-15T17:21:40.381270] [INFO ] [MAIN ] ATHM: Loaded 31560 existing records. [2025-10-15T17:21:40.570225] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:40.570615] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-15T17:21:40.570739] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-15T17:21:40.571418] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-15T17:21:40.571478] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-15T17:21:40.883745] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-15T17:21:40.959592] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-15T17:21:40.980905] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:21:41.039244] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:41.713962] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-15T17:21:41.860872] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:21:42.131478] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:21:42.514017] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-15T17:21:43.231874] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:21:43.314076] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-15T17:21:44.114004] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-15T17:21:44.266841] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T17:21:44.894427] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:21:44.913975] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-15T17:21:45.428316] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T17:21:45.714004] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-15T17:21:46.437108] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:21:46.513994] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-15T17:21:47.154077] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T17:21:47.313997] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-15T17:21:47.691009] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:21:48.114002] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-15T17:21:48.913972] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-15T17:21:49.210918] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T17:21:49.651566] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:21:49.714012] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-15T17:21:49.867144] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T17:21:50.514041] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-15T17:21:51.093611] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:21:51.314042] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-15T17:21:51.643057] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T17:21:52.114016] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-15T17:21:52.684859] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T17:21:52.914229] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-15T17:21:53.714034] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-15T17:21:54.255499] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T17:21:54.491930] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:21:54.513955] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-15T17:21:54.759382] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T17:21:55.314072] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-15T17:21:56.041239] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:21:56.113944] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-15T17:21:56.836402] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:21:56.914003] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-15T17:21:57.526372] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:21:57.530745] [INFO ] [REMOTE ] ATEN: Full fetch complete (56874 records). [2025-10-15T17:21:57.530859] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-15T17:21:57.723944] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-15T17:21:57.920985] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-15T17:21:57.921121] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-15T17:21:57.921982] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-15T17:21:57.922061] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-15T17:21:57.923574] [DEBUG] [LOCAL ] ATEN: Trimmed 56874 records to 38334 (keeping 200 days of data) [2025-10-15T17:21:58.153343] [DEBUG] [LOCAL ] ATEN: Primary data saved (38334 records). [2025-10-15T17:21:58.153499] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-15T17:21:58.153584] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATEN took 32.1s. Estimated remaining: 4h 52m 27s. Rate: 7.5 symbols/min [2025-10-15T17:21:58.321357] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:58.329256] [DEBUG] [LOCAL ] ATHS: Loaded 6717 existing records from primary storage. [2025-10-15T17:21:58.329706] [INFO ] [MAIN ] ATHS: Loaded 6717 existing records. [2025-10-15T17:21:58.512865] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:58.513207] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-15T17:21:58.513285] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-15T17:21:58.513543] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-15T17:21:58.513602] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-15T17:21:58.528024] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-15T17:21:58.685074] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T17:21:58.771430] [INFO ] [REMOTE ] ASX: Full fetch complete (76761 records). [2025-10-15T17:21:58.785234] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-15T17:21:59.107916] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:59.197258] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:21:59.322929] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-15T17:21:59.437450] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-15T17:21:59.437584] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-15T17:21:59.438465] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-15T17:21:59.438535] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-15T17:21:59.440373] [DEBUG] [LOCAL ] ASX: Trimmed 76761 records to 52874 (keeping 200 days of data) [2025-10-15T17:21:59.762376] [DEBUG] [LOCAL ] ASX: Primary data saved (52874 records). [2025-10-15T17:21:59.762532] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-15T17:21:59.762615] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ASX took 33.9s. Estimated remaining: 4h 50m 55s. Rate: 7.6 symbols/min [2025-10-15T17:21:59.944266] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:21:59.977165] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:59.986217] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T17:22:00.036358] [DEBUG] [LOCAL ] ATI: Loaded 51381 existing records from primary storage. [2025-10-15T17:22:00.036743] [INFO ] [MAIN ] ATI: Loaded 51381 existing records. [2025-10-15T17:22:00.119164] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-15T17:22:00.246660] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:00.247123] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-15T17:22:00.247170] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-15T17:22:00.248300] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-15T17:22:00.248360] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-15T17:22:00.609300] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:00.913977] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-15T17:22:01.247218] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:22:01.714051] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-15T17:22:02.116235] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T17:22:02.514003] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-15T17:22:02.854292] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T17:22:03.314015] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-15T17:22:03.884774] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T17:22:04.048378] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:22:04.114003] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-15T17:22:04.914037] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-15T17:22:05.473043] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T17:22:05.594813] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:22:05.598472] [INFO ] [REMOTE ] ATGE: Full fetch complete (46043 records). [2025-10-15T17:22:05.598582] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-15T17:22:05.719091] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-15T17:22:05.975264] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-15T17:22:05.975353] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-15T17:22:05.975982] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-15T17:22:05.976047] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-15T17:22:05.977125] [DEBUG] [LOCAL ] ATGE: Trimmed 46043 records to 31064 (keeping 200 days of data) [2025-10-15T17:22:06.161970] [DEBUG] [LOCAL ] ATGE: Primary data saved (31064 records). [2025-10-15T17:22:06.162101] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-15T17:22:06.162178] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATGE took 38.1s. Estimated remaining: 4h 50m 27s. Rate: 7.6 symbols/min [2025-10-15T17:22:06.327310] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:06.358265] [DEBUG] [LOCAL ] ATKR: Loaded 35205 existing records from primary storage. [2025-10-15T17:22:06.358539] [INFO ] [MAIN ] ATKR: Loaded 35205 existing records. [2025-10-15T17:22:06.519947] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-15T17:22:06.532702] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:06.533969] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-15T17:22:06.534028] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-15T17:22:06.534421] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-15T17:22:06.534460] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-15T17:22:06.883698] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:07.314007] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-15T17:22:07.437351] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:22:07.515148] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T17:22:08.114050] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-15T17:22:08.623580] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-15T17:22:08.714112] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T17:22:08.914000] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-15T17:22:09.714008] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-15T17:22:10.513976] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-15T17:22:10.545932] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:22:10.721173] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T17:22:11.314036] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-15T17:22:11.424445] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T17:22:12.113996] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-15T17:22:12.445297] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:22:12.820072] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T17:22:12.914013] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-15T17:22:13.714050] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-15T17:22:14.385089] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T17:22:14.516238] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-15T17:22:14.518773] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:22:15.189096] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T17:22:15.314002] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-15T17:22:16.113963] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-15T17:22:16.505346] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T17:22:16.511074] [INFO ] [REMOTE ] ATHM: Full fetch complete (50139 records). [2025-10-15T17:22:16.511257] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-15T17:22:16.640346] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T17:22:16.922746] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-15T17:22:16.942551] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-15T17:22:16.942726] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-15T17:22:16.943524] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-15T17:22:16.943605] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-15T17:22:16.944826] [DEBUG] [LOCAL ] ATHM: Trimmed 50139 records to 31512 (keeping 200 days of data) [2025-10-15T17:22:17.132968] [DEBUG] [LOCAL ] ATHM: Primary data saved (31512 records). [2025-10-15T17:22:17.133147] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-15T17:22:17.133248] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHM took 37.0s. Estimated remaining: 4h 50m 59s. Rate: 7.6 symbols/min [2025-10-15T17:22:17.330755] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:17.368584] [DEBUG] [LOCAL ] ATMU: Loaded 38890 existing records from primary storage. [2025-10-15T17:22:17.368911] [INFO ] [MAIN ] ATMU: Loaded 38890 existing records. [2025-10-15T17:22:17.553073] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:17.553291] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-15T17:22:17.553339] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-15T17:22:17.553741] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-15T17:22:17.553798] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-15T17:22:17.727791] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-15T17:22:17.917814] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:18.313764] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T17:22:18.315119] [INFO ] [REMOTE ] ATHS: Full fetch complete (9670 records). [2025-10-15T17:22:18.315194] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-15T17:22:18.519480] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-15T17:22:18.711682] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-15T17:22:18.711776] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-15T17:22:18.712103] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-15T17:22:18.712144] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-15T17:22:18.712710] [DEBUG] [LOCAL ] ATHS: Trimmed 9670 records to 6640 (keeping 200 days of data) [2025-10-15T17:22:18.756863] [DEBUG] [LOCAL ] ATHS: Primary data saved (6640 records). [2025-10-15T17:22:18.757060] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-15T17:22:18.757178] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHS took 20.6s. Estimated remaining: 4h 49m 29s. Rate: 7.6 symbols/min [2025-10-15T17:22:18.935607] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:18.976929] [DEBUG] [LOCAL ] ATO: Loaded 41812 existing records from primary storage. [2025-10-15T17:22:18.977253] [INFO ] [MAIN ] ATO: Loaded 41812 existing records. [2025-10-15T17:22:19.155962] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:19.156186] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-15T17:22:19.156233] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-15T17:22:19.156893] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-15T17:22:19.156948] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-15T17:22:19.331027] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-15T17:22:19.516778] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:19.549339] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-15T17:22:20.114026] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-15T17:22:20.713210] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-15T17:22:20.913971] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-15T17:22:21.174351] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T17:22:21.366518] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T17:22:21.714032] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-15T17:22:22.263997] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:22:22.514000] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-15T17:22:23.003270] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:22:23.314006] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-15T17:22:24.121020] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-15T17:22:24.146844] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:22:24.625577] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:22:24.914047] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-15T17:22:25.498206] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:22:25.714019] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-15T17:22:26.258665] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:22:26.514025] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-15T17:22:27.219066] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:22:27.313993] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-15T17:22:28.063531] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T17:22:28.113991] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-15T17:22:28.432707] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:22:28.914073] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-15T17:22:29.681140] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:22:29.714050] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-15T17:22:30.191793] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:22:30.514015] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-15T17:22:31.237243] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T17:22:31.313970] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-15T17:22:31.603812] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:22:32.114058] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-15T17:22:32.914017] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-15T17:22:33.051979] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T17:22:33.478213] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T17:22:33.714007] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-15T17:22:34.514090] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-15T17:22:34.746232] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T17:22:35.200685] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:22:35.314003] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-15T17:22:35.817491] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T17:22:36.114000] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-15T17:22:36.644248] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:22:36.914044] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-15T17:22:37.528472] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T17:22:37.714169] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-15T17:22:38.452359] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T17:22:38.513992] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-15T17:22:39.034887] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T17:22:39.314041] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-15T17:22:40.114028] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-15T17:22:40.377804] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T17:22:40.416212] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:22:40.420461] [INFO ] [REMOTE ] ATKR: Full fetch complete (53534 records). [2025-10-15T17:22:40.420577] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-15T17:22:40.804393] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-15T17:22:40.804487] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-15T17:22:40.805123] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-15T17:22:40.805184] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-15T17:22:40.806277] [DEBUG] [LOCAL ] ATKR: Trimmed 53534 records to 35206 (keeping 200 days of data) [2025-10-15T17:22:40.913995] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-15T17:22:41.015832] [DEBUG] [LOCAL ] ATKR: Primary data saved (35206 records). [2025-10-15T17:22:41.015945] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-15T17:22:41.016034] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATKR took 34.9s. Estimated remaining: 4h 52m 27s. Rate: 7.5 symbols/min [2025-10-15T17:22:41.180282] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:41.210524] [DEBUG] [LOCAL ] ATR: Loaded 30558 existing records from primary storage. [2025-10-15T17:22:41.210825] [INFO ] [MAIN ] ATR: Loaded 30558 existing records. [2025-10-15T17:22:41.383466] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:41.383663] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-15T17:22:41.383723] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-15T17:22:41.384091] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-15T17:22:41.384146] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-15T17:22:41.678291] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:22:41.704039] [INFO ] [REMOTE ] ATO: Full fetch complete (60567 records). [2025-10-15T17:22:41.721886] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-15T17:22:41.721781] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-15T17:22:41.768908] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:42.140231] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-15T17:22:42.140303] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-15T17:22:42.140922] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-15T17:22:42.140983] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-15T17:22:42.142089] [DEBUG] [LOCAL ] ATO: Trimmed 60567 records to 41759 (keeping 200 days of data) [2025-10-15T17:22:42.399637] [DEBUG] [LOCAL ] ATO: Primary data saved (41759 records). [2025-10-15T17:22:42.399784] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-15T17:22:42.399880] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATO took 23.6s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-15T17:22:42.520738] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-15T17:22:42.569098] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:42.588171] [DEBUG] [LOCAL ] ATS: Loaded 17644 existing records from primary storage. [2025-10-15T17:22:42.588404] [INFO ] [MAIN ] ATS: Loaded 17644 existing records. [2025-10-15T17:22:42.762473] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:42.762726] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-15T17:22:42.762798] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-15T17:22:42.763322] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-15T17:22:42.763384] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-15T17:22:42.898554] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T17:22:43.157450] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:43.228106] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T17:22:43.313956] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-15T17:22:43.566081] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T17:22:44.114001] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-15T17:22:44.744629] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:22:44.914055] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-15T17:22:45.713980] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-15T17:22:46.011144] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T17:22:46.084622] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:22:46.513988] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-15T17:22:47.101007] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:22:47.314000] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-15T17:22:47.823228] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:22:48.114018] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-15T17:22:48.398858] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T17:22:48.914121] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-15T17:22:49.456051] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:22:49.714136] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-15T17:22:50.514011] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-15T17:22:51.281556] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:22:51.313995] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-15T17:22:51.431954] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-15T17:22:51.439294] [INFO ] [REMOTE ] ATI: Full fetch complete (73616 records). [2025-10-15T17:22:51.439459] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-15T17:22:51.440563] [FATAL] [VALIDATOR ] ATI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:22:51.440700] [FATAL] [MAIN ] ATI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:22:51.440754] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:22:51.440833] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-15T17:22:51.440915] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-15T17:22:51.440953] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-10-15T17:22:51.441474] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-10-15T17:22:51.442020] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATI took 51.7s. Estimated remaining: 4h 50m 60s. Rate: 7.5 symbols/min [2025-10-15T17:22:51.640424] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:51.696047] [DEBUG] [LOCAL ] ATUS: Loaded 49800 existing records from primary storage. [2025-10-15T17:22:51.696562] [INFO ] [MAIN ] ATUS: Loaded 49800 existing records. [2025-10-15T17:22:51.888907] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:51.889192] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-15T17:22:51.889245] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-15T17:22:51.889915] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-15T17:22:51.890000] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-15T17:22:52.121480] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-15T17:22:52.298558] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:52.914085] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-15T17:23:05.169964] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (14.66 seconds). [2025-10-15T17:23:05.176512] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-15T17:23:05.396470] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (13.27 seconds). [2025-10-15T17:23:05.402994] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-15T17:23:05.853587] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (14.54 seconds). [2025-10-15T17:23:05.863373] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-15T17:23:06.278447] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (13.36 seconds). [2025-10-15T17:23:06.288375] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-15T17:23:07.099628] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:23:07.108032] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-15T17:23:07.207106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T17:23:07.210940] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-15T17:23:07.352285] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:23:07.359156] [INFO ] [REMOTE ] ATMU: Full fetch complete (56427 records). [2025-10-15T17:23:07.359332] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-15T17:23:07.360373] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:23:07.360492] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:23:07.360783] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:23:07.360870] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-15T17:23:07.360961] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-15T17:23:07.361016] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-10-15T17:23:07.361268] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-10-15T17:23:07.361424] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATMU took 50.2s. Estimated remaining: 4h 52m 33s. Rate: 7.5 symbols/min [2025-10-15T17:23:07.554566] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:07.554768] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-15T17:23:07.554815] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-15T17:23:07.554947] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-15T17:23:07.555005] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-15T17:23:07.555051] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-15T17:23:07.555084] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-15T17:23:08.017816] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:08.018418] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-15T17:23:08.046465] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T17:23:08.056821] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-15T17:23:08.461736] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:23:08.474100] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:23:08.479020] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-15T17:23:08.480188] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-15T17:23:09.601811] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T17:23:09.607947] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-15T17:23:09.634020] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T17:23:09.643469] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-15T17:23:09.699455] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:23:09.706327] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-15T17:23:10.325887] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-15T17:23:10.336415] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-15T17:23:10.673594] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T17:23:10.678243] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-15T17:23:10.775112] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T17:23:10.783239] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-15T17:23:11.091088] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:23:11.101184] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-15T17:23:11.786712] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T17:23:11.790969] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-15T17:23:11.858135] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:23:11.868919] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-15T17:23:12.505065] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T17:23:12.512423] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-15T17:23:12.637489] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T17:23:12.642519] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-15T17:23:13.323007] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T17:23:13.334170] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-15T17:23:13.841906] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:23:13.846063] [INFO ] [REMOTE ] ATR: Full fetch complete (43924 records). [2025-10-15T17:23:13.846158] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-15T17:23:14.004767] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-15T17:23:14.066607] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-15T17:23:14.212562] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:23:14.257773] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-15T17:23:14.300488] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-15T17:23:14.300591] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-15T17:23:14.301186] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-15T17:23:14.301248] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-15T17:23:14.302348] [DEBUG] [LOCAL ] ATR: Trimmed 43924 records to 30562 (keeping 200 days of data) [2025-10-15T17:23:14.500998] [DEBUG] [LOCAL ] ATR: Primary data saved (30562 records). [2025-10-15T17:23:14.501133] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-15T17:23:14.501215] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 33.5s. Estimated remaining: 4h 52m 14s. Rate: 7.5 symbols/min [2025-10-15T17:23:14.671767] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:14.715484] [DEBUG] [LOCAL ] AUB: Loaded 46046 existing records from primary storage. [2025-10-15T17:23:14.715793] [INFO ] [MAIN ] AUB: Loaded 46046 existing records. [2025-10-15T17:23:14.901560] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:14.901906] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-15T17:23:14.901965] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-15T17:23:14.902448] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-15T17:23:14.902504] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-15T17:23:15.047753] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:23:15.126371] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-15T17:23:15.339583] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:15.339939] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-15T17:23:15.349778] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:23:15.353368] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-15T17:23:16.189165] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T17:23:16.200838] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-15T17:23:16.453106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:23:16.455097] [INFO ] [REMOTE ] ATS: Full fetch complete (25488 records). [2025-10-15T17:23:16.455191] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-15T17:23:16.455682] [FATAL] [VALIDATOR ] ATS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:23:16.455783] [FATAL] [MAIN ] ATS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:23:16.455857] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:23:16.455949] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-15T17:23:16.456029] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-15T17:23:16.456067] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-10-15T17:23:16.456344] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-10-15T17:23:16.456438] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATS took 34.1s. Estimated remaining: 4h 50m 51s. Rate: 7.5 symbols/min [2025-10-15T17:23:16.641116] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:16.648520] [DEBUG] [LOCAL ] AUNA: Loaded 5113 existing records from primary storage. [2025-10-15T17:23:16.648933] [INFO ] [MAIN ] AUNA: Loaded 5113 existing records. [2025-10-15T17:23:16.840700] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:16.841394] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-15T17:23:16.841838] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-15T17:23:16.842692] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-15T17:23:16.842845] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-15T17:23:16.941203] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T17:23:17.043539] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-15T17:23:17.068561] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:23:17.158494] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-15T17:23:17.293391] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:17.714035] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-15T17:23:17.900076] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:23:18.455962] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T17:23:18.513979] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-15T17:23:18.913836] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:23:18.963115] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:23:19.055535] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T17:23:19.314022] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-15T17:23:19.897490] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T17:23:20.114010] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-15T17:23:20.914028] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-15T17:23:21.398149] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:23:21.714109] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-15T17:23:22.514133] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-15T17:23:22.922761] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T17:23:23.027019] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T17:23:23.100544] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:23:23.314051] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-15T17:23:24.113992] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-15T17:23:24.447920] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T17:23:24.925769] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-15T17:23:24.947312] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:23:25.714008] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-15T17:23:26.514025] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-15T17:23:26.684466] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T17:23:26.991730] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T17:23:27.313973] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-15T17:23:27.373674] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:23:27.928873] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:23:28.114012] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-15T17:23:28.914041] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-15T17:23:29.718363] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-15T17:23:29.720792] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T17:23:29.726812] [INFO ] [REMOTE ] ATUS: Full fetch complete (71337 records). [2025-10-15T17:23:29.726912] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-15T17:23:30.138325] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-15T17:23:30.138412] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-15T17:23:30.139336] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-15T17:23:30.139403] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-15T17:23:30.140889] [DEBUG] [LOCAL ] ATUS: Trimmed 71337 records to 49869 (keeping 200 days of data) [2025-10-15T17:23:30.441384] [DEBUG] [LOCAL ] ATUS: Primary data saved (49869 records). [2025-10-15T17:23:30.441547] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-15T17:23:30.441705] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 39.0s. Estimated remaining: 4h 51m 58s. Rate: 7.5 symbols/min [2025-10-15T17:23:30.515464] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-15T17:23:30.650277] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:30.689598] [DEBUG] [LOCAL ] AVA: Loaded 38899 existing records from primary storage. [2025-10-15T17:23:30.689963] [INFO ] [MAIN ] AVA: Loaded 38899 existing records. [2025-10-15T17:23:30.857775] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:23:30.932911] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:30.933133] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-15T17:23:30.933201] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-15T17:23:30.933591] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-15T17:23:30.933679] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-15T17:23:31.266209] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T17:23:31.292189] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:31.313947] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-15T17:23:31.366502] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T17:23:31.952724] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:23:32.113997] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-15T17:23:32.914049] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-15T17:23:33.714057] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-15T17:23:34.398547] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-15T17:23:34.514010] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-15T17:23:35.314078] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-15T17:23:35.619161] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-15T17:23:36.114020] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-15T17:23:36.219434] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:23:36.505973] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-15T17:23:36.913110] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T17:23:36.914679] [INFO ] [REMOTE ] AUNA: Full fetch complete (7795 records). [2025-10-15T17:23:36.914788] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-15T17:23:36.914178] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-15T17:23:37.319099] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-15T17:23:37.319183] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-15T17:23:37.319412] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-15T17:23:37.319451] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-15T17:23:37.319901] [DEBUG] [LOCAL ] AUNA: Trimmed 7795 records to 5131 (keeping 200 days of data) [2025-10-15T17:23:37.347767] [DEBUG] [LOCAL ] AUNA: Primary data saved (5131 records). [2025-10-15T17:23:37.347880] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-15T17:23:37.347960] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AUNA took 20.9s. Estimated remaining: 4h 51m 37s. Rate: 7.5 symbols/min [2025-10-15T17:23:37.529993] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:37.540302] [DEBUG] [LOCAL ] AVAL: Loaded 8611 existing records from primary storage. [2025-10-15T17:23:37.540540] [INFO ] [MAIN ] AVAL: Loaded 8611 existing records. [2025-10-15T17:23:37.720727] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-15T17:23:37.726344] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:37.726824] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-15T17:23:37.728152] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-15T17:23:37.728437] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-15T17:23:37.728614] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-15T17:23:37.944887] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-15T17:23:38.150940] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:38.376725] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T17:23:38.514006] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-15T17:23:39.314075] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-15T17:23:39.448590] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:23:40.020447] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:23:40.113982] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-15T17:23:40.914064] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-15T17:23:41.359686] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:23:41.714097] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-15T17:23:41.790093] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T17:23:41.984537] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:23:42.514076] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-15T17:23:43.314008] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-15T17:23:43.553020] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T17:23:43.559531] [INFO ] [REMOTE ] AU: Full fetch complete (76541 records). [2025-10-15T17:23:43.559678] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-15T17:23:43.960665] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-15T17:23:43.960868] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-15T17:23:43.961775] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-15T17:23:43.982379] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-15T17:23:43.984161] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:23:43.993328] [DEBUG] [LOCAL ] AU: Trimmed 76541 records to 53079 (keeping 200 days of data) [2025-10-15T17:23:44.113986] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-15T17:23:44.328767] [DEBUG] [LOCAL ] AU: Primary data saved (53079 records). [2025-10-15T17:23:44.329009] [INFO ] [MAIN ] AU: Full history saved. [2025-10-15T17:23:44.329101] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AU took 37.0s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-15T17:23:44.519638] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:44.567310] [DEBUG] [LOCAL ] AVB: Loaded 42213 existing records from primary storage. [2025-10-15T17:23:44.567845] [INFO ] [MAIN ] AVB: Loaded 42213 existing records. [2025-10-15T17:23:44.760113] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:44.760764] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-15T17:23:44.760916] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-15T17:23:44.761514] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-15T17:23:44.761593] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-15T17:23:44.919183] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-15T17:23:45.184765] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:45.187413] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T17:23:45.358122] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:23:45.619887] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T17:23:45.714007] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-15T17:23:46.513992] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-15T17:23:47.152261] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:23:47.299090] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T17:23:47.313952] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-15T17:23:47.988833] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T17:23:48.113989] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-15T17:23:48.914022] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-15T17:23:49.607311] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:23:49.714004] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-15T17:23:49.895288] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T17:23:50.514048] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-15T17:23:51.260869] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T17:23:51.266721] [INFO ] [REMOTE ] AUB: Full fetch complete (66030 records). [2025-10-15T17:23:51.266835] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-15T17:23:51.320962] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-15T17:23:51.392837] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T17:23:51.676964] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-15T17:23:51.677041] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-15T17:23:51.677853] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-15T17:23:51.677924] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-15T17:23:51.679175] [DEBUG] [LOCAL ] AUB: Trimmed 66030 records to 46010 (keeping 200 days of data) [2025-10-15T17:23:51.947098] [DEBUG] [LOCAL ] AUB: Primary data saved (46010 records). [2025-10-15T17:23:51.947221] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-15T17:23:51.947543] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUB took 37.4s. Estimated remaining: 4h 51m 4s. Rate: 7.5 symbols/min [2025-10-15T17:23:52.119495] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:52.119793] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-15T17:23:52.117987] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-15T17:23:52.119868] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-15T17:23:52.121005] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-15T17:23:52.121050] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-15T17:23:52.121093] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-15T17:23:52.121125] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-15T17:23:52.501972] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:52.801384] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:23:52.913973] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-15T17:23:52.968161] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:23:53.714001] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-15T17:23:54.299224] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:23:54.514011] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-15T17:23:55.314110] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-15T17:23:55.357398] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T17:23:55.894551] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:23:55.961446] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:23:56.113983] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-15T17:23:56.914030] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-15T17:23:57.714068] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-15T17:23:58.111260] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-15T17:23:58.115676] [INFO ] [REMOTE ] AVA: Full fetch complete (55532 records). [2025-10-15T17:23:58.115809] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-15T17:23:58.161796] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:23:58.195305] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-15T17:23:58.219461] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:23:58.221872] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-15T17:23:58.221993] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:23:58.222072] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-15T17:23:58.232961] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-15T17:23:58.243291] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-15T17:23:58.272163] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-15T17:23:58.281920] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVBC took 6.3s. Estimated remaining: 4h 50m 36s. Rate: 7.5 symbols/min [2025-10-15T17:23:58.516474] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-15T17:23:58.718488] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:58.755700] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-15T17:23:58.755875] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-15T17:23:58.757191] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-15T17:23:58.757294] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-15T17:23:58.758812] [DEBUG] [LOCAL ] AVA: Trimmed 55532 records to 38779 (keeping 200 days of data) [2025-10-15T17:23:58.867507] [DEBUG] [LOCAL ] AVD: Loaded 21954 existing records from primary storage. [2025-10-15T17:23:58.869249] [INFO ] [MAIN ] AVD: Loaded 21954 existing records. [2025-10-15T17:23:59.095318] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:59.098048] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-15T17:23:59.098222] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-15T17:23:59.104247] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-15T17:23:59.104553] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-15T17:23:59.231430] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T17:23:59.328727] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-15T17:23:59.342383] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-15T17:23:59.560089] [DEBUG] [LOCAL ] AVA: Primary data saved (38779 records). [2025-10-15T17:23:59.576002] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-15T17:23:59.586447] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVA took 29.1s. Estimated remaining: 4h 49m 8s. Rate: 7.6 symbols/min [2025-10-15T17:23:59.756120] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:59.841591] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:59.863400] [DEBUG] [LOCAL ] AVK: Loaded 18602 existing records from primary storage. [2025-10-15T17:23:59.863790] [INFO ] [MAIN ] AVK: Loaded 18602 existing records. [2025-10-15T17:24:00.047467] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:00.047843] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-15T17:24:00.047897] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-15T17:24:00.048190] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-15T17:24:00.048230] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-15T17:24:00.127300] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-15T17:24:00.147742] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:24:00.433206] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:00.914050] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-15T17:24:01.721102] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-15T17:24:01.726046] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:24:01.823230] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T17:24:02.289270] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T17:24:02.514016] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-15T17:24:03.213885] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T17:24:03.215563] [INFO ] [REMOTE ] AVAL: Full fetch complete (14909 records). [2025-10-15T17:24:03.215637] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-15T17:24:03.314197] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-15T17:24:03.575175] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-15T17:24:03.575253] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-15T17:24:03.575576] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-15T17:24:03.575614] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-15T17:24:03.576101] [DEBUG] [LOCAL ] AVAL: Trimmed 14909 records to 8592 (keeping 200 days of data) [2025-10-15T17:24:03.626560] [DEBUG] [LOCAL ] AVAL: Primary data saved (8592 records). [2025-10-15T17:24:03.626716] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-15T17:24:03.626805] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVAL took 26.3s. Estimated remaining: 4h 48m 13s. Rate: 7.6 symbols/min [2025-10-15T17:24:03.796260] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:03.831472] [DEBUG] [LOCAL ] AVNS: Loaded 33614 existing records from primary storage. [2025-10-15T17:24:03.831803] [INFO ] [MAIN ] AVNS: Loaded 33614 existing records. [2025-10-15T17:24:04.013802] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:04.014001] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-15T17:24:04.014050] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-15T17:24:04.014388] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-15T17:24:04.014429] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-15T17:24:04.115902] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-15T17:24:04.368092] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:04.913958] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-15T17:24:05.099420] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T17:24:05.318895] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:24:05.714000] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-15T17:24:06.182235] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:24:06.514008] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-15T17:24:07.313996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-15T17:24:07.423358] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:24:07.476170] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:24:08.114003] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-15T17:24:08.174091] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:24:08.914000] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-15T17:24:09.713958] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-15T17:24:09.744921] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:24:10.173343] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:24:10.513962] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-15T17:24:10.755765] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:24:11.313993] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-15T17:24:12.113999] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-15T17:24:12.176063] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:24:12.296862] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T17:24:12.914057] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-15T17:24:13.714131] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-15T17:24:14.250248] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T17:24:14.298064] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:24:14.514060] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-15T17:24:14.761328] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:24:15.314060] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-15T17:24:16.114029] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-15T17:24:16.177281] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T17:24:16.592306] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T17:24:16.913962] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-15T17:24:16.943122] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T17:24:17.714013] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-15T17:24:17.975466] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T17:24:18.514020] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-15T17:24:18.678273] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T17:24:19.313965] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-15T17:24:19.573299] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T17:24:20.113968] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-15T17:24:20.268933] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T17:24:20.914007] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-15T17:24:21.714043] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-15T17:24:21.876460] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T17:24:21.960985] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:24:22.513996] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-15T17:24:23.080320] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:24:23.314029] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-15T17:24:23.879980] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T17:24:23.884518] [INFO ] [REMOTE ] AVB: Full fetch complete (58688 records). [2025-10-15T17:24:23.884612] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-15T17:24:23.885343] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:24:23.885426] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:24:23.885467] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:24:23.885505] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-15T17:24:23.885560] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-15T17:24:23.885593] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-10-15T17:24:23.885798] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-10-15T17:24:23.885886] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVB took 39.6s. Estimated remaining: 4h 50m 33s. Rate: 7.5 symbols/min [2025-10-15T17:24:24.052440] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:24.089361] [DEBUG] [LOCAL ] AVNT: Loaded 39087 existing records from primary storage. [2025-10-15T17:24:24.089630] [INFO ] [MAIN ] AVNT: Loaded 39087 existing records. [2025-10-15T17:24:24.119461] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-15T17:24:24.267976] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:24.268179] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-15T17:24:24.268226] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-15T17:24:24.268674] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-15T17:24:24.268731] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-15T17:24:24.615160] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:24.721942] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T17:24:24.913966] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-15T17:24:25.713979] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-15T17:24:25.816783] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:24:26.326696] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:24:26.514006] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-15T17:24:27.313979] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-15T17:24:27.332808] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:24:27.416472] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:24:28.114021] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-15T17:24:28.636050] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T17:24:28.914004] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-15T17:24:29.242871] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T17:24:29.713999] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-15T17:24:30.041184] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:24:30.514004] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-15T17:24:30.966872] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:24:31.203684] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T17:24:31.313980] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-15T17:24:32.113996] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-15T17:24:32.441030] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T17:24:32.443420] [INFO ] [REMOTE ] AVD: Full fetch complete (32903 records). [2025-10-15T17:24:32.443513] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-15T17:24:32.804632] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-15T17:24:32.804742] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-15T17:24:32.805205] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-15T17:24:32.805246] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-15T17:24:32.806012] [DEBUG] [LOCAL ] AVD: Trimmed 32903 records to 21808 (keeping 200 days of data) [2025-10-15T17:24:32.921379] [DEBUG] [LOCAL ] AVD: Primary data saved (21808 records). [2025-10-15T17:24:32.921490] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-15T17:24:32.921603] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVD took 34.6s. Estimated remaining: 4h 50m 37s. Rate: 7.5 symbols/min [2025-10-15T17:24:32.916013] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-15T17:24:33.096546] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:33.148603] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-15T17:24:33.149170] [INFO ] [MAIN ] AVTR: Loaded 53571 existing records. [2025-10-15T17:24:33.279062] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T17:24:33.365199] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:33.365420] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-15T17:24:33.365473] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-15T17:24:33.365984] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-15T17:24:33.366046] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-15T17:24:33.711014] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:33.713951] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-15T17:24:34.519185] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-15T17:24:34.544746] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:24:35.314044] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-15T17:24:35.436577] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T17:24:35.680903] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T17:24:36.114082] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-15T17:24:36.848967] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:24:36.914002] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-15T17:24:37.712144] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:24:37.718983] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-15T17:24:38.045512] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:24:38.513998] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-15T17:24:39.313969] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-15T17:24:39.413547] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:24:39.452908] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T17:24:39.455970] [INFO ] [REMOTE ] AVK: Full fetch complete (26678 records). [2025-10-15T17:24:39.456046] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-15T17:24:39.819093] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-15T17:24:39.819167] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-15T17:24:39.819693] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-15T17:24:39.819754] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-15T17:24:39.820442] [DEBUG] [LOCAL ] AVK: Trimmed 26678 records to 18628 (keeping 200 days of data) [2025-10-15T17:24:39.929751] [DEBUG] [LOCAL ] AVK: Primary data saved (18628 records). [2025-10-15T17:24:39.929896] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-15T17:24:39.929973] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVK took 40.3s. Estimated remaining: 4h 50m 18s. Rate: 7.5 symbols/min [2025-10-15T17:24:40.104607] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:40.104955] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-15T17:24:40.105004] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-15T17:24:40.105144] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-15T17:24:40.105202] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-15T17:24:40.105286] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-15T17:24:40.105331] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-15T17:24:40.119195] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-15T17:24:40.460191] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:40.655761] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:24:40.659881] [INFO ] [REMOTE ] AVNS: Full fetch complete (48410 records). [2025-10-15T17:24:40.659962] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-15T17:24:40.914105] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-15T17:24:41.045043] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-15T17:24:41.045129] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-15T17:24:41.045868] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-15T17:24:41.045931] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-15T17:24:41.047018] [DEBUG] [LOCAL ] AVNS: Trimmed 48410 records to 33666 (keeping 200 days of data) [2025-10-15T17:24:41.251088] [DEBUG] [LOCAL ] AVNS: Primary data saved (33666 records). [2025-10-15T17:24:41.251222] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-15T17:24:41.251300] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNS took 37.6s. Estimated remaining: 4h 48m 52s. Rate: 7.6 symbols/min [2025-10-15T17:24:41.419681] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:41.443717] [DEBUG] [LOCAL ] AWF: Loaded 23950 existing records from primary storage. [2025-10-15T17:24:41.443990] [INFO ] [MAIN ] AWF: Loaded 23950 existing records. [2025-10-15T17:24:41.630775] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:41.631109] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-15T17:24:41.631165] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-15T17:24:41.631604] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-15T17:24:41.631701] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-15T17:24:41.720151] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-15T17:24:41.991569] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T17:24:42.031346] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:42.346680] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T17:24:42.514015] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-15T17:24:43.314025] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-15T17:24:43.369211] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:24:43.819897] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T17:24:44.114010] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-15T17:24:44.859862] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T17:24:44.913959] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-15T17:24:45.658968] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T17:24:45.713977] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-15T17:24:46.407189] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:24:46.514006] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-15T17:24:46.686555] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T17:24:47.313980] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-15T17:24:47.937110] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:24:48.114022] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-15T17:24:48.484145] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T17:24:48.913989] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-15T17:24:49.319146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T17:24:49.714057] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-15T17:24:50.513964] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-15T17:24:50.732193] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:24:51.289740] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T17:24:51.313994] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-15T17:24:51.747511] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T17:24:52.114014] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-15T17:24:52.914019] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-15T17:24:53.356496] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T17:24:53.494505] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:24:53.713998] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-15T17:24:54.019172] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T17:24:54.025871] [INFO ] [REMOTE ] AVNT: Full fetch complete (56396 records). [2025-10-15T17:24:54.026104] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-15T17:24:54.461939] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-15T17:24:54.462045] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-15T17:24:54.462833] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-15T17:24:54.462906] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-15T17:24:54.464509] [DEBUG] [LOCAL ] AVNT: Trimmed 56396 records to 39045 (keeping 200 days of data) [2025-10-15T17:24:54.520339] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-15T17:24:54.719868] [DEBUG] [LOCAL ] AVNT: Primary data saved (39045 records). [2025-10-15T17:24:54.720088] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-15T17:24:54.720216] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNT took 30.8s. Estimated remaining: 4h 49m 48s. Rate: 7.5 symbols/min [2025-10-15T17:24:54.896859] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:54.933758] [DEBUG] [LOCAL ] AWI: Loaded 25384 existing records from primary storage. [2025-10-15T17:24:54.934910] [INFO ] [MAIN ] AWI: Loaded 25384 existing records. [2025-10-15T17:24:55.133487] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:55.134074] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-15T17:24:55.134161] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-15T17:24:55.135070] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-15T17:24:55.135133] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-15T17:24:55.325740] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-15T17:24:55.607151] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:55.634165] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T17:24:55.683827] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T17:24:56.113994] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-15T17:24:56.914058] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-15T17:24:57.146712] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:24:57.399705] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T17:24:57.714070] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-15T17:24:57.865082] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T17:24:58.514043] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-15T17:24:59.066313] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:24:59.313980] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-15T17:24:59.472562] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T17:25:00.113992] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-15T17:25:00.192962] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T17:25:00.914023] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-15T17:25:01.244224] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:25:01.714083] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-15T17:25:02.100848] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T17:25:02.514024] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-15T17:25:03.064294] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T17:25:03.314028] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-15T17:25:03.764932] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T17:25:04.114040] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-15T17:25:04.593542] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T17:25:04.914022] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-15T17:25:05.000354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:25:05.714037] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-15T17:25:06.410796] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T17:25:06.513987] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-15T17:25:06.897937] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:25:07.314013] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-15T17:25:08.114021] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-15T17:25:08.242262] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:25:08.271066] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T17:25:08.914005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-15T17:25:09.339493] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T17:25:09.714025] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-15T17:25:09.918008] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:25:10.514005] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-15T17:25:10.966464] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:25:11.314078] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-15T17:25:12.114011] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-15T17:25:12.457483] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:25:12.635209] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:25:12.914045] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-15T17:25:13.714062] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-15T17:25:13.781200] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T17:25:14.516751] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-15T17:25:14.520066] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T17:25:14.803067] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:25:15.313955] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-15T17:25:15.425862] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T17:25:15.430216] [INFO ] [REMOTE ] AWF: Full fetch complete (35523 records). [2025-10-15T17:25:15.430311] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-15T17:25:15.431004] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:25:15.431099] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:25:15.431149] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:25:15.431198] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-15T17:25:15.431285] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-15T17:25:15.431342] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-10-15T17:25:15.431563] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-10-15T17:25:15.431693] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AWF took 34.2s. Estimated remaining: 4h 52m 8s. Rate: 7.5 symbols/min [2025-10-15T17:25:15.601126] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:15.654225] [DEBUG] [LOCAL ] AWK: Loaded 48593 existing records from primary storage. [2025-10-15T17:25:15.654568] [INFO ] [MAIN ] AWK: Loaded 48593 existing records. [2025-10-15T17:25:15.827978] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:15.828188] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-15T17:25:15.828235] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-15T17:25:15.828725] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-15T17:25:15.828780] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-15T17:25:16.115483] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-15T17:25:16.195794] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:16.389737] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T17:25:16.393059] [INFO ] [REMOTE ] AWI: Full fetch complete (35787 records). [2025-10-15T17:25:16.393142] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-15T17:25:16.393685] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:25:16.393764] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:25:16.393828] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:25:16.393896] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-15T17:25:16.393959] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-15T17:25:16.393993] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-10-15T17:25:16.394147] [DEBUG] [LOCAL ] AWI: Deleted derivative data file. [2025-10-15T17:25:16.394250] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AWI took 21.7s. Estimated remaining: 4h 50m 38s. Rate: 7.5 symbols/min [2025-10-15T17:25:16.560891] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:16.581672] [DEBUG] [LOCAL ] AWP: Loaded 21577 existing records from primary storage. [2025-10-15T17:25:16.581945] [INFO ] [MAIN ] AWP: Loaded 21577 existing records. [2025-10-15T17:25:16.759521] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:16.759771] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-15T17:25:16.759824] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-15T17:25:16.760103] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-15T17:25:16.760158] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-15T17:25:16.917213] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-15T17:25:17.135359] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:17.554578] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T17:25:17.559529] [INFO ] [REMOTE ] AVY: Full fetch complete (56300 records). [2025-10-15T17:25:17.559664] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-15T17:25:17.560369] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:25:17.560479] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:25:17.560551] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:25:17.560667] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-15T17:25:17.560752] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-15T17:25:17.560790] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-15T17:25:17.560831] [DEBUG] [LOCAL ] AVY: No derivative data file found to delete. [2025-10-15T17:25:17.560886] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AVY took 37.6s. Estimated remaining: 4h 49m 12s. Rate: 7.5 symbols/min [2025-10-15T17:25:17.715370] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-15T17:25:17.740141] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:17.762388] [DEBUG] [LOCAL ] AWR: Loaded 22835 existing records from primary storage. [2025-10-15T17:25:17.762675] [INFO ] [MAIN ] AWR: Loaded 22835 existing records. [2025-10-15T17:25:17.943669] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:17.943889] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-15T17:25:17.943937] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-15T17:25:17.944214] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-15T17:25:17.944269] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-15T17:25:18.298081] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:18.514029] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-15T17:25:18.877244] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T17:25:19.249277] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:25:19.313959] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-15T17:25:19.609364] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T17:25:20.113991] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-15T17:25:20.913965] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-15T17:25:20.976229] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:25:21.089851] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T17:25:21.713979] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-15T17:25:21.950240] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T17:25:22.514063] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-15T17:25:23.299866] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:25:23.313941] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-15T17:25:23.398822] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:25:24.113996] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-15T17:25:24.913994] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-15T17:25:25.195164] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T17:25:25.232718] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T17:25:25.713998] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-15T17:25:26.514056] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-15T17:25:26.550876] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:25:26.562053] [INFO ] [REMOTE ] AVTR: Full fetch complete (77634 records). [2025-10-15T17:25:26.562281] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-15T17:25:26.917737] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T17:25:26.999253] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-15T17:25:26.999343] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-15T17:25:27.000362] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-15T17:25:27.000438] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-15T17:25:27.002046] [DEBUG] [LOCAL ] AVTR: Trimmed 77634 records to 53572 (keeping 200 days of data) [2025-10-15T17:25:27.312786] [DEBUG] [LOCAL ] AVTR: Primary data saved (53572 records). [2025-10-15T17:25:27.312926] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-15T17:25:27.313242] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AVTR took 54.4s. Estimated remaining: 4h 49m 25s. Rate: 7.5 symbols/min [2025-10-15T17:25:27.324737] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-15T17:25:27.487144] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:27.517050] [DEBUG] [LOCAL ] AX: Loaded 28003 existing records from primary storage. [2025-10-15T17:25:27.517318] [INFO ] [MAIN ] AX: Loaded 28003 existing records. [2025-10-15T17:25:27.695921] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:27.696219] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-15T17:25:27.696344] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-15T17:25:27.701892] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-15T17:25:27.707536] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-15T17:25:27.707923] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T17:25:28.060590] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:28.113992] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-15T17:25:28.670831] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:25:28.914001] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-15T17:25:29.356633] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T17:25:29.714026] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-15T17:25:30.009440] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T17:25:30.514019] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-15T17:25:31.314049] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-15T17:25:31.464538] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:25:31.501003] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T17:25:32.114025] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-15T17:25:32.429836] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T17:25:32.913963] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-15T17:25:33.123051] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T17:25:33.714034] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-15T17:25:34.080997] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:25:34.514072] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-15T17:25:34.943509] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T17:25:35.314011] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-15T17:25:35.407507] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:25:36.087316] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T17:25:36.113957] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-15T17:25:36.914017] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-15T17:25:37.001014] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T17:25:37.713981] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-15T17:25:38.113329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T17:25:38.514014] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-15T17:25:39.313985] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-15T17:25:39.413053] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:25:40.114030] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-15T17:25:40.196392] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T17:25:40.485392] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T17:25:40.488483] [INFO ] [REMOTE ] AWR: Full fetch complete (32300 records). [2025-10-15T17:25:40.488560] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-15T17:25:40.856748] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-15T17:25:40.856822] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-15T17:25:40.857286] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-15T17:25:40.857327] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-15T17:25:40.858072] [DEBUG] [LOCAL ] AWR: Trimmed 32300 records to 22839 (keeping 200 days of data) [2025-10-15T17:25:40.918903] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-15T17:25:41.000193] [DEBUG] [LOCAL ] AWR: Primary data saved (22839 records). [2025-10-15T17:25:41.000353] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-15T17:25:41.000444] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWR took 23.4s. Estimated remaining: 4h 50m 21s. Rate: 7.5 symbols/min [2025-10-15T17:25:41.110728] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T17:25:41.194010] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:41.239224] [DEBUG] [LOCAL ] AXL: Loaded 50552 existing records from primary storage. [2025-10-15T17:25:41.239532] [INFO ] [MAIN ] AXL: Loaded 50552 existing records. [2025-10-15T17:25:41.414105] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:41.414309] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-15T17:25:41.414354] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-15T17:25:41.414842] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-15T17:25:41.414897] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-15T17:25:41.719088] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-15T17:25:41.781521] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:42.478631] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T17:25:42.514021] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-15T17:25:43.151057] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T17:25:43.314054] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-15T17:25:44.082429] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:25:44.114116] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-15T17:25:44.567765] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T17:25:44.914065] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-15T17:25:45.464591] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T17:25:45.713977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-15T17:25:46.287922] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T17:25:46.514007] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-15T17:25:47.048486] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-15T17:25:47.314031] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-15T17:25:48.017927] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T17:25:48.091472] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:25:48.113987] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-15T17:25:48.914000] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-15T17:25:49.078353] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:25:49.081007] [INFO ] [REMOTE ] AWP: Full fetch complete (31965 records). [2025-10-15T17:25:49.081090] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-15T17:25:49.468902] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-15T17:25:49.468997] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-15T17:25:49.469585] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-15T17:25:49.469679] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-15T17:25:49.470436] [DEBUG] [LOCAL ] AWP: Trimmed 31965 records to 21616 (keeping 200 days of data) [2025-10-15T17:25:49.599219] [DEBUG] [LOCAL ] AWP: Primary data saved (21616 records). [2025-10-15T17:25:49.599343] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-15T17:25:49.599421] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWP took 33.2s. Estimated remaining: 4h 50m 20s. Rate: 7.5 symbols/min [2025-10-15T17:25:49.719094] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-15T17:25:49.780573] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:49.832146] [DEBUG] [LOCAL ] AXP: Loaded 53167 existing records from primary storage. [2025-10-15T17:25:49.832454] [INFO ] [MAIN ] AXP: Loaded 53167 existing records. [2025-10-15T17:25:50.021891] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:50.022110] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-15T17:25:50.022158] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-15T17:25:50.022772] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-15T17:25:50.022835] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-15T17:25:50.405428] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:50.513961] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-15T17:25:50.774549] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T17:25:50.780620] [INFO ] [REMOTE ] AWK: Full fetch complete (70863 records). [2025-10-15T17:25:50.780824] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-15T17:25:51.097362] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:25:51.196395] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-15T17:25:51.196487] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-15T17:25:51.197269] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-15T17:25:51.197334] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-15T17:25:51.198997] [DEBUG] [LOCAL ] AWK: Trimmed 70863 records to 48557 (keeping 200 days of data) [2025-10-15T17:25:51.314049] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-15T17:25:51.513758] [DEBUG] [LOCAL ] AWK: Primary data saved (48557 records). [2025-10-15T17:25:51.513893] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-15T17:25:51.515111] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWK took 36.1s. Estimated remaining: 4h 49m 4s. Rate: 7.5 symbols/min [2025-10-15T17:25:51.702826] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:51.713015] [DEBUG] [LOCAL ] AXR: Loaded 2948 existing records from primary storage. [2025-10-15T17:25:51.713326] [INFO ] [MAIN ] AXR: Loaded 2948 existing records. [2025-10-15T17:25:51.921803] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:51.922025] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-15T17:25:51.922087] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-15T17:25:51.922269] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-15T17:25:51.922341] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-15T17:25:52.147373] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-15T17:25:52.293364] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:52.758217] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-15T17:25:52.872403] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:25:52.913975] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-15T17:25:53.489163] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:25:53.714028] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-15T17:25:54.513977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-15T17:25:54.745044] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:25:55.314016] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-15T17:25:55.398841] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:25:55.754277] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T17:25:56.114015] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-15T17:25:56.913929] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-15T17:25:57.154477] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T17:25:57.616139] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T17:25:57.713975] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-15T17:25:58.163678] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:25:58.514007] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-15T17:25:59.313961] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-15T17:25:59.390099] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:25:59.530194] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T17:26:00.048428] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T17:26:00.113956] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-15T17:26:00.715726] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T17:26:00.913986] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-15T17:26:01.714007] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-15T17:26:02.514034] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-15T17:26:02.646463] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:26:02.649850] [INFO ] [REMOTE ] AX: Full fetch complete (42208 records). [2025-10-15T17:26:02.649953] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-15T17:26:02.937747] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T17:26:03.068760] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-15T17:26:03.068838] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-15T17:26:03.069365] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-15T17:26:03.069406] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-15T17:26:03.070278] [DEBUG] [LOCAL ] AX: Trimmed 42208 records to 28036 (keeping 200 days of data) [2025-10-15T17:26:03.244734] [DEBUG] [LOCAL ] AX: Primary data saved (28036 records). [2025-10-15T17:26:03.244929] [INFO ] [MAIN ] AX: Full history saved. [2025-10-15T17:26:03.245047] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 35.9s. Estimated remaining: 4h 49m 38s. Rate: 7.5 symbols/min [2025-10-15T17:26:03.319103] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-15T17:26:03.445016] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:03.479831] [DEBUG] [LOCAL ] AXS: Loaded 38625 existing records from primary storage. [2025-10-15T17:26:03.480128] [INFO ] [MAIN ] AXS: Loaded 38625 existing records. [2025-10-15T17:26:03.654974] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:03.655182] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-15T17:26:03.655229] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-15T17:26:03.655636] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-15T17:26:03.655726] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-15T17:26:04.004003] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:04.113992] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-15T17:26:04.692849] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-15T17:26:04.732763] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T17:26:04.913989] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-15T17:26:05.677396] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:26:05.714013] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-15T17:26:06.514004] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-15T17:26:06.823948] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:26:07.003906] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:26:07.017170] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:26:07.313992] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-15T17:26:08.114005] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-15T17:26:08.632621] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T17:26:08.913982] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-15T17:26:09.028818] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:26:09.714047] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-15T17:26:10.365730] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T17:26:10.514041] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-15T17:26:11.313959] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-15T17:26:11.601917] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T17:26:12.113976] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-15T17:26:12.628779] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T17:26:12.840826] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-15T17:26:12.913981] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-15T17:26:13.714068] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-15T17:26:13.808559] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T17:26:13.815584] [INFO ] [REMOTE ] AXL: Full fetch complete (73001 records). [2025-10-15T17:26:13.815846] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-15T17:26:14.211760] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-15T17:26:14.211878] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-15T17:26:14.212881] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-15T17:26:14.212949] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-15T17:26:14.214412] [DEBUG] [LOCAL ] AXL: Trimmed 73001 records to 50565 (keeping 200 days of data) [2025-10-15T17:26:14.493327] [DEBUG] [LOCAL ] AXL: Primary data saved (50565 records). [2025-10-15T17:26:14.493456] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-15T17:26:14.493536] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 33.5s. Estimated remaining: 4h 50m 6s. Rate: 7.5 symbols/min [2025-10-15T17:26:14.523014] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-15T17:26:14.665703] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:14.675624] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T17:26:14.719145] [DEBUG] [LOCAL ] AXTA: Loaded 52240 existing records from primary storage. [2025-10-15T17:26:14.719488] [INFO ] [MAIN ] AXTA: Loaded 52240 existing records. [2025-10-15T17:26:14.902095] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:14.902553] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-15T17:26:14.902628] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-15T17:26:14.903256] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-15T17:26:14.903315] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-15T17:26:15.275123] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:15.293623] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:26:15.313962] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-15T17:26:16.113994] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-15T17:26:16.787417] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-15T17:26:16.858392] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:26:16.913960] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-15T17:26:17.432045] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:26:17.714094] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-15T17:26:18.500192] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T17:26:18.513946] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-15T17:26:19.281578] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T17:26:19.313982] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-15T17:26:19.845711] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T17:26:20.113996] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-15T17:26:20.761063] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T17:26:20.913985] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-15T17:26:21.713970] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-15T17:26:22.029907] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T17:26:22.160951] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T17:26:22.163850] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:26:22.514005] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-15T17:26:22.993070] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T17:26:23.314011] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-15T17:26:24.113978] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-15T17:26:24.743534] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T17:26:24.913983] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-15T17:26:25.714003] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-15T17:26:25.761084] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:26:26.152066] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:26:26.156935] [INFO ] [REMOTE ] AXS: Full fetch complete (55809 records). [2025-10-15T17:26:26.157074] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-15T17:26:26.519418] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-15T17:26:26.561087] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-15T17:26:26.561195] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-15T17:26:26.562032] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-15T17:26:26.562109] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-15T17:26:26.563699] [DEBUG] [LOCAL ] AXS: Trimmed 55809 records to 38593 (keeping 200 days of data) [2025-10-15T17:26:26.800812] [DEBUG] [LOCAL ] AXS: Primary data saved (38593 records). [2025-10-15T17:26:26.800950] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-15T17:26:26.801032] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXS took 23.6s. Estimated remaining: 4h 50m 45s. Rate: 7.5 symbols/min [2025-10-15T17:26:27.314054] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-15T17:26:31.357258] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (5.64 seconds). [2025-10-15T17:26:31.358743] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-15T17:26:32.037018] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:26:32.038239] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-15T17:26:32.106135] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (4.79 seconds). [2025-10-15T17:26:32.118444] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-15T17:26:32.614425] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:26:32.616008] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-15T17:26:33.105080] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T17:26:33.105864] [INFO ] [REMOTE ] AXR: Full fetch complete (4424 records). [2025-10-15T17:26:33.105933] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-15T17:26:33.106278] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:26:33.106385] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:26:33.106431] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:26:33.106469] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-15T17:26:33.106524] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-15T17:26:33.106597] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-15T17:26:33.106847] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-10-15T17:26:33.107043] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXR took 41.6s. Estimated remaining: 4h 50m 18s. Rate: 7.5 symbols/min [2025-10-15T17:26:33.392265] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (6.87 seconds). [2025-10-15T17:26:33.404485] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-15T17:26:33.642866] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T17:26:33.654484] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-15T17:26:35.338770] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T17:26:35.349429] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-15T17:26:35.437865] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T17:26:35.449023] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-15T17:26:36.786678] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:26:36.798265] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-15T17:26:37.537165] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T17:26:37.549036] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-15T17:26:38.402319] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:26:38.414589] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-15T17:26:39.728501] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T17:26:39.736172] [INFO ] [REMOTE ] AXP: Full fetch complete (77073 records). [2025-10-15T17:26:39.736381] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-15T17:26:39.957225] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T17:26:40.060751] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-15T17:26:40.200269] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-15T17:26:40.200387] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-15T17:26:40.201483] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-15T17:26:40.201557] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-15T17:26:40.203700] [DEBUG] [LOCAL ] AXP: Trimmed 77073 records to 53166 (keeping 200 days of data) [2025-10-15T17:26:40.569702] [DEBUG] [LOCAL ] AXP: Primary data saved (53166 records). [2025-10-15T17:26:40.569911] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-15T17:26:40.570011] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 51.0s. Estimated remaining: 4h 50m 4s. Rate: 7.5 symbols/min [2025-10-15T17:26:41.934183] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:26:41.941342] [INFO ] [REMOTE ] AXTA: Full fetch complete (75354 records). [2025-10-15T17:26:41.941515] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-15T17:26:42.359916] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-15T17:26:42.360036] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-15T17:26:42.361297] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-15T17:26:42.361381] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-15T17:26:42.363502] [DEBUG] [LOCAL ] AXTA: Trimmed 75354 records to 52253 (keeping 200 days of data) [2025-10-15T17:26:42.686844] [DEBUG] [LOCAL ] AXTA: Primary data saved (52253 records). [2025-10-15T17:26:42.687033] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-15T17:26:42.687137] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 28.2s. Estimated remaining: 4h 48m 52s. Rate: 7.5 symbols/min [2025-10-15T17:26:43.305912] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.384775] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.460432] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.482098] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.482820] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-15T17:26:43.483242] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-15T17:26:43.487890] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-15T17:26:43.488088] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-15T17:26:43.488167] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-15T17:26:43.488586] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-15T17:26:43.543103] [DEBUG] [LOCAL ] AZO: Loaded 11054 existing records from primary storage. [2025-10-15T17:26:43.574672] [INFO ] [MAIN ] AZO: Loaded 11054 existing records. [2025-10-15T17:26:43.757090] [DEBUG] [LOCAL ] AZZ: Loaded 22646 existing records from primary storage. [2025-10-15T17:26:43.830091] [INFO ] [MAIN ] AZZ: Loaded 22646 existing records. [2025-10-15T17:26:43.866210] [DEBUG] [LOCAL ] AYI: Loaded 25008 existing records from primary storage. [2025-10-15T17:26:43.927010] [INFO ] [MAIN ] AYI: Loaded 25008 existing records. [2025-10-15T17:26:44.142977] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:44.182811] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-15T17:26:44.221816] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-15T17:26:44.250299] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-15T17:26:44.327863] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-15T17:26:44.495907] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:44.516901] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-15T17:26:44.485478] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:44.522921] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-15T17:26:44.522529] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-15T17:26:44.635002] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-15T17:26:44.681434] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-15T17:26:44.681287] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:44.707854] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-15T17:26:44.755247] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-15T17:26:44.819589] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-15T17:26:44.838442] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-15T17:26:45.306263] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:45.393177] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-15T17:26:45.664273] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:45.708236] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-15T17:26:45.744127] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:45.744884] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-15T17:26:46.031638] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:26:46.038430] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-15T17:26:46.887202] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:26:46.892355] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-15T17:26:46.934027] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:26:46.938207] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-15T17:26:47.024012] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:26:47.027317] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-15T17:26:47.058377] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:26:47.064608] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-15T17:26:47.248317] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:26:47.248698] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-15T17:26:47.248817] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:26:47.248921] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-15T17:26:47.248991] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:26:47.249089] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-15T17:26:47.249202] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-15T17:26:47.249260] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-15T17:26:47.249307] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-15T17:26:47.249354] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. B took 4.6s. Estimated remaining: 4h 48m 7s. Rate: 7.5 symbols/min [2025-10-15T17:26:47.427890] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:47.487294] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-15T17:26:47.487791] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-15T17:26:47.683909] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:47.684207] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-15T17:26:47.684272] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-15T17:26:47.684823] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-15T17:26:47.684879] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-15T17:26:47.997252] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T17:26:48.016600] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T17:26:48.031255] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-15T17:26:48.097075] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-15T17:26:48.101154] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:48.102952] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-15T17:26:48.153710] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:26:48.160229] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-15T17:26:48.866406] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:26:48.868923] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-15T17:26:49.251587] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T17:26:49.257303] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-15T17:26:49.324399] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T17:26:49.713995] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-15T17:26:49.742517] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T17:26:50.077831] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T17:26:50.129087] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T17:26:50.514003] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-15T17:26:51.049799] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:26:51.314002] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-15T17:26:51.545729] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T17:26:52.114014] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-15T17:26:52.914220] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-15T17:26:52.916037] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T17:26:53.714019] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-15T17:26:53.772028] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-15T17:26:53.784430] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:26:54.513988] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-15T17:26:54.836606] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T17:26:55.314050] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-15T17:26:56.114009] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-15T17:26:56.164109] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:26:56.659817] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-15T17:26:56.914059] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-15T17:26:57.293288] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:26:57.715246] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-15T17:26:57.718980] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T17:26:58.513967] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-15T17:26:59.314959] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-15T17:26:59.318083] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T17:26:59.333733] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:27:00.114329] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-15T17:27:00.118040] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T17:27:00.914004] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-15T17:27:01.075351] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:27:01.714042] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-15T17:27:01.785046] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T17:27:02.514029] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-15T17:27:02.728636] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T17:27:03.314026] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-15T17:27:04.114026] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-15T17:27:04.364128] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:27:04.914061] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-15T17:27:05.101885] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-15T17:27:05.123767] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T17:27:05.714020] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-15T17:27:06.232362] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T17:27:06.236700] [INFO ] [REMOTE ] AZZ: Full fetch complete (31803 records). [2025-10-15T17:27:06.236808] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-15T17:27:06.519170] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-15T17:27:06.635433] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-15T17:27:06.635542] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-15T17:27:06.636192] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-15T17:27:06.636259] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-15T17:27:06.637338] [DEBUG] [LOCAL ] AZZ: Trimmed 31803 records to 22700 (keeping 200 days of data) [2025-10-15T17:27:06.782292] [DEBUG] [LOCAL ] AZZ: Primary data saved (22700 records). [2025-10-15T17:27:06.782476] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-15T17:27:06.782580] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AZZ took 24.1s. Estimated remaining: 4h 50m 3s. Rate: 7.5 symbols/min [2025-10-15T17:27:06.976350] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:07.048427] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-15T17:27:07.049294] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-15T17:27:07.241353] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:07.241703] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-15T17:27:07.241768] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-15T17:27:07.242377] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-15T17:27:07.242435] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-15T17:27:07.321040] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-15T17:27:07.554901] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T17:27:07.584532] [INFO ] [REMOTE ] AZO: Full fetch complete (15981 records). [2025-10-15T17:27:07.585267] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-15T17:27:07.742982] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:08.050834] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-15T17:27:08.050951] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-15T17:27:08.051494] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-15T17:27:08.051537] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-15T17:27:08.052176] [DEBUG] [LOCAL ] AZO: Trimmed 15981 records to 11036 (keeping 200 days of data) [2025-10-15T17:27:08.114054] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-15T17:27:08.140135] [DEBUG] [LOCAL ] AZO: Primary data saved (11036 records). [2025-10-15T17:27:08.140336] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-15T17:27:08.140495] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 25.5s. Estimated remaining: 4h 48m 44s. Rate: 7.5 symbols/min [2025-10-15T17:27:08.324183] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:08.380411] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-15T17:27:08.382733] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T17:27:08.475423] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-15T17:27:08.476056] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-15T17:27:08.682353] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:08.682665] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-15T17:27:08.682733] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-15T17:27:08.684259] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-15T17:27:08.684322] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-15T17:27:08.919218] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-15T17:27:09.084408] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:09.714043] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-15T17:27:10.514056] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-15T17:27:10.835047] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-15T17:27:11.313992] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-15T17:27:11.379626] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-15T17:27:11.481632] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T17:27:11.960395] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-15T17:27:12.114008] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-15T17:27:12.914130] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-15T17:27:13.714033] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-15T17:27:13.854812] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-15T17:27:13.892694] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T17:27:14.509141] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-15T17:27:14.519817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-15T17:27:15.314090] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-15T17:27:15.755337] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-15T17:27:16.114046] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-15T17:27:16.919123] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-15T17:27:16.936271] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-15T17:27:17.128394] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:27:17.131863] [INFO ] [REMOTE ] AYI: Full fetch complete (37072 records). [2025-10-15T17:27:17.131976] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-15T17:27:17.531972] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-15T17:27:17.532154] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-15T17:27:17.532788] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-15T17:27:17.532853] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-15T17:27:17.533851] [DEBUG] [LOCAL ] AYI: Trimmed 37072 records to 24967 (keeping 200 days of data) [2025-10-15T17:27:17.694815] [DEBUG] [LOCAL ] AYI: Primary data saved (24967 records). [2025-10-15T17:27:17.695041] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-15T17:27:17.695208] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 35.0s. Estimated remaining: 4h 48m 52s. Rate: 7.5 symbols/min [2025-10-15T17:27:17.727936] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-15T17:27:17.892746] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:17.929043] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-15T17:27:17.985163] [DEBUG] [LOCAL ] BAH: Loaded 51734 existing records from primary storage. [2025-10-15T17:27:17.985542] [INFO ] [MAIN ] BAH: Loaded 51734 existing records. [2025-10-15T17:27:18.170744] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:18.171049] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-15T17:27:18.171112] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-15T17:27:18.171840] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-15T17:27:18.171912] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-15T17:27:18.517782] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-15T17:27:18.521478] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:18.997200] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-15T17:27:19.314050] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-15T17:27:20.114024] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-15T17:27:20.305144] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-15T17:27:20.823660] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-15T17:27:20.914097] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-15T17:27:21.156848] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:27:21.714019] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-15T17:27:22.416020] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-15T17:27:22.514107] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-15T17:27:23.313989] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-15T17:27:23.383819] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-15T17:27:23.504590] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T17:27:24.114057] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-15T17:27:24.913973] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-15T17:27:25.026184] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-15T17:27:25.063996] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T17:27:25.071305] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-15T17:27:25.071495] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-15T17:27:25.482295] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-15T17:27:25.482401] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-15T17:27:25.483387] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-15T17:27:25.483457] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-15T17:27:25.485427] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-15T17:27:25.717583] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-15T17:27:25.835401] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-15T17:27:25.835732] [INFO ] [MAIN ] BA: Full history saved. [2025-10-15T17:27:25.836036] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 38.6s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-15T17:27:25.993365] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-15T17:27:26.070133] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:26.106116] [DEBUG] [LOCAL ] BAK: Loaded 39300 existing records from primary storage. [2025-10-15T17:27:26.106453] [INFO ] [MAIN ] BAK: Loaded 39300 existing records. [2025-10-15T17:27:26.292080] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:26.292358] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-15T17:27:26.292410] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-15T17:27:26.292885] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-15T17:27:26.292944] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-15T17:27:26.523986] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-15T17:27:26.694982] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:26.725886] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T17:27:27.314057] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-15T17:27:27.985493] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-15T17:27:28.114011] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-15T17:27:28.914057] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-15T17:27:29.041844] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:27:29.269366] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-15T17:27:29.714043] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-15T17:27:30.294800] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-15T17:27:30.358442] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:27:30.514085] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-15T17:27:31.314073] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-15T17:27:32.060324] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:27:32.099790] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-15T17:27:32.113942] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-15T17:27:32.914055] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-15T17:27:33.282385] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T17:27:33.713997] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-15T17:27:34.513975] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-15T17:27:34.795860] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-15T17:27:35.251933] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-15T17:27:35.313962] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-15T17:27:35.549424] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T17:27:35.585754] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T17:27:36.114068] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-15T17:27:36.914056] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-15T17:27:37.466842] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T17:27:37.714031] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-15T17:27:37.885060] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T17:27:38.514104] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-15T17:27:38.923910] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-15T17:27:39.314035] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-15T17:27:39.481827] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:27:39.549051] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T17:27:40.114103] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-15T17:27:40.914023] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-15T17:27:41.713978] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-15T17:27:41.921907] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-15T17:27:41.935457] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:27:42.514069] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-15T17:27:43.313993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-15T17:27:43.571773] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-15T17:27:44.113979] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-15T17:27:44.256856] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-15T17:27:44.642260] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T17:27:44.913996] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-15T17:27:45.714052] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-15T17:27:46.262160] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-15T17:27:46.268550] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-15T17:27:46.268700] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-15T17:27:46.676406] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-15T17:27:46.677762] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-15T17:27:46.677109] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-15T17:27:46.684533] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-15T17:27:46.685077] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-15T17:27:46.685772] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-15T17:27:46.686255] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-15T17:27:46.718430] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-15T17:27:47.401249] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-15T17:27:47.524855] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-15T17:27:47.521501] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:27:47.530209] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-15T17:27:47.541683] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-15T17:27:47.542456] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BABA took 40.8s. Estimated remaining: 4h 51m 2s. Rate: 7.4 symbols/min [2025-10-15T17:27:47.563211] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-15T17:27:47.687733] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-15T17:27:47.705733] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-15T17:27:47.706782] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-15T17:27:47.707169] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-15T17:27:47.761143] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-15T17:27:47.780505] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:47.948294] [DEBUG] [LOCAL ] BALL: Loaded 51865 existing records from primary storage. [2025-10-15T17:27:48.009821] [INFO ] [MAIN ] BALL: Loaded 51865 existing records. [2025-10-15T17:27:48.258316] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:48.262957] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-15T17:27:48.266360] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-15T17:27:48.269112] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-15T17:27:48.269434] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-15T17:27:48.677021] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-15T17:27:48.716209] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-15T17:27:48.736162] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:48.736679] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 40.6s. Estimated remaining: 4h 49m 42s. Rate: 7.5 symbols/min [2025-10-15T17:27:48.737232] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-15T17:27:48.917959] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T17:27:48.951281] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:48.951630] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-15T17:27:48.952067] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-15T17:27:48.951718] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-15T17:27:48.952331] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-15T17:27:48.953192] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-15T17:27:48.953254] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-15T17:27:48.953288] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-15T17:27:49.309231] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:49.406266] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:27:49.714013] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-15T17:27:50.443448] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:27:50.513963] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-15T17:27:50.843612] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-15T17:27:51.313983] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-15T17:27:51.509432] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T17:27:51.515621] [INFO ] [REMOTE ] BAH: Full fetch complete (75189 records). [2025-10-15T17:27:51.515781] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-15T17:27:51.785428] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:27:51.943215] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-15T17:27:51.943322] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-15T17:27:51.944225] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-15T17:27:51.944292] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-15T17:27:51.945788] [DEBUG] [LOCAL ] BAH: Trimmed 75189 records to 51719 (keeping 200 days of data) [2025-10-15T17:27:52.124446] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-15T17:27:52.277139] [DEBUG] [LOCAL ] BAH: Primary data saved (51719 records). [2025-10-15T17:27:52.277329] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-15T17:27:52.277836] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAH took 34.6s. Estimated remaining: 4h 48m 47s. Rate: 7.5 symbols/min [2025-10-15T17:27:52.445492] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:52.497748] [DEBUG] [LOCAL ] BAM: Loaded 52087 existing records from primary storage. [2025-10-15T17:27:52.498111] [INFO ] [MAIN ] BAM: Loaded 52087 existing records. [2025-10-15T17:27:52.676385] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:52.676628] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-15T17:27:52.676733] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-15T17:27:52.677309] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-15T17:27:52.677367] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-15T17:27:52.919108] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-15T17:27:53.051496] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:53.065085] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:27:53.070930] [INFO ] [REMOTE ] BAK: Full fetch complete (56996 records). [2025-10-15T17:27:53.071147] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-15T17:27:53.523040] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-15T17:27:53.523181] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-15T17:27:53.524172] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-15T17:27:53.524260] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-15T17:27:53.526016] [DEBUG] [LOCAL ] BAK: Trimmed 56996 records to 39305 (keeping 200 days of data) [2025-10-15T17:27:53.732555] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-15T17:27:53.762721] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T17:27:53.805301] [DEBUG] [LOCAL ] BAK: Primary data saved (39305 records). [2025-10-15T17:27:53.805479] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-15T17:27:53.805570] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 28.0s. Estimated remaining: 4h 47m 32s. Rate: 7.5 symbols/min [2025-10-15T17:27:53.977068] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:54.027993] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T17:27:54.051531] [DEBUG] [LOCAL ] BANC: Loaded 51342 existing records from primary storage. [2025-10-15T17:27:54.051977] [INFO ] [MAIN ] BANC: Loaded 51342 existing records. [2025-10-15T17:27:54.230611] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:54.230887] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-15T17:27:54.230946] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-15T17:27:54.231459] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-15T17:27:54.231540] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-15T17:27:54.519179] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-15T17:27:54.577199] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:55.314024] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-15T17:27:55.368467] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T17:27:56.000770] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:27:56.114033] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-15T17:27:56.914035] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-15T17:27:57.673459] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-15T17:27:57.713993] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-15T17:27:58.441291] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-15T17:27:58.514017] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-15T17:27:58.714929] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:27:59.314010] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-15T17:27:59.501042] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T17:27:59.836471] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:28:00.113992] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-15T17:28:00.241105] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T17:28:00.913993] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-15T17:28:01.695137] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T17:28:01.713953] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-15T17:28:02.514054] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-15T17:28:02.684957] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:28:03.313996] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-15T17:28:03.712822] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-15T17:28:04.114009] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-15T17:28:04.145515] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:28:04.193264] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:28:04.914030] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-15T17:28:05.714009] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-15T17:28:05.837985] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T17:28:06.183044] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T17:28:06.513967] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-15T17:28:06.592309] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T17:28:07.314013] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-15T17:28:08.113977] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-15T17:28:08.213925] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:28:08.914025] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-15T17:28:09.162866] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T17:28:09.714085] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-15T17:28:09.897886] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T17:28:10.513999] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-15T17:28:11.323969] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-15T17:28:11.326782] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:28:12.113972] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-15T17:28:12.239716] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T17:28:12.259592] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T17:28:12.522795] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (3.61 seconds). [2025-10-15T17:28:12.914066] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-15T17:28:13.714036] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-15T17:28:14.404156] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:28:14.500925] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:28:14.513949] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-15T17:28:14.533395] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T17:28:15.314028] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-15T17:28:16.114013] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-15T17:28:16.502910] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T17:28:16.913999] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-15T17:28:17.719307] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-15T17:28:17.722111] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-15T17:28:18.004134] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T17:28:18.336172] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:28:18.369522] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T17:28:18.514076] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-15T17:28:19.314038] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-15T17:28:19.762808] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T17:28:20.114043] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-15T17:28:20.306105] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:28:20.913996] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-15T17:28:21.714097] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-15T17:28:21.860359] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T17:28:22.514067] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-15T17:28:22.575621] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T17:28:22.581963] [INFO ] [REMOTE ] BAM: Full fetch complete (74945 records). [2025-10-15T17:28:22.582116] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-15T17:28:23.009752] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-15T17:28:23.009877] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-15T17:28:23.011044] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-15T17:28:23.011199] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-15T17:28:23.013142] [DEBUG] [LOCAL ] BAM: Trimmed 74945 records to 52107 (keeping 200 days of data) [2025-10-15T17:28:23.314150] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-15T17:28:23.454464] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T17:28:23.527662] [DEBUG] [LOCAL ] BAM: Primary data saved (52107 records). [2025-10-15T17:28:23.527862] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-15T17:28:23.528241] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BAM took 31.3s. Estimated remaining: 4h 51m 7s. Rate: 7.4 symbols/min [2025-10-15T17:28:23.749633] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:23.778763] [DEBUG] [LOCAL ] BAP: Loaded 25720 existing records from primary storage. [2025-10-15T17:28:23.779123] [INFO ] [MAIN ] BAP: Loaded 25720 existing records. [2025-10-15T17:28:23.969991] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:23.970311] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-15T17:28:23.970391] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-15T17:28:23.970815] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-15T17:28:23.970873] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-15T17:28:24.139603] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-15T17:28:24.169304] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T17:28:24.366809] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T17:28:24.397505] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:24.398725] [INFO ] [REMOTE ] BANC: Full fetch complete (74148 records). [2025-10-15T17:28:24.398918] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-15T17:28:24.399757] [FATAL] [VALIDATOR ] BANC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:28:24.399845] [FATAL] [MAIN ] BANC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:28:24.399927] [WARN ] [MAIN ] BANC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:28:24.400003] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-15T17:28:24.400069] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-15T17:28:24.400103] [INFO ] [LOCAL ] BANC: Starting deletion of derivative data. [2025-10-15T17:28:24.400316] [DEBUG] [LOCAL ] BANC: Deleted derivative data file. [2025-10-15T17:28:24.400412] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BANC took 30.6s. Estimated remaining: 4h 49m 45s. Rate: 7.4 symbols/min [2025-10-15T17:28:24.568138] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:24.604201] [DEBUG] [LOCAL ] BARK: Loaded 38229 existing records from primary storage. [2025-10-15T17:28:24.604511] [INFO ] [MAIN ] BARK: Loaded 38229 existing records. [2025-10-15T17:28:24.784264] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:24.784522] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-15T17:28:24.784570] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-15T17:28:24.784943] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-15T17:28:24.785005] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-15T17:28:24.919812] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-15T17:28:25.132000] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:25.714024] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-15T17:28:26.184181] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:28:26.184981] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T17:28:26.192879] [INFO ] [REMOTE ] BALY: Full fetch complete (16499 records). [2025-10-15T17:28:26.193042] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-15T17:28:26.235258] [INFO ] [REMOTE ] BALL: Full fetch complete (75560 records). [2025-10-15T17:28:26.266429] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-15T17:28:26.519757] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-15T17:28:26.531847] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T17:28:26.640396] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:28:26.664480] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:28:26.694415] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-15T17:28:26.706219] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-15T17:28:26.713561] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-15T17:28:26.729803] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-15T17:28:26.733632] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BALY took 38.0s. Estimated remaining: 4h 48m 39s. Rate: 7.5 symbols/min [2025-10-15T17:28:27.032210] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-15T17:28:27.037455] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-15T17:28:27.054125] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-15T17:28:27.054352] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-15T17:28:27.109202] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:27.111202] [DEBUG] [LOCAL ] BALL: Trimmed 75560 records to 51888 (keeping 200 days of data) [2025-10-15T17:28:27.367142] [DEBUG] [LOCAL ] BAX: Loaded 53525 existing records from primary storage. [2025-10-15T17:28:27.376932] [INFO ] [MAIN ] BAX: Loaded 53525 existing records. [2025-10-15T17:28:27.584092] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:28:27.614579] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-15T17:28:27.692930] [DEBUG] [LOCAL ] BALL: Primary data saved (51888 records). [2025-10-15T17:28:27.709080] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-15T17:28:27.714486] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BALL took 40.2s. Estimated remaining: 4h 47m 20s. Rate: 7.5 symbols/min [2025-10-15T17:28:27.714278] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:27.784667] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-15T17:28:27.801363] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-15T17:28:27.823987] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-15T17:28:27.834336] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-15T17:28:27.950299] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:28.215562] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:28:28.264220] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-15T17:28:28.306406] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:28.307581] [DEBUG] [LOCAL ] BB: Loaded 52924 existing records from primary storage. [2025-10-15T17:28:28.308026] [INFO ] [MAIN ] BB: Loaded 52924 existing records. [2025-10-15T17:28:28.491456] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:28.491717] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-15T17:28:28.491813] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-15T17:28:28.492243] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-15T17:28:28.492301] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-15T17:28:28.883561] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:28.913970] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-15T17:28:29.173086] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:28:29.559720] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:28:29.713995] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-15T17:28:30.513999] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-15T17:28:30.766485] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:28:30.887379] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T17:28:31.314009] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-15T17:28:31.677742] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T17:28:32.114013] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-15T17:28:32.913975] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-15T17:28:33.206223] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-15T17:28:33.714063] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-15T17:28:33.970264] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T17:28:34.096184] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-15T17:28:34.514018] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-15T17:28:34.958461] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:28:35.314025] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-15T17:28:36.113986] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-15T17:28:36.292823] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T17:28:36.913956] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-15T17:28:37.408428] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-15T17:28:37.617735] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:28:37.713978] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-15T17:28:38.513972] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-15T17:28:38.598535] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:28:39.029605] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:28:39.313992] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-15T17:28:40.114053] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-15T17:28:40.622587] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T17:28:40.913969] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-15T17:28:41.014827] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:28:41.713974] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-15T17:28:41.836953] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:28:42.514029] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-15T17:28:42.913601] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:28:43.104629] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T17:28:43.313990] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-15T17:28:44.113968] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-15T17:28:44.435247] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T17:28:44.914021] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-15T17:28:45.541023] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-15T17:28:45.714003] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-15T17:28:45.804136] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:28:46.513996] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-15T17:28:46.739278] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T17:28:47.313961] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-15T17:28:47.585833] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T17:28:47.726630] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T17:28:48.113999] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-15T17:28:48.914040] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-15T17:28:49.071057] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:28:49.714072] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-15T17:28:49.750158] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T17:28:50.223536] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:28:50.514033] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-15T17:28:51.272671] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T17:28:51.314072] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-15T17:28:51.783224] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T17:28:52.114047] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-15T17:28:52.913991] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-15T17:28:53.188400] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T17:28:53.532805] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:28:53.714003] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-15T17:28:54.168201] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:28:54.514083] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-15T17:28:54.943784] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T17:28:54.951697] [INFO ] [REMOTE ] BARK: Full fetch complete (56201 records). [2025-10-15T17:28:54.951873] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-15T17:28:55.325319] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-15T17:28:55.363211] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-15T17:28:55.363411] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-15T17:28:55.364511] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-15T17:28:55.364613] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-15T17:28:55.366486] [DEBUG] [LOCAL ] BARK: Trimmed 56201 records to 38160 (keeping 200 days of data) [2025-10-15T17:28:55.596532] [DEBUG] [LOCAL ] BARK: Primary data saved (38160 records). [2025-10-15T17:28:55.596765] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-15T17:28:55.596877] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BARK took 31.2s. Estimated remaining: 4h 50m 32s. Rate: 7.4 symbols/min [2025-10-15T17:28:55.778087] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:55.827937] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-15T17:28:55.828305] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-15T17:28:56.018877] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:56.019134] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-15T17:28:56.019183] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-15T17:28:56.020087] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-15T17:28:56.020146] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-15T17:28:56.120304] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-15T17:28:56.383850] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:56.914074] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-15T17:28:57.291357] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T17:28:57.322907] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T17:28:57.714002] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-15T17:28:57.885444] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-10-15T17:28:58.514027] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-15T17:28:59.314039] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-15T17:29:00.912054] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (4.00 seconds). [2025-10-15T17:29:00.925000] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-15T17:29:01.117606] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (3.40 seconds). [2025-10-15T17:29:01.124072] [INFO ] [REMOTE ] BAX: Full fetch complete (77609 records). [2025-10-15T17:29:01.124204] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-15T17:29:01.283310] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-15T17:29:01.329458] [INFO ] [REMOTE ] BAP: Full fetch complete (37514 records). [2025-10-15T17:29:01.336156] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-15T17:29:01.870547] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-15T17:29:01.870738] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-15T17:29:01.871967] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-15T17:29:01.872400] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-15T17:29:01.934807] [DEBUG] [LOCAL ] BAX: Trimmed 77609 records to 53529 (keeping 200 days of data) [2025-10-15T17:29:01.966477] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-15T17:29:01.966802] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-15T17:29:01.967254] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-15T17:29:01.967323] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-15T17:29:01.972156] [DEBUG] [LOCAL ] BAP: Trimmed 37514 records to 25781 (keeping 200 days of data) [2025-10-15T17:29:02.244220] [DEBUG] [LOCAL ] BAP: Primary data saved (25781 records). [2025-10-15T17:29:02.245013] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-15T17:29:02.245699] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BAP took 38.7s. Estimated remaining: 4h 50m 10s. Rate: 7.4 symbols/min [2025-10-15T17:29:02.459187] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:02.636602] [DEBUG] [LOCAL ] BBAR: Loaded 42247 existing records from primary storage. [2025-10-15T17:29:02.644827] [INFO ] [MAIN ] BBAR: Loaded 42247 existing records. [2025-10-15T17:29:02.915901] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:02.921554] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-15T17:29:02.926737] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-15T17:29:02.934681] [DEBUG] [LOCAL ] BAX: Primary data saved (53529 records). [2025-10-15T17:29:02.934798] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-15T17:29:02.934967] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 36.2s. Estimated remaining: 4h 48m 48s. Rate: 7.5 symbols/min [2025-10-15T17:29:02.940291] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-15T17:29:02.958252] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-15T17:29:03.306269] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:03.580743] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:03.586197] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-15T17:29:03.590481] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (4.28 seconds). [2025-10-15T17:29:03.619193] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-15T17:29:03.641627] [DEBUG] [LOCAL ] BBD: Loaded 53260 existing records from primary storage. [2025-10-15T17:29:03.642073] [INFO ] [MAIN ] BBD: Loaded 53260 existing records. [2025-10-15T17:29:03.796775] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-15T17:29:03.857919] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-15T17:29:03.898708] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:03.898987] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-15T17:29:03.899040] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-15T17:29:03.900008] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-15T17:29:03.900067] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-15T17:29:04.287406] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:04.288111] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-15T17:29:05.234569] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:29:05.243977] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-15T17:29:05.662376] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T17:29:05.674222] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-15T17:29:06.166756] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T17:29:06.178353] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-15T17:29:06.295306] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-15T17:29:06.382474] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:29:06.514056] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-15T17:29:07.314119] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-15T17:29:07.717348] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:29:07.724678] [INFO ] [REMOTE ] BB: Full fetch complete (77009 records). [2025-10-15T17:29:07.724869] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-15T17:29:08.147771] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T17:29:08.168169] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-15T17:29:08.179239] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-15T17:29:08.181052] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-15T17:29:08.181157] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-15T17:29:08.181935] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-15T17:29:08.184527] [DEBUG] [LOCAL ] BB: Trimmed 77009 records to 52914 (keeping 200 days of data) [2025-10-15T17:29:08.513199] [DEBUG] [LOCAL ] BB: Primary data saved (52914 records). [2025-10-15T17:29:08.513447] [INFO ] [MAIN ] BB: Full history saved. [2025-10-15T17:29:08.513603] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 40.8s. Estimated remaining: 4h 48m 15s. Rate: 7.5 symbols/min [2025-10-15T17:29:08.730500] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:08.732700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T17:29:08.778430] [DEBUG] [LOCAL ] BBDC: Loaded 33129 existing records from primary storage. [2025-10-15T17:29:08.778810] [INFO ] [MAIN ] BBDC: Loaded 33129 existing records. [2025-10-15T17:29:08.927887] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-15T17:29:08.975146] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:08.975882] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-15T17:29:08.976025] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-15T17:29:08.976923] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-15T17:29:08.977006] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-15T17:29:09.224275] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-15T17:29:09.483064] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:09.713983] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-15T17:29:09.823261] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:29:10.227999] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T17:29:10.514000] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-15T17:29:11.156390] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:29:11.314026] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-15T17:29:12.114049] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-15T17:29:12.923213] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-15T17:29:12.933908] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:29:13.276963] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T17:29:13.287050] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-15T17:29:13.714002] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-15T17:29:13.994602] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:29:14.514031] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-15T17:29:15.034260] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T17:29:15.313996] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-15T17:29:16.097881] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:29:16.113956] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-15T17:29:16.695689] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:29:16.914027] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-15T17:29:17.575920] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T17:29:17.713978] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-15T17:29:18.514016] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-15T17:29:18.714786] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:29:19.314020] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-15T17:29:19.564886] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T17:29:20.113989] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-15T17:29:20.350951] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-15T17:29:20.424807] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T17:29:20.914053] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-15T17:29:21.208872] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T17:29:21.714073] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-15T17:29:22.513998] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-15T17:29:23.261431] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-15T17:29:23.314038] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-15T17:29:23.427049] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:29:23.699976] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T17:29:24.114020] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-15T17:29:24.914049] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-15T17:29:25.109789] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:29:25.713980] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-15T17:29:25.926418] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-15T17:29:26.514025] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-15T17:29:26.723325] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T17:29:26.953524] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T17:29:27.314021] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-15T17:29:28.114033] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-15T17:29:28.145086] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T17:29:28.914059] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-15T17:29:29.129671] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T17:29:29.491096] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:29:29.714024] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-15T17:29:30.521487] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-15T17:29:30.544768] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:29:30.978362] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T17:29:30.983676] [INFO ] [REMOTE ] BBDC: Full fetch complete (48812 records). [2025-10-15T17:29:30.983814] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-15T17:29:31.322208] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-15T17:29:31.366376] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-15T17:29:31.366463] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-15T17:29:31.367239] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-15T17:29:31.367300] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-15T17:29:31.368344] [DEBUG] [LOCAL ] BBDC: Trimmed 48812 records to 33095 (keeping 200 days of data) [2025-10-15T17:29:31.562526] [DEBUG] [LOCAL ] BBDC: Primary data saved (33095 records). [2025-10-15T17:29:31.562712] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-15T17:29:31.562806] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBDC took 23.0s. Estimated remaining: 4h 50m 35s. Rate: 7.4 symbols/min [2025-10-15T17:29:31.738519] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:31.745120] [DEBUG] [LOCAL ] BBDO: Loaded 5044 existing records from primary storage. [2025-10-15T17:29:31.745351] [INFO ] [MAIN ] BBDO: Loaded 5044 existing records. [2025-10-15T17:29:31.954349] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:31.954587] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-15T17:29:31.954665] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-15T17:29:31.954974] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-15T17:29:31.955032] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-15T17:29:32.119868] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-15T17:29:32.348225] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:32.914053] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-15T17:29:33.164741] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-15T17:29:33.603841] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:29:33.714066] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-15T17:29:33.789080] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:29:33.874153] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:29:33.885983] [INFO ] [REMOTE ] BBAR: Full fetch complete (61285 records). [2025-10-15T17:29:33.886262] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-15T17:29:34.260212] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-15T17:29:34.260317] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-15T17:29:34.261106] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-15T17:29:34.261170] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-15T17:29:34.262533] [DEBUG] [LOCAL ] BBAR: Trimmed 61285 records to 42354 (keeping 200 days of data) [2025-10-15T17:29:34.517482] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-15T17:29:34.522463] [DEBUG] [LOCAL ] BBAR: Primary data saved (42354 records). [2025-10-15T17:29:34.522538] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-15T17:29:34.522922] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAR took 32.3s. Estimated remaining: 4h 49m 37s. Rate: 7.4 symbols/min [2025-10-15T17:29:34.696942] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:34.718635] [DEBUG] [LOCAL ] BBN: Loaded 18085 existing records from primary storage. [2025-10-15T17:29:34.718988] [INFO ] [MAIN ] BBN: Loaded 18085 existing records. [2025-10-15T17:29:34.923513] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:34.923795] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-15T17:29:34.923843] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-15T17:29:34.924086] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-15T17:29:34.924125] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-15T17:29:35.145598] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T17:29:35.293196] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:35.314036] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-15T17:29:35.797495] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T17:29:36.114017] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-15T17:29:36.541105] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-15T17:29:36.914026] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-15T17:29:37.371417] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T17:29:37.377219] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:29:37.713983] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-15T17:29:38.472786] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T17:29:38.514003] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-15T17:29:39.173049] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:29:39.313998] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-15T17:29:40.114036] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-15T17:29:40.243416] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T17:29:40.797494] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T17:29:40.914009] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-15T17:29:41.713997] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-15T17:29:41.820726] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T17:29:42.514023] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-15T17:29:43.313983] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-15T17:29:43.504427] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:29:44.113967] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-15T17:29:44.268630] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T17:29:44.913966] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-15T17:29:45.714062] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-15T17:29:45.738694] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:29:45.745736] [INFO ] [REMOTE ] BBD: Full fetch complete (77277 records). [2025-10-15T17:29:45.745922] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-15T17:29:46.090589] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T17:29:46.199868] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-15T17:29:46.218629] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-15T17:29:46.221887] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-15T17:29:46.220401] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.71 seconds). [2025-10-15T17:29:46.228294] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-15T17:29:46.230307] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-15T17:29:46.230619] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-15T17:29:46.237313] [DEBUG] [LOCAL ] BBD: Trimmed 77277 records to 53260 (keeping 200 days of data) [2025-10-15T17:29:46.402546] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T17:29:46.514035] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-15T17:29:46.858019] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-15T17:29:46.885040] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-15T17:29:46.887728] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-15T17:29:46.888091] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-15T17:29:46.894887] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-15T17:29:47.083272] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T17:29:47.217730] [DEBUG] [LOCAL ] BBD: Primary data saved (53260 records). [2025-10-15T17:29:47.225693] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-15T17:29:47.226562] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 44.3s. Estimated remaining: 4h 50m 14s. Rate: 7.4 symbols/min [2025-10-15T17:29:47.314503] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-15T17:29:47.482714] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-15T17:29:47.501323] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-15T17:29:47.501243] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:47.501519] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBAI took 51.9s. Estimated remaining: 4h 48m 50s. Rate: 7.4 symbols/min [2025-10-15T17:29:47.512985] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-15T17:29:47.570079] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-15T17:29:47.586606] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-15T17:29:47.605416] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-15T17:29:47.608124] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-15T17:29:47.608183] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-15T17:29:47.803271] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:47.842019] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-15T17:29:47.858580] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-15T17:29:47.905885] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-15T17:29:47.932434] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-15T17:29:47.964611] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-15T17:29:47.964841] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-15T17:29:48.117061] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-15T17:29:48.153062] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:48.409428] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:48.421086] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T17:29:48.780390] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T17:29:48.913964] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-15T17:29:49.671545] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T17:29:49.673135] [INFO ] [REMOTE ] BBDO: Full fetch complete (7501 records). [2025-10-15T17:29:49.673210] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-15T17:29:49.719084] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-15T17:29:49.977270] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:29:50.005842] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-15T17:29:50.037126] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:29:50.037346] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-15T17:29:50.037439] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-15T17:29:50.037267] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-15T17:29:50.037831] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-15T17:29:50.037908] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-15T17:29:50.037564] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:29:50.038091] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-15T17:29:50.038577] [DEBUG] [LOCAL ] BBDO: Trimmed 7501 records to 5027 (keeping 200 days of data) [2025-10-15T17:29:50.038499] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-15T17:29:50.038691] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-15T17:29:50.039043] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-15T17:29:50.039264] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBT took 2.8s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-15T17:29:50.191500] [DEBUG] [LOCAL ] BBDO: Primary data saved (5027 records). [2025-10-15T17:29:50.209795] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-15T17:29:50.223001] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBDO took 18.7s. Estimated remaining: 4h 46m 24s. Rate: 7.5 symbols/min [2025-10-15T17:29:50.241687] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:50.388179] [DEBUG] [LOCAL ] BBUC: Loaded 13635 existing records from primary storage. [2025-10-15T17:29:50.418813] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:50.417397] [INFO ] [MAIN ] BBUC: Loaded 13635 existing records. [2025-10-15T17:29:50.519057] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-15T17:29:50.607103] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:50.607556] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-15T17:29:50.607632] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-15T17:29:50.607942] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-15T17:29:50.608009] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-15T17:29:50.821416] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-15T17:29:50.900878] [INFO ] [MAIN ] BBVA: Loaded 49107 existing records. [2025-10-15T17:29:51.188973] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:51.217935] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:51.218165] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-15T17:29:51.218223] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-15T17:29:51.218605] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-15T17:29:51.218693] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-15T17:29:51.319267] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-15T17:29:51.592675] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:51.657249] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:29:52.034260] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T17:29:52.114048] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-15T17:29:52.738496] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:29:52.914051] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-15T17:29:53.427571] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T17:29:53.714012] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-15T17:29:54.256167] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T17:29:54.513996] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-15T17:29:55.313986] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-15T17:29:55.431028] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T17:29:55.742884] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T17:29:56.114038] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-15T17:29:56.624463] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T17:29:56.914011] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-15T17:29:57.714003] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-15T17:29:57.769174] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T17:29:58.513995] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-15T17:29:59.313999] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-15T17:29:59.674079] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T17:29:59.769710] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T17:29:59.849949] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T17:30:00.114020] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-15T17:30:00.878338] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T17:30:00.914024] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-15T17:30:01.714086] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-15T17:30:02.012376] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T17:30:02.321303] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T17:30:02.514070] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-15T17:30:03.314056] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-15T17:30:04.114063] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-15T17:30:04.199774] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:30:04.609802] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T17:30:04.906276] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:30:04.908513] [INFO ] [REMOTE ] BBN: Full fetch complete (25519 records). [2025-10-15T17:30:04.908598] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-15T17:30:04.909262] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:04.909366] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:04.909418] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:04.909492] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-15T17:30:04.909563] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-15T17:30:04.909608] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-15T17:30:04.909848] [DEBUG] [LOCAL ] BBN: Deleted derivative data file. [2025-10-15T17:30:04.909958] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBN took 30.4s. Estimated remaining: 4h 47m 20s. Rate: 7.5 symbols/min [2025-10-15T17:30:04.921246] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-15T17:30:05.099015] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:05.132008] [DEBUG] [LOCAL ] BBW: Loaded 27403 existing records from primary storage. [2025-10-15T17:30:05.132599] [INFO ] [MAIN ] BBW: Loaded 27403 existing records. [2025-10-15T17:30:05.326958] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:05.327205] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-15T17:30:05.327259] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-15T17:30:05.327634] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-15T17:30:05.327729] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-15T17:30:05.727380] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-15T17:30:05.734750] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:06.485814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T17:30:06.514022] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-15T17:30:06.730611] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T17:30:07.314022] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-15T17:30:07.551766] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T17:30:08.114016] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-15T17:30:08.914061] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-15T17:30:09.012149] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:30:09.273938] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T17:30:09.437051] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:30:09.714058] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-15T17:30:10.514050] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-15T17:30:11.299213] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:30:11.301496] [INFO ] [REMOTE ] BBU: Full fetch complete (7156 records). [2025-10-15T17:30:11.301578] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-15T17:30:11.302133] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:11.302223] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:11.302297] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:11.302385] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-15T17:30:11.302474] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-15T17:30:11.302531] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-15T17:30:11.302593] [DEBUG] [LOCAL ] BBU: No derivative data file found to delete. [2025-10-15T17:30:11.302678] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBU took 23.8s. Estimated remaining: 4h 46m 57s. Rate: 7.5 symbols/min [2025-10-15T17:30:11.319074] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-15T17:30:11.496777] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:11.552371] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-15T17:30:11.552825] [INFO ] [MAIN ] BBWI: Loaded 53584 existing records. [2025-10-15T17:30:11.741945] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:11.742295] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-15T17:30:11.742349] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-15T17:30:11.742980] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-15T17:30:11.743040] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-15T17:30:12.114928] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-15T17:30:12.154441] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-15T17:30:12.188885] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:12.441046] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:30:12.914091] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-15T17:30:13.581949] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T17:30:13.714039] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-15T17:30:14.459787] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T17:30:14.514032] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-15T17:30:14.779446] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:30:15.314012] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-15T17:30:15.373810] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T17:30:16.114030] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-15T17:30:16.922313] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-15T17:30:16.947967] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:30:17.648885] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T17:30:17.714024] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-15T17:30:17.856749] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:30:18.514021] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-15T17:30:18.742975] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T17:30:19.177245] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T17:30:19.314029] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-15T17:30:20.114024] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-15T17:30:20.253968] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T17:30:20.892864] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T17:30:20.895531] [INFO ] [REMOTE ] BBUC: Full fetch complete (18704 records). [2025-10-15T17:30:20.895609] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-15T17:30:20.896193] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:20.896307] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:20.896421] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:20.896481] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-15T17:30:20.896583] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-15T17:30:20.896637] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-15T17:30:20.897008] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-10-15T17:30:20.897126] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBUC took 30.9s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-15T17:30:20.919146] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-15T17:30:21.079909] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:21.080144] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-10-15T17:30:21.080193] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-10-15T17:30:21.080316] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-15T17:30:21.080360] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-15T17:30:21.080436] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-15T17:30:21.080496] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-15T17:30:21.469887] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:21.714038] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-15T17:30:22.514086] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-15T17:30:22.675014] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T17:30:23.314052] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-15T17:30:23.388951] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:30:24.114005] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-15T17:30:24.272995] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T17:30:24.657824] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:30:24.914108] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-15T17:30:25.714047] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-15T17:30:25.933570] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:30:26.101856] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T17:30:26.514099] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-15T17:30:27.314063] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-15T17:30:27.655253] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:30:28.114055] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-15T17:30:28.315325] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:30:28.393918] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T17:30:28.914060] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-15T17:30:29.713986] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-15T17:30:29.914072] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T17:30:30.514000] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-15T17:30:30.865314] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-15T17:30:31.006795] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:30:31.314070] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-15T17:30:32.113999] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-15T17:30:32.518546] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T17:30:32.914035] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-15T17:30:33.055302] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T17:30:33.714028] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-15T17:30:34.133678] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T17:30:34.514231] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-15T17:30:35.314008] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-15T17:30:35.611393] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-15T17:30:35.618097] [INFO ] [REMOTE ] BBVA: Full fetch complete (71747 records). [2025-10-15T17:30:35.618279] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-15T17:30:36.047750] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-15T17:30:36.100326] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-15T17:30:36.100561] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-15T17:30:36.101826] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-15T17:30:36.112551] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-15T17:30:36.114629] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-15T17:30:36.119751] [DEBUG] [LOCAL ] BBVA: Trimmed 71747 records to 49092 (keeping 200 days of data) [2025-10-15T17:30:36.264724] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:30:36.495007] [DEBUG] [LOCAL ] BBVA: Primary data saved (49092 records). [2025-10-15T17:30:36.495206] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-15T17:30:36.495309] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBVA took 46.3s. Estimated remaining: 4h 48m 7s. Rate: 7.4 symbols/min [2025-10-15T17:30:36.689007] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:36.706611] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:30:36.755156] [DEBUG] [LOCAL ] BC: Loaded 44123 existing records from primary storage. [2025-10-15T17:30:36.755566] [INFO ] [MAIN ] BC: Loaded 44123 existing records. [2025-10-15T17:30:36.917247] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-15T17:30:36.948120] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:36.948443] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-15T17:30:36.948496] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-15T17:30:36.949070] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-15T17:30:36.949148] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-15T17:30:37.329026] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:37.714033] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-15T17:30:38.044519] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T17:30:38.513996] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-15T17:30:38.635973] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:30:39.037212] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T17:30:39.314047] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-15T17:30:40.113989] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-15T17:30:40.251799] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:30:40.483929] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:30:40.914023] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-15T17:30:41.714054] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-15T17:30:41.865573] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T17:30:42.514033] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-15T17:30:42.560695] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:30:43.314066] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-15T17:30:43.584555] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T17:30:44.172394] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-15T17:30:44.202459] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T17:30:44.367011] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T17:30:44.914023] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-15T17:30:45.714000] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-15T17:30:45.816986] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:30:45.824036] [INFO ] [REMOTE ] BBWI: Full fetch complete (77622 records). [2025-10-15T17:30:45.824240] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-15T17:30:46.219170] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-15T17:30:46.219308] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-15T17:30:46.220285] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-15T17:30:46.220360] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-15T17:30:46.222015] [DEBUG] [LOCAL ] BBWI: Trimmed 77622 records to 53584 (keeping 200 days of data) [2025-10-15T17:30:46.329555] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:30:46.520519] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-15T17:30:46.568288] [DEBUG] [LOCAL ] BBWI: Primary data saved (53584 records). [2025-10-15T17:30:46.568445] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-15T17:30:46.568528] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBWI took 35.3s. Estimated remaining: 4h 48m 17s. Rate: 7.4 symbols/min [2025-10-15T17:30:46.744159] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:46.778597] [DEBUG] [LOCAL ] BCAT: Loaded 34173 existing records from primary storage. [2025-10-15T17:30:46.778987] [INFO ] [MAIN ] BCAT: Loaded 34173 existing records. [2025-10-15T17:30:46.964755] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:46.965358] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-15T17:30:46.965559] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-15T17:30:46.966438] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-15T17:30:46.966498] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-15T17:30:47.143141] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:30:47.319185] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-15T17:30:47.388612] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:48.007860] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:30:48.113991] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-15T17:30:48.914021] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-15T17:30:49.062672] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:30:49.561511] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:30:49.714039] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-15T17:30:50.153401] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:30:50.157906] [INFO ] [REMOTE ] BBW: Full fetch complete (39570 records). [2025-10-15T17:30:50.158039] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-15T17:30:50.158801] [FATAL] [VALIDATOR ] BBW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:50.158892] [FATAL] [MAIN ] BBW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:50.158936] [WARN ] [MAIN ] BBW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:50.158979] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-15T17:30:50.159044] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-15T17:30:50.159082] [INFO ] [LOCAL ] BBW: Starting deletion of derivative data. [2025-10-15T17:30:50.159412] [DEBUG] [LOCAL ] BBW: Deleted derivative data file. [2025-10-15T17:30:50.159518] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBW took 45.2s. Estimated remaining: 4h 47m 27s. Rate: 7.4 symbols/min [2025-10-15T17:30:50.343170] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:50.377409] [DEBUG] [LOCAL ] BCC: Loaded 28478 existing records from primary storage. [2025-10-15T17:30:50.377819] [INFO ] [MAIN ] BCC: Loaded 28478 existing records. [2025-10-15T17:30:50.520329] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-15T17:30:50.564232] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:50.564481] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-15T17:30:50.564531] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-15T17:30:50.565152] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-15T17:30:50.565212] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-15T17:30:50.966773] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:50.980076] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T17:30:51.313999] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-15T17:30:52.114073] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-15T17:30:52.185612] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T17:30:52.914017] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-15T17:30:53.087721] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:30:53.228027] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T17:30:53.714013] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-15T17:30:54.439811] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:30:54.513968] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-15T17:30:54.626554] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T17:30:55.314008] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-15T17:30:56.043521] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T17:30:56.113978] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-15T17:30:56.554326] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:30:56.914049] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-15T17:30:57.400724] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:30:57.714019] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-15T17:30:58.361830] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:30:58.514025] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-15T17:30:59.054323] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:30:59.314024] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-15T17:31:00.113966] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-15T17:31:00.276510] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T17:31:00.282872] [INFO ] [REMOTE ] BBY: Full fetch complete (77394 records). [2025-10-15T17:31:00.283001] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-15T17:31:00.693792] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-15T17:31:00.694037] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-15T17:31:00.695119] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-15T17:31:00.695222] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-15T17:31:00.716964] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T17:31:00.717118] [DEBUG] [LOCAL ] BBY: Trimmed 77394 records to 53445 (keeping 200 days of data) [2025-10-15T17:31:00.915182] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-15T17:31:01.058735] [DEBUG] [LOCAL ] BBY: Primary data saved (53445 records). [2025-10-15T17:31:01.058890] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-15T17:31:01.058971] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBY took 40.2s. Estimated remaining: 4h 47m 46s. Rate: 7.4 symbols/min [2025-10-15T17:31:01.236161] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:01.255808] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:31:01.311804] [DEBUG] [LOCAL ] BCE: Loaded 52241 existing records from primary storage. [2025-10-15T17:31:01.312121] [INFO ] [MAIN ] BCE: Loaded 52241 existing records. [2025-10-15T17:31:01.494834] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:01.495103] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-15T17:31:01.495159] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-15T17:31:01.496078] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-15T17:31:01.496137] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-15T17:31:01.722739] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-15T17:31:01.889915] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:02.514015] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-15T17:31:02.644827] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T17:31:03.319900] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-15T17:31:03.325095] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T17:31:04.114014] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-15T17:31:04.522179] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T17:31:04.836100] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T17:31:04.913979] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-15T17:31:05.396191] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T17:31:05.714004] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-15T17:31:06.368138] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T17:31:06.514112] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-15T17:31:07.313976] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-15T17:31:07.366320] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T17:31:07.803994] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T17:31:08.114056] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-15T17:31:08.739983] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T17:31:08.744915] [INFO ] [REMOTE ] BC: Full fetch complete (63748 records). [2025-10-15T17:31:08.745022] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-15T17:31:08.920249] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-15T17:31:09.137754] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-15T17:31:09.137857] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-15T17:31:09.138780] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-15T17:31:09.138855] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-15T17:31:09.155099] [DEBUG] [LOCAL ] BC: Trimmed 63748 records to 44083 (keeping 200 days of data) [2025-10-15T17:31:09.154800] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T17:31:09.428263] [DEBUG] [LOCAL ] BC: Primary data saved (44083 records). [2025-10-15T17:31:09.428403] [INFO ] [MAIN ] BC: Full history saved. [2025-10-15T17:31:09.428481] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BC took 32.9s. Estimated remaining: 4h 47m 40s. Rate: 7.4 symbols/min [2025-10-15T17:31:09.592893] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:09.623083] [DEBUG] [LOCAL ] BCH: Loaded 30171 existing records from primary storage. [2025-10-15T17:31:09.623397] [INFO ] [MAIN ] BCH: Loaded 30171 existing records. [2025-10-15T17:31:09.719121] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-15T17:31:09.812402] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:09.812689] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-15T17:31:09.812750] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-15T17:31:09.813379] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-15T17:31:09.813437] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-15T17:31:10.198664] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:10.284296] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T17:31:10.514037] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-15T17:31:11.246816] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T17:31:11.314053] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-15T17:31:12.020602] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T17:31:12.114008] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-15T17:31:12.809890] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:31:12.914005] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-15T17:31:13.713974] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-15T17:31:13.839407] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:31:14.214797] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T17:31:14.514014] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-15T17:31:14.829812] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T17:31:15.313993] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-15T17:31:16.113977] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-15T17:31:16.253921] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:31:16.593969] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:31:16.914044] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-15T17:31:17.393563] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T17:31:17.713991] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-15T17:31:18.037249] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T17:31:18.045006] [INFO ] [REMOTE ] BCAT: Full fetch complete (49983 records). [2025-10-15T17:31:18.045159] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-15T17:31:18.426965] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-15T17:31:18.427056] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-15T17:31:18.427786] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-15T17:31:18.427851] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-15T17:31:18.428949] [DEBUG] [LOCAL ] BCAT: Trimmed 49983 records to 34198 (keeping 200 days of data) [2025-10-15T17:31:18.516374] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-15T17:31:18.651350] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:31:18.664813] [DEBUG] [LOCAL ] BCAT: Primary data saved (34198 records). [2025-10-15T17:31:18.664961] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-15T17:31:18.665232] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCAT took 32.1s. Estimated remaining: 4h 47m 43s. Rate: 7.4 symbols/min [2025-10-15T17:31:18.842783] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:18.869394] [DEBUG] [LOCAL ] BCO: Loaded 25488 existing records from primary storage. [2025-10-15T17:31:18.869727] [INFO ] [MAIN ] BCO: Loaded 25488 existing records. [2025-10-15T17:31:19.072329] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:19.072623] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-15T17:31:19.072704] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-15T17:31:19.073352] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-15T17:31:19.073437] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-15T17:31:19.319233] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-15T17:31:19.559525] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:19.872914] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:31:19.881056] [INFO ] [REMOTE ] BCC: Full fetch complete (41224 records). [2025-10-15T17:31:19.881329] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-15T17:31:20.119158] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-15T17:31:20.417586] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-15T17:31:20.417731] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-15T17:31:20.418553] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-15T17:31:20.418636] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-15T17:31:20.419880] [DEBUG] [LOCAL ] BCC: Trimmed 41224 records to 28504 (keeping 200 days of data) [2025-10-15T17:31:20.541693] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:31:20.631706] [DEBUG] [LOCAL ] BCC: Primary data saved (28504 records). [2025-10-15T17:31:20.631874] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-15T17:31:20.631967] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 30.5s. Estimated remaining: 4h 46m 39s. Rate: 7.5 symbols/min [2025-10-15T17:31:20.823052] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:20.877571] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-15T17:31:20.878003] [INFO ] [MAIN ] BCS: Loaded 53441 existing records. [2025-10-15T17:31:20.924084] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-15T17:31:21.084986] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:21.085297] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-15T17:31:21.085380] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-15T17:31:21.086531] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-15T17:31:21.086688] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-15T17:31:21.471151] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T17:31:21.517243] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:21.714037] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-15T17:31:21.962802] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T17:31:22.514017] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-15T17:31:23.314042] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-15T17:31:23.513286] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T17:31:23.560606] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:31:24.113988] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-15T17:31:24.467686] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T17:31:24.913964] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-15T17:31:25.213295] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T17:31:25.713974] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-15T17:31:26.058521] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T17:31:26.513982] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-15T17:31:27.272213] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:31:27.313963] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-15T17:31:28.113998] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-15T17:31:28.327811] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T17:31:28.512363] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T17:31:28.913948] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-15T17:31:29.128808] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:31:29.714013] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-15T17:31:30.087380] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T17:31:30.514126] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-15T17:31:31.314017] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-15T17:31:31.494693] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T17:31:32.114034] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-15T17:31:32.333039] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T17:31:32.389269] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:31:32.914051] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-15T17:31:33.713997] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-15T17:31:34.020331] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:31:34.173014] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:31:34.514015] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-15T17:31:35.313998] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-15T17:31:35.814767] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-15T17:31:36.100045] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:31:36.113947] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-15T17:31:36.282165] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T17:31:36.286588] [INFO ] [REMOTE ] BCH: Full fetch complete (41483 records). [2025-10-15T17:31:36.286715] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-15T17:31:36.287212] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:31:36.287292] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:31:36.287334] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:31:36.287377] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-15T17:31:36.287473] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-15T17:31:36.287588] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-10-15T17:31:36.287847] [DEBUG] [LOCAL ] BCH: Deleted derivative data file. [2025-10-15T17:31:36.287934] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCH took 26.9s. Estimated remaining: 4h 47m 40s. Rate: 7.4 symbols/min [2025-10-15T17:31:36.463270] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:36.491795] [DEBUG] [LOCAL ] BCSF: Loaded 28261 existing records from primary storage. [2025-10-15T17:31:36.492110] [INFO ] [MAIN ] BCSF: Loaded 28261 existing records. [2025-10-15T17:31:36.675957] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:36.676224] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-15T17:31:36.676282] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-15T17:31:36.676890] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-15T17:31:36.676947] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-15T17:31:36.919164] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-15T17:31:37.038719] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:37.424119] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:31:37.714025] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-15T17:31:38.284988] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T17:31:38.491607] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:31:38.513952] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-15T17:31:39.313978] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-15T17:31:39.405934] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T17:31:40.114008] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-15T17:31:40.812253] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T17:31:40.818623] [INFO ] [REMOTE ] BCE: Full fetch complete (76116 records). [2025-10-15T17:31:40.818824] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-15T17:31:40.917344] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-15T17:31:41.232418] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-15T17:31:41.232801] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-15T17:31:41.233849] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-15T17:31:41.233916] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-15T17:31:41.235458] [DEBUG] [LOCAL ] BCE: Trimmed 76116 records to 52247 (keeping 200 days of data) [2025-10-15T17:31:41.344780] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:31:41.580265] [DEBUG] [LOCAL ] BCE: Primary data saved (52247 records). [2025-10-15T17:31:41.580387] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-15T17:31:41.581422] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCE took 40.5s. Estimated remaining: 4h 47m 7s. Rate: 7.4 symbols/min [2025-10-15T17:31:41.731698] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-15T17:31:41.771309] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:41.797336] [DEBUG] [LOCAL ] BCX: Loaded 21952 existing records from primary storage. [2025-10-15T17:31:41.797753] [INFO ] [MAIN ] BCX: Loaded 21952 existing records. [2025-10-15T17:31:41.934397] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T17:31:42.004612] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:42.004946] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-15T17:31:42.004998] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-15T17:31:42.005863] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-15T17:31:42.005926] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-15T17:31:42.373791] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:42.514011] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-15T17:31:43.313978] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-15T17:31:43.732369] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:31:43.763175] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:31:44.113998] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-15T17:31:44.244393] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T17:31:44.913966] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-15T17:31:45.084250] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T17:31:45.714003] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-15T17:31:45.845809] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T17:31:46.513980] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-15T17:31:46.738551] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:31:47.314025] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-15T17:31:47.651527] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:31:48.114020] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-15T17:31:48.451830] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:31:48.914006] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-15T17:31:49.277303] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T17:31:49.713989] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-15T17:31:49.936752] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T17:31:50.513999] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-15T17:31:50.641953] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:31:50.645052] [INFO ] [REMOTE ] BCO: Full fetch complete (36288 records). [2025-10-15T17:31:50.645189] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-15T17:31:51.037901] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-15T17:31:51.038015] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-15T17:31:51.038948] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-15T17:31:51.039016] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-15T17:31:51.043418] [DEBUG] [LOCAL ] BCO: Trimmed 36288 records to 25461 (keeping 200 days of data) [2025-10-15T17:31:51.211392] [DEBUG] [LOCAL ] BCO: Primary data saved (25461 records). [2025-10-15T17:31:51.211729] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-15T17:31:51.211887] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCO took 32.5s. Estimated remaining: 4h 47m 13s. Rate: 7.4 symbols/min [2025-10-15T17:31:51.316719] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-15T17:31:51.410776] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:51.454783] [DEBUG] [LOCAL ] BDC: Loaded 24554 existing records from primary storage. [2025-10-15T17:31:51.456311] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T17:31:51.456831] [INFO ] [MAIN ] BDC: Loaded 24554 existing records. [2025-10-15T17:31:51.667946] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:51.668210] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-15T17:31:51.668304] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-15T17:31:51.668715] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-15T17:31:51.668775] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-15T17:31:52.065907] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:52.114004] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-15T17:31:52.914025] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-15T17:31:53.348235] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-15T17:31:53.534571] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:31:53.713997] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-15T17:31:54.244726] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T17:31:54.514080] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-15T17:31:54.563927] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:31:55.313997] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-15T17:31:55.597446] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T17:31:56.114042] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-15T17:31:56.332471] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T17:31:56.914023] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-15T17:31:57.185370] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T17:31:57.713985] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-15T17:31:57.844243] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T17:31:58.514060] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-15T17:31:59.313984] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-15T17:31:59.407630] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:32:00.114005] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-15T17:32:00.477192] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-15T17:32:00.913973] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-15T17:32:01.164341] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:32:01.182766] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:32:01.714082] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-15T17:32:02.037094] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T17:32:02.514032] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-15T17:32:02.642338] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:32:02.645796] [INFO ] [REMOTE ] BCX: Full fetch complete (33882 records). [2025-10-15T17:32:02.645873] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-15T17:32:03.044495] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-15T17:32:03.044592] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-15T17:32:03.045138] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-15T17:32:03.045198] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-15T17:32:03.045947] [DEBUG] [LOCAL ] BCX: Trimmed 33882 records to 22028 (keeping 200 days of data) [2025-10-15T17:32:03.172382] [DEBUG] [LOCAL ] BCX: Primary data saved (22028 records). [2025-10-15T17:32:03.172515] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-15T17:32:03.172589] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCX took 21.6s. Estimated remaining: 4h 47m 40s. Rate: 7.4 symbols/min [2025-10-15T17:32:03.314078] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-15T17:32:04.040383] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T17:32:04.113974] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-15T17:32:04.477152] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T17:32:04.913997] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-15T17:32:05.432174] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T17:32:05.713997] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-15T17:32:06.341568] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T17:32:06.514040] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-15T17:32:07.196792] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:32:07.201718] [INFO ] [REMOTE ] BCSF: Full fetch complete (39378 records). [2025-10-15T17:32:07.201811] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-15T17:32:07.319135] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-15T17:32:07.602064] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-15T17:32:07.602147] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-15T17:32:07.602778] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-15T17:32:07.602839] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-15T17:32:07.603734] [DEBUG] [LOCAL ] BCSF: Trimmed 39378 records to 28156 (keeping 200 days of data) [2025-10-15T17:32:07.774751] [DEBUG] [LOCAL ] BCSF: Primary data saved (28156 records). [2025-10-15T17:32:07.774902] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-15T17:32:07.774982] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 31.5s. Estimated remaining: 4h 47m 0s. Rate: 7.4 symbols/min [2025-10-15T17:32:08.390417] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T17:32:08.401944] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-15T17:32:08.766137] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:32:08.913966] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-15T17:32:10.288718] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T17:32:10.300783] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-15T17:32:10.334084] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:32:10.513999] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-15T17:32:11.698209] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:32:11.704975] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-15T17:32:11.814491] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T17:32:11.821343] [INFO ] [REMOTE ] BCS: Full fetch complete (77507 records). [2025-10-15T17:32:11.821548] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-15T17:32:12.351314] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-15T17:32:12.351485] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-15T17:32:12.352854] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-15T17:32:12.352945] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-15T17:32:12.355089] [DEBUG] [LOCAL ] BCS: Trimmed 77507 records to 53442 (keeping 200 days of data) [2025-10-15T17:32:12.636916] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:32:12.666422] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-15T17:32:12.802422] [DEBUG] [LOCAL ] BCS: Primary data saved (53442 records). [2025-10-15T17:32:12.802621] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-15T17:32:12.802993] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCS took 52.2s. Estimated remaining: 4h 46m 25s. Rate: 7.4 symbols/min [2025-10-15T17:32:13.842365] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:32:13.848499] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-15T17:32:15.102636] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:32:15.108687] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-15T17:32:16.151953] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:32:16.158281] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-15T17:32:17.514385] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:32:17.518137] [INFO ] [REMOTE ] BDC: Full fetch complete (35751 records). [2025-10-15T17:32:17.518297] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-15T17:32:17.518949] [FATAL] [VALIDATOR ] BDC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:32:17.519041] [FATAL] [MAIN ] BDC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:32:17.519085] [WARN ] [MAIN ] BDC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:32:17.519125] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-15T17:32:17.519182] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-15T17:32:17.519218] [INFO ] [LOCAL ] BDC: Starting deletion of derivative data. [2025-10-15T17:32:17.519369] [DEBUG] [LOCAL ] BDC: Deleted derivative data file. [2025-10-15T17:32:17.519460] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 26.3s. Estimated remaining: 4h 45m 47s. Rate: 7.4 symbols/min [2025-10-15T17:32:18.123991] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.273213] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.296638] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.296880] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-15T17:32:18.279194] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.297257] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-15T17:32:18.297808] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-15T17:32:18.297878] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-15T17:32:18.298055] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-15T17:32:18.298107] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-15T17:32:18.575613] [DEBUG] [LOCAL ] BDJ: Loaded 29403 existing records from primary storage. [2025-10-15T17:32:18.592803] [INFO ] [MAIN ] BDJ: Loaded 29403 existing records. [2025-10-15T17:32:18.761372] [DEBUG] [LOCAL ] BDX: Loaded 52180 existing records from primary storage. [2025-10-15T17:32:18.813555] [DEBUG] [LOCAL ] BDN: Loaded 47627 existing records from primary storage. [2025-10-15T17:32:18.813710] [INFO ] [MAIN ] BDX: Loaded 52180 existing records. [2025-10-15T17:32:18.857759] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:18.891927] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-15T17:32:18.875308] [INFO ] [MAIN ] BDN: Loaded 47627 existing records. [2025-10-15T17:32:19.112700] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:19.174805] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-15T17:32:19.201560] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-15T17:32:19.212119] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-15T17:32:19.281864] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-15T17:32:19.323349] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:19.357372] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-15T17:32:19.357279] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:19.365804] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-15T17:32:19.357613] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-15T17:32:19.394017] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-15T17:32:19.414793] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-15T17:32:19.406477] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-15T17:32:19.480092] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-15T17:32:19.523038] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-15T17:32:20.366008] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:20.410155] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-15T17:32:20.488059] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:20.510759] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-15T17:32:20.600371] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:20.600878] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-15T17:32:21.334123] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-15T17:32:21.344991] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-15T17:32:21.614616] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T17:32:21.621415] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-15T17:32:22.116457] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:32:22.127224] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-15T17:32:22.328589] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T17:32:22.340253] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-15T17:32:22.820258] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:32:22.827127] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-15T17:32:23.396467] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T17:32:23.407614] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-15T17:32:23.621612] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T17:32:23.633512] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-15T17:32:23.682868] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:32:23.718528] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T17:32:24.114022] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-15T17:32:24.914006] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-15T17:32:25.421960] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T17:32:25.547788] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T17:32:25.615432] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:32:25.713965] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-15T17:32:26.152711] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:32:26.514010] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-15T17:32:27.314028] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-15T17:32:27.618220] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T17:32:28.114044] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-15T17:32:28.648480] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T17:32:28.763327] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:32:28.914090] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-15T17:32:29.714029] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-15T17:32:30.043682] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T17:32:30.513985] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-15T17:32:31.313971] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-15T17:32:31.425588] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:32:31.535591] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T17:32:32.114016] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-15T17:32:32.729204] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-15T17:32:32.747029] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T17:32:32.914035] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-15T17:32:33.229258] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:32:33.714026] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-15T17:32:34.125955] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T17:32:34.514070] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-15T17:32:35.071350] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T17:32:35.313991] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-15T17:32:35.613559] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T17:32:36.113993] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-15T17:32:36.921566] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-15T17:32:36.924485] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T17:32:37.713956] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-15T17:32:38.037476] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T17:32:38.514013] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-15T17:32:39.314031] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-15T17:32:39.469114] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:32:39.583353] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-15T17:32:40.114075] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-15T17:32:40.754380] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T17:32:40.907802] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:32:40.917361] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-15T17:32:41.117682] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T17:32:41.714015] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-15T17:32:42.513992] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-15T17:32:43.179586] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T17:32:43.313971] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-15T17:32:43.356361] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-15T17:32:44.114034] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-15T17:32:44.211716] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:32:44.914036] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-15T17:32:45.064105] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T17:32:45.714006] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-15T17:32:46.250394] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:32:46.254496] [INFO ] [REMOTE ] BDJ: Full fetch complete (43106 records). [2025-10-15T17:32:46.254586] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-15T17:32:46.467561] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-15T17:32:46.513977] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-15T17:32:46.725178] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-15T17:32:46.725285] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-15T17:32:46.725945] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-15T17:32:46.726014] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-15T17:32:46.727126] [DEBUG] [LOCAL ] BDJ: Trimmed 43106 records to 29470 (keeping 200 days of data) [2025-10-15T17:32:46.901317] [DEBUG] [LOCAL ] BDJ: Primary data saved (29470 records). [2025-10-15T17:32:46.901461] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-15T17:32:46.901541] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDJ took 29.4s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-15T17:32:47.073970] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:47.074179] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-15T17:32:47.074216] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-15T17:32:47.074324] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-15T17:32:47.074365] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-15T17:32:47.074404] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-15T17:32:47.074436] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-15T17:32:47.317746] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-15T17:32:47.452097] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:47.619350] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:32:48.113985] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-15T17:32:48.233685] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:32:48.239742] [INFO ] [REMOTE ] BDN: Full fetch complete (69342 records). [2025-10-15T17:32:48.239889] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-15T17:32:48.631928] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-15T17:32:48.632024] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-15T17:32:48.632955] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-15T17:32:48.633030] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-15T17:32:48.634482] [DEBUG] [LOCAL ] BDN: Trimmed 69342 records to 47666 (keeping 200 days of data) [2025-10-15T17:32:48.909080] [DEBUG] [LOCAL ] BDN: Primary data saved (47666 records). [2025-10-15T17:32:48.909237] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-15T17:32:48.909322] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDN took 31.4s. Estimated remaining: 4h 47m 45s. Rate: 7.4 symbols/min [2025-10-15T17:32:48.941168] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-15T17:32:49.084908] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:49.138889] [DEBUG] [LOCAL ] BEKE: Loaded 53218 existing records from primary storage. [2025-10-15T17:32:49.139247] [INFO ] [MAIN ] BEKE: Loaded 53218 existing records. [2025-10-15T17:32:49.315161] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:49.315394] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-15T17:32:49.315441] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-15T17:32:49.315849] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-15T17:32:49.315904] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-15T17:32:49.532234] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T17:32:49.678319] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:49.713968] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-15T17:32:50.035554] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:32:50.050093] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T17:32:50.325431] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-15T17:32:50.335054] [INFO ] [REMOTE ] BE: Full fetch complete (77813 records). [2025-10-15T17:32:50.335264] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-15T17:32:50.522846] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-15T17:32:50.741622] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-15T17:32:50.741752] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-15T17:32:50.742595] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-15T17:32:50.742637] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-15T17:32:50.744100] [DEBUG] [LOCAL ] BE: Trimmed 77813 records to 53661 (keeping 200 days of data) [2025-10-15T17:32:50.919725] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T17:32:51.062765] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-15T17:32:51.062926] [INFO ] [MAIN ] BE: Full history saved. [2025-10-15T17:32:51.062998] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BE took 33.5s. Estimated remaining: 4h 46m 45s. Rate: 7.4 symbols/min [2025-10-15T17:32:51.232920] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:51.281628] [DEBUG] [LOCAL ] BEN: Loaded 53122 existing records from primary storage. [2025-10-15T17:32:51.282024] [INFO ] [MAIN ] BEN: Loaded 53122 existing records. [2025-10-15T17:32:51.319134] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-15T17:32:51.465730] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:51.465956] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-15T17:32:51.466003] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-15T17:32:51.466565] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-15T17:32:51.466623] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-15T17:32:51.846584] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:52.114009] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-15T17:32:52.531064] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:32:52.914025] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-15T17:32:53.272019] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-15T17:32:53.714009] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-15T17:32:54.156529] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T17:32:54.513982] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-15T17:32:54.615421] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:32:54.857265] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T17:32:55.314070] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-15T17:32:56.113990] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-15T17:32:56.913981] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-15T17:32:57.232824] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T17:32:57.235428] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T17:32:57.714000] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-15T17:32:57.808204] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:32:57.982156] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-15T17:32:58.514019] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-15T17:32:59.314047] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-15T17:33:00.005427] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:33:00.012223] [INFO ] [REMOTE ] BDX: Full fetch complete (75561 records). [2025-10-15T17:33:00.012440] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-15T17:33:00.119102] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-15T17:33:00.426485] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-15T17:33:00.451464] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-15T17:33:00.451569] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-15T17:33:00.452547] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-15T17:33:00.452616] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-15T17:33:00.454260] [DEBUG] [LOCAL ] BDX: Trimmed 75561 records to 52176 (keeping 200 days of data) [2025-10-15T17:33:00.781614] [DEBUG] [LOCAL ] BDX: Primary data saved (52176 records). [2025-10-15T17:33:00.781815] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-15T17:33:00.781902] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BDX took 43.2s. Estimated remaining: 4h 46m 51s. Rate: 7.4 symbols/min [2025-10-15T17:33:00.926007] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-15T17:33:00.958756] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:01.000748] [DEBUG] [LOCAL ] BEP: Loaded 38935 existing records from primary storage. [2025-10-15T17:33:01.001090] [INFO ] [MAIN ] BEP: Loaded 38935 existing records. [2025-10-15T17:33:01.215509] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:01.215959] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-15T17:33:01.216162] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-15T17:33:01.225971] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-15T17:33:01.241313] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-15T17:33:01.307388] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T17:33:01.662867] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:01.713948] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-15T17:33:02.514040] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-15T17:33:02.789956] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:33:03.170840] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:33:03.314077] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-15T17:33:04.113975] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-15T17:33:04.200140] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T17:33:04.765396] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T17:33:04.913978] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-15T17:33:05.211301] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T17:33:05.713997] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-15T17:33:06.514017] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-15T17:33:06.563844] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T17:33:06.976223] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T17:33:06.977036] [INFO ] [REMOTE ] BEDU: Full fetch complete (1342 records). [2025-10-15T17:33:06.977104] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-15T17:33:07.149945] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-15T17:33:07.150118] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:33:07.150224] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:33:07.150313] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-15T17:33:07.150391] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-15T17:33:07.150430] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-15T17:33:07.150475] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-15T17:33:07.150528] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 20.2s. Estimated remaining: 4h 46m 28s. Rate: 7.4 symbols/min [2025-10-15T17:33:07.317732] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-15T17:33:07.322976] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:07.377389] [DEBUG] [LOCAL ] BEPC: Loaded 46493 existing records from primary storage. [2025-10-15T17:33:07.377871] [INFO ] [MAIN ] BEPC: Loaded 46493 existing records. [2025-10-15T17:33:07.568488] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:07.598122] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-15T17:33:07.598302] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-15T17:33:07.599200] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-15T17:33:07.600427] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-15T17:33:07.600338] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:33:07.995813] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:08.113973] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-15T17:33:08.903122] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T17:33:08.913950] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-15T17:33:09.713980] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-15T17:33:09.903161] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T17:33:10.469433] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:33:10.513962] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-15T17:33:11.314021] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-15T17:33:12.114028] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-15T17:33:12.752457] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-15T17:33:12.865513] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T17:33:12.913953] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-15T17:33:13.714134] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-15T17:33:14.001039] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (3.49 seconds). [2025-10-15T17:33:14.349511] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:33:14.513976] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-15T17:33:14.835834] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-15T17:33:15.234509] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T17:33:15.313998] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-15T17:33:16.114001] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-15T17:33:16.365021] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:33:16.913976] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-15T17:33:17.184186] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T17:33:17.714039] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-15T17:33:17.799574] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:33:18.352135] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T17:33:18.514007] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-15T17:33:19.313989] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-15T17:33:19.411414] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:33:19.754688] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:33:20.114083] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-15T17:33:20.740309] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:33:20.914020] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-15T17:33:21.372124] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T17:33:21.714084] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-15T17:33:22.514117] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-15T17:33:22.854978] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T17:33:23.314064] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-15T17:33:23.507361] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:33:23.594167] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:33:24.114024] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-15T17:33:24.638079] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T17:33:24.914028] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-15T17:33:25.714095] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-15T17:33:25.986134] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:33:25.993180] [INFO ] [REMOTE ] BEN: Full fetch complete (77088 records). [2025-10-15T17:33:25.993357] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-15T17:33:26.408443] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-15T17:33:26.408549] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-15T17:33:26.409722] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-15T17:33:26.409788] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-15T17:33:26.412062] [DEBUG] [LOCAL ] BEN: Trimmed 77088 records to 53122 (keeping 200 days of data) [2025-10-15T17:33:26.515846] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-15T17:33:26.769028] [DEBUG] [LOCAL ] BEN: Primary data saved (53122 records). [2025-10-15T17:33:26.769248] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-15T17:33:26.769365] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEN took 35.7s. Estimated remaining: 4h 47m 60s. Rate: 7.4 symbols/min [2025-10-15T17:33:26.961602] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:26.978185] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T17:33:26.985716] [INFO ] [REMOTE ] BEKE: Full fetch complete (76963 records). [2025-10-15T17:33:26.987891] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-15T17:33:26.989508] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:33:26.993287] [DEBUG] [LOCAL ] BEPH: Loaded 5235 existing records from primary storage. [2025-10-15T17:33:26.993397] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:33:26.993811] [INFO ] [MAIN ] BEPH: Loaded 5235 existing records. [2025-10-15T17:33:26.993925] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:33:27.039769] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-15T17:33:27.067489] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-10-15T17:33:27.074872] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-10-15T17:33:27.102560] [DEBUG] [LOCAL ] BEKE: Deleted derivative data file. [2025-10-15T17:33:27.102893] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 38.2s. Estimated remaining: 4h 46m 44s. Rate: 7.4 symbols/min [2025-10-15T17:33:27.276198] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:27.312998] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-15T17:33:27.332196] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-15T17:33:27.348171] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-15T17:33:27.353532] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-15T17:33:27.436696] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:33:27.469223] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:27.531693] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-15T17:33:27.567022] [DEBUG] [LOCAL ] BEPI: Loaded 3611 existing records from primary storage. [2025-10-15T17:33:27.567474] [INFO ] [MAIN ] BEPI: Loaded 3611 existing records. [2025-10-15T17:33:28.078895] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:28.099407] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:33:28.105611] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:28.109256] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-15T17:33:28.114218] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-15T17:33:28.114101] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-15T17:33:28.115907] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-15T17:33:28.115967] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-15T17:33:28.501040] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:28.907388] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T17:33:28.913955] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-15T17:33:29.713983] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-15T17:33:30.217172] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-15T17:33:30.280457] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:33:30.369750] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T17:33:30.514063] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-15T17:33:31.314048] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-15T17:33:31.740129] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T17:33:31.875918] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T17:33:32.114096] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-15T17:33:32.914072] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-15T17:33:33.350934] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:33:33.654996] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:33:33.714032] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-15T17:33:34.168997] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T17:33:34.514014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-15T17:33:34.934948] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:33:35.314016] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-15T17:33:36.114029] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-15T17:33:36.771935] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T17:33:36.914042] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-15T17:33:37.433699] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T17:33:37.603323] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T17:33:37.714027] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-15T17:33:38.337137] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T17:33:38.514012] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-15T17:33:39.314043] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-15T17:33:39.913696] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T17:33:40.114019] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-15T17:33:40.361095] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:33:40.783613] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T17:33:40.914066] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-15T17:33:41.481077] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T17:33:41.714058] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-15T17:33:42.300014] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T17:33:42.514014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-15T17:33:42.935817] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T17:33:43.314043] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-15T17:33:44.114010] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-15T17:33:44.667417] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T17:33:44.914034] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-15T17:33:45.063826] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:33:45.070125] [INFO ] [REMOTE ] BEPC: Full fetch complete (68910 records). [2025-10-15T17:33:45.070282] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-15T17:33:45.461323] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T17:33:45.485922] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-15T17:33:45.486007] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-15T17:33:45.486894] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-15T17:33:45.489234] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-15T17:33:45.491683] [DEBUG] [LOCAL ] BEPC: Trimmed 68910 records to 46488 (keeping 200 days of data) [2025-10-15T17:33:45.714793] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-15T17:33:45.792131] [DEBUG] [LOCAL ] BEPC: Primary data saved (46488 records). [2025-10-15T17:33:45.792320] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-15T17:33:45.793558] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEPC took 38.6s. Estimated remaining: 4h 48m 7s. Rate: 7.4 symbols/min [2025-10-15T17:33:45.987414] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:45.995467] [DEBUG] [LOCAL ] BEPJ: Loaded 3116 existing records from primary storage. [2025-10-15T17:33:45.995825] [INFO ] [MAIN ] BEPJ: Loaded 3116 existing records. [2025-10-15T17:33:46.177358] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:46.177706] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-15T17:33:46.177768] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-15T17:33:46.177979] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-15T17:33:46.178051] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-15T17:33:46.519155] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-15T17:33:46.558862] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:47.003928] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T17:33:47.296412] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:33:47.313963] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-15T17:33:48.114022] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-15T17:33:48.642342] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:33:48.648471] [INFO ] [REMOTE ] BEP: Full fetch complete (59183 records). [2025-10-15T17:33:48.648616] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-15T17:33:48.761477] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:33:48.919258] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-15T17:33:49.076455] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-15T17:33:49.076827] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-15T17:33:49.077712] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-15T17:33:49.077777] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-15T17:33:49.079310] [DEBUG] [LOCAL ] BEP: Trimmed 59183 records to 38951 (keeping 200 days of data) [2025-10-15T17:33:49.326919] [DEBUG] [LOCAL ] BEP: Primary data saved (38951 records). [2025-10-15T17:33:49.327112] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-15T17:33:49.327622] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEP took 48.5s. Estimated remaining: 4h 47m 19s. Rate: 7.4 symbols/min [2025-10-15T17:33:49.503610] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:49.550627] [DEBUG] [LOCAL ] BFAM: Loaded 33752 existing records from primary storage. [2025-10-15T17:33:49.551744] [INFO ] [MAIN ] BFAM: Loaded 33752 existing records. [2025-10-15T17:33:49.552043] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T17:33:49.717580] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-15T17:33:49.742220] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:49.742733] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-15T17:33:49.742794] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-15T17:33:49.743398] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-15T17:33:49.743471] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-15T17:33:50.123608] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:50.186632] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T17:33:50.514053] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-15T17:33:51.200004] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T17:33:51.201130] [INFO ] [REMOTE ] BEPH: Full fetch complete (7570 records). [2025-10-15T17:33:51.201198] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-15T17:33:51.201581] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:33:51.201686] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:33:51.201736] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:33:51.201874] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-15T17:33:51.201941] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-15T17:33:51.201975] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-10-15T17:33:51.202155] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-10-15T17:33:51.202239] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPH took 24.4s. Estimated remaining: 4h 46m 18s. Rate: 7.4 symbols/min [2025-10-15T17:33:51.319238] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-15T17:33:51.370884] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:51.371108] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-10-15T17:33:51.371145] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-10-15T17:33:51.371259] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-15T17:33:51.371302] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-15T17:33:51.371342] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-15T17:33:51.371374] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-15T17:33:51.735203] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:51.934793] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T17:33:52.114031] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-15T17:33:52.480694] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T17:33:52.914040] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-15T17:33:53.526326] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T17:33:53.527518] [INFO ] [REMOTE ] BEPI: Full fetch complete (4772 records). [2025-10-15T17:33:53.527623] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-15T17:33:53.723298] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-15T17:33:53.903900] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-15T17:33:53.903995] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-15T17:33:53.904203] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-15T17:33:53.904244] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-15T17:33:53.904689] [DEBUG] [LOCAL ] BEPI: Trimmed 4772 records to 3616 (keeping 200 days of data) [2025-10-15T17:33:53.928631] [DEBUG] [LOCAL ] BEPI: Primary data saved (3616 records). [2025-10-15T17:33:53.928826] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-15T17:33:53.928938] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPI took 26.8s. Estimated remaining: 4h 45m 25s. Rate: 7.4 symbols/min [2025-10-15T17:33:54.108434] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:54.108671] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-15T17:33:54.108727] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-15T17:33:54.108850] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-15T17:33:54.108892] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-15T17:33:54.108959] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-15T17:33:54.109005] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-15T17:33:54.477425] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:54.514006] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-15T17:33:55.251319] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:33:55.314040] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-15T17:33:55.535606] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T17:33:56.114054] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-15T17:33:56.614096] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:33:56.914004] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-15T17:33:57.713996] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-15T17:33:58.019461] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:33:58.185210] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:33:58.189081] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:33:58.514060] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-15T17:33:59.313996] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-15T17:33:59.366021] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T17:34:00.114025] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-15T17:34:00.314331] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T17:34:00.914024] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-15T17:34:00.936759] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T17:34:01.453109] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T17:34:01.714023] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-15T17:34:02.152220] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T17:34:02.514024] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-15T17:34:03.314084] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-15T17:34:04.044953] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T17:34:04.114022] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-15T17:34:04.773287] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T17:34:04.914048] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-15T17:34:05.039022] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T17:34:05.290928] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T17:34:05.714028] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-15T17:34:06.170709] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T17:34:06.514022] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-15T17:34:07.314036] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-15T17:34:07.927229] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T17:34:08.114069] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-15T17:34:08.469634] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T17:34:08.914049] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-15T17:34:09.420948] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T17:34:09.714040] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-15T17:34:09.852051] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T17:34:10.071121] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-15T17:34:10.514032] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-15T17:34:10.850719] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T17:34:11.314071] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-15T17:34:11.885809] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T17:34:11.887086] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4452 records). [2025-10-15T17:34:11.887181] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-15T17:34:12.125553] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-15T17:34:12.364030] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-15T17:34:12.364147] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-15T17:34:12.364376] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-15T17:34:12.364452] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-15T17:34:12.364960] [DEBUG] [LOCAL ] BEPJ: Trimmed 4452 records to 3112 (keeping 200 days of data) [2025-10-15T17:34:12.387253] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3112 records). [2025-10-15T17:34:12.387396] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-15T17:34:12.387581] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPJ took 26.6s. Estimated remaining: 4h 46m 44s. Rate: 7.4 symbols/min [2025-10-15T17:34:12.564388] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:12.564598] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-10-15T17:34:12.564636] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-10-15T17:34:12.564781] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-15T17:34:12.564823] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-15T17:34:12.564864] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-15T17:34:12.564897] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-15T17:34:12.919200] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-15T17:34:12.989638] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:13.472252] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:34:13.714012] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-15T17:34:14.054400] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:34:14.514064] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-15T17:34:15.109860] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:34:15.314098] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-15T17:34:16.114024] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-15T17:34:16.348791] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T17:34:16.503706] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T17:34:16.914086] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-15T17:34:17.595130] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T17:34:17.714077] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-15T17:34:17.943345] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T17:34:18.373233] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:34:18.514077] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-15T17:34:19.314018] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-15T17:34:20.114128] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-15T17:34:20.144468] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:34:20.255235] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:34:20.914015] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-15T17:34:21.714029] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-15T17:34:21.920996] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T17:34:22.268811] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:34:22.514046] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-15T17:34:23.054791] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:34:23.059504] [INFO ] [REMOTE ] BFAM: Full fetch complete (46975 records). [2025-10-15T17:34:23.059636] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-15T17:34:23.060607] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:34:23.060732] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:34:23.060801] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:34:23.060855] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-15T17:34:23.060925] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-15T17:34:23.060968] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-10-15T17:34:23.061175] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-10-15T17:34:23.061279] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFAM took 33.7s. Estimated remaining: 4h 46m 57s. Rate: 7.4 symbols/min [2025-10-15T17:34:23.244310] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:23.258065] [DEBUG] [LOCAL ] BFS: Loaded 9545 existing records from primary storage. [2025-10-15T17:34:23.258346] [INFO ] [MAIN ] BFS: Loaded 9545 existing records. [2025-10-15T17:34:23.322193] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-15T17:34:23.451096] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:23.451377] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-15T17:34:23.451435] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-15T17:34:23.451698] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-15T17:34:23.451778] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-15T17:34:23.853611] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:23.881867] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T17:34:24.114013] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-15T17:34:24.859037] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:34:24.880554] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T17:34:24.914084] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-15T17:34:25.714025] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-15T17:34:26.460882] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T17:34:26.514020] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-15T17:34:26.640909] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:34:27.258195] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T17:34:27.314044] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-15T17:34:28.114035] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-15T17:34:28.698976] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:34:28.717751] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:34:28.719995] [INFO ] [REMOTE ] BFK: Full fetch complete (18968 records). [2025-10-15T17:34:28.720076] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-15T17:34:28.923134] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-15T17:34:29.109946] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-15T17:34:29.110041] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-15T17:34:29.110569] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-15T17:34:29.110679] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-15T17:34:29.111444] [DEBUG] [LOCAL ] BFK: Trimmed 18968 records to 13505 (keeping 200 days of data) [2025-10-15T17:34:29.197846] [DEBUG] [LOCAL ] BFK: Primary data saved (13505 records). [2025-10-15T17:34:29.198028] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-15T17:34:29.198117] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFK took 35.3s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-10-15T17:34:29.384724] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:29.402182] [DEBUG] [LOCAL ] BFZ: Loaded 11900 existing records from primary storage. [2025-10-15T17:34:29.402525] [INFO ] [MAIN ] BFZ: Loaded 11900 existing records. [2025-10-15T17:34:29.594907] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:29.595189] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-15T17:34:29.595247] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-15T17:34:29.595492] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-15T17:34:29.595552] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-15T17:34:29.719161] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-15T17:34:29.980064] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:30.442087] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T17:34:30.513982] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-15T17:34:30.797632] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T17:34:31.062203] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T17:34:31.314020] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-15T17:34:32.114045] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-15T17:34:32.917427] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-15T17:34:32.923177] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:34:32.924531] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T17:34:33.714031] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-15T17:34:34.514034] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-15T17:34:34.555039] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:34:34.757198] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T17:34:35.314036] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-15T17:34:36.117512] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:34:36.116094] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-15T17:34:36.145195] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:34:36.657705] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T17:34:36.913981] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-15T17:34:37.694087] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T17:34:37.713979] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-15T17:34:38.351272] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T17:34:38.514038] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-15T17:34:39.314014] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-15T17:34:39.945905] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T17:34:40.113999] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-15T17:34:40.758715] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T17:34:40.915011] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-15T17:34:40.919022] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T17:34:41.714019] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-15T17:34:42.244332] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:34:42.250228] [INFO ] [REMOTE ] BFH: Full fetch complete (60072 records). [2025-10-15T17:34:42.250417] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-15T17:34:42.520457] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-15T17:34:42.660449] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-15T17:34:42.660557] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-15T17:34:42.661490] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-15T17:34:42.661555] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-15T17:34:42.663422] [DEBUG] [LOCAL ] BFH: Trimmed 60072 records to 41564 (keeping 200 days of data) [2025-10-15T17:34:42.924623] [DEBUG] [LOCAL ] BFH: Primary data saved (41564 records). [2025-10-15T17:34:42.924823] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-15T17:34:42.924912] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFH took 51.7s. Estimated remaining: 4h 47m 10s. Rate: 7.4 symbols/min [2025-10-15T17:34:43.100208] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:43.153746] [DEBUG] [LOCAL ] BG: Loaded 50480 existing records from primary storage. [2025-10-15T17:34:43.154144] [INFO ] [MAIN ] BG: Loaded 50480 existing records. [2025-10-15T17:34:43.316729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-15T17:34:43.350991] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:43.352019] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-15T17:34:43.352342] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-15T17:34:43.353899] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-15T17:34:43.354118] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-15T17:34:43.532236] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T17:34:43.529139] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T17:34:43.831993] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:44.114023] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-15T17:34:44.213770] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:34:44.914055] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-15T17:34:45.714045] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-15T17:34:45.764277] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:34:45.992491] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:34:46.514014] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-15T17:34:47.219629] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T17:34:47.221797] [INFO ] [REMOTE ] BFS: Full fetch complete (13008 records). [2025-10-15T17:34:47.221885] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-15T17:34:47.319202] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-15T17:34:47.630746] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-15T17:34:47.630861] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-15T17:34:47.631260] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-15T17:34:47.631335] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-15T17:34:47.632164] [DEBUG] [LOCAL ] BFS: Trimmed 13008 records to 9589 (keeping 200 days of data) [2025-10-15T17:34:47.714340] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T17:34:47.740105] [DEBUG] [LOCAL ] BFS: Primary data saved (9589 records). [2025-10-15T17:34:47.740255] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-15T17:34:47.740346] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFS took 24.7s. Estimated remaining: 4h 46m 35s. Rate: 7.4 symbols/min [2025-10-15T17:34:47.909775] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:47.930751] [DEBUG] [LOCAL ] BGB: Loaded 17991 existing records from primary storage. [2025-10-15T17:34:47.931047] [INFO ] [MAIN ] BGB: Loaded 17991 existing records. [2025-10-15T17:34:48.117841] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-15T17:34:48.111663] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:48.120288] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T17:34:48.121426] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-15T17:34:48.124943] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-15T17:34:48.125668] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-15T17:34:48.125738] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-15T17:34:48.498565] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:48.914042] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-15T17:34:49.714038] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-15T17:34:50.157989] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:34:50.167621] [INFO ] [REMOTE ] BFLY: Full fetch complete (75504 records). [2025-10-15T17:34:50.167842] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-15T17:34:50.516801] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-15T17:34:50.611758] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-15T17:34:50.612383] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-15T17:34:50.613523] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-15T17:34:50.613633] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-15T17:34:50.648925] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T17:34:50.659922] [DEBUG] [LOCAL ] BFLY: Trimmed 75504 records to 51836 (keeping 200 days of data) [2025-10-15T17:34:50.763709] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T17:34:50.997857] [DEBUG] [LOCAL ] BFLY: Primary data saved (51836 records). [2025-10-15T17:34:50.998038] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-15T17:34:50.998120] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFLY took 38.6s. Estimated remaining: 4h 45m 46s. Rate: 7.4 symbols/min [2025-10-15T17:34:51.171159] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:51.190815] [DEBUG] [LOCAL ] BGH: Loaded 17259 existing records from primary storage. [2025-10-15T17:34:51.191120] [INFO ] [MAIN ] BGH: Loaded 17259 existing records. [2025-10-15T17:34:51.314909] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-15T17:34:51.348446] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T17:34:51.398090] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:51.398501] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-15T17:34:51.398555] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-15T17:34:51.398829] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-15T17:34:51.398888] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-15T17:34:51.756777] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:52.113984] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-15T17:34:52.856126] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T17:34:52.903796] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:34:52.913948] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-15T17:34:53.714016] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-15T17:34:54.340957] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T17:34:54.513968] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-15T17:34:54.704284] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:34:55.313971] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-15T17:34:55.495124] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T17:34:56.114034] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-15T17:34:56.211907] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T17:34:56.763821] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:34:56.914052] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-15T17:34:57.714121] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-15T17:34:58.514043] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-15T17:34:58.655914] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T17:34:58.803759] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T17:34:59.096578] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:34:59.313982] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-15T17:35:00.113968] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-15T17:35:00.315942] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T17:35:00.914051] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-15T17:35:01.565797] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T17:35:01.714124] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-15T17:35:01.864199] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T17:35:02.513985] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-15T17:35:02.579022] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T17:35:03.314062] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-15T17:35:03.639587] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T17:35:04.113997] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-15T17:35:04.914027] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-15T17:35:05.012311] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:35:05.043304] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:35:05.664618] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T17:35:05.713975] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-15T17:35:06.514058] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-15T17:35:06.672761] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:35:07.313978] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-15T17:35:07.451709] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T17:35:08.114067] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-15T17:35:08.910889] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T17:35:08.915266] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-15T17:35:09.239540] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T17:35:09.659626] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:35:09.713976] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-15T17:35:10.514018] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-15T17:35:10.646208] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:35:11.314018] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-15T17:35:12.084712] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T17:35:12.084017] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:35:12.113977] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-15T17:35:12.914011] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-15T17:35:12.968218] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T17:35:12.970123] [INFO ] [REMOTE ] BFZ: Full fetch complete (17432 records). [2025-10-15T17:35:12.970227] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-15T17:35:13.343492] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-15T17:35:13.343571] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-15T17:35:13.343994] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-15T17:35:13.344055] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-15T17:35:13.344559] [DEBUG] [LOCAL ] BFZ: Trimmed 17432 records to 11947 (keeping 200 days of data) [2025-10-15T17:35:13.415667] [DEBUG] [LOCAL ] BFZ: Primary data saved (11947 records). [2025-10-15T17:35:13.415835] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-15T17:35:13.415922] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFZ took 44.2s. Estimated remaining: 4h 47m 35s. Rate: 7.3 symbols/min [2025-10-15T17:35:13.585952] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:13.601519] [DEBUG] [LOCAL ] BGR: Loaded 13590 existing records from primary storage. [2025-10-15T17:35:13.601772] [INFO ] [MAIN ] BGR: Loaded 13590 existing records. [2025-10-15T17:35:13.714954] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-15T17:35:13.789484] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:13.796878] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-15T17:35:13.797019] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-15T17:35:13.798420] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-15T17:35:13.798350] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T17:35:13.798634] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-15T17:35:14.156498] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:14.514065] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-15T17:35:15.167490] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T17:35:15.313987] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-15T17:35:15.351737] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:35:16.113980] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-15T17:35:16.272378] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T17:35:16.739430] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T17:35:16.914016] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-15T17:35:17.692267] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:35:17.713971] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-15T17:35:18.513998] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-15T17:35:18.694612] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T17:35:18.697459] [INFO ] [REMOTE ] BGH: Full fetch complete (22849 records). [2025-10-15T17:35:18.697577] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-15T17:35:19.075568] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-15T17:35:19.075673] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-15T17:35:19.076159] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-15T17:35:19.076205] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-15T17:35:19.076811] [DEBUG] [LOCAL ] BGH: Trimmed 22849 records to 17264 (keeping 200 days of data) [2025-10-15T17:35:19.177931] [DEBUG] [LOCAL ] BGH: Primary data saved (17264 records). [2025-10-15T17:35:19.178073] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-15T17:35:19.178171] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BGH took 28.2s. Estimated remaining: 4h 47m 7s. Rate: 7.3 symbols/min [2025-10-15T17:35:19.315195] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-15T17:35:19.349867] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:19.398937] [DEBUG] [LOCAL ] BGS: Loaded 50514 existing records from primary storage. [2025-10-15T17:35:19.399270] [INFO ] [MAIN ] BGS: Loaded 50514 existing records. [2025-10-15T17:35:19.584672] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:19.591570] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-15T17:35:19.591512] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T17:35:19.591696] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-15T17:35:19.594710] [INFO ] [REMOTE ] BGB: Full fetch complete (26875 records). [2025-10-15T17:35:19.594782] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-15T17:35:19.594875] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-15T17:35:19.594991] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-15T17:35:20.118333] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-15T17:35:20.311423] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:20.340067] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-15T17:35:20.340154] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-15T17:35:20.340667] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-15T17:35:20.340733] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-15T17:35:20.341430] [DEBUG] [LOCAL ] BGB: Trimmed 26875 records to 17952 (keeping 200 days of data) [2025-10-15T17:35:20.447660] [DEBUG] [LOCAL ] BGB: Primary data saved (17952 records). [2025-10-15T17:35:20.447826] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-15T17:35:20.447907] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGB took 32.7s. Estimated remaining: 4h 46m 3s. Rate: 7.4 symbols/min [2025-10-15T17:35:20.616430] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:20.625572] [DEBUG] [LOCAL ] BGSF: Loaded 7899 existing records from primary storage. [2025-10-15T17:35:20.625809] [INFO ] [MAIN ] BGSF: Loaded 7899 existing records. [2025-10-15T17:35:20.812006] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:20.812185] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-15T17:35:20.812235] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-15T17:35:20.812407] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-15T17:35:20.812465] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-15T17:35:20.919133] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-15T17:35:21.173793] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:21.275381] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:35:21.372247] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T17:35:21.378483] [INFO ] [REMOTE ] BG: Full fetch complete (72958 records). [2025-10-15T17:35:21.378676] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-15T17:35:21.719377] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-15T17:35:21.772434] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-15T17:35:21.772521] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-15T17:35:21.773466] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-15T17:35:21.773529] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-15T17:35:21.775199] [DEBUG] [LOCAL ] BG: Trimmed 72958 records to 50524 (keeping 200 days of data) [2025-10-15T17:35:22.085509] [DEBUG] [LOCAL ] BG: Primary data saved (50524 records). [2025-10-15T17:35:22.085688] [INFO ] [MAIN ] BG: Full history saved. [2025-10-15T17:35:22.085784] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BG took 39.2s. Estimated remaining: 4h 45m 3s. Rate: 7.4 symbols/min [2025-10-15T17:35:22.253112] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:22.271496] [DEBUG] [LOCAL ] BGT: Loaded 16483 existing records from primary storage. [2025-10-15T17:35:22.271747] [INFO ] [MAIN ] BGT: Loaded 16483 existing records. [2025-10-15T17:35:22.455057] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:22.455421] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-15T17:35:22.455524] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-15T17:35:22.455998] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-15T17:35:22.456081] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-15T17:35:22.520049] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-15T17:35:22.613787] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T17:35:22.784943] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:35:22.910134] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:23.249482] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T17:35:23.314014] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-15T17:35:24.114023] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-15T17:35:24.164245] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:35:24.914009] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-15T17:35:25.608362] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T17:35:25.713973] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-15T17:35:25.845027] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:35:26.514018] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-15T17:35:27.149195] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:35:27.269782] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:35:27.313970] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-15T17:35:28.034534] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T17:35:28.114052] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-15T17:35:28.659117] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T17:35:28.914047] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-15T17:35:29.407483] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T17:35:29.714089] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-15T17:35:30.514063] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-15T17:35:31.104716] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:35:31.151965] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:35:31.314027] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-15T17:35:31.723707] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T17:35:32.114024] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-15T17:35:32.559551] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T17:35:32.914028] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-15T17:35:33.714044] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-15T17:35:33.897167] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T17:35:34.349592] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T17:35:34.514001] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-15T17:35:35.314006] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-15T17:35:36.114026] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-15T17:35:36.132537] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:35:36.181971] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T17:35:36.914036] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-15T17:35:37.189786] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T17:35:37.714020] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-15T17:35:38.521170] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-15T17:35:38.545499] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:35:38.614716] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T17:35:39.314008] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-15T17:35:39.596632] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T17:35:39.622629] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-15T17:35:40.113987] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-15T17:35:40.914002] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-15T17:35:40.930767] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T17:35:41.714048] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-15T17:35:42.380498] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:35:42.397736] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T17:35:42.513965] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-15T17:35:43.314065] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-15T17:35:43.877206] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T17:35:44.113974] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-15T17:35:44.275243] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:35:44.913987] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-15T17:35:45.015551] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:35:45.713970] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-15T17:35:45.865347] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:35:46.514051] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-15T17:35:47.178380] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:35:47.314050] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-15T17:35:47.479550] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T17:35:48.114022] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-15T17:35:48.501754] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T17:35:48.914059] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-15T17:35:49.714051] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-15T17:35:49.886626] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:35:50.114188] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T17:35:50.116550] [INFO ] [REMOTE ] BGSF: Full fetch complete (9515 records). [2025-10-15T17:35:50.116621] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-15T17:35:50.484914] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-15T17:35:50.485169] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:35:50.485373] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-15T17:35:50.487841] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-15T17:35:50.488005] [INFO ] [REMOTE ] BGR: Full fetch complete (20072 records). [2025-10-15T17:35:50.488082] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-15T17:35:50.488386] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-15T17:35:50.489185] [DEBUG] [LOCAL ] BGSF: Trimmed 9515 records to 7984 (keeping 200 days of data) [2025-10-15T17:35:50.514866] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-15T17:35:50.621991] [DEBUG] [LOCAL ] BGSF: Primary data saved (7984 records). [2025-10-15T17:35:50.634093] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-15T17:35:50.641532] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGSF took 30.2s. Estimated remaining: 4h 47m 39s. Rate: 7.3 symbols/min [2025-10-15T17:35:51.017203] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:51.139826] [DEBUG] [LOCAL ] BGX: Loaded 11165 existing records from primary storage. [2025-10-15T17:35:51.140292] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-15T17:35:51.140543] [INFO ] [MAIN ] BGX: Loaded 11165 existing records. [2025-10-15T17:35:51.140672] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-15T17:35:51.171939] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-15T17:35:51.183288] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-15T17:35:51.238225] [DEBUG] [LOCAL ] BGR: Trimmed 20072 records to 13605 (keeping 200 days of data) [2025-10-15T17:35:51.320420] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-15T17:35:51.389343] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:51.415412] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-15T17:35:51.416791] [DEBUG] [LOCAL ] BGR: Primary data saved (13605 records). [2025-10-15T17:35:51.415584] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-15T17:35:51.417008] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-15T17:35:51.417397] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGR took 38.0s. Estimated remaining: 4h 46m 31s. Rate: 7.4 symbols/min [2025-10-15T17:35:51.417599] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-15T17:35:51.417795] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-15T17:35:51.782965] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:51.883712] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:35:51.978287] [DEBUG] [LOCAL ] BGY: Loaded 21940 existing records from primary storage. [2025-10-15T17:35:51.997634] [INFO ] [MAIN ] BGY: Loaded 21940 existing records. [2025-10-15T17:35:51.997510] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:52.119153] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-15T17:35:52.196694] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:52.196905] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-15T17:35:52.196957] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-15T17:35:52.197347] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-15T17:35:52.197404] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-15T17:35:52.562416] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:52.866525] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T17:35:52.873606] [INFO ] [REMOTE ] BGS: Full fetch complete (72657 records). [2025-10-15T17:35:52.873782] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-15T17:35:52.919172] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-15T17:35:53.285527] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-15T17:35:53.285665] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-15T17:35:53.286639] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-15T17:35:53.286745] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-15T17:35:53.301903] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:35:53.307990] [DEBUG] [LOCAL ] BGS: Trimmed 72657 records to 50534 (keeping 200 days of data) [2025-10-15T17:35:53.599154] [DEBUG] [LOCAL ] BGS: Primary data saved (50534 records). [2025-10-15T17:35:53.599311] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-15T17:35:53.600323] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGS took 34.4s. Estimated remaining: 4h 45m 36s. Rate: 7.4 symbols/min [2025-10-15T17:35:53.719251] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-15T17:35:53.768258] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:53.786544] [DEBUG] [LOCAL ] BH: Loaded 16212 existing records from primary storage. [2025-10-15T17:35:53.786847] [INFO ] [MAIN ] BH: Loaded 16212 existing records. [2025-10-15T17:35:53.963114] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:53.963624] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-15T17:35:53.963887] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-15T17:35:53.964184] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-15T17:35:53.964244] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-15T17:35:54.105052] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T17:35:54.342450] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:54.513974] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-15T17:35:54.672695] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T17:35:55.314057] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-15T17:35:55.525859] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:35:56.026433] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T17:35:56.113950] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-15T17:35:56.853199] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T17:35:56.914014] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-15T17:35:57.388692] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:35:57.713998] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-15T17:35:58.514038] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-15T17:35:58.571160] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:35:59.314075] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-15T17:35:59.441947] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T17:36:00.114053] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-15T17:36:00.150511] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T17:36:00.914075] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-15T17:36:01.109094] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:36:01.112880] [INFO ] [REMOTE ] BGT: Full fetch complete (24166 records). [2025-10-15T17:36:01.113068] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-15T17:36:01.639848] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-15T17:36:01.640048] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-15T17:36:01.640784] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-15T17:36:01.640944] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-15T17:36:01.653932] [DEBUG] [LOCAL ] BGT: Trimmed 24166 records to 16412 (keeping 200 days of data) [2025-10-15T17:36:01.653413] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T17:36:01.714094] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-15T17:36:01.775265] [DEBUG] [LOCAL ] BGT: Primary data saved (16412 records). [2025-10-15T17:36:01.775494] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-15T17:36:01.775675] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGT took 39.7s. Estimated remaining: 4h 45m 28s. Rate: 7.4 symbols/min [2025-10-15T17:36:01.991598] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:02.041704] [DEBUG] [LOCAL ] BHC: Loaded 46658 existing records from primary storage. [2025-10-15T17:36:02.042316] [INFO ] [MAIN ] BHC: Loaded 46658 existing records. [2025-10-15T17:36:02.256046] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:02.256301] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-15T17:36:02.256391] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-15T17:36:02.256814] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-15T17:36:02.256870] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-15T17:36:02.494384] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T17:36:02.519311] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-15T17:36:02.682504] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:03.314021] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-15T17:36:03.591536] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T17:36:04.113996] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-15T17:36:04.480192] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T17:36:04.913994] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-15T17:36:05.372991] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T17:36:05.714009] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-15T17:36:06.321166] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T17:36:06.459002] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:36:06.513953] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-15T17:36:07.195198] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T17:36:07.314004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-15T17:36:08.074958] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:36:08.114001] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-15T17:36:08.913998] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-15T17:36:08.952678] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:36:09.714018] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-15T17:36:10.433337] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:36:10.514010] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-15T17:36:10.557915] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:36:11.313999] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-15T17:36:12.114522] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-15T17:36:12.118900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:36:12.169386] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T17:36:12.914097] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-15T17:36:13.160267] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:36:13.713989] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-15T17:36:13.785122] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:36:14.513966] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-15T17:36:14.653475] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T17:36:15.313977] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-15T17:36:16.084439] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T17:36:16.113955] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-15T17:36:16.222831] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:36:16.755942] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T17:36:16.913998] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-15T17:36:17.713978] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-15T17:36:17.795689] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:36:18.514054] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-15T17:36:19.208988] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:36:19.257553] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:36:19.313998] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-15T17:36:20.114002] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-15T17:36:20.818600] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:36:20.913983] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-15T17:36:20.983572] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T17:36:21.714047] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-15T17:36:22.358755] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:36:22.469536] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T17:36:22.513955] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-15T17:36:23.313975] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-15T17:36:23.367603] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:36:24.114052] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-15T17:36:24.913969] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-15T17:36:24.989172] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T17:36:25.025629] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:36:25.620165] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T17:36:25.713991] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-15T17:36:26.463609] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:36:26.513964] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-15T17:36:27.313986] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-15T17:36:27.414960] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:36:27.418456] [INFO ] [REMOTE ] BGY: Full fetch complete (33116 records). [2025-10-15T17:36:27.418835] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-15T17:36:27.837437] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-15T17:36:27.837553] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-15T17:36:27.838129] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-15T17:36:27.838192] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-15T17:36:27.839048] [DEBUG] [LOCAL ] BGY: Trimmed 33116 records to 21983 (keeping 200 days of data) [2025-10-15T17:36:27.964415] [DEBUG] [LOCAL ] BGY: Primary data saved (21983 records). [2025-10-15T17:36:27.964592] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-15T17:36:27.964747] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGY took 36.5s. Estimated remaining: 4h 47m 42s. Rate: 7.3 symbols/min [2025-10-15T17:36:28.114489] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-15T17:36:28.140224] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:28.148335] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T17:36:28.150920] [INFO ] [REMOTE ] BH: Full fetch complete (19517 records). [2025-10-15T17:36:28.151079] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-15T17:36:28.341048] [DEBUG] [LOCAL ] BHE: Loaded 23832 existing records from primary storage. [2025-10-15T17:36:28.383431] [INFO ] [MAIN ] BHE: Loaded 23832 existing records. [2025-10-15T17:36:28.695585] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-15T17:36:28.708561] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-15T17:36:28.716298] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-15T17:36:28.716755] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-15T17:36:28.737604] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:28.738368] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-15T17:36:28.738204] [DEBUG] [LOCAL ] BH: Trimmed 19517 records to 16248 (keeping 200 days of data) [2025-10-15T17:36:28.738475] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-15T17:36:28.738919] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-15T17:36:28.739200] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-15T17:36:28.920705] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-15T17:36:29.000592] [DEBUG] [LOCAL ] BH: Primary data saved (16248 records). [2025-10-15T17:36:29.025350] [INFO ] [MAIN ] BH: Full history saved. [2025-10-15T17:36:29.039859] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BH took 35.4s. Estimated remaining: 4h 46m 38s. Rate: 7.3 symbols/min [2025-10-15T17:36:29.122050] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:36:29.229997] [INFO ] [REMOTE ] BGX: Full fetch complete (16592 records). [2025-10-15T17:36:29.242130] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-15T17:36:29.465300] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:29.538841] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:29.719203] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-15T17:36:29.765168] [DEBUG] [LOCAL ] BHK: Loaded 23624 existing records from primary storage. [2025-10-15T17:36:29.765718] [INFO ] [MAIN ] BHK: Loaded 23624 existing records. [2025-10-15T17:36:30.003535] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-15T17:36:30.008820] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-15T17:36:30.015221] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-15T17:36:30.015316] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-15T17:36:30.047109] [DEBUG] [LOCAL ] BGX: Trimmed 16592 records to 11151 (keeping 200 days of data) [2025-10-15T17:36:30.046946] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:30.047506] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-15T17:36:30.047973] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-15T17:36:30.048600] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-15T17:36:30.048721] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-15T17:36:30.235029] [DEBUG] [LOCAL ] BGX: Primary data saved (11151 records). [2025-10-15T17:36:30.269171] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-15T17:36:30.275150] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGX took 39.6s. Estimated remaining: 4h 45m 35s. Rate: 7.4 symbols/min [2025-10-15T17:36:30.663327] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:30.707628] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:30.709186] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-15T17:36:30.739330] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T17:36:30.802072] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-15T17:36:30.802536] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-10-15T17:36:30.997705] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:31.012247] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-15T17:36:31.013610] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-15T17:36:31.013503] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T17:36:31.018465] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-15T17:36:31.019218] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-15T17:36:31.318541] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-15T17:36:31.411608] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:31.721830] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T17:36:32.114064] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-15T17:36:32.238921] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T17:36:32.914028] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-15T17:36:33.714056] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-15T17:36:33.889049] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T17:36:33.918865] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T17:36:34.514030] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-15T17:36:35.252745] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:36:35.258468] [INFO ] [REMOTE ] BHC: Full fetch complete (67415 records). [2025-10-15T17:36:35.258581] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-15T17:36:35.320828] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-15T17:36:35.638088] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-15T17:36:35.638178] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-15T17:36:35.639002] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-15T17:36:35.639064] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-15T17:36:35.640594] [DEBUG] [LOCAL ] BHC: Trimmed 67415 records to 46689 (keeping 200 days of data) [2025-10-15T17:36:35.909433] [DEBUG] [LOCAL ] BHC: Primary data saved (46689 records). [2025-10-15T17:36:35.909613] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-15T17:36:35.909756] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHC took 34.1s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-15T17:36:36.108496] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:36.115160] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-15T17:36:36.121709] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:36:36.150171] [DEBUG] [LOCAL ] BHR: Loaded 22078 existing records from primary storage. [2025-10-15T17:36:36.150523] [INFO ] [MAIN ] BHR: Loaded 22078 existing records. [2025-10-15T17:36:36.332933] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:36.333507] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-15T17:36:36.333568] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-15T17:36:36.344912] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-15T17:36:36.345015] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-15T17:36:36.446837] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T17:36:36.741340] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:36.914070] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-15T17:36:37.438246] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T17:36:37.714053] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-15T17:36:38.067470] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:36:38.514008] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-15T17:36:39.251897] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:36:39.314000] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-15T17:36:39.557510] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T17:36:40.114030] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-15T17:36:40.913984] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-15T17:36:40.987879] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:36:41.336676] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T17:36:41.713966] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-15T17:36:41.859826] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T17:36:42.513999] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-15T17:36:43.314019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-15T17:36:43.351681] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T17:36:43.375673] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T17:36:44.114051] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-15T17:36:44.331914] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T17:36:44.914083] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-15T17:36:45.714023] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-15T17:36:45.934588] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:36:45.993907] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T17:36:46.513962] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-15T17:36:46.577971] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T17:36:47.314022] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-15T17:36:48.114027] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-15T17:36:48.218309] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:36:48.216816] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:36:48.914023] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-15T17:36:49.015507] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:36:49.714104] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-15T17:36:50.481869] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T17:36:50.513972] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-15T17:36:50.992247] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:36:51.313984] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-15T17:36:51.396971] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:36:52.114018] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-15T17:36:52.468184] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:36:52.913989] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-15T17:36:53.066611] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T17:36:53.713972] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-15T17:36:53.775252] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T17:36:54.513977] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-15T17:36:54.790233] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T17:36:55.314082] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-15T17:36:56.113997] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-15T17:36:56.347891] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:36:56.481851] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:36:56.923836] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-15T17:36:56.929055] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:36:57.714050] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-15T17:36:58.513985] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-15T17:36:58.566539] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T17:36:58.946931] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-15T17:36:59.295511] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T17:36:59.313948] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-15T17:37:00.114065] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-15T17:37:00.333540] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T17:37:00.914066] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-15T17:37:01.217569] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T17:37:01.714001] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-15T17:37:02.514083] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-15T17:37:02.802212] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T17:37:02.805391] [INFO ] [REMOTE ] BHE: Full fetch complete (36279 records). [2025-10-15T17:37:02.805497] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-15T17:37:02.979315] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-15T17:37:03.003503] [INFO ] [REMOTE ] BHP: Full fetch complete (77439 records). [2025-10-15T17:37:03.015634] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-15T17:37:03.328445] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-15T17:37:03.480043] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-15T17:37:03.510124] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-15T17:37:03.528037] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-15T17:37:03.546297] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-15T17:37:03.576224] [DEBUG] [LOCAL ] BHE: Trimmed 36279 records to 23842 (keeping 200 days of data) [2025-10-15T17:37:03.739294] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-15T17:37:03.739516] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-15T17:37:03.742508] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-15T17:37:03.748705] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-15T17:37:03.799864] [DEBUG] [LOCAL ] BHP: Trimmed 77439 records to 53372 (keeping 200 days of data) [2025-10-15T17:37:03.806187] [DEBUG] [LOCAL ] BHE: Primary data saved (23842 records). [2025-10-15T17:37:03.806532] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-15T17:37:03.807070] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHE took 35.8s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-15T17:37:03.985301] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T17:37:04.025512] [INFO ] [REMOTE ] BHK: Full fetch complete (30732 records). [2025-10-15T17:37:04.027886] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-15T17:37:04.195939] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:04.229495] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-15T17:37:04.233543] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-15T17:37:04.235704] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-15T17:37:04.236975] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-15T17:37:04.238339] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-15T17:37:04.239023] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-15T17:37:04.802994] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T17:37:04.844351] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-15T17:37:05.037266] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-15T17:37:05.036724] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:05.037472] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-15T17:37:05.037784] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-15T17:37:05.040900] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-15T17:37:05.041598] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-15T17:37:05.046527] [DEBUG] [LOCAL ] BHK: Trimmed 30732 records to 23743 (keeping 200 days of data) [2025-10-15T17:37:05.207795] [DEBUG] [LOCAL ] BHK: Primary data saved (23743 records). [2025-10-15T17:37:05.209325] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-15T17:37:05.209737] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHK took 36.1s. Estimated remaining: 4h 46m 32s. Rate: 7.3 symbols/min [2025-10-15T17:37:05.469227] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:05.479296] [DEBUG] [LOCAL ] BHP: Primary data saved (53372 records). [2025-10-15T17:37:05.479517] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-15T17:37:05.479618] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHP took 35.2s. Estimated remaining: 4h 45m 23s. Rate: 7.3 symbols/min [2025-10-15T17:37:05.548570] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T17:37:05.681162] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:05.702612] [DEBUG] [LOCAL ] BHVN: Loaded 50511 existing records from primary storage. [2025-10-15T17:37:05.703108] [INFO ] [MAIN ] BHVN: Loaded 50511 existing records. [2025-10-15T17:37:05.723826] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-15T17:37:05.904940] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:05.906458] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-15T17:37:05.906547] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-15T17:37:05.924805] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-15T17:37:05.924975] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-15T17:37:05.947788] [DEBUG] [LOCAL ] BILL: Loaded 52469 existing records from primary storage. [2025-10-15T17:37:05.981820] [INFO ] [MAIN ] BILL: Loaded 52469 existing records. [2025-10-15T17:37:06.120527] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:37:06.193399] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T17:37:06.524706] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-15T17:37:06.535083] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:06.540419] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-15T17:37:06.546478] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-15T17:37:06.561989] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-15T17:37:06.586118] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-15T17:37:06.642935] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:06.957569] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:07.314035] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-15T17:37:07.655352] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T17:37:07.824291] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T17:37:07.827856] [INFO ] [REMOTE ] BHR: Full fetch complete (31383 records). [2025-10-15T17:37:07.827937] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-15T17:37:08.119153] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-15T17:37:08.190507] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-15T17:37:08.190576] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-15T17:37:08.191099] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-15T17:37:08.191162] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-15T17:37:08.192045] [DEBUG] [LOCAL ] BHR: Trimmed 31383 records to 22093 (keeping 200 days of data) [2025-10-15T17:37:08.315992] [DEBUG] [LOCAL ] BHR: Primary data saved (22093 records). [2025-10-15T17:37:08.316131] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-15T17:37:08.316212] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHR took 32.4s. Estimated remaining: 4h 44m 33s. Rate: 7.4 symbols/min [2025-10-15T17:37:08.480247] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:08.503525] [DEBUG] [LOCAL ] BIO: Loaded 24138 existing records from primary storage. [2025-10-15T17:37:08.503809] [INFO ] [MAIN ] BIO: Loaded 24138 existing records. [2025-10-15T17:37:08.675985] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:08.676200] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-15T17:37:08.676246] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-15T17:37:08.676464] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-15T17:37:08.676501] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-15T17:37:08.923930] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-15T17:37:09.038757] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:09.714007] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-15T17:37:09.815259] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:37:09.955689] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-15T17:37:10.495145] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T17:37:10.514020] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-15T17:37:11.314091] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-15T17:37:12.109580] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:37:12.118581] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-15T17:37:12.721041] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T17:37:12.914011] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-15T17:37:13.299847] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T17:37:13.714060] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-15T17:37:14.416659] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:37:14.514077] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-15T17:37:14.552598] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:37:14.885106] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T17:37:15.314016] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-15T17:37:15.801265] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T17:37:16.114049] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-15T17:37:16.914011] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-15T17:37:17.228636] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T17:37:17.716489] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-15T17:37:17.719679] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:37:18.034994] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-15T17:37:18.514055] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-15T17:37:19.314068] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-15T17:37:19.614221] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-15T17:37:19.902675] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:37:20.114027] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-15T17:37:20.914055] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-15T17:37:21.347072] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T17:37:21.713978] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-15T17:37:21.843930] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:37:22.514055] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-15T17:37:22.976764] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T17:37:22.977715] [INFO ] [REMOTE ] BHV: Full fetch complete (1386 records). [2025-10-15T17:37:22.977788] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-15T17:37:23.170632] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-15T17:37:23.170946] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:37:23.171027] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:37:23.171123] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-15T17:37:23.171292] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-15T17:37:23.171354] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-15T17:37:23.171441] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-15T17:37:23.171540] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHV took 19.4s. Estimated remaining: 4h 45m 17s. Rate: 7.3 symbols/min [2025-10-15T17:37:23.323616] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-15T17:37:23.360710] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:23.404959] [DEBUG] [LOCAL ] BIP: Loaded 39214 existing records from primary storage. [2025-10-15T17:37:23.405383] [INFO ] [MAIN ] BIP: Loaded 39214 existing records. [2025-10-15T17:37:23.601369] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:23.602025] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-15T17:37:23.602139] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-15T17:37:23.613311] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-15T17:37:23.621626] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-15T17:37:23.680545] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T17:37:24.021556] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:24.114072] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-15T17:37:24.815549] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T17:37:24.914003] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-15T17:37:25.713980] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-15T17:37:25.798787] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:37:26.186713] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T17:37:26.514067] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-15T17:37:27.314505] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-15T17:37:27.320018] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:37:27.524592] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:37:28.114000] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-15T17:37:28.810572] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:37:28.913973] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-15T17:37:29.463913] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:37:29.714008] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-15T17:37:30.363706] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:37:30.514036] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-15T17:37:31.305584] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T17:37:31.316155] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-15T17:37:32.114016] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-15T17:37:32.347172] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:37:32.553328] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:37:32.914013] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-15T17:37:33.587293] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:37:33.713970] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-15T17:37:33.770912] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T17:37:34.514042] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-15T17:37:35.314035] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-15T17:37:35.700085] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T17:37:36.114079] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-15T17:37:36.353292] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T17:37:36.510630] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T17:37:36.914026] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-15T17:37:37.566081] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:37:37.714010] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-15T17:37:38.439394] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T17:37:38.513989] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-15T17:37:39.313999] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-15T17:37:40.113991] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-15T17:37:40.288799] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-15T17:37:40.503098] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T17:37:40.510502] [INFO ] [REMOTE ] BILL: Full fetch complete (76063 records). [2025-10-15T17:37:40.510679] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-15T17:37:40.930163] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-15T17:37:40.958789] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-15T17:37:40.958911] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-15T17:37:40.960115] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-15T17:37:40.960455] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-15T17:37:40.962508] [DEBUG] [LOCAL ] BILL: Trimmed 76063 records to 52497 (keeping 200 days of data) [2025-10-15T17:37:41.090150] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T17:37:41.261909] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:37:41.365888] [DEBUG] [LOCAL ] BILL: Primary data saved (52497 records). [2025-10-15T17:37:41.366065] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-15T17:37:41.366188] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BILL took 35.9s. Estimated remaining: 4h 46m 25s. Rate: 7.3 symbols/min [2025-10-15T17:37:41.557143] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:41.597281] [DEBUG] [LOCAL ] BIPC: Loaded 41199 existing records from primary storage. [2025-10-15T17:37:41.597625] [INFO ] [MAIN ] BIPC: Loaded 41199 existing records. [2025-10-15T17:37:41.719136] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-15T17:37:41.799227] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:41.799465] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-15T17:37:41.799514] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-15T17:37:41.799906] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-15T17:37:41.799965] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-15T17:37:42.184627] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:42.514024] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-15T17:37:42.702131] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T17:37:42.939924] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T17:37:42.946233] [INFO ] [REMOTE ] BHVN: Full fetch complete (70486 records). [2025-10-15T17:37:42.946380] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-15T17:37:43.316732] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-15T17:37:43.341294] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-15T17:37:43.341433] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-15T17:37:43.342512] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-15T17:37:43.342610] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-15T17:37:43.344344] [DEBUG] [LOCAL ] BHVN: Trimmed 70486 records to 50605 (keeping 200 days of data) [2025-10-15T17:37:43.640749] [DEBUG] [LOCAL ] BHVN: Primary data saved (50605 records). [2025-10-15T17:37:43.641027] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-15T17:37:43.641915] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BHVN took 38.4s. Estimated remaining: 4h 45m 32s. Rate: 7.3 symbols/min [2025-10-15T17:37:43.813840] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:43.820166] [DEBUG] [LOCAL ] BIPH: Loaded 2528 existing records from primary storage. [2025-10-15T17:37:43.820387] [INFO ] [MAIN ] BIPH: Loaded 2528 existing records. [2025-10-15T17:37:44.020244] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:44.020635] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-15T17:37:44.020739] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-15T17:37:44.020918] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-15T17:37:44.020969] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-15T17:37:44.121357] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-15T17:37:44.385976] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:37:44.461171] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:44.730577] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T17:37:44.913974] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-15T17:37:45.150726] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T17:37:45.710280] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:37:45.713948] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-15T17:37:46.170164] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:37:46.514102] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-15T17:37:47.314029] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-15T17:37:47.710612] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:37:48.114024] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-15T17:37:48.536746] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T17:37:48.654824] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:37:48.913998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-15T17:37:49.360269] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T17:37:49.714020] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-15T17:37:50.514038] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-15T17:37:50.799201] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T17:37:51.314068] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-15T17:37:51.919444] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T17:37:52.114033] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-15T17:37:52.576768] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T17:37:52.864174] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T17:37:52.913971] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-15T17:37:53.714027] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-15T17:37:54.514012] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-15T17:37:54.593898] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:37:54.867931] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:37:55.314080] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-15T17:37:55.608767] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T17:37:55.611280] [INFO ] [REMOTE ] BIO: Full fetch complete (34141 records). [2025-10-15T17:37:55.611354] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-15T17:37:55.900135] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:37:55.991256] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-15T17:37:55.991379] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-15T17:37:55.992087] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-15T17:37:55.992153] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-15T17:37:55.993153] [DEBUG] [LOCAL ] BIO: Trimmed 34141 records to 24027 (keeping 200 days of data) [2025-10-15T17:37:56.114194] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-15T17:37:56.149310] [DEBUG] [LOCAL ] BIO: Primary data saved (24027 records). [2025-10-15T17:37:56.149526] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-15T17:37:56.149683] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BIO took 47.8s. Estimated remaining: 4h 45m 56s. Rate: 7.3 symbols/min [2025-10-15T17:37:56.560559] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T17:37:56.914045] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-15T17:37:57.217073] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-15T17:37:57.714028] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-15T17:37:58.514059] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-15T17:37:59.162530] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:37:59.313996] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-15T17:37:59.665499] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:38:00.114028] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-15T17:38:00.694330] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:38:00.914007] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-15T17:38:01.305730] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T17:38:01.504398] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:38:01.714086] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-15T17:38:02.513996] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-15T17:38:02.868691] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T17:38:03.314083] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-15T17:38:03.387071] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T17:38:03.392868] [INFO ] [REMOTE ] BIP: Full fetch complete (57363 records). [2025-10-15T17:38:03.393069] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-15T17:38:03.814267] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T17:38:03.860926] [INFO ] [REMOTE ] BIPH: Full fetch complete (4092 records). [2025-10-15T17:38:03.885109] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-15T17:38:03.931560] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-15T17:38:03.947393] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-15T17:38:03.976097] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-15T17:38:03.999441] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-15T17:38:04.073896] [DEBUG] [LOCAL ] BIP: Trimmed 57363 records to 39192 (keeping 200 days of data) [2025-10-15T17:38:04.117751] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-15T17:38:04.553148] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-15T17:38:04.553740] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-15T17:38:04.554057] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-15T17:38:04.554152] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-15T17:38:04.557193] [DEBUG] [LOCAL ] BIPH: Trimmed 4092 records to 2518 (keeping 200 days of data) [2025-10-15T17:38:04.717454] [DEBUG] [LOCAL ] BIPH: Primary data saved (2518 records). [2025-10-15T17:38:04.721005] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-15T17:38:04.721175] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIPH took 21.1s. Estimated remaining: 4h 45m 51s. Rate: 7.3 symbols/min [2025-10-15T17:38:04.754245] [DEBUG] [LOCAL ] BIP: Primary data saved (39192 records). [2025-10-15T17:38:04.754405] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-15T17:38:04.754490] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIP took 41.6s. Estimated remaining: 4h 44m 41s. Rate: 7.3 symbols/min [2025-10-15T17:38:05.838625] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T17:38:05.848167] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-15T17:38:07.306167] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T17:38:07.315848] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-15T17:38:08.558873] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T17:38:08.568035] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-15T17:38:09.769783] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T17:38:09.775547] [INFO ] [REMOTE ] BIPC: Full fetch complete (60249 records). [2025-10-15T17:38:09.775745] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-15T17:38:10.173789] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-15T17:38:10.173916] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-15T17:38:10.174734] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-15T17:38:10.174796] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-15T17:38:10.176157] [DEBUG] [LOCAL ] BIPC: Trimmed 60249 records to 41257 (keeping 200 days of data) [2025-10-15T17:38:10.417224] [DEBUG] [LOCAL ] BIPC: Primary data saved (41257 records). [2025-10-15T17:38:10.417357] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-15T17:38:10.417614] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 29.1s. Estimated remaining: 4h 44m 14s. Rate: 7.3 symbols/min [2025-10-15T17:38:11.102192] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.125703] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.103020] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.124895] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.135188] [DEBUG] [LOCAL ] BIPJ: Loaded 3176 existing records from primary storage. [2025-10-15T17:38:11.137278] [DEBUG] [LOCAL ] BIPI: Loaded 3072 existing records from primary storage. [2025-10-15T17:38:11.137616] [INFO ] [MAIN ] BIPI: Loaded 3072 existing records. [2025-10-15T17:38:11.160947] [INFO ] [MAIN ] BIPJ: Loaded 3176 existing records. [2025-10-15T17:38:11.442039] [DEBUG] [LOCAL ] BIT: Loaded 23575 existing records from primary storage. [2025-10-15T17:38:11.531596] [INFO ] [MAIN ] BIT: Loaded 23575 existing records. [2025-10-15T17:38:11.512060] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:11.556168] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-15T17:38:11.593976] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-15T17:38:11.618945] [DEBUG] [LOCAL ] BIRK: Loaded 51059 existing records from primary storage. [2025-10-15T17:38:11.588605] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:11.619404] [INFO ] [MAIN ] BIRK: Loaded 51059 existing records. [2025-10-15T17:38:11.627793] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-15T17:38:11.666692] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-15T17:38:11.675760] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-15T17:38:11.701638] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-15T17:38:11.798986] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-15T17:38:11.910354] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:11.891079] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-15T17:38:11.993361] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-15T17:38:12.094364] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-15T17:38:12.178187] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-15T17:38:12.226947] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:12.236390] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-15T17:38:12.234700] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-15T17:38:12.269788] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-15T17:38:12.297400] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-15T17:38:12.411163] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-15T17:38:12.916154] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:12.976387] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-15T17:38:13.243474] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:13.259285] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-15T17:38:13.397049] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:13.400317] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-15T17:38:13.477804] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:13.478159] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-15T17:38:13.855795] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:38:13.858004] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-15T17:38:14.009320] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T17:38:14.011058] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-15T17:38:14.392852] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T17:38:14.394290] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-15T17:38:14.469244] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:38:14.470507] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-15T17:38:14.656231] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:38:14.661528] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-15T17:38:14.667668] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-15T17:38:14.669036] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-15T17:38:14.834430] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T17:38:15.050114] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-15T17:38:15.177687] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:38:15.313974] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-15T17:38:15.698105] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:38:15.751046] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T17:38:16.114057] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-15T17:38:16.478237] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T17:38:16.914046] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-15T17:38:17.713983] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-15T17:38:17.795441] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T17:38:18.513987] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-15T17:38:18.952763] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T17:38:19.310027] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:38:19.319179] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-15T17:38:19.660407] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T17:38:20.114005] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-15T17:38:20.548541] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T17:38:20.914017] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-15T17:38:21.394728] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T17:38:21.714021] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-15T17:38:22.254149] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T17:38:22.514013] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-15T17:38:23.045469] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T17:38:23.046426] [INFO ] [REMOTE ] BIPI: Full fetch complete (4808 records). [2025-10-15T17:38:23.046498] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-15T17:38:23.319141] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-15T17:38:23.412435] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-15T17:38:23.412514] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-15T17:38:23.412684] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-15T17:38:23.412744] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-15T17:38:23.413128] [DEBUG] [LOCAL ] BIPI: Trimmed 4808 records to 2999 (keeping 200 days of data) [2025-10-15T17:38:23.431327] [DEBUG] [LOCAL ] BIPI: Primary data saved (2999 records). [2025-10-15T17:38:23.431431] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-15T17:38:23.431505] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 13.0s. Estimated remaining: 4h 44m 42s. Rate: 7.3 symbols/min [2025-10-15T17:38:23.597769] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:23.650916] [DEBUG] [LOCAL ] BJ: Loaded 51583 existing records from primary storage. [2025-10-15T17:38:23.651259] [INFO ] [MAIN ] BJ: Loaded 51583 existing records. [2025-10-15T17:38:23.825284] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:23.825540] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-15T17:38:23.825587] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-15T17:38:23.826031] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-15T17:38:23.826090] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-15T17:38:24.119096] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-15T17:38:24.196297] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:24.617169] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T17:38:24.913967] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-15T17:38:25.240013] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T17:38:25.714005] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-15T17:38:26.286441] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T17:38:26.507231] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:38:26.517154] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-15T17:38:27.314002] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-15T17:38:28.114003] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-15T17:38:28.165695] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:38:28.404565] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T17:38:28.551921] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T17:38:28.914011] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-15T17:38:29.526714] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:38:29.713979] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-15T17:38:30.514005] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-15T17:38:30.911119] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T17:38:31.317025] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-15T17:38:31.322620] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T17:38:32.088988] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T17:38:32.113982] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-15T17:38:32.913986] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-15T17:38:33.044103] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:38:33.714070] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-15T17:38:34.288664] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:38:34.513980] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-15T17:38:34.829744] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T17:38:35.314015] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-15T17:38:35.740366] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T17:38:36.113974] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-15T17:38:36.248459] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T17:38:36.914008] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-15T17:38:37.714014] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-15T17:38:37.783304] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T17:38:37.925173] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T17:38:38.514004] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-15T17:38:39.084365] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:38:39.314026] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-15T17:38:40.114002] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-15T17:38:40.238595] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:38:40.299108] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T17:38:40.914004] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-15T17:38:41.713973] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-15T17:38:41.849113] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T17:38:41.956450] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T17:38:41.960703] [INFO ] [REMOTE ] BIT: Full fetch complete (32036 records). [2025-10-15T17:38:41.960837] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-15T17:38:42.356624] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-15T17:38:42.356985] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-15T17:38:42.357852] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-15T17:38:42.357919] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-15T17:38:42.358820] [DEBUG] [LOCAL ] BIT: Trimmed 32036 records to 23665 (keeping 200 days of data) [2025-10-15T17:38:42.468449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:38:42.516342] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-15T17:38:42.525218] [DEBUG] [LOCAL ] BIT: Primary data saved (23665 records). [2025-10-15T17:38:42.525436] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-15T17:38:42.525554] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIT took 32.1s. Estimated remaining: 4h 45m 55s. Rate: 7.3 symbols/min [2025-10-15T17:38:42.704920] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:42.760119] [DEBUG] [LOCAL ] BK: Loaded 53536 existing records from primary storage. [2025-10-15T17:38:42.760536] [INFO ] [MAIN ] BK: Loaded 53536 existing records. [2025-10-15T17:38:42.953857] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:42.954180] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-15T17:38:42.954259] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-15T17:38:42.954904] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-15T17:38:42.954976] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-15T17:38:43.071503] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T17:38:43.084155] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4360 records). [2025-10-15T17:38:43.089457] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-15T17:38:43.320922] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-15T17:38:43.701147] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:43.757154] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-15T17:38:43.757252] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-15T17:38:43.757459] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-15T17:38:43.757567] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-15T17:38:43.758256] [DEBUG] [LOCAL ] BIPJ: Trimmed 4360 records to 3164 (keeping 200 days of data) [2025-10-15T17:38:43.778179] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3164 records). [2025-10-15T17:38:43.778326] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-15T17:38:43.778411] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPJ took 33.4s. Estimated remaining: 4h 44m 55s. Rate: 7.3 symbols/min [2025-10-15T17:38:43.949353] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:43.998544] [DEBUG] [LOCAL ] BKD: Loaded 50449 existing records from primary storage. [2025-10-15T17:38:43.998894] [INFO ] [MAIN ] BKD: Loaded 50449 existing records. [2025-10-15T17:38:44.119159] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-15T17:38:44.187632] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:44.187992] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-15T17:38:44.188043] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-15T17:38:44.188455] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-15T17:38:44.188521] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-15T17:38:44.549199] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:44.914020] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-15T17:38:45.026606] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:38:45.714053] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-15T17:38:46.178977] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T17:38:46.368102] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:38:46.514022] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-15T17:38:47.320363] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-15T17:38:47.352883] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:38:48.114015] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-15T17:38:48.392760] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T17:38:48.624434] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:38:48.914030] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-15T17:38:49.714114] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-15T17:38:49.836054] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:38:49.842788] [INFO ] [REMOTE ] BIRK: Full fetch complete (73272 records). [2025-10-15T17:38:49.842968] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-15T17:38:50.283007] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-15T17:38:50.283178] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-15T17:38:50.284478] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-15T17:38:50.284987] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-15T17:38:50.286422] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T17:38:50.297286] [DEBUG] [LOCAL ] BIRK: Trimmed 73272 records to 51107 (keeping 200 days of data) [2025-10-15T17:38:50.514206] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-15T17:38:50.590408] [DEBUG] [LOCAL ] BIRK: Primary data saved (51107 records). [2025-10-15T17:38:50.590543] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-15T17:38:50.590624] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 40.2s. Estimated remaining: 4h 44m 37s. Rate: 7.3 symbols/min [2025-10-15T17:38:50.758851] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:50.791340] [DEBUG] [LOCAL ] BKE: Loaded 33992 existing records from primary storage. [2025-10-15T17:38:50.791685] [INFO ] [MAIN ] BKE: Loaded 33992 existing records. [2025-10-15T17:38:50.967269] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:50.967498] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-15T17:38:50.967575] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-15T17:38:50.967955] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-15T17:38:50.968013] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-15T17:38:51.325630] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-15T17:38:51.330956] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:51.554550] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:38:51.947773] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:38:52.114011] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-15T17:38:52.919135] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-15T17:38:52.940840] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T17:38:53.714080] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-15T17:38:53.812800] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:38:54.513974] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-15T17:38:54.570348] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:38:55.313984] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-15T17:38:55.536282] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T17:38:55.943380] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T17:38:56.114044] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-15T17:38:56.584852] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:38:56.914023] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-15T17:38:57.714111] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-15T17:38:57.891608] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T17:38:58.290539] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:38:58.514084] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-15T17:38:59.109095] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T17:38:59.314006] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-15T17:39:00.114057] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-15T17:39:00.354619] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:39:00.914027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-15T17:39:01.405177] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:39:01.433840] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T17:39:01.714009] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-15T17:39:02.514005] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-15T17:39:02.705196] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T17:39:03.020584] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T17:39:03.314076] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-15T17:39:04.113266] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:39:04.123472] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-15T17:39:04.804324] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T17:39:04.914029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-15T17:39:05.719236] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-15T17:39:05.754273] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:39:06.490259] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T17:39:06.496617] [INFO ] [REMOTE ] BJ: Full fetch complete (74338 records). [2025-10-15T17:39:06.496812] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-15T17:39:06.519139] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-15T17:39:06.902353] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-15T17:39:06.902472] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-15T17:39:06.903393] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-15T17:39:06.903482] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-15T17:39:06.905258] [DEBUG] [LOCAL ] BJ: Trimmed 74338 records to 51595 (keeping 200 days of data) [2025-10-15T17:39:07.139541] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T17:39:07.254478] [DEBUG] [LOCAL ] BJ: Primary data saved (51595 records). [2025-10-15T17:39:07.254662] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-15T17:39:07.254831] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 43.8s. Estimated remaining: 4h 45m 31s. Rate: 7.3 symbols/min [2025-10-15T17:39:07.322993] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-15T17:39:07.438794] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:07.474963] [DEBUG] [LOCAL ] BKH: Loaded 37028 existing records from primary storage. [2025-10-15T17:39:07.475261] [INFO ] [MAIN ] BKH: Loaded 37028 existing records. [2025-10-15T17:39:07.651346] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:07.651573] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-15T17:39:07.651621] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-15T17:39:07.651972] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-15T17:39:07.652029] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-15T17:39:08.046427] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:08.114004] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-15T17:39:08.194469] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T17:39:08.913976] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-15T17:39:09.088843] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:39:09.639386] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:39:09.714007] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-15T17:39:10.126826] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T17:39:10.514010] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-15T17:39:11.015730] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:39:11.313974] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-15T17:39:11.792214] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T17:39:12.114007] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-15T17:39:12.647550] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T17:39:12.914004] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-15T17:39:13.623086] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T17:39:13.714047] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-15T17:39:14.523058] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-15T17:39:14.543839] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:39:15.315046] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:39:15.315226] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-15T17:39:15.791243] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T17:39:16.113994] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-15T17:39:16.428059] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T17:39:16.914077] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-15T17:39:17.714009] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-15T17:39:17.910149] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T17:39:18.487734] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:39:18.514012] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-15T17:39:19.317602] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-15T17:39:19.319871] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T17:39:20.017559] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:39:20.113961] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-15T17:39:20.913986] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-15T17:39:21.205689] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T17:39:21.213563] [INFO ] [REMOTE ] BKD: Full fetch complete (72031 records). [2025-10-15T17:39:21.213832] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-15T17:39:21.625308] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-15T17:39:21.633782] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-15T17:39:21.646442] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-15T17:39:21.646604] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-15T17:39:21.648830] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T17:39:21.657502] [DEBUG] [LOCAL ] BKD: Trimmed 72031 records to 50474 (keeping 200 days of data) [2025-10-15T17:39:21.740397] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-15T17:39:21.959052] [DEBUG] [LOCAL ] BKD: Primary data saved (50474 records). [2025-10-15T17:39:21.959303] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-15T17:39:21.960333] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BKD took 38.2s. Estimated remaining: 4h 46m 10s. Rate: 7.3 symbols/min [2025-10-15T17:39:22.137823] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:22.171588] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:39:22.215330] [DEBUG] [LOCAL ] BKKT: Loaded 36403 existing records from primary storage. [2025-10-15T17:39:22.215717] [INFO ] [MAIN ] BKKT: Loaded 36403 existing records. [2025-10-15T17:39:22.394685] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:22.394970] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-15T17:39:22.395052] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-15T17:39:22.395438] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-15T17:39:22.395495] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-15T17:39:22.519115] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-15T17:39:22.812418] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:23.314010] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-15T17:39:23.613347] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:39:23.620700] [INFO ] [REMOTE ] BK: Full fetch complete (77670 records). [2025-10-15T17:39:23.620889] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-15T17:39:24.023455] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T17:39:24.052886] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-15T17:39:24.053084] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-15T17:39:24.054027] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-15T17:39:24.054112] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-15T17:39:24.054358] [INFO ] [REMOTE ] BKE: Full fetch complete (50384 records). [2025-10-15T17:39:24.054448] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-15T17:39:24.115098] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-15T17:39:24.138288] [DEBUG] [LOCAL ] BK: Trimmed 77670 records to 53543 (keeping 200 days of data) [2025-10-15T17:39:24.709356] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-15T17:39:24.716876] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-15T17:39:24.718392] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-15T17:39:24.720888] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-15T17:39:24.778750] [DEBUG] [LOCAL ] BKE: Trimmed 50384 records to 33979 (keeping 200 days of data) [2025-10-15T17:39:24.890888] [DEBUG] [LOCAL ] BK: Primary data saved (53543 records). [2025-10-15T17:39:24.891566] [INFO ] [MAIN ] BK: Full history saved. [2025-10-15T17:39:24.895111] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BK took 42.4s. Estimated remaining: 4h 45m 23s. Rate: 7.3 symbols/min [2025-10-15T17:39:25.089061] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:25.157444] [DEBUG] [LOCAL ] BKN: Loaded 7362 existing records from primary storage. [2025-10-15T17:39:25.178741] [INFO ] [MAIN ] BKN: Loaded 7362 existing records. [2025-10-15T17:39:25.200601] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T17:39:25.249336] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-15T17:39:25.437494] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:25.437983] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-15T17:39:25.438422] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-15T17:39:25.439525] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-15T17:39:25.441090] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-15T17:39:25.477275] [DEBUG] [LOCAL ] BKE: Primary data saved (33979 records). [2025-10-15T17:39:25.495048] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-15T17:39:25.511892] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKE took 34.9s. Estimated remaining: 4h 44m 20s. Rate: 7.3 symbols/min [2025-10-15T17:39:25.738145] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:39:25.853421] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-15T17:39:25.937681] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:26.035764] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:26.072121] [DEBUG] [LOCAL ] BKSY: Loaded 48676 existing records from primary storage. [2025-10-15T17:39:26.072457] [INFO ] [MAIN ] BKSY: Loaded 48676 existing records. [2025-10-15T17:39:26.259333] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:26.259676] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-15T17:39:26.259750] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-15T17:39:26.260142] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-15T17:39:26.260204] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-15T17:39:26.519820] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-15T17:39:26.696272] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:26.855507] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T17:39:27.313979] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-15T17:39:27.486858] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T17:39:27.505516] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T17:39:28.114003] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-15T17:39:28.711970] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T17:39:28.914003] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-15T17:39:29.711395] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:39:29.714944] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-15T17:39:29.755306] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T17:39:30.514006] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-15T17:39:31.276025] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T17:39:31.314037] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-15T17:39:32.114011] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-15T17:39:32.239519] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T17:39:32.603694] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:39:32.914014] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-15T17:39:33.511379] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T17:39:33.524336] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T17:39:33.714071] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-15T17:39:34.514070] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-15T17:39:35.217633] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T17:39:35.314019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-15T17:39:35.589889] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T17:39:35.873372] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T17:39:36.113996] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-15T17:39:36.914079] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-15T17:39:37.713982] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-15T17:39:37.972459] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T17:39:38.298706] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:39:38.303780] [INFO ] [REMOTE ] BKH: Full fetch complete (52690 records). [2025-10-15T17:39:38.303944] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-15T17:39:38.460362] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T17:39:38.519138] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-15T17:39:38.726964] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-15T17:39:38.727063] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-15T17:39:38.727847] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-15T17:39:38.727937] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-15T17:39:38.729976] [DEBUG] [LOCAL ] BKH: Trimmed 52690 records to 37090 (keeping 200 days of data) [2025-10-15T17:39:38.954718] [DEBUG] [LOCAL ] BKH: Primary data saved (37090 records). [2025-10-15T17:39:38.954890] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-15T17:39:38.954972] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKH took 31.7s. Estimated remaining: 4h 44m 49s. Rate: 7.3 symbols/min [2025-10-15T17:39:39.119710] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:39.133761] [DEBUG] [LOCAL ] BKT: Loaded 12331 existing records from primary storage. [2025-10-15T17:39:39.134024] [INFO ] [MAIN ] BKT: Loaded 12331 existing records. [2025-10-15T17:39:39.312764] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:39.313010] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-15T17:39:39.313056] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-15T17:39:39.313282] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-15T17:39:39.313336] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-15T17:39:39.324419] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-15T17:39:39.661321] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:40.114035] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-15T17:39:40.202442] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T17:39:40.300214] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T17:39:40.910218] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:39:40.913945] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-15T17:39:41.679998] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T17:39:41.713969] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-15T17:39:42.514025] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-15T17:39:43.314012] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-15T17:39:43.497667] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T17:39:43.925313] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T17:39:44.055315] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:39:44.113996] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-15T17:39:44.914014] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-15T17:39:45.434897] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T17:39:45.714023] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-15T17:39:46.247146] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T17:39:46.284738] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T17:39:46.514014] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-15T17:39:47.314020] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-15T17:39:47.776019] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:39:48.114000] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-15T17:39:48.914011] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-15T17:39:49.636860] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:39:49.718528] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-15T17:39:49.747786] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T17:39:49.987237] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:39:50.359478] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T17:39:50.514053] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-15T17:39:51.313968] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-15T17:39:51.952510] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T17:39:52.114016] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-15T17:39:52.914031] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-15T17:39:53.145317] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:39:53.713991] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-15T17:39:53.786062] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:39:53.961251] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:39:54.514002] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-15T17:39:55.254280] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T17:39:55.313948] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-15T17:39:55.666089] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T17:39:55.829300] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T17:39:55.831364] [INFO ] [REMOTE ] BKN: Full fetch complete (11410 records). [2025-10-15T17:39:55.831460] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-15T17:39:56.117104] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-15T17:39:56.199544] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-15T17:39:56.199636] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-15T17:39:56.200069] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-15T17:39:56.200125] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-15T17:39:56.200593] [DEBUG] [LOCAL ] BKN: Trimmed 11410 records to 7312 (keeping 200 days of data) [2025-10-15T17:39:56.246105] [DEBUG] [LOCAL ] BKN: Primary data saved (7312 records). [2025-10-15T17:39:56.246453] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-15T17:39:56.246538] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKN took 31.4s. Estimated remaining: 4h 45m 46s. Rate: 7.3 symbols/min [2025-10-15T17:39:56.419299] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:56.458848] [DEBUG] [LOCAL ] BKU: Loaded 42065 existing records from primary storage. [2025-10-15T17:39:56.459175] [INFO ] [MAIN ] BKU: Loaded 42065 existing records. [2025-10-15T17:39:56.631187] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:56.631901] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-15T17:39:56.631952] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-15T17:39:56.632381] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-15T17:39:56.632437] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-15T17:39:56.919174] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-15T17:39:57.001220] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:57.406774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T17:39:57.714024] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-15T17:39:58.104220] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T17:39:58.111204] [INFO ] [REMOTE ] BKSY: Full fetch complete (70348 records). [2025-10-15T17:39:58.111392] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-15T17:39:58.394214] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T17:39:58.519224] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-15T17:39:58.543221] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-15T17:39:58.544188] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-15T17:39:58.545138] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-15T17:39:58.545302] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-15T17:39:58.546850] [DEBUG] [LOCAL ] BKSY: Trimmed 70348 records to 48700 (keeping 200 days of data) [2025-10-15T17:39:58.835947] [DEBUG] [LOCAL ] BKSY: Primary data saved (48700 records). [2025-10-15T17:39:58.836106] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-15T17:39:58.836188] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKSY took 33.3s. Estimated remaining: 4h 44m 58s. Rate: 7.3 symbols/min [2025-10-15T17:39:59.012404] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:59.046872] [DEBUG] [LOCAL ] BKV: Loaded 29704 existing records from primary storage. [2025-10-15T17:39:59.047245] [INFO ] [MAIN ] BKV: Loaded 29704 existing records. [2025-10-15T17:39:59.225180] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:59.225486] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-15T17:39:59.225538] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-15T17:39:59.225844] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-15T17:39:59.225903] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-15T17:39:59.320310] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-15T17:39:59.584924] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:59.878904] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T17:40:00.114026] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-15T17:40:00.913994] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-15T17:40:01.441308] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T17:40:01.448440] [INFO ] [REMOTE ] BKKT: Full fetch complete (51339 records). [2025-10-15T17:40:01.448597] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-15T17:40:01.723044] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-15T17:40:01.830905] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:40:01.923558] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-15T17:40:01.923684] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-15T17:40:01.924437] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-15T17:40:01.924485] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-15T17:40:01.927019] [DEBUG] [LOCAL ] BKKT: Trimmed 51339 records to 36603 (keeping 200 days of data) [2025-10-15T17:40:02.152504] [DEBUG] [LOCAL ] BKKT: Primary data saved (36603 records). [2025-10-15T17:40:02.152716] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-15T17:40:02.152814] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKKT took 40.2s. Estimated remaining: 4h 44m 14s. Rate: 7.3 symbols/min [2025-10-15T17:40:02.334994] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:02.358557] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:40:02.399670] [DEBUG] [LOCAL ] BLCO: Loaded 35353 existing records from primary storage. [2025-10-15T17:40:02.400008] [INFO ] [MAIN ] BLCO: Loaded 35353 existing records. [2025-10-15T17:40:02.517337] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-15T17:40:02.532202] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T17:40:02.609395] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:02.609661] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-15T17:40:02.609727] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-15T17:40:02.610068] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-15T17:40:02.610109] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-15T17:40:03.051491] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:03.314043] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-15T17:40:03.568188] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T17:40:04.114000] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-15T17:40:04.714888] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T17:40:04.913978] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-15T17:40:05.292460] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T17:40:05.714016] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-15T17:40:06.237190] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T17:40:06.514017] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-15T17:40:07.143129] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:40:07.314111] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-15T17:40:07.760049] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T17:40:08.114027] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-15T17:40:08.914009] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-15T17:40:08.952889] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T17:40:09.173955] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:40:09.177256] [INFO ] [REMOTE ] BKT: Full fetch complete (16292 records). [2025-10-15T17:40:09.177370] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-15T17:40:09.561071] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-15T17:40:09.561172] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-15T17:40:09.561580] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-15T17:40:09.561626] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-15T17:40:09.562228] [DEBUG] [LOCAL ] BKT: Trimmed 16292 records to 12457 (keeping 200 days of data) [2025-10-15T17:40:09.637857] [DEBUG] [LOCAL ] BKT: Primary data saved (12457 records). [2025-10-15T17:40:09.638018] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-15T17:40:09.638103] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKT took 30.7s. Estimated remaining: 4h 44m 1s. Rate: 7.3 symbols/min [2025-10-15T17:40:09.719207] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-15T17:40:09.825228] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:09.853365] [DEBUG] [LOCAL ] BLD: Loaded 27592 existing records from primary storage. [2025-10-15T17:40:09.853706] [INFO ] [MAIN ] BLD: Loaded 27592 existing records. [2025-10-15T17:40:10.044162] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:10.044691] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-15T17:40:10.044767] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-15T17:40:10.052960] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-15T17:40:10.066222] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-15T17:40:10.131358] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:40:10.446016] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:10.514020] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-15T17:40:11.314044] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-15T17:40:11.402238] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T17:40:11.487233] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T17:40:12.114044] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-15T17:40:12.499527] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T17:40:12.914000] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-15T17:40:13.349086] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:40:13.714012] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-15T17:40:13.985598] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:40:14.514011] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-15T17:40:15.273609] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T17:40:15.313998] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-15T17:40:15.874596] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T17:40:16.113996] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-15T17:40:16.659967] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T17:40:16.913999] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-15T17:40:17.371258] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T17:40:17.714024] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-15T17:40:18.134484] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:40:18.514012] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-15T17:40:19.115919] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T17:40:19.313992] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-15T17:40:20.113996] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-15T17:40:20.317110] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T17:40:20.455994] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:40:20.914009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-15T17:40:21.714011] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-15T17:40:21.793288] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:40:21.799190] [INFO ] [REMOTE ] BKU: Full fetch complete (60687 records). [2025-10-15T17:40:21.799323] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-15T17:40:22.180075] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-15T17:40:22.180161] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-15T17:40:22.180941] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-15T17:40:22.181007] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-15T17:40:22.182350] [DEBUG] [LOCAL ] BKU: Trimmed 60687 records to 42161 (keeping 200 days of data) [2025-10-15T17:40:22.460995] [DEBUG] [LOCAL ] BKU: Primary data saved (42161 records). [2025-10-15T17:40:22.461770] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-15T17:40:22.463563] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKU took 26.2s. Estimated remaining: 4h 44m 25s. Rate: 7.3 symbols/min [2025-10-15T17:40:22.463193] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T17:40:22.526270] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-15T17:40:22.645527] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:22.697459] [DEBUG] [LOCAL ] BLDR: Loaded 51879 existing records from primary storage. [2025-10-15T17:40:22.697860] [INFO ] [MAIN ] BLDR: Loaded 51879 existing records. [2025-10-15T17:40:22.877615] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:22.878057] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-15T17:40:22.878135] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-15T17:40:22.887014] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-15T17:40:22.887146] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-15T17:40:22.985693] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T17:40:23.282599] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:23.313971] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-15T17:40:23.792698] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:40:24.113990] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-15T17:40:24.913987] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-15T17:40:24.971592] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T17:40:25.123291] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:40:25.714008] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-15T17:40:26.025685] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T17:40:26.513998] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-15T17:40:27.313997] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-15T17:40:27.374164] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:40:27.849921] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:40:28.114032] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-15T17:40:28.304558] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T17:40:28.914066] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-15T17:40:29.416132] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T17:40:29.714033] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-15T17:40:30.312626] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:40:30.514032] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-15T17:40:31.189491] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:40:31.314001] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-15T17:40:31.604275] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:40:32.114026] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-15T17:40:32.515831] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T17:40:32.914009] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-15T17:40:33.456303] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:40:33.713982] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-15T17:40:34.452277] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T17:40:34.513953] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-15T17:40:34.667216] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:40:35.314009] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-15T17:40:35.898680] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:40:36.114009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-15T17:40:36.914017] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-15T17:40:37.076146] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:40:37.080305] [INFO ] [REMOTE ] BLCO: Full fetch complete (52337 records). [2025-10-15T17:40:37.080446] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-15T17:40:37.451349] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T17:40:37.502817] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-15T17:40:37.502895] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-15T17:40:37.503679] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-15T17:40:37.503744] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-15T17:40:37.504914] [DEBUG] [LOCAL ] BLCO: Trimmed 52337 records to 35230 (keeping 200 days of data) [2025-10-15T17:40:37.699558] [DEBUG] [LOCAL ] BLCO: Primary data saved (35230 records). [2025-10-15T17:40:37.699732] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-15T17:40:37.699821] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BLCO took 35.5s. Estimated remaining: 4h 45m 6s. Rate: 7.3 symbols/min [2025-10-15T17:40:37.720431] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-15T17:40:37.869598] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:37.884008] [DEBUG] [LOCAL ] BLE: Loaded 13853 existing records from primary storage. [2025-10-15T17:40:37.884237] [INFO ] [MAIN ] BLE: Loaded 13853 existing records. [2025-10-15T17:40:38.061976] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:38.062172] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-15T17:40:38.062219] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-15T17:40:38.062431] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-15T17:40:38.062468] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-15T17:40:38.189172] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T17:40:38.233820] [INFO ] [REMOTE ] BKV: Full fetch complete (44886 records). [2025-10-15T17:40:38.242089] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-15T17:40:38.532582] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-15T17:40:38.634665] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:38.852950] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-15T17:40:38.853248] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-15T17:40:38.853978] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-15T17:40:38.854088] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-15T17:40:38.862284] [DEBUG] [LOCAL ] BKV: Trimmed 44886 records to 29596 (keeping 200 days of data) [2025-10-15T17:40:38.875812] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T17:40:39.047989] [DEBUG] [LOCAL ] BKV: Primary data saved (29596 records). [2025-10-15T17:40:39.048137] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-15T17:40:39.048222] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BKV took 40.2s. Estimated remaining: 4h 44m 10s. Rate: 7.3 symbols/min [2025-10-15T17:40:39.216633] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:39.252787] [DEBUG] [LOCAL ] BLK: Loaded 34255 existing records from primary storage. [2025-10-15T17:40:39.253088] [INFO ] [MAIN ] BLK: Loaded 34255 existing records. [2025-10-15T17:40:39.319171] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-15T17:40:39.430016] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:39.430301] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-15T17:40:39.430368] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-15T17:40:39.430806] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-15T17:40:39.430864] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-15T17:40:39.789321] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:40.113968] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-15T17:40:40.233969] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:40:40.373708] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T17:40:40.913992] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-15T17:40:41.717451] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-15T17:40:41.720313] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:40:42.513977] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-15T17:40:42.688935] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:40:42.726703] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:40:43.314035] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-15T17:40:43.852223] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:40:44.047988] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T17:40:44.113999] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-15T17:40:44.779543] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T17:40:44.913956] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-15T17:40:45.713976] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-15T17:40:45.844918] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T17:40:46.514019] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-15T17:40:47.319094] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-15T17:40:47.331793] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T17:40:47.843588] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T17:40:48.096432] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T17:40:48.113950] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-15T17:40:48.914016] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-15T17:40:49.697337] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T17:40:49.721863] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-15T17:40:49.725236] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T17:40:50.514141] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-15T17:40:51.314026] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-15T17:40:51.572313] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:40:51.630777] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:40:52.114016] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-15T17:40:52.914012] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-15T17:40:52.956823] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:40:53.714026] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-15T17:40:54.012767] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:40:54.016149] [INFO ] [REMOTE ] BLD: Full fetch complete (39970 records). [2025-10-15T17:40:54.016242] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-15T17:40:54.146878] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T17:40:54.193956] [INFO ] [REMOTE ] BLDR: Full fetch complete (74715 records). [2025-10-15T17:40:54.231844] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-15T17:40:54.520272] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-15T17:40:54.569540] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-15T17:40:54.580896] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-15T17:40:54.587101] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-15T17:40:54.592344] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-15T17:40:54.637226] [DEBUG] [LOCAL ] BLD: Trimmed 39970 records to 27482 (keeping 200 days of data) [2025-10-15T17:40:55.001114] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-15T17:40:55.002741] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-15T17:40:55.004778] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-15T17:40:55.004866] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-15T17:40:55.038921] [DEBUG] [LOCAL ] BLDR: Trimmed 74715 records to 51906 (keeping 200 days of data) [2025-10-15T17:40:55.117296] [DEBUG] [LOCAL ] BLD: Primary data saved (27482 records). [2025-10-15T17:40:55.150564] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-15T17:40:55.151183] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 45.5s. Estimated remaining: 4h 44m 57s. Rate: 7.3 symbols/min [2025-10-15T17:40:55.466050] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T17:40:55.467761] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:55.511562] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-15T17:40:55.625137] [DEBUG] [LOCAL ] BLDR: Primary data saved (51906 records). [2025-10-15T17:40:55.626151] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-15T17:40:55.626711] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLDR took 33.2s. Estimated remaining: 4h 43m 54s. Rate: 7.3 symbols/min [2025-10-15T17:40:55.723959] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T17:40:55.873142] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:55.874873] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-15T17:40:55.874627] [DEBUG] [LOCAL ] BLND: Loaded 49272 existing records from primary storage. [2025-10-15T17:40:55.875009] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-15T17:40:55.875370] [INFO ] [MAIN ] BLND: Loaded 49272 existing records. [2025-10-15T17:40:55.875521] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-15T17:40:55.922167] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-15T17:40:55.949159] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-15T17:40:55.955085] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-15T17:40:56.114748] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-15T17:40:56.254528] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:56.281969] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-15T17:40:56.282331] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-15T17:40:56.329815] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-15T17:40:56.341783] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-15T17:40:56.342700] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T17:40:56.637883] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:56.905155] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:56.914028] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-15T17:40:57.115894] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:40:57.116240] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-15T17:40:57.116336] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:40:57.116381] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-15T17:40:57.116414] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:40:57.116450] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-15T17:40:57.116508] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-15T17:40:57.116548] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-15T17:40:57.116585] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-15T17:40:57.116631] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLSH took 1.5s. Estimated remaining: 4h 42m 59s. Rate: 7.3 symbols/min [2025-10-15T17:40:57.292707] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:57.309391] [DEBUG] [LOCAL ] BLW: Loaded 13213 existing records from primary storage. [2025-10-15T17:40:57.309679] [INFO ] [MAIN ] BLW: Loaded 13213 existing records. [2025-10-15T17:40:57.482882] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:57.483100] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-15T17:40:57.483145] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-15T17:40:57.483401] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-15T17:40:57.483465] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-15T17:40:57.719218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-15T17:40:57.831456] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:58.156865] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T17:40:58.514025] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-15T17:40:59.236791] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T17:40:59.313957] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-15T17:40:59.820596] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T17:40:59.962773] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T17:41:00.114069] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-15T17:41:00.914042] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-15T17:41:01.642638] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T17:41:01.711693] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:41:01.719847] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-15T17:41:02.305358] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:41:02.514046] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-15T17:41:03.314009] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-15T17:41:04.006896] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T17:41:04.113996] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-15T17:41:04.913993] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-15T17:41:05.361878] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:41:05.493861] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:41:05.515868] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T17:41:05.714029] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-15T17:41:06.513990] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-15T17:41:07.198135] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T17:41:07.313995] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-15T17:41:07.827439] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T17:41:07.923581] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T17:41:08.114085] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-15T17:41:08.779772] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:41:08.914045] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-15T17:41:09.714030] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-15T17:41:09.858530] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:41:10.365914] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T17:41:10.367868] [INFO ] [REMOTE ] BLE: Full fetch complete (19837 records). [2025-10-15T17:41:10.367947] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-15T17:41:10.519171] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-15T17:41:10.734254] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-15T17:41:10.734336] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-15T17:41:10.734797] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-15T17:41:10.734859] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-15T17:41:10.735442] [DEBUG] [LOCAL ] BLE: Trimmed 19837 records to 13810 (keeping 200 days of data) [2025-10-15T17:41:10.815573] [DEBUG] [LOCAL ] BLE: Primary data saved (13810 records). [2025-10-15T17:41:10.815749] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-15T17:41:10.815874] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLE took 33.1s. Estimated remaining: 4h 43m 29s. Rate: 7.3 symbols/min [2025-10-15T17:41:10.980891] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:10.981084] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-10-15T17:41:10.981120] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-10-15T17:41:10.981233] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-15T17:41:10.981273] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-15T17:41:10.981313] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-10-15T17:41:10.981344] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-15T17:41:11.330519] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:11.321473] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-15T17:41:12.113976] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-15T17:41:12.157407] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T17:41:12.424247] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:41:12.914010] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-15T17:41:13.713980] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-15T17:41:13.852186] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T17:41:13.953142] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T17:41:14.408690] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T17:41:14.513990] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-15T17:41:15.313988] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-15T17:41:15.433937] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T17:41:16.114007] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-15T17:41:16.914031] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-15T17:41:16.991349] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T17:41:17.006186] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T17:41:17.008686] [INFO ] [REMOTE ] BLW: Full fetch complete (19297 records). [2025-10-15T17:41:17.008799] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-15T17:41:17.394852] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-15T17:41:17.394974] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-15T17:41:17.395531] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-15T17:41:17.395593] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-15T17:41:17.396186] [DEBUG] [LOCAL ] BLW: Trimmed 19297 records to 13190 (keeping 200 days of data) [2025-10-15T17:41:17.476310] [DEBUG] [LOCAL ] BLW: Primary data saved (13190 records). [2025-10-15T17:41:17.476473] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-15T17:41:17.476554] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLW took 20.4s. Estimated remaining: 4h 43m 10s. Rate: 7.3 symbols/min [2025-10-15T17:41:17.641487] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:17.677135] [DEBUG] [LOCAL ] BMA: Loaded 36025 existing records from primary storage. [2025-10-15T17:41:17.677444] [INFO ] [MAIN ] BMA: Loaded 36025 existing records. [2025-10-15T17:41:17.722758] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-15T17:41:17.871585] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:17.871946] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-15T17:41:17.872005] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-15T17:41:17.872519] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-15T17:41:17.872580] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-15T17:41:18.266337] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:18.294868] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:41:18.513991] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-15T17:41:18.851052] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T17:41:19.314061] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-15T17:41:20.020831] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:41:20.113984] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-15T17:41:20.155047] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:41:20.914049] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-15T17:41:21.372848] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:41:21.714006] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-15T17:41:22.319465] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:41:22.324029] [INFO ] [REMOTE ] BLK: Full fetch complete (52840 records). [2025-10-15T17:41:22.324150] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-15T17:41:22.520040] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-15T17:41:22.696624] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-15T17:41:22.696735] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-15T17:41:22.697417] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-15T17:41:22.697457] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-15T17:41:22.698525] [DEBUG] [LOCAL ] BLK: Trimmed 52840 records to 34301 (keeping 200 days of data) [2025-10-15T17:41:22.923908] [DEBUG] [LOCAL ] BLK: Primary data saved (34301 records). [2025-10-15T17:41:22.924060] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-15T17:41:22.924152] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLK took 43.9s. Estimated remaining: 4h 42m 43s. Rate: 7.3 symbols/min [2025-10-15T17:41:23.102624] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:23.137985] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T17:41:23.154264] [DEBUG] [LOCAL ] BME: Loaded 11234 existing records from primary storage. [2025-10-15T17:41:23.154717] [INFO ] [MAIN ] BME: Loaded 11234 existing records. [2025-10-15T17:41:23.239719] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T17:41:23.319408] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-15T17:41:23.363052] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:23.363495] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-15T17:41:23.363545] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-15T17:41:23.363777] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-15T17:41:23.363835] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-15T17:41:23.722774] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:24.113993] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-15T17:41:24.521536] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T17:41:24.913998] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-15T17:41:25.723721] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-15T17:41:25.749479] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:41:25.773572] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T17:41:26.514029] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-15T17:41:27.119125] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T17:41:27.314038] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-15T17:41:27.397875] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:41:28.114019] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-15T17:41:28.914024] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-15T17:41:28.935003] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T17:41:29.047932] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T17:41:29.714017] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-15T17:41:29.819271] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T17:41:30.513996] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-15T17:41:31.051440] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:41:31.058056] [INFO ] [REMOTE ] BLND: Full fetch complete (72323 records). [2025-10-15T17:41:31.058316] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-15T17:41:31.319108] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-15T17:41:31.475958] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-15T17:41:31.476061] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-15T17:41:31.476946] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-15T17:41:31.477017] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-15T17:41:31.478772] [DEBUG] [LOCAL ] BLND: Trimmed 72323 records to 49281 (keeping 200 days of data) [2025-10-15T17:41:31.764681] [DEBUG] [LOCAL ] BLND: Primary data saved (49281 records). [2025-10-15T17:41:31.764857] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-15T17:41:31.764948] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLND took 36.6s. Estimated remaining: 4h 42m 39s. Rate: 7.3 symbols/min [2025-10-15T17:41:31.942809] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:31.969699] [DEBUG] [LOCAL ] BMEZ: Loaded 26013 existing records from primary storage. [2025-10-15T17:41:31.969973] [INFO ] [MAIN ] BMEZ: Loaded 26013 existing records. [2025-10-15T17:41:32.128708] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T17:41:32.127338] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-15T17:41:32.182867] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:32.183378] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-15T17:41:32.183444] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-15T17:41:32.183809] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-15T17:41:32.183866] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-15T17:41:32.484710] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:41:32.580815] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:32.913992] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-15T17:41:33.001409] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:41:33.714116] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-15T17:41:34.181856] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:41:34.514058] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-15T17:41:34.549190] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T17:41:35.314105] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-15T17:41:35.572123] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T17:41:36.080468] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T17:41:36.114030] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-15T17:41:36.914030] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-15T17:41:37.154453] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:41:37.519719] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T17:41:37.714038] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-15T17:41:38.514042] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-15T17:41:38.675413] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:41:39.201854] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:41:39.314024] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-15T17:41:40.113995] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-15T17:41:40.156159] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:41:40.914030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-15T17:41:41.355366] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:41:41.468300] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T17:41:41.714048] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-15T17:41:42.491084] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:41:42.513983] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-15T17:41:43.314066] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-15T17:41:43.505079] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T17:41:44.073792] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T17:41:44.076084] [INFO ] [REMOTE ] BLX: Full fetch complete (22450 records). [2025-10-15T17:41:44.076158] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-15T17:41:44.119135] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-15T17:41:44.458846] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-15T17:41:44.458962] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-15T17:41:44.459690] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-15T17:41:44.459757] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-15T17:41:44.460872] [DEBUG] [LOCAL ] BLX: Trimmed 22450 records to 15583 (keeping 200 days of data) [2025-10-15T17:41:44.571257] [DEBUG] [LOCAL ] BLX: Primary data saved (15583 records). [2025-10-15T17:41:44.571461] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-15T17:41:44.571555] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BLX took 33.8s. Estimated remaining: 4h 43m 2s. Rate: 7.3 symbols/min [2025-10-15T17:41:44.815593] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:44.844064] [DEBUG] [LOCAL ] BMI: Loaded 24471 existing records from primary storage. [2025-10-15T17:41:44.844406] [INFO ] [MAIN ] BMI: Loaded 24471 existing records. [2025-10-15T17:41:44.924328] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-15T17:41:45.049512] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:45.057817] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-15T17:41:45.058738] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T17:41:45.061690] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-15T17:41:45.062333] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-15T17:41:45.062386] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-15T17:41:45.436099] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:45.714091] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-15T17:41:46.156934] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:41:46.514028] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-15T17:41:46.896426] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:41:47.314009] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-15T17:41:47.606165] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T17:41:48.113998] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-15T17:41:48.566353] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:41:48.914054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-15T17:41:49.440974] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T17:41:49.623840] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T17:41:49.714034] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-15T17:41:50.512087] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:41:50.516201] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-15T17:41:51.314034] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-15T17:41:51.841277] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T17:41:52.114076] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-15T17:41:52.332791] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T17:41:52.913988] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-15T17:41:53.333790] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:41:53.714022] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-15T17:41:53.750152] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T17:41:54.514075] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-15T17:41:54.665738] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T17:41:55.314089] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-15T17:41:55.895020] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:41:56.114090] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-15T17:41:56.658872] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T17:41:56.914044] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-15T17:41:57.303846] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T17:41:57.650779] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T17:41:57.652866] [INFO ] [REMOTE ] BME: Full fetch complete (15950 records). [2025-10-15T17:41:57.652952] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-15T17:41:57.720895] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-15T17:41:58.023282] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-15T17:41:58.023368] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-15T17:41:58.023775] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-15T17:41:58.023837] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-15T17:41:58.024363] [DEBUG] [LOCAL ] BME: Trimmed 15950 records to 11286 (keeping 200 days of data) [2025-10-15T17:41:58.092487] [DEBUG] [LOCAL ] BME: Primary data saved (11286 records). [2025-10-15T17:41:58.092661] [INFO ] [MAIN ] BME: Full history saved. [2025-10-15T17:41:58.092764] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BME took 35.2s. Estimated remaining: 4h 43m 30s. Rate: 7.3 symbols/min [2025-10-15T17:41:58.268059] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:58.273481] [DEBUG] [LOCAL ] BMN: Loaded 2585 existing records from primary storage. [2025-10-15T17:41:58.273737] [INFO ] [MAIN ] BMN: Loaded 2585 existing records. [2025-10-15T17:41:58.452314] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:58.452601] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-15T17:41:58.452700] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-15T17:41:58.452850] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-15T17:41:58.452888] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-15T17:41:58.519149] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-15T17:41:58.844183] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:59.055834] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T17:41:59.314066] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-15T17:41:59.903972] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T17:42:00.117327] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-15T17:42:00.121952] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:42:00.914025] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-15T17:42:01.115898] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:42:01.121727] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40275 records). [2025-10-15T17:42:01.121951] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-15T17:42:01.538540] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-15T17:42:01.538700] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-15T17:42:01.539599] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-15T17:42:01.539669] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-15T17:42:01.540996] [DEBUG] [LOCAL ] BMEZ: Trimmed 40275 records to 25911 (keeping 200 days of data) [2025-10-15T17:42:01.701126] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25911 records). [2025-10-15T17:42:01.701299] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-15T17:42:01.701408] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BMEZ took 29.9s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-15T17:42:01.722417] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-15T17:42:01.879637] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:01.920928] [DEBUG] [LOCAL ] BMO: Loaded 41163 existing records from primary storage. [2025-10-15T17:42:01.921325] [INFO ] [MAIN ] BMO: Loaded 41163 existing records. [2025-10-15T17:42:02.103166] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:02.103780] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-15T17:42:02.103870] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-15T17:42:02.109696] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-15T17:42:02.117021] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T17:42:02.116528] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-15T17:42:02.229742] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T17:42:02.515489] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-15T17:42:02.519272] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:03.314025] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-15T17:42:03.514300] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:42:04.033691] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T17:42:04.114018] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-15T17:42:04.914024] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-15T17:42:05.191732] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T17:42:05.713987] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-15T17:42:06.513981] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-15T17:42:06.624206] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T17:42:06.629446] [INFO ] [REMOTE ] BMA: Full fetch complete (51918 records). [2025-10-15T17:42:06.629553] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-15T17:42:07.007895] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-15T17:42:07.008034] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-15T17:42:07.009691] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-15T17:42:07.009755] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-15T17:42:07.010891] [DEBUG] [LOCAL ] BMA: Trimmed 51918 records to 36165 (keeping 200 days of data) [2025-10-15T17:42:07.234009] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:42:07.269613] [DEBUG] [LOCAL ] BMA: Primary data saved (36165 records). [2025-10-15T17:42:07.269795] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-15T17:42:07.270063] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMA took 49.8s. Estimated remaining: 4h 42m 24s. Rate: 7.3 symbols/min [2025-10-15T17:42:07.316131] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-15T17:42:07.447234] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:07.447635] [DEBUG] [LOCAL ] BMY: No existing data file found in primary storage. [2025-10-15T17:42:07.447721] [WARN ] [MAIN ] BMY: No existing data found, performing full refresh instead. [2025-10-15T17:42:07.447853] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-15T17:42:07.447895] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-15T17:42:07.447936] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-10-15T17:42:07.447966] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-15T17:42:07.767259] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:42:07.830739] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:07.830951] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T17:42:08.114036] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-15T17:42:08.914012] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-15T17:42:09.230942] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:42:09.713993] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-15T17:42:10.514005] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-15T17:42:10.837487] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T17:42:10.841987] [INFO ] [REMOTE ] BMI: Full fetch complete (33376 records). [2025-10-15T17:42:10.842146] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-15T17:42:11.073785] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T17:42:11.204969] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-15T17:42:11.298623] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-15T17:42:11.298766] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-15T17:42:11.299590] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-15T17:42:11.299636] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-15T17:42:11.300772] [DEBUG] [LOCAL ] BMI: Trimmed 33376 records to 24500 (keeping 200 days of data) [2025-10-15T17:42:11.358053] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-15T17:42:11.476095] [DEBUG] [LOCAL ] BMI: Primary data saved (24500 records). [2025-10-15T17:42:11.476276] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-15T17:42:11.476376] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 26.9s. Estimated remaining: 4h 41m 49s. Rate: 7.3 symbols/min [2025-10-15T17:42:11.655999] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:11.716282] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-15T17:42:11.716712] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-15T17:42:11.909371] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:11.909625] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-15T17:42:11.909710] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-15T17:42:11.910350] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-15T17:42:11.910393] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-15T17:42:12.125851] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-15T17:42:12.284289] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:12.615009] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:42:12.914029] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-15T17:42:13.714070] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-15T17:42:13.999052] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T17:42:14.290177] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T17:42:14.514063] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-15T17:42:14.937197] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T17:42:15.314021] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-15T17:42:15.487613] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T17:42:15.805218] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T17:42:16.113999] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-15T17:42:16.914006] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-15T17:42:17.268452] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-15T17:42:17.501765] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:42:17.714003] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-15T17:42:18.025748] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-15T17:42:18.514079] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-15T17:42:18.882864] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-15T17:42:19.313987] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-15T17:42:20.113996] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-15T17:42:20.914198] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-15T17:42:20.920720] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:42:21.456442] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:42:21.457319] [INFO ] [REMOTE ] BMN: Full fetch complete (3724 records). [2025-10-15T17:42:21.457389] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-15T17:42:21.718275] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-15T17:42:21.838312] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-15T17:42:21.847595] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-15T17:42:21.862904] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-15T17:42:21.863049] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-15T17:42:21.864174] [DEBUG] [LOCAL ] BMN: Trimmed 3724 records to 2596 (keeping 200 days of data) [2025-10-15T17:42:21.865806] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:42:21.891905] [DEBUG] [LOCAL ] BMN: Primary data saved (2596 records). [2025-10-15T17:42:21.892014] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-15T17:42:21.892097] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMN took 23.8s. Estimated remaining: 4h 41m 56s. Rate: 7.3 symbols/min [2025-10-15T17:42:22.074348] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:22.104322] [DEBUG] [LOCAL ] BNED: Loaded 28733 existing records from primary storage. [2025-10-15T17:42:22.104706] [INFO ] [MAIN ] BNED: Loaded 28733 existing records. [2025-10-15T17:42:22.311076] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:22.311399] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-15T17:42:22.311472] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-15T17:42:22.311994] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-15T17:42:22.312244] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-15T17:42:22.519223] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-15T17:42:22.670090] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:23.314031] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-15T17:42:23.511325] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:42:23.927852] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T17:42:24.114034] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-15T17:42:24.914020] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-15T17:42:25.029329] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:42:25.714013] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-15T17:42:25.779588] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T17:42:26.032432] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T17:42:26.514046] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-15T17:42:27.314013] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-15T17:42:27.971790] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-15T17:42:28.114057] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-15T17:42:28.284714] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T17:42:28.447114] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:42:28.914056] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-15T17:42:29.713986] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-15T17:42:29.895281] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T17:42:30.513966] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-15T17:42:30.547492] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:42:30.846821] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:42:31.314080] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-15T17:42:32.113981] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-15T17:42:32.530994] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-15T17:42:32.840207] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:42:32.913954] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-15T17:42:33.565779] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:42:33.714008] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-15T17:42:34.496936] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:42:34.513951] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-15T17:42:35.313967] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-15T17:42:35.573398] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T17:42:35.716618] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T17:42:36.114002] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-15T17:42:36.840631] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:42:36.845613] [INFO ] [REMOTE ] BMO: Full fetch complete (59852 records). [2025-10-15T17:42:36.845751] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-15T17:42:36.920638] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-15T17:42:37.231915] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-15T17:42:37.232004] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-15T17:42:37.232746] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-15T17:42:37.232811] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-15T17:42:37.234219] [DEBUG] [LOCAL ] BMO: Trimmed 59852 records to 41237 (keeping 200 days of data) [2025-10-15T17:42:37.484197] [DEBUG] [LOCAL ] BMO: Primary data saved (41237 records). [2025-10-15T17:42:37.484347] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-15T17:42:37.484431] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 35.8s. Estimated remaining: 4h 42m 37s. Rate: 7.3 symbols/min [2025-10-15T17:42:37.687409] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:37.699314] [DEBUG] [LOCAL ] BNH: Loaded 5072 existing records from primary storage. [2025-10-15T17:42:37.699551] [INFO ] [MAIN ] BNH: Loaded 5072 existing records. [2025-10-15T17:42:37.720813] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-15T17:42:37.895617] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:37.896269] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-15T17:42:37.896426] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-15T17:42:37.896617] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-15T17:42:37.896708] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-15T17:42:38.092344] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T17:42:38.334706] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T17:42:38.340283] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:38.514010] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-15T17:42:39.314039] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-15T17:42:39.728194] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T17:42:39.953785] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T17:42:39.953581] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T17:42:40.113987] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-15T17:42:40.914054] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-15T17:42:41.208996] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T17:42:41.714010] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-15T17:42:42.513986] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-15T17:42:42.745051] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:42:42.924497] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T17:42:42.940745] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T17:42:43.314064] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-15T17:42:44.114010] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-15T17:42:44.913995] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-15T17:42:45.320170] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T17:42:45.714004] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-15T17:42:45.978572] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T17:42:46.143093] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T17:42:46.514020] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-15T17:42:46.775037] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:42:47.314050] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-15T17:42:47.900784] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:42:48.113964] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-15T17:42:48.155371] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T17:42:48.813746] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T17:42:48.914081] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-15T17:42:49.714018] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-15T17:42:50.306819] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T17:42:50.317122] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-15T17:42:50.317398] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-15T17:42:50.536070] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-15T17:42:50.780019] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-15T17:42:50.780340] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-15T17:42:50.783702] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:42:50.781807] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-15T17:42:50.794557] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-15T17:42:50.796688] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-15T17:42:51.121886] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-15T17:42:51.122039] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-15T17:42:51.122114] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMY took 43.9s. Estimated remaining: 4h 43m 4s. Rate: 7.3 symbols/min [2025-10-15T17:42:51.302604] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:51.308272] [DEBUG] [LOCAL ] BNJ: Loaded 2629 existing records from primary storage. [2025-10-15T17:42:51.308461] [INFO ] [MAIN ] BNJ: Loaded 2629 existing records. [2025-10-15T17:42:51.320068] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-15T17:42:51.444485] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T17:42:51.537872] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:51.538186] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-15T17:42:51.538241] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-15T17:42:51.538481] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-15T17:42:51.538541] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-15T17:42:51.924734] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:52.114017] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-15T17:42:52.510523] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T17:42:52.766417] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:42:52.913971] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-15T17:42:53.714016] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-15T17:42:54.277178] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T17:42:54.513971] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-15T17:42:54.922771] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T17:42:55.314028] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-15T17:42:55.539198] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T17:42:56.114028] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-15T17:42:56.651621] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:42:56.654550] [INFO ] [REMOTE ] BNED: Full fetch complete (42620 records). [2025-10-15T17:42:56.654633] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-15T17:42:56.762787] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:42:56.919111] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-15T17:42:57.044131] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-15T17:42:57.044215] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-15T17:42:57.044840] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-15T17:42:57.044901] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-15T17:42:57.045796] [DEBUG] [LOCAL ] BNED: Trimmed 42620 records to 28621 (keeping 200 days of data) [2025-10-15T17:42:57.208046] [DEBUG] [LOCAL ] BNED: Primary data saved (28621 records). [2025-10-15T17:42:57.208189] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-15T17:42:57.208273] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BNED took 35.3s. Estimated remaining: 4h 42m 42s. Rate: 7.3 symbols/min [2025-10-15T17:42:57.359016] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:42:57.383821] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:57.427449] [DEBUG] [LOCAL ] BNL: Loaded 47213 existing records from primary storage. [2025-10-15T17:42:57.427814] [INFO ] [MAIN ] BNL: Loaded 47213 existing records. [2025-10-15T17:42:57.602010] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:57.602288] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-15T17:42:57.602338] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-15T17:42:57.602605] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-15T17:42:57.602694] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-15T17:42:57.719291] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-15T17:42:57.968986] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:58.514027] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-15T17:42:58.883181] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T17:42:59.314005] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-15T17:42:59.470321] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:42:59.477444] [INFO ] [REMOTE ] BN: Full fetch complete (76941 records). [2025-10-15T17:42:59.477626] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-15T17:42:59.901558] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-15T17:42:59.902177] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-15T17:42:59.902072] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T17:42:59.903953] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-15T17:42:59.906542] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-15T17:42:59.909316] [DEBUG] [LOCAL ] BN: Trimmed 76941 records to 52988 (keeping 200 days of data) [2025-10-15T17:43:00.136945] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-15T17:43:00.258943] [DEBUG] [LOCAL ] BN: Primary data saved (52988 records). [2025-10-15T17:43:00.259114] [INFO ] [MAIN ] BN: Full history saved. [2025-10-15T17:43:00.260182] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BN took 48.8s. Estimated remaining: 4h 41m 59s. Rate: 7.3 symbols/min [2025-10-15T17:43:00.444975] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:00.497982] [DEBUG] [LOCAL ] BNS: Loaded 51485 existing records from primary storage. [2025-10-15T17:43:00.498391] [INFO ] [MAIN ] BNS: Loaded 51485 existing records. [2025-10-15T17:43:00.700206] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:00.700476] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-15T17:43:00.700537] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-15T17:43:00.700996] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-15T17:43:00.701059] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-15T17:43:00.923301] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-15T17:43:01.081621] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:01.713969] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-15T17:43:01.764311] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:43:01.783401] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:43:01.784582] [INFO ] [REMOTE ] BNH: Full fetch complete (6893 records). [2025-10-15T17:43:01.784680] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-15T17:43:01.785066] [FATAL] [VALIDATOR ] BNH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:43:01.785149] [FATAL] [MAIN ] BNH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:43:01.785193] [WARN ] [MAIN ] BNH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:43:01.785280] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-15T17:43:01.785345] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-10-15T17:43:01.785381] [INFO ] [LOCAL ] BNH: Starting deletion of derivative data. [2025-10-15T17:43:01.785606] [DEBUG] [LOCAL ] BNH: Deleted derivative data file. [2025-10-15T17:43:01.785719] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNH took 24.3s. Estimated remaining: 4h 41m 7s. Rate: 7.3 symbols/min [2025-10-15T17:43:01.950329] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:01.956029] [DEBUG] [LOCAL ] BNT: Loaded 3459 existing records from primary storage. [2025-10-15T17:43:01.956243] [INFO ] [MAIN ] BNT: Loaded 3459 existing records. [2025-10-15T17:43:02.139621] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:02.140147] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-15T17:43:02.144621] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-15T17:43:02.144902] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T17:43:02.146827] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-15T17:43:02.146915] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-15T17:43:02.514381] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:02.514531] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-15T17:43:03.047180] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T17:43:03.314013] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-15T17:43:04.114058] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-15T17:43:04.914009] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-15T17:43:05.055101] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T17:43:05.343587] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T17:43:05.411715] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-15T17:43:05.714012] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-15T17:43:06.128223] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T17:43:06.514050] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-15T17:43:06.951738] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T17:43:07.314071] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-15T17:43:08.113991] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-15T17:43:08.752231] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:43:08.913984] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-15T17:43:09.095211] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T17:43:09.576035] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T17:43:09.714005] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-15T17:43:10.252628] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T17:43:10.513994] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-15T17:43:11.313997] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-15T17:43:11.781591] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:43:12.113977] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-15T17:43:12.924390] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-15T17:43:12.944735] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:43:13.515072] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:43:13.521066] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:43:13.714027] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-15T17:43:14.514021] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-15T17:43:15.314023] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-15T17:43:15.623873] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T17:43:16.095583] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:43:16.119936] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-15T17:43:16.132363] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T17:43:16.535109] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T17:43:16.913988] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-15T17:43:17.713991] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-15T17:43:18.081311] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-15T17:43:18.467526] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T17:43:18.513976] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-15T17:43:19.314143] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-15T17:43:20.029792] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T17:43:20.059689] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T17:43:20.114013] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-15T17:43:20.914001] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-15T17:43:21.403175] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T17:43:21.491542] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T17:43:21.714027] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-15T17:43:22.294088] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:43:22.514050] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-15T17:43:22.990188] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T17:43:22.991281] [INFO ] [REMOTE ] BNT: Full fetch complete (4674 records). [2025-10-15T17:43:22.991365] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-15T17:43:23.319202] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-15T17:43:23.350448] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-15T17:43:23.350535] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-15T17:43:23.350703] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-15T17:43:23.350765] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-15T17:43:23.351140] [DEBUG] [LOCAL ] BNT: Trimmed 4674 records to 3485 (keeping 200 days of data) [2025-10-15T17:43:23.376543] [DEBUG] [LOCAL ] BNT: Primary data saved (3485 records). [2025-10-15T17:43:23.376743] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-15T17:43:23.376908] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNT took 21.6s. Estimated remaining: 4h 42m 26s. Rate: 7.3 symbols/min [2025-10-15T17:43:23.547027] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:23.556626] [DEBUG] [LOCAL ] BNY: Loaded 7171 existing records from primary storage. [2025-10-15T17:43:23.556903] [INFO ] [MAIN ] BNY: Loaded 7171 existing records. [2025-10-15T17:43:23.733073] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:23.733296] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-15T17:43:23.733345] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-15T17:43:23.733522] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-15T17:43:23.733561] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-15T17:43:24.091133] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:24.113999] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-15T17:43:24.914059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-15T17:43:25.220261] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:43:25.306391] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T17:43:25.599960] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T17:43:25.714048] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-15T17:43:26.514059] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-15T17:43:27.313968] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-15T17:43:27.590420] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T17:43:27.872982] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T17:43:28.019740] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T17:43:28.113976] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-15T17:43:28.913968] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-15T17:43:29.714059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-15T17:43:29.835445] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:43:29.841893] [INFO ] [REMOTE ] BNL: Full fetch complete (67273 records). [2025-10-15T17:43:29.842081] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-15T17:43:30.255141] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:43:30.255609] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-15T17:43:30.256803] [INFO ] [REMOTE ] BNJ: Full fetch complete (4141 records). [2025-10-15T17:43:30.257050] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-15T17:43:30.257223] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-15T17:43:30.269860] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-15T17:43:30.291393] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-15T17:43:30.370402] [DEBUG] [LOCAL ] BNL: Trimmed 67273 records to 47279 (keeping 200 days of data) [2025-10-15T17:43:30.519014] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-15T17:43:30.773894] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-15T17:43:30.784067] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T17:43:30.794422] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-15T17:43:30.795528] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-15T17:43:30.796963] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-15T17:43:30.799512] [DEBUG] [LOCAL ] BNJ: Trimmed 4141 records to 2607 (keeping 200 days of data) [2025-10-15T17:43:30.819035] [DEBUG] [LOCAL ] BNJ: Primary data saved (2607 records). [2025-10-15T17:43:30.820195] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-15T17:43:30.820838] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNJ took 39.7s. Estimated remaining: 4h 42m 13s. Rate: 7.3 symbols/min [2025-10-15T17:43:31.103748] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:31.177088] [DEBUG] [LOCAL ] BOC: Loaded 18632 existing records from primary storage. [2025-10-15T17:43:31.183229] [DEBUG] [LOCAL ] BNL: Primary data saved (47279 records). [2025-10-15T17:43:31.183169] [INFO ] [MAIN ] BOC: Loaded 18632 existing records. [2025-10-15T17:43:31.183349] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-15T17:43:31.246570] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNL took 34.0s. Estimated remaining: 4h 41m 14s. Rate: 7.3 symbols/min [2025-10-15T17:43:31.321764] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-15T17:43:31.363131] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:31.363318] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-15T17:43:31.363366] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-15T17:43:31.363618] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-15T17:43:31.363700] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-15T17:43:31.661364] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:43:31.740042] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:32.114000] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-15T17:43:32.923615] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-15T17:43:32.925287] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T17:43:33.094133] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:43:33.539769] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:43:33.714026] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-15T17:43:34.514044] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-15T17:43:35.314079] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-15T17:43:35.397992] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T17:43:35.450536] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:43:35.688889] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T17:43:36.114024] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-15T17:43:36.914049] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-15T17:43:37.714048] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-15T17:43:37.781388] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:43:37.950001] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T17:43:38.360105] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T17:43:38.514021] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-15T17:43:39.250833] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T17:43:39.314070] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-15T17:43:39.925789] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T17:43:40.114158] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-15T17:43:40.914096] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-15T17:43:41.191681] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:43:41.606714] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T17:43:41.714008] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-15T17:43:42.322908] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:43:42.514007] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-15T17:43:43.314083] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-15T17:43:44.113992] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-15T17:43:44.209983] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T17:43:44.216995] [INFO ] [REMOTE ] BNS: Full fetch complete (74616 records). [2025-10-15T17:43:44.217159] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-15T17:43:44.421346] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T17:43:44.651849] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-15T17:43:44.651958] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-15T17:43:44.652946] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-15T17:43:44.653012] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-15T17:43:44.654855] [DEBUG] [LOCAL ] BNS: Trimmed 74616 records to 51484 (keeping 200 days of data) [2025-10-15T17:43:44.893733] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T17:43:44.914100] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-15T17:43:45.007996] [DEBUG] [LOCAL ] BNS: Primary data saved (51484 records). [2025-10-15T17:43:45.008184] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-15T17:43:45.009149] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNS took 44.7s. Estimated remaining: 4h 41m 41s. Rate: 7.3 symbols/min [2025-10-15T17:43:45.469019] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T17:43:45.714050] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-15T17:43:46.514060] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-15T17:43:46.542326] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T17:43:47.026799] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T17:43:47.314062] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-15T17:43:48.114043] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-15T17:43:48.313925] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:43:48.853056] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T17:43:48.855007] [INFO ] [REMOTE ] BNY: Full fetch complete (10384 records). [2025-10-15T17:43:48.855083] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-15T17:43:48.928702] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-15T17:43:49.242012] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-15T17:43:49.242116] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-15T17:43:49.242631] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-15T17:43:49.242728] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-15T17:43:49.243308] [DEBUG] [LOCAL ] BNY: Trimmed 10384 records to 7182 (keeping 200 days of data) [2025-10-15T17:43:49.291581] [DEBUG] [LOCAL ] BNY: Primary data saved (7182 records). [2025-10-15T17:43:49.291776] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-15T17:43:49.291886] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNY took 25.9s. Estimated remaining: 4h 41m 8s. Rate: 7.3 symbols/min [2025-10-15T17:43:49.986018] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T17:43:49.991529] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-15T17:43:50.946331] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:43:50.950514] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-15T17:43:51.998190] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T17:43:52.002720] [INFO ] [REMOTE ] BOC: Full fetch complete (25942 records). [2025-10-15T17:43:52.002966] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-15T17:43:52.421329] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-15T17:43:52.421425] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-15T17:43:52.422114] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-15T17:43:52.422177] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-15T17:43:52.423043] [DEBUG] [LOCAL ] BOC: Trimmed 25942 records to 18587 (keeping 200 days of data) [2025-10-15T17:43:52.538542] [DEBUG] [LOCAL ] BOC: Primary data saved (18587 records). [2025-10-15T17:43:52.538786] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-15T17:43:52.538902] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 21.7s. Estimated remaining: 4h 40m 27s. Rate: 7.3 symbols/min [2025-10-15T17:43:53.241569] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.228871] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.338386] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.377119] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.452466] [DEBUG] [LOCAL ] BOOT: Loaded 39842 existing records from primary storage. [2025-10-15T17:43:53.453866] [DEBUG] [LOCAL ] BOE: Loaded 18298 existing records from primary storage. [2025-10-15T17:43:53.453124] [DEBUG] [LOCAL ] BOH: Loaded 30552 existing records from primary storage. [2025-10-15T17:43:53.464897] [INFO ] [MAIN ] BOH: Loaded 30552 existing records. [2025-10-15T17:43:53.465204] [INFO ] [MAIN ] BOOT: Loaded 39842 existing records. [2025-10-15T17:43:53.465409] [INFO ] [MAIN ] BOE: Loaded 18298 existing records. [2025-10-15T17:43:53.483557] [DEBUG] [LOCAL ] BOND: Loaded 32377 existing records from primary storage. [2025-10-15T17:43:53.617909] [INFO ] [MAIN ] BOND: Loaded 32377 existing records. [2025-10-15T17:43:54.162960] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.166264] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.205246] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.199811] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.215517] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-15T17:43:54.241342] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-15T17:43:54.276577] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-15T17:43:54.285051] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.296457] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-15T17:43:54.297704] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-15T17:43:54.329361] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.319616] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-15T17:43:54.329836] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-15T17:43:54.329221] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.424729] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-15T17:43:54.457020] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.457166] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-15T17:43:54.450218] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-15T17:43:54.463088] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-15T17:43:54.544910] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-15T17:43:55.728407] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.865734] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-15T17:43:55.874700] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.871460] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.881639] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-15T17:43:55.882707] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-15T17:43:55.971047] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.971671] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-15T17:43:56.846031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:43:56.851359] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-15T17:43:57.006919] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:43:57.012858] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-15T17:43:57.385115] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:43:57.393464] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-15T17:43:57.495119] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:43:57.503723] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-15T17:43:57.832067] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T17:43:57.836779] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-15T17:43:58.057536] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:43:58.435485] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:43:58.460876] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-15T17:43:58.514005] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-15T17:43:58.713465] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:43:59.313978] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-15T17:43:59.364713] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T17:44:00.114040] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-15T17:44:00.127249] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T17:44:00.914002] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-15T17:44:01.695438] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:44:01.713956] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-15T17:44:01.856888] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T17:44:02.514018] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-15T17:44:03.149222] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:44:03.313998] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-15T17:44:03.738621] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:44:04.113999] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-15T17:44:04.461172] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:44:04.844821] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:44:04.914000] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-15T17:44:05.574827] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T17:44:05.713998] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-15T17:44:06.514009] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-15T17:44:06.692339] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T17:44:07.314033] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-15T17:44:07.586553] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T17:44:07.963146] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:44:08.114041] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-15T17:44:08.913972] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-15T17:44:08.989255] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T17:44:09.714029] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-15T17:44:10.514017] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-15T17:44:10.584984] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:44:10.763287] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T17:44:10.766388] [INFO ] [REMOTE ] BOE: Full fetch complete (26785 records). [2025-10-15T17:44:10.766481] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-15T17:44:11.141055] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-15T17:44:11.141137] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-15T17:44:11.141670] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-15T17:44:11.141734] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-15T17:44:11.142366] [DEBUG] [LOCAL ] BOE: Trimmed 26785 records to 18229 (keeping 200 days of data) [2025-10-15T17:44:11.255004] [DEBUG] [LOCAL ] BOE: Primary data saved (18229 records). [2025-10-15T17:44:11.255169] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-15T17:44:11.255257] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOE took 18.7s. Estimated remaining: 4h 41m 26s. Rate: 7.3 symbols/min [2025-10-15T17:44:11.319125] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-15T17:44:11.426266] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:11.493037] [DEBUG] [LOCAL ] BORR: Loaded 51146 existing records from primary storage. [2025-10-15T17:44:11.493436] [INFO ] [MAIN ] BORR: Loaded 51146 existing records. [2025-10-15T17:44:11.668962] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:11.669205] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-15T17:44:11.669252] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-15T17:44:11.670095] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-15T17:44:11.670155] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-15T17:44:12.012950] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:44:12.071818] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:12.113967] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-15T17:44:12.457415] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T17:44:12.914043] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-15T17:44:13.658327] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:44:13.713970] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-15T17:44:13.819260] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T17:44:14.514051] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-15T17:44:15.313978] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-15T17:44:15.482244] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T17:44:15.606109] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T17:44:16.114001] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-15T17:44:16.633817] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T17:44:16.914028] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-15T17:44:17.713992] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-15T17:44:17.776132] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T17:44:18.411070] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:44:18.514034] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-15T17:44:19.107067] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:44:19.314062] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-15T17:44:20.020922] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:44:20.113962] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-15T17:44:20.596269] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T17:44:20.914039] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-15T17:44:21.664473] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T17:44:21.713977] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-15T17:44:22.191340] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:44:22.514002] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-15T17:44:23.313971] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-15T17:44:23.443017] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T17:44:23.568349] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:44:24.114021] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-15T17:44:24.817054] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:44:24.913955] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-15T17:44:25.483512] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T17:44:25.489483] [INFO ] [REMOTE ] BOH: Full fetch complete (45129 records). [2025-10-15T17:44:25.489686] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-15T17:44:25.719131] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-15T17:44:25.875542] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-15T17:44:25.875619] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-15T17:44:25.876292] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-15T17:44:25.876350] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-15T17:44:25.877305] [DEBUG] [LOCAL ] BOH: Trimmed 45129 records to 30544 (keeping 200 days of data) [2025-10-15T17:44:26.064586] [DEBUG] [LOCAL ] BOH: Primary data saved (30544 records). [2025-10-15T17:44:26.064759] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-15T17:44:26.064849] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOH took 33.5s. Estimated remaining: 4h 41m 60s. Rate: 7.3 symbols/min [2025-10-15T17:44:26.242093] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:26.268526] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T17:44:26.297252] [DEBUG] [LOCAL ] BOW: Loaded 23426 existing records from primary storage. [2025-10-15T17:44:26.297686] [INFO ] [MAIN ] BOW: Loaded 23426 existing records. [2025-10-15T17:44:26.472607] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:26.472863] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-15T17:44:26.472912] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-15T17:44:26.473181] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-15T17:44:26.473220] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-15T17:44:26.519162] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-15T17:44:26.831897] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:26.870853] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:44:27.314079] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-15T17:44:28.113970] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-15T17:44:28.145683] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:44:28.324975] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T17:44:28.914039] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-15T17:44:29.396042] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T17:44:29.714031] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-15T17:44:30.176279] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:44:30.387938] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T17:44:30.514011] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-15T17:44:31.313996] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-15T17:44:31.355470] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:44:32.114052] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-15T17:44:32.914028] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-15T17:44:33.168664] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:44:33.234220] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T17:44:33.713978] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-15T17:44:34.159593] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:44:34.164115] [INFO ] [REMOTE ] BOOT: Full fetch complete (60086 records). [2025-10-15T17:44:34.164241] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-15T17:44:34.523414] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-15T17:44:34.562487] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-15T17:44:34.562624] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-15T17:44:34.563627] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-15T17:44:34.563727] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-15T17:44:34.565343] [DEBUG] [LOCAL ] BOOT: Trimmed 60086 records to 39827 (keeping 200 days of data) [2025-10-15T17:44:34.808092] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T17:44:34.846288] [DEBUG] [LOCAL ] BOOT: Primary data saved (39827 records). [2025-10-15T17:44:34.846469] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-15T17:44:34.846927] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOOT took 42.3s. Estimated remaining: 4h 41m 55s. Rate: 7.3 symbols/min [2025-10-15T17:44:35.020826] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:35.021016] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-15T17:44:35.021053] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-15T17:44:35.021163] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-15T17:44:35.021208] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-15T17:44:35.021264] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-15T17:44:35.021299] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-15T17:44:35.319141] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-15T17:44:35.391154] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:36.082780] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:44:36.113984] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-15T17:44:36.476681] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T17:44:36.914022] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-15T17:44:37.713975] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-15T17:44:37.759677] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:44:37.796544] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T17:44:38.514021] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-15T17:44:38.783350] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:44:39.313974] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-15T17:44:39.402920] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T17:44:40.114008] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-15T17:44:40.913980] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-15T17:44:41.068610] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T17:44:41.149941] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T17:44:41.714181] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-15T17:44:42.047389] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T17:44:42.051704] [INFO ] [REMOTE ] BOND: Full fetch complete (46594 records). [2025-10-15T17:44:42.051800] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-15T17:44:42.438109] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-15T17:44:42.438194] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-15T17:44:42.438919] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-15T17:44:42.438987] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-15T17:44:42.440109] [DEBUG] [LOCAL ] BOND: Trimmed 46594 records to 32426 (keeping 200 days of data) [2025-10-15T17:44:42.534271] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-15T17:44:42.648148] [DEBUG] [LOCAL ] BOND: Primary data saved (32426 records). [2025-10-15T17:44:42.648306] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-15T17:44:42.648413] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOND took 50.1s. Estimated remaining: 4h 41m 44s. Rate: 7.3 symbols/min [2025-10-15T17:44:42.825306] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:42.884355] [DEBUG] [LOCAL ] BP: Loaded 53708 existing records from primary storage. [2025-10-15T17:44:42.884774] [INFO ] [MAIN ] BP: Loaded 53708 existing records. [2025-10-15T17:44:43.080456] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:43.080752] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-15T17:44:43.080809] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-15T17:44:43.081988] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-15T17:44:43.082051] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-15T17:44:43.323142] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-15T17:44:43.476445] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:43.746679] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T17:44:43.752317] [INFO ] [REMOTE ] BORR: Full fetch complete (74299 records). [2025-10-15T17:44:43.752451] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-15T17:44:43.753125] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:44:43.753210] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:44:43.753252] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:44:43.753292] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-15T17:44:43.753348] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-15T17:44:43.753382] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-10-15T17:44:43.753563] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-10-15T17:44:43.753677] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BORR took 32.5s. Estimated remaining: 4h 40m 50s. Rate: 7.3 symbols/min [2025-10-15T17:44:43.935408] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:43.971157] [DEBUG] [LOCAL ] BR: Loaded 34787 existing records from primary storage. [2025-10-15T17:44:43.971451] [INFO ] [MAIN ] BR: Loaded 34787 existing records. [2025-10-15T17:44:44.127959] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-15T17:44:44.171289] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:44.171953] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-15T17:44:44.172021] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-15T17:44:44.182752] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-15T17:44:44.206898] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-15T17:44:44.260480] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T17:44:44.401559] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:44:44.614985] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:44.914008] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-15T17:44:45.714011] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-15T17:44:45.746233] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:44:46.305444] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T17:44:46.514010] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-15T17:44:47.056932] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T17:44:47.314007] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-15T17:44:48.114064] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-15T17:44:48.557973] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-15T17:44:48.650885] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:44:48.914044] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-15T17:44:49.367987] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:44:49.372492] [INFO ] [REMOTE ] BOW: Full fetch complete (32121 records). [2025-10-15T17:44:49.372620] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-15T17:44:49.722913] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-15T17:44:49.910799] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-15T17:44:49.910935] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-15T17:44:49.911883] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-15T17:44:49.911957] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-15T17:44:49.913311] [DEBUG] [LOCAL ] BOW: Trimmed 32121 records to 23268 (keeping 200 days of data) [2025-10-15T17:44:50.114422] [DEBUG] [LOCAL ] BOW: Primary data saved (23268 records). [2025-10-15T17:44:50.114691] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-15T17:44:50.114949] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BOW took 24.0s. Estimated remaining: 4h 40m 30s. Rate: 7.3 symbols/min [2025-10-15T17:44:50.330877] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:50.331127] [DEBUG] [LOCAL ] BRBR: No existing data file found in primary storage. [2025-10-15T17:44:50.331169] [WARN ] [MAIN ] BRBR: No existing data found, performing full refresh instead. [2025-10-15T17:44:50.331349] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-15T17:44:50.331391] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-15T17:44:50.331434] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-15T17:44:50.331467] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-15T17:44:50.537613] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-15T17:44:50.752710] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:50.786792] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T17:44:50.957482] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:44:51.314048] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-15T17:44:52.114004] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-15T17:44:52.221001] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:44:52.792901] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T17:44:52.913983] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-15T17:44:53.364724] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T17:44:53.714027] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-15T17:44:54.383378] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:44:54.514035] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-15T17:44:55.314017] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-15T17:44:55.534009] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:44:55.742869] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:44:56.114034] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-15T17:44:56.919222] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-15T17:44:56.947740] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:44:57.166726] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:44:57.714101] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-15T17:44:58.514060] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-15T17:44:59.024399] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T17:44:59.073237] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-15T17:44:59.314037] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-15T17:44:59.971953] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T17:45:00.114057] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-15T17:45:00.582430] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:45:00.913983] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-15T17:45:01.714062] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-15T17:45:02.509963] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T17:45:02.521059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-15T17:45:03.024274] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T17:45:03.314006] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-15T17:45:03.569733] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T17:45:04.114011] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-15T17:45:04.715732] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T17:45:04.914024] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-15T17:45:05.285270] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-15T17:45:05.714002] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-15T17:45:06.334543] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T17:45:06.514045] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-15T17:45:06.690057] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T17:45:07.187979] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:45:07.314038] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-15T17:45:08.114013] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-15T17:45:08.232143] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T17:45:08.777444] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-15T17:45:08.913991] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-15T17:45:09.714003] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-15T17:45:09.794954] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:45:09.801078] [INFO ] [REMOTE ] BOX: Full fetch complete (72285 records). [2025-10-15T17:45:09.801273] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-15T17:45:10.270176] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-15T17:45:10.270283] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-15T17:45:10.271168] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-15T17:45:10.271248] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-15T17:45:10.272865] [DEBUG] [LOCAL ] BOX: Trimmed 72285 records to 50190 (keeping 200 days of data) [2025-10-15T17:45:10.382721] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T17:45:10.515720] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-15T17:45:10.594039] [DEBUG] [LOCAL ] BOX: Primary data saved (50190 records). [2025-10-15T17:45:10.594165] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-15T17:45:10.594269] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOX took 35.7s. Estimated remaining: 4h 41m 38s. Rate: 7.3 symbols/min [2025-10-15T17:45:10.767739] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:10.793072] [DEBUG] [LOCAL ] BRC: Loaded 18597 existing records from primary storage. [2025-10-15T17:45:10.793381] [INFO ] [MAIN ] BRC: Loaded 18597 existing records. [2025-10-15T17:45:10.983557] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:45:10.983804] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-15T17:45:10.983853] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-15T17:45:10.984379] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-15T17:45:10.984437] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-15T17:45:11.315843] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-15T17:45:11.337624] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:11.899721] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T17:45:12.117622] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-15T17:45:12.124312] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:45:12.363348] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T17:45:12.914061] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-15T17:45:13.714068] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-15T17:45:14.351031] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T17:45:14.399470] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T17:45:14.514051] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-15T17:45:14.895871] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T17:45:15.314010] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-15T17:45:15.914624] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:45:16.113997] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-15T17:45:16.914169] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-15T17:45:16.916747] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T17:45:16.922731] [INFO ] [REMOTE ] BR: Full fetch complete (49863 records). [2025-10-15T17:45:16.922832] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-15T17:45:17.355695] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-15T17:45:17.355953] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-15T17:45:17.369582] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-15T17:45:17.370995] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:45:17.376450] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-15T17:45:17.377771] [DEBUG] [LOCAL ] BR: Trimmed 49863 records to 34787 (keeping 200 days of data) [2025-10-15T17:45:17.614899] [DEBUG] [LOCAL ] BR: Primary data saved (34787 records). [2025-10-15T17:45:17.615069] [INFO ] [MAIN ] BR: Full history saved. [2025-10-15T17:45:17.615162] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BR took 33.9s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-15T17:45:17.714132] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-15T17:45:17.783506] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:17.783709] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-15T17:45:17.783759] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-15T17:45:17.783865] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-15T17:45:17.783907] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-15T17:45:17.783947] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-15T17:45:17.783978] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-15T17:45:18.127071] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:18.441854] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:45:18.513969] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-15T17:45:19.314071] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-15T17:45:19.956573] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-15T17:45:19.962874] [INFO ] [REMOTE ] BP: Full fetch complete (77492 records). [2025-10-15T17:45:19.963068] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-15T17:45:19.963919] [FATAL] [VALIDATOR ] BP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:45:19.964028] [FATAL] [MAIN ] BP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:45:19.964108] [WARN ] [MAIN ] BP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:45:19.964190] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-15T17:45:19.964264] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-15T17:45:19.964301] [INFO ] [LOCAL ] BP: Starting deletion of derivative data. [2025-10-15T17:45:19.964468] [DEBUG] [LOCAL ] BP: Deleted derivative data file. [2025-10-15T17:45:19.964559] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BP took 37.3s. Estimated remaining: 4h 40m 37s. Rate: 7.3 symbols/min [2025-10-15T17:45:20.114577] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-15T17:45:20.149970] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:20.150279] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-15T17:45:20.150438] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-15T17:45:20.150774] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-15T17:45:20.150894] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-15T17:45:20.150951] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-15T17:45:20.150985] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-15T17:45:20.479422] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T17:45:20.577678] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:45:20.581968] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:20.914002] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-15T17:45:21.560327] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:45:21.584475] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T17:45:21.713965] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-15T17:45:22.513993] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-15T17:45:22.869619] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T17:45:23.314056] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-15T17:45:24.114007] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-15T17:45:24.158366] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:45:24.165304] [INFO ] [REMOTE ] BRBR: Full fetch complete (72810 records). [2025-10-15T17:45:24.165488] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-15T17:45:24.585394] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T17:45:24.585738] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-15T17:45:24.591177] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-15T17:45:24.592618] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-15T17:45:24.592894] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-15T17:45:24.594738] [DEBUG] [LOCAL ] BRBR: Trimmed 72810 records to 51693 (keeping 200 days of data) [2025-10-15T17:45:24.888106] [DEBUG] [LOCAL ] BRBR: Primary data saved (51693 records). [2025-10-15T17:45:24.888253] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-15T17:45:24.888324] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BRBR took 34.8s. Estimated remaining: 4h 40m 9s. Rate: 7.3 symbols/min [2025-10-15T17:45:24.920845] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-15T17:45:25.064699] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:25.121621] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-15T17:45:25.122020] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-15T17:45:25.317746] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:45:25.317994] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-15T17:45:25.318043] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-15T17:45:25.318552] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-15T17:45:25.318608] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-15T17:45:25.693820] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:25.719191] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-15T17:45:25.733693] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:45:26.140194] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:45:26.410112] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T17:45:26.513977] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-15T17:45:27.314031] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-15T17:45:27.623235] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T17:45:28.114011] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-15T17:45:28.913986] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-15T17:45:29.003926] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:45:29.111449] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:45:29.714023] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-15T17:45:29.994218] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T17:45:30.376029] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T17:45:30.514015] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-15T17:45:31.313984] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-15T17:45:31.423804] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T17:45:32.114047] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-15T17:45:32.899379] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:45:32.913962] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-15T17:45:33.714051] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-15T17:45:33.770242] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T17:45:34.066430] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T17:45:34.487979] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:45:34.490845] [INFO ] [REMOTE ] BRC: Full fetch complete (28430 records). [2025-10-15T17:45:34.491023] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-15T17:45:34.519155] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-15T17:45:34.875658] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-15T17:45:34.875757] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-15T17:45:34.876261] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-15T17:45:34.876301] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-15T17:45:34.877128] [DEBUG] [LOCAL ] BRC: Trimmed 28430 records to 18601 (keeping 200 days of data) [2025-10-15T17:45:34.996737] [DEBUG] [LOCAL ] BRC: Primary data saved (18601 records). [2025-10-15T17:45:34.996944] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-15T17:45:34.997075] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 24.4s. Estimated remaining: 4h 40m 12s. Rate: 7.3 symbols/min [2025-10-15T17:45:35.163695] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:35.163925] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-15T17:45:35.163982] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-15T17:45:35.164099] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-15T17:45:35.164153] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-15T17:45:35.164220] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-15T17:45:35.164254] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-15T17:45:35.334597] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-15T17:45:35.565687] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:36.099922] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:45:36.113941] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-15T17:45:36.913974] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-15T17:45:37.145859] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:45:37.579786] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:45:37.714034] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-15T17:45:38.485676] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:45:38.514033] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-15T17:45:39.324161] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-15T17:45:39.329350] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:45:39.580484] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:45:39.580897] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-15T17:45:39.580989] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:45:39.581035] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-15T17:45:39.581092] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:45:39.581181] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-15T17:45:39.581260] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-15T17:45:39.581296] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-15T17:45:39.581336] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-15T17:45:39.581380] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRSL took 4.6s. Estimated remaining: 4h 39m 41s. Rate: 7.3 symbols/min [2025-10-15T17:45:39.757115] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:39.789966] [DEBUG] [LOCAL ] BRSP: Loaded 36881 existing records from primary storage. [2025-10-15T17:45:39.790253] [INFO ] [MAIN ] BRSP: Loaded 36881 existing records. [2025-10-15T17:45:39.967712] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:45:39.967981] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-15T17:45:39.968119] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-15T17:45:39.968940] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-15T17:45:39.968999] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-15T17:45:40.115294] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-15T17:45:40.350360] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:45:40.354769] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:40.913998] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-15T17:45:41.714078] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-15T17:45:42.225806] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-15T17:45:42.291977] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:45:42.514090] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-15T17:45:43.255245] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:45:43.314068] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-15T17:45:44.115201] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-15T17:45:44.115095] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:45:44.913975] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-15T17:45:45.080371] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:45:45.714076] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-15T17:45:45.805353] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:45:46.376284] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:45:46.381425] [INFO ] [REMOTE ] BRCC: Full fetch complete (57499 records). [2025-10-15T17:45:46.381561] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-15T17:45:46.519204] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-15T17:45:46.793320] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-15T17:45:46.793433] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-15T17:45:46.794772] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-15T17:45:46.794841] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-15T17:45:46.796615] [DEBUG] [LOCAL ] BRCC: Trimmed 57499 records to 40208 (keeping 200 days of data) [2025-10-15T17:45:47.052789] [DEBUG] [LOCAL ] BRCC: Primary data saved (40208 records). [2025-10-15T17:45:47.052954] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-15T17:45:47.053043] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRCC took 29.4s. Estimated remaining: 4h 39m 28s. Rate: 7.3 symbols/min [2025-10-15T17:45:47.244727] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:47.253790] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-15T17:45:47.259114] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-15T17:45:47.270350] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:45:47.268750] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-15T17:45:47.278806] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-15T17:45:47.278927] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-15T17:45:47.278978] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-15T17:45:47.319192] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-15T17:45:47.676718] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:48.114058] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-15T17:45:48.395140] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T17:45:48.914007] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-15T17:45:49.124403] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:45:49.455242] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T17:45:49.715753] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-15T17:45:49.716710] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:45:50.514019] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-15T17:45:51.123070] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T17:45:51.314021] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-15T17:45:51.393446] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T17:45:52.114049] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-15T17:45:52.530001] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T17:45:52.532983] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:45:52.914012] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-15T17:45:53.447283] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T17:45:53.714018] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-15T17:45:54.514044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-15T17:45:55.148041] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T17:45:55.313969] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-15T17:45:55.510378] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:45:56.114007] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-15T17:45:56.919154] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-15T17:45:56.941161] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:45:57.415075] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T17:45:57.714013] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-15T17:45:58.161740] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:45:58.514018] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-15T17:45:59.314047] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-15T17:45:59.511859] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T17:45:59.518720] [INFO ] [REMOTE ] BRO: Full fetch complete (74788 records). [2025-10-15T17:45:59.518855] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-15T17:45:59.906424] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-15T17:45:59.906530] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-15T17:45:59.907464] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-15T17:45:59.907543] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-15T17:45:59.909230] [DEBUG] [LOCAL ] BRO: Trimmed 74788 records to 52061 (keeping 200 days of data) [2025-10-15T17:46:00.132321] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-15T17:46:00.241622] [DEBUG] [LOCAL ] BRO: Primary data saved (52061 records). [2025-10-15T17:46:00.241809] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-15T17:46:00.241886] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRO took 40.3s. Estimated remaining: 4h 39m 50s. Rate: 7.3 symbols/min [2025-10-15T17:46:00.409095] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:00.428207] [DEBUG] [LOCAL ] BRW: Loaded 21043 existing records from primary storage. [2025-10-15T17:46:00.428500] [INFO ] [MAIN ] BRW: Loaded 21043 existing records. [2025-10-15T17:46:00.606316] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:00.606701] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-15T17:46:00.606761] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-15T17:46:00.607319] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-15T17:46:00.607385] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-15T17:46:00.765787] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-15T17:46:00.918766] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-15T17:46:00.975490] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T17:46:01.038300] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:46:01.112720] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:01.714027] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-15T17:46:02.349386] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T17:46:02.514021] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-15T17:46:02.862888] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:46:03.313988] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-15T17:46:03.977549] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T17:46:04.113989] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-15T17:46:04.164427] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:46:04.914036] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-15T17:46:05.261629] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:46:05.713998] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-15T17:46:06.055673] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:46:06.301733] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T17:46:06.513997] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-15T17:46:06.997336] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T17:46:07.314001] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-15T17:46:08.113994] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-15T17:46:08.654398] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:46:08.654572] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:46:08.663616] [INFO ] [REMOTE ] BRT: Full fetch complete (7032 records). [2025-10-15T17:46:08.664034] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-15T17:46:08.919112] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-15T17:46:09.029831] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-15T17:46:09.029994] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-15T17:46:09.030212] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-15T17:46:09.030255] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-15T17:46:09.030737] [DEBUG] [LOCAL ] BRT: Trimmed 7032 records to 5222 (keeping 200 days of data) [2025-10-15T17:46:09.062200] [DEBUG] [LOCAL ] BRT: Primary data saved (5222 records). [2025-10-15T17:46:09.062299] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-15T17:46:09.062369] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BRT took 22.0s. Estimated remaining: 4h 39m 45s. Rate: 7.3 symbols/min [2025-10-15T17:46:09.233515] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:09.279846] [DEBUG] [LOCAL ] BRX: Loaded 51776 existing records from primary storage. [2025-10-15T17:46:09.280225] [INFO ] [MAIN ] BRX: Loaded 51776 existing records. [2025-10-15T17:46:09.459844] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:09.460130] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-15T17:46:09.460188] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-15T17:46:09.461167] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-15T17:46:09.461227] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-15T17:46:09.719172] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-15T17:46:09.819163] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:10.514019] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-15T17:46:10.948554] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T17:46:11.313988] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-15T17:46:11.398023] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T17:46:12.113964] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-15T17:46:12.194675] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T17:46:12.247352] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:46:12.914015] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-15T17:46:13.713976] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-15T17:46:13.875571] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T17:46:14.019212] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T17:46:14.514047] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-15T17:46:15.039592] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:46:15.314027] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-15T17:46:15.750737] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:46:16.114076] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-15T17:46:16.919220] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-15T17:46:16.932811] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T17:46:17.471117] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T17:46:17.560277] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T17:46:17.714015] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-15T17:46:18.496400] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:46:18.513987] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-15T17:46:19.314044] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-15T17:46:19.647078] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:46:20.114061] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-15T17:46:20.746608] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T17:46:20.752337] [INFO ] [REMOTE ] BRSP: Full fetch complete (54378 records). [2025-10-15T17:46:20.752457] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-15T17:46:20.919009] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-15T17:46:20.988318] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T17:46:21.225320] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-15T17:46:21.225422] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-15T17:46:21.226310] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-15T17:46:21.226378] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-15T17:46:21.227748] [DEBUG] [LOCAL ] BRSP: Trimmed 54378 records to 36808 (keeping 200 days of data) [2025-10-15T17:46:21.469024] [DEBUG] [LOCAL ] BRSP: Primary data saved (36808 records). [2025-10-15T17:46:21.469183] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-15T17:46:21.469475] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRSP took 41.9s. Estimated remaining: 4h 40m 2s. Rate: 7.3 symbols/min [2025-10-15T17:46:21.635277] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:21.666497] [DEBUG] [LOCAL ] BSAC: Loaded 32899 existing records from primary storage. [2025-10-15T17:46:21.666831] [INFO ] [MAIN ] BSAC: Loaded 32899 existing records. [2025-10-15T17:46:21.719898] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-15T17:46:21.846707] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:21.846978] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-15T17:46:21.847026] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-15T17:46:21.847726] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-15T17:46:21.847783] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-15T17:46:22.195173] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:22.513989] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-15T17:46:22.826107] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T17:46:22.972219] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T17:46:22.978694] [INFO ] [REMOTE ] BROS: Full fetch complete (77234 records). [2025-10-15T17:46:22.978833] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-15T17:46:23.319109] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-15T17:46:23.390377] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-15T17:46:23.390526] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-15T17:46:23.391483] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-15T17:46:23.391546] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-15T17:46:23.393127] [DEBUG] [LOCAL ] BROS: Trimmed 77234 records to 53300 (keeping 200 days of data) [2025-10-15T17:46:23.712224] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T17:46:23.723209] [DEBUG] [LOCAL ] BROS: Primary data saved (53300 records). [2025-10-15T17:46:23.723350] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-15T17:46:23.724353] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BROS took 58.8s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-15T17:46:23.890145] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:23.926811] [DEBUG] [LOCAL ] BSBR: Loaded 35663 existing records from primary storage. [2025-10-15T17:46:23.927145] [INFO ] [MAIN ] BSBR: Loaded 35663 existing records. [2025-10-15T17:46:24.103881] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:24.104115] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-15T17:46:24.104164] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-15T17:46:24.104794] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-15T17:46:24.104854] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-15T17:46:24.119169] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-15T17:46:24.470461] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:24.801381] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:46:24.823817] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T17:46:24.913998] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-15T17:46:25.714003] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-15T17:46:26.097881] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:46:26.514042] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-15T17:46:27.192218] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T17:46:27.314009] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-15T17:46:27.959759] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:46:28.113973] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-15T17:46:28.331287] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T17:46:28.334872] [INFO ] [REMOTE ] BRW: Full fetch complete (30445 records). [2025-10-15T17:46:28.334982] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-15T17:46:28.697233] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-15T17:46:28.697315] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-15T17:46:28.697844] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-15T17:46:28.697904] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-15T17:46:28.698689] [DEBUG] [LOCAL ] BRW: Trimmed 30445 records to 20981 (keeping 200 days of data) [2025-10-15T17:46:28.820508] [DEBUG] [LOCAL ] BRW: Primary data saved (20981 records). [2025-10-15T17:46:28.820667] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-15T17:46:28.820763] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRW took 28.6s. Estimated remaining: 4h 38m 50s. Rate: 7.3 symbols/min [2025-10-15T17:46:28.918774] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-15T17:46:28.989459] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:28.998370] [DEBUG] [LOCAL ] BSL: Loaded 8184 existing records from primary storage. [2025-10-15T17:46:28.998556] [INFO ] [MAIN ] BSL: Loaded 8184 existing records. [2025-10-15T17:46:29.177117] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:29.177527] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-15T17:46:29.177714] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-15T17:46:29.184927] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-15T17:46:29.196818] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-15T17:46:29.230829] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T17:46:29.557621] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:29.714040] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-15T17:46:30.266525] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T17:46:30.514068] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-15T17:46:30.757601] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:46:31.314052] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-15T17:46:31.925607] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T17:46:32.042486] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:46:32.113962] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-15T17:46:32.914038] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-15T17:46:33.295197] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:46:33.678119] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T17:46:33.713953] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-15T17:46:34.497434] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T17:46:34.513945] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-15T17:46:35.314062] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-15T17:46:35.622490] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T17:46:36.114096] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-15T17:46:36.570557] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:46:36.914003] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-15T17:46:37.714058] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-15T17:46:37.958706] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:46:38.292902] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T17:46:38.343365] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T17:46:38.514051] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-15T17:46:39.025561] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T17:46:39.313977] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-15T17:46:39.815998] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T17:46:40.114039] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-15T17:46:40.914036] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-15T17:46:41.713978] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-15T17:46:41.804489] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:46:41.985868] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T17:46:42.514045] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-15T17:46:43.083331] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:46:43.261541] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T17:46:43.313989] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-15T17:46:43.949772] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:46:44.114015] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-15T17:46:44.914069] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-15T17:46:45.503613] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T17:46:45.714002] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-15T17:46:46.380339] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:46:46.519148] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-15T17:46:46.535836] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T17:46:47.314060] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-15T17:46:48.036933] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T17:46:48.040962] [INFO ] [REMOTE ] BSAC: Full fetch complete (44541 records). [2025-10-15T17:46:48.041070] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-15T17:46:48.041701] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:46:48.041790] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:46:48.041833] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:46:48.041872] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-15T17:46:48.041928] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-15T17:46:48.041966] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-15T17:46:48.042168] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-15T17:46:48.042456] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BSAC took 26.6s. Estimated remaining: 4h 39m 48s. Rate: 7.3 symbols/min [2025-10-15T17:46:48.119121] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-15T17:46:48.221227] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:48.255422] [DEBUG] [LOCAL ] BSM: Loaded 32337 existing records from primary storage. [2025-10-15T17:46:48.255728] [INFO ] [MAIN ] BSM: Loaded 32337 existing records. [2025-10-15T17:46:48.450903] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:48.451189] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-15T17:46:48.451242] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-15T17:46:48.451942] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-15T17:46:48.452003] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-15T17:46:48.839911] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:46:48.882771] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:48.883954] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T17:46:48.885977] [INFO ] [REMOTE ] BSL: Full fetch complete (12856 records). [2025-10-15T17:46:48.886045] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-15T17:46:48.919075] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-15T17:46:49.259391] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-15T17:46:49.259474] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-15T17:46:49.259780] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-15T17:46:49.259843] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-15T17:46:49.260379] [DEBUG] [LOCAL ] BSL: Trimmed 12856 records to 8231 (keeping 200 days of data) [2025-10-15T17:46:49.310093] [DEBUG] [LOCAL ] BSL: Primary data saved (8231 records). [2025-10-15T17:46:49.310223] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-15T17:46:49.310305] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BSL took 20.5s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-15T17:46:49.482276] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:49.500518] [DEBUG] [LOCAL ] BST: Loaded 18922 existing records from primary storage. [2025-10-15T17:46:49.500774] [INFO ] [MAIN ] BST: Loaded 18922 existing records. [2025-10-15T17:46:49.684039] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:49.684290] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-15T17:46:49.684341] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-15T17:46:49.684691] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-15T17:46:49.684751] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-15T17:46:49.719232] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-15T17:46:50.055212] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:50.164824] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T17:46:50.514026] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-15T17:46:51.214811] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:46:51.314072] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-15T17:46:51.890556] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:46:52.114038] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-15T17:46:52.918010] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-15T17:46:52.921388] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T17:46:53.146950] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T17:46:53.713983] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-15T17:46:53.767056] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T17:46:54.513990] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-15T17:46:55.313991] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-15T17:46:55.385960] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T17:46:55.576450] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:46:56.113996] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-15T17:46:56.693110] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T17:46:56.913999] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-15T17:46:57.713997] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-15T17:46:57.780553] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T17:46:58.362297] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:46:58.514001] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-15T17:46:59.229801] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:46:59.313966] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-15T17:47:00.024469] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T17:47:00.031079] [INFO ] [REMOTE ] BRX: Full fetch complete (75124 records). [2025-10-15T17:47:00.031235] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-15T17:47:00.122228] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-15T17:47:00.432358] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-15T17:47:00.432510] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-15T17:47:00.433481] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-15T17:47:00.433558] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-15T17:47:00.460512] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T17:47:00.470816] [DEBUG] [LOCAL ] BRX: Trimmed 75124 records to 51797 (keeping 200 days of data) [2025-10-15T17:47:00.782755] [DEBUG] [LOCAL ] BRX: Primary data saved (51797 records). [2025-10-15T17:47:00.782894] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-15T17:47:00.782971] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BRX took 51.7s. Estimated remaining: 4h 39m 9s. Rate: 7.3 symbols/min [2025-10-15T17:47:00.920436] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-15T17:47:00.952322] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:00.976631] [DEBUG] [LOCAL ] BSTZ: Loaded 25010 existing records from primary storage. [2025-10-15T17:47:00.976927] [INFO ] [MAIN ] BSTZ: Loaded 25010 existing records. [2025-10-15T17:47:01.151403] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:01.151638] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-15T17:47:01.151719] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-15T17:47:01.152314] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-15T17:47:01.152371] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-15T17:47:01.510311] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:01.536540] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T17:47:01.713970] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-15T17:47:01.926740] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:47:02.514011] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-15T17:47:03.127813] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:47:03.132324] [INFO ] [REMOTE ] BSBR: Full fetch complete (50903 records). [2025-10-15T17:47:03.132423] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-15T17:47:03.319898] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-15T17:47:03.514024] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-15T17:47:03.514123] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-15T17:47:03.514831] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-15T17:47:03.514893] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-15T17:47:03.515954] [DEBUG] [LOCAL ] BSBR: Trimmed 50903 records to 35665 (keeping 200 days of data) [2025-10-15T17:47:03.738987] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T17:47:03.742033] [DEBUG] [LOCAL ] BSBR: Primary data saved (35665 records). [2025-10-15T17:47:03.748314] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-15T17:47:03.749279] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSBR took 40.0s. Estimated remaining: 4h 38m 29s. Rate: 7.3 symbols/min [2025-10-15T17:47:03.923905] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:03.924080] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-15T17:47:03.924117] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-15T17:47:03.924227] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-15T17:47:03.924309] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-15T17:47:03.924361] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-15T17:47:03.924396] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-15T17:47:04.118587] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-15T17:47:04.306622] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:04.606373] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:47:04.913988] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-15T17:47:05.610736] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T17:47:05.714003] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-15T17:47:06.513964] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-15T17:47:06.715842] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T17:47:06.927548] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T17:47:07.313973] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-15T17:47:07.459149] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T17:47:08.114035] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-15T17:47:08.565065] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:47:08.914026] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-15T17:47:08.934875] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T17:47:09.714067] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-15T17:47:10.513973] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-15T17:47:10.784711] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T17:47:10.938033] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:47:11.146455] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T17:47:11.314034] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-15T17:47:12.113993] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-15T17:47:12.148829] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T17:47:12.914023] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-15T17:47:13.168708] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:47:13.714041] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-15T17:47:14.475543] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:47:14.514047] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-15T17:47:15.313998] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-15T17:47:15.536782] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T17:47:15.636466] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:47:16.114056] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-15T17:47:16.821253] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:47:16.913980] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-15T17:47:17.714050] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-15T17:47:18.047935] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T17:47:18.268796] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T17:47:18.513990] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-15T17:47:19.049468] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:47:19.053274] [INFO ] [REMOTE ] BSM: Full fetch complete (46808 records). [2025-10-15T17:47:19.053462] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-15T17:47:19.054224] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:47:19.054313] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:47:19.054358] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:47:19.054429] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-15T17:47:19.054510] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-15T17:47:19.054556] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-15T17:47:19.054897] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-15T17:47:19.054998] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSM took 31.0s. Estimated remaining: 4h 39m 3s. Rate: 7.3 symbols/min [2025-10-15T17:47:19.248533] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:19.256024] [DEBUG] [LOCAL ] BTA: Loaded 5627 existing records from primary storage. [2025-10-15T17:47:19.256253] [INFO ] [MAIN ] BTA: Loaded 5627 existing records. [2025-10-15T17:47:19.323079] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-15T17:47:19.454607] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:19.454982] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-15T17:47:19.455040] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-15T17:47:19.455285] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-15T17:47:19.455337] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-15T17:47:19.854707] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:47:19.875890] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:20.114019] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-15T17:47:20.913996] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-15T17:47:21.200864] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:47:21.330547] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T17:47:21.713968] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-15T17:47:22.079304] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T17:47:22.514005] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-15T17:47:23.313977] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-15T17:47:23.532757] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T17:47:23.642718] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T17:47:24.010017] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T17:47:24.114003] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-15T17:47:24.913970] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-15T17:47:24.964978] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:47:25.714026] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-15T17:47:25.771955] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T17:47:26.514051] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-15T17:47:26.730931] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:47:27.314031] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-15T17:47:28.114004] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-15T17:47:28.258875] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T17:47:28.366896] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T17:47:28.370072] [INFO ] [REMOTE ] BST: Full fetch complete (28524 records). [2025-10-15T17:47:28.370275] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-15T17:47:28.920557] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-15T17:47:28.952187] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:47:28.954472] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-15T17:47:28.954561] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-15T17:47:28.955370] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-15T17:47:28.955459] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-15T17:47:28.962750] [DEBUG] [LOCAL ] BST: Trimmed 28524 records to 18867 (keeping 200 days of data) [2025-10-15T17:47:29.089929] [DEBUG] [LOCAL ] BST: Primary data saved (18867 records). [2025-10-15T17:47:29.090125] [INFO ] [MAIN ] BST: Full history saved. [2025-10-15T17:47:29.090343] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BST took 39.8s. Estimated remaining: 4h 39m 5s. Rate: 7.3 symbols/min [2025-10-15T17:47:29.280179] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:29.298631] [DEBUG] [LOCAL ] BTCM: Loaded 16664 existing records from primary storage. [2025-10-15T17:47:29.298938] [INFO ] [MAIN ] BTCM: Loaded 16664 existing records. [2025-10-15T17:47:29.504890] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:29.505147] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-15T17:47:29.505218] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-15T17:47:29.505480] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-15T17:47:29.505541] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-15T17:47:29.721679] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-15T17:47:29.934920] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:30.081598] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T17:47:30.233755] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T17:47:30.514034] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-15T17:47:31.314019] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-15T17:47:31.775963] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:47:32.114038] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-15T17:47:32.601108] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-15T17:47:32.914069] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-15T17:47:33.295148] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T17:47:33.295510] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-15T17:47:33.713982] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-15T17:47:34.514055] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-15T17:47:35.313984] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-15T17:47:35.348433] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T17:47:35.394622] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T17:47:36.114014] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-15T17:47:36.317221] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:47:36.321146] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36717 records). [2025-10-15T17:47:36.321285] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-15T17:47:36.687141] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-15T17:47:36.687231] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-15T17:47:36.687948] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-15T17:47:36.688030] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-15T17:47:36.688954] [DEBUG] [LOCAL ] BSTZ: Trimmed 36717 records to 24906 (keeping 200 days of data) [2025-10-15T17:47:36.843093] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24906 records). [2025-10-15T17:47:36.843280] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-15T17:47:36.843386] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BSTZ took 36.1s. Estimated remaining: 4h 38m 54s. Rate: 7.3 symbols/min [2025-10-15T17:47:36.920006] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-15T17:47:37.022316] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:37.022510] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-15T17:47:37.022549] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-15T17:47:37.022697] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-15T17:47:37.022752] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-15T17:47:37.022795] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-15T17:47:37.022827] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-15T17:47:37.375156] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:37.714067] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-15T17:47:37.743672] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T17:47:38.160688] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:47:38.421666] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T17:47:38.513997] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-15T17:47:39.157514] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T17:47:39.314050] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-15T17:47:39.787314] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T17:47:40.114014] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-15T17:47:40.688626] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T17:47:40.914007] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-15T17:47:41.553826] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:47:41.714025] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-15T17:47:42.200360] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T17:47:42.514045] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-15T17:47:43.220725] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T17:47:43.222134] [INFO ] [REMOTE ] BTA: Full fetch complete (9568 records). [2025-10-15T17:47:43.222204] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-15T17:47:43.319072] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-15T17:47:43.573858] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-15T17:47:43.573945] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-15T17:47:43.574171] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-15T17:47:43.574210] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-15T17:47:43.574607] [DEBUG] [LOCAL ] BTA: Trimmed 9568 records to 5669 (keeping 200 days of data) [2025-10-15T17:47:43.607210] [DEBUG] [LOCAL ] BTA: Primary data saved (5669 records). [2025-10-15T17:47:43.607332] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-15T17:47:43.607411] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BTA took 24.6s. Estimated remaining: 4h 38m 37s. Rate: 7.3 symbols/min [2025-10-15T17:47:43.778486] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:43.826945] [DEBUG] [LOCAL ] BTI: Loaded 53590 existing records from primary storage. [2025-10-15T17:47:43.827287] [INFO ] [MAIN ] BTI: Loaded 53590 existing records. [2025-10-15T17:47:44.004882] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:44.005229] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-15T17:47:44.005382] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-15T17:47:44.006516] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-15T17:47:44.006573] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-15T17:47:44.117021] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-15T17:47:44.319539] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:47:44.355121] [INFO ] [REMOTE ] BSX: Full fetch complete (77856 records). [2025-10-15T17:47:44.365697] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-15T17:47:44.526712] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:44.818671] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-15T17:47:44.818790] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-15T17:47:44.819803] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-15T17:47:44.819869] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-15T17:47:44.821590] [DEBUG] [LOCAL ] BSX: Trimmed 77856 records to 53688 (keeping 200 days of data) [2025-10-15T17:47:44.936893] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-15T17:47:45.020265] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:47:45.178694] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-15T17:47:45.178856] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-15T17:47:45.178929] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSX took 41.4s. Estimated remaining: 4h 37m 49s. Rate: 7.3 symbols/min [2025-10-15T17:47:45.350018] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:45.359873] [DEBUG] [LOCAL ] BTO: Loaded 8779 existing records from primary storage. [2025-10-15T17:47:45.360103] [INFO ] [MAIN ] BTO: Loaded 8779 existing records. [2025-10-15T17:47:45.537122] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:45.537351] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-15T17:47:45.537400] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-15T17:47:45.537757] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-15T17:47:45.537816] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-15T17:47:45.719952] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-15T17:47:45.903285] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:46.489813] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T17:47:46.513977] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-15T17:47:47.314087] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-15T17:47:47.570196] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:47:47.766382] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T17:47:47.986619] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T17:47:48.114075] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-15T17:47:48.914072] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-15T17:47:48.960116] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:47:49.714059] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-15T17:47:50.417273] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:47:50.514032] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-15T17:47:50.524619] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T17:47:51.314045] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-15T17:47:51.967253] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:47:52.113994] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-15T17:47:52.615078] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:47:52.913989] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-15T17:47:53.281513] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T17:47:53.714007] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-15T17:47:54.455150] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T17:47:54.472170] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:47:54.514003] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-15T17:47:55.314045] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-15T17:47:55.940720] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T17:47:55.962837] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T17:47:56.113989] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-15T17:47:56.914021] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-15T17:47:57.714011] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-15T17:47:57.739255] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T17:47:57.834185] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T17:47:58.514014] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-15T17:47:59.307940] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T17:47:59.313956] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-15T17:47:59.373855] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:48:00.054100] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:48:00.114013] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-15T17:48:00.725329] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T17:48:00.913981] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-15T17:48:01.714018] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-15T17:48:02.498571] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:48:02.513969] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-15T17:48:03.065931] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T17:48:03.314008] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-15T17:48:04.114017] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-15T17:48:04.139097] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:48:04.322587] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:48:04.914061] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-15T17:48:05.714025] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-15T17:48:05.826403] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:48:06.386171] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T17:48:06.514035] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-15T17:48:07.038063] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:48:07.280154] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:48:07.281977] [INFO ] [REMOTE ] BTO: Full fetch complete (13246 records). [2025-10-15T17:48:07.282056] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-15T17:48:07.319171] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-15T17:48:07.696187] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-15T17:48:07.696310] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-15T17:48:07.696912] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-15T17:48:07.696978] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-15T17:48:07.697612] [DEBUG] [LOCAL ] BTO: Trimmed 13246 records to 8850 (keeping 200 days of data) [2025-10-15T17:48:07.758416] [DEBUG] [LOCAL ] BTO: Primary data saved (8850 records). [2025-10-15T17:48:07.758611] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-15T17:48:07.758755] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTO took 22.6s. Estimated remaining: 4h 39m 4s. Rate: 7.2 symbols/min [2025-10-15T17:48:07.930882] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:07.950533] [DEBUG] [LOCAL ] BTT: Loaded 15724 existing records from primary storage. [2025-10-15T17:48:07.950856] [INFO ] [MAIN ] BTT: Loaded 15724 existing records. [2025-10-15T17:48:08.117532] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-15T17:48:08.140430] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:08.140751] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-15T17:48:08.140821] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-15T17:48:08.141258] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-15T17:48:08.141316] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-15T17:48:08.540064] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:08.914071] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-15T17:48:09.538973] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:48:09.713997] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-15T17:48:09.839872] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T17:48:09.866399] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T17:48:10.513987] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-15T17:48:10.717367] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:48:10.720696] [INFO ] [REMOTE ] BTCM: Full fetch complete (20126 records). [2025-10-15T17:48:10.720787] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-15T17:48:11.097350] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-15T17:48:11.097428] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-15T17:48:11.097929] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-15T17:48:11.097990] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-15T17:48:11.098622] [DEBUG] [LOCAL ] BTCM: Trimmed 20126 records to 16911 (keeping 200 days of data) [2025-10-15T17:48:11.201328] [DEBUG] [LOCAL ] BTCM: Primary data saved (16911 records). [2025-10-15T17:48:11.201830] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-15T17:48:11.202004] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTCM took 42.1s. Estimated remaining: 4h 38m 28s. Rate: 7.3 symbols/min [2025-10-15T17:48:11.319114] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-15T17:48:11.380620] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:11.395000] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:48:11.449470] [DEBUG] [LOCAL ] BTU: Loaded 53323 existing records from primary storage. [2025-10-15T17:48:11.449847] [INFO ] [MAIN ] BTU: Loaded 53323 existing records. [2025-10-15T17:48:11.649962] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:11.650241] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-15T17:48:11.650310] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-15T17:48:11.651246] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-15T17:48:11.651303] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-15T17:48:11.996862] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:12.114001] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-15T17:48:12.913987] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-15T17:48:13.240130] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T17:48:13.656057] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:48:13.719119] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-15T17:48:13.735572] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:48:14.514006] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-15T17:48:15.313972] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-15T17:48:15.437014] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T17:48:15.769526] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T17:48:16.114029] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-15T17:48:16.913985] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-15T17:48:17.231257] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T17:48:17.255511] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:48:17.714009] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-15T17:48:18.513972] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-15T17:48:18.649450] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T17:48:18.829603] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:48:19.314014] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-15T17:48:20.114061] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-15T17:48:20.780441] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-15T17:48:20.833764] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:48:20.914034] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-15T17:48:21.492775] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:48:21.714062] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-15T17:48:22.514021] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-15T17:48:22.837272] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T17:48:23.313977] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-15T17:48:23.392374] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:48:23.398779] [INFO ] [REMOTE ] BTE: Full fetch complete (76378 records). [2025-10-15T17:48:23.398952] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-15T17:48:23.514273] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:48:23.798227] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-15T17:48:23.798330] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-15T17:48:23.799213] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-15T17:48:23.799276] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-15T17:48:23.800791] [DEBUG] [LOCAL ] BTE: Trimmed 76378 records to 52736 (keeping 200 days of data) [2025-10-15T17:48:24.116275] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-15T17:48:24.137819] [DEBUG] [LOCAL ] BTE: Primary data saved (52736 records). [2025-10-15T17:48:24.138898] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-15T17:48:24.139009] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTE took 47.3s. Estimated remaining: 4h 38m 47s. Rate: 7.2 symbols/min [2025-10-15T17:48:24.332547] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:24.332805] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-15T17:48:24.332865] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-15T17:48:24.332979] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-15T17:48:24.333022] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-15T17:48:24.333063] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-15T17:48:24.333094] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-15T17:48:24.748089] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:24.914039] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-15T17:48:25.105257] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:48:25.105590] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-15T17:48:25.105719] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:48:25.105790] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-15T17:48:25.105860] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:48:25.105940] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-15T17:48:25.106006] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-15T17:48:25.106043] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-15T17:48:25.106083] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-15T17:48:25.106130] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTX took 1.0s. Estimated remaining: 4h 37m 56s. Rate: 7.3 symbols/min [2025-10-15T17:48:25.245105] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:48:25.314969] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:25.361248] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:48:25.391635] [DEBUG] [LOCAL ] BTZ: Loaded 22641 existing records from primary storage. [2025-10-15T17:48:25.391962] [INFO ] [MAIN ] BTZ: Loaded 22641 existing records. [2025-10-15T17:48:25.576187] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:25.576427] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-15T17:48:25.576501] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-15T17:48:25.576823] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-15T17:48:25.576881] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-15T17:48:25.719978] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-15T17:48:25.944296] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:26.513991] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-15T17:48:27.194946] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:48:27.314496] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-15T17:48:27.337310] [DEBUG] [REMOTE ] BTU: Error fetching primary data for 2025-04: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-15T17:48:27.337463] [WARN ] [REMOTE ] BTU: No data returned for month 2025-04 [2025-10-15T17:48:27.337534] [FATAL] [REMOTE ] BTU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:48:27.337603] [FATAL] [MAIN ] BTU: Failed to fetch primary data. [2025-10-15T17:48:27.337695] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:48:27.337769] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-15T17:48:27.337833] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-15T17:48:27.337869] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-15T17:48:27.339314] [DEBUG] [LOCAL ] BTU: Deleted derivative data file. [2025-10-15T17:48:27.339453] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTU took 16.1s. Estimated remaining: 4h 37m 13s. Rate: 7.3 symbols/min [2025-10-15T17:48:27.515414] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:27.563053] [DEBUG] [LOCAL ] BUD: Loaded 52625 existing records from primary storage. [2025-10-15T17:48:27.563427] [INFO ] [MAIN ] BUD: Loaded 52625 existing records. [2025-10-15T17:48:27.750595] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:27.750840] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-15T17:48:27.750886] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-15T17:48:27.751998] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-15T17:48:27.752057] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-15T17:48:28.119467] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-15T17:48:28.124953] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:28.397954] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T17:48:28.920557] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-15T17:48:28.922505] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T17:48:29.714068] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-15T17:48:29.846813] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T17:48:30.513998] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-15T17:48:30.612379] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:48:30.614334] [INFO ] [REMOTE ] BTT: Full fetch complete (22911 records). [2025-10-15T17:48:30.614407] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-15T17:48:30.991568] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-15T17:48:30.991707] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-15T17:48:30.992290] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-15T17:48:30.992333] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-15T17:48:30.992956] [DEBUG] [LOCAL ] BTT: Trimmed 22911 records to 15721 (keeping 200 days of data) [2025-10-15T17:48:31.086665] [DEBUG] [LOCAL ] BTT: Primary data saved (15721 records). [2025-10-15T17:48:31.086829] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-15T17:48:31.086911] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTT took 23.3s. Estimated remaining: 4h 36m 40s. Rate: 7.3 symbols/min [2025-10-15T17:48:31.265804] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:31.282430] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T17:48:31.298505] [DEBUG] [LOCAL ] BUI: Loaded 11942 existing records from primary storage. [2025-10-15T17:48:31.298814] [INFO ] [MAIN ] BUI: Loaded 11942 existing records. [2025-10-15T17:48:31.319184] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-15T17:48:31.474194] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:31.474430] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-15T17:48:31.474479] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-15T17:48:31.474821] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-15T17:48:31.474881] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-15T17:48:31.813824] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:32.114020] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-15T17:48:32.914067] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-15T17:48:33.401773] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-15T17:48:33.714040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-15T17:48:33.863182] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T17:48:34.061194] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T17:48:34.067620] [INFO ] [REMOTE ] BTI: Full fetch complete (77636 records). [2025-10-15T17:48:34.067782] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-15T17:48:34.480843] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-15T17:48:34.480955] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-15T17:48:34.482264] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-15T17:48:34.482345] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-15T17:48:34.484454] [DEBUG] [LOCAL ] BTI: Trimmed 77636 records to 53596 (keeping 200 days of data) [2025-10-15T17:48:34.541360] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-15T17:48:34.843608] [DEBUG] [LOCAL ] BTI: Primary data saved (53596 records). [2025-10-15T17:48:34.852283] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-15T17:48:34.858162] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTI took 51.3s. Estimated remaining: 4h 36m 6s. Rate: 7.3 symbols/min [2025-10-15T17:48:34.859610] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T17:48:35.053942] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:35.105177] [DEBUG] [LOCAL ] BUR: Loaded 45343 existing records from primary storage. [2025-10-15T17:48:35.105805] [INFO ] [MAIN ] BUR: Loaded 45343 existing records. [2025-10-15T17:48:35.295571] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:35.295922] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-15T17:48:35.295977] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-15T17:48:35.297130] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-15T17:48:35.297192] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-15T17:48:35.319301] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-15T17:48:35.672878] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:36.113973] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-15T17:48:36.199297] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:48:36.566215] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-15T17:48:36.914014] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-15T17:48:37.376461] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:48:37.714064] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-15T17:48:38.214247] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T17:48:38.514066] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-15T17:48:38.983739] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T17:48:39.115199] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T17:48:39.314038] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-15T17:48:40.114071] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-15T17:48:40.921207] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-15T17:48:40.926627] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:48:41.265999] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:48:41.714015] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-15T17:48:42.141181] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:48:42.472003] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T17:48:42.513965] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-15T17:48:43.313982] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-15T17:48:43.551517] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T17:48:44.033262] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T17:48:44.114023] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-15T17:48:44.913977] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-15T17:48:45.026795] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T17:48:45.714007] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-15T17:48:46.513977] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-15T17:48:46.544553] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T17:48:46.956087] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T17:48:47.319080] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-15T17:48:47.331087] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:48:48.114018] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-15T17:48:48.856431] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T17:48:48.879357] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T17:48:48.913960] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-15T17:48:49.713982] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-15T17:48:49.924366] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T17:48:50.513975] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-15T17:48:50.800853] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:48:51.314037] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-15T17:48:52.114029] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-15T17:48:52.142242] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T17:48:52.804959] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:48:52.808201] [INFO ] [REMOTE ] BTZ: Full fetch complete (33426 records). [2025-10-15T17:48:52.808276] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-15T17:48:52.919131] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-15T17:48:53.184057] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-15T17:48:53.184139] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-15T17:48:53.184762] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-15T17:48:53.184843] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-15T17:48:53.185670] [DEBUG] [LOCAL ] BTZ: Trimmed 33426 records to 22588 (keeping 200 days of data) [2025-10-15T17:48:53.318428] [DEBUG] [LOCAL ] BTZ: Primary data saved (22588 records). [2025-10-15T17:48:53.318576] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-15T17:48:53.318678] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTZ took 28.2s. Estimated remaining: 4h 36m 56s. Rate: 7.3 symbols/min [2025-10-15T17:48:53.485183] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:53.527009] [DEBUG] [LOCAL ] BURL: Loaded 45744 existing records from primary storage. [2025-10-15T17:48:53.527321] [INFO ] [MAIN ] BURL: Loaded 45744 existing records. [2025-10-15T17:48:53.710947] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:53.711233] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-15T17:48:53.711302] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-15T17:48:53.711684] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-15T17:48:53.711800] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-15T17:48:53.731726] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-15T17:48:54.016824] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:48:54.109238] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:54.253751] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T17:48:54.351332] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T17:48:54.514025] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-15T17:48:55.313984] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-15T17:48:56.114012] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-15T17:48:56.311116] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T17:48:56.779750] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:48:56.826044] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T17:48:56.913994] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-15T17:48:57.714006] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-15T17:48:58.513961] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-15T17:48:58.578774] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T17:48:58.632874] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T17:48:58.634865] [INFO ] [REMOTE ] BUI: Full fetch complete (16577 records). [2025-10-15T17:48:58.634935] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-15T17:48:59.018052] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-15T17:48:59.018134] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-15T17:48:59.018515] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-15T17:48:59.018575] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-15T17:48:59.019163] [DEBUG] [LOCAL ] BUI: Trimmed 16577 records to 11893 (keeping 200 days of data) [2025-10-15T17:48:59.090964] [DEBUG] [LOCAL ] BUI: Primary data saved (11893 records). [2025-10-15T17:48:59.091113] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-15T17:48:59.091196] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BUI took 28.0s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-15T17:48:59.278824] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:59.279226] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-15T17:48:59.279285] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-15T17:48:59.279412] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-15T17:48:59.279477] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-15T17:48:59.279520] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-15T17:48:59.279554] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-15T17:48:59.319205] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-15T17:48:59.670876] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:00.114026] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-15T17:49:00.311376] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T17:49:00.913962] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-15T17:49:00.923533] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T17:49:01.303925] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T17:49:01.714051] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-15T17:49:02.396688] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T17:49:02.514000] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-15T17:49:02.601476] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T17:49:03.314011] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-15T17:49:04.114076] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-15T17:49:04.202497] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:49:04.901827] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T17:49:04.904298] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T17:49:04.916543] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-15T17:49:05.714090] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-15T17:49:06.250550] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T17:49:06.417972] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T17:49:06.513972] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-15T17:49:07.314012] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-15T17:49:07.387979] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:49:08.114070] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-15T17:49:08.760204] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:49:08.766423] [INFO ] [REMOTE ] BUR: Full fetch complete (64108 records). [2025-10-15T17:49:08.766624] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-15T17:49:08.922125] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-15T17:49:09.141150] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T17:49:09.218015] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-15T17:49:09.218130] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-15T17:49:09.219371] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-15T17:49:09.219447] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-15T17:49:09.221405] [DEBUG] [LOCAL ] BUR: Trimmed 64108 records to 45344 (keeping 200 days of data) [2025-10-15T17:49:09.501114] [DEBUG] [LOCAL ] BUR: Primary data saved (45344 records). [2025-10-15T17:49:09.501292] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-15T17:49:09.501573] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUR took 34.6s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-15T17:49:09.714074] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-15T17:49:10.514128] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-15T17:49:11.043362] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-15T17:49:11.313978] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-15T17:49:11.354021] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:49:11.515581] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:49:12.114044] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-15T17:49:12.823799] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T17:49:12.913956] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-15T17:49:12.993902] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:49:13.714054] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-15T17:49:14.409790] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T17:49:14.492840] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:49:14.513970] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-15T17:49:15.314139] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-15T17:49:16.060036] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:49:16.113966] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-15T17:49:16.264752] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:49:16.271126] [INFO ] [REMOTE ] BUD: Full fetch complete (76496 records). [2025-10-15T17:49:16.271280] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-15T17:49:16.672854] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-15T17:49:16.672948] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-15T17:49:16.674266] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-15T17:49:16.674331] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-15T17:49:16.676010] [DEBUG] [LOCAL ] BUD: Trimmed 76496 records to 52596 (keeping 200 days of data) [2025-10-15T17:49:16.915100] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-15T17:49:16.988864] [DEBUG] [LOCAL ] BUD: Primary data saved (52596 records). [2025-10-15T17:49:16.988988] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-15T17:49:16.989065] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUD took 49.6s. Estimated remaining: 4h 36m 25s. Rate: 7.3 symbols/min [2025-10-15T17:49:17.014583] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:49:17.016547] [INFO ] [REMOTE ] BUXX: Full fetch complete (20454 records). [2025-10-15T17:49:17.016634] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-15T17:49:17.017090] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:49:17.017183] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:49:17.017227] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:49:17.017265] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-15T17:49:17.017321] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-15T17:49:17.017384] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-15T17:49:17.017459] [DEBUG] [LOCAL ] BUXX: No derivative data file found to delete. [2025-10-15T17:49:17.017611] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUXX took 17.9s. Estimated remaining: 4h 35m 31s. Rate: 7.3 symbols/min [2025-10-15T17:49:18.725085] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T17:49:18.735988] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-15T17:49:20.275281] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:49:20.286038] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-15T17:49:21.821602] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T17:49:21.831600] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-15T17:49:23.377601] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:49:23.387734] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-15T17:49:25.033459] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:49:25.043997] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-15T17:49:26.729112] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T17:49:26.739752] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-15T17:49:28.217061] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:49:28.222420] [INFO ] [REMOTE ] BURL: Full fetch complete (65853 records). [2025-10-15T17:49:28.222551] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-15T17:49:28.635461] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-15T17:49:28.635617] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-15T17:49:28.638096] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-15T17:49:28.638177] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-15T17:49:28.640268] [DEBUG] [LOCAL ] BURL: Trimmed 65853 records to 45707 (keeping 200 days of data) [2025-10-15T17:49:28.939579] [DEBUG] [LOCAL ] BURL: Primary data saved (45707 records). [2025-10-15T17:49:28.939784] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-15T17:49:28.939896] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BURL took 35.6s. Estimated remaining: 4h 35m 43s. Rate: 7.3 symbols/min [2025-10-15T17:49:29.537331] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.602812] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.689943] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.716967] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.787934] [DEBUG] [LOCAL ] BVN: Loaded 44242 existing records from primary storage. [2025-10-15T17:49:29.801020] [INFO ] [MAIN ] BVN: Loaded 44242 existing records. [2025-10-15T17:49:29.942681] [DEBUG] [LOCAL ] BW: Loaded 40458 existing records from primary storage. [2025-10-15T17:49:29.941805] [DEBUG] [LOCAL ] BWA: Loaded 52150 existing records from primary storage. [2025-10-15T17:49:29.964129] [INFO ] [MAIN ] BWA: Loaded 52150 existing records. [2025-10-15T17:49:29.958592] [INFO ] [MAIN ] BW: Loaded 40458 existing records. [2025-10-15T17:49:29.958329] [DEBUG] [LOCAL ] BV: Loaded 38559 existing records from primary storage. [2025-10-15T17:49:30.026927] [INFO ] [MAIN ] BV: Loaded 38559 existing records. [2025-10-15T17:49:30.273747] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:30.384806] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-15T17:49:30.433039] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-15T17:49:30.549708] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-15T17:49:30.583480] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-15T17:49:30.673170] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:30.679146] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-15T17:49:30.745606] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:30.691607] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-15T17:49:30.759032] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-15T17:49:30.815857] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-15T17:49:30.821583] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-15T17:49:30.833547] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-15T17:49:30.863584] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-15T17:49:30.902310] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-15T17:49:30.975461] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:31.091574] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-15T17:49:31.134052] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-15T17:49:31.220034] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-15T17:49:31.431469] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-15T17:49:32.132071] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.201230] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-15T17:49:32.382863] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.423817] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-15T17:49:32.524220] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.560616] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-15T17:49:32.675628] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.676027] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-15T17:49:33.743042] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:49:33.752951] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-15T17:49:34.054761] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T17:49:34.062966] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-15T17:49:34.148570] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T17:49:34.157787] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-15T17:49:34.366198] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T17:49:34.378193] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-15T17:49:34.892244] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T17:49:34.898894] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-15T17:49:34.956158] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:49:34.964291] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-15T17:49:35.329127] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:49:35.337859] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-15T17:49:36.102571] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:49:36.113571] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-15T17:49:36.160470] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T17:49:36.169297] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-15T17:49:36.244296] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:49:36.253752] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-15T17:49:36.312314] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T17:49:36.320637] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-15T17:49:37.354424] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:49:37.365809] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-15T17:49:37.456548] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T17:49:37.466163] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-15T17:49:37.541937] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T17:49:37.551758] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-15T17:49:37.905846] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:49:37.915793] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-15T17:49:38.626737] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T17:49:38.635492] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-15T17:49:38.735295] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:49:38.748163] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-15T17:49:39.121341] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:49:39.314043] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-15T17:49:39.539186] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T17:49:39.759999] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:49:40.114030] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-15T17:49:40.184242] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:49:40.431374] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:49:40.914048] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-15T17:49:41.218392] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T17:49:41.714030] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-15T17:49:42.516322] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-15T17:49:42.521795] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:49:43.014770] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T17:49:43.314056] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-15T17:49:43.674358] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T17:49:44.114003] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-15T17:49:44.914011] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-15T17:49:44.941295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:49:45.714021] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-15T17:49:45.844889] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:49:46.137516] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:49:46.514033] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-15T17:49:47.211707] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:49:47.313954] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-15T17:49:48.113966] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-15T17:49:48.371730] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T17:49:48.885574] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T17:49:48.913950] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-15T17:49:49.506843] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:49:49.713973] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-15T17:49:50.514031] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-15T17:49:50.627109] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T17:49:50.632931] [INFO ] [REMOTE ] BVN: Full fetch complete (63226 records). [2025-10-15T17:49:50.633039] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-15T17:49:51.017272] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-15T17:49:51.017528] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-15T17:49:51.018402] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-15T17:49:51.026100] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-15T17:49:51.041363] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:49:51.049686] [DEBUG] [LOCAL ] BVN: Trimmed 63226 records to 44301 (keeping 200 days of data) [2025-10-15T17:49:51.320226] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-15T17:49:51.334736] [DEBUG] [LOCAL ] BVN: Primary data saved (44301 records). [2025-10-15T17:49:51.334884] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-15T17:49:51.335000] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BVN took 22.4s. Estimated remaining: 4h 36m 54s. Rate: 7.3 symbols/min [2025-10-15T17:49:51.505440] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:51.517360] [DEBUG] [LOCAL ] BWG: Loaded 12616 existing records from primary storage. [2025-10-15T17:49:51.517551] [INFO ] [MAIN ] BWG: Loaded 12616 existing records. [2025-10-15T17:49:51.692807] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:51.693098] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-15T17:49:51.693156] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-15T17:49:51.693497] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-15T17:49:51.693554] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-15T17:49:51.953630] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:49:52.089451] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:52.114018] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-15T17:49:52.765757] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:49:52.785562] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T17:49:52.913998] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-15T17:49:53.714067] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-15T17:49:53.876228] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T17:49:54.513998] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-15T17:49:55.237169] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T17:49:55.313961] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-15T17:49:55.851752] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:49:56.113993] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-15T17:49:56.900783] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T17:49:56.913959] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-15T17:49:57.652727] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:49:57.661576] [INFO ] [REMOTE ] BWA: Full fetch complete (75899 records). [2025-10-15T17:49:57.661851] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-15T17:49:57.721538] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-15T17:49:58.097104] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-15T17:49:58.097235] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-15T17:49:58.098919] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-15T17:49:58.098994] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-15T17:49:58.101246] [DEBUG] [LOCAL ] BWA: Trimmed 75899 records to 52138 (keeping 200 days of data) [2025-10-15T17:49:58.455172] [DEBUG] [LOCAL ] BWA: Primary data saved (52138 records). [2025-10-15T17:49:58.455403] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-15T17:49:58.455524] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BWA took 29.5s. Estimated remaining: 4h 36m 39s. Rate: 7.3 symbols/min [2025-10-15T17:49:58.528283] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-15T17:49:58.640315] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:58.676254] [DEBUG] [LOCAL ] BWLP: Loaded 32295 existing records from primary storage. [2025-10-15T17:49:58.676621] [INFO ] [MAIN ] BWLP: Loaded 32295 existing records. [2025-10-15T17:49:58.877028] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:58.888176] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-15T17:49:58.889607] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T17:49:58.889776] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-15T17:49:58.896343] [INFO ] [REMOTE ] BW: Full fetch complete (59424 records). [2025-10-15T17:49:58.896627] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-15T17:49:58.896517] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-15T17:49:58.896854] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-15T17:49:59.252496] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T17:49:59.345017] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-15T17:49:59.407873] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T17:49:59.764735] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:59.784469] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-15T17:49:59.784561] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-15T17:49:59.785373] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-15T17:49:59.785435] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-15T17:49:59.786790] [DEBUG] [LOCAL ] BW: Trimmed 59424 records to 40513 (keeping 200 days of data) [2025-10-15T17:50:00.022443] [DEBUG] [LOCAL ] BW: Primary data saved (40513 records). [2025-10-15T17:50:00.022590] [INFO ] [MAIN ] BW: Full history saved. [2025-10-15T17:50:00.022695] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BW took 31.1s. Estimated remaining: 4h 35m 54s. Rate: 7.3 symbols/min [2025-10-15T17:50:00.119244] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-15T17:50:00.194233] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T17:50:00.221479] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:00.233551] [DEBUG] [LOCAL ] BWMX: Loaded 7777 existing records from primary storage. [2025-10-15T17:50:00.233854] [INFO ] [MAIN ] BWMX: Loaded 7777 existing records. [2025-10-15T17:50:00.430281] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:00.430533] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-15T17:50:00.430592] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-15T17:50:00.430892] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-15T17:50:00.430979] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-15T17:50:00.794880] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:00.914019] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-15T17:50:01.714070] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-15T17:50:01.968341] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:50:02.405120] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:50:02.410708] [INFO ] [REMOTE ] BV: Full fetch complete (54510 records). [2025-10-15T17:50:02.410908] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-15T17:50:02.411900] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:50:02.411993] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:50:02.412040] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:50:02.412109] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-15T17:50:02.412177] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-15T17:50:02.412216] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-15T17:50:02.412368] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-15T17:50:02.412459] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BV took 33.5s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-15T17:50:02.517070] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-15T17:50:02.624594] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T17:50:02.674676] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:02.685931] [DEBUG] [LOCAL ] BWNB: Loaded 4215 existing records from primary storage. [2025-10-15T17:50:02.686282] [INFO ] [MAIN ] BWNB: Loaded 4215 existing records. [2025-10-15T17:50:02.905103] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:02.905401] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-15T17:50:02.905469] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-15T17:50:02.905739] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-15T17:50:02.905802] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-15T17:50:03.298034] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:03.314125] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-15T17:50:03.877416] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T17:50:04.054164] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T17:50:04.114024] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-15T17:50:04.754102] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T17:50:04.914073] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-15T17:50:05.369949] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:50:05.714095] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-15T17:50:06.294840] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T17:50:06.514014] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-15T17:50:07.314001] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-15T17:50:07.508863] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T17:50:08.114024] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-15T17:50:08.660755] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T17:50:08.776388] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:50:08.914086] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-15T17:50:09.528540] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:50:09.714046] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-15T17:50:10.514021] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-15T17:50:10.889086] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T17:50:10.902492] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-15T17:50:11.314033] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-15T17:50:12.114044] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-15T17:50:12.815582] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:50:12.859371] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T17:50:12.914109] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-15T17:50:13.714062] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-15T17:50:14.066675] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:50:14.514097] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-15T17:50:14.611635] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T17:50:15.314517] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-15T17:50:15.940979] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:50:16.011332] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T17:50:16.114021] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-15T17:50:16.914025] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-15T17:50:17.291478] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:50:17.331585] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T17:50:17.714002] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-15T17:50:18.513969] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-15T17:50:18.632149] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T17:50:19.314049] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-15T17:50:19.852483] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:50:19.887287] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:50:20.113993] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-15T17:50:20.799205] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:50:20.914032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-15T17:50:21.411792] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T17:50:21.713997] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-15T17:50:22.251165] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T17:50:22.514013] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-15T17:50:23.313989] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-15T17:50:23.460916] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:50:23.744633] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T17:50:24.114044] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-15T17:50:24.886236] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:50:24.887973] [INFO ] [REMOTE ] BWG: Full fetch complete (17795 records). [2025-10-15T17:50:24.888058] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-15T17:50:24.921093] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-15T17:50:25.276318] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-15T17:50:25.276404] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-15T17:50:25.276866] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-15T17:50:25.276928] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-15T17:50:25.277492] [DEBUG] [LOCAL ] BWG: Trimmed 17795 records to 12586 (keeping 200 days of data) [2025-10-15T17:50:25.355886] [DEBUG] [LOCAL ] BWG: Primary data saved (12586 records). [2025-10-15T17:50:25.356097] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-15T17:50:25.356238] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWG took 34.0s. Estimated remaining: 4h 36m 26s. Rate: 7.2 symbols/min [2025-10-15T17:50:25.547093] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:25.553341] [DEBUG] [LOCAL ] BWSN: Loaded 5143 existing records from primary storage. [2025-10-15T17:50:25.553509] [INFO ] [MAIN ] BWSN: Loaded 5143 existing records. [2025-10-15T17:50:25.650102] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T17:50:25.715387] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-15T17:50:25.743829] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:25.744161] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-15T17:50:25.744209] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-15T17:50:25.744463] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-15T17:50:25.744522] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-15T17:50:26.107422] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:26.514008] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-15T17:50:27.026894] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-15T17:50:27.292201] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:50:27.313953] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-15T17:50:28.114025] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-15T17:50:28.709888] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T17:50:28.714111] [INFO ] [REMOTE ] BWLP: Full fetch complete (48068 records). [2025-10-15T17:50:28.714208] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-15T17:50:28.814206] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T17:50:28.919158] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-15T17:50:29.093764] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-15T17:50:29.093855] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-15T17:50:29.094559] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-15T17:50:29.094599] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-15T17:50:29.095614] [DEBUG] [LOCAL ] BWLP: Trimmed 48068 records to 32251 (keeping 200 days of data) [2025-10-15T17:50:29.303407] [DEBUG] [LOCAL ] BWLP: Primary data saved (32251 records). [2025-10-15T17:50:29.303581] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-15T17:50:29.303704] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWLP took 30.8s. Estimated remaining: 4h 35m 54s. Rate: 7.3 symbols/min [2025-10-15T17:50:29.498547] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:29.547539] [DEBUG] [LOCAL ] BWXT: Loaded 47039 existing records from primary storage. [2025-10-15T17:50:29.547951] [INFO ] [MAIN ] BWXT: Loaded 47039 existing records. [2025-10-15T17:50:29.719162] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-15T17:50:29.753472] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:29.753928] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-15T17:50:29.754098] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-15T17:50:29.755136] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-15T17:50:29.755238] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-15T17:50:29.894087] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T17:50:30.146500] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:30.440577] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T17:50:30.514055] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-15T17:50:31.313974] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-15T17:50:31.350403] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T17:50:32.113989] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-15T17:50:32.451133] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T17:50:32.913973] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-15T17:50:33.002868] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T17:50:33.475690] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T17:50:33.713979] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-15T17:50:34.363618] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T17:50:34.365385] [INFO ] [REMOTE ] BWMX: Full fetch complete (10032 records). [2025-10-15T17:50:34.365468] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-15T17:50:34.521682] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-15T17:50:34.737739] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-15T17:50:34.737820] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-15T17:50:34.738041] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-15T17:50:34.738079] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-15T17:50:34.738482] [DEBUG] [LOCAL ] BWMX: Trimmed 10032 records to 7781 (keeping 200 days of data) [2025-10-15T17:50:34.784186] [DEBUG] [LOCAL ] BWMX: Primary data saved (7781 records). [2025-10-15T17:50:34.784284] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-15T17:50:34.784355] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWMX took 34.8s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-15T17:50:34.947793] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:34.989985] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T17:50:34.990874] [INFO ] [REMOTE ] BWNB: Full fetch complete (5669 records). [2025-10-15T17:50:34.990948] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-15T17:50:35.125324] [DEBUG] [LOCAL ] BX: Loaded 53484 existing records from primary storage. [2025-10-15T17:50:35.148547] [INFO ] [MAIN ] BX: Loaded 53484 existing records. [2025-10-15T17:50:35.319042] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-15T17:50:35.467192] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:35.483405] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-15T17:50:35.488583] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-15T17:50:35.508110] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-15T17:50:35.526977] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-15T17:50:35.611982] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-15T17:50:35.628352] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-15T17:50:35.638853] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-15T17:50:35.646600] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-15T17:50:35.649116] [DEBUG] [LOCAL ] BWNB: Trimmed 5669 records to 4206 (keeping 200 days of data) [2025-10-15T17:50:35.731910] [DEBUG] [LOCAL ] BWNB: Primary data saved (4206 records). [2025-10-15T17:50:35.733549] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-15T17:50:35.733678] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWNB took 33.3s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-15T17:50:35.831738] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T17:50:36.104315] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:36.100587] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:36.117299] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-15T17:50:36.118507] [DEBUG] [LOCAL ] BXC: Loaded 13691 existing records from primary storage. [2025-10-15T17:50:36.118699] [INFO ] [MAIN ] BXC: Loaded 13691 existing records. [2025-10-15T17:50:36.293871] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:36.294016] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-15T17:50:36.294058] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-15T17:50:36.294330] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-15T17:50:36.294369] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-15T17:50:36.633690] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:36.913959] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-15T17:50:37.713960] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-15T17:50:37.833901] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T17:50:38.102718] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T17:50:38.291440] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T17:50:38.513984] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-15T17:50:39.289624] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T17:50:39.313965] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-15T17:50:40.114006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-15T17:50:40.702775] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T17:50:40.913968] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-15T17:50:41.162287] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T17:50:41.500145] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:50:41.713990] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-15T17:50:42.513997] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-15T17:50:43.066081] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T17:50:43.190435] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:50:43.313998] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-15T17:50:44.114006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-15T17:50:44.126345] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T17:50:44.598090] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T17:50:44.914017] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-15T17:50:45.714057] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-15T17:50:46.514048] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-15T17:50:46.701019] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:50:46.723753] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:50:47.314049] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-15T17:50:47.800322] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T17:50:48.113975] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-15T17:50:48.206628] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:50:48.913980] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-15T17:50:49.713989] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-15T17:50:50.131436] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T17:50:50.388015] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T17:50:50.514048] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-15T17:50:50.690162] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T17:50:51.313996] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-15T17:50:52.120917] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-15T17:50:52.142376] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:50:52.162730] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:50:52.913991] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-15T17:50:53.719059] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-15T17:50:53.740547] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:50:54.469574] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T17:50:54.513958] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-15T17:50:54.536081] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T17:50:55.065598] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T17:50:55.314004] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-15T17:50:56.114017] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-15T17:50:56.914081] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-15T17:50:56.996012] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:50:57.358339] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T17:50:57.713995] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-15T17:50:58.336213] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T17:50:58.337539] [INFO ] [REMOTE ] BWSN: Full fetch complete (6358 records). [2025-10-15T17:50:58.337667] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-15T17:50:58.521616] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-15T17:50:58.654174] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:50:58.735911] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-15T17:50:58.735992] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-15T17:50:58.736166] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-15T17:50:58.736206] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-15T17:50:58.736585] [DEBUG] [LOCAL ] BWSN: Trimmed 6358 records to 5154 (keeping 200 days of data) [2025-10-15T17:50:58.767117] [DEBUG] [LOCAL ] BWSN: Primary data saved (5154 records). [2025-10-15T17:50:58.767206] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-15T17:50:58.767281] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 33.4s. Estimated remaining: 4h 35m 54s. Rate: 7.2 symbols/min [2025-10-15T17:50:58.941170] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:58.983330] [DEBUG] [LOCAL ] BXMT: Loaded 47304 existing records from primary storage. [2025-10-15T17:50:58.983679] [INFO ] [MAIN ] BXMT: Loaded 47304 existing records. [2025-10-15T17:50:59.162086] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:59.162287] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-15T17:50:59.162378] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-15T17:50:59.163252] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-15T17:50:59.163311] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-15T17:50:59.315884] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-15T17:50:59.532718] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:59.533395] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T17:51:00.114077] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-15T17:51:00.913975] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-15T17:51:00.999091] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T17:51:01.246063] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T17:51:01.714214] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-15T17:51:02.500913] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T17:51:02.513961] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-15T17:51:03.140886] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:51:03.313997] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-15T17:51:04.114055] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-15T17:51:04.236336] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:51:04.913969] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-15T17:51:05.009930] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:51:05.013120] [INFO ] [REMOTE ] BXC: Full fetch complete (18242 records). [2025-10-15T17:51:05.013298] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-15T17:51:05.421281] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-15T17:51:05.421511] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-15T17:51:05.423839] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T17:51:05.422309] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-15T17:51:05.433502] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-15T17:51:05.434777] [DEBUG] [LOCAL ] BXC: Trimmed 18242 records to 13669 (keeping 200 days of data) [2025-10-15T17:51:05.513743] [DEBUG] [LOCAL ] BXC: Primary data saved (13669 records). [2025-10-15T17:51:05.513889] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-15T17:51:05.513967] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BXC took 29.8s. Estimated remaining: 4h 35m 38s. Rate: 7.3 symbols/min [2025-10-15T17:51:05.682989] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:05.709705] [DEBUG] [LOCAL ] BXMX: Loaded 19577 existing records from primary storage. [2025-10-15T17:51:05.710286] [INFO ] [MAIN ] BXMX: Loaded 19577 existing records. [2025-10-15T17:51:05.725072] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-15T17:51:05.906386] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:05.906670] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-15T17:51:05.906741] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-15T17:51:05.906920] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-15T17:51:05.906962] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-15T17:51:06.275724] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:06.303051] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T17:51:06.513999] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-15T17:51:07.313989] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-15T17:51:07.633108] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T17:51:08.113999] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-15T17:51:08.684056] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T17:51:08.728868] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:51:08.914002] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-15T17:51:09.714011] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-15T17:51:10.172945] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T17:51:10.513977] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-15T17:51:10.618759] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:51:10.716198] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T17:51:11.314015] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-15T17:51:12.113964] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-15T17:51:12.205912] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T17:51:12.370973] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T17:51:12.376843] [INFO ] [REMOTE ] BWXT: Full fetch complete (67831 records). [2025-10-15T17:51:12.376970] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-15T17:51:12.759556] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-15T17:51:12.759684] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-15T17:51:12.760496] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-15T17:51:12.760539] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-15T17:51:12.761968] [DEBUG] [LOCAL ] BWXT: Trimmed 67831 records to 47121 (keeping 200 days of data) [2025-10-15T17:51:12.941709] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-15T17:51:13.065039] [DEBUG] [LOCAL ] BWXT: Primary data saved (47121 records). [2025-10-15T17:51:13.065219] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-15T17:51:13.065320] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BWXT took 43.8s. Estimated remaining: 4h 35m 25s. Rate: 7.3 symbols/min [2025-10-15T17:51:13.243227] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:13.300739] [DEBUG] [LOCAL ] BXP: Loaded 49862 existing records from primary storage. [2025-10-15T17:51:13.301141] [INFO ] [MAIN ] BXP: Loaded 49862 existing records. [2025-10-15T17:51:13.541092] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:13.541875] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-15T17:51:13.541979] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-15T17:51:13.542538] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-15T17:51:13.542810] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-15T17:51:13.689890] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:51:13.718028] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-15T17:51:13.969962] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:14.513969] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-15T17:51:14.758679] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:51:14.844879] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T17:51:15.314046] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-15T17:51:15.832175] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T17:51:16.113984] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-15T17:51:16.410399] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T17:51:16.914073] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-15T17:51:17.717980] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-15T17:51:17.730608] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:51:18.514012] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-15T17:51:18.691866] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T17:51:18.869369] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T17:51:18.877670] [INFO ] [REMOTE ] BX: Full fetch complete (77573 records). [2025-10-15T17:51:18.877834] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-15T17:51:19.318605] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-15T17:51:19.318361] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-15T17:51:19.318754] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-15T17:51:19.319774] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-15T17:51:19.320690] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-15T17:51:19.322417] [DEBUG] [LOCAL ] BX: Trimmed 77573 records to 53483 (keeping 200 days of data) [2025-10-15T17:51:19.671612] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-15T17:51:19.671887] [INFO ] [MAIN ] BX: Full history saved. [2025-10-15T17:51:19.673054] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 44.9s. Estimated remaining: 4h 35m 8s. Rate: 7.3 symbols/min [2025-10-15T17:51:19.866609] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:19.913708] [DEBUG] [LOCAL ] BXSL: Loaded 48094 existing records from primary storage. [2025-10-15T17:51:19.914112] [INFO ] [MAIN ] BXSL: Loaded 48094 existing records. [2025-10-15T17:51:20.098171] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:20.098743] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-15T17:51:20.098811] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-15T17:51:20.099313] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-15T17:51:20.108414] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-15T17:51:20.121475] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-15T17:51:20.208097] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:51:20.474240] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T17:51:20.558191] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:20.914019] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-15T17:51:21.548678] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T17:51:21.714022] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-15T17:51:22.086056] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T17:51:22.514055] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-15T17:51:23.313993] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-15T17:51:23.411296] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:51:23.662072] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T17:51:24.114005] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-15T17:51:24.913996] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-15T17:51:25.148027] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:51:25.200410] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:51:25.714050] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-15T17:51:26.446049] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:51:26.513974] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-15T17:51:27.272701] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T17:51:27.313960] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-15T17:51:27.548432] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:51:28.114063] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-15T17:51:28.914122] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-15T17:51:29.131603] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:51:29.320128] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:51:29.714030] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-15T17:51:29.917016] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T17:51:30.514009] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-15T17:51:31.315604] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-15T17:51:31.319043] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:51:32.115514] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-15T17:51:32.117784] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T17:51:32.123958] [INFO ] [REMOTE ] BXMT: Full fetch complete (69940 records). [2025-10-15T17:51:32.124079] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-15T17:51:32.544207] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-15T17:51:32.544366] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-15T17:51:32.545970] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-15T17:51:32.546079] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-15T17:51:32.547984] [DEBUG] [LOCAL ] BXMT: Trimmed 69940 records to 47317 (keeping 200 days of data) [2025-10-15T17:51:32.845363] [DEBUG] [LOCAL ] BXMT: Primary data saved (47317 records). [2025-10-15T17:51:32.845935] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-15T17:51:32.846061] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BXMT took 34.1s. Estimated remaining: 4h 35m 26s. Rate: 7.2 symbols/min [2025-10-15T17:51:32.937432] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-15T17:51:32.937365] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T17:51:33.052837] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T17:51:33.069372] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:33.072011] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-15T17:51:33.072066] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-15T17:51:33.072186] [INFO ] [REMOTE ] BXMX: Full fetch complete (28794 records). [2025-10-15T17:51:33.072328] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-15T17:51:33.072395] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-15T17:51:33.072474] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-15T17:51:33.072574] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-15T17:51:33.072787] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-15T17:51:33.714109] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-15T17:51:33.799401] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:33.825408] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-15T17:51:33.825935] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-15T17:51:33.826393] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-15T17:51:33.826434] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-15T17:51:33.827109] [DEBUG] [LOCAL ] BXMX: Trimmed 28794 records to 19492 (keeping 200 days of data) [2025-10-15T17:51:33.941313] [DEBUG] [LOCAL ] BXMX: Primary data saved (19492 records). [2025-10-15T17:51:33.941454] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-15T17:51:33.941531] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMX took 28.4s. Estimated remaining: 4h 34m 40s. Rate: 7.3 symbols/min [2025-10-15T17:51:34.109377] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:34.152428] [DEBUG] [LOCAL ] BYD: Loaded 44865 existing records from primary storage. [2025-10-15T17:51:34.152789] [INFO ] [MAIN ] BYD: Loaded 44865 existing records. [2025-10-15T17:51:34.326625] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:34.326909] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-15T17:51:34.327021] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-15T17:51:34.327443] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-15T17:51:34.327500] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-15T17:51:34.524015] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-15T17:51:34.683995] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:34.712220] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:51:35.313968] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-15T17:51:35.370709] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T17:51:35.498421] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T17:51:36.113999] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-15T17:51:36.656280] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T17:51:36.914051] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-15T17:51:37.591912] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T17:51:37.713998] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-15T17:51:38.523285] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-15T17:51:38.525635] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:51:39.095869] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:51:39.313980] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-15T17:51:39.497044] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T17:51:40.113989] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-15T17:51:40.819039] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T17:51:40.914013] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-15T17:51:41.698356] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T17:51:41.713957] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-15T17:51:42.514101] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-15T17:51:42.682966] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:51:43.245124] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:51:43.295581] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T17:51:43.313961] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-15T17:51:44.114000] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-15T17:51:44.842015] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:51:44.913995] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-15T17:51:45.713977] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-15T17:51:45.845067] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:51:46.437191] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:51:46.513990] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-15T17:51:46.604631] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T17:51:47.314019] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-15T17:51:48.098597] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:51:48.113953] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-15T17:51:48.322197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:51:48.914010] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-15T17:51:49.714478] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:51:49.714551] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-15T17:51:50.449549] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:51:50.513997] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-15T17:51:51.301863] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:51:51.308112] [INFO ] [REMOTE ] BXP: Full fetch complete (72106 records). [2025-10-15T17:51:51.308278] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-15T17:51:51.321060] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-15T17:51:51.702581] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-15T17:51:51.702696] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-15T17:51:51.703739] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-15T17:51:51.703806] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-15T17:51:51.705293] [DEBUG] [LOCAL ] BXP: Trimmed 72106 records to 49889 (keeping 200 days of data) [2025-10-15T17:51:52.022912] [DEBUG] [LOCAL ] BXP: Primary data saved (49889 records). [2025-10-15T17:51:52.023183] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-15T17:51:52.023370] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXP took 39.0s. Estimated remaining: 4h 35m 24s. Rate: 7.2 symbols/min [2025-10-15T17:51:52.124759] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-15T17:51:52.204570] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:52.238183] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T17:51:52.256358] [DEBUG] [LOCAL ] BYM: Loaded 11730 existing records from primary storage. [2025-10-15T17:51:52.256626] [INFO ] [MAIN ] BYM: Loaded 11730 existing records. [2025-10-15T17:51:52.439668] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:52.439867] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-15T17:51:52.439913] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-15T17:51:52.440126] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-15T17:51:52.440181] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-15T17:51:52.549077] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:51:52.803614] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:52.914000] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-15T17:51:53.691948] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:51:53.713954] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-15T17:51:54.514815] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-15T17:51:54.517973] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:51:55.301314] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:51:55.313950] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-15T17:51:55.342808] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T17:51:56.114030] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-15T17:51:56.657285] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:51:56.914082] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-15T17:51:57.261078] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:51:57.714054] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-15T17:51:58.514028] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-15T17:51:58.597811] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:51:58.854196] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-15T17:51:58.861848] [INFO ] [REMOTE ] BXSL: Full fetch complete (69908 records). [2025-10-15T17:51:58.862018] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-15T17:51:59.261488] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-15T17:51:59.261578] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-15T17:51:59.262499] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-15T17:51:59.262569] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-15T17:51:59.264186] [DEBUG] [LOCAL ] BXSL: Trimmed 69908 records to 48119 (keeping 200 days of data) [2025-10-15T17:51:59.320871] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-15T17:51:59.574122] [DEBUG] [LOCAL ] BXSL: Primary data saved (48119 records). [2025-10-15T17:51:59.574262] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-15T17:51:59.575366] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXSL took 39.9s. Estimated remaining: 4h 35m 11s. Rate: 7.2 symbols/min [2025-10-15T17:51:59.742342] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:59.779100] [DEBUG] [LOCAL ] BZH: Loaded 32491 existing records from primary storage. [2025-10-15T17:51:59.779397] [INFO ] [MAIN ] BZH: Loaded 32491 existing records. [2025-10-15T17:51:59.962405] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:59.962795] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-15T17:51:59.962927] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-15T17:51:59.963216] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-15T17:51:59.963273] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-15T17:52:00.090956] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T17:52:00.114743] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-15T17:52:00.171330] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T17:52:00.219383] [INFO ] [REMOTE ] BYD: Full fetch complete (65286 records). [2025-10-15T17:52:00.252682] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-15T17:52:00.515424] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:00.757922] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-15T17:52:00.758007] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-15T17:52:00.758820] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-15T17:52:00.758885] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-15T17:52:00.760250] [DEBUG] [LOCAL ] BYD: Trimmed 65286 records to 44894 (keeping 200 days of data) [2025-10-15T17:52:00.933713] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-15T17:52:01.031623] [DEBUG] [LOCAL ] BYD: Primary data saved (44894 records). [2025-10-15T17:52:01.031815] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-15T17:52:01.032059] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BYD took 27.1s. Estimated remaining: 4h 34m 27s. Rate: 7.3 symbols/min [2025-10-15T17:52:01.196126] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:01.250151] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-15T17:52:01.250474] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-15T17:52:01.441337] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:01.455560] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-15T17:52:01.455912] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-15T17:52:01.456710] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-15T17:52:01.457268] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:52:01.457372] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-15T17:52:01.567347] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T17:52:01.720282] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-15T17:52:01.890214] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:02.514061] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-15T17:52:02.874001] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:52:03.313999] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-15T17:52:04.114054] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-15T17:52:04.352870] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:52:04.379822] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:52:04.913989] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-15T17:52:04.938685] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T17:52:05.713959] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-15T17:52:05.896089] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T17:52:05.899243] [INFO ] [REMOTE ] BY: Full fetch complete (29731 records). [2025-10-15T17:52:05.899357] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-15T17:52:06.305689] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-15T17:52:06.305816] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-15T17:52:06.306592] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-15T17:52:06.306681] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-15T17:52:06.307670] [DEBUG] [LOCAL ] BY: Trimmed 29731 records to 21823 (keeping 200 days of data) [2025-10-15T17:52:06.447331] [DEBUG] [LOCAL ] BY: Primary data saved (21823 records). [2025-10-15T17:52:06.447493] [INFO ] [MAIN ] BY: Full history saved. [2025-10-15T17:52:06.447575] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BY took 33.6s. Estimated remaining: 4h 34m 4s. Rate: 7.3 symbols/min [2025-10-15T17:52:06.519143] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-15T17:52:06.632449] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:06.654837] [DEBUG] [LOCAL ] CAAP: Loaded 19791 existing records from primary storage. [2025-10-15T17:52:06.655160] [INFO ] [MAIN ] CAAP: Loaded 19791 existing records. [2025-10-15T17:52:06.835960] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:06.836270] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-15T17:52:06.836333] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-15T17:52:06.836542] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-15T17:52:06.836582] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-15T17:52:07.229889] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:07.313990] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-15T17:52:07.541843] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:52:07.658379] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T17:52:08.113970] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-15T17:52:08.244486] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T17:52:08.913991] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-15T17:52:09.108232] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T17:52:09.501893] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T17:52:09.713982] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-15T17:52:10.513973] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-15T17:52:10.526769] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T17:52:11.314071] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-15T17:52:11.509238] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T17:52:12.114011] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-15T17:52:12.710975] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T17:52:12.913965] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-15T17:52:13.202214] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T17:52:13.713991] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-15T17:52:13.866904] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T17:52:14.514050] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-15T17:52:14.957747] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:52:15.289451] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T17:52:15.313974] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-15T17:52:16.065814] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T17:52:16.114023] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-15T17:52:16.914034] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-15T17:52:16.980499] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T17:52:17.556199] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T17:52:17.714035] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-15T17:52:18.514012] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-15T17:52:18.730026] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T17:52:19.314138] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-15T17:52:19.610952] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T17:52:20.114029] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-15T17:52:20.152073] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T17:52:20.153838] [INFO ] [REMOTE ] BYM: Full fetch complete (17602 records). [2025-10-15T17:52:20.153908] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-15T17:52:20.511156] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-15T17:52:20.511235] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-15T17:52:20.511593] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-15T17:52:20.511631] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-15T17:52:20.512182] [DEBUG] [LOCAL ] BYM: Trimmed 17602 records to 11722 (keeping 200 days of data) [2025-10-15T17:52:20.581048] [DEBUG] [LOCAL ] BYM: Primary data saved (11722 records). [2025-10-15T17:52:20.581176] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-15T17:52:20.581301] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYM took 28.6s. Estimated remaining: 4h 34m 26s. Rate: 7.3 symbols/min [2025-10-15T17:52:20.745412] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:20.763132] [DEBUG] [LOCAL ] CABO: Loaded 16823 existing records from primary storage. [2025-10-15T17:52:20.763357] [INFO ] [MAIN ] CABO: Loaded 16823 existing records. [2025-10-15T17:52:20.918613] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-15T17:52:20.940864] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:20.941177] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-15T17:52:20.941231] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-15T17:52:20.941428] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-15T17:52:20.941464] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-15T17:52:21.254019] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:52:21.322059] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:21.713967] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-15T17:52:22.098939] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T17:52:22.464545] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T17:52:22.513957] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-15T17:52:23.083944] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T17:52:23.313996] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-15T17:52:24.031111] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T17:52:24.114017] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-15T17:52:24.914012] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-15T17:52:25.639342] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T17:52:25.713987] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-15T17:52:26.022385] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T17:52:26.514052] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-15T17:52:26.686178] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T17:52:27.314065] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-15T17:52:28.114070] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-15T17:52:28.690603] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T17:52:28.728701] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T17:52:28.913984] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-15T17:52:29.069084] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:52:29.713990] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-15T17:52:30.514007] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-15T17:52:30.621552] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T17:52:31.052674] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-15T17:52:31.314007] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-15T17:52:31.838566] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:52:32.113997] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-15T17:52:32.913991] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-15T17:52:32.946966] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:52:33.245008] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:52:33.714001] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-15T17:52:34.039065] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:52:34.514074] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-15T17:52:35.314009] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-15T17:52:35.653592] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:52:35.651853] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T17:52:35.669321] [INFO ] [REMOTE ] BZH: Full fetch complete (47187 records). [2025-10-15T17:52:35.669588] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-15T17:52:36.047783] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-15T17:52:36.047859] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-15T17:52:36.048524] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-15T17:52:36.048564] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-15T17:52:36.049574] [DEBUG] [LOCAL ] BZH: Trimmed 47187 records to 32426 (keeping 200 days of data) [2025-10-15T17:52:36.133152] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-15T17:52:36.236793] [DEBUG] [LOCAL ] BZH: Primary data saved (32426 records). [2025-10-15T17:52:36.236929] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-15T17:52:36.237022] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BZH took 36.7s. Estimated remaining: 4h 34m 57s. Rate: 7.2 symbols/min [2025-10-15T17:52:36.405209] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:36.428015] [DEBUG] [LOCAL ] CACI: Loaded 23249 existing records from primary storage. [2025-10-15T17:52:36.428269] [INFO ] [MAIN ] CACI: Loaded 23249 existing records. [2025-10-15T17:52:36.613437] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:36.614288] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T17:52:36.614454] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-15T17:52:36.617489] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-15T17:52:36.617613] [INFO ] [REMOTE ] CAAP: Full fetch complete (27926 records). [2025-10-15T17:52:36.617706] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-15T17:52:36.621158] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-15T17:52:36.663794] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-15T17:52:36.916995] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-15T17:52:37.366603] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-15T17:52:37.366429] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:37.367066] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-15T17:52:37.367677] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-15T17:52:37.367756] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-15T17:52:37.379375] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T17:52:37.378922] [DEBUG] [LOCAL ] CAAP: Trimmed 27926 records to 19831 (keeping 200 days of data) [2025-10-15T17:52:37.495799] [DEBUG] [LOCAL ] CAAP: Primary data saved (19831 records). [2025-10-15T17:52:37.495948] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-15T17:52:37.496025] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. CAAP took 31.0s. Estimated remaining: 4h 34m 12s. Rate: 7.3 symbols/min [2025-10-15T17:52:37.660405] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:37.703321] [DEBUG] [LOCAL ] CADE: Loaded 49416 existing records from primary storage. [2025-10-15T17:52:37.703671] [INFO ] [MAIN ] CADE: Loaded 49416 existing records. [2025-10-15T17:52:37.723876] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-15T17:52:37.879186] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:37.879422] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-15T17:52:37.879474] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-15T17:52:37.879775] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-15T17:52:37.879829] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-15T17:52:38.227933] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:38.514017] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-15T17:52:38.900817] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T17:52:39.065118] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T17:52:39.314053] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-15T17:52:39.967813] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:52:40.113982] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-15T17:52:40.599961] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:52:40.905496] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T17:52:40.913953] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-15T17:52:41.714070] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-15T17:52:42.086089] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:52:42.514019] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-15T17:52:43.060104] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:52:43.314030] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-15T17:52:44.037436] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:52:44.114019] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-15T17:52:44.789179] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:52:44.914001] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-15T17:52:45.453307] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:52:45.714043] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-15T17:52:46.504479] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:52:46.514501] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-15T17:52:46.981337] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T17:52:47.314039] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-15T17:52:47.495540] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T17:52:48.113977] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-15T17:52:48.914018] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-15T17:52:49.333180] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T17:52:49.540747] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T17:52:49.713991] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-15T17:52:49.833495] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T17:52:50.514018] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-15T17:52:50.747049] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T17:52:51.313983] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-15T17:52:52.114028] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-15T17:52:52.263392] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T17:52:52.698347] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T17:52:52.704847] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-15T17:52:52.704978] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-15T17:52:52.916755] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-15T17:52:53.156373] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-15T17:52:53.164750] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-15T17:52:53.166832] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-15T17:52:53.167747] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-15T17:52:53.167456] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T17:52:53.175766] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 53740 (keeping 200 days of data) [2025-10-15T17:52:53.531169] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-15T17:52:53.531366] [INFO ] [MAIN ] C: Full history saved. [2025-10-15T17:52:53.531885] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 52.5s. Estimated remaining: 4h 34m 44s. Rate: 7.2 symbols/min [2025-10-15T17:52:53.721546] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-15T17:52:53.764672] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:53.809778] [DEBUG] [LOCAL ] CAE: Loaded 39218 existing records from primary storage. [2025-10-15T17:52:53.810122] [INFO ] [MAIN ] CAE: Loaded 39218 existing records. [2025-10-15T17:52:53.993598] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:53.993895] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-15T17:52:53.993947] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-15T17:52:53.994421] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-15T17:52:53.994481] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-15T17:52:54.374523] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:54.513962] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-15T17:52:54.686130] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:52:54.908900] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T17:52:55.313985] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-15T17:52:56.079280] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T17:52:56.114012] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-15T17:52:56.692300] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:52:56.914003] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-15T17:52:57.241628] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:52:57.714023] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-15T17:52:58.409395] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:52:58.514000] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-15T17:52:59.054498] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T17:52:59.314035] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-15T17:53:00.119104] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-15T17:53:00.137103] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:53:00.846545] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:53:00.864258] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:53:00.913961] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-15T17:53:01.714008] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-15T17:53:01.820573] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T17:53:01.822338] [INFO ] [REMOTE ] CABO: Full fetch complete (23128 records). [2025-10-15T17:53:01.822407] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-15T17:53:01.822891] [FATAL] [VALIDATOR ] CABO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:53:01.822999] [FATAL] [MAIN ] CABO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:53:01.823040] [WARN ] [MAIN ] CABO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:53:01.823078] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-15T17:53:01.823134] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-10-15T17:53:01.823169] [INFO ] [LOCAL ] CABO: Starting deletion of derivative data. [2025-10-15T17:53:01.823352] [DEBUG] [LOCAL ] CABO: Deleted derivative data file. [2025-10-15T17:53:01.823439] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. CABO took 41.2s. Estimated remaining: 4h 34m 35s. Rate: 7.2 symbols/min [2025-10-15T17:53:01.990802] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:01.997616] [DEBUG] [LOCAL ] CAF: Loaded 3450 existing records from primary storage. [2025-10-15T17:53:01.997884] [INFO ] [MAIN ] CAF: Loaded 3450 existing records. [2025-10-15T17:53:02.179540] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:02.179801] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-15T17:53:02.179853] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-15T17:53:02.180020] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-15T17:53:02.180060] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-15T17:53:02.519173] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-15T17:53:02.584189] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:03.029739] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T17:53:03.313987] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-15T17:53:04.078116] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T17:53:04.113967] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-15T17:53:04.169219] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:53:04.549884] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:53:04.914052] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-15T17:53:05.714052] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-15T17:53:06.323055] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T17:53:06.514029] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-15T17:53:07.313973] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-15T17:53:07.409083] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:53:07.985672] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T17:53:07.991954] [INFO ] [REMOTE ] CADE: Full fetch complete (70447 records). [2025-10-15T17:53:07.992067] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-15T17:53:08.119153] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-15T17:53:08.433849] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-15T17:53:08.434066] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-15T17:53:08.436020] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-15T17:53:08.436923] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-15T17:53:08.436814] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:53:08.443492] [DEBUG] [LOCAL ] CADE: Trimmed 70447 records to 49483 (keeping 200 days of data) [2025-10-15T17:53:08.552848] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T17:53:08.757475] [DEBUG] [LOCAL ] CADE: Primary data saved (49483 records). [2025-10-15T17:53:08.757687] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-15T17:53:08.757796] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CADE took 31.3s. Estimated remaining: 4h 34m 20s. Rate: 7.2 symbols/min [2025-10-15T17:53:08.922429] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-15T17:53:08.926625] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:08.979780] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-15T17:53:08.980102] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-15T17:53:09.164893] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:09.165150] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-15T17:53:09.165206] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-15T17:53:09.165522] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-15T17:53:09.165561] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-15T17:53:09.530846] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:09.714047] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-15T17:53:10.133162] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:53:10.500571] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:53:10.513956] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-15T17:53:11.314038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-15T17:53:11.998227] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:53:12.114013] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-15T17:53:12.816130] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:53:12.914010] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-15T17:53:13.220770] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T17:53:13.713999] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-15T17:53:14.233252] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T17:53:14.513982] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-15T17:53:14.669715] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T17:53:15.313991] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-15T17:53:15.733065] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T17:53:16.114070] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-15T17:53:16.450406] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T17:53:16.452759] [INFO ] [REMOTE ] CACI: Full fetch complete (38272 records). [2025-10-15T17:53:16.452854] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-15T17:53:16.820900] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-15T17:53:16.820980] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-15T17:53:16.821575] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-15T17:53:16.821615] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-15T17:53:16.822475] [DEBUG] [LOCAL ] CACI: Trimmed 38272 records to 23152 (keeping 200 days of data) [2025-10-15T17:53:16.917429] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-15T17:53:16.965781] [DEBUG] [LOCAL ] CACI: Primary data saved (23152 records). [2025-10-15T17:53:16.965909] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-15T17:53:16.965990] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CACI took 40.7s. Estimated remaining: 4h 34m 11s. Rate: 7.2 symbols/min [2025-10-15T17:53:17.132192] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:17.188383] [DEBUG] [LOCAL ] CAH: Loaded 51482 existing records from primary storage. [2025-10-15T17:53:17.188736] [INFO ] [MAIN ] CAH: Loaded 51482 existing records. [2025-10-15T17:53:17.364187] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:17.364467] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-15T17:53:17.364528] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-15T17:53:17.365021] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-15T17:53:17.365091] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-15T17:53:17.717424] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-15T17:53:17.723392] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:17.831989] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:53:17.837126] [INFO ] [REMOTE ] CAE: Full fetch complete (56387 records). [2025-10-15T17:53:17.837225] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-15T17:53:18.242775] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-15T17:53:18.242508] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T17:53:18.243050] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-15T17:53:18.246519] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-15T17:53:18.246594] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-15T17:53:18.248342] [DEBUG] [LOCAL ] CAE: Trimmed 56387 records to 39206 (keeping 200 days of data) [2025-10-15T17:53:18.481634] [DEBUG] [LOCAL ] CAE: Primary data saved (39206 records). [2025-10-15T17:53:18.481818] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-15T17:53:18.482157] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAE took 25.0s. Estimated remaining: 4h 33m 28s. Rate: 7.3 symbols/min [2025-10-15T17:53:18.519002] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-15T17:53:18.675912] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:18.720448] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T17:53:18.765623] [DEBUG] [LOCAL ] CAL: Loaded 43003 existing records from primary storage. [2025-10-15T17:53:18.765997] [INFO ] [MAIN ] CAL: Loaded 43003 existing records. [2025-10-15T17:53:18.955159] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:18.955440] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-15T17:53:18.955498] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-15T17:53:18.955907] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-15T17:53:18.955963] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-15T17:53:19.278073] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T17:53:19.319153] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-15T17:53:19.412855] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:20.114062] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-15T17:53:20.224977] [DEBUG] [REMOTE ] CAL: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T17:53:20.225351] [WARN ] [REMOTE ] CAL: No data returned for month 2024-12 [2025-10-15T17:53:20.225445] [FATAL] [REMOTE ] CAL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:53:20.225515] [FATAL] [MAIN ] CAL: Failed to fetch primary data. [2025-10-15T17:53:20.225580] [WARN ] [MAIN ] CAL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:53:20.225677] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-15T17:53:20.225757] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-15T17:53:20.225794] [INFO ] [LOCAL ] CAL: Starting deletion of derivative data. [2025-10-15T17:53:20.225977] [DEBUG] [LOCAL ] CAL: Deleted derivative data file. [2025-10-15T17:53:20.226237] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAL took 1.7s. Estimated remaining: 4h 32m 47s. Rate: 7.3 symbols/min [2025-10-15T17:53:20.398519] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:20.434096] [DEBUG] [LOCAL ] CALX: Loaded 37675 existing records from primary storage. [2025-10-15T17:53:20.434387] [INFO ] [MAIN ] CALX: Loaded 37675 existing records. [2025-10-15T17:53:20.608940] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:20.609159] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-15T17:53:20.609205] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-15T17:53:20.609452] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-15T17:53:20.609490] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-15T17:53:20.927182] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-15T17:53:20.968482] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:21.202111] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T17:53:21.495363] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T17:53:21.714026] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-15T17:53:22.514000] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-15T17:53:23.291348] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:53:23.313955] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-15T17:53:24.113992] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-15T17:53:24.395752] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T17:53:24.617092] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:53:24.914014] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-15T17:53:25.724834] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-15T17:53:25.732279] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:53:25.781764] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:53:26.514063] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-15T17:53:27.314043] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-15T17:53:27.372323] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T17:53:27.730287] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T17:53:27.972410] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T17:53:28.114083] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-15T17:53:28.913995] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-15T17:53:29.714031] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-15T17:53:29.853563] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T17:53:30.005760] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T17:53:30.513990] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-15T17:53:31.313989] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-15T17:53:31.425581] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T17:53:31.579461] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:53:31.834292] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:53:32.114008] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-15T17:53:32.914014] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-15T17:53:33.637354] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:53:33.713955] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-15T17:53:34.518132] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-15T17:53:34.523347] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:53:35.313966] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-15T17:53:35.482825] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:53:35.853595] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:53:35.854628] [INFO ] [REMOTE ] CAF: Full fetch complete (5566 records). [2025-10-15T17:53:35.854743] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-15T17:53:36.119258] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-15T17:53:36.243106] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-15T17:53:36.243213] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-15T17:53:36.243431] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-15T17:53:36.243473] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-15T17:53:36.244295] [DEBUG] [LOCAL ] CAF: Trimmed 5566 records to 3465 (keeping 200 days of data) [2025-10-15T17:53:36.265179] [DEBUG] [LOCAL ] CAF: Primary data saved (3465 records). [2025-10-15T17:53:36.265253] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-15T17:53:36.265340] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAF took 34.4s. Estimated remaining: 4h 33m 18s. Rate: 7.2 symbols/min [2025-10-15T17:53:36.436604] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:36.436886] [DEBUG] [LOCAL ] CANG: No existing data file found in primary storage. [2025-10-15T17:53:36.437086] [WARN ] [MAIN ] CANG: No existing data found, performing full refresh instead. [2025-10-15T17:53:36.437276] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-15T17:53:36.437320] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-15T17:53:36.437363] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-15T17:53:36.437398] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-15T17:53:36.796362] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:36.829190] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-15T17:53:36.913974] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-15T17:53:37.419941] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T17:53:37.713983] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-15T17:53:38.513993] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-15T17:53:38.840733] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T17:53:39.191929] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:53:39.313962] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-15T17:53:40.113999] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-15T17:53:40.450140] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T17:53:40.840538] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:53:40.914021] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-15T17:53:41.366250] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T17:53:41.713998] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-15T17:53:42.312975] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T17:53:42.513959] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-15T17:53:42.999084] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:53:43.314009] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-15T17:53:43.819169] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:53:44.114003] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-15T17:53:44.914021] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-15T17:53:45.093605] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T17:53:45.169890] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:53:45.713974] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-15T17:53:46.319322] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:53:46.323542] [INFO ] [REMOTE ] CALX: Full fetch complete (54227 records). [2025-10-15T17:53:46.323637] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-15T17:53:46.517528] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-15T17:53:46.719298] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-15T17:53:46.719431] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-15T17:53:46.720290] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-15T17:53:46.720355] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-15T17:53:46.721535] [DEBUG] [LOCAL ] CALX: Trimmed 54227 records to 37642 (keeping 200 days of data) [2025-10-15T17:53:46.925623] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T17:53:46.962734] [DEBUG] [LOCAL ] CALX: Primary data saved (37642 records). [2025-10-15T17:53:46.962909] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-15T17:53:46.963169] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CALX took 26.7s. Estimated remaining: 4h 33m 22s. Rate: 7.2 symbols/min [2025-10-15T17:53:47.139149] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:47.148308] [DEBUG] [LOCAL ] CAPL: Loaded 5645 existing records from primary storage. [2025-10-15T17:53:47.148552] [INFO ] [MAIN ] CAPL: Loaded 5645 existing records. [2025-10-15T17:53:47.319205] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-15T17:53:47.323356] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:47.324565] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-15T17:53:47.324629] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-15T17:53:47.325031] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-15T17:53:47.325089] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-15T17:53:47.683737] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:48.113997] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-15T17:53:48.277567] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:53:48.397997] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:53:48.914015] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-15T17:53:49.714019] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-15T17:53:49.992010] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T17:53:50.513980] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-15T17:53:50.530458] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T17:53:50.747542] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T17:53:50.754469] [INFO ] [REMOTE ] CAG: Full fetch complete (77822 records). [2025-10-15T17:53:50.754624] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-15T17:53:51.168139] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-15T17:53:51.168296] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-15T17:53:51.169710] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-15T17:53:51.169779] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-15T17:53:51.171830] [DEBUG] [LOCAL ] CAG: Trimmed 77822 records to 53665 (keeping 200 days of data) [2025-10-15T17:53:51.351697] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-15T17:53:51.519967] [DEBUG] [LOCAL ] CAG: Primary data saved (53665 records). [2025-10-15T17:53:51.520163] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-15T17:53:51.520262] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 42.8s. Estimated remaining: 4h 32m 55s. Rate: 7.3 symbols/min [2025-10-15T17:53:51.693873] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:51.745594] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-15T17:53:51.746046] [INFO ] [MAIN ] CARR: Loaded 53602 existing records. [2025-10-15T17:53:51.926880] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:51.927131] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-15T17:53:51.927181] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-15T17:53:51.927480] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-15T17:53:51.927573] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-15T17:53:52.123203] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-15T17:53:52.305842] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:52.355844] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T17:53:52.395307] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:53:52.633463] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T17:53:52.913997] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-15T17:53:53.714026] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-15T17:53:54.079412] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T17:53:54.514013] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-15T17:53:54.991890] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T17:53:55.314002] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-15T17:53:55.491316] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T17:53:55.497450] [INFO ] [REMOTE ] CAH: Full fetch complete (74818 records). [2025-10-15T17:53:55.497582] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-15T17:53:55.893274] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-15T17:53:55.893355] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-15T17:53:55.894249] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-15T17:53:55.894312] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-15T17:53:55.895808] [DEBUG] [LOCAL ] CAH: Trimmed 74818 records to 51461 (keeping 200 days of data) [2025-10-15T17:53:56.114628] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-15T17:53:56.218094] [DEBUG] [LOCAL ] CAH: Primary data saved (51461 records). [2025-10-15T17:53:56.218232] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-15T17:53:56.219367] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 39.3s. Estimated remaining: 4h 32m 29s. Rate: 7.3 symbols/min [2025-10-15T17:53:56.392016] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:56.432611] [DEBUG] [LOCAL ] CARS: Loaded 39798 existing records from primary storage. [2025-10-15T17:53:56.433015] [INFO ] [MAIN ] CARS: Loaded 39798 existing records. [2025-10-15T17:53:56.617317] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:56.617526] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-15T17:53:56.617573] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-15T17:53:56.618167] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-15T17:53:56.618225] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-15T17:53:56.919190] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-15T17:53:56.976519] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:57.180294] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:53:57.368472] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T17:53:57.394474] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T17:53:57.714096] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-15T17:53:58.406928] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:53:58.514037] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-15T17:53:59.314080] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-15T17:54:00.004868] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T17:54:00.114094] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-15T17:54:00.822802] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:54:00.914024] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-15T17:54:01.675637] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:54:01.714047] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-15T17:54:02.514045] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-15T17:54:03.027169] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T17:54:03.167302] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-15T17:54:03.313966] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-15T17:54:03.942212] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T17:54:04.114013] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-15T17:54:04.843316] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:54:04.913970] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-15T17:54:04.947767] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:54:05.714004] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-15T17:54:06.065938] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T17:54:06.071270] [INFO ] [REMOTE ] CANG: Full fetch complete (39777 records). [2025-10-15T17:54:06.071434] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-15T17:54:06.337278] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T17:54:06.501969] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-15T17:54:06.502073] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-15T17:54:06.503692] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-15T17:54:06.503761] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-15T17:54:06.505298] [DEBUG] [LOCAL ] CANG: Trimmed 39777 records to 26919 (keeping 200 days of data) [2025-10-15T17:54:06.553458] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-15T17:54:06.672554] [DEBUG] [LOCAL ] CANG: Primary data saved (26919 records). [2025-10-15T17:54:06.672785] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-15T17:54:06.672924] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CANG took 30.4s. Estimated remaining: 4h 32m 31s. Rate: 7.3 symbols/min [2025-10-15T17:54:06.860174] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:06.918491] [DEBUG] [LOCAL ] CAT: Loaded 52943 existing records from primary storage. [2025-10-15T17:54:06.919041] [INFO ] [MAIN ] CAT: Loaded 52943 existing records. [2025-10-15T17:54:07.109147] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:07.109539] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-15T17:54:07.109627] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-15T17:54:07.110286] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-15T17:54:07.110358] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-15T17:54:07.323076] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-15T17:54:07.541747] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:08.114041] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-15T17:54:08.524930] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T17:54:08.563612] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T17:54:08.914014] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-15T17:54:09.713963] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-15T17:54:10.227015] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T17:54:10.267434] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T17:54:10.292421] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T17:54:10.513998] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-15T17:54:11.087046] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T17:54:11.313965] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-15T17:54:11.897446] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:54:12.114089] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-15T17:54:12.914048] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-15T17:54:13.715674] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-15T17:54:13.718601] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T17:54:14.514006] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-15T17:54:14.570854] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T17:54:15.313991] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-15T17:54:15.376485] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:54:15.377788] [INFO ] [REMOTE ] CAPL: Full fetch complete (8751 records). [2025-10-15T17:54:15.377854] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-15T17:54:15.742757] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-15T17:54:15.742884] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-15T17:54:15.743155] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-15T17:54:15.743282] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-15T17:54:15.743717] [DEBUG] [LOCAL ] CAPL: Trimmed 8751 records to 5642 (keeping 200 days of data) [2025-10-15T17:54:15.805020] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T17:54:15.818157] [DEBUG] [LOCAL ] CAPL: Primary data saved (5642 records). [2025-10-15T17:54:15.818268] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-15T17:54:15.818346] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 28.9s. Estimated remaining: 4h 32m 27s. Rate: 7.3 symbols/min [2025-10-15T17:54:15.983215] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:15.991670] [DEBUG] [LOCAL ] CATO: Loaded 6737 existing records from primary storage. [2025-10-15T17:54:15.991867] [INFO ] [MAIN ] CATO: Loaded 6737 existing records. [2025-10-15T17:54:16.125583] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-15T17:54:16.166932] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:16.167163] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-15T17:54:16.167212] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-15T17:54:16.167389] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-15T17:54:16.167461] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-15T17:54:16.520286] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:16.744268] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:54:16.913991] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-15T17:54:17.366726] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T17:54:17.713999] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-15T17:54:18.514013] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-15T17:54:18.914570] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T17:54:18.952142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:54:19.303953] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T17:54:19.313965] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-15T17:54:19.914327] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T17:54:20.114050] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-15T17:54:20.690982] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T17:54:20.913999] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-15T17:54:21.714003] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-15T17:54:21.755176] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T17:54:22.514013] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-15T17:54:23.286323] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:54:23.313953] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-15T17:54:23.465221] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T17:54:23.984350] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T17:54:24.113996] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-15T17:54:24.914047] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-15T17:54:25.644256] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T17:54:25.714065] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-15T17:54:26.186518] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T17:54:26.514000] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-15T17:54:26.983670] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T17:54:27.314021] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-15T17:54:28.113998] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-15T17:54:28.163741] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T17:54:28.170552] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-15T17:54:28.170750] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-15T17:54:28.577468] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-15T17:54:28.577940] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-15T17:54:28.579107] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-15T17:54:28.579276] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-15T17:54:28.602072] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T17:54:28.610063] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53602 (keeping 200 days of data) [2025-10-15T17:54:28.711303] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T17:54:28.927492] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-15T17:54:28.951525] [DEBUG] [LOCAL ] CARR: Primary data saved (53602 records). [2025-10-15T17:54:28.951632] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-15T17:54:28.951744] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CARR took 37.4s. Estimated remaining: 4h 32m 44s. Rate: 7.2 symbols/min [2025-10-15T17:54:29.116941] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:29.117098] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-10-15T17:54:29.117134] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-10-15T17:54:29.117241] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-15T17:54:29.117282] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-15T17:54:29.117323] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-15T17:54:29.117355] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-15T17:54:29.469259] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:29.713990] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-15T17:54:29.752165] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:54:30.514013] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-15T17:54:31.313996] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-15T17:54:31.754681] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:54:31.760065] [INFO ] [REMOTE ] CARS: Full fetch complete (56246 records). [2025-10-15T17:54:31.760215] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-15T17:54:31.991343] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:54:32.115381] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-15T17:54:32.208784] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-15T17:54:32.208880] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-15T17:54:32.209599] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-15T17:54:32.209661] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-15T17:54:32.211103] [DEBUG] [LOCAL ] CARS: Trimmed 56246 records to 39797 (keeping 200 days of data) [2025-10-15T17:54:32.247117] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-15T17:54:32.485842] [DEBUG] [LOCAL ] CARS: Primary data saved (39797 records). [2025-10-15T17:54:32.486007] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-15T17:54:32.486090] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARS took 36.3s. Estimated remaining: 4h 32m 12s. Rate: 7.3 symbols/min [2025-10-15T17:54:32.651269] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:32.701857] [DEBUG] [LOCAL ] CB: Loaded 49935 existing records from primary storage. [2025-10-15T17:54:32.702204] [INFO ] [MAIN ] CB: Loaded 49935 existing records. [2025-10-15T17:54:32.873303] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:32.873524] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-15T17:54:32.873570] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-15T17:54:32.873788] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-15T17:54:32.873844] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-15T17:54:32.926170] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-15T17:54:33.223031] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:33.713997] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-15T17:54:34.375931] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T17:54:34.407505] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-15T17:54:34.513959] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-15T17:54:34.790492] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:54:35.313999] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-15T17:54:36.114002] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-15T17:54:36.533366] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T17:54:36.913977] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-15T17:54:37.186837] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:54:37.713979] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-15T17:54:37.832837] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T17:54:38.344394] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T17:54:38.345699] [INFO ] [REMOTE ] CATO: Full fetch complete (10963 records). [2025-10-15T17:54:38.345770] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-15T17:54:38.523336] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-15T17:54:38.703458] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-15T17:54:38.703588] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-15T17:54:38.703894] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-15T17:54:38.703955] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-15T17:54:38.704457] [DEBUG] [LOCAL ] CATO: Trimmed 10963 records to 6687 (keeping 200 days of data) [2025-10-15T17:54:38.741611] [DEBUG] [LOCAL ] CATO: Primary data saved (6687 records). [2025-10-15T17:54:38.741777] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-15T17:54:38.741864] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CATO took 22.9s. Estimated remaining: 4h 31m 53s. Rate: 7.3 symbols/min [2025-10-15T17:54:38.918329] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:38.930877] [DEBUG] [LOCAL ] CBAN: Loaded 10508 existing records from primary storage. [2025-10-15T17:54:38.931094] [INFO ] [MAIN ] CBAN: Loaded 10508 existing records. [2025-10-15T17:54:39.124770] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:39.125142] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-15T17:54:39.125233] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-15T17:54:39.125559] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-15T17:54:39.125791] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-15T17:54:39.267907] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-15T17:54:39.321560] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-15T17:54:39.546133] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:40.114047] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-15T17:54:40.762617] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-15T17:54:40.913996] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-15T17:54:41.016688] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T17:54:41.513713] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-15T17:54:41.714007] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-15T17:54:42.513969] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-15T17:54:42.770624] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T17:54:43.313988] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-15T17:54:43.344987] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T17:54:43.556351] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T17:54:44.113995] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-15T17:54:44.914028] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-15T17:54:45.081627] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:54:45.713992] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-15T17:54:46.343745] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T17:54:46.513964] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-15T17:54:46.764977] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T17:54:47.313984] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-15T17:54:47.513127] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-15T17:54:47.803620] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T17:54:48.113993] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-15T17:54:48.406161] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T17:54:48.897472] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T17:54:48.913972] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-15T17:54:49.713997] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-15T17:54:49.806568] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T17:54:50.514010] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-15T17:54:51.154759] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:54:51.277563] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T17:54:51.313981] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-15T17:54:52.114063] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-15T17:54:52.913988] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-15T17:54:52.934009] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T17:54:53.099542] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:54:53.714040] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-15T17:54:54.514036] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-15T17:54:55.140184] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T17:54:55.180083] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T17:54:55.279346] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T17:54:55.313971] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-15T17:54:56.034414] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:54:56.113958] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-15T17:54:56.914014] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-15T17:54:56.956019] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T17:54:57.714008] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-15T17:54:58.514007] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-15T17:54:59.028242] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-15T17:54:59.244837] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T17:54:59.246419] [INFO ] [REMOTE ] CBAN: Full fetch complete (16201 records). [2025-10-15T17:54:59.246488] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-15T17:54:59.314719] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-15T17:54:59.621614] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-15T17:54:59.621756] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-15T17:54:59.622237] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-15T17:54:59.622312] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-15T17:54:59.623068] [DEBUG] [LOCAL ] CBAN: Trimmed 16201 records to 10503 (keeping 200 days of data) [2025-10-15T17:54:59.717412] [DEBUG] [LOCAL ] CBAN: Primary data saved (10503 records). [2025-10-15T17:54:59.717686] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-15T17:54:59.717833] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CBAN took 21.0s. Estimated remaining: 4h 32m 48s. Rate: 7.2 symbols/min [2025-10-15T17:54:59.721205] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T17:55:00.114051] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-15T17:55:00.914102] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-15T17:55:01.082873] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:55:01.714035] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-15T17:55:02.152090] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:55:02.158404] [INFO ] [REMOTE ] CAT: Full fetch complete (76863 records). [2025-10-15T17:55:02.158572] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-15T17:55:02.543851] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-15T17:55:02.543949] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-15T17:55:02.544850] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-15T17:55:02.544917] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-15T17:55:02.546412] [DEBUG] [LOCAL ] CAT: Trimmed 76863 records to 52958 (keeping 200 days of data) [2025-10-15T17:55:02.881991] [DEBUG] [LOCAL ] CAT: Primary data saved (52958 records). [2025-10-15T17:55:02.882168] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-15T17:55:02.882335] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CAT took 56.2s. Estimated remaining: 4h 32m 14s. Rate: 7.2 symbols/min [2025-10-15T17:55:03.055548] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-15T17:55:03.068943] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-15T17:55:03.764748] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T17:55:03.775205] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-15T17:55:05.332900] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-15T17:55:05.339551] [INFO ] [REMOTE ] CAVA: Full fetch complete (77455 records). [2025-10-15T17:55:05.339750] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-15T17:55:05.881389] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-15T17:55:05.881831] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-15T17:55:05.884160] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-15T17:55:05.884412] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-15T17:55:05.930751] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T17:55:05.948070] [DEBUG] [LOCAL ] CAVA: Trimmed 77455 records to 53567 (keeping 200 days of data) [2025-10-15T17:55:05.948976] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-15T17:55:06.378755] [DEBUG] [LOCAL ] CAVA: Primary data saved (53567 records). [2025-10-15T17:55:06.379001] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-15T17:55:06.379160] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 37.4s. Estimated remaining: 4h 31m 42s. Rate: 7.3 symbols/min [2025-10-15T17:55:08.008310] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T17:55:08.020433] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-15T17:55:09.709924] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T17:55:09.722546] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-15T17:55:11.507627] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T17:55:11.514073] [INFO ] [REMOTE ] CB: Full fetch complete (72758 records). [2025-10-15T17:55:11.514232] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-15T17:55:11.907820] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-15T17:55:11.907902] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-15T17:55:11.908782] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-15T17:55:11.908847] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-15T17:55:11.910282] [DEBUG] [LOCAL ] CB: Trimmed 72758 records to 49940 (keeping 200 days of data) [2025-10-15T17:55:12.231165] [DEBUG] [LOCAL ] CB: Primary data saved (49940 records). [2025-10-15T17:55:12.231316] [INFO ] [MAIN ] CB: Full history saved. [2025-10-15T17:55:12.232308] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CB took 39.7s. Estimated remaining: 4h 31m 22s. Rate: 7.3 symbols/min [2025-10-15T17:55:12.810923] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.965372] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.928983] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.972503] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-15T17:55:12.972087] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.972764] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-15T17:55:12.973305] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-15T17:55:12.973387] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-15T17:55:12.973487] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-15T17:55:12.973677] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-15T17:55:13.030056] [DEBUG] [LOCAL ] CBNA: Loaded 2912 existing records from primary storage. [2025-10-15T17:55:13.065864] [INFO ] [MAIN ] CBNA: Loaded 2912 existing records. [2025-10-15T17:55:13.164550] [DEBUG] [LOCAL ] CBL: Loaded 16285 existing records from primary storage. [2025-10-15T17:55:13.192287] [INFO ] [MAIN ] CBL: Loaded 16285 existing records. [2025-10-15T17:55:13.506342] [DEBUG] [LOCAL ] CBRE: Loaded 50370 existing records from primary storage. [2025-10-15T17:55:13.599354] [INFO ] [MAIN ] CBRE: Loaded 50370 existing records. [2025-10-15T17:55:13.714251] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:13.765346] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-15T17:55:13.892684] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-15T17:55:13.954703] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:13.964827] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-15T17:55:13.968087] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-15T17:55:13.967848] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:13.967907] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-15T17:55:13.969108] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-15T17:55:13.969035] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-15T17:55:13.979684] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-15T17:55:14.014584] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-15T17:55:14.214568] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:14.262551] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-15T17:55:14.295905] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-15T17:55:14.375832] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-15T17:55:14.478149] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-15T17:55:14.889049] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:14.958936] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:14.959208] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-15T17:55:14.969873] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-15T17:55:15.228208] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:15.228538] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-15T17:55:15.915398] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:55:15.917120] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-15T17:55:16.137001] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T17:55:16.144614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-15T17:55:16.299444] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-15T17:55:16.301786] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-15T17:55:16.767412] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:55:16.768813] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-15T17:55:16.810023] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:55:16.821063] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-15T17:55:17.138572] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:55:17.145174] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-15T17:55:17.157509] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T17:55:17.158742] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-15T17:55:17.623555] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T17:55:17.625190] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-15T17:55:17.941274] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:55:17.945427] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-15T17:55:18.084722] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:55:18.095547] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-15T17:55:18.972117] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T17:55:18.976598] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-15T17:55:19.564962] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:55:19.565273] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-15T17:55:19.565376] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:55:19.565468] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-15T17:55:19.565548] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:55:19.565636] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-15T17:55:19.565748] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-15T17:55:19.565790] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-15T17:55:19.565833] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-15T17:55:19.565881] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 7.3s. Estimated remaining: 4h 31m 9s. Rate: 7.3 symbols/min [2025-10-15T17:55:19.771397] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:55:19.774686] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:19.785034] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-15T17:55:19.815603] [DEBUG] [LOCAL ] CBT: Loaded 31069 existing records from primary storage. [2025-10-15T17:55:19.815952] [INFO ] [MAIN ] CBT: Loaded 31069 existing records. [2025-10-15T17:55:19.950223] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T17:55:20.004471] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:20.006382] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-15T17:55:20.007457] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-15T17:55:20.007734] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-15T17:55:20.008082] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-15T17:55:20.008139] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-15T17:55:20.315781] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T17:55:20.359337] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-15T17:55:20.385773] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:20.613115] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:55:20.914004] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-15T17:55:21.315078] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:55:21.355919] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T17:55:21.367070] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T17:55:21.714014] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-15T17:55:21.815293] [DEBUG] [REMOTE ] CBT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T17:55:21.815631] [WARN ] [REMOTE ] CBT: No data returned for month 2024-12 [2025-10-15T17:55:21.815737] [FATAL] [REMOTE ] CBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:55:21.815816] [FATAL] [MAIN ] CBT: Failed to fetch primary data. [2025-10-15T17:55:21.815893] [WARN ] [MAIN ] CBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:55:21.816169] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-15T17:55:21.816250] [DEBUG] [LOCAL ] CBT: No primary data file found to delete. [2025-10-15T17:55:21.816301] [INFO ] [LOCAL ] CBT: Starting deletion of derivative data. [2025-10-15T17:55:21.816490] [DEBUG] [LOCAL ] CBT: Deleted derivative data file. [2025-10-15T17:55:21.816606] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBT took 2.3s. Estimated remaining: 4h 30m 32s. Rate: 7.3 symbols/min [2025-10-15T17:55:21.985180] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:22.005928] [DEBUG] [LOCAL ] CBU: Loaded 22672 existing records from primary storage. [2025-10-15T17:55:22.006146] [INFO ] [MAIN ] CBU: Loaded 22672 existing records. [2025-10-15T17:55:22.177908] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:22.178084] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-15T17:55:22.178163] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-15T17:55:22.178375] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-15T17:55:22.178432] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-15T17:55:22.523852] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:22.519484] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-15T17:55:23.144787] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T17:55:23.314000] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-15T17:55:24.114011] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-15T17:55:24.552816] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:55:24.913986] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-15T17:55:25.274034] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:55:25.341737] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T17:55:25.714012] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-15T17:55:26.229570] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:55:26.513998] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-15T17:55:27.313983] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-15T17:55:27.653232] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T17:55:28.114047] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-15T17:55:28.820108] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T17:55:28.914026] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-15T17:55:29.669148] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:55:29.714046] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-15T17:55:29.931668] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:55:30.513989] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-15T17:55:31.298525] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:55:31.313941] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-15T17:55:31.340556] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:55:32.113994] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-15T17:55:32.900557] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:55:32.903433] [INFO ] [REMOTE ] CBL: Full fetch complete (25204 records). [2025-10-15T17:55:32.903631] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-15T17:55:32.919094] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-15T17:55:33.124952] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:55:33.320794] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-15T17:55:33.320873] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-15T17:55:33.321490] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-15T17:55:33.321551] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-15T17:55:33.322164] [DEBUG] [LOCAL ] CBL: Trimmed 25204 records to 16293 (keeping 200 days of data) [2025-10-15T17:55:33.417506] [DEBUG] [LOCAL ] CBL: Primary data saved (16293 records). [2025-10-15T17:55:33.420589] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-15T17:55:33.420702] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 21.2s. Estimated remaining: 4h 30m 40s. Rate: 7.3 symbols/min [2025-10-15T17:55:33.585356] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:33.585523] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-15T17:55:33.585579] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-15T17:55:33.585711] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-15T17:55:33.585776] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-15T17:55:33.585820] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-15T17:55:33.585854] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-15T17:55:33.721880] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-15T17:55:33.937247] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:33.977724] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:55:34.513988] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-15T17:55:35.313955] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-15T17:55:35.502058] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:55:35.502359] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-15T17:55:35.502446] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:55:35.502491] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-15T17:55:35.502550] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:55:35.502619] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-15T17:55:35.502716] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-15T17:55:35.502761] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-15T17:55:35.502802] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-15T17:55:35.502848] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBX took 2.1s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-15T17:55:35.676358] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:35.693278] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T17:55:35.731952] [DEBUG] [LOCAL ] CBZ: Loaded 34151 existing records from primary storage. [2025-10-15T17:55:35.732261] [INFO ] [MAIN ] CBZ: Loaded 34151 existing records. [2025-10-15T17:55:35.911626] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:35.911863] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-15T17:55:35.911911] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-15T17:55:35.912136] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-15T17:55:35.912204] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-15T17:55:36.115709] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-15T17:55:36.142789] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-15T17:55:36.334761] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:36.914036] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-15T17:55:37.318230] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T17:55:37.713975] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-15T17:55:38.212226] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T17:55:38.213084] [INFO ] [REMOTE ] CBNA: Full fetch complete (4407 records). [2025-10-15T17:55:38.213151] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-15T17:55:38.516130] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-15T17:55:38.610638] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-15T17:55:38.610803] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-15T17:55:38.610999] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-15T17:55:38.611042] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-15T17:55:38.611843] [DEBUG] [LOCAL ] CBNA: Trimmed 4407 records to 2920 (keeping 200 days of data) [2025-10-15T17:55:38.644671] [DEBUG] [LOCAL ] CBNA: Primary data saved (2920 records). [2025-10-15T17:55:38.656214] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-15T17:55:38.656374] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBNA took 26.4s. Estimated remaining: 4h 29m 28s. Rate: 7.3 symbols/min [2025-10-15T17:55:38.727425] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T17:55:38.836862] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:38.888082] [DEBUG] [LOCAL ] CC: Loaded 53008 existing records from primary storage. [2025-10-15T17:55:38.888427] [INFO ] [MAIN ] CC: Loaded 53008 existing records. [2025-10-15T17:55:39.061869] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:39.062085] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-15T17:55:39.062131] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-15T17:55:39.062531] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-15T17:55:39.062569] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-15T17:55:39.314159] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-15T17:55:39.419934] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:39.708887] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T17:55:40.113993] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-15T17:55:40.914024] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-15T17:55:41.220534] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-15T17:55:41.226751] [INFO ] [REMOTE ] CBRE: Full fetch complete (73854 records). [2025-10-15T17:55:41.226871] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-15T17:55:41.624119] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:55:41.652769] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-15T17:55:41.652835] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-15T17:55:41.653703] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-15T17:55:41.653765] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-15T17:55:41.655106] [DEBUG] [LOCAL ] CBRE: Trimmed 73854 records to 50361 (keeping 200 days of data) [2025-10-15T17:55:41.715284] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-15T17:55:41.950348] [DEBUG] [LOCAL ] CBRE: Primary data saved (50361 records). [2025-10-15T17:55:41.950485] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-15T17:55:41.950563] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBRE took 29.7s. Estimated remaining: 4h 28m 56s. Rate: 7.3 symbols/min [2025-10-15T17:55:42.122379] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:42.175194] [DEBUG] [LOCAL ] CCI: Loaded 53124 existing records from primary storage. [2025-10-15T17:55:42.175499] [INFO ] [MAIN ] CCI: Loaded 53124 existing records. [2025-10-15T17:55:42.357018] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:42.357418] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-15T17:55:42.357467] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-15T17:55:42.357789] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-15T17:55:42.357851] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-15T17:55:42.515546] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-15T17:55:42.735862] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:42.755762] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:55:42.777917] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T17:55:43.314023] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-15T17:55:43.610165] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:55:44.114019] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-15T17:55:44.135578] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T17:55:44.914033] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-15T17:55:45.332207] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:55:45.713987] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-15T17:55:46.513963] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-15T17:55:46.613374] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:55:46.647564] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:55:47.313973] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-15T17:55:47.712843] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T17:55:48.114025] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-15T17:55:48.799910] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T17:55:48.913998] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-15T17:55:49.186230] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:55:49.714080] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-15T17:55:50.400514] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T17:55:50.513994] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-15T17:55:51.314026] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-15T17:55:51.542457] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:55:51.977490] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T17:55:52.114010] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-15T17:55:52.161702] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:55:52.914044] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-15T17:55:53.714075] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-15T17:55:53.979122] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T17:55:54.517184] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-15T17:55:54.522464] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:55:54.935907] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:55:55.314059] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-15T17:55:55.414135] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:55:55.417343] [INFO ] [REMOTE ] CBU: Full fetch complete (32441 records). [2025-10-15T17:55:55.417436] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-15T17:55:55.783732] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-15T17:55:55.783812] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-15T17:55:55.784350] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-15T17:55:55.784389] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-15T17:55:55.785196] [DEBUG] [LOCAL ] CBU: Trimmed 32441 records to 22717 (keeping 200 days of data) [2025-10-15T17:55:55.921712] [DEBUG] [LOCAL ] CBU: Primary data saved (22717 records). [2025-10-15T17:55:55.921848] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-15T17:55:55.921951] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 34.1s. Estimated remaining: 4h 29m 16s. Rate: 7.3 symbols/min [2025-10-15T17:55:56.101559] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:56.102274] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-15T17:55:56.102318] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-15T17:55:56.102490] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-15T17:55:56.102559] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-15T17:55:56.102631] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-15T17:55:56.102711] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-15T17:55:56.119200] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-15T17:55:56.489582] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:56.914058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-15T17:55:57.502976] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T17:55:57.714015] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-15T17:55:58.096589] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T17:55:58.305735] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:55:58.514066] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-15T17:55:59.314058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-15T17:55:59.483891] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:56:00.011154] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:56:00.114002] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-15T17:56:00.767017] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:56:00.913966] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-15T17:56:01.713988] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-15T17:56:02.011423] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T17:56:02.297834] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:56:02.514021] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-15T17:56:03.150727] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T17:56:03.313971] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-15T17:56:03.930609] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T17:56:03.934633] [INFO ] [REMOTE ] CBZ: Full fetch complete (45745 records). [2025-10-15T17:56:03.934775] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-15T17:56:03.935362] [FATAL] [VALIDATOR ] CBZ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:56:03.935449] [FATAL] [MAIN ] CBZ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:56:03.935492] [WARN ] [MAIN ] CBZ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:56:03.935530] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-15T17:56:03.935626] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-15T17:56:03.935712] [INFO ] [LOCAL ] CBZ: Starting deletion of derivative data. [2025-10-15T17:56:03.935945] [DEBUG] [LOCAL ] CBZ: Deleted derivative data file. [2025-10-15T17:56:03.936257] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBZ took 28.4s. Estimated remaining: 4h 29m 7s. Rate: 7.3 symbols/min [2025-10-15T17:56:04.106273] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:04.106445] [DEBUG] [LOCAL ] CCIF: No existing data file found in primary storage. [2025-10-15T17:56:04.106483] [WARN ] [MAIN ] CCIF: No existing data found, performing full refresh instead. [2025-10-15T17:56:04.106595] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-15T17:56:04.106637] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-15T17:56:04.106725] [DEBUG] [LOCAL ] CCIF: No primary data file found to delete. [2025-10-15T17:56:04.106761] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-15T17:56:04.119362] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-15T17:56:04.453251] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:04.914005] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-15T17:56:04.999521] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T17:56:05.345822] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T17:56:05.713967] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-15T17:56:06.147534] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T17:56:06.196420] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:56:06.514060] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-15T17:56:07.314062] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-15T17:56:08.114023] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-15T17:56:08.149774] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:56:08.440021] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T17:56:08.914014] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-15T17:56:09.141692] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:56:09.714073] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-15T17:56:10.060459] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-15T17:56:10.513998] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-15T17:56:10.693565] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T17:56:10.851142] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T17:56:11.314032] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-15T17:56:11.780710] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T17:56:12.114042] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-15T17:56:12.437343] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T17:56:12.914000] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-15T17:56:13.273485] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T17:56:13.713992] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-15T17:56:14.513985] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-15T17:56:15.314040] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-15T17:56:15.365260] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:56:15.790443] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T17:56:15.884409] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T17:56:16.113995] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-15T17:56:16.914049] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-15T17:56:17.016971] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T17:56:17.265636] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T17:56:17.714052] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-15T17:56:18.232044] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T17:56:18.233675] [INFO ] [REMOTE ] CCIA: Full fetch complete (2158 records). [2025-10-15T17:56:18.233766] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-15T17:56:18.431528] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T17:56:18.431801] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:56:18.431886] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:56:18.431948] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-15T17:56:18.432015] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-15T17:56:18.432052] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-15T17:56:18.432096] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-15T17:56:18.432314] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CCIA took 22.5s. Estimated remaining: 4h 29m 28s. Rate: 7.3 symbols/min [2025-10-15T17:56:18.519151] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-15T17:56:18.621916] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:18.680575] [DEBUG] [LOCAL ] CCJ: Loaded 53686 existing records from primary storage. [2025-10-15T17:56:18.681105] [INFO ] [MAIN ] CCJ: Loaded 53686 existing records. [2025-10-15T17:56:18.866825] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:18.867102] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-15T17:56:18.867155] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-15T17:56:18.867449] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-15T17:56:18.867489] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-15T17:56:19.243886] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:19.314056] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-15T17:56:20.114013] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-15T17:56:20.570675] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:56:20.913959] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-15T17:56:20.913882] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:56:21.065730] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T17:56:21.714001] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-15T17:56:22.513974] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-15T17:56:22.688751] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T17:56:22.695142] [INFO ] [REMOTE ] CCI: Full fetch complete (77106 records). [2025-10-15T17:56:22.695307] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-15T17:56:23.099636] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-15T17:56:23.099744] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-15T17:56:23.100734] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-15T17:56:23.100799] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-15T17:56:23.102378] [DEBUG] [LOCAL ] CCI: Trimmed 77106 records to 53117 (keeping 200 days of data) [2025-10-15T17:56:23.322835] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-15T17:56:23.430128] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T17:56:23.457713] [DEBUG] [LOCAL ] CCI: Primary data saved (53117 records). [2025-10-15T17:56:23.457837] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-15T17:56:23.459130] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCI took 41.5s. Estimated remaining: 4h 29m 5s. Rate: 7.3 symbols/min [2025-10-15T17:56:23.652748] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:23.665117] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T17:56:23.672880] [INFO ] [REMOTE ] CC: Full fetch complete (76047 records). [2025-10-15T17:56:23.673090] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-15T17:56:24.013044] [DEBUG] [LOCAL ] CCK: Loaded 46416 existing records from primary storage. [2025-10-15T17:56:24.028985] [INFO ] [MAIN ] CCK: Loaded 46416 existing records. [2025-10-15T17:56:24.126871] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-15T17:56:24.217662] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-15T17:56:24.217820] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-15T17:56:24.218835] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-15T17:56:24.218915] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-15T17:56:24.278034] [DEBUG] [LOCAL ] CC: Trimmed 76047 records to 53013 (keeping 200 days of data) [2025-10-15T17:56:24.297932] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:24.298334] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-15T17:56:24.298393] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-15T17:56:24.299001] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-15T17:56:24.299058] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-15T17:56:24.778519] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:24.916538] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-15T17:56:24.997502] [DEBUG] [LOCAL ] CC: Primary data saved (53013 records). [2025-10-15T17:56:24.997684] [INFO ] [MAIN ] CC: Full history saved. [2025-10-15T17:56:24.997777] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CC took 46.3s. Estimated remaining: 4h 28m 25s. Rate: 7.3 symbols/min [2025-10-15T17:56:25.186679] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:25.188075] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T17:56:25.224573] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T17:56:25.280725] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-15T17:56:25.281052] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-15T17:56:25.455884] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:25.456129] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-15T17:56:25.456179] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-15T17:56:25.456507] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-15T17:56:25.456563] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-15T17:56:25.719137] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-15T17:56:25.841938] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:26.365940] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:56:26.513977] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-15T17:56:26.884248] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:56:27.314048] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-15T17:56:28.113994] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-15T17:56:28.370841] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T17:56:28.857621] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T17:56:28.913995] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-15T17:56:29.467310] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T17:56:29.713986] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-15T17:56:29.868535] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T17:56:30.514009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-15T17:56:31.314001] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-15T17:56:31.884797] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:56:32.114080] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-15T17:56:32.287702] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-15T17:56:32.368934] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T17:56:32.914012] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-15T17:56:33.714031] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-15T17:56:34.120090] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T17:56:34.507520] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:56:34.517227] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-15T17:56:35.255375] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T17:56:35.313959] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-15T17:56:35.774501] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T17:56:36.097315] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T17:56:36.099344] [INFO ] [REMOTE ] CCIF: Full fetch complete (21883 records). [2025-10-15T17:56:36.099418] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-15T17:56:36.122257] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-15T17:56:36.520408] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-15T17:56:36.520526] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-15T17:56:36.521192] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-15T17:56:36.521258] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-15T17:56:36.522131] [DEBUG] [LOCAL ] CCIF: Trimmed 21883 records to 15528 (keeping 200 days of data) [2025-10-15T17:56:36.614576] [DEBUG] [LOCAL ] CCIF: Primary data saved (15528 records). [2025-10-15T17:56:36.614751] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-15T17:56:36.614831] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCIF took 32.7s. Estimated remaining: 4h 28m 32s. Rate: 7.3 symbols/min [2025-10-15T17:56:36.779950] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:36.828286] [DEBUG] [LOCAL ] CCO: Loaded 48290 existing records from primary storage. [2025-10-15T17:56:36.828632] [INFO ] [MAIN ] CCO: Loaded 48290 existing records. [2025-10-15T17:56:36.924125] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-15T17:56:37.007070] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:37.007246] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-15T17:56:37.007305] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-15T17:56:37.007677] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-15T17:56:37.007734] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-15T17:56:37.354505] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:37.713964] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-15T17:56:37.921020] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:56:38.513957] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-15T17:56:38.560484] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:56:39.234036] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:56:39.313988] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-15T17:56:40.114020] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-15T17:56:40.480761] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:56:40.914032] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-15T17:56:41.514183] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T17:56:41.713976] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-15T17:56:42.513988] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-15T17:56:43.258070] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:56:43.313961] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-15T17:56:43.385796] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-15T17:56:43.472638] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T17:56:44.113986] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-15T17:56:44.914055] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-15T17:56:45.632780] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:56:45.713975] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-15T17:56:46.148338] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (7.63 seconds). [2025-10-15T17:56:46.514063] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-15T17:56:47.163774] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-15T17:56:47.238743] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (3.92 seconds). [2025-10-15T17:56:47.287510] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:56:47.314002] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-15T17:56:48.113995] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-15T17:56:48.566099] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T17:56:48.887542] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T17:56:48.913946] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-15T17:56:49.714022] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-15T17:56:50.521064] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-15T17:56:50.541289] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:56:50.897910] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-15T17:56:51.289092] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T17:56:51.314009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-15T17:56:52.114016] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-15T17:56:52.814205] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:56:52.881103] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:56:52.913993] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-15T17:56:53.714054] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-15T17:56:54.513994] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-15T17:56:55.000701] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-15T17:56:55.314021] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-15T17:56:55.394623] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-10-15T17:56:56.058977] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:56:56.113963] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-15T17:56:56.500631] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-15T17:56:56.914037] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-15T17:56:57.491401] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T17:56:57.713990] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-15T17:56:58.514100] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-15T17:56:59.814357] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-15T17:56:59.824893] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-15T17:57:00.078469] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:57:00.085097] [INFO ] [REMOTE ] CCK: Full fetch complete (67760 records). [2025-10-15T17:57:00.085238] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-15T17:57:00.178123] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-15T17:57:00.222881] [INFO ] [REMOTE ] CCJ: Full fetch complete (77837 records). [2025-10-15T17:57:00.256619] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-15T17:57:00.731134] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-15T17:57:00.752040] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-15T17:57:00.753131] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-15T17:57:00.777046] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-15T17:57:00.847207] [DEBUG] [LOCAL ] CCK: Trimmed 67760 records to 46451 (keeping 200 days of data) [2025-10-15T17:57:00.925227] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-15T17:57:00.925418] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-15T17:57:00.926186] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-15T17:57:00.926277] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-15T17:57:00.928080] [DEBUG] [LOCAL ] CCJ: Trimmed 77837 records to 53688 (keeping 200 days of data) [2025-10-15T17:57:01.488946] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:57:01.562043] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-15T17:57:01.561361] [DEBUG] [LOCAL ] CCK: Primary data saved (46451 records). [2025-10-15T17:57:01.563815] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-15T17:57:01.564837] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCK took 38.1s. Estimated remaining: 4h 29m 43s. Rate: 7.3 symbols/min [2025-10-15T17:57:01.811457] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:01.807911] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (5.69 seconds). [2025-10-15T17:57:01.827220] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-15T17:57:01.832121] [DEBUG] [LOCAL ] CCJ: Primary data saved (53688 records). [2025-10-15T17:57:01.834711] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-15T17:57:01.834914] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCJ took 43.4s. Estimated remaining: 4h 28m 57s. Rate: 7.3 symbols/min [2025-10-15T17:57:01.940208] [DEBUG] [LOCAL ] CCRD: Loaded 9483 existing records from primary storage. [2025-10-15T17:57:01.946092] [INFO ] [MAIN ] CCRD: Loaded 9483 existing records. [2025-10-15T17:57:02.116116] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:02.202862] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:02.203202] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-15T17:57:02.203294] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-15T17:57:02.203583] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-15T17:57:02.203676] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-15T17:57:02.382111] [DEBUG] [LOCAL ] CCS: Loaded 30327 existing records from primary storage. [2025-10-15T17:57:02.450597] [INFO ] [MAIN ] CCS: Loaded 30327 existing records. [2025-10-15T17:57:02.799993] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:02.806912] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-15T17:57:02.806732] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:02.807110] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-15T17:57:02.807481] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-15T17:57:02.807568] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-15T17:57:02.808907] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-15T17:57:03.186545] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:57:03.225550] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:03.226815] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-15T17:57:03.228056] [INFO ] [REMOTE ] CCO: Full fetch complete (67086 records). [2025-10-15T17:57:03.228283] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-15T17:57:03.663568] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-15T17:57:03.663723] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-15T17:57:03.665031] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-15T17:57:03.665103] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-15T17:57:03.667054] [DEBUG] [LOCAL ] CCO: Trimmed 67086 records to 48392 (keeping 200 days of data) [2025-10-15T17:57:03.950849] [DEBUG] [LOCAL ] CCO: Primary data saved (48392 records). [2025-10-15T17:57:03.951050] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-15T17:57:03.951327] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCO took 27.3s. Estimated remaining: 4h 28m 20s. Rate: 7.3 symbols/min [2025-10-15T17:57:04.130426] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:04.168225] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-15T17:57:04.180402] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-15T17:57:04.202461] [DEBUG] [LOCAL ] CCU: Loaded 22426 existing records from primary storage. [2025-10-15T17:57:04.202889] [INFO ] [MAIN ] CCU: Loaded 22426 existing records. [2025-10-15T17:57:04.307738] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:57:04.337986] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-15T17:57:04.430383] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:04.431205] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-15T17:57:04.431422] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-15T17:57:04.437495] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-15T17:57:04.446859] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-15T17:57:04.453531] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:57:04.847131] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:04.849167] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T17:57:04.913972] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-15T17:57:05.714025] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-15T17:57:06.450884] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:57:06.514009] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-15T17:57:06.577095] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-15T17:57:07.014889] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:57:07.266685] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:57:07.314017] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-15T17:57:08.114071] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-15T17:57:08.751804] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:57:08.877182] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:57:08.914038] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-15T17:57:09.372355] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T17:57:09.714072] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-15T17:57:10.514002] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-15T17:57:10.752363] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:57:11.314091] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-15T17:57:11.876756] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T17:57:12.114045] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-15T17:57:12.914498] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-15T17:57:12.914411] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-15T17:57:12.923138] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-15T17:57:12.923327] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-15T17:57:13.097387] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T17:57:13.364264] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-15T17:57:13.364383] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-15T17:57:13.365543] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-15T17:57:13.365614] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-15T17:57:13.367913] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-15T17:57:13.693976] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-15T17:57:13.694125] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-15T17:57:13.694206] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCL took 48.7s. Estimated remaining: 4h 28m 19s. Rate: 7.3 symbols/min [2025-10-15T17:57:13.723168] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-15T17:57:13.877103] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:13.877273] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-15T17:57:13.877309] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-15T17:57:13.877419] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-15T17:57:13.877465] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-15T17:57:13.877506] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-15T17:57:13.877537] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-15T17:57:14.252241] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:14.309429] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:57:14.514091] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-15T17:57:14.535049] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T17:57:15.314064] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-15T17:57:15.900569] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T17:57:16.093053] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T17:57:16.114022] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-15T17:57:16.914077] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-15T17:57:17.572367] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T17:57:17.714041] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-15T17:57:18.195885] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:57:18.514021] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-15T17:57:18.934766] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:57:19.314020] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-15T17:57:19.483445] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T17:57:19.923941] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T17:57:20.114000] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-15T17:57:20.914002] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-15T17:57:21.335939] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T17:57:21.406414] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:57:21.714013] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-15T17:57:22.514010] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-15T17:57:22.643483] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:57:22.645040] [INFO ] [REMOTE ] CCRD: Full fetch complete (11904 records). [2025-10-15T17:57:22.645111] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-15T17:57:22.995449] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-15T17:57:22.995524] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-15T17:57:22.995829] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-15T17:57:22.995891] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-15T17:57:22.996348] [DEBUG] [LOCAL ] CCRD: Trimmed 11904 records to 9504 (keeping 200 days of data) [2025-10-15T17:57:23.051850] [DEBUG] [LOCAL ] CCRD: Primary data saved (9504 records). [2025-10-15T17:57:23.051990] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-15T17:57:23.052073] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCRD took 21.5s. Estimated remaining: 4h 28m 16s. Rate: 7.3 symbols/min [2025-10-15T17:57:23.227348] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:23.286998] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-15T17:57:23.287486] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-15T17:57:23.320374] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-15T17:57:23.486757] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:23.487085] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-15T17:57:23.487177] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-15T17:57:23.487720] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-15T17:57:23.487780] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-15T17:57:23.629955] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T17:57:23.687312] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:57:23.938203] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:24.113998] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-15T17:57:24.336635] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-15T17:57:24.914005] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-15T17:57:25.152538] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-15T17:57:25.714009] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-15T17:57:26.514026] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-15T17:57:27.313969] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-15T17:57:27.679740] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T17:57:27.686308] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T17:57:27.828458] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:57:28.113998] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-15T17:57:28.914080] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-15T17:57:29.172385] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-15T17:57:29.499610] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:57:29.714007] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-15T17:57:29.941853] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:57:29.942231] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-15T17:57:29.942346] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:57:29.942469] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-15T17:57:29.942561] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:57:29.942675] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-15T17:57:29.942777] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-15T17:57:29.942844] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-15T17:57:29.942910] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-15T17:57:29.942982] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCZ took 16.2s. Estimated remaining: 4h 28m 1s. Rate: 7.3 symbols/min [2025-10-15T17:57:30.124565] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:30.137344] [DEBUG] [LOCAL ] CDLR: Loaded 10012 existing records from primary storage. [2025-10-15T17:57:30.137589] [INFO ] [MAIN ] CDLR: Loaded 10012 existing records. [2025-10-15T17:57:30.317141] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:30.317462] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-15T17:57:30.317528] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-15T17:57:30.317799] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-15T17:57:30.317857] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-15T17:57:30.522280] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-15T17:57:30.753277] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:31.314003] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-15T17:57:31.878440] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T17:57:32.114041] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-15T17:57:32.913972] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-15T17:57:33.022220] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:57:33.316338] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T17:57:33.319935] [INFO ] [REMOTE ] CCS: Full fetch complete (44881 records). [2025-10-15T17:57:33.320014] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-15T17:57:33.671524] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T17:57:33.705522] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-15T17:57:33.705583] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-15T17:57:33.706215] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-15T17:57:33.706275] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-15T17:57:33.707163] [DEBUG] [LOCAL ] CCS: Trimmed 44881 records to 30343 (keeping 200 days of data) [2025-10-15T17:57:33.759194] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-15T17:57:33.890728] [DEBUG] [LOCAL ] CCS: Primary data saved (30343 records). [2025-10-15T17:57:33.890875] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-15T17:57:33.890959] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCS took 32.1s. Estimated remaining: 4h 27m 33s. Rate: 7.3 symbols/min [2025-10-15T17:57:34.058365] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:34.095276] [DEBUG] [LOCAL ] CDP: Loaded 42524 existing records from primary storage. [2025-10-15T17:57:34.095566] [INFO ] [MAIN ] CDP: Loaded 42524 existing records. [2025-10-15T17:57:34.268506] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:34.268721] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-15T17:57:34.268776] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-15T17:57:34.269595] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-15T17:57:34.269685] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-15T17:57:34.522528] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-15T17:57:34.528499] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T17:57:34.627590] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:35.314048] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-15T17:57:35.554154] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T17:57:36.114021] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-15T17:57:36.725424] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:57:36.914026] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-15T17:57:37.714045] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-15T17:57:38.039853] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:57:38.083935] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T17:57:38.234317] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:57:38.514036] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-15T17:57:39.314037] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-15T17:57:39.455199] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T17:57:40.114025] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-15T17:57:40.914033] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-15T17:57:41.263006] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T17:57:41.299301] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T17:57:41.713960] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-15T17:57:41.971497] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T17:57:42.514018] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-15T17:57:43.283945] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:57:43.313962] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-15T17:57:43.452941] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:57:43.836935] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T17:57:44.114019] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-15T17:57:44.914013] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-15T17:57:45.674595] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:57:45.713985] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-15T17:57:45.788799] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T17:57:46.514013] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-15T17:57:47.314061] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-15T17:57:47.360783] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:57:47.515898] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:57:47.518363] [INFO ] [REMOTE ] CCU: Full fetch complete (32410 records). [2025-10-15T17:57:47.518463] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-15T17:57:47.898285] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-15T17:57:47.898365] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-15T17:57:47.898999] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-15T17:57:47.899062] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-15T17:57:47.899795] [DEBUG] [LOCAL ] CCU: Trimmed 32410 records to 22294 (keeping 200 days of data) [2025-10-15T17:57:48.042061] [DEBUG] [LOCAL ] CCU: Primary data saved (22294 records). [2025-10-15T17:57:48.043325] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-15T17:57:48.043493] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCU took 44.1s. Estimated remaining: 4h 27m 52s. Rate: 7.3 symbols/min [2025-10-15T17:57:48.043208] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T17:57:48.119173] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-15T17:57:48.222609] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:48.245028] [DEBUG] [LOCAL ] CDRE: Loaded 24873 existing records from primary storage. [2025-10-15T17:57:48.245310] [INFO ] [MAIN ] CDRE: Loaded 24873 existing records. [2025-10-15T17:57:48.419809] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:48.420100] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-15T17:57:48.420164] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-15T17:57:48.420718] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-15T17:57:48.420778] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-15T17:57:48.791138] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:48.914062] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-15T17:57:49.714023] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-15T17:57:50.451601] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T17:57:50.513988] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-15T17:57:50.737381] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:57:51.048691] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T17:57:51.313999] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-15T17:57:52.114002] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-15T17:57:52.350231] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T17:57:52.448827] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:57:52.914033] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-15T17:57:53.345818] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:57:53.540923] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T17:57:53.713981] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-15T17:57:54.514011] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-15T17:57:54.573932] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T17:57:55.314007] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-15T17:57:55.971156] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T17:57:55.997546] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:57:56.114038] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-15T17:57:56.914016] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-15T17:57:57.330693] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:57:57.714016] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-15T17:57:58.045852] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T17:57:58.513972] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-15T17:57:58.581989] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T17:57:59.314024] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-15T17:57:59.618915] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T17:58:00.114056] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-15T17:58:00.914078] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-15T17:58:01.084430] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T17:58:01.412306] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T17:58:01.714063] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-15T17:58:02.408929] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:58:02.514052] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-15T17:58:03.314089] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-15T17:58:03.674848] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T17:58:03.932621] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T17:58:04.114050] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-15T17:58:04.692147] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:58:04.914013] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-15T17:58:05.714007] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-15T17:58:05.941233] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T17:58:05.943487] [INFO ] [REMOTE ] CDLR: Full fetch complete (13860 records). [2025-10-15T17:58:05.943667] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-15T17:58:06.310634] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-15T17:58:06.310946] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-15T17:58:06.311600] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-15T17:58:06.311775] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-15T17:58:06.312636] [DEBUG] [LOCAL ] CDLR: Trimmed 13860 records to 10075 (keeping 200 days of data) [2025-10-15T17:58:06.374776] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-15T17:58:06.392975] [INFO ] [REMOTE ] CDE: Full fetch complete (77771 records). [2025-10-15T17:58:06.397480] [DEBUG] [LOCAL ] CDLR: Primary data saved (10075 records). [2025-10-15T17:58:06.397965] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-15T17:58:06.397875] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-15T17:58:06.398264] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CDLR took 36.5s. Estimated remaining: 4h 28m 31s. Rate: 7.3 symbols/min [2025-10-15T17:58:06.524903] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-15T17:58:06.761772] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:06.802196] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:58:07.032205] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-15T17:58:07.047102] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-15T17:58:07.048250] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-15T17:58:07.048412] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-15T17:58:07.050011] [DEBUG] [LOCAL ] CDE: Trimmed 77771 records to 53643 (keeping 200 days of data) [2025-10-15T17:58:07.123917] [DEBUG] [LOCAL ] CE: Loaded 51362 existing records from primary storage. [2025-10-15T17:58:07.157833] [INFO ] [MAIN ] CE: Loaded 51362 existing records. [2025-10-15T17:58:07.320275] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-15T17:58:07.475830] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:07.477585] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-15T17:58:07.480989] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-15T17:58:07.523183] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-15T17:58:07.529686] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-15T17:58:07.759957] [DEBUG] [LOCAL ] CDE: Primary data saved (53643 records). [2025-10-15T17:58:07.831368] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-15T17:58:07.850294] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDE took 44.8s. Estimated remaining: 4h 27m 51s. Rate: 7.3 symbols/min [2025-10-15T17:58:08.079822] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:08.138059] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:08.118130] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-15T17:58:08.146689] [DEBUG] [LOCAL ] CEE: Loaded 5395 existing records from primary storage. [2025-10-15T17:58:08.146930] [INFO ] [MAIN ] CEE: Loaded 5395 existing records. [2025-10-15T17:58:08.349408] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:08.350633] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-15T17:58:08.366680] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-15T17:58:08.379842] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:58:08.379905] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-15T17:58:08.389878] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-15T17:58:08.642184] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:58:08.782078] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:08.914019] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-15T17:58:09.714027] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-15T17:58:09.924279] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:58:10.044744] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:58:10.514004] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-15T17:58:11.240287] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:58:11.241011] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T17:58:11.248202] [INFO ] [REMOTE ] CDP: Full fetch complete (61967 records). [2025-10-15T17:58:11.248323] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-15T17:58:11.319241] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-15T17:58:11.640912] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-15T17:58:11.640992] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-15T17:58:11.641864] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-15T17:58:11.641928] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-15T17:58:11.643246] [DEBUG] [LOCAL ] CDP: Trimmed 61967 records to 42531 (keeping 200 days of data) [2025-10-15T17:58:11.898445] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:58:11.914476] [DEBUG] [LOCAL ] CDP: Primary data saved (42531 records). [2025-10-15T17:58:11.914609] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-15T17:58:11.914720] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDP took 38.0s. Estimated remaining: 4h 27m 24s. Rate: 7.3 symbols/min [2025-10-15T17:58:12.081701] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:12.109622] [DEBUG] [LOCAL ] CEPU: Loaded 26472 existing records from primary storage. [2025-10-15T17:58:12.109915] [INFO ] [MAIN ] CEPU: Loaded 26472 existing records. [2025-10-15T17:58:12.120445] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-15T17:58:12.290307] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:12.290528] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-15T17:58:12.290577] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-15T17:58:12.290904] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-15T17:58:12.290957] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-15T17:58:12.646805] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:12.914080] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-15T17:58:13.403107] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T17:58:13.407947] [INFO ] [REMOTE ] CDRE: Full fetch complete (35173 records). [2025-10-15T17:58:13.408069] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-15T17:58:13.719122] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-15T17:58:13.797959] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-15T17:58:13.798072] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-15T17:58:13.798731] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-15T17:58:13.798792] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-15T17:58:13.799611] [DEBUG] [LOCAL ] CDRE: Trimmed 35173 records to 24933 (keeping 200 days of data) [2025-10-15T17:58:13.949573] [DEBUG] [LOCAL ] CDRE: Primary data saved (24933 records). [2025-10-15T17:58:13.949740] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-15T17:58:13.949872] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDRE took 25.9s. Estimated remaining: 4h 26m 47s. Rate: 7.3 symbols/min [2025-10-15T17:58:14.136434] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:14.186385] [DEBUG] [LOCAL ] CF: Loaded 52133 existing records from primary storage. [2025-10-15T17:58:14.186749] [INFO ] [MAIN ] CF: Loaded 52133 existing records. [2025-10-15T17:58:14.373787] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:14.374065] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-15T17:58:14.374199] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-15T17:58:14.381909] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-15T17:58:14.393184] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-15T17:58:14.471480] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:58:14.519090] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-15T17:58:14.605592] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T17:58:14.782581] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:15.313970] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-15T17:58:16.057149] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T17:58:16.113959] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-15T17:58:16.230341] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T17:58:16.914040] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-15T17:58:17.673115] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:58:17.714022] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-15T17:58:18.231380] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T17:58:18.514004] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-15T17:58:19.211561] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:58:19.314006] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-15T17:58:20.114035] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-15T17:58:20.184792] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T17:58:20.913973] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-15T17:58:21.161588] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:58:21.627734] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-15T17:58:21.694040] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T17:58:21.713942] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-15T17:58:22.323734] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T17:58:22.513998] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-15T17:58:23.314028] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-15T17:58:23.378016] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T17:58:24.113997] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-15T17:58:24.913963] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-15T17:58:25.289967] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T17:58:25.317121] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T17:58:25.531693] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T17:58:25.714015] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-15T17:58:26.513998] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-15T17:58:27.242307] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:58:27.313966] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-15T17:58:27.781415] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T17:58:27.906000] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T17:58:28.114098] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-15T17:58:28.515809] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T17:58:28.913993] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-15T17:58:29.714115] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-15T17:58:30.280047] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T17:58:30.512157] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:58:30.521545] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-15T17:58:31.314008] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-15T17:58:32.113979] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-15T17:58:32.216562] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T17:58:32.310463] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:58:32.794971] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:58:32.795957] [INFO ] [REMOTE ] CEE: Full fetch complete (10135 records). [2025-10-15T17:58:32.796027] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-15T17:58:32.919094] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-15T17:58:33.169573] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-15T17:58:33.169679] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-15T17:58:33.169929] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-15T17:58:33.169968] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-15T17:58:33.170402] [DEBUG] [LOCAL ] CEE: Trimmed 10135 records to 5365 (keeping 200 days of data) [2025-10-15T17:58:33.202212] [DEBUG] [LOCAL ] CEE: Primary data saved (5365 records). [2025-10-15T17:58:33.202375] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-15T17:58:33.202500] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CEE took 25.4s. Estimated remaining: 4h 27m 29s. Rate: 7.3 symbols/min [2025-10-15T17:58:33.371577] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:33.425241] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-15T17:58:33.425548] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-15T17:58:33.603709] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:33.603909] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-15T17:58:33.603957] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-15T17:58:33.604306] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-15T17:58:33.604367] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-15T17:58:33.719099] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-15T17:58:33.964053] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:34.513963] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-15T17:58:34.926177] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T17:58:35.313980] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-15T17:58:35.390524] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:58:36.114016] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-15T17:58:36.226491] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T17:58:36.296359] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T17:58:36.914007] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-15T17:58:37.714030] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-15T17:58:37.753339] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:58:37.935462] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:58:38.513983] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-15T17:58:39.313976] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-15T17:58:39.501741] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T17:58:39.847558] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T17:58:40.114006] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-15T17:58:40.841057] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T17:58:40.914057] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-15T17:58:41.713966] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-15T17:58:41.880593] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:58:42.471166] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:58:42.477329] [INFO ] [REMOTE ] CE: Full fetch complete (74873 records). [2025-10-15T17:58:42.477458] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-15T17:58:42.519089] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-15T17:58:42.872574] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-15T17:58:42.872709] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-15T17:58:42.873753] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-15T17:58:42.873819] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-15T17:58:42.875531] [DEBUG] [LOCAL ] CE: Trimmed 74873 records to 51344 (keeping 200 days of data) [2025-10-15T17:58:43.192129] [DEBUG] [LOCAL ] CE: Primary data saved (51344 records). [2025-10-15T17:58:43.192377] [INFO ] [MAIN ] CE: Full history saved. [2025-10-15T17:58:43.192530] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CE took 36.8s. Estimated remaining: 4h 27m 29s. Rate: 7.3 symbols/min [2025-10-15T17:58:43.320591] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-15T17:58:43.371992] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:58:43.407278] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:43.408261] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-15T17:58:43.408317] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-15T17:58:43.408428] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-15T17:58:43.408470] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-15T17:58:43.408514] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-15T17:58:43.408546] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-15T17:58:43.800605] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:43.901063] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:58:43.905314] [INFO ] [REMOTE ] CEPU: Full fetch complete (39893 records). [2025-10-15T17:58:43.905405] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-15T17:58:44.121288] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-15T17:58:44.284409] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-15T17:58:44.284494] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-15T17:58:44.285122] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-15T17:58:44.285187] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-15T17:58:44.286556] [DEBUG] [LOCAL ] CEPU: Trimmed 39893 records to 26707 (keeping 200 days of data) [2025-10-15T17:58:44.438140] [DEBUG] [LOCAL ] CEPU: Primary data saved (26707 records). [2025-10-15T17:58:44.438274] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-15T17:58:44.438352] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CEPU took 32.5s. Estimated remaining: 4h 26m 49s. Rate: 7.3 symbols/min [2025-10-15T17:58:44.606138] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:44.637979] [DEBUG] [LOCAL ] CFR: Loaded 32654 existing records from primary storage. [2025-10-15T17:58:44.638258] [INFO ] [MAIN ] CFR: Loaded 32654 existing records. [2025-10-15T17:58:44.821180] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:44.821410] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-15T17:58:44.821459] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-15T17:58:44.822141] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-15T17:58:44.822199] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-15T17:58:44.923153] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-15T17:58:45.182025] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:58:45.187857] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:45.189025] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-15T17:58:45.189365] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:58:45.189520] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-15T17:58:45.189674] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:58:45.189902] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-15T17:58:45.190017] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-15T17:58:45.190160] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-15T17:58:45.190408] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-15T17:58:45.190551] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CFND took 2.0s. Estimated remaining: 4h 26m 6s. Rate: 7.3 symbols/min [2025-10-15T17:58:45.421446] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:45.425758] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T17:58:45.486198] [DEBUG] [LOCAL ] CGAU: Loaded 43482 existing records from primary storage. [2025-10-15T17:58:45.486692] [INFO ] [MAIN ] CGAU: Loaded 43482 existing records. [2025-10-15T17:58:45.692477] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:45.693021] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-15T17:58:45.693160] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-15T17:58:45.693631] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-15T17:58:45.693810] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-15T17:58:45.724496] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-15T17:58:46.052072] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T17:58:46.175392] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:46.514035] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-15T17:58:47.314030] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-15T17:58:47.557051] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:58:48.114003] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-15T17:58:48.593424] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T17:58:48.682635] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T17:58:48.914075] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-15T17:58:49.395230] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T17:58:49.714036] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-15T17:58:50.514048] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-15T17:58:50.754059] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:58:50.975423] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:58:51.314019] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-15T17:58:52.113981] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-15T17:58:52.157944] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:58:52.913968] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-15T17:58:53.036940] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:58:53.380890] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T17:58:53.714070] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-15T17:58:54.041575] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:58:54.514120] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-15T17:58:55.314028] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-15T17:58:55.541855] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:58:56.114079] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-15T17:58:56.218501] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:58:56.607777] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:58:56.914092] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-15T17:58:57.714067] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-15T17:58:58.340412] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:58:58.405774] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-15T17:58:58.412483] [INFO ] [REMOTE ] CF: Full fetch complete (75522 records). [2025-10-15T17:58:58.412701] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-15T17:58:58.518752] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-15T17:58:58.814629] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-15T17:58:58.814843] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-15T17:58:58.815956] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-15T17:58:58.816041] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-15T17:58:58.817821] [DEBUG] [LOCAL ] CF: Trimmed 75522 records to 52155 (keeping 200 days of data) [2025-10-15T17:58:58.932161] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T17:58:59.158774] [DEBUG] [LOCAL ] CF: Primary data saved (52155 records). [2025-10-15T17:58:59.158913] [INFO ] [MAIN ] CF: Full history saved. [2025-10-15T17:58:59.159282] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CF took 45.2s. Estimated remaining: 4h 26m 24s. Rate: 7.3 symbols/min [2025-10-15T17:58:59.325073] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-15T17:58:59.327942] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:59.333631] [DEBUG] [LOCAL ] CGV: Loaded 1397 existing records from primary storage. [2025-10-15T17:58:59.334051] [INFO ] [MAIN ] CGV: Loaded 1397 existing records. [2025-10-15T17:58:59.512347] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:59.512602] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-15T17:58:59.512683] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-15T17:58:59.512861] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-15T17:58:59.512919] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-15T17:58:59.872046] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:00.093227] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:59:00.114003] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-15T17:59:00.615507] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-15T17:59:00.891048] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:59:00.913971] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-15T17:59:01.714033] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-15T17:59:02.514095] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-15T17:59:02.660757] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T17:59:03.099682] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:59:03.314029] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-15T17:59:03.981284] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T17:59:04.114006] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-15T17:59:04.643148] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T17:59:04.914056] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-15T17:59:05.719439] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-15T17:59:05.724291] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T17:59:06.485376] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:59:06.513972] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-15T17:59:07.066303] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T17:59:07.314027] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-15T17:59:07.672201] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T17:59:08.114027] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-15T17:59:08.914118] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-15T17:59:09.184571] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:59:09.191080] [INFO ] [REMOTE ] CFG: Full fetch complete (77754 records). [2025-10-15T17:59:09.191205] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-15T17:59:09.316974] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T17:59:09.657680] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-15T17:59:09.657821] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-15T17:59:09.659019] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-15T17:59:09.659087] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-15T17:59:09.661212] [DEBUG] [LOCAL ] CFG: Trimmed 77754 records to 53623 (keeping 200 days of data) [2025-10-15T17:59:09.717442] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-15T17:59:10.009185] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-15T17:59:10.009385] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-15T17:59:10.010361] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 36.8s. Estimated remaining: 4h 26m 28s. Rate: 7.3 symbols/min [2025-10-15T17:59:10.189972] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:10.220035] [DEBUG] [LOCAL ] CHCT: Loaded 24137 existing records from primary storage. [2025-10-15T17:59:10.220376] [INFO ] [MAIN ] CHCT: Loaded 24137 existing records. [2025-10-15T17:59:10.420995] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:10.421400] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-15T17:59:10.421490] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-15T17:59:10.421979] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-15T17:59:10.422050] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-15T17:59:10.519285] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-15T17:59:10.646525] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T17:59:10.858514] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:10.996073] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T17:59:11.140071] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:59:11.314035] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-15T17:59:12.114059] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-15T17:59:12.644439] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:59:12.914049] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-15T17:59:13.208561] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-15T17:59:13.630561] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T17:59:13.636622] [INFO ] [REMOTE ] CGAU: Full fetch complete (61586 records). [2025-10-15T17:59:13.636754] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-15T17:59:13.719109] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-15T17:59:14.027056] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-15T17:59:14.027135] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-15T17:59:14.027926] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-15T17:59:14.027988] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-15T17:59:14.029112] [DEBUG] [LOCAL ] CGAU: Trimmed 61586 records to 43550 (keeping 200 days of data) [2025-10-15T17:59:14.304978] [DEBUG] [LOCAL ] CGAU: Primary data saved (43550 records). [2025-10-15T17:59:14.305198] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-15T17:59:14.305343] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CGAU took 29.1s. Estimated remaining: 4h 26m 2s. Rate: 7.3 symbols/min [2025-10-15T17:59:14.515578] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-15T17:59:14.515433] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:14.576205] [DEBUG] [LOCAL ] CHD: Loaded 52310 existing records from primary storage. [2025-10-15T17:59:14.576635] [INFO ] [MAIN ] CHD: Loaded 52310 existing records. [2025-10-15T17:59:14.769996] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:14.770295] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-15T17:59:14.770350] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-15T17:59:14.770847] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-15T17:59:14.770907] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-15T17:59:14.870873] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T17:59:15.182489] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:15.205693] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:59:15.314075] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-15T17:59:16.114021] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-15T17:59:16.309031] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T17:59:16.312965] [INFO ] [REMOTE ] CFR: Full fetch complete (48238 records). [2025-10-15T17:59:16.313058] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-15T17:59:16.692061] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-15T17:59:16.692140] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-15T17:59:16.692852] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-15T17:59:16.692914] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-15T17:59:16.693879] [DEBUG] [LOCAL ] CFR: Trimmed 48238 records to 32574 (keeping 200 days of data) [2025-10-15T17:59:16.901889] [DEBUG] [LOCAL ] CFR: Primary data saved (32574 records). [2025-10-15T17:59:16.902107] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-15T17:59:16.902194] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CFR took 32.5s. Estimated remaining: 4h 25m 28s. Rate: 7.3 symbols/min [2025-10-15T17:59:16.923403] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-15T17:59:17.089704] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:17.106008] [DEBUG] [LOCAL ] CHE: Loaded 15380 existing records from primary storage. [2025-10-15T17:59:17.106223] [INFO ] [MAIN ] CHE: Loaded 15380 existing records. [2025-10-15T17:59:17.302421] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:17.302699] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-15T17:59:17.302762] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-15T17:59:17.303007] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-15T17:59:17.303064] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-15T17:59:17.678027] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:17.714023] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-15T17:59:18.014202] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T17:59:18.132073] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T17:59:18.222472] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T17:59:18.514010] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-15T17:59:19.313984] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-15T17:59:19.599726] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T17:59:20.098121] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:59:20.113955] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-15T17:59:20.461194] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T17:59:20.914037] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-15T17:59:21.445866] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T17:59:21.714012] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-15T17:59:22.514034] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-15T17:59:22.531295] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T17:59:23.314038] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-15T17:59:24.119070] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-15T17:59:24.132411] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T17:59:24.235989] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:59:24.711639] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T17:59:24.914044] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-15T17:59:25.714013] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-15T17:59:26.476034] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:59:26.516609] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-15T17:59:26.519290] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T17:59:26.909843] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T17:59:27.313992] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-15T17:59:28.084015] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T17:59:28.113996] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-15T17:59:28.443470] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-15T17:59:28.914009] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-15T17:59:29.715322] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-15T17:59:29.716390] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T17:59:30.346352] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T17:59:30.347203] [INFO ] [REMOTE ] CGV: Full fetch complete (2278 records). [2025-10-15T17:59:30.347273] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-15T17:59:30.523936] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-15T17:59:30.731588] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-15T17:59:30.731688] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-15T17:59:30.731799] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-15T17:59:30.731837] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-15T17:59:30.732151] [DEBUG] [LOCAL ] CGV: Trimmed 2278 records to 1398 (keeping 200 days of data) [2025-10-15T17:59:30.740981] [DEBUG] [LOCAL ] CGV: Primary data saved (1398 records). [2025-10-15T17:59:30.741043] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-15T17:59:30.741109] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGV took 31.6s. Estimated remaining: 4h 25m 45s. Rate: 7.3 symbols/min [2025-10-15T17:59:30.908330] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:30.958865] [DEBUG] [LOCAL ] CHGG: Loaded 47711 existing records from primary storage. [2025-10-15T17:59:30.959230] [INFO ] [MAIN ] CHGG: Loaded 47711 existing records. [2025-10-15T17:59:31.138434] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:31.138677] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-15T17:59:31.138738] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-15T17:59:31.139121] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-15T17:59:31.139178] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-15T17:59:31.326835] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-15T17:59:31.528734] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:32.114024] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-15T17:59:32.914079] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-15T17:59:33.255390] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-15T17:59:33.371173] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T17:59:33.508903] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T17:59:33.714033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-15T17:59:34.513980] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-15T17:59:34.711605] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T17:59:34.781128] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:59:35.314038] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-15T17:59:35.421782] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T17:59:36.113987] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-15T17:59:36.367479] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:59:36.914027] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-15T17:59:37.021399] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T17:59:37.714025] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-15T17:59:38.514045] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-15T17:59:38.824990] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T17:59:39.191198] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T17:59:39.313978] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-15T17:59:39.644629] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:59:40.113994] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-15T17:59:40.848374] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:59:40.906244] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T17:59:40.913953] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-15T17:59:41.714026] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-15T17:59:42.012844] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T17:59:42.514001] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-15T17:59:43.314022] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-15T17:59:43.453716] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T17:59:44.114004] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-15T17:59:44.418778] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T17:59:44.555881] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:59:44.559599] [INFO ] [REMOTE ] CHCT: Full fetch complete (34781 records). [2025-10-15T17:59:44.559725] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-15T17:59:44.924028] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-15T17:59:44.984688] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-15T17:59:44.984970] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-15T17:59:44.986018] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-15T17:59:44.986106] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-15T17:59:45.000219] [DEBUG] [LOCAL ] CHCT: Trimmed 34781 records to 24209 (keeping 200 days of data) [2025-10-15T17:59:45.001253] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T17:59:45.165261] [DEBUG] [LOCAL ] CHCT: Primary data saved (24209 records). [2025-10-15T17:59:45.165420] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-15T17:59:45.165512] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CHCT took 35.2s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-15T17:59:45.357261] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:45.397071] [DEBUG] [LOCAL ] CHH: Loaded 32451 existing records from primary storage. [2025-10-15T17:59:45.397387] [INFO ] [MAIN ] CHH: Loaded 32451 existing records. [2025-10-15T17:59:45.601941] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:45.602176] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-15T17:59:45.602297] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-15T17:59:45.602729] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-15T17:59:45.602789] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-15T17:59:45.719739] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-15T17:59:46.017713] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:46.513970] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-15T17:59:46.591362] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:59:47.313986] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-15T17:59:47.517138] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:59:47.583126] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T17:59:47.966184] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:59:48.114026] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-15T17:59:48.902003] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T17:59:48.913961] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-15T17:59:49.713965] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-15T17:59:49.981816] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T17:59:49.984243] [INFO ] [REMOTE ] CHE: Full fetch complete (20318 records). [2025-10-15T17:59:49.984319] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-15T17:59:50.336167] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-15T17:59:50.336248] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-15T17:59:50.336698] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-15T17:59:50.336771] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-15T17:59:50.337341] [DEBUG] [LOCAL ] CHE: Trimmed 20318 records to 15315 (keeping 200 days of data) [2025-10-15T17:59:50.431043] [DEBUG] [LOCAL ] CHE: Primary data saved (15315 records). [2025-10-15T17:59:50.431204] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-15T17:59:50.431293] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHE took 33.5s. Estimated remaining: 4h 25m 43s. Rate: 7.3 symbols/min [2025-10-15T17:59:50.519870] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-15T17:59:50.599377] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:50.624499] [DEBUG] [LOCAL ] CHMI: Loaded 21630 existing records from primary storage. [2025-10-15T17:59:50.624778] [INFO ] [MAIN ] CHMI: Loaded 21630 existing records. [2025-10-15T17:59:50.805040] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:50.805402] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-15T17:59:50.805497] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-15T17:59:50.805710] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-15T17:59:50.805767] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-15T17:59:51.156335] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:59:51.187969] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:51.313967] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-15T17:59:51.907680] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:59:52.113967] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-15T17:59:52.319706] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T17:59:52.914002] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-15T17:59:53.714028] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-15T17:59:54.235594] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T17:59:54.513969] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-15T17:59:54.650217] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:59:54.781147] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:59:55.313971] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-15T17:59:55.617434] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T17:59:56.114007] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-15T17:59:56.913951] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-15T17:59:56.950175] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:59:57.065540] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T17:59:57.714010] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-15T17:59:58.514079] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-15T17:59:58.648262] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T17:59:58.909590] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T17:59:59.313982] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-15T17:59:59.348372] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T18:00:00.114017] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-15T18:00:00.882913] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:00:00.913950] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-15T18:00:01.713976] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-15T18:00:01.938926] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:00:02.266720] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:00:02.514075] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-15T18:00:03.314039] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-15T18:00:03.721399] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T18:00:03.835635] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-15T18:00:04.113994] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-15T18:00:04.914070] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-15T18:00:05.143729] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T18:00:05.150449] [INFO ] [REMOTE ] CHGG: Full fetch complete (70363 records). [2025-10-15T18:00:05.150638] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-15T18:00:05.570690] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-15T18:00:05.570810] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-15T18:00:05.571863] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-15T18:00:05.571932] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-15T18:00:05.573419] [DEBUG] [LOCAL ] CHGG: Trimmed 70363 records to 47763 (keeping 200 days of data) [2025-10-15T18:00:05.732134] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-15T18:00:05.845553] [DEBUG] [LOCAL ] CHGG: Primary data saved (47763 records). [2025-10-15T18:00:05.846008] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-15T18:00:05.846444] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHGG took 35.1s. Estimated remaining: 4h 26m 6s. Rate: 7.3 symbols/min [2025-10-15T18:00:06.020896] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:06.021497] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-15T18:00:06.021603] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-15T18:00:06.021925] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-15T18:00:06.021992] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-15T18:00:06.022079] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-15T18:00:06.022149] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-15T18:00:06.340965] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:00:06.388863] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-15T18:00:06.447151] [INFO ] [REMOTE ] CHD: Full fetch complete (74743 records). [2025-10-15T18:00:06.450875] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:06.451168] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-15T18:00:06.519874] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-15T18:00:06.859467] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-15T18:00:06.859568] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-15T18:00:06.860632] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-15T18:00:06.860726] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-15T18:00:06.862294] [DEBUG] [LOCAL ] CHD: Trimmed 74743 records to 52319 (keeping 200 days of data) [2025-10-15T18:00:07.112443] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T18:00:07.212499] [DEBUG] [LOCAL ] CHD: Primary data saved (52319 records). [2025-10-15T18:00:07.212660] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-15T18:00:07.212764] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHD took 52.9s. Estimated remaining: 4h 25m 28s. Rate: 7.3 symbols/min [2025-10-15T18:00:07.314041] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-15T18:00:07.948126] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:00:08.116031] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-15T18:00:08.117529] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T18:00:08.914003] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-15T18:00:09.544286] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:00:09.555802] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:00:09.713995] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-15T18:00:10.514054] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-15T18:00:11.168300] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:00:11.314011] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-15T18:00:11.594169] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:00:12.114091] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-15T18:00:12.836899] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T18:00:12.846824] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:00:12.849387] [INFO ] [REMOTE ] CHH: Full fetch complete (47425 records). [2025-10-15T18:00:12.849540] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-15T18:00:12.922766] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-15T18:00:13.229406] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-15T18:00:13.229482] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-15T18:00:13.230174] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-15T18:00:13.230236] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-15T18:00:13.231179] [DEBUG] [LOCAL ] CHH: Trimmed 47425 records to 32425 (keeping 200 days of data) [2025-10-15T18:00:13.434707] [DEBUG] [LOCAL ] CHH: Primary data saved (32425 records). [2025-10-15T18:00:13.434885] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-15T18:00:13.435001] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHH took 28.3s. Estimated remaining: 4h 25m 11s. Rate: 7.3 symbols/min [2025-10-15T18:00:13.714030] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-15T18:00:13.852997] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:00:14.358940] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:00:14.513997] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-15T18:00:15.314030] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-15T18:00:15.622874] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T18:00:16.022211] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T18:00:16.113973] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-15T18:00:16.914039] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-15T18:00:17.192671] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T18:00:17.438165] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T18:00:17.714008] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-15T18:00:18.438455] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:00:18.514008] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-15T18:00:19.314075] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-15T18:00:19.612167] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T18:00:19.920183] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T18:00:20.114043] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-15T18:00:20.703878] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:00:20.914018] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-15T18:00:21.478972] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T18:00:21.714016] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-15T18:00:22.224418] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:00:22.225507] [INFO ] [REMOTE ] CHN: Full fetch complete (7429 records). [2025-10-15T18:00:22.225576] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-15T18:00:22.225970] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:00:22.226057] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:00:22.226099] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:00:22.226174] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-15T18:00:22.226238] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-15T18:00:22.226274] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-15T18:00:22.226332] [DEBUG] [LOCAL ] CHN: No derivative data file found to delete. [2025-10-15T18:00:22.226384] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHN took 16.4s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-15T18:00:22.514044] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-15T18:00:23.429570] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T18:00:23.432423] [INFO ] [REMOTE ] CHMI: Full fetch complete (31738 records). [2025-10-15T18:00:23.432523] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-15T18:00:23.433130] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:00:23.433215] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:00:23.433288] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:00:23.433371] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-15T18:00:23.433448] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-15T18:00:23.433497] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-15T18:00:23.434009] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-10-15T18:00:23.434120] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHMI took 33.0s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-15T18:00:23.981175] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.151063] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.154535] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.156451] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.157404] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-15T18:00:24.157472] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-15T18:00:24.157602] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-15T18:00:24.157694] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-15T18:00:24.157752] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-15T18:00:24.157785] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-15T18:00:24.387583] [DEBUG] [LOCAL ] CHT: Loaded 19461 existing records from primary storage. [2025-10-15T18:00:24.428177] [INFO ] [MAIN ] CHT: Loaded 19461 existing records. [2025-10-15T18:00:24.522617] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-15T18:00:24.582538] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-15T18:00:24.583233] [DEBUG] [LOCAL ] CI: Loaded 49778 existing records from primary storage. [2025-10-15T18:00:24.639247] [INFO ] [MAIN ] CI: Loaded 49778 existing records. [2025-10-15T18:00:24.836080] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:24.936522] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-15T18:00:24.977105] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:25.024334] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-15T18:00:25.078705] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-15T18:00:25.132349] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:25.137866] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-15T18:00:25.152475] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-15T18:00:25.152687] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-15T18:00:25.156055] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-15T18:00:25.174933] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-15T18:00:25.169697] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:25.201498] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-15T18:00:25.201784] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-15T18:00:25.201677] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-15T18:00:25.287263] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-15T18:00:25.309987] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-15T18:00:26.144024] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:26.172982] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-15T18:00:26.267751] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:26.284809] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-15T18:00:26.340352] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:26.340724] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-15T18:00:27.130122] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:00:27.134409] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-15T18:00:27.167902] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-15T18:00:27.313995] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-15T18:00:27.920735] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:00:27.965486] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T18:00:27.986705] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:00:28.113952] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-15T18:00:28.914017] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-15T18:00:28.939950] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T18:00:29.272046] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:00:29.713988] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-15T18:00:30.513956] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-15T18:00:30.769331] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T18:00:30.832703] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:00:31.314035] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-15T18:00:32.113985] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-15T18:00:32.613174] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T18:00:32.914494] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-15T18:00:32.914424] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T18:00:33.713970] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-15T18:00:33.964255] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-15T18:00:34.049298] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T18:00:34.514006] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-15T18:00:35.313979] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-15T18:00:35.522282] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T18:00:36.084491] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:00:36.113958] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-15T18:00:36.174320] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T18:00:36.914016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-15T18:00:37.713970] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-15T18:00:38.001238] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T18:00:38.002197] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T18:00:38.514067] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-15T18:00:39.289275] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T18:00:39.313966] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-15T18:00:39.883807] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-15T18:00:40.114006] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-15T18:00:40.378479] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T18:00:40.914008] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-15T18:00:41.714006] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-15T18:00:42.180811] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T18:00:42.514044] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-15T18:00:42.688465] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:00:43.313973] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-15T18:00:43.812226] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-15T18:00:44.113980] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-15T18:00:44.390441] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:00:44.913998] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-15T18:00:45.157922] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T18:00:45.676587] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:00:45.713959] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-15T18:00:46.513994] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-15T18:00:46.801376] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T18:00:47.314049] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-15T18:00:47.663451] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:00:47.786389] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T18:00:48.114018] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-15T18:00:48.919113] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-15T18:00:48.931671] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T18:00:49.713968] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-15T18:00:50.116399] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T18:00:50.514043] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-15T18:00:50.980056] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-15T18:00:51.041022] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:00:51.313982] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-15T18:00:52.113967] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-15T18:00:52.355258] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T18:00:52.914032] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-15T18:00:52.977876] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:00:52.982952] [INFO ] [REMOTE ] CHPT: Full fetch complete (71787 records). [2025-10-15T18:00:52.983114] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-15T18:00:53.332722] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T18:00:53.417584] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-15T18:00:53.417738] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-15T18:00:53.418582] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-15T18:00:53.418626] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-15T18:00:53.420161] [DEBUG] [LOCAL ] CHPT: Trimmed 71787 records to 47661 (keeping 200 days of data) [2025-10-15T18:00:53.701702] [DEBUG] [LOCAL ] CHPT: Primary data saved (47661 records). [2025-10-15T18:00:53.701854] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-15T18:00:53.702124] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHPT took 30.3s. Estimated remaining: 4h 25m 54s. Rate: 7.3 symbols/min [2025-10-15T18:00:53.724504] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-15T18:00:53.909433] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:53.925843] [DEBUG] [LOCAL ] CIA: Loaded 16701 existing records from primary storage. [2025-10-15T18:00:53.926125] [INFO ] [MAIN ] CIA: Loaded 16701 existing records. [2025-10-15T18:00:54.098267] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:54.098512] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-15T18:00:54.098561] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-15T18:00:54.098785] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-15T18:00:54.098842] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-15T18:00:54.463520] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:54.513966] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-15T18:00:54.657760] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:00:55.314093] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-15T18:00:55.326661] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:00:55.560028] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:00:56.114020] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-15T18:00:56.190500] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T18:00:56.196454] [INFO ] [REMOTE ] CI: Full fetch complete (72162 records). [2025-10-15T18:00:56.196569] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-15T18:00:56.593748] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-15T18:00:56.593844] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-15T18:00:56.594805] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-15T18:00:56.594870] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-15T18:00:56.596382] [DEBUG] [LOCAL ] CI: Trimmed 72162 records to 49737 (keeping 200 days of data) [2025-10-15T18:00:56.917076] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-15T18:00:56.925290] [DEBUG] [LOCAL ] CI: Primary data saved (49737 records). [2025-10-15T18:00:56.925405] [INFO ] [MAIN ] CI: Full history saved. [2025-10-15T18:00:56.925498] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CI took 33.5s. Estimated remaining: 4h 25m 23s. Rate: 7.3 symbols/min [2025-10-15T18:00:57.140856] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:57.177251] [DEBUG] [LOCAL ] CIB: Loaded 30546 existing records from primary storage. [2025-10-15T18:00:57.177676] [INFO ] [MAIN ] CIB: Loaded 30546 existing records. [2025-10-15T18:00:57.419914] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:57.420233] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-15T18:00:57.420316] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-15T18:00:57.420756] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-15T18:00:57.420829] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-15T18:00:57.718012] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-15T18:00:57.813301] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T18:00:57.987593] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:58.121863] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-15T18:00:58.514026] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-15T18:00:58.776151] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T18:00:58.778890] [INFO ] [REMOTE ] CHT: Full fetch complete (27396 records). [2025-10-15T18:00:58.779009] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-15T18:00:58.779545] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:00:58.779631] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:00:58.779722] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:00:58.779803] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-15T18:00:58.779879] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-15T18:00:58.779914] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-15T18:00:58.780056] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-15T18:00:58.780145] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CHT took 35.3s. Estimated remaining: 4h 24m 47s. Rate: 7.3 symbols/min [2025-10-15T18:00:58.945857] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:58.946033] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-15T18:00:58.946071] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-15T18:00:58.946176] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-15T18:00:58.946216] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-15T18:00:58.946257] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-15T18:00:58.946328] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-15T18:00:59.293026] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:59.313959] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-15T18:00:59.751327] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T18:01:00.114001] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-15T18:01:00.748172] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T18:01:00.913968] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-15T18:01:01.111242] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:01:01.714034] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-15T18:01:02.106385] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T18:01:02.448711] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:01:02.513993] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-15T18:01:03.314063] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-15T18:01:04.114001] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-15T18:01:04.289537] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T18:01:04.379980] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-15T18:01:04.708442] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-15T18:01:04.715250] [INFO ] [REMOTE ] CHWY: Full fetch complete (77775 records). [2025-10-15T18:01:04.715407] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-15T18:01:04.920900] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-15T18:01:05.119729] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-15T18:01:05.119823] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-15T18:01:05.120813] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-15T18:01:05.120879] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-15T18:01:05.122382] [DEBUG] [LOCAL ] CHWY: Trimmed 77775 records to 53655 (keeping 200 days of data) [2025-10-15T18:01:05.432549] [DEBUG] [LOCAL ] CHWY: Primary data saved (53655 records). [2025-10-15T18:01:05.432721] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-15T18:01:05.432814] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHWY took 42.0s. Estimated remaining: 4h 24m 32s. Rate: 7.3 symbols/min [2025-10-15T18:01:05.602634] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:05.650712] [DEBUG] [LOCAL ] CIEN: Loaded 52153 existing records from primary storage. [2025-10-15T18:01:05.651062] [INFO ] [MAIN ] CIEN: Loaded 52153 existing records. [2025-10-15T18:01:05.723837] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-15T18:01:05.832174] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:05.832408] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-15T18:01:05.832471] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-15T18:01:05.832905] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-15T18:01:05.832963] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-15T18:01:06.194766] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:06.423003] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:01:06.513992] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-15T18:01:06.741574] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T18:01:07.313977] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-15T18:01:07.754562] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:01:08.114037] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-15T18:01:08.161676] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T18:01:08.914006] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-15T18:01:09.229087] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-15T18:01:09.509935] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:01:09.714010] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-15T18:01:10.281123] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:01:10.513975] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-15T18:01:11.314015] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-15T18:01:11.612564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T18:01:12.113999] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-15T18:01:12.433103] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T18:01:12.913972] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-15T18:01:13.170960] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T18:01:13.714039] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-15T18:01:13.990915] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-15T18:01:14.261429] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:01:14.514065] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-15T18:01:15.314003] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-15T18:01:15.631629] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:01:15.726493] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T18:01:16.113992] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-15T18:01:16.455827] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T18:01:16.914050] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-15T18:01:17.714035] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-15T18:01:18.513992] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-15T18:01:18.740716] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T18:01:18.772669] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T18:01:18.772771] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-15T18:01:19.314016] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-15T18:01:20.114012] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-15T18:01:20.450050] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T18:01:20.913979] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-15T18:01:21.098860] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T18:01:21.714012] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-15T18:01:22.310897] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:01:22.513974] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-15T18:01:22.839255] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:01:22.960506] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:01:23.314008] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-15T18:01:24.113993] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-15T18:01:24.520212] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T18:01:24.521133] [INFO ] [REMOTE ] CICB: Full fetch complete (1988 records). [2025-10-15T18:01:24.521212] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-15T18:01:24.712784] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T18:01:24.712973] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:01:24.713181] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:01:24.713260] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-15T18:01:24.713341] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-15T18:01:24.713505] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-15T18:01:24.713663] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-15T18:01:24.713751] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CICB took 25.9s. Estimated remaining: 4h 25m 12s. Rate: 7.3 symbols/min [2025-10-15T18:01:24.857954] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:01:24.914953] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-15T18:01:24.918765] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:24.927013] [DEBUG] [LOCAL ] CIF: Loaded 4046 existing records from primary storage. [2025-10-15T18:01:24.927256] [INFO ] [MAIN ] CIF: Loaded 4046 existing records. [2025-10-15T18:01:25.101691] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:25.101935] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-15T18:01:25.101983] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-15T18:01:25.102142] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-15T18:01:25.102179] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-15T18:01:25.474864] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:25.700468] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T18:01:25.702318] [INFO ] [REMOTE ] CIA: Full fetch complete (23410 records). [2025-10-15T18:01:25.702389] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-15T18:01:25.702903] [FATAL] [VALIDATOR ] CIA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:01:25.702983] [FATAL] [MAIN ] CIA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:01:25.703024] [WARN ] [MAIN ] CIA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:01:25.703061] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-15T18:01:25.703115] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-15T18:01:25.703149] [INFO ] [LOCAL ] CIA: Starting deletion of derivative data. [2025-10-15T18:01:25.703264] [DEBUG] [LOCAL ] CIA: Deleted derivative data file. [2025-10-15T18:01:25.703327] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CIA took 32.0s. Estimated remaining: 4h 24m 32s. Rate: 7.3 symbols/min [2025-10-15T18:01:25.723464] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-15T18:01:25.874133] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:25.944549] [DEBUG] [LOCAL ] CIG: Loaded 44270 existing records from primary storage. [2025-10-15T18:01:25.944931] [INFO ] [MAIN ] CIG: Loaded 44270 existing records. [2025-10-15T18:01:26.125801] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:26.126052] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-15T18:01:26.126111] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-15T18:01:26.126371] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-15T18:01:26.126416] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-15T18:01:26.442070] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T18:01:26.506131] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:26.513947] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-15T18:01:27.314052] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-15T18:01:27.794975] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T18:01:28.113993] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-15T18:01:28.913997] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-15T18:01:29.007709] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T18:01:29.049874] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T18:01:29.714076] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-15T18:01:30.317288] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:01:30.444326] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:01:30.514052] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-15T18:01:31.163552] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:01:31.314004] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-15T18:01:32.114001] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-15T18:01:32.413036] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:01:32.417018] [INFO ] [REMOTE ] CIB: Full fetch complete (45018 records). [2025-10-15T18:01:32.417165] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-15T18:01:32.806965] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-15T18:01:32.807062] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-15T18:01:32.807735] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-15T18:01:32.807798] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-15T18:01:32.808712] [DEBUG] [LOCAL ] CIB: Trimmed 45018 records to 30426 (keeping 200 days of data) [2025-10-15T18:01:32.917275] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-15T18:01:32.985974] [DEBUG] [LOCAL ] CIB: Primary data saved (30426 records). [2025-10-15T18:01:32.986108] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-15T18:01:32.986186] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CIB took 36.1s. Estimated remaining: 4h 24m 20s. Rate: 7.3 symbols/min [2025-10-15T18:01:33.151457] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:33.151699] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-15T18:01:33.151750] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-15T18:01:33.151874] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-15T18:01:33.151914] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-15T18:01:33.151956] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-15T18:01:33.152461] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-15T18:01:33.475747] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:01:33.539166] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:33.713965] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-15T18:01:34.513974] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-15T18:01:34.565530] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T18:01:34.648513] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:01:35.082615] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:01:35.314110] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-15T18:01:36.113969] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-15T18:01:36.191027] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T18:01:36.914035] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-15T18:01:37.714004] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-15T18:01:37.757098] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T18:01:38.284754] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:01:38.358809] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T18:01:38.514075] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-15T18:01:39.119009] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T18:01:39.314133] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-15T18:01:40.114028] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-15T18:01:40.914012] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-15T18:01:41.180591] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T18:01:41.346775] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T18:01:41.531504] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T18:01:41.714006] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-15T18:01:42.514051] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-15T18:01:43.197447] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T18:01:43.313972] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-15T18:01:43.498862] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:01:44.113990] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-15T18:01:44.345549] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T18:01:44.914036] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-15T18:01:45.427220] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:01:45.426333] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:01:45.714045] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-15T18:01:46.514047] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-15T18:01:47.314054] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-15T18:01:47.377541] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:01:47.832569] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T18:01:48.011633] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T18:01:48.114019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-15T18:01:48.914005] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-15T18:01:49.418858] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-15T18:01:49.714029] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-15T18:01:49.916047] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:01:50.387358] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T18:01:50.514113] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-15T18:01:51.314016] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-15T18:01:51.827784] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T18:01:52.113989] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-15T18:01:52.195482] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:01:52.756492] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:01:52.757714] [INFO ] [REMOTE ] CIF: Full fetch complete (6580 records). [2025-10-15T18:01:52.757797] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-15T18:01:52.917475] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-15T18:01:53.127221] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-15T18:01:53.127322] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-15T18:01:53.127492] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-15T18:01:53.127533] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-15T18:01:53.127937] [DEBUG] [LOCAL ] CIF: Trimmed 6580 records to 4024 (keeping 200 days of data) [2025-10-15T18:01:53.151448] [DEBUG] [LOCAL ] CIF: Primary data saved (4024 records). [2025-10-15T18:01:53.151517] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-15T18:01:53.151586] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIF took 28.4s. Estimated remaining: 4h 25m 2s. Rate: 7.2 symbols/min [2025-10-15T18:01:53.312564] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:53.349599] [DEBUG] [LOCAL ] CIM: Loaded 37747 existing records from primary storage. [2025-10-15T18:01:53.349908] [INFO ] [MAIN ] CIM: Loaded 37747 existing records. [2025-10-15T18:01:53.531988] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:53.532253] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-15T18:01:53.532304] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-15T18:01:53.532526] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-15T18:01:53.532583] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-15T18:01:53.724082] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-15T18:01:53.935552] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:54.513985] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-15T18:01:54.568209] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:01:54.649589] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T18:01:55.314084] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-15T18:01:55.879099] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T18:01:56.114027] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-15T18:01:56.144040] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T18:01:56.914063] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-15T18:01:57.527022] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:01:57.714048] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-15T18:01:58.398740] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:01:58.513976] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-15T18:01:58.813930] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T18:01:59.314013] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-15T18:01:59.930464] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T18:01:59.936187] [INFO ] [REMOTE ] CIG: Full fetch complete (62134 records). [2025-10-15T18:01:59.936290] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-15T18:02:00.117964] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-15T18:02:00.283979] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T18:02:00.338828] [INFO ] [REMOTE ] CII: Full fetch complete (22913 records). [2025-10-15T18:02:00.362263] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-15T18:02:00.378467] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-15T18:02:00.378585] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-15T18:02:00.379710] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-15T18:02:00.379814] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-15T18:02:00.482549] [DEBUG] [LOCAL ] CIG: Trimmed 62134 records to 44317 (keeping 200 days of data) [2025-10-15T18:02:00.866014] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-15T18:02:00.870098] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-15T18:02:00.871105] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-15T18:02:00.873560] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-15T18:02:00.874509] [DEBUG] [LOCAL ] CII: Trimmed 22913 records to 15321 (keeping 200 days of data) [2025-10-15T18:02:00.921433] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-15T18:02:01.109316] [DEBUG] [LOCAL ] CIG: Primary data saved (44317 records). [2025-10-15T18:02:01.106175] [DEBUG] [LOCAL ] CII: Primary data saved (15321 records). [2025-10-15T18:02:01.109473] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-15T18:02:01.109571] [INFO ] [MAIN ] CII: Full history saved. [2025-10-15T18:02:01.109698] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIG took 35.4s. Estimated remaining: 4h 24m 53s. Rate: 7.2 symbols/min [2025-10-15T18:02:01.109943] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CII took 28.1s. Estimated remaining: 4h 24m 9s. Rate: 7.3 symbols/min [2025-10-15T18:02:01.438443] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:01.455119] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:01.455496] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-15T18:02:01.455545] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-15T18:02:01.455685] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-15T18:02:01.455739] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-15T18:02:01.455786] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-15T18:02:01.455819] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-15T18:02:01.567871] [DEBUG] [LOCAL ] CIMN: Loaded 2750 existing records from primary storage. [2025-10-15T18:02:01.583538] [INFO ] [MAIN ] CIMN: Loaded 2750 existing records. [2025-10-15T18:02:02.028713] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:02.065333] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:02.066137] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-15T18:02:02.067487] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-15T18:02:02.067616] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-15T18:02:02.067888] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-15T18:02:02.068123] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-15T18:02:02.156359] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T18:02:02.187037] [INFO ] [REMOTE ] CIEN: Full fetch complete (75782 records). [2025-10-15T18:02:02.198304] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-15T18:02:02.744376] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T18:02:02.741092] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:02.770739] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-15T18:02:02.877575] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:02:02.953435] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-15T18:02:02.953527] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-15T18:02:02.954377] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-15T18:02:02.954448] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-15T18:02:02.955958] [DEBUG] [LOCAL ] CIEN: Trimmed 75782 records to 52151 (keeping 200 days of data) [2025-10-15T18:02:03.259573] [DEBUG] [LOCAL ] CIEN: Primary data saved (52151 records). [2025-10-15T18:02:03.259743] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-15T18:02:03.260064] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIEN took 57.8s. Estimated remaining: 4h 23m 35s. Rate: 7.3 symbols/min [2025-10-15T18:02:03.323250] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-15T18:02:03.433551] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:03.433769] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-15T18:02:03.433861] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-15T18:02:03.433974] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-15T18:02:03.434017] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-15T18:02:03.434059] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-15T18:02:03.434092] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-15T18:02:03.538172] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:02:03.800322] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:03.917163] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T18:02:04.114002] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-15T18:02:04.350665] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:02:04.351046] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-15T18:02:04.351163] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:02:04.351216] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-15T18:02:04.351309] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:02:04.351392] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-15T18:02:04.351494] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-15T18:02:04.351789] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-15T18:02:04.351862] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-15T18:02:04.351938] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIMP took 1.1s. Estimated remaining: 4h 22m 56s. Rate: 7.3 symbols/min [2025-10-15T18:02:04.555073] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:04.575625] [DEBUG] [LOCAL ] CINT: Loaded 19941 existing records from primary storage. [2025-10-15T18:02:04.575918] [INFO ] [MAIN ] CINT: Loaded 19941 existing records. [2025-10-15T18:02:04.751374] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:04.751588] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-15T18:02:04.751636] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-15T18:02:04.751837] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-15T18:02:04.751878] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-15T18:02:04.921057] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-15T18:02:05.109016] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:05.713991] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-15T18:02:06.031931] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-15T18:02:06.375297] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:02:06.514055] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-15T18:02:06.968708] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T18:02:07.314004] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-15T18:02:07.873003] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T18:02:08.114004] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-15T18:02:08.914006] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-15T18:02:09.133717] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T18:02:09.200318] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-15T18:02:09.714042] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-15T18:02:10.000476] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-15T18:02:10.513999] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-15T18:02:11.200211] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T18:02:11.314046] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-15T18:02:12.113977] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-15T18:02:12.150868] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T18:02:12.913997] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-15T18:02:13.714034] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-15T18:02:13.790536] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T18:02:13.794620] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:02:14.249394] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T18:02:14.514017] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-15T18:02:15.064016] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T18:02:15.313990] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-15T18:02:15.820732] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T18:02:16.114031] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-15T18:02:16.635847] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T18:02:16.913997] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-15T18:02:17.713996] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-15T18:02:18.208306] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T18:02:18.351546] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T18:02:18.514059] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-15T18:02:19.021162] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:02:19.022157] [INFO ] [REMOTE ] CIMO: Full fetch complete (4861 records). [2025-10-15T18:02:19.022224] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-15T18:02:19.022576] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:02:19.022695] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:02:19.022750] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:02:19.022795] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-15T18:02:19.022852] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-15T18:02:19.022886] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-15T18:02:19.022925] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-15T18:02:19.022977] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMO took 17.9s. Estimated remaining: 4h 23m 15s. Rate: 7.3 symbols/min [2025-10-15T18:02:19.192736] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:19.211994] [DEBUG] [LOCAL ] CIO: Loaded 20780 existing records from primary storage. [2025-10-15T18:02:19.212215] [INFO ] [MAIN ] CIO: Loaded 20780 existing records. [2025-10-15T18:02:19.319106] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-15T18:02:19.391189] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:19.391419] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-15T18:02:19.391467] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-15T18:02:19.391721] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-15T18:02:19.391779] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-15T18:02:19.786242] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:20.114019] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-15T18:02:20.487825] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T18:02:20.914040] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-15T18:02:21.713993] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-15T18:02:21.854783] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T18:02:22.050073] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T18:02:22.513977] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-15T18:02:22.952701] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T18:02:23.313974] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-15T18:02:23.887144] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (4.57 seconds). [2025-10-15T18:02:24.113998] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-15T18:02:24.146122] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:02:24.914015] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-15T18:02:25.129292] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T18:02:25.713986] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-15T18:02:25.961110] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T18:02:26.513992] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-15T18:02:27.018884] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:02:27.031461] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T18:02:27.314002] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-15T18:02:27.947089] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:02:28.113998] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-15T18:02:28.914013] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-15T18:02:29.713970] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-15T18:02:29.760113] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T18:02:30.514034] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-15T18:02:31.002207] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-15T18:02:31.313976] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-15T18:02:31.377062] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T18:02:31.638796] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:02:32.114008] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-15T18:02:32.550810] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:02:32.834307] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T18:02:32.839968] [INFO ] [REMOTE ] CIM: Full fetch complete (55067 records). [2025-10-15T18:02:32.840152] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-15T18:02:32.919179] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-15T18:02:33.260276] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-15T18:02:33.260399] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-15T18:02:33.261980] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-15T18:02:33.262051] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-15T18:02:33.263793] [DEBUG] [LOCAL ] CIM: Trimmed 55067 records to 37688 (keeping 200 days of data) [2025-10-15T18:02:33.373306] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:02:33.542189] [DEBUG] [LOCAL ] CIM: Primary data saved (37688 records). [2025-10-15T18:02:33.542420] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-15T18:02:33.543318] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 40.4s. Estimated remaining: 4h 23m 34s. Rate: 7.3 symbols/min [2025-10-15T18:02:33.724114] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-15T18:02:33.728206] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:33.729618] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-15T18:02:33.729700] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-15T18:02:33.729820] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-15T18:02:33.729864] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-15T18:02:33.729907] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-15T18:02:33.729941] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-15T18:02:34.086244] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:34.513979] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-15T18:02:34.916440] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T18:02:35.314028] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-15T18:02:35.457369] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T18:02:36.113977] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-15T18:02:36.236233] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:02:36.620123] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:02:36.621093] [INFO ] [REMOTE ] CIMN: Full fetch complete (3917 records). [2025-10-15T18:02:36.621161] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-15T18:02:36.927804] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-15T18:02:36.968119] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-15T18:02:36.968199] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-15T18:02:36.968342] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-15T18:02:36.968381] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-15T18:02:36.968894] [DEBUG] [LOCAL ] CIMN: Trimmed 3917 records to 2756 (keeping 200 days of data) [2025-10-15T18:02:36.985321] [DEBUG] [LOCAL ] CIMN: Primary data saved (2756 records). [2025-10-15T18:02:36.985446] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-15T18:02:36.985573] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMN took 35.9s. Estimated remaining: 4h 23m 5s. Rate: 7.3 symbols/min [2025-10-15T18:02:37.154952] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:37.202693] [DEBUG] [LOCAL ] CIVI: Loaded 52673 existing records from primary storage. [2025-10-15T18:02:37.203004] [INFO ] [MAIN ] CIVI: Loaded 52673 existing records. [2025-10-15T18:02:37.375955] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:37.376225] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-15T18:02:37.376270] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-15T18:02:37.376605] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-15T18:02:37.376702] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-15T18:02:37.721145] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:37.716611] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-15T18:02:37.906840] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:02:38.514075] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-15T18:02:38.716014] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:02:39.243842] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T18:02:39.313993] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-15T18:02:40.113999] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-15T18:02:40.287354] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T18:02:40.914054] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-15T18:02:41.066952] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:02:41.714062] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-15T18:02:42.215423] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:02:42.425770] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T18:02:42.514019] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-15T18:02:43.314031] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-15T18:02:43.937480] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T18:02:44.113991] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-15T18:02:44.771560] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:02:44.914056] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-15T18:02:45.713988] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-15T18:02:45.922798] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T18:02:46.513971] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-15T18:02:46.627337] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-15T18:02:46.900482] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:02:47.313968] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-15T18:02:47.492806] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T18:02:48.101911] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T18:02:48.113961] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-15T18:02:48.914049] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-15T18:02:49.254580] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T18:02:49.259461] [INFO ] [REMOTE ] CINT: Full fetch complete (27835 records). [2025-10-15T18:02:49.259620] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-15T18:02:49.260324] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:02:49.260445] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:02:49.260508] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:02:49.260587] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-15T18:02:49.260702] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-15T18:02:49.260776] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-10-15T18:02:49.260986] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-10-15T18:02:49.261103] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CINT took 44.9s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-15T18:02:49.449846] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:49.450022] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-15T18:02:49.450059] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-15T18:02:49.450174] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-15T18:02:49.450238] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-15T18:02:49.450281] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-15T18:02:49.450313] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-15T18:02:49.724211] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-15T18:02:49.876230] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:50.377363] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T18:02:50.514041] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-15T18:02:50.989918] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T18:02:51.314037] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-15T18:02:51.910076] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T18:02:52.114034] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-15T18:02:52.913979] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-15T18:02:53.015986] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T18:02:53.139800] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T18:02:53.626014] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:02:53.713958] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-15T18:02:54.514036] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-15T18:02:54.581432] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:02:54.585210] [INFO ] [REMOTE ] CIO: Full fetch complete (29327 records). [2025-10-15T18:02:54.585349] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-15T18:02:54.586072] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:02:54.586167] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:02:54.586212] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:02:54.586255] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-15T18:02:54.586322] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-15T18:02:54.586364] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-10-15T18:02:54.586769] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-10-15T18:02:54.587097] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CIO took 35.6s. Estimated remaining: 4h 22m 53s. Rate: 7.3 symbols/min [2025-10-15T18:02:54.780588] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:54.822506] [DEBUG] [LOCAL ] CLB: Loaded 33361 existing records from primary storage. [2025-10-15T18:02:54.822930] [INFO ] [MAIN ] CLB: Loaded 33361 existing records. [2025-10-15T18:02:55.033798] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:55.034133] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-15T18:02:55.034195] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-15T18:02:55.034749] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-15T18:02:55.035012] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-15T18:02:55.315254] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-15T18:02:55.435840] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:55.557667] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T18:02:56.114011] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-15T18:02:56.914028] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-15T18:02:57.020156] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T18:02:57.204685] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T18:02:57.714014] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-15T18:02:58.180462] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T18:02:58.513968] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-15T18:02:58.643917] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:02:59.314049] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-15T18:03:00.114045] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-15T18:03:00.699762] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-15T18:03:00.914015] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-15T18:03:01.018472] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T18:03:01.021976] [INFO ] [REMOTE ] CION: Full fetch complete (40426 records). [2025-10-15T18:03:01.022189] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-15T18:03:01.023029] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:03:01.023135] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:03:01.023273] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:03:01.023379] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-15T18:03:01.023477] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-15T18:03:01.023536] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-15T18:03:01.023583] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-15T18:03:01.023670] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 27.5s. Estimated remaining: 4h 22m 37s. Rate: 7.3 symbols/min [2025-10-15T18:03:01.201571] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:01.201869] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-10-15T18:03:01.201968] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-10-15T18:03:01.202169] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-15T18:03:01.202281] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-15T18:03:01.202365] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-15T18:03:01.202420] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-15T18:03:01.360400] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T18:03:01.652836] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:01.714069] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-15T18:03:02.514188] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-15T18:03:02.848866] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T18:03:02.911702] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T18:03:03.314005] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-15T18:03:03.797285] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T18:03:04.114037] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-15T18:03:04.802340] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T18:03:04.881782] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T18:03:04.913955] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-15T18:03:05.714008] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-15T18:03:06.514028] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-15T18:03:06.649620] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:03:06.670520] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:03:07.314034] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-15T18:03:08.114042] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-15T18:03:08.289865] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T18:03:08.315770] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:03:08.914017] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-15T18:03:09.713977] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-15T18:03:09.974180] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:03:10.156446] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T18:03:10.513972] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-15T18:03:10.625157] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T18:03:11.313999] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-15T18:03:12.121389] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-15T18:03:12.137590] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T18:03:12.867082] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T18:03:12.913962] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-15T18:03:13.713990] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-15T18:03:14.156931] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T18:03:14.364921] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T18:03:14.514011] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-15T18:03:14.615339] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:03:15.314114] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-15T18:03:16.114003] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-15T18:03:16.448619] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T18:03:16.478592] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T18:03:16.914046] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-15T18:03:17.483335] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T18:03:17.713977] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-15T18:03:18.030347] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T18:03:18.235711] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T18:03:18.241739] [INFO ] [REMOTE ] CL: Full fetch complete (77414 records). [2025-10-15T18:03:18.241910] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-15T18:03:18.242764] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:03:18.242877] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:03:18.242921] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:03:18.242988] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-15T18:03:18.243053] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-15T18:03:18.243093] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-10-15T18:03:18.243175] [DEBUG] [LOCAL ] CL: No derivative data file found to delete. [2025-10-15T18:03:18.243263] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CL took 29.0s. Estimated remaining: 4h 23m 6s. Rate: 7.3 symbols/min [2025-10-15T18:03:18.414748] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:18.438402] [DEBUG] [LOCAL ] CLDT: Loaded 25439 existing records from primary storage. [2025-10-15T18:03:18.438681] [INFO ] [MAIN ] CLDT: Loaded 25439 existing records. [2025-10-15T18:03:18.519146] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-15T18:03:18.616298] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:03:18.616482] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-15T18:03:18.616528] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-15T18:03:18.617086] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-15T18:03:18.617143] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-15T18:03:18.966156] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:19.234974] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:03:19.313958] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-15T18:03:19.817918] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T18:03:20.113991] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-15T18:03:20.914004] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-15T18:03:21.713998] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-15T18:03:21.798092] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T18:03:22.073412] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T18:03:22.514038] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-15T18:03:22.713271] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:03:23.313971] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-15T18:03:24.114007] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-15T18:03:24.140024] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:03:24.258052] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T18:03:24.914034] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-15T18:03:24.922503] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T18:03:25.714024] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-15T18:03:25.873212] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:03:26.514005] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-15T18:03:26.966571] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:03:27.314004] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-15T18:03:27.523352] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T18:03:28.113978] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-15T18:03:28.225691] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T18:03:28.914061] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-15T18:03:29.067977] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T18:03:29.713995] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-15T18:03:30.241903] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T18:03:30.246142] [INFO ] [REMOTE ] CLB: Full fetch complete (47047 records). [2025-10-15T18:03:30.246232] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-15T18:03:30.521802] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-15T18:03:30.628048] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-15T18:03:30.628157] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-15T18:03:30.629097] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-15T18:03:30.629172] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-15T18:03:30.630558] [DEBUG] [LOCAL ] CLB: Trimmed 47047 records to 33430 (keeping 200 days of data) [2025-10-15T18:03:30.827501] [DEBUG] [LOCAL ] CLB: Primary data saved (33430 records). [2025-10-15T18:03:30.827675] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-15T18:03:30.827793] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CLB took 36.2s. Estimated remaining: 4h 23m 16s. Rate: 7.3 symbols/min [2025-10-15T18:03:31.035154] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:31.035340] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-10-15T18:03:31.035379] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-10-15T18:03:31.035490] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-15T18:03:31.035534] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-15T18:03:31.035578] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-15T18:03:31.035613] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-15T18:03:31.313989] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-15T18:03:31.399388] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:31.419072] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:03:31.425886] [INFO ] [REMOTE ] CIVI: Full fetch complete (75966 records). [2025-10-15T18:03:31.426046] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-15T18:03:31.827000] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-15T18:03:31.827176] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-15T18:03:31.828435] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-15T18:03:31.828745] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-15T18:03:31.830372] [DEBUG] [LOCAL ] CIVI: Trimmed 75966 records to 52699 (keeping 200 days of data) [2025-10-15T18:03:31.943147] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T18:03:32.129283] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-15T18:03:32.170769] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:03:32.175665] [INFO ] [REMOTE ] CLCO: Full fetch complete (22908 records). [2025-10-15T18:03:32.176535] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-15T18:03:32.267583] [DEBUG] [LOCAL ] CIVI: Primary data saved (52699 records). [2025-10-15T18:03:32.286030] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-15T18:03:32.288320] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CIVI took 55.3s. Estimated remaining: 4h 22m 40s. Rate: 7.3 symbols/min [2025-10-15T18:03:32.748713] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:32.759291] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-10-15T18:03:32.769733] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-10-15T18:03:32.806076] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-15T18:03:32.806974] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-15T18:03:32.832172] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-15T18:03:32.832013] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-15T18:03:32.832279] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-15T18:03:32.832333] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-15T18:03:32.863473] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-15T18:03:32.894723] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-15T18:03:32.921252] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-15T18:03:32.933458] [DEBUG] [LOCAL ] CLCO: Trimmed 22908 records to 13176 (keeping 200 days of data) [2025-10-15T18:03:33.184124] [DEBUG] [LOCAL ] CLCO: Primary data saved (13176 records). [2025-10-15T18:03:33.196514] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-15T18:03:33.207367] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 32.2s. Estimated remaining: 4h 22m 1s. Rate: 7.3 symbols/min [2025-10-15T18:03:33.444988] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:33.469489] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:33.469738] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-15T18:03:33.470018] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-15T18:03:33.470143] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-15T18:03:33.470196] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-15T18:03:33.470239] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-15T18:03:33.470271] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-15T18:03:33.718474] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-15T18:03:33.784624] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:03:33.857632] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:34.513967] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-15T18:03:34.886249] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T18:03:34.989565] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-15T18:03:35.313976] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-15T18:03:35.531994] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T18:03:36.114033] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-15T18:03:36.196585] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T18:03:36.688228] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:03:36.913997] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-15T18:03:37.713991] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-15T18:03:38.514003] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-15T18:03:38.845025] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T18:03:39.037942] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T18:03:39.066080] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T18:03:39.314052] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-15T18:03:40.114030] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-15T18:03:40.201027] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T18:03:40.913986] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-15T18:03:41.701621] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T18:03:41.713993] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-15T18:03:41.992592] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T18:03:42.514060] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-15T18:03:42.694212] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T18:03:43.314076] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-15T18:03:44.114004] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-15T18:03:44.248191] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:03:44.841098] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:03:44.914010] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-15T18:03:45.211153] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T18:03:45.713993] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-15T18:03:46.095814] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T18:03:46.513999] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-15T18:03:47.313973] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-15T18:03:47.629788] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:03:47.692682] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T18:03:48.114030] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-15T18:03:48.318571] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:03:48.913966] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-15T18:03:48.964625] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T18:03:49.714043] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-15T18:03:50.514008] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-15T18:03:50.714154] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T18:03:50.894440] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T18:03:51.068726] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T18:03:51.314005] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-15T18:03:52.113986] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-15T18:03:52.510269] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T18:03:52.913987] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-15T18:03:53.004892] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T18:03:53.714040] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-15T18:03:54.513954] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-15T18:03:54.538215] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:03:55.170567] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-15T18:03:55.308145] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T18:03:55.313944] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-15T18:03:55.779510] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T18:03:56.114041] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-15T18:03:56.830034] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T18:03:56.914026] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-15T18:03:57.713988] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-15T18:03:58.059763] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T18:03:58.063494] [INFO ] [REMOTE ] CLDT: Full fetch complete (37360 records). [2025-10-15T18:03:58.063678] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-15T18:03:58.477723] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-15T18:03:58.477813] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-15T18:03:58.478400] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-15T18:03:58.478441] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-15T18:03:58.479398] [DEBUG] [LOCAL ] CLDT: Trimmed 37360 records to 25429 (keeping 200 days of data) [2025-10-15T18:03:58.531875] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-15T18:03:58.633864] [DEBUG] [LOCAL ] CLDT: Primary data saved (25429 records). [2025-10-15T18:03:58.634001] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-15T18:03:58.634101] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 40.4s. Estimated remaining: 4h 23m 4s. Rate: 7.2 symbols/min [2025-10-15T18:03:58.754784] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T18:03:58.815726] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:58.866535] [DEBUG] [LOCAL ] CLS: Loaded 53583 existing records from primary storage. [2025-10-15T18:03:58.866888] [INFO ] [MAIN ] CLS: Loaded 53583 existing records. [2025-10-15T18:03:59.038983] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:03:59.039199] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-15T18:03:59.039259] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-15T18:03:59.039670] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-15T18:03:59.039725] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-15T18:03:59.314843] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-15T18:03:59.394734] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:59.903271] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:03:59.909327] [INFO ] [REMOTE ] CLH: Full fetch complete (42039 records). [2025-10-15T18:03:59.909473] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-15T18:04:00.119170] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-15T18:04:00.306674] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-15T18:04:00.306798] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-15T18:04:00.307673] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-15T18:04:00.307766] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-15T18:04:00.309153] [DEBUG] [LOCAL ] CLH: Trimmed 42039 records to 27821 (keeping 200 days of data) [2025-10-15T18:04:00.507696] [DEBUG] [LOCAL ] CLH: Primary data saved (27821 records). [2025-10-15T18:04:00.507844] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-15T18:04:00.507917] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLH took 28.2s. Estimated remaining: 4h 22m 29s. Rate: 7.3 symbols/min [2025-10-15T18:04:00.677310] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:00.724107] [DEBUG] [LOCAL ] CLVT: Loaded 51954 existing records from primary storage. [2025-10-15T18:04:00.724426] [INFO ] [MAIN ] CLVT: Loaded 51954 existing records. [2025-10-15T18:04:00.819316] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T18:04:00.908560] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:00.908811] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-15T18:04:00.908863] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-15T18:04:00.909318] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-15T18:04:00.909375] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-15T18:04:00.920234] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-15T18:04:01.261536] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:01.417484] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T18:04:01.714015] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-15T18:04:02.452095] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T18:04:02.453551] [INFO ] [REMOTE ] CLPR: Full fetch complete (16230 records). [2025-10-15T18:04:02.453622] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-15T18:04:02.454042] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:04:02.454128] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:04:02.454171] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:04:02.454210] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-15T18:04:02.454266] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-15T18:04:02.454301] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-15T18:04:02.454340] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-15T18:04:02.454392] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLPR took 29.2s. Estimated remaining: 4h 21m 55s. Rate: 7.3 symbols/min [2025-10-15T18:04:02.514017] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-15T18:04:02.631538] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:02.653011] [DEBUG] [LOCAL ] CLW: Loaded 21558 existing records from primary storage. [2025-10-15T18:04:02.653265] [INFO ] [MAIN ] CLW: Loaded 21558 existing records. [2025-10-15T18:04:02.857991] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T18:04:02.861174] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:02.871540] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-15T18:04:02.872087] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-15T18:04:02.872345] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-15T18:04:02.872401] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-15T18:04:03.231591] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:03.313999] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-15T18:04:04.114043] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-15T18:04:04.226076] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T18:04:04.645229] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:04:04.914014] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-15T18:04:05.714037] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-15T18:04:06.359497] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T18:04:06.492252] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-15T18:04:06.513948] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-15T18:04:07.313988] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-15T18:04:07.612599] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T18:04:08.113971] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-15T18:04:08.469190] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-15T18:04:08.730772] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:04:08.914014] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-15T18:04:09.713992] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-15T18:04:10.299945] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T18:04:10.400728] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T18:04:10.513988] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-15T18:04:11.314075] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-15T18:04:12.033964] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-15T18:04:12.114044] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-15T18:04:12.325977] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T18:04:12.914006] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-15T18:04:13.140014] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T18:04:13.147128] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-15T18:04:13.147323] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-15T18:04:13.592818] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-15T18:04:13.593181] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-15T18:04:13.594201] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-15T18:04:13.595086] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-15T18:04:13.596764] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:04:13.608933] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-15T18:04:13.727349] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-15T18:04:13.932392] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-15T18:04:13.932549] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-15T18:04:13.932629] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLF took 43.1s. Estimated remaining: 4h 21m 60s. Rate: 7.3 symbols/min [2025-10-15T18:04:14.103263] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:14.153154] [DEBUG] [LOCAL ] CLX: Loaded 51660 existing records from primary storage. [2025-10-15T18:04:14.153469] [INFO ] [MAIN ] CLX: Loaded 51660 existing records. [2025-10-15T18:04:14.334063] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:14.334304] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-15T18:04:14.334355] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-15T18:04:14.334754] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-15T18:04:14.334813] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-15T18:04:14.541243] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-15T18:04:14.689735] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:15.314003] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-15T18:04:15.400088] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-15T18:04:15.443841] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:04:15.872232] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:04:16.114040] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-15T18:04:16.883492] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:04:16.913967] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-15T18:04:17.710028] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T18:04:17.719541] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-15T18:04:18.513999] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-15T18:04:18.850521] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T18:04:18.922261] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T18:04:19.314057] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-15T18:04:20.109210] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:04:20.119327] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-15T18:04:20.913991] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-15T18:04:21.012972] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:04:21.089302] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:04:21.714003] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-15T18:04:22.175664] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T18:04:22.464312] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T18:04:22.513998] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-15T18:04:23.314008] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-15T18:04:23.487759] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:04:24.113997] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-15T18:04:24.914020] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-15T18:04:25.016501] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T18:04:25.713989] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-15T18:04:25.861352] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T18:04:26.514062] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-15T18:04:26.628168] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-15T18:04:27.314099] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-15T18:04:27.735599] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-15T18:04:27.741681] [INFO ] [REMOTE ] CLVT: Full fetch complete (75020 records). [2025-10-15T18:04:27.741847] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-15T18:04:27.742618] [FATAL] [VALIDATOR ] CLVT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:04:27.742754] [FATAL] [MAIN ] CLVT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:04:27.742796] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:04:27.742835] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-15T18:04:27.742891] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-15T18:04:27.742924] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-10-15T18:04:27.743088] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-10-15T18:04:27.743176] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLVT took 27.2s. Estimated remaining: 4h 22m 14s. Rate: 7.3 symbols/min [2025-10-15T18:04:27.915448] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:27.961104] [DEBUG] [LOCAL ] CM: Loaded 48743 existing records from primary storage. [2025-10-15T18:04:27.961548] [INFO ] [MAIN ] CM: Loaded 48743 existing records. [2025-10-15T18:04:28.141870] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:28.142033] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-15T18:04:28.143138] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-15T18:04:28.143204] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-15T18:04:28.143705] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-15T18:04:28.143767] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-15T18:04:28.278402] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:04:28.540460] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:28.913993] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-15T18:04:29.714055] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-15T18:04:30.332865] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T18:04:30.386679] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T18:04:30.513999] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-15T18:04:31.228312] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:04:31.314034] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-15T18:04:31.882870] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (4.57 seconds). [2025-10-15T18:04:32.020950] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:04:32.114010] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-15T18:04:32.799159] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T18:04:32.914006] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-15T18:04:33.466240] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:04:33.714061] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-15T18:04:34.513990] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-15T18:04:34.615036] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T18:04:35.313979] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-15T18:04:35.654537] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-15T18:04:36.117737] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-15T18:04:36.120991] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T18:04:36.783677] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:04:36.913988] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-15T18:04:37.231365] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T18:04:37.234066] [INFO ] [REMOTE ] CLW: Full fetch complete (33955 records). [2025-10-15T18:04:37.234144] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-15T18:04:37.589475] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-15T18:04:37.589552] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-15T18:04:37.590156] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-15T18:04:37.590218] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-15T18:04:37.591236] [DEBUG] [LOCAL ] CLW: Trimmed 33955 records to 21508 (keeping 200 days of data) [2025-10-15T18:04:37.723750] [DEBUG] [LOCAL ] CLW: Primary data saved (21508 records). [2025-10-15T18:04:37.715124] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-15T18:04:37.724056] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-15T18:04:37.725034] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLW took 35.3s. Estimated remaining: 4h 22m 13s. Rate: 7.2 symbols/min [2025-10-15T18:04:37.901142] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:37.901350] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-15T18:04:37.901387] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-15T18:04:37.901495] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-15T18:04:37.901537] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-15T18:04:37.901576] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-15T18:04:37.901607] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-15T18:04:38.243976] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:38.465350] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T18:04:38.514007] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-15T18:04:39.314070] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-15T18:04:39.827559] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T18:04:39.986009] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-15T18:04:39.992307] [INFO ] [REMOTE ] CLS: Full fetch complete (77677 records). [2025-10-15T18:04:39.992440] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-15T18:04:40.119200] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-15T18:04:40.391120] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-15T18:04:40.391202] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-15T18:04:40.392273] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-15T18:04:40.392339] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-15T18:04:40.394248] [DEBUG] [LOCAL ] CLS: Trimmed 77677 records to 53583 (keeping 200 days of data) [2025-10-15T18:04:40.768463] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T18:04:40.787617] [DEBUG] [LOCAL ] CLS: Primary data saved (53583 records). [2025-10-15T18:04:40.787810] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-15T18:04:40.787939] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLS took 42.2s. Estimated remaining: 4h 21m 43s. Rate: 7.3 symbols/min [2025-10-15T18:04:40.919149] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-15T18:04:40.986103] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:41.014532] [DEBUG] [LOCAL ] CMBT: Loaded 25911 existing records from primary storage. [2025-10-15T18:04:41.014849] [INFO ] [MAIN ] CMBT: Loaded 25911 existing records. [2025-10-15T18:04:41.210421] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:41.210630] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-15T18:04:41.210717] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-15T18:04:41.210920] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-15T18:04:41.210976] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-15T18:04:41.553635] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:41.713956] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-15T18:04:42.168184] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T18:04:42.333075] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:04:42.514053] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-15T18:04:42.542709] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:04:43.314057] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-15T18:04:44.113996] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-15T18:04:44.393567] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T18:04:44.418271] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T18:04:44.914047] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-15T18:04:45.609353] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:04:45.714054] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-15T18:04:45.856860] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T18:04:46.514061] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-15T18:04:47.238521] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:04:47.314047] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-15T18:04:48.113974] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-15T18:04:48.204349] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T18:04:48.861156] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:04:48.914001] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-15T18:04:49.714087] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-15T18:04:50.020024] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T18:04:50.280192] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:04:50.514009] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-15T18:04:50.704896] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T18:04:51.314002] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-15T18:04:51.949975] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T18:04:52.114010] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-15T18:04:52.206970] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:04:52.913996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-15T18:04:53.538922] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:04:53.714007] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-15T18:04:54.460203] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T18:04:54.466455] [INFO ] [REMOTE ] CLX: Full fetch complete (73524 records). [2025-10-15T18:04:54.466573] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-15T18:04:54.522102] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-15T18:04:54.853937] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-15T18:04:54.854038] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-15T18:04:54.855107] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-15T18:04:54.855173] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-15T18:04:54.856686] [DEBUG] [LOCAL ] CLX: Trimmed 73524 records to 51677 (keeping 200 days of data) [2025-10-15T18:04:55.186585] [DEBUG] [LOCAL ] CLX: Primary data saved (51677 records). [2025-10-15T18:04:55.186761] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-15T18:04:55.186850] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 41.3s. Estimated remaining: 4h 21m 60s. Rate: 7.2 symbols/min [2025-10-15T18:04:55.332448] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-15T18:04:55.358743] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:55.400140] [DEBUG] [LOCAL ] CMC: Loaded 45430 existing records from primary storage. [2025-10-15T18:04:55.400446] [INFO ] [MAIN ] CMC: Loaded 45430 existing records. [2025-10-15T18:04:55.593040] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:04:55.616248] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:55.626855] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-15T18:04:55.627082] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-15T18:04:55.627449] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-15T18:04:55.627512] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-15T18:04:55.983126] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:56.113981] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-15T18:04:56.255591] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T18:04:56.280897] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:04:56.913971] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-15T18:04:57.659161] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T18:04:57.713959] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-15T18:04:58.294922] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:04:58.301283] [INFO ] [REMOTE ] CM: Full fetch complete (69851 records). [2025-10-15T18:04:58.301440] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-15T18:04:58.519174] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-15T18:04:58.723554] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-15T18:04:58.723748] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-15T18:04:58.725064] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-15T18:04:58.725148] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-15T18:04:58.727109] [DEBUG] [LOCAL ] CM: Trimmed 69851 records to 48739 (keeping 200 days of data) [2025-10-15T18:04:59.040810] [DEBUG] [LOCAL ] CM: Primary data saved (48739 records). [2025-10-15T18:04:59.040968] [INFO ] [MAIN ] CM: Full history saved. [2025-10-15T18:04:59.041052] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CM took 31.3s. Estimated remaining: 4h 21m 34s. Rate: 7.3 symbols/min [2025-10-15T18:04:59.209351] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:59.216373] [DEBUG] [LOCAL ] CMCM: Loaded 4866 existing records from primary storage. [2025-10-15T18:04:59.216576] [INFO ] [MAIN ] CMCM: Loaded 4866 existing records. [2025-10-15T18:04:59.315956] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-15T18:04:59.401717] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:59.402181] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-15T18:04:59.402310] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-15T18:04:59.402532] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-15T18:04:59.402606] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-15T18:04:59.550597] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:04:59.599143] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:04:59.841301] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:00.114033] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-15T18:05:00.685043] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T18:05:00.913968] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-15T18:05:01.258215] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T18:05:01.272743] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-15T18:05:01.714019] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-15T18:05:02.514057] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-15T18:05:03.018789] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T18:05:03.314054] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-15T18:05:03.827583] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T18:05:04.114038] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-15T18:05:04.914038] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-15T18:05:04.974848] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T18:05:05.014923] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T18:05:05.714000] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-15T18:05:06.300288] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T18:05:06.513996] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-15T18:05:06.636609] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:05:07.314047] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-15T18:05:07.832976] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T18:05:08.114055] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-15T18:05:08.158015] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:05:08.914035] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-15T18:05:09.451239] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:05:09.714074] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-15T18:05:10.450399] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:05:10.513985] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-15T18:05:11.313989] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-15T18:05:11.506122] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:05:11.512935] [INFO ] [REMOTE ] CMA: Full fetch complete (73390 records). [2025-10-15T18:05:11.513062] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-15T18:05:11.906785] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-15T18:05:11.910734] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-15T18:05:11.910888] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T18:05:11.913638] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-15T18:05:11.913768] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-15T18:05:11.915758] [DEBUG] [LOCAL ] CMA: Trimmed 73390 records to 50122 (keeping 200 days of data) [2025-10-15T18:05:12.049901] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:05:12.133508] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-15T18:05:12.263469] [DEBUG] [LOCAL ] CMA: Primary data saved (50122 records). [2025-10-15T18:05:12.263625] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-15T18:05:12.263741] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 34.5s. Estimated remaining: 4h 21m 45s. Rate: 7.2 symbols/min [2025-10-15T18:05:12.434026] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:12.434223] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-15T18:05:12.434261] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-15T18:05:12.434374] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-15T18:05:12.434415] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-15T18:05:12.434457] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-15T18:05:12.434489] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-15T18:05:12.776162] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:12.914014] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-15T18:05:13.406788] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T18:05:13.713988] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-15T18:05:14.381699] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:05:14.514041] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-15T18:05:15.314016] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-15T18:05:15.575313] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:05:15.577669] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T18:05:15.576279] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-15T18:05:15.577893] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:05:15.589135] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-15T18:05:15.589234] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:05:15.589701] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-15T18:05:15.589821] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-15T18:05:15.589872] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-15T18:05:15.589914] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-15T18:05:15.589959] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMDB took 3.3s. Estimated remaining: 4h 21m 17s. Rate: 7.3 symbols/min [2025-10-15T18:05:15.755820] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:15.813492] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-10-15T18:05:15.814064] [INFO ] [MAIN ] CMG: Loaded 53720 existing records. [2025-10-15T18:05:15.996300] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:16.012598] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-15T18:05:16.021895] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-15T18:05:16.023545] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-15T18:05:16.023675] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-15T18:05:16.023479] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:05:16.119214] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-15T18:05:16.387078] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:16.600600] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T18:05:16.914028] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-15T18:05:17.423813] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:05:17.714166] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-15T18:05:18.323226] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T18:05:18.514013] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-15T18:05:19.314048] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-15T18:05:19.867205] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T18:05:20.050576] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:05:20.113991] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-15T18:05:20.913995] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-15T18:05:21.619892] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:05:21.713987] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-15T18:05:22.513973] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-15T18:05:22.686618] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:05:22.692708] [INFO ] [REMOTE ] CMBT: Full fetch complete (32610 records). [2025-10-15T18:05:22.692836] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-15T18:05:23.061332] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-15T18:05:23.061483] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-15T18:05:23.062165] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-15T18:05:23.062239] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-15T18:05:23.063190] [DEBUG] [LOCAL ] CMBT: Trimmed 32610 records to 26155 (keeping 200 days of data) [2025-10-15T18:05:23.189949] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T18:05:23.193097] [INFO ] [REMOTE ] CMCM: Full fetch complete (6940 records). [2025-10-15T18:05:23.193749] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-15T18:05:23.195094] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:05:23.314206] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-15T18:05:23.628960] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-15T18:05:23.629585] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-15T18:05:23.630487] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-15T18:05:23.631867] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-15T18:05:23.634177] [DEBUG] [LOCAL ] CMBT: Primary data saved (26155 records). [2025-10-15T18:05:23.634593] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-15T18:05:23.634982] [DEBUG] [LOCAL ] CMCM: Trimmed 6940 records to 4788 (keeping 200 days of data) [2025-10-15T18:05:23.635106] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMBT took 42.8s. Estimated remaining: 4h 21m 8s. Rate: 7.3 symbols/min [2025-10-15T18:05:23.761913] [DEBUG] [LOCAL ] CMCM: Primary data saved (4788 records). [2025-10-15T18:05:23.777837] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-15T18:05:23.783061] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMCM took 24.7s. Estimated remaining: 4h 20m 28s. Rate: 7.3 symbols/min [2025-10-15T18:05:23.902847] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:24.005805] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:24.036816] [DEBUG] [LOCAL ] CMI: Loaded 41661 existing records from primary storage. [2025-10-15T18:05:24.046136] [INFO ] [MAIN ] CMI: Loaded 41661 existing records. [2025-10-15T18:05:24.126540] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-15T18:05:24.169410] [DEBUG] [LOCAL ] CMP: Loaded 35866 existing records from primary storage. [2025-10-15T18:05:24.180861] [INFO ] [MAIN ] CMP: Loaded 35866 existing records. [2025-10-15T18:05:24.349591] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:24.364503] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-15T18:05:24.364627] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-15T18:05:24.365036] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-15T18:05:24.370614] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-15T18:05:24.555296] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:24.571097] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-15T18:05:24.605915] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-15T18:05:24.619109] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-15T18:05:24.691576] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-15T18:05:24.916902] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:24.917471] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-15T18:05:25.181085] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T18:05:25.229039] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:25.229331] [INFO ] [REMOTE ] CMC: Full fetch complete (67057 records). [2025-10-15T18:05:25.230103] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-15T18:05:25.699481] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-15T18:05:25.699603] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-15T18:05:25.700858] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-15T18:05:25.700936] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-15T18:05:25.703712] [DEBUG] [LOCAL ] CMC: Trimmed 67057 records to 45483 (keeping 200 days of data) [2025-10-15T18:05:25.762454] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-15T18:05:25.991319] [DEBUG] [LOCAL ] CMC: Primary data saved (45483 records). [2025-10-15T18:05:25.991454] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-15T18:05:25.991556] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMC took 30.8s. Estimated remaining: 4h 19m 55s. Rate: 7.3 symbols/min [2025-10-15T18:05:26.159234] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:26.198881] [DEBUG] [LOCAL ] CMPO: Loaded 38842 existing records from primary storage. [2025-10-15T18:05:26.199182] [INFO ] [MAIN ] CMPO: Loaded 38842 existing records. [2025-10-15T18:05:26.381203] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:26.381469] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-15T18:05:26.381630] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-15T18:05:26.382099] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-15T18:05:26.382166] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-15T18:05:26.708065] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-15T18:05:26.728799] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-15T18:05:26.809989] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:26.831992] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T18:05:27.319085] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-15T18:05:27.334708] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:05:28.114027] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-15T18:05:28.637456] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T18:05:28.714873] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T18:05:28.914064] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-15T18:05:29.129035] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:05:29.713978] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-15T18:05:30.514009] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-15T18:05:30.650830] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T18:05:31.041720] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T18:05:31.314073] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-15T18:05:32.029731] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T18:05:32.114011] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-15T18:05:32.453079] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T18:05:32.914002] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-15T18:05:33.427336] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T18:05:33.713994] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-15T18:05:34.514035] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-15T18:05:34.736174] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:05:34.836033] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:05:35.314015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-15T18:05:35.600631] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T18:05:36.114016] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-15T18:05:36.914039] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-15T18:05:37.592435] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-15T18:05:37.687138] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:05:37.713952] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-15T18:05:38.120671] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T18:05:38.514064] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-15T18:05:39.108492] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T18:05:39.314075] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-15T18:05:39.674462] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T18:05:40.114076] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-15T18:05:40.779183] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:05:40.914024] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-15T18:05:41.714046] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-15T18:05:41.892954] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T18:05:42.519108] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-15T18:05:42.531263] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:05:42.934386] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T18:05:43.314024] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-15T18:05:43.824376] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:05:44.113990] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-15T18:05:44.516627] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T18:05:44.914008] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-15T18:05:45.626275] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:05:45.713983] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-15T18:05:46.021306] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T18:05:46.513996] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-15T18:05:47.080484] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T18:05:47.314052] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-15T18:05:47.971094] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T18:05:48.114047] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-15T18:05:48.913998] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-15T18:05:49.140042] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:05:49.374894] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T18:05:49.714013] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-15T18:05:50.455287] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T18:05:50.514017] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-15T18:05:51.313985] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-15T18:05:51.353336] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T18:05:51.728210] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:05:52.114070] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-15T18:05:52.922298] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-15T18:05:52.929634] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T18:05:52.965234] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T18:05:53.714024] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-15T18:05:54.428819] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T18:05:54.513971] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-15T18:05:55.314011] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-15T18:05:55.742459] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-15T18:05:56.094001] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:05:56.099596] [INFO ] [REMOTE ] CMI: Full fetch complete (60652 records). [2025-10-15T18:05:56.099828] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-15T18:05:56.121552] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-15T18:05:56.513025] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-15T18:05:56.512925] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:05:56.516467] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-15T18:05:56.518116] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-15T18:05:56.518233] [INFO ] [REMOTE ] CMP: Full fetch complete (51780 records). [2025-10-15T18:05:56.518358] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-15T18:05:56.518536] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-15T18:05:56.626937] [DEBUG] [LOCAL ] CMI: Trimmed 60652 records to 41687 (keeping 200 days of data) [2025-10-15T18:05:56.930563] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-15T18:05:57.042110] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-15T18:05:57.042461] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-15T18:05:57.044711] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-15T18:05:57.044790] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-15T18:05:57.054744] [DEBUG] [LOCAL ] CMP: Trimmed 51780 records to 35832 (keeping 200 days of data) [2025-10-15T18:05:57.401659] [DEBUG] [LOCAL ] CMP: Primary data saved (35832 records). [2025-10-15T18:05:57.402353] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-15T18:05:57.403974] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMP took 33.6s. Estimated remaining: 4h 21m 19s. Rate: 7.2 symbols/min [2025-10-15T18:05:57.422759] [DEBUG] [LOCAL ] CMI: Primary data saved (41687 records). [2025-10-15T18:05:57.422894] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-15T18:05:57.422973] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMI took 33.8s. Estimated remaining: 4h 20m 38s. Rate: 7.3 symbols/min [2025-10-15T18:05:57.460802] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:05:57.465123] [INFO ] [REMOTE ] CMPO: Full fetch complete (58588 records). [2025-10-15T18:05:57.465228] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-15T18:05:57.859549] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-15T18:05:57.859626] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-15T18:05:57.860468] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-15T18:05:57.860523] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-15T18:05:57.861732] [DEBUG] [LOCAL ] CMPO: Trimmed 58588 records to 38834 (keeping 200 days of data) [2025-10-15T18:05:58.078985] [DEBUG] [LOCAL ] CMPO: Primary data saved (38834 records). [2025-10-15T18:05:58.079121] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-15T18:05:58.079199] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMPO took 32.1s. Estimated remaining: 4h 19m 60s. Rate: 7.3 symbols/min [2025-10-15T18:05:59.046706] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T18:05:59.059525] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-15T18:06:01.670007] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-15T18:06:01.683143] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-15T18:06:02.317448] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T18:06:02.324964] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-15T18:06:02.325174] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-15T18:06:02.728083] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-15T18:06:02.728170] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-15T18:06:02.729088] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-15T18:06:02.729156] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-15T18:06:02.730709] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 53721 (keeping 200 days of data) [2025-10-15T18:06:03.058658] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-15T18:06:03.058815] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-15T18:06:03.059618] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMG took 47.5s. Estimated remaining: 4h 19m 38s. Rate: 7.3 symbols/min [2025-10-15T18:06:03.812406] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.859409] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.941316] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.946369] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.946998] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-15T18:06:03.947546] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-15T18:06:03.947944] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-15T18:06:03.947993] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-15T18:06:03.948042] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-15T18:06:03.948081] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-15T18:06:03.997611] [DEBUG] [LOCAL ] CMSC: Loaded 4884 existing records from primary storage. [2025-10-15T18:06:04.041288] [INFO ] [MAIN ] CMSC: Loaded 4884 existing records. [2025-10-15T18:06:04.239372] [DEBUG] [LOCAL ] CMRE: Loaded 35862 existing records from primary storage. [2025-10-15T18:06:04.332147] [INFO ] [MAIN ] CMRE: Loaded 35862 existing records. [2025-10-15T18:06:04.624467] [DEBUG] [LOCAL ] CMS: Loaded 52623 existing records from primary storage. [2025-10-15T18:06:04.607175] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:04.630688] [INFO ] [MAIN ] CMS: Loaded 52623 existing records. [2025-10-15T18:06:04.630781] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-15T18:06:04.666991] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-15T18:06:04.757788] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-15T18:06:04.804755] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:04.867361] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-15T18:06:04.885943] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-15T18:06:04.944556] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:05.006525] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-15T18:06:05.055849] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-15T18:06:05.096767] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-15T18:06:05.099807] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-15T18:06:05.089244] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:05.152511] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-15T18:06:05.166411] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-15T18:06:05.252462] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-15T18:06:05.270447] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-15T18:06:05.781513] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:06:05.827224] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-15T18:06:05.865283] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:05.883031] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-15T18:06:06.093030] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:06.116772] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-15T18:06:06.146388] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:06.146679] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-15T18:06:06.412067] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T18:06:06.414715] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-15T18:06:06.646971] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T18:06:06.648762] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-15T18:06:06.850354] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:06:06.852157] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-15T18:06:07.214715] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T18:06:07.216517] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-15T18:06:07.388256] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T18:06:07.393767] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-15T18:06:07.446578] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T18:06:07.448368] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-15T18:06:07.553208] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T18:06:07.695466] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T18:06:07.916938] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T18:06:08.114005] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-15T18:06:08.431473] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T18:06:08.914014] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-15T18:06:09.384875] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T18:06:09.713986] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-15T18:06:09.795267] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:06:10.283513] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:06:10.514009] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-15T18:06:10.869595] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:06:11.313996] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-15T18:06:11.784760] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T18:06:12.113996] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-15T18:06:12.455819] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T18:06:12.914009] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-15T18:06:13.451938] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T18:06:13.714019] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-15T18:06:14.052591] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:06:14.514002] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-15T18:06:15.049927] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:06:15.050925] [INFO ] [REMOTE ] CMSA: Full fetch complete (5098 records). [2025-10-15T18:06:15.050994] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-15T18:06:15.051387] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:06:15.051471] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:06:15.051515] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:06:15.051581] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-15T18:06:15.051666] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-15T18:06:15.051725] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-15T18:06:15.051771] [DEBUG] [LOCAL ] CMSA: No derivative data file found to delete. [2025-10-15T18:06:15.051826] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSA took 12.0s. Estimated remaining: 4h 19m 45s. Rate: 7.3 symbols/min [2025-10-15T18:06:15.218616] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:15.227924] [DEBUG] [LOCAL ] CMSD: Loaded 7911 existing records from primary storage. [2025-10-15T18:06:15.228101] [INFO ] [MAIN ] CMSD: Loaded 7911 existing records. [2025-10-15T18:06:15.319111] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-15T18:06:15.410793] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:15.410999] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-15T18:06:15.411082] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-15T18:06:15.411280] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-15T18:06:15.411338] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-15T18:06:15.764572] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:16.114005] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-15T18:06:16.571118] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:06:16.913999] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-15T18:06:17.391886] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:06:17.713982] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-15T18:06:18.334285] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T18:06:18.514001] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-15T18:06:19.314004] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-15T18:06:19.536631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:06:19.592590] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:06:19.769373] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T18:06:20.114018] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-15T18:06:20.534498] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:06:20.914046] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-15T18:06:21.713981] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-15T18:06:21.984277] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:06:22.222085] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:06:22.514011] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-15T18:06:23.314005] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-15T18:06:23.434730] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T18:06:23.896447] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T18:06:24.113975] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-15T18:06:24.913995] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-15T18:06:25.496303] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:06:25.713991] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-15T18:06:25.926982] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T18:06:26.514036] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-15T18:06:26.955319] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:06:26.955586] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T18:06:27.314010] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-15T18:06:28.114011] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-15T18:06:28.914020] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-15T18:06:29.157109] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T18:06:29.471434] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:06:29.520831] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T18:06:29.714061] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-15T18:06:30.401257] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T18:06:30.402335] [INFO ] [REMOTE ] CMSC: Full fetch complete (7119 records). [2025-10-15T18:06:30.402404] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-15T18:06:30.519168] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-15T18:06:30.770033] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-15T18:06:30.770113] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-15T18:06:30.770327] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-15T18:06:30.770430] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-15T18:06:30.770921] [DEBUG] [LOCAL ] CMSC: Trimmed 7119 records to 4881 (keeping 200 days of data) [2025-10-15T18:06:30.801010] [DEBUG] [LOCAL ] CMSC: Primary data saved (4881 records). [2025-10-15T18:06:30.801155] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-15T18:06:30.801242] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSC took 27.7s. Estimated remaining: 4h 20m 6s. Rate: 7.3 symbols/min [2025-10-15T18:06:30.968132] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:31.007578] [DEBUG] [LOCAL ] CMTG: Loaded 35934 existing records from primary storage. [2025-10-15T18:06:31.007920] [INFO ] [MAIN ] CMTG: Loaded 35934 existing records. [2025-10-15T18:06:31.182146] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:31.182363] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-15T18:06:31.182411] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-15T18:06:31.182816] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-15T18:06:31.182873] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-15T18:06:31.301547] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T18:06:31.317350] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-15T18:06:31.613444] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:32.114060] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-15T18:06:32.883722] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:06:32.913998] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-15T18:06:33.526671] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:06:33.531794] [INFO ] [REMOTE ] CMRE: Full fetch complete (51055 records). [2025-10-15T18:06:33.531933] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-15T18:06:33.721624] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-15T18:06:33.954843] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-15T18:06:33.954921] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-15T18:06:33.955630] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-15T18:06:33.955707] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-15T18:06:33.956722] [DEBUG] [LOCAL ] CMRE: Trimmed 51055 records to 35851 (keeping 200 days of data) [2025-10-15T18:06:34.167142] [DEBUG] [LOCAL ] CMRE: Primary data saved (35851 records). [2025-10-15T18:06:34.167282] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-15T18:06:34.167409] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMRE took 31.1s. Estimated remaining: 4h 19m 39s. Rate: 7.3 symbols/min [2025-10-15T18:06:34.339789] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:34.347938] [DEBUG] [LOCAL ] CMU: Loaded 6338 existing records from primary storage. [2025-10-15T18:06:34.348111] [INFO ] [MAIN ] CMU: Loaded 6338 existing records. [2025-10-15T18:06:34.528744] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:34.529150] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-15T18:06:34.522725] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-15T18:06:34.529357] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-15T18:06:34.530279] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-15T18:06:34.530364] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-15T18:06:34.832298] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T18:06:34.938518] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:34.949537] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T18:06:35.152785] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:06:35.314008] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-15T18:06:35.980093] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T18:06:36.113967] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-15T18:06:36.884591] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T18:06:36.913964] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-15T18:06:37.612484] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:06:37.713981] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-15T18:06:38.151197] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T18:06:38.513996] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-15T18:06:39.164398] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T18:06:39.314005] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-15T18:06:40.104187] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T18:06:40.113953] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-15T18:06:40.505067] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T18:06:40.914044] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-15T18:06:41.491122] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T18:06:41.713989] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-15T18:06:42.514067] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-15T18:06:42.786200] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:06:43.253544] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T18:06:43.313965] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-15T18:06:44.063734] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:06:44.113991] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-15T18:06:44.914036] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-15T18:06:44.924776] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T18:06:45.714009] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-15T18:06:46.040094] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T18:06:46.514053] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-15T18:06:47.122588] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T18:06:47.314046] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-15T18:06:48.072800] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T18:06:48.074445] [INFO ] [REMOTE ] CMSD: Full fetch complete (11876 records). [2025-10-15T18:06:48.074762] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-15T18:06:48.119140] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-15T18:06:48.224234] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T18:06:48.483077] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-15T18:06:48.483156] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-15T18:06:48.483456] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-15T18:06:48.483497] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-15T18:06:48.483979] [DEBUG] [LOCAL ] CMSD: Trimmed 11876 records to 7835 (keeping 200 days of data) [2025-10-15T18:06:48.530979] [DEBUG] [LOCAL ] CMSD: Primary data saved (7835 records). [2025-10-15T18:06:48.531093] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-15T18:06:48.531170] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMSD took 33.5s. Estimated remaining: 4h 19m 54s. Rate: 7.3 symbols/min [2025-10-15T18:06:48.699334] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:48.730115] [DEBUG] [LOCAL ] CNA: Loaded 32938 existing records from primary storage. [2025-10-15T18:06:48.730411] [INFO ] [MAIN ] CNA: Loaded 32938 existing records. [2025-10-15T18:06:48.909678] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:48.909876] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-15T18:06:48.909923] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-15T18:06:48.910112] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-15T18:06:48.910168] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-15T18:06:48.921032] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-15T18:06:49.256980] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:49.523447] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T18:06:49.714021] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-15T18:06:50.158485] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T18:06:50.508059] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T18:06:50.516398] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-15T18:06:51.313979] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-15T18:06:51.735874] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:06:51.946457] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:06:52.113980] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-15T18:06:52.914018] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-15T18:06:53.595997] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T18:06:53.603126] [INFO ] [REMOTE ] CMS: Full fetch complete (76185 records). [2025-10-15T18:06:53.603336] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-15T18:06:53.719114] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-15T18:06:53.724620] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T18:06:54.015174] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-15T18:06:54.015262] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-15T18:06:54.016263] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-15T18:06:54.016330] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-15T18:06:54.017892] [DEBUG] [LOCAL ] CMS: Trimmed 76185 records to 52615 (keeping 200 days of data) [2025-10-15T18:06:54.339670] [DEBUG] [LOCAL ] CMS: Primary data saved (52615 records). [2025-10-15T18:06:54.339806] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-15T18:06:54.340830] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMS took 51.3s. Estimated remaining: 4h 19m 36s. Rate: 7.3 symbols/min [2025-10-15T18:06:54.503671] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:54.514084] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-15T18:06:54.555208] [DEBUG] [LOCAL ] CNC: Loaded 53767 existing records from primary storage. [2025-10-15T18:06:54.555573] [INFO ] [MAIN ] CNC: Loaded 53767 existing records. [2025-10-15T18:06:54.726227] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:54.727053] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-15T18:06:54.727105] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-15T18:06:54.727564] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-15T18:06:54.727603] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-15T18:06:55.078376] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:55.104828] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T18:06:55.314054] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-15T18:06:55.462307] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T18:06:56.113998] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-15T18:06:56.855706] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T18:06:56.913989] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-15T18:06:57.219715] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:06:57.714044] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-15T18:06:58.399217] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T18:06:58.514031] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-15T18:06:58.912306] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T18:06:58.979545] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:06:59.314013] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-15T18:07:00.114046] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-15T18:07:00.658359] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:07:00.765222] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:07:00.914020] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-15T18:07:01.713999] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-15T18:07:02.514052] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-15T18:07:02.635046] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:07:03.006351] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:07:03.314016] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-15T18:07:03.701868] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:07:04.113993] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-15T18:07:04.790076] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T18:07:04.914043] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-15T18:07:05.270605] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T18:07:05.714003] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-15T18:07:06.520832] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-15T18:07:06.540921] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T18:07:06.636622] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T18:07:06.640702] [INFO ] [REMOTE ] CMTG: Full fetch complete (53421 records). [2025-10-15T18:07:06.640885] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-15T18:07:07.054545] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-15T18:07:07.054671] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-15T18:07:07.055404] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-15T18:07:07.055450] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-15T18:07:07.056877] [DEBUG] [LOCAL ] CMTG: Trimmed 53421 records to 35854 (keeping 200 days of data) [2025-10-15T18:07:07.144301] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T18:07:07.146279] [INFO ] [REMOTE ] CMU: Full fetch complete (9538 records). [2025-10-15T18:07:07.146973] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-15T18:07:07.330613] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-15T18:07:07.591319] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-15T18:07:07.616326] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-15T18:07:07.617736] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-15T18:07:07.619792] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-15T18:07:07.622076] [DEBUG] [LOCAL ] CMU: Trimmed 9538 records to 6330 (keeping 200 days of data) [2025-10-15T18:07:07.685853] [DEBUG] [LOCAL ] CMU: Primary data saved (6330 records). [2025-10-15T18:07:07.686184] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-15T18:07:07.685974] [DEBUG] [LOCAL ] CMTG: Primary data saved (35854 records). [2025-10-15T18:07:07.686386] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 33.5s. Estimated remaining: 4h 19m 48s. Rate: 7.2 symbols/min [2025-10-15T18:07:07.686503] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-15T18:07:07.707471] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CMTG took 36.9s. Estimated remaining: 4h 19m 7s. Rate: 7.3 symbols/min [2025-10-15T18:07:08.024763] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:08.042241] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:08.052947] [DEBUG] [LOCAL ] CNF: Loaded 10639 existing records from primary storage. [2025-10-15T18:07:08.053178] [INFO ] [MAIN ] CNF: Loaded 10639 existing records. [2025-10-15T18:07:08.114729] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-15T18:07:08.251106] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:08.251793] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-15T18:07:08.251892] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-15T18:07:08.252076] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-15T18:07:08.252116] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-15T18:07:08.402232] [DEBUG] [LOCAL ] CNH: Loaded 53552 existing records from primary storage. [2025-10-15T18:07:08.432993] [INFO ] [MAIN ] CNH: Loaded 53552 existing records. [2025-10-15T18:07:08.763664] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T18:07:08.817319] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:08.838971] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-15T18:07:08.860877] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-15T18:07:08.881797] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:08.883104] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-15T18:07:08.883201] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-15T18:07:08.919130] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-15T18:07:09.253988] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:09.713971] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-15T18:07:09.725114] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:07:09.947241] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:07:10.514010] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-15T18:07:10.689966] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:07:11.060882] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:07:11.314004] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-15T18:07:12.113999] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-15T18:07:12.914018] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-15T18:07:13.339921] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:07:13.353211] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:07:13.585374] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:07:13.713963] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-15T18:07:14.514054] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-15T18:07:15.029804] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T18:07:15.314014] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-15T18:07:15.891400] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T18:07:16.097074] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T18:07:16.113952] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-15T18:07:16.913994] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-15T18:07:17.406399] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T18:07:17.713995] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-15T18:07:17.880763] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:07:18.514030] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-15T18:07:19.314009] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-15T18:07:19.514986] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:07:19.941546] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T18:07:20.114282] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-15T18:07:20.914048] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-15T18:07:21.207318] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-15T18:07:21.713972] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-15T18:07:21.869206] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:07:21.966001] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:07:22.514017] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-15T18:07:23.314099] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-15T18:07:23.894871] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T18:07:24.113977] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-15T18:07:24.251318] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:07:24.724750] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:07:24.914024] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-15T18:07:25.407726] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T18:07:25.713984] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-15T18:07:25.945864] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:07:26.513971] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-15T18:07:26.639515] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:07:27.314017] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-15T18:07:27.626907] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:07:27.777273] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T18:07:28.113998] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-15T18:07:28.212918] [DEBUG] [REMOTE ] CNF: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-15T18:07:28.213229] [WARN ] [REMOTE ] CNF: No data returned for month 2025-08 [2025-10-15T18:07:28.213316] [FATAL] [REMOTE ] CNF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:07:28.213397] [FATAL] [MAIN ] CNF: Failed to fetch primary data. [2025-10-15T18:07:28.213433] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:07:28.213502] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-15T18:07:28.213568] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-15T18:07:28.213602] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-15T18:07:28.213774] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-15T18:07:28.213858] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNF took 20.5s. Estimated remaining: 4h 19m 46s. Rate: 7.2 symbols/min [2025-10-15T18:07:28.377487] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:28.425871] [DEBUG] [LOCAL ] CNI: Loaded 51687 existing records from primary storage. [2025-10-15T18:07:28.426197] [INFO ] [MAIN ] CNI: Loaded 51687 existing records. [2025-10-15T18:07:28.600066] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:28.600270] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-15T18:07:28.600316] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-15T18:07:28.600866] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-15T18:07:28.600928] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-15T18:07:28.920609] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-15T18:07:28.941922] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:29.713982] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-15T18:07:30.512879] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:07:30.515036] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-15T18:07:30.520288] [INFO ] [REMOTE ] CNC: Full fetch complete (77844 records). [2025-10-15T18:07:30.520370] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-15T18:07:30.828555] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T18:07:30.962939] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-15T18:07:30.963071] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-15T18:07:30.964058] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-15T18:07:30.964121] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-15T18:07:30.965636] [DEBUG] [LOCAL ] CNC: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-10-15T18:07:31.273942] [DEBUG] [LOCAL ] CNC: Primary data saved (53770 records). [2025-10-15T18:07:31.274081] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-15T18:07:31.274405] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNC took 36.9s. Estimated remaining: 4h 19m 18s. Rate: 7.3 symbols/min [2025-10-15T18:07:31.319196] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-15T18:07:31.440367] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:31.488945] [DEBUG] [LOCAL ] CNK: Loaded 52891 existing records from primary storage. [2025-10-15T18:07:31.489293] [INFO ] [MAIN ] CNK: Loaded 52891 existing records. [2025-10-15T18:07:31.662163] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:31.662370] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-15T18:07:31.662417] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-15T18:07:31.662983] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-15T18:07:31.663041] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-15T18:07:32.005097] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:32.113973] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-15T18:07:32.395633] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:07:32.914114] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-15T18:07:33.248835] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:07:33.272138] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T18:07:33.276140] [INFO ] [REMOTE ] CNA: Full fetch complete (46015 records). [2025-10-15T18:07:33.276218] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-15T18:07:33.643880] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-15T18:07:33.643961] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-15T18:07:33.644617] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-15T18:07:33.644686] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-15T18:07:33.645595] [DEBUG] [LOCAL ] CNA: Trimmed 46015 records to 32932 (keeping 200 days of data) [2025-10-15T18:07:33.731741] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-15T18:07:33.838251] [DEBUG] [LOCAL ] CNA: Primary data saved (32932 records). [2025-10-15T18:07:33.838386] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-15T18:07:33.838464] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNA took 45.3s. Estimated remaining: 4h 18m 48s. Rate: 7.3 symbols/min [2025-10-15T18:07:34.003195] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:34.049574] [DEBUG] [LOCAL ] CNM: Loaded 51023 existing records from primary storage. [2025-10-15T18:07:34.049898] [INFO ] [MAIN ] CNM: Loaded 51023 existing records. [2025-10-15T18:07:34.222491] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:34.222679] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-15T18:07:34.222736] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-15T18:07:34.223060] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-15T18:07:34.223120] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-15T18:07:34.516922] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-15T18:07:34.581267] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:34.635985] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:07:35.121050] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:07:35.313981] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-15T18:07:35.944381] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:07:36.113980] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-15T18:07:36.514950] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T18:07:36.914006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-15T18:07:37.630453] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T18:07:37.713951] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-15T18:07:38.513986] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-15T18:07:38.603266] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:07:39.314026] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-15T18:07:39.457297] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T18:07:39.464909] [INFO ] [REMOTE ] CNH: Full fetch complete (77705 records). [2025-10-15T18:07:39.465049] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-15T18:07:39.853009] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-15T18:07:39.853301] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-15T18:07:39.854418] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-15T18:07:39.854485] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-15T18:07:39.856179] [DEBUG] [LOCAL ] CNH: Trimmed 77705 records to 53552 (keeping 200 days of data) [2025-10-15T18:07:40.094908] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T18:07:40.114008] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-15T18:07:40.219532] [DEBUG] [LOCAL ] CNH: Primary data saved (53552 records). [2025-10-15T18:07:40.219709] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-15T18:07:40.219806] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNH took 32.5s. Estimated remaining: 4h 18m 32s. Rate: 7.3 symbols/min [2025-10-15T18:07:40.384202] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:40.413044] [DEBUG] [LOCAL ] CNMD: Loaded 32167 existing records from primary storage. [2025-10-15T18:07:40.413321] [INFO ] [MAIN ] CNMD: Loaded 32167 existing records. [2025-10-15T18:07:40.585572] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:40.585793] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-15T18:07:40.585840] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-15T18:07:40.586586] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-15T18:07:40.586680] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-15T18:07:40.914634] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-15T18:07:40.938252] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:41.173039] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T18:07:41.439289] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:07:41.714073] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-15T18:07:42.400950] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T18:07:42.514068] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-15T18:07:43.230598] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T18:07:43.313975] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-15T18:07:44.018799] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T18:07:44.113955] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-15T18:07:44.781096] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:07:44.913997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-15T18:07:45.626370] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:07:45.714006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-15T18:07:46.266831] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:07:46.514062] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-15T18:07:47.304573] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T18:07:47.314697] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-15T18:07:47.755840] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:07:48.114006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-15T18:07:48.913978] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-15T18:07:48.952437] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T18:07:49.400117] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T18:07:49.714003] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-15T18:07:49.815549] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T18:07:50.514003] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-15T18:07:51.185241] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:07:51.314055] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-15T18:07:52.113980] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-15T18:07:52.169187] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T18:07:52.350591] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:07:52.913993] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-15T18:07:53.535842] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T18:07:53.714014] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-15T18:07:54.514079] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-15T18:07:54.636194] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T18:07:54.830396] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:07:55.314009] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-15T18:07:56.114631] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-15T18:07:56.117310] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:07:56.831039] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:07:56.913978] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-15T18:07:57.383047] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T18:07:57.714005] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-15T18:07:58.338815] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:07:58.513987] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-15T18:07:59.109316] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:07:59.313992] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-15T18:07:59.949334] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T18:08:00.113990] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-15T18:08:00.821413] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:08:00.914010] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-15T18:08:01.714045] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-15T18:08:01.828447] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:08:01.834880] [INFO ] [REMOTE ] CNK: Full fetch complete (75727 records). [2025-10-15T18:08:01.835267] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-15T18:08:01.836239] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:08:01.836340] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:08:01.836383] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:08:01.836436] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-15T18:08:01.836527] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-15T18:08:01.836578] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-15T18:08:01.836780] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-15T18:08:01.837232] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNK took 30.6s. Estimated remaining: 4h 19m 15s. Rate: 7.2 symbols/min [2025-10-15T18:08:02.012341] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:02.048604] [DEBUG] [LOCAL ] CNNE: Loaded 36021 existing records from primary storage. [2025-10-15T18:08:02.049013] [INFO ] [MAIN ] CNNE: Loaded 36021 existing records. [2025-10-15T18:08:02.240417] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:02.240697] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-15T18:08:02.240772] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-15T18:08:02.241411] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-15T18:08:02.241469] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-15T18:08:02.520177] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-15T18:08:02.606435] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:02.659825] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:08:03.227790] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:08:03.314046] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-15T18:08:03.595917] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:08:04.114064] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-15T18:08:04.556571] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:08:04.914099] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-15T18:08:05.658034] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:08:05.710913] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:08:05.716912] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-15T18:08:06.514044] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-15T18:08:07.314077] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-15T18:08:07.568251] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:08:07.574319] [INFO ] [REMOTE ] CNI: Full fetch complete (74811 records). [2025-10-15T18:08:07.574448] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-15T18:08:07.976692] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-15T18:08:07.976951] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-15T18:08:07.978186] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-15T18:08:07.978289] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-15T18:08:08.000810] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T18:08:08.009459] [DEBUG] [LOCAL ] CNI: Trimmed 74811 records to 51698 (keeping 200 days of data) [2025-10-15T18:08:08.115131] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-15T18:08:08.331236] [DEBUG] [LOCAL ] CNI: Primary data saved (51698 records). [2025-10-15T18:08:08.331366] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-15T18:08:08.331441] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNI took 40.1s. Estimated remaining: 4h 18m 60s. Rate: 7.2 symbols/min [2025-10-15T18:08:08.518370] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:08.519535] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T18:08:08.561099] [DEBUG] [LOCAL ] CNO: Loaded 40696 existing records from primary storage. [2025-10-15T18:08:08.561393] [INFO ] [MAIN ] CNO: Loaded 40696 existing records. [2025-10-15T18:08:08.734021] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:08.734185] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-15T18:08:08.734230] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-15T18:08:08.735073] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-15T18:08:08.735130] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-15T18:08:08.919157] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-15T18:08:09.083791] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:09.463440] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T18:08:09.714055] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-15T18:08:10.320460] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T18:08:10.327036] [INFO ] [REMOTE ] CNM: Full fetch complete (73763 records). [2025-10-15T18:08:10.327210] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-15T18:08:10.526543] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-15T18:08:10.767543] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-15T18:08:10.767921] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-15T18:08:10.769170] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-15T18:08:10.769290] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-15T18:08:10.770974] [DEBUG] [LOCAL ] CNM: Trimmed 73763 records to 51035 (keeping 200 days of data) [2025-10-15T18:08:10.986546] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:08:11.087594] [DEBUG] [LOCAL ] CNM: Primary data saved (51035 records). [2025-10-15T18:08:11.087771] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-15T18:08:11.087857] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNM took 37.2s. Estimated remaining: 4h 18m 31s. Rate: 7.3 symbols/min [2025-10-15T18:08:11.251041] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:11.296783] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-15T18:08:11.297082] [INFO ] [MAIN ] CNP: Loaded 53480 existing records. [2025-10-15T18:08:11.319178] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-15T18:08:11.474449] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:11.474719] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-15T18:08:11.474779] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-15T18:08:11.475828] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-15T18:08:11.475884] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-15T18:08:11.827767] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:11.878596] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T18:08:12.113959] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-15T18:08:12.732707] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T18:08:12.913991] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-15T18:08:13.354831] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T18:08:13.714051] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-15T18:08:14.487578] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:08:14.513955] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-15T18:08:14.953067] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T18:08:15.314006] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-15T18:08:16.046222] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:08:16.113958] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-15T18:08:16.508306] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T18:08:16.512089] [INFO ] [REMOTE ] CNMD: Full fetch complete (47238 records). [2025-10-15T18:08:16.512200] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-15T18:08:16.921922] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-15T18:08:16.924595] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-15T18:08:16.925521] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-15T18:08:16.926250] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-15T18:08:16.926419] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-15T18:08:16.927403] [DEBUG] [LOCAL ] CNMD: Trimmed 47238 records to 32127 (keeping 200 days of data) [2025-10-15T18:08:17.144993] [DEBUG] [LOCAL ] CNMD: Primary data saved (32127 records). [2025-10-15T18:08:17.145159] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-15T18:08:17.145261] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNMD took 36.9s. Estimated remaining: 4h 18m 14s. Rate: 7.3 symbols/min [2025-10-15T18:08:17.311168] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:17.365434] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:08:17.391901] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-15T18:08:17.392400] [INFO ] [MAIN ] CNQ: Loaded 53583 existing records. [2025-10-15T18:08:17.566744] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:17.566954] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-15T18:08:17.567001] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-15T18:08:17.567974] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-15T18:08:17.568038] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-15T18:08:17.720977] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-15T18:08:17.939227] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:18.350988] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:08:18.514047] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-15T18:08:19.282566] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T18:08:19.313975] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-15T18:08:20.114044] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-15T18:08:20.338743] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T18:08:20.799849] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:08:20.914026] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-15T18:08:21.411740] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T18:08:21.714002] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-15T18:08:22.272169] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:08:22.513975] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-15T18:08:23.313978] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-15T18:08:23.413959] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:08:23.985506] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:08:24.113981] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-15T18:08:24.701300] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:08:24.913988] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-15T18:08:25.590373] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T18:08:25.713967] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-15T18:08:26.078493] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T18:08:26.513992] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-15T18:08:27.314014] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-15T18:08:27.499074] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:08:27.919384] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:08:28.114037] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-15T18:08:28.914033] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-15T18:08:28.916683] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:08:29.462175] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:08:29.714002] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-15T18:08:30.513974] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-15T18:08:30.568600] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:08:30.992334] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T18:08:31.314097] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-15T18:08:31.641488] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T18:08:32.114014] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-15T18:08:32.809353] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:08:32.913958] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-15T18:08:33.317227] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T18:08:33.714056] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-15T18:08:34.514083] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-15T18:08:34.734919] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:08:35.242190] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T18:08:35.314011] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-15T18:08:35.645793] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:08:36.114002] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-15T18:08:36.913983] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-15T18:08:37.247349] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:08:37.713982] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-15T18:08:37.815287] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T18:08:38.362299] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:08:38.514019] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-15T18:08:38.814474] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T18:08:39.314022] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-15T18:08:39.875407] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T18:08:39.880282] [INFO ] [REMOTE ] CNO: Full fetch complete (60772 records). [2025-10-15T18:08:39.880386] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-15T18:08:40.119109] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-15T18:08:40.298731] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-15T18:08:40.298818] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-15T18:08:40.299700] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-15T18:08:40.299765] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-15T18:08:40.300951] [DEBUG] [LOCAL ] CNO: Trimmed 60772 records to 40648 (keeping 200 days of data) [2025-10-15T18:08:40.546808] [DEBUG] [LOCAL ] CNO: Primary data saved (40648 records). [2025-10-15T18:08:40.546947] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-15T18:08:40.547039] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 32.2s. Estimated remaining: 4h 19m 3s. Rate: 7.2 symbols/min [2025-10-15T18:08:40.716566] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:40.716913] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-15T18:08:40.716984] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-15T18:08:40.717318] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-15T18:08:40.717415] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-15T18:08:40.717498] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-15T18:08:40.717613] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-15T18:08:40.912189] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T18:08:40.929221] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-15T18:08:40.983012] [INFO ] [REMOTE ] CNP: Full fetch complete (77547 records). [2025-10-15T18:08:41.003151] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-15T18:08:41.246600] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:41.553311] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-15T18:08:41.553402] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-15T18:08:41.554466] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-15T18:08:41.554532] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-15T18:08:41.556098] [DEBUG] [LOCAL ] CNP: Trimmed 77547 records to 53480 (keeping 200 days of data) [2025-10-15T18:08:41.702517] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:08:41.765469] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-15T18:08:41.921115] [DEBUG] [LOCAL ] CNP: Primary data saved (53480 records). [2025-10-15T18:08:41.921288] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-15T18:08:41.921383] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNP took 30.8s. Estimated remaining: 4h 18m 29s. Rate: 7.2 symbols/min [2025-10-15T18:08:42.064396] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:08:42.087055] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-15T18:08:42.089470] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:08:42.089398] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:42.089709] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-15T18:08:42.090097] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:08:42.090255] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-15T18:08:42.090341] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-15T18:08:42.090382] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-15T18:08:42.090436] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-15T18:08:42.090590] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNR took 1.5s. Estimated remaining: 4h 17m 50s. Rate: 7.3 symbols/min [2025-10-15T18:08:42.278962] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:42.279967] [DEBUG] [LOCAL ] CNS: Loaded 21073 existing records from primary storage. [2025-10-15T18:08:42.280783] [INFO ] [MAIN ] CNS: Loaded 21073 existing records. [2025-10-15T18:08:42.466004] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:42.479416] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-15T18:08:42.479487] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-15T18:08:42.480006] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-15T18:08:42.480063] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-15T18:08:42.518717] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-15T18:08:42.626474] [DEBUG] [LOCAL ] CNX: Loaded 51365 existing records from primary storage. [2025-10-15T18:08:42.650570] [INFO ] [MAIN ] CNX: Loaded 51365 existing records. [2025-10-15T18:08:43.007283] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:43.007699] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-15T18:08:43.007770] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-15T18:08:43.031448] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-15T18:08:43.058222] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-15T18:08:43.061115] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:43.317934] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-15T18:08:43.381939] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-15T18:08:43.471480] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:43.864442] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T18:08:44.114015] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-15T18:08:44.475008] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T18:08:44.914022] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-15T18:08:45.714012] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-15T18:08:45.891567] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T18:08:45.989279] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T18:08:46.514040] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-15T18:08:46.989325] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T18:08:46.993571] [INFO ] [REMOTE ] CNNE: Full fetch complete (50455 records). [2025-10-15T18:08:46.993723] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-15T18:08:47.327720] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-15T18:08:47.378904] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-15T18:08:47.378998] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-15T18:08:47.379754] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-15T18:08:47.379822] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-15T18:08:47.381011] [DEBUG] [LOCAL ] CNNE: Trimmed 50455 records to 35946 (keeping 200 days of data) [2025-10-15T18:08:47.597942] [DEBUG] [LOCAL ] CNNE: Primary data saved (35946 records). [2025-10-15T18:08:47.598126] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-15T18:08:47.598436] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNNE took 45.8s. Estimated remaining: 4h 17m 31s. Rate: 7.3 symbols/min [2025-10-15T18:08:47.765744] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:47.765919] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-15T18:08:47.765975] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-15T18:08:47.766078] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-15T18:08:47.766120] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-15T18:08:47.766162] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-15T18:08:47.766195] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-15T18:08:48.115241] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-15T18:08:48.115156] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:48.147914] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T18:08:48.914008] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-15T18:08:49.010563] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:08:49.091097] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T18:08:49.713973] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-15T18:08:50.100843] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T18:08:50.513995] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-15T18:08:51.229518] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T18:08:51.235983] [INFO ] [REMOTE ] CNQ: Full fetch complete (77737 records). [2025-10-15T18:08:51.236128] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-15T18:08:51.319119] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-15T18:08:51.634250] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-15T18:08:51.634328] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-15T18:08:51.635248] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-15T18:08:51.635312] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-15T18:08:51.636911] [DEBUG] [LOCAL ] CNQ: Trimmed 77737 records to 53582 (keeping 200 days of data) [2025-10-15T18:08:51.895464] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:08:52.006510] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-10-15T18:08:52.006679] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-15T18:08:52.007764] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNQ took 34.9s. Estimated remaining: 4h 17m 9s. Rate: 7.3 symbols/min [2025-10-15T18:08:52.119106] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-15T18:08:52.182360] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:52.235281] [DEBUG] [LOCAL ] COF: Loaded 53619 existing records from primary storage. [2025-10-15T18:08:52.235714] [INFO ] [MAIN ] COF: Loaded 53619 existing records. [2025-10-15T18:08:52.350187] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:08:52.432774] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:52.432991] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-15T18:08:52.433038] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-15T18:08:52.434067] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-15T18:08:52.434127] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-15T18:08:52.785430] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:52.914018] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-15T18:08:53.618079] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:08:53.713983] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-15T18:08:54.004000] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:08:54.514027] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-15T18:08:55.313966] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-15T18:08:55.444082] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T18:08:55.538399] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:08:56.114018] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-15T18:08:56.290520] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:08:56.914046] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-15T18:08:57.714025] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-15T18:08:57.927134] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T18:08:58.513993] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-15T18:08:58.618915] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:08:59.108453] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-15T18:08:59.313989] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-15T18:08:59.414439] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T18:09:00.113987] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-15T18:09:00.168513] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T18:09:00.914012] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-15T18:09:01.714016] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-15T18:09:01.870940] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T18:09:02.514052] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-15T18:09:02.793046] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T18:09:02.949462] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T18:09:03.314012] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-15T18:09:03.889425] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:09:04.114065] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-15T18:09:04.914030] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-15T18:09:05.099762] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:09:05.713993] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-15T18:09:05.877435] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:09:06.484044] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T18:09:06.513963] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-15T18:09:07.108571] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T18:09:07.314016] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-15T18:09:07.806820] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:09:08.114012] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-15T18:09:08.530843] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:09:08.914009] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-15T18:09:09.713967] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-15T18:09:09.980494] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T18:09:10.138290] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:09:10.513999] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-15T18:09:11.226443] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T18:09:11.313329] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:09:11.317719] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-15T18:09:12.113990] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-15T18:09:12.914013] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-15T18:09:13.020731] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T18:09:13.027503] [INFO ] [REMOTE ] CNX: Full fetch complete (74928 records). [2025-10-15T18:09:13.027922] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-15T18:09:13.426063] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-15T18:09:13.426185] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-15T18:09:13.427333] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-15T18:09:13.427410] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-15T18:09:13.429428] [DEBUG] [LOCAL ] CNX: Trimmed 74928 records to 51367 (keeping 200 days of data) [2025-10-15T18:09:13.727683] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-15T18:09:13.750159] [DEBUG] [LOCAL ] CNX: Primary data saved (51367 records). [2025-10-15T18:09:13.750369] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-15T18:09:13.750473] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNX took 31.7s. Estimated remaining: 4h 17m 51s. Rate: 7.2 symbols/min [2025-10-15T18:09:13.940141] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:14.000996] [DEBUG] [LOCAL ] COHR: Loaded 53376 existing records from primary storage. [2025-10-15T18:09:14.001575] [INFO ] [MAIN ] COHR: Loaded 53376 existing records. [2025-10-15T18:09:14.153328] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T18:09:14.255990] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:14.256520] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-15T18:09:14.256610] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-15T18:09:14.257089] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-15T18:09:14.257169] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-15T18:09:14.516918] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-15T18:09:14.571526] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:09:14.702727] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:14.704074] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T18:09:15.314043] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-15T18:09:16.114071] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-15T18:09:16.394872] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:09:16.913980] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-15T18:09:17.256780] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T18:09:17.256477] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T18:09:17.270892] [INFO ] [REMOTE ] CNS: Full fetch complete (30764 records). [2025-10-15T18:09:17.270978] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-15T18:09:17.631443] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-15T18:09:17.631517] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-15T18:09:17.632073] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-15T18:09:17.632134] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-15T18:09:17.632916] [DEBUG] [LOCAL ] CNS: Trimmed 30764 records to 21154 (keeping 200 days of data) [2025-10-15T18:09:17.718887] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-15T18:09:17.762582] [DEBUG] [LOCAL ] CNS: Primary data saved (21154 records). [2025-10-15T18:09:17.762732] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-15T18:09:17.762816] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. CNS took 35.8s. Estimated remaining: 4h 17m 26s. Rate: 7.3 symbols/min [2025-10-15T18:09:17.933858] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:17.985608] [DEBUG] [LOCAL ] COLD: Loaded 52370 existing records from primary storage. [2025-10-15T18:09:17.985965] [INFO ] [MAIN ] COLD: Loaded 52370 existing records. [2025-10-15T18:09:18.163517] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:18.163753] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-15T18:09:18.163804] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-15T18:09:18.164179] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-15T18:09:18.164219] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-15T18:09:18.517996] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-15T18:09:18.547353] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T18:09:18.553214] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:19.313984] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-15T18:09:19.663170] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T18:09:20.114051] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-15T18:09:20.343541] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:09:20.777472] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T18:09:20.914010] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-15T18:09:21.645164] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T18:09:21.651204] [INFO ] [REMOTE ] CODI: Full fetch complete (52633 records). [2025-10-15T18:09:21.651374] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-15T18:09:21.719161] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-15T18:09:22.061757] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-15T18:09:22.061839] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-15T18:09:22.062585] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-15T18:09:22.062627] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-15T18:09:22.063781] [DEBUG] [LOCAL ] CODI: Trimmed 52633 records to 41441 (keeping 200 days of data) [2025-10-15T18:09:22.300187] [DEBUG] [LOCAL ] CODI: Primary data saved (41441 records). [2025-10-15T18:09:22.300316] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-15T18:09:22.300388] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CODI took 34.7s. Estimated remaining: 4h 17m 4s. Rate: 7.3 symbols/min [2025-10-15T18:09:22.476141] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:22.514034] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-15T18:09:22.530149] [DEBUG] [LOCAL ] COMP: Loaded 53405 existing records from primary storage. [2025-10-15T18:09:22.530419] [INFO ] [MAIN ] COMP: Loaded 53405 existing records. [2025-10-15T18:09:22.715622] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:22.716128] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-15T18:09:22.716369] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-15T18:09:22.716731] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-15T18:09:22.716792] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-15T18:09:23.082557] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:23.153786] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:09:23.167249] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T18:09:23.313981] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-15T18:09:24.113993] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-15T18:09:24.377192] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T18:09:24.549186] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:09:24.914026] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-15T18:09:25.714063] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-15T18:09:26.006074] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T18:09:26.514086] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-15T18:09:26.615294] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:09:27.038811] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T18:09:27.314401] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-15T18:09:27.917348] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:09:28.114097] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-15T18:09:28.914004] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-15T18:09:29.251768] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T18:09:29.674869] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:09:29.714204] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-15T18:09:30.519096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-15T18:09:30.538440] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T18:09:31.314002] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-15T18:09:31.430822] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:09:31.863793] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:09:32.113985] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-15T18:09:32.891243] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:09:32.913967] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-15T18:09:33.378610] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:09:33.714058] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-15T18:09:34.386824] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:09:34.435621] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:09:34.442072] [INFO ] [REMOTE ] COF: Full fetch complete (77632 records). [2025-10-15T18:09:34.442200] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-15T18:09:34.519071] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-15T18:09:34.822534] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-15T18:09:34.822620] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-15T18:09:34.823537] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-15T18:09:34.823615] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-15T18:09:34.825061] [DEBUG] [LOCAL ] COF: Trimmed 77632 records to 53622 (keeping 200 days of data) [2025-10-15T18:09:35.155384] [DEBUG] [LOCAL ] COF: Primary data saved (53622 records). [2025-10-15T18:09:35.155535] [INFO ] [MAIN ] COF: Full history saved. [2025-10-15T18:09:35.156394] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COF took 43.1s. Estimated remaining: 4h 17m 13s. Rate: 7.3 symbols/min [2025-10-15T18:09:35.319321] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-15T18:09:35.321833] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:35.360831] [DEBUG] [LOCAL ] CON: Loaded 38883 existing records from primary storage. [2025-10-15T18:09:35.361104] [INFO ] [MAIN ] CON: Loaded 38883 existing records. [2025-10-15T18:09:35.533725] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:35.533945] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-15T18:09:35.533994] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-15T18:09:35.534895] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-15T18:09:35.534979] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-15T18:09:35.885158] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:35.959548] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T18:09:36.113976] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-15T18:09:36.870840] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:09:36.913955] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-15T18:09:37.676336] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T18:09:37.713953] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-15T18:09:38.513976] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-15T18:09:38.590256] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T18:09:38.703018] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T18:09:39.314065] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-15T18:09:40.114055] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-15T18:09:40.175258] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T18:09:40.338579] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:09:40.914012] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-15T18:09:41.714005] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-15T18:09:42.363126] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T18:09:42.514013] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-15T18:09:42.659167] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:09:43.314030] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-15T18:09:43.365951] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:09:43.918458] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:09:44.113995] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-15T18:09:44.914027] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-15T18:09:45.489456] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T18:09:45.663088] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T18:09:45.713984] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-15T18:09:45.987277] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T18:09:46.514050] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-15T18:09:47.314006] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-15T18:09:47.535700] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:09:48.113986] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-15T18:09:48.202461] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T18:09:48.914032] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-15T18:09:49.169285] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T18:09:49.176200] [INFO ] [REMOTE ] COHR: Full fetch complete (77421 records). [2025-10-15T18:09:49.176391] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-15T18:09:49.573703] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-15T18:09:49.573852] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-15T18:09:49.574952] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-15T18:09:49.575017] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-15T18:09:49.576567] [DEBUG] [LOCAL ] COHR: Trimmed 77421 records to 53381 (keeping 200 days of data) [2025-10-15T18:09:49.776090] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-15T18:09:49.937573] [DEBUG] [LOCAL ] COHR: Primary data saved (53381 records). [2025-10-15T18:09:49.937821] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-15T18:09:49.938032] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COHR took 36.2s. Estimated remaining: 4h 17m 29s. Rate: 7.2 symbols/min [2025-10-15T18:09:50.077380] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T18:09:50.163706] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:50.187067] [DEBUG] [LOCAL ] COOK: Loaded 24891 existing records from primary storage. [2025-10-15T18:09:50.187349] [INFO ] [MAIN ] COOK: Loaded 24891 existing records. [2025-10-15T18:09:50.365884] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:50.366292] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-15T18:09:50.366368] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-15T18:09:50.367203] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-15T18:09:50.367266] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-15T18:09:50.521212] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-15T18:09:50.723121] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T18:09:50.794409] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:51.221005] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T18:09:51.314034] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-15T18:09:52.114039] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-15T18:09:52.357230] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T18:09:52.363733] [INFO ] [REMOTE ] COMP: Full fetch complete (77385 records). [2025-10-15T18:09:52.363910] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-15T18:09:52.766239] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-15T18:09:52.766405] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-15T18:09:52.767947] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-15T18:09:52.768029] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-15T18:09:52.770736] [DEBUG] [LOCAL ] COMP: Trimmed 77385 records to 53406 (keeping 200 days of data) [2025-10-15T18:09:52.941138] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-15T18:09:53.098416] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T18:09:53.123428] [INFO ] [REMOTE ] COLD: Full fetch complete (74696 records). [2025-10-15T18:09:53.125891] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-15T18:09:53.165342] [DEBUG] [LOCAL ] COMP: Primary data saved (53406 records). [2025-10-15T18:09:53.205381] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-15T18:09:53.217036] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COMP took 30.9s. Estimated remaining: 4h 17m 2s. Rate: 7.2 symbols/min [2025-10-15T18:09:53.614336] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:53.722900] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-15T18:09:53.723120] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-15T18:09:53.724538] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-15T18:09:53.739499] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-15T18:09:53.750231] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T18:09:53.762047] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-15T18:09:53.763341] [DEBUG] [LOCAL ] COLD: Trimmed 74696 records to 52391 (keeping 200 days of data) [2025-10-15T18:09:53.925884] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-15T18:09:53.927540] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-15T18:09:54.344184] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:54.360680] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-15T18:09:54.362795] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-15T18:09:54.366293] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-15T18:09:54.365853] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T18:09:54.369088] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-15T18:09:54.383709] [DEBUG] [LOCAL ] COLD: Primary data saved (52391 records). [2025-10-15T18:09:54.438771] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-15T18:09:54.461030] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COLD took 36.7s. Estimated remaining: 4h 16m 28s. Rate: 7.3 symbols/min [2025-10-15T18:09:54.519287] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-15T18:09:54.835083] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:54.950862] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:54.978809] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:09:55.021502] [DEBUG] [LOCAL ] COR: Loaded 46682 existing records from primary storage. [2025-10-15T18:09:55.021926] [INFO ] [MAIN ] COR: Loaded 46682 existing records. [2025-10-15T18:09:55.195691] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:55.195929] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-15T18:09:55.195980] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-15T18:09:55.196816] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-15T18:09:55.196887] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-15T18:09:55.319180] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-15T18:09:55.548760] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T18:09:55.578978] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:56.114030] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-15T18:09:56.914067] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-15T18:09:57.499174] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T18:09:57.519078] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T18:09:57.713982] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-15T18:09:57.799405] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:09:58.514023] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-15T18:09:58.748740] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:09:59.314024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-15T18:10:00.114044] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-15T18:10:00.361433] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T18:10:00.913970] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-15T18:10:00.996193] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T18:10:01.083481] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:10:01.713998] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-15T18:10:02.513983] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-15T18:10:02.727274] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:10:03.092437] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:10:03.313999] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-15T18:10:03.757848] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:10:04.114040] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-15T18:10:04.754958] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T18:10:04.913993] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-15T18:10:05.575161] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T18:10:05.713996] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-15T18:10:05.932266] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T18:10:06.513988] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-15T18:10:07.224884] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:10:07.312481] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:10:07.317612] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-15T18:10:08.114016] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-15T18:10:08.914046] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-15T18:10:09.015895] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:10:09.274881] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T18:10:09.714042] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-15T18:10:10.073966] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T18:10:10.078790] [INFO ] [REMOTE ] CON: Full fetch complete (56911 records). [2025-10-15T18:10:10.078912] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-15T18:10:10.452070] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-15T18:10:10.452150] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-15T18:10:10.452901] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-15T18:10:10.452964] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-15T18:10:10.455469] [DEBUG] [LOCAL ] CON: Trimmed 56911 records to 38935 (keeping 200 days of data) [2025-10-15T18:10:10.517790] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-15T18:10:10.692581] [DEBUG] [LOCAL ] CON: Primary data saved (38935 records). [2025-10-15T18:10:10.692776] [INFO ] [MAIN ] CON: Full history saved. [2025-10-15T18:10:10.692892] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. CON took 35.5s. Estimated remaining: 4h 16m 49s. Rate: 7.2 symbols/min [2025-10-15T18:10:10.866768] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:10.914612] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T18:10:10.942873] [DEBUG] [LOCAL ] COTY: Loaded 53268 existing records from primary storage. [2025-10-15T18:10:10.943290] [INFO ] [MAIN ] COTY: Loaded 53268 existing records. [2025-10-15T18:10:11.126837] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:11.127110] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-15T18:10:11.127163] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-15T18:10:11.127900] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-15T18:10:11.127957] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-15T18:10:11.322680] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-15T18:10:11.495925] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:12.114114] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-15T18:10:12.368006] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T18:10:12.914016] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-15T18:10:13.724052] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-15T18:10:13.726626] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:10:14.149009] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-15T18:10:14.152754] [INFO ] [REMOTE ] COOK: Full fetch complete (33222 records). [2025-10-15T18:10:14.152847] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-15T18:10:14.516733] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-15T18:10:14.528625] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-15T18:10:14.528879] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-15T18:10:14.530064] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-15T18:10:14.530140] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-15T18:10:14.531068] [DEBUG] [LOCAL ] COOK: Trimmed 33222 records to 24994 (keeping 200 days of data) [2025-10-15T18:10:14.672668] [DEBUG] [LOCAL ] COOK: Primary data saved (24994 records). [2025-10-15T18:10:14.672813] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-15T18:10:14.672892] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COOK took 24.7s. Estimated remaining: 4h 16m 25s. Rate: 7.3 symbols/min [2025-10-15T18:10:14.844453] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:14.887101] [DEBUG] [LOCAL ] COUR: Loaded 49240 existing records from primary storage. [2025-10-15T18:10:14.887444] [INFO ] [MAIN ] COUR: Loaded 49240 existing records. [2025-10-15T18:10:15.074869] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:15.075231] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-15T18:10:15.075314] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-15T18:10:15.091226] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-15T18:10:15.101817] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-15T18:10:15.183522] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-15T18:10:15.339194] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-15T18:10:15.488745] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:16.113964] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-15T18:10:16.240550] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:10:16.914065] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-15T18:10:17.351845] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (3.63 seconds). [2025-10-15T18:10:17.463766] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T18:10:17.714056] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-15T18:10:17.918955] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:10:18.514016] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-15T18:10:18.576362] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:10:19.314056] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-15T18:10:20.113989] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-15T18:10:20.318140] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T18:10:20.355789] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-15T18:10:20.710511] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:10:20.914080] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-15T18:10:21.680716] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:10:21.713962] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-15T18:10:22.513987] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-15T18:10:22.563198] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T18:10:22.828361] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T18:10:23.314004] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-15T18:10:24.123739] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-15T18:10:24.146140] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:10:24.564295] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:10:24.914056] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-15T18:10:25.714061] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-15T18:10:25.847602] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:10:26.258929] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:10:26.514094] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-15T18:10:27.078206] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T18:10:27.086076] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-15T18:10:27.086254] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-15T18:10:27.319147] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-15T18:10:27.509273] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-15T18:10:27.524439] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-15T18:10:27.538238] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-15T18:10:27.538364] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-15T18:10:27.540758] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T18:10:27.552294] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-15T18:10:27.870708] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-15T18:10:27.870842] [INFO ] [MAIN ] COP: Full history saved. [2025-10-15T18:10:27.870918] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COP took 34.6s. Estimated remaining: 4h 16m 35s. Rate: 7.2 symbols/min [2025-10-15T18:10:28.061231] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:28.107298] [DEBUG] [LOCAL ] CP: Loaded 53250 existing records from primary storage. [2025-10-15T18:10:28.107593] [INFO ] [MAIN ] CP: Loaded 53250 existing records. [2025-10-15T18:10:28.120156] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-15T18:10:28.286868] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:28.287086] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-15T18:10:28.287132] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-15T18:10:28.288088] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-15T18:10:28.288145] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-15T18:10:28.640609] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:28.913986] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-15T18:10:29.038874] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:10:29.714022] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-15T18:10:30.144504] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T18:10:30.514002] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-15T18:10:30.566602] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T18:10:31.270175] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:10:31.313968] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-15T18:10:32.113974] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-15T18:10:32.283375] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:10:32.913985] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-15T18:10:33.097336] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:10:33.515307] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T18:10:33.714023] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-15T18:10:34.162583] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:10:34.514003] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-15T18:10:35.290328] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:10:35.295598] [INFO ] [REMOTE ] COR: Full fetch complete (68607 records). [2025-10-15T18:10:35.295800] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-15T18:10:35.319147] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-15T18:10:35.681825] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-15T18:10:35.681914] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-15T18:10:35.682839] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-15T18:10:35.682908] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-15T18:10:35.684456] [DEBUG] [LOCAL ] COR: Trimmed 68607 records to 46611 (keeping 200 days of data) [2025-10-15T18:10:35.977825] [DEBUG] [LOCAL ] COR: Primary data saved (46611 records). [2025-10-15T18:10:35.978000] [INFO ] [MAIN ] COR: Full history saved. [2025-10-15T18:10:35.978112] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COR took 41.5s. Estimated remaining: 4h 16m 26s. Rate: 7.2 symbols/min [2025-10-15T18:10:36.124853] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-15T18:10:36.158264] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:36.186741] [DEBUG] [LOCAL ] CPA: Loaded 28481 existing records from primary storage. [2025-10-15T18:10:36.187117] [INFO ] [MAIN ] CPA: Loaded 28481 existing records. [2025-10-15T18:10:36.376250] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:36.376560] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-15T18:10:36.376620] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-15T18:10:36.416065] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-15T18:10:36.416235] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-15T18:10:36.485807] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T18:10:36.814385] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:36.919121] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-15T18:10:36.933332] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:10:37.714050] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-15T18:10:37.827753] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T18:10:38.314423] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T18:10:38.513988] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-15T18:10:39.314035] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-15T18:10:39.383382] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:10:40.004122] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:10:40.114034] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-15T18:10:40.913977] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-15T18:10:41.044924] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:10:41.629106] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:10:41.713968] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-15T18:10:42.514054] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-15T18:10:42.803250] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T18:10:42.809720] [INFO ] [REMOTE ] COUR: Full fetch complete (71018 records). [2025-10-15T18:10:42.809867] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-15T18:10:43.190001] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-15T18:10:43.190134] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-15T18:10:43.191040] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-15T18:10:43.191103] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-15T18:10:43.192422] [DEBUG] [LOCAL ] COUR: Trimmed 71018 records to 49310 (keeping 200 days of data) [2025-10-15T18:10:43.352254] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-15T18:10:43.481543] [DEBUG] [LOCAL ] COUR: Primary data saved (49310 records). [2025-10-15T18:10:43.482057] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-15T18:10:43.482376] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COUR took 28.8s. Estimated remaining: 4h 16m 14s. Rate: 7.2 symbols/min [2025-10-15T18:10:43.652679] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:43.653153] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-15T18:10:43.682840] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-15T18:10:43.685377] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T18:10:43.685536] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-15T18:10:43.696312] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-15T18:10:43.696593] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-15T18:10:43.696842] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-15T18:10:43.993635] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:10:44.097966] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:44.114039] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-15T18:10:44.913966] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-15T18:10:45.005097] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:10:45.721126] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-15T18:10:45.726535] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:10:46.158795] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:10:46.167354] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T18:10:46.514009] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-15T18:10:46.841768] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T18:10:47.313994] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-15T18:10:48.114033] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-15T18:10:48.457520] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T18:10:48.896526] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T18:10:48.913941] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-15T18:10:49.713991] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-15T18:10:50.263881] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:10:50.513970] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-15T18:10:50.851846] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T18:10:51.185976] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:10:51.313989] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-15T18:10:51.651468] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T18:10:52.113996] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-15T18:10:52.913990] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-15T18:10:53.225134] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-15T18:10:53.245513] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T18:10:53.713995] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-15T18:10:54.514011] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-15T18:10:55.314004] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-15T18:10:55.676522] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:10:55.683134] [INFO ] [REMOTE ] COTY: Full fetch complete (77287 records). [2025-10-15T18:10:55.683252] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-15T18:10:56.071190] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-15T18:10:56.071339] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-15T18:10:56.072299] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-15T18:10:56.072385] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-15T18:10:56.073981] [DEBUG] [LOCAL ] COTY: Trimmed 77287 records to 53271 (keeping 200 days of data) [2025-10-15T18:10:56.119887] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-15T18:10:56.403712] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T18:10:56.415332] [DEBUG] [LOCAL ] COTY: Primary data saved (53271 records). [2025-10-15T18:10:56.425970] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-15T18:10:56.427513] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COTY took 45.7s. Estimated remaining: 4h 16m 23s. Rate: 7.2 symbols/min [2025-10-15T18:10:56.599866] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:56.600151] [DEBUG] [LOCAL ] CPAY: No existing data file found in primary storage. [2025-10-15T18:10:56.600204] [WARN ] [MAIN ] CPAY: No existing data found, performing full refresh instead. [2025-10-15T18:10:56.600371] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-15T18:10:56.600427] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-15T18:10:56.600501] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-10-15T18:10:56.600662] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-15T18:10:56.665087] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T18:10:56.773292] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T18:10:56.919075] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-15T18:10:56.985150] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:57.408303] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T18:10:57.714012] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-15T18:10:58.514055] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-15T18:10:58.854616] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T18:10:58.905606] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T18:10:59.313997] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-15T18:10:59.751545] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T18:11:00.114008] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-15T18:11:00.914000] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-15T18:11:01.714012] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-15T18:11:01.784786] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:11:02.207676] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T18:11:02.245708] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T18:11:02.246524] [INFO ] [REMOTE ] CPAC: Full fetch complete (1852 records). [2025-10-15T18:11:02.246595] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-15T18:11:02.437519] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T18:11:02.437777] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:11:02.437869] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:11:02.437943] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-15T18:11:02.438011] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-15T18:11:02.438048] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-15T18:11:02.438087] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-15T18:11:02.438146] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CPAC took 19.0s. Estimated remaining: 4h 16m 7s. Rate: 7.2 symbols/min [2025-10-15T18:11:02.519195] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-15T18:11:02.630351] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:02.630532] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-15T18:11:02.630570] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-15T18:11:02.630709] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-15T18:11:02.630762] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-15T18:11:02.630804] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-15T18:11:02.630837] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-15T18:11:03.032212] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:03.314010] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-15T18:11:03.906584] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:11:04.113984] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-15T18:11:04.343276] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T18:11:04.914014] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-15T18:11:05.714005] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-15T18:11:05.910796] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T18:11:06.368040] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:11:06.513976] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-15T18:11:06.992935] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T18:11:07.314112] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-15T18:11:07.737490] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T18:11:07.990856] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T18:11:08.114026] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-15T18:11:08.914072] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-15T18:11:09.250694] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:11:09.714015] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-15T18:11:10.480940] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:11:10.513952] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-15T18:11:10.788707] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T18:11:11.313991] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-15T18:11:12.113983] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-15T18:11:12.307247] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:11:12.313602] [INFO ] [REMOTE ] CP: Full fetch complete (77292 records). [2025-10-15T18:11:12.313795] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-15T18:11:12.703397] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-15T18:11:12.703575] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-15T18:11:12.704537] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-15T18:11:12.704600] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-15T18:11:12.706370] [DEBUG] [LOCAL ] CP: Trimmed 77292 records to 53238 (keeping 200 days of data) [2025-10-15T18:11:12.724889] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:11:12.915677] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-15T18:11:13.061879] [DEBUG] [LOCAL ] CP: Primary data saved (53238 records). [2025-10-15T18:11:13.062095] [INFO ] [MAIN ] CP: Full history saved. [2025-10-15T18:11:13.062337] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CP took 45.2s. Estimated remaining: 4h 16m 7s. Rate: 7.2 symbols/min [2025-10-15T18:11:13.191127] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:11:13.242055] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:13.259182] [DEBUG] [LOCAL ] CPK: Loaded 13850 existing records from primary storage. [2025-10-15T18:11:13.259422] [INFO ] [MAIN ] CPK: Loaded 13850 existing records. [2025-10-15T18:11:13.428417] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:13.428635] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-15T18:11:13.428720] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-15T18:11:13.428973] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-15T18:11:13.429028] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-15T18:11:13.719192] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-15T18:11:13.779759] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:14.017726] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:11:14.021165] [INFO ] [REMOTE ] CPA: Full fetch complete (41508 records). [2025-10-15T18:11:14.021247] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-15T18:11:14.388007] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-15T18:11:14.388084] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-15T18:11:14.388727] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-15T18:11:14.388787] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-15T18:11:14.389616] [DEBUG] [LOCAL ] CPA: Trimmed 41508 records to 28423 (keeping 200 days of data) [2025-10-15T18:11:14.515068] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-15T18:11:14.569326] [DEBUG] [LOCAL ] CPA: Primary data saved (28423 records). [2025-10-15T18:11:14.569525] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-15T18:11:14.569615] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPA took 38.6s. Estimated remaining: 4h 15m 34s. Rate: 7.3 symbols/min [2025-10-15T18:11:14.752074] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:14.765077] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T18:11:14.823709] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-15T18:11:14.824047] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-15T18:11:15.011180] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:15.011413] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-15T18:11:15.011460] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-15T18:11:15.011960] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-15T18:11:15.012014] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-15T18:11:15.317699] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-15T18:11:15.389415] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:15.390411] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T18:11:16.113988] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-15T18:11:16.399837] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:11:16.914011] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-15T18:11:17.279178] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T18:11:17.463928] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T18:11:17.713990] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-15T18:11:18.514012] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-15T18:11:19.314062] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-15T18:11:19.898746] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:11:20.068413] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-15T18:11:20.109134] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:11:20.113942] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-15T18:11:20.833039] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T18:11:20.914000] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-15T18:11:21.713999] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-15T18:11:21.908916] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T18:11:22.514001] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-15T18:11:23.314060] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-15T18:11:23.578405] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T18:11:23.844183] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-15T18:11:23.873822] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:11:24.114007] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-15T18:11:24.914050] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-15T18:11:25.714037] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-15T18:11:25.742389] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T18:11:26.235559] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T18:11:26.439320] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:11:26.514020] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-15T18:11:27.314002] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-15T18:11:28.114001] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-15T18:11:28.456035] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T18:11:28.567793] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T18:11:28.913971] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-15T18:11:29.131327] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T18:11:29.133691] [INFO ] [REMOTE ] CPF: Full fetch complete (23595 records). [2025-10-15T18:11:29.133765] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-15T18:11:29.493206] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-15T18:11:29.493280] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-15T18:11:29.493781] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-15T18:11:29.493840] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-15T18:11:29.494404] [DEBUG] [LOCAL ] CPF: Trimmed 23595 records to 15271 (keeping 200 days of data) [2025-10-15T18:11:29.589684] [DEBUG] [LOCAL ] CPF: Primary data saved (15271 records). [2025-10-15T18:11:29.589834] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-15T18:11:29.589909] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPF took 27.2s. Estimated remaining: 4h 15m 50s. Rate: 7.2 symbols/min [2025-10-15T18:11:29.714051] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-15T18:11:30.514060] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-15T18:11:30.736128] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T18:11:30.915838] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:11:30.919546] [INFO ] [REMOTE ] CPAY: Full fetch complete (44821 records). [2025-10-15T18:11:30.919740] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-15T18:11:31.308101] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-15T18:11:31.308236] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-15T18:11:31.309008] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-15T18:11:31.309102] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-15T18:11:31.310322] [DEBUG] [LOCAL ] CPAY: Trimmed 44821 records to 30434 (keeping 200 days of data) [2025-10-15T18:11:31.314056] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-15T18:11:31.419831] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T18:11:31.510125] [DEBUG] [LOCAL ] CPAY: Primary data saved (30434 records). [2025-10-15T18:11:31.510268] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-15T18:11:31.510341] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPAY took 35.1s. Estimated remaining: 4h 15m 19s. Rate: 7.2 symbols/min [2025-10-15T18:11:32.114044] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-15T18:11:33.199190] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T18:11:33.204002] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-15T18:11:33.478351] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-15T18:11:33.714041] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-15T18:11:33.962196] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T18:11:34.514040] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-15T18:11:35.372040] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T18:11:35.377006] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-15T18:11:35.809208] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T18:11:36.077534] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T18:11:36.114070] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-15T18:11:36.914034] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-15T18:11:37.034255] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T18:11:37.714046] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-15T18:11:38.572197] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T18:11:38.575572] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-15T18:11:39.230583] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-15T18:11:39.313961] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-15T18:11:39.549954] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T18:11:39.553486] [INFO ] [REMOTE ] CPK: Full fetch complete (18430 records). [2025-10-15T18:11:39.553582] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-15T18:11:39.930399] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-15T18:11:39.930495] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-15T18:11:39.930922] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-15T18:11:39.930982] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-15T18:11:39.931508] [DEBUG] [LOCAL ] CPK: Trimmed 18430 records to 13940 (keeping 200 days of data) [2025-10-15T18:11:40.020318] [DEBUG] [LOCAL ] CPK: Primary data saved (13940 records). [2025-10-15T18:11:40.020465] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-15T18:11:40.020576] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPK took 27.0s. Estimated remaining: 4h 15m 11s. Rate: 7.2 symbols/min [2025-10-15T18:11:41.466835] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T18:11:41.478320] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-15T18:11:43.762419] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T18:11:43.774416] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-15T18:11:45.822047] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T18:11:45.828471] [INFO ] [REMOTE ] CPNG: Full fetch complete (77780 records). [2025-10-15T18:11:45.828597] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-15T18:11:46.218754] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-15T18:11:46.218832] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-15T18:11:46.219748] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-15T18:11:46.219810] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-15T18:11:46.221221] [DEBUG] [LOCAL ] CPNG: Trimmed 77780 records to 53679 (keeping 200 days of data) [2025-10-15T18:11:46.533859] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-15T18:11:46.533993] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-15T18:11:46.534067] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPNG took 32.0s. Estimated remaining: 4h 14m 57s. Rate: 7.3 symbols/min [2025-10-15T18:11:47.199933] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.111440] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.196893] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.224377] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.254396] [DEBUG] [LOCAL ] CQP: Loaded 18820 existing records from primary storage. [2025-10-15T18:11:47.254869] [INFO ] [MAIN ] CQP: Loaded 18820 existing records. [2025-10-15T18:11:47.336203] [DEBUG] [LOCAL ] CPS: Loaded 25324 existing records from primary storage. [2025-10-15T18:11:47.364267] [INFO ] [MAIN ] CPS: Loaded 25324 existing records. [2025-10-15T18:11:47.498014] [DEBUG] [LOCAL ] CPT: Loaded 44529 existing records from primary storage. [2025-10-15T18:11:47.514784] [DEBUG] [LOCAL ] CPRI: Loaded 52473 existing records from primary storage. [2025-10-15T18:11:47.536023] [INFO ] [MAIN ] CPRI: Loaded 52473 existing records. [2025-10-15T18:11:47.572979] [INFO ] [MAIN ] CPT: Loaded 44529 existing records. [2025-10-15T18:11:47.724369] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:47.740059] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-15T18:11:47.812593] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-15T18:11:47.865710] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-15T18:11:47.865898] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-15T18:11:47.893041] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:47.994383] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-15T18:11:48.026270] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-15T18:11:48.119634] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-15T18:11:48.171418] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:48.159817] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-15T18:11:48.215629] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:48.216185] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-15T18:11:48.231774] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-15T18:11:48.256224] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-15T18:11:48.317863] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-15T18:11:48.300703] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-15T18:11:48.318005] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-15T18:11:48.375876] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-15T18:11:48.480857] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-15T18:11:49.172502] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.251617] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-15T18:11:49.234325] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.305810] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-15T18:11:49.564979] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.584122] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-15T18:11:49.628258] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.628635] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-15T18:11:50.280155] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T18:11:50.284512] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-15T18:11:50.557962] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T18:11:50.562390] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-15T18:11:51.110563] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:11:51.118934] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-15T18:11:51.132287] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:11:51.136900] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-15T18:11:51.290459] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:11:51.301121] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-15T18:11:51.730040] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:11:51.735784] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-15T18:11:52.123537] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T18:11:52.128863] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-15T18:11:52.374724] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T18:11:52.383433] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-15T18:11:52.555327] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:11:52.565579] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-15T18:11:52.903413] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T18:11:52.908715] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-15T18:11:53.317451] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T18:11:53.323513] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-15T18:11:53.563990] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T18:11:53.699533] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:11:53.713945] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-15T18:11:53.772991] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T18:11:54.445389] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T18:11:54.513953] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-15T18:11:54.968916] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:11:55.314007] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-15T18:11:55.616795] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T18:11:56.114045] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-15T18:11:56.749584] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:11:56.814746] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T18:11:56.913964] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-15T18:11:57.714003] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-15T18:11:58.513974] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-15T18:11:58.593120] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:11:59.279853] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T18:11:59.313956] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-15T18:11:59.565297] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:12:00.114070] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-15T18:12:00.913971] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-15T18:12:01.413964] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-15T18:12:01.713975] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-15T18:12:01.830198] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:12:02.273781] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T18:12:02.513983] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-15T18:12:03.271895] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:12:03.313957] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-15T18:12:03.687786] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T18:12:04.114003] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-15T18:12:04.913963] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-15T18:12:05.036205] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:12:05.135260] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T18:12:05.714011] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-15T18:12:06.364801] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:12:06.513985] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-15T18:12:06.535163] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T18:12:07.314050] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-15T18:12:08.077904] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T18:12:08.097458] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T18:12:08.113956] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-15T18:12:08.914056] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-15T18:12:09.714048] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-15T18:12:09.725190] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T18:12:09.849489] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T18:12:10.514054] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-15T18:12:11.233021] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:12:11.234965] [INFO ] [REMOTE ] CQP: Full fetch complete (29941 records). [2025-10-15T18:12:11.235048] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-15T18:12:11.326384] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-15T18:12:11.577072] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T18:12:11.703452] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-15T18:12:11.703532] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-15T18:12:11.704147] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-15T18:12:11.704210] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-15T18:12:11.705001] [DEBUG] [LOCAL ] CQP: Trimmed 29941 records to 18825 (keeping 200 days of data) [2025-10-15T18:12:11.819024] [DEBUG] [LOCAL ] CQP: Primary data saved (18825 records). [2025-10-15T18:12:11.819188] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-15T18:12:11.819283] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 25.3s. Estimated remaining: 4h 15m 49s. Rate: 7.2 symbols/min [2025-10-15T18:12:11.993225] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:12.017535] [DEBUG] [LOCAL ] CR: Loaded 24122 existing records from primary storage. [2025-10-15T18:12:12.017870] [INFO ] [MAIN ] CR: Loaded 24122 existing records. [2025-10-15T18:12:12.119537] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-15T18:12:12.203627] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:12.203945] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-15T18:12:12.204009] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-15T18:12:12.204391] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-15T18:12:12.204448] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-15T18:12:12.524265] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T18:12:12.591879] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:12.913990] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-15T18:12:13.655137] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:12:13.713965] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-15T18:12:14.161287] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:12:14.514066] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-15T18:12:15.283449] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T18:12:15.288520] [INFO ] [REMOTE ] CPT: Full fetch complete (63997 records). [2025-10-15T18:12:15.288705] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-15T18:12:15.289535] [FATAL] [VALIDATOR ] CPT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:12:15.289624] [FATAL] [MAIN ] CPT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:12:15.289719] [WARN ] [MAIN ] CPT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:12:15.289781] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-15T18:12:15.289859] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-10-15T18:12:15.289914] [INFO ] [LOCAL ] CPT: Starting deletion of derivative data. [2025-10-15T18:12:15.290224] [DEBUG] [LOCAL ] CPT: Deleted derivative data file. [2025-10-15T18:12:15.290788] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CPT took 28.8s. Estimated remaining: 4h 15m 24s. Rate: 7.2 symbols/min [2025-10-15T18:12:15.321260] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-15T18:12:15.469174] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:15.481030] [DEBUG] [LOCAL ] CRBD: Loaded 8944 existing records from primary storage. [2025-10-15T18:12:15.481254] [INFO ] [MAIN ] CRBD: Loaded 8944 existing records. [2025-10-15T18:12:15.674390] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:15.669451] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:12:15.679718] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-15T18:12:15.679776] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-15T18:12:15.679937] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-15T18:12:15.679991] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-15T18:12:16.018527] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:16.113951] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-15T18:12:16.341189] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T18:12:16.914042] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-15T18:12:17.242492] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T18:12:17.714002] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-15T18:12:18.506942] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:12:18.517575] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-15T18:12:18.541839] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:12:19.313963] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-15T18:12:19.394246] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T18:12:19.397029] [INFO ] [REMOTE ] CPS: Full fetch complete (36312 records). [2025-10-15T18:12:19.397136] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-15T18:12:19.759683] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-15T18:12:19.759768] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-15T18:12:19.760343] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-15T18:12:19.760383] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-15T18:12:19.761173] [DEBUG] [LOCAL ] CPS: Trimmed 36312 records to 25220 (keeping 200 days of data) [2025-10-15T18:12:19.901797] [DEBUG] [LOCAL ] CPS: Primary data saved (25220 records). [2025-10-15T18:12:19.901933] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-15T18:12:19.902013] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPS took 33.4s. Estimated remaining: 4h 15m 2s. Rate: 7.2 symbols/min [2025-10-15T18:12:20.074988] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:20.125164] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-15T18:12:20.127982] [DEBUG] [LOCAL ] CRBG: Loaded 52568 existing records from primary storage. [2025-10-15T18:12:20.128374] [INFO ] [MAIN ] CRBG: Loaded 52568 existing records. [2025-10-15T18:12:20.305978] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:20.306277] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-15T18:12:20.306465] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-15T18:12:20.318290] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-15T18:12:20.318408] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-15T18:12:20.361754] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T18:12:20.675796] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:20.682467] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T18:12:20.914007] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-15T18:12:21.714043] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-15T18:12:22.514046] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-15T18:12:22.591194] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:12:22.608453] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T18:12:23.280521] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T18:12:23.314063] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-15T18:12:23.925041] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T18:12:24.114024] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-15T18:12:24.914017] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-15T18:12:25.289906] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T18:12:25.714091] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-15T18:12:26.514071] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-15T18:12:26.707990] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:12:26.715119] [INFO ] [REMOTE ] CPRI: Full fetch complete (76217 records). [2025-10-15T18:12:26.715360] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-15T18:12:27.050955] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T18:12:27.144273] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-15T18:12:27.144393] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-15T18:12:27.145508] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-15T18:12:27.145605] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-15T18:12:27.147373] [DEBUG] [LOCAL ] CPRI: Trimmed 76217 records to 52475 (keeping 200 days of data) [2025-10-15T18:12:27.320090] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-15T18:12:27.488535] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:12:27.490985] [DEBUG] [LOCAL ] CPRI: Primary data saved (52475 records). [2025-10-15T18:12:27.501437] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-15T18:12:27.501690] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPRI took 41.0s. Estimated remaining: 4h 14m 52s. Rate: 7.2 symbols/min [2025-10-15T18:12:27.673256] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:27.713589] [DEBUG] [LOCAL ] CRC: Loaded 44076 existing records from primary storage. [2025-10-15T18:12:27.713919] [INFO ] [MAIN ] CRC: Loaded 44076 existing records. [2025-10-15T18:12:27.894808] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:27.895042] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-15T18:12:27.895088] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-15T18:12:27.895431] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-15T18:12:27.895486] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-15T18:12:28.118957] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-15T18:12:28.271017] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:28.272490] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:12:28.914022] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-15T18:12:29.498574] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:12:29.714014] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-15T18:12:30.329980] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T18:12:30.514041] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-15T18:12:30.790333] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:12:31.101248] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T18:12:31.314014] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-15T18:12:32.053458] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T18:12:32.114050] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-15T18:12:32.698773] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T18:12:32.914000] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-15T18:12:33.576091] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T18:12:33.713998] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-15T18:12:34.514003] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-15T18:12:35.143851] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:12:35.314013] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-15T18:12:36.114005] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-15T18:12:36.164196] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:12:36.485295] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T18:12:36.599860] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:12:36.601281] [INFO ] [REMOTE ] CRBD: Full fetch complete (13455 records). [2025-10-15T18:12:36.601348] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-15T18:12:36.913977] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-15T18:12:36.952841] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-15T18:12:36.952912] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-15T18:12:36.953224] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-15T18:12:36.953264] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-15T18:12:36.953768] [DEBUG] [LOCAL ] CRBD: Trimmed 13455 records to 8927 (keeping 200 days of data) [2025-10-15T18:12:37.006626] [DEBUG] [LOCAL ] CRBD: Primary data saved (8927 records). [2025-10-15T18:12:37.006757] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-15T18:12:37.006842] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 21.7s. Estimated remaining: 4h 14m 48s. Rate: 7.2 symbols/min [2025-10-15T18:12:37.169552] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:37.169732] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-15T18:12:37.169777] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-15T18:12:37.169907] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-15T18:12:37.169980] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-15T18:12:37.170043] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-15T18:12:37.170078] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-15T18:12:37.516076] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:37.714007] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-15T18:12:38.311098] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:12:38.514018] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-15T18:12:39.154326] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T18:12:39.313977] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-15T18:12:39.971823] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:12:40.114049] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-15T18:12:40.301272] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:12:40.301580] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-15T18:12:40.301688] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:12:40.301785] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-15T18:12:40.301841] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:12:40.301903] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-15T18:12:40.301970] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-15T18:12:40.302008] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-15T18:12:40.302047] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-15T18:12:40.302092] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRCL took 3.3s. Estimated remaining: 4h 14m 22s. Rate: 7.2 symbols/min [2025-10-15T18:12:40.476556] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:40.523907] [DEBUG] [LOCAL ] CRGY: Loaded 52500 existing records from primary storage. [2025-10-15T18:12:40.524248] [INFO ] [MAIN ] CRGY: Loaded 52500 existing records. [2025-10-15T18:12:40.706669] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:40.706876] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-15T18:12:40.706923] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-15T18:12:40.707490] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-15T18:12:40.707548] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-15T18:12:40.924313] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-15T18:12:41.071778] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:41.104566] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:12:41.714018] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-15T18:12:42.211473] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T18:12:42.513996] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-15T18:12:43.222846] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:12:43.284346] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T18:12:43.313972] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-15T18:12:44.114055] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-15T18:12:44.775767] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:12:44.914036] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-15T18:12:45.714029] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-15T18:12:45.862249] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:12:46.263999] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:12:46.513962] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-15T18:12:46.702726] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T18:12:47.314051] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-15T18:12:47.833054] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T18:12:48.113997] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-15T18:12:48.518091] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:12:48.520993] [INFO ] [REMOTE ] CR: Full fetch complete (34634 records). [2025-10-15T18:12:48.521076] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-15T18:12:48.905890] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-15T18:12:48.906006] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-15T18:12:48.906711] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-15T18:12:48.906770] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-15T18:12:48.907924] [DEBUG] [LOCAL ] CR: Trimmed 34634 records to 24087 (keeping 200 days of data) [2025-10-15T18:12:48.962561] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-15T18:12:49.057234] [DEBUG] [LOCAL ] CR: Primary data saved (24087 records). [2025-10-15T18:12:49.057358] [INFO ] [MAIN ] CR: Full history saved. [2025-10-15T18:12:49.057436] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CR took 37.2s. Estimated remaining: 4h 14m 15s. Rate: 7.2 symbols/min [2025-10-15T18:12:49.220918] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:49.272211] [DEBUG] [LOCAL ] CRH: Loaded 53443 existing records from primary storage. [2025-10-15T18:12:49.272516] [INFO ] [MAIN ] CRH: Loaded 53443 existing records. [2025-10-15T18:12:49.447129] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:49.447357] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-15T18:12:49.447404] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-15T18:12:49.447701] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-15T18:12:49.447766] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-15T18:12:49.720635] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-15T18:12:49.803549] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:49.829911] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:12:50.442374] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T18:12:50.514009] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-15T18:12:51.313970] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-15T18:12:51.408761] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T18:12:52.006488] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:12:52.113967] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-15T18:12:52.707876] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:12:52.914008] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-15T18:12:53.713973] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-15T18:12:53.967550] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T18:12:54.058179] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:12:54.514020] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-15T18:12:55.314046] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-15T18:12:55.458851] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T18:12:56.070092] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:12:56.114031] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-15T18:12:56.913991] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-15T18:12:56.975468] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:12:57.714122] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-15T18:12:58.060187] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T18:12:58.362468] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:12:58.513981] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-15T18:12:59.314008] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-15T18:12:59.642905] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T18:12:59.902070] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T18:12:59.908332] [INFO ] [REMOTE ] CRBG: Full fetch complete (75989 records). [2025-10-15T18:12:59.908476] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-15T18:13:00.119306] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-15T18:13:00.347828] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-15T18:13:00.347940] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-15T18:13:00.348992] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-15T18:13:00.349059] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-15T18:13:00.350559] [DEBUG] [LOCAL ] CRBG: Trimmed 75989 records to 52586 (keeping 200 days of data) [2025-10-15T18:13:00.701106] [DEBUG] [LOCAL ] CRBG: Primary data saved (52586 records). [2025-10-15T18:13:00.701250] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-15T18:13:00.702216] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRBG took 40.8s. Estimated remaining: 4h 14m 19s. Rate: 7.2 symbols/min [2025-10-15T18:13:00.896088] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:00.923597] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-15T18:13:00.943707] [DEBUG] [LOCAL ] CRI: Loaded 49699 existing records from primary storage. [2025-10-15T18:13:00.944031] [INFO ] [MAIN ] CRI: Loaded 49699 existing records. [2025-10-15T18:13:01.130211] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:01.130625] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-15T18:13:01.130817] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-15T18:13:01.131101] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-15T18:13:01.131243] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-15T18:13:01.413506] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-15T18:13:01.535746] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:01.713963] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-15T18:13:02.064493] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:13:02.070273] [INFO ] [REMOTE ] CRC: Full fetch complete (62855 records). [2025-10-15T18:13:02.070393] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-15T18:13:02.448606] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-15T18:13:02.448716] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-15T18:13:02.449551] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-15T18:13:02.449593] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-15T18:13:02.450863] [DEBUG] [LOCAL ] CRC: Trimmed 62855 records to 44068 (keeping 200 days of data) [2025-10-15T18:13:02.539621] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-15T18:13:02.731370] [DEBUG] [LOCAL ] CRC: Primary data saved (44068 records). [2025-10-15T18:13:02.731738] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-15T18:13:02.731833] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRC took 35.2s. Estimated remaining: 4h 13m 49s. Rate: 7.2 symbols/min [2025-10-15T18:13:02.866538] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T18:13:02.955351] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:02.955758] [DEBUG] [LOCAL ] CRK: No existing data file found in primary storage. [2025-10-15T18:13:02.955810] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-10-15T18:13:02.955922] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-15T18:13:02.955963] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-15T18:13:02.956003] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-15T18:13:02.956052] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-15T18:13:03.322824] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-15T18:13:03.327986] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:03.388946] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:13:04.114083] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-15T18:13:04.243222] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:13:04.914036] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-15T18:13:05.234040] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T18:13:05.717834] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-15T18:13:05.725127] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:13:06.514012] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-15T18:13:06.573579] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:13:07.222369] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:13:07.313996] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-15T18:13:08.114036] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-15T18:13:08.228488] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:13:08.913962] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-15T18:13:08.976527] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:13:09.567041] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T18:13:09.714001] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-15T18:13:10.286389] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T18:13:10.514005] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-15T18:13:11.139269] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:13:11.314025] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-15T18:13:12.013435] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:13:12.113983] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-15T18:13:12.914040] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-15T18:13:12.988615] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:13:12.995358] [INFO ] [REMOTE ] CRGY: Full fetch complete (76137 records). [2025-10-15T18:13:12.995494] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-15T18:13:13.430217] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-15T18:13:13.430317] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-15T18:13:13.431418] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-15T18:13:13.431485] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-15T18:13:13.433001] [DEBUG] [LOCAL ] CRGY: Trimmed 76137 records to 52507 (keeping 200 days of data) [2025-10-15T18:13:13.719711] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-15T18:13:13.759220] [DEBUG] [LOCAL ] CRGY: Primary data saved (52507 records). [2025-10-15T18:13:13.759398] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-15T18:13:13.759791] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRGY took 33.5s. Estimated remaining: 4h 13m 50s. Rate: 7.2 symbols/min [2025-10-15T18:13:13.954936] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:14.000015] [DEBUG] [LOCAL ] CRL: Loaded 42908 existing records from primary storage. [2025-10-15T18:13:14.000322] [INFO ] [MAIN ] CRL: Loaded 42908 existing records. [2025-10-15T18:13:14.212803] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:14.213114] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-15T18:13:14.213247] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-15T18:13:14.213800] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-15T18:13:14.213941] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-15T18:13:14.381210] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-15T18:13:14.521693] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-15T18:13:14.684963] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:13:14.719178] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:15.314029] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-15T18:13:15.410903] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:13:16.114016] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-15T18:13:16.235614] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:13:16.244623] [INFO ] [REMOTE ] CRH: Full fetch complete (77113 records). [2025-10-15T18:13:16.244875] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-15T18:13:16.245920] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:13:16.246076] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:13:16.246140] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:13:16.246204] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-15T18:13:16.246289] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-15T18:13:16.246350] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-10-15T18:13:16.246561] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-10-15T18:13:16.246723] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRH took 27.2s. Estimated remaining: 4h 13m 21s. Rate: 7.3 symbols/min [2025-10-15T18:13:16.515452] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:16.576912] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-15T18:13:16.577258] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-15T18:13:16.782467] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:16.783075] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-15T18:13:16.783177] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-15T18:13:16.792711] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-15T18:13:16.810140] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-15T18:13:16.845885] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:13:16.918203] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-15T18:13:17.203231] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:17.714113] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-15T18:13:18.244595] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T18:13:18.513974] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-15T18:13:18.545043] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:13:19.313995] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-15T18:13:19.779621] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-15T18:13:20.113981] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-15T18:13:20.244094] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:13:20.568489] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T18:13:20.913979] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-15T18:13:21.408842] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T18:13:21.714057] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-15T18:13:22.417320] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:13:22.513964] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-15T18:13:23.207008] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:13:23.314030] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-15T18:13:24.113979] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-15T18:13:24.186369] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T18:13:24.913986] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-15T18:13:24.954194] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:13:25.435564] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:13:25.713998] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-15T18:13:26.209702] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:13:26.514012] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-15T18:13:27.086729] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:13:27.313988] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-15T18:13:28.113987] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-15T18:13:28.269177] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:13:28.913994] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-15T18:13:29.387351] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-15T18:13:29.714011] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-15T18:13:29.895390] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T18:13:30.513979] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-15T18:13:30.568839] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:13:30.671675] [DEBUG] [REMOTE ] CRM: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-15T18:13:30.671963] [WARN ] [REMOTE ] CRM: No data returned for month 2025-02 [2025-10-15T18:13:30.672052] [FATAL] [REMOTE ] CRM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:13:30.672144] [FATAL] [MAIN ] CRM: Failed to fetch primary data. [2025-10-15T18:13:30.672206] [WARN ] [MAIN ] CRM: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:13:30.672274] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-15T18:13:30.672337] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-15T18:13:30.672372] [INFO ] [LOCAL ] CRM: Starting deletion of derivative data. [2025-10-15T18:13:30.672514] [DEBUG] [LOCAL ] CRM: Deleted derivative data file. [2025-10-15T18:13:30.672595] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRM took 14.4s. Estimated remaining: 4h 13m 34s. Rate: 7.2 symbols/min [2025-10-15T18:13:30.839679] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:30.879358] [DEBUG] [LOCAL ] CRS: Loaded 43223 existing records from primary storage. [2025-10-15T18:13:30.879668] [INFO ] [MAIN ] CRS: Loaded 43223 existing records. [2025-10-15T18:13:31.054747] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:31.054953] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-15T18:13:31.055000] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-15T18:13:31.055434] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-15T18:13:31.055478] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-15T18:13:31.319188] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-15T18:13:31.412030] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:31.448337] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T18:13:32.114002] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-15T18:13:32.916505] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-15T18:13:32.920311] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T18:13:32.926858] [INFO ] [REMOTE ] CRK: Full fetch complete (75830 records). [2025-10-15T18:13:32.926999] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-15T18:13:33.332537] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-15T18:13:33.332960] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-15T18:13:33.333997] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-15T18:13:33.334128] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-15T18:13:33.335494] [DEBUG] [LOCAL ] CRK: Trimmed 75830 records to 52246 (keeping 200 days of data) [2025-10-15T18:13:33.589304] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T18:13:33.683237] [DEBUG] [LOCAL ] CRK: Primary data saved (52246 records). [2025-10-15T18:13:33.683399] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-15T18:13:33.683481] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRK took 30.9s. Estimated remaining: 4h 13m 8s. Rate: 7.3 symbols/min [2025-10-15T18:13:33.719112] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-15T18:13:33.865405] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:33.873507] [DEBUG] [LOCAL ] CRT: Loaded 4916 existing records from primary storage. [2025-10-15T18:13:33.873769] [INFO ] [MAIN ] CRT: Loaded 4916 existing records. [2025-10-15T18:13:34.058164] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:34.058398] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-15T18:13:34.058447] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-15T18:13:34.058609] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-15T18:13:34.058686] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-15T18:13:34.407480] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:34.513975] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-15T18:13:34.615507] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T18:13:35.290501] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:13:35.313965] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-15T18:13:35.965133] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:13:36.114008] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-15T18:13:36.881824] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:13:36.913956] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-15T18:13:37.485210] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:13:37.490751] [INFO ] [REMOTE ] CRI: Full fetch complete (70931 records). [2025-10-15T18:13:37.490901] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-15T18:13:37.689109] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T18:13:37.720120] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-15T18:13:37.886572] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-15T18:13:37.886682] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-15T18:13:37.887538] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-15T18:13:37.887583] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-15T18:13:37.889181] [DEBUG] [LOCAL ] CRI: Trimmed 70931 records to 49669 (keeping 200 days of data) [2025-10-15T18:13:38.184165] [DEBUG] [LOCAL ] CRI: Primary data saved (49669 records). [2025-10-15T18:13:38.184314] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-15T18:13:38.185315] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRI took 37.5s. Estimated remaining: 4h 12m 47s. Rate: 7.3 symbols/min [2025-10-15T18:13:38.350329] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:38.396435] [DEBUG] [LOCAL ] CSAN: Loaded 42149 existing records from primary storage. [2025-10-15T18:13:38.396797] [INFO ] [MAIN ] CSAN: Loaded 42149 existing records. [2025-10-15T18:13:38.519148] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-15T18:13:38.573926] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:38.574181] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-15T18:13:38.574230] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-15T18:13:38.574753] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-15T18:13:38.574808] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-15T18:13:38.916324] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:39.314008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-15T18:13:39.406713] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:13:39.826688] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:13:40.113975] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-15T18:13:40.542912] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T18:13:40.914008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-15T18:13:41.476500] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T18:13:41.714004] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-15T18:13:42.301016] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:13:42.513985] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-15T18:13:43.064943] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:13:43.313979] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-15T18:13:43.853761] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T18:13:43.875672] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:13:44.113970] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-15T18:13:44.914052] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-15T18:13:45.451978] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:13:45.645511] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:13:45.714001] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-15T18:13:46.514025] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-15T18:13:47.314023] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-15T18:13:47.562158] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T18:13:47.754501] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:13:47.825846] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T18:13:48.114009] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-15T18:13:48.914040] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-15T18:13:49.375474] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T18:13:49.714029] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-15T18:13:50.255075] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T18:13:50.514023] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-15T18:13:51.051284] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T18:13:51.241994] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T18:13:51.247171] [INFO ] [REMOTE ] CRL: Full fetch complete (63407 records). [2025-10-15T18:13:51.247284] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-15T18:13:51.319059] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-15T18:13:51.645911] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-15T18:13:51.645990] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-15T18:13:51.646886] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-15T18:13:51.646953] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-15T18:13:51.648240] [DEBUG] [LOCAL ] CRL: Trimmed 63407 records to 42812 (keeping 200 days of data) [2025-10-15T18:13:51.905856] [DEBUG] [LOCAL ] CRL: Primary data saved (42812 records). [2025-10-15T18:13:51.905982] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-15T18:13:51.906310] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRL took 38.1s. Estimated remaining: 4h 12m 57s. Rate: 7.3 symbols/min [2025-10-15T18:13:52.087929] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:52.122386] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-15T18:13:52.125613] [DEBUG] [LOCAL ] CSL: Loaded 31497 existing records from primary storage. [2025-10-15T18:13:52.125996] [INFO ] [MAIN ] CSL: Loaded 31497 existing records. [2025-10-15T18:13:52.306668] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:52.306892] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-15T18:13:52.306939] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-15T18:13:52.307274] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-15T18:13:52.307312] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-15T18:13:52.668181] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:52.688284] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T18:13:52.913964] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-15T18:13:53.018202] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T18:13:53.714017] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-15T18:13:54.121778] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:13:54.513974] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-15T18:13:55.314933] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-15T18:13:55.314852] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T18:13:55.758963] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T18:13:56.113998] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-15T18:13:56.802416] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T18:13:56.829608] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T18:13:56.913979] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-15T18:13:57.713996] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-15T18:13:58.267257] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:13:58.514030] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-15T18:13:58.724397] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T18:13:59.314053] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-15T18:14:00.113973] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-15T18:14:00.254477] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T18:14:00.796014] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T18:14:00.795865] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T18:14:00.913947] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-15T18:14:01.713995] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-15T18:14:02.184563] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:14:02.240033] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T18:14:02.514004] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-15T18:14:03.314010] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-15T18:14:03.904899] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T18:14:04.114007] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-15T18:14:04.689857] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T18:14:04.914046] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-15T18:14:05.699843] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:14:05.713949] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-15T18:14:06.343306] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:14:06.513973] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-15T18:14:07.257680] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T18:14:07.262434] [INFO ] [REMOTE ] CSAN: Full fetch complete (60439 records). [2025-10-15T18:14:07.262579] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-15T18:14:07.324457] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-15T18:14:07.670468] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-15T18:14:07.670678] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-15T18:14:07.671537] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-15T18:14:07.671728] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-15T18:14:07.690220] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T18:14:07.696710] [DEBUG] [LOCAL ] CSAN: Trimmed 60439 records to 42170 (keeping 200 days of data) [2025-10-15T18:14:07.928159] [DEBUG] [LOCAL ] CSAN: Primary data saved (42170 records). [2025-10-15T18:14:07.928289] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-15T18:14:07.928370] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CSAN took 29.7s. Estimated remaining: 4h 13m 15s. Rate: 7.2 symbols/min [2025-10-15T18:14:08.092523] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:08.106947] [DEBUG] [LOCAL ] CSR: Loaded 13282 existing records from primary storage. [2025-10-15T18:14:08.107185] [INFO ] [MAIN ] CSR: Loaded 13282 existing records. [2025-10-15T18:14:08.119755] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-15T18:14:08.287120] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:08.287328] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-15T18:14:08.287375] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-15T18:14:08.287690] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-15T18:14:08.287749] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-15T18:14:08.668953] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:08.847493] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T18:14:08.847893] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T18:14:08.914236] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-15T18:14:09.714077] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-15T18:14:10.215663] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T18:14:10.307384] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T18:14:10.308502] [INFO ] [REMOTE ] CRT: Full fetch complete (7407 records). [2025-10-15T18:14:10.308572] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-15T18:14:10.523819] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-15T18:14:10.679728] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-15T18:14:10.679812] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-15T18:14:10.680027] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-15T18:14:10.680065] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-15T18:14:10.680451] [DEBUG] [LOCAL ] CRT: Trimmed 7407 records to 4885 (keeping 200 days of data) [2025-10-15T18:14:10.711292] [DEBUG] [LOCAL ] CRT: Primary data saved (4885 records). [2025-10-15T18:14:10.711462] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-15T18:14:10.711545] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CRT took 37.0s. Estimated remaining: 4h 12m 48s. Rate: 7.2 symbols/min [2025-10-15T18:14:10.884727] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:10.930000] [DEBUG] [LOCAL ] CSTM: Loaded 47568 existing records from primary storage. [2025-10-15T18:14:10.930307] [INFO ] [MAIN ] CSTM: Loaded 47568 existing records. [2025-10-15T18:14:11.104132] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:11.104345] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-15T18:14:11.104393] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-15T18:14:11.104849] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-15T18:14:11.104905] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-15T18:14:11.322094] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-15T18:14:11.460087] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:11.996115] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T18:14:12.001905] [INFO ] [REMOTE ] CRS: Full fetch complete (62604 records). [2025-10-15T18:14:12.002063] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-15T18:14:12.115210] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-15T18:14:12.367107] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T18:14:12.439430] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-15T18:14:12.439531] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-15T18:14:12.440630] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-15T18:14:12.440738] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-15T18:14:12.442198] [DEBUG] [LOCAL ] CRS: Trimmed 62604 records to 43214 (keeping 200 days of data) [2025-10-15T18:14:12.720896] [DEBUG] [LOCAL ] CRS: Primary data saved (43214 records). [2025-10-15T18:14:12.721044] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-15T18:14:12.721135] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CRS took 42.0s. Estimated remaining: 4h 12m 19s. Rate: 7.3 symbols/min [2025-10-15T18:14:12.892236] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:12.906169] [DEBUG] [LOCAL ] CSV: Loaded 12742 existing records from primary storage. [2025-10-15T18:14:12.906457] [INFO ] [MAIN ] CSV: Loaded 12742 existing records. [2025-10-15T18:14:12.920186] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-15T18:14:13.127418] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:13.127722] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-15T18:14:13.127781] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-15T18:14:13.128028] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-15T18:14:13.128083] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-15T18:14:13.496355] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:13.538594] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T18:14:13.714014] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-15T18:14:14.513985] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-15T18:14:14.722071] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:14:15.132535] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:14:15.250465] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T18:14:15.314010] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-15T18:14:16.008554] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T18:14:16.113988] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-15T18:14:16.914002] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-15T18:14:17.121350] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:14:17.714019] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-15T18:14:18.188446] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T18:14:18.514042] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-15T18:14:18.564088] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T18:14:19.314021] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-15T18:14:20.020094] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T18:14:20.024222] [INFO ] [REMOTE ] CSL: Full fetch complete (45458 records). [2025-10-15T18:14:20.024383] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-15T18:14:20.119773] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-15T18:14:20.324209] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T18:14:20.416924] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-15T18:14:20.417006] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-15T18:14:20.417716] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-15T18:14:20.417780] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-15T18:14:20.418808] [DEBUG] [LOCAL ] CSL: Trimmed 45458 records to 31478 (keeping 200 days of data) [2025-10-15T18:14:20.615841] [DEBUG] [LOCAL ] CSL: Primary data saved (31478 records). [2025-10-15T18:14:20.615988] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-15T18:14:20.616136] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 28.7s. Estimated remaining: 4h 12m 9s. Rate: 7.3 symbols/min [2025-10-15T18:14:20.794349] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:20.794543] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-15T18:14:20.794581] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-15T18:14:20.794724] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-15T18:14:20.794772] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-15T18:14:20.794815] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-15T18:14:20.794849] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-15T18:14:20.919125] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-15T18:14:21.159477] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:21.501206] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:14:21.713966] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-15T18:14:21.850932] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T18:14:22.514003] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-15T18:14:23.160691] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T18:14:23.314917] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-15T18:14:23.323583] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T18:14:24.114033] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-15T18:14:24.215720] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:14:24.913970] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-15T18:14:25.561994] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T18:14:25.650415] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:14:25.714031] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-15T18:14:26.514054] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-15T18:14:26.634256] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T18:14:26.710539] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:14:26.710959] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-15T18:14:26.711050] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:14:26.711097] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-15T18:14:26.711167] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:14:26.711237] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-15T18:14:26.711299] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-15T18:14:26.711334] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-15T18:14:26.711373] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-15T18:14:26.711420] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSW took 6.1s. Estimated remaining: 4h 11m 54s. Rate: 7.3 symbols/min [2025-10-15T18:14:26.887884] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:26.896930] [DEBUG] [LOCAL ] CTBB: Loaded 6891 existing records from primary storage. [2025-10-15T18:14:26.897179] [INFO ] [MAIN ] CTBB: Loaded 6891 existing records. [2025-10-15T18:14:27.107475] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:27.107813] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-15T18:14:27.107878] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-15T18:14:27.108110] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-15T18:14:27.108179] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-15T18:14:27.319921] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-15T18:14:27.486072] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:28.113981] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-15T18:14:28.145342] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T18:14:28.698266] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T18:14:28.913988] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-15T18:14:29.714049] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-15T18:14:30.513988] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-15T18:14:30.571754] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:14:30.684443] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T18:14:31.117668] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:14:31.313998] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-15T18:14:32.065704] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T18:14:32.113977] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-15T18:14:32.760444] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T18:14:32.914057] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-15T18:14:33.713970] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-15T18:14:33.849602] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T18:14:34.514067] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-15T18:14:34.541074] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T18:14:34.543828] [INFO ] [REMOTE ] CSV: Full fetch complete (19249 records). [2025-10-15T18:14:34.543899] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-15T18:14:34.916990] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-15T18:14:34.917079] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-15T18:14:34.917492] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-15T18:14:34.917532] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-15T18:14:34.918985] [DEBUG] [LOCAL ] CSV: Trimmed 19249 records to 12707 (keeping 200 days of data) [2025-10-15T18:14:34.995863] [DEBUG] [LOCAL ] CSV: Primary data saved (12707 records). [2025-10-15T18:14:34.996008] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-15T18:14:34.996089] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSV took 22.3s. Estimated remaining: 4h 11m 45s. Rate: 7.3 symbols/min [2025-10-15T18:14:35.162313] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:35.162485] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-10-15T18:14:35.162521] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-10-15T18:14:35.162636] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-15T18:14:35.162714] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-15T18:14:35.162763] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-15T18:14:35.162795] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-15T18:14:35.316950] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-15T18:14:35.471856] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:14:35.532724] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:36.045866] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T18:14:36.114055] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-15T18:14:36.914088] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-15T18:14:36.951872] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T18:14:37.434719] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T18:14:37.714035] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-15T18:14:38.514063] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-15T18:14:39.101903] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:14:39.131513] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:14:39.314002] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-15T18:14:40.113973] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-15T18:14:40.143617] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:14:40.883526] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T18:14:40.914032] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-15T18:14:41.713972] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-15T18:14:41.744349] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T18:14:41.747092] [INFO ] [REMOTE ] CSR: Full fetch complete (17968 records). [2025-10-15T18:14:41.747170] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-15T18:14:42.106217] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-15T18:14:42.106292] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-15T18:14:42.106728] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-15T18:14:42.106789] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-15T18:14:42.107294] [DEBUG] [LOCAL ] CSR: Trimmed 17968 records to 13403 (keeping 200 days of data) [2025-10-15T18:14:42.186525] [DEBUG] [LOCAL ] CSR: Primary data saved (13403 records). [2025-10-15T18:14:42.186674] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-15T18:14:42.186770] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSR took 34.3s. Estimated remaining: 4h 11m 34s. Rate: 7.3 symbols/min [2025-10-15T18:14:42.367496] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:42.371130] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-15T18:14:42.371191] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-15T18:14:42.371325] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-15T18:14:42.371379] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-15T18:14:42.371423] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-15T18:14:42.371456] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-15T18:14:42.481333] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T18:14:42.522476] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-15T18:14:42.738188] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:43.170623] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-15T18:14:43.313993] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-15T18:14:43.953228] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:14:44.113969] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-15T18:14:44.302329] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:14:44.302544] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-15T18:14:44.302629] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:14:44.302715] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-15T18:14:44.302778] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:14:44.302845] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-15T18:14:44.302903] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-15T18:14:44.302938] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-15T18:14:44.302976] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-15T18:14:44.303018] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTEV took 2.1s. Estimated remaining: 4h 11m 5s. Rate: 7.3 symbols/min [2025-10-15T18:14:44.477442] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:44.505774] [DEBUG] [LOCAL ] CTO: Loaded 27742 existing records from primary storage. [2025-10-15T18:14:44.506029] [INFO ] [MAIN ] CTO: Loaded 27742 existing records. [2025-10-15T18:14:44.677925] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:44.678129] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-15T18:14:44.678178] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-15T18:14:44.678516] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-15T18:14:44.678570] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-15T18:14:44.919111] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-15T18:14:45.047534] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:45.535914] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-15T18:14:45.713999] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-15T18:14:46.513994] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-15T18:14:46.524298] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:14:47.314047] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-15T18:14:47.858466] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T18:14:48.052372] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:14:48.114010] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-15T18:14:48.914002] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-15T18:14:49.545934] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:14:49.713984] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-15T18:14:50.260904] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T18:14:50.513998] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-15T18:14:51.050144] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T18:14:51.322703] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-15T18:14:51.339916] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:14:51.911099] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T18:14:52.113973] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-15T18:14:52.736388] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:14:52.914043] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-15T18:14:53.364058] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T18:14:53.714010] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-15T18:14:54.362476] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T18:14:54.513996] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-15T18:14:54.986058] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:14:55.313988] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-15T18:14:56.114005] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-15T18:14:56.874878] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:14:56.913997] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-15T18:14:57.074114] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:14:57.714000] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-15T18:14:58.265708] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T18:14:58.271963] [INFO ] [REMOTE ] CSTM: Full fetch complete (69466 records). [2025-10-15T18:14:58.272124] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-15T18:14:58.403112] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T18:14:58.523563] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-15T18:14:58.690041] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-15T18:14:58.690125] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-15T18:14:58.690990] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-15T18:14:58.691051] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-15T18:14:58.692391] [DEBUG] [LOCAL ] CSTM: Trimmed 69466 records to 47572 (keeping 200 days of data) [2025-10-15T18:14:58.958571] [DEBUG] [LOCAL ] CSTM: Primary data saved (47572 records). [2025-10-15T18:14:58.958725] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-15T18:14:58.958812] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CSTM took 48.2s. Estimated remaining: 4h 11m 18s. Rate: 7.3 symbols/min [2025-10-15T18:14:59.123332] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:59.157664] [DEBUG] [LOCAL ] CTOS: Loaded 37068 existing records from primary storage. [2025-10-15T18:14:59.157958] [INFO ] [MAIN ] CTOS: Loaded 37068 existing records. [2025-10-15T18:14:59.286143] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T18:14:59.323711] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-15T18:14:59.338745] [INFO ] [REMOTE ] CTDD: Full fetch complete (8154 records). [2025-10-15T18:14:59.343810] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-15T18:14:59.343639] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:59.387731] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-15T18:14:59.387913] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-15T18:14:59.421864] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-15T18:14:59.444090] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-15T18:15:00.032385] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-15T18:15:00.037718] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-15T18:15:00.037985] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-15T18:15:00.038055] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-15T18:15:00.090630] [DEBUG] [LOCAL ] CTDD: Trimmed 8154 records to 5471 (keeping 200 days of data) [2025-10-15T18:15:00.110161] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:00.126562] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-15T18:15:00.148278] [DEBUG] [LOCAL ] CTDD: Primary data saved (5471 records). [2025-10-15T18:15:00.148405] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-15T18:15:00.148475] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTDD took 25.2s. Estimated remaining: 4h 10m 46s. Rate: 7.3 symbols/min [2025-10-15T18:15:00.328590] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:00.356951] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:15:00.401092] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-15T18:15:00.401434] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-15T18:15:00.582137] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:00.582378] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-15T18:15:00.582435] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-15T18:15:00.582905] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-15T18:15:00.582960] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-15T18:15:00.927349] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-15T18:15:00.971105] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:01.713964] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-15T18:15:01.805525] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:15:02.519134] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-15T18:15:02.532053] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:15:03.209693] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T18:15:03.314029] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-15T18:15:03.831251] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T18:15:04.113993] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-15T18:15:04.602138] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T18:15:04.913997] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-15T18:15:05.513528] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:15:05.714064] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-15T18:15:06.302007] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T18:15:06.513985] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-15T18:15:06.793058] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T18:15:07.293748] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T18:15:07.295040] [INFO ] [REMOTE ] CTBB: Full fetch complete (10361 records). [2025-10-15T18:15:07.295123] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-15T18:15:07.319110] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-15T18:15:07.674683] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-15T18:15:07.674772] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-15T18:15:07.675043] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-15T18:15:07.675095] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-15T18:15:07.675571] [DEBUG] [LOCAL ] CTBB: Trimmed 10361 records to 6784 (keeping 200 days of data) [2025-10-15T18:15:07.717128] [DEBUG] [LOCAL ] CTBB: Primary data saved (6784 records). [2025-10-15T18:15:07.717257] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-15T18:15:07.717335] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTBB took 41.0s. Estimated remaining: 4h 10m 35s. Rate: 7.3 symbols/min [2025-10-15T18:15:07.892693] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:07.940715] [DEBUG] [LOCAL ] CTRE: Loaded 49413 existing records from primary storage. [2025-10-15T18:15:07.941080] [INFO ] [MAIN ] CTRE: Loaded 49413 existing records. [2025-10-15T18:15:08.119311] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:08.115789] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-15T18:15:08.119589] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-15T18:15:08.119693] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-15T18:15:08.121236] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-15T18:15:08.121292] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-15T18:15:08.496812] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:08.672717] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:15:08.913995] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-15T18:15:09.373565] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:15:09.714011] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-15T18:15:10.513976] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-15T18:15:10.604594] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:15:10.715918] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:15:11.313996] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-15T18:15:12.114000] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-15T18:15:12.526330] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:15:12.913975] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-15T18:15:13.284402] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T18:15:13.321307] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T18:15:13.714028] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-15T18:15:14.514021] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-15T18:15:14.562757] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T18:15:15.193276] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T18:15:15.314009] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-15T18:15:15.715333] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T18:15:16.113995] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-15T18:15:16.913967] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-15T18:15:16.956476] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T18:15:17.664406] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:15:17.713975] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-15T18:15:18.020327] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:15:18.514263] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-15T18:15:19.124211] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T18:15:19.314091] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-15T18:15:20.114041] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-15T18:15:20.304597] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:15:20.786606] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T18:15:20.913961] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-15T18:15:21.074220] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T18:15:21.714016] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-15T18:15:21.926138] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:15:22.514010] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-15T18:15:23.314024] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-15T18:15:23.460860] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:15:23.663223] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:15:24.114032] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-15T18:15:24.914064] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-15T18:15:25.048896] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:15:25.247997] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:15:25.714037] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-15T18:15:25.951596] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:15:25.956855] [INFO ] [REMOTE ] CTOS: Full fetch complete (53892 records). [2025-10-15T18:15:25.957006] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-15T18:15:26.407917] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-15T18:15:26.408013] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-15T18:15:26.408847] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-15T18:15:26.408919] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-15T18:15:26.410197] [DEBUG] [LOCAL ] CTOS: Trimmed 53892 records to 37188 (keeping 200 days of data) [2025-10-15T18:15:26.516112] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-15T18:15:26.624027] [DEBUG] [LOCAL ] CTOS: Primary data saved (37188 records). [2025-10-15T18:15:26.624208] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-15T18:15:26.624300] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTOS took 27.7s. Estimated remaining: 4h 11m 3s. Rate: 7.3 symbols/min [2025-10-15T18:15:26.822937] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:26.824814] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:15:26.865488] [DEBUG] [LOCAL ] CTRI: Loaded 39942 existing records from primary storage. [2025-10-15T18:15:26.865869] [INFO ] [MAIN ] CTRI: Loaded 39942 existing records. [2025-10-15T18:15:27.041041] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:27.041279] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-15T18:15:27.041327] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-15T18:15:27.041739] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-15T18:15:27.041797] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-15T18:15:27.319095] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-15T18:15:27.437018] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:28.113977] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-15T18:15:28.235401] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:15:28.566360] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T18:15:28.570499] [INFO ] [REMOTE ] CTO: Full fetch complete (41673 records). [2025-10-15T18:15:28.570606] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-15T18:15:28.941742] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-15T18:15:28.958475] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-15T18:15:28.958585] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-15T18:15:28.959270] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-15T18:15:28.959343] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-15T18:15:28.960437] [DEBUG] [LOCAL ] CTO: Trimmed 41673 records to 27682 (keeping 200 days of data) [2025-10-15T18:15:29.124690] [DEBUG] [LOCAL ] CTO: Primary data saved (27682 records). [2025-10-15T18:15:29.124835] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-15T18:15:29.124914] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTO took 44.8s. Estimated remaining: 4h 10m 35s. Rate: 7.3 symbols/min [2025-10-15T18:15:29.292367] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:29.312566] [DEBUG] [LOCAL ] CTS: Loaded 19598 existing records from primary storage. [2025-10-15T18:15:29.312840] [INFO ] [MAIN ] CTS: Loaded 19598 existing records. [2025-10-15T18:15:29.489304] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:29.489499] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-15T18:15:29.489545] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-15T18:15:29.489802] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-15T18:15:29.489860] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-15T18:15:29.743308] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-15T18:15:29.849990] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:29.882078] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T18:15:30.117783] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T18:15:30.513995] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-15T18:15:31.082608] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:15:31.314060] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-15T18:15:31.450699] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T18:15:32.113998] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-15T18:15:32.913982] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-15T18:15:33.073945] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T18:15:33.113367] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:15:33.713996] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-15T18:15:34.513970] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-15T18:15:34.674348] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T18:15:35.285417] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:15:35.313968] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-15T18:15:35.500257] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T18:15:36.114028] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-15T18:15:36.913995] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-15T18:15:37.045089] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:15:37.262238] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:15:37.268722] [INFO ] [REMOTE ] CTRA: Full fetch complete (77821 records). [2025-10-15T18:15:37.268862] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-15T18:15:37.656513] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-15T18:15:37.656606] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-15T18:15:37.657508] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-15T18:15:37.657571] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-15T18:15:37.658997] [DEBUG] [LOCAL ] CTRA: Trimmed 77821 records to 53648 (keeping 200 days of data) [2025-10-15T18:15:37.715344] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-15T18:15:37.984376] [DEBUG] [LOCAL ] CTRA: Primary data saved (53648 records). [2025-10-15T18:15:37.984504] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-15T18:15:37.984579] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRA took 37.8s. Estimated remaining: 4h 10m 29s. Rate: 7.3 symbols/min [2025-10-15T18:15:38.163071] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:38.209264] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:15:38.231623] [DEBUG] [LOCAL ] CTVA: Loaded 53288 existing records from primary storage. [2025-10-15T18:15:38.231957] [INFO ] [MAIN ] CTVA: Loaded 53288 existing records. [2025-10-15T18:15:38.414261] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:38.414511] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-15T18:15:38.414560] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-15T18:15:38.415036] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-15T18:15:38.415092] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-15T18:15:38.517583] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-15T18:15:38.735599] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:15:38.796712] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:39.313968] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-15T18:15:39.519746] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:15:40.114007] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-15T18:15:40.728833] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:15:40.913976] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-15T18:15:41.714002] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-15T18:15:41.867577] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:15:42.446210] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:15:42.514022] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-15T18:15:42.715058] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T18:15:43.314028] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-15T18:15:43.779105] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:15:44.114003] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-15T18:15:44.913997] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-15T18:15:45.023014] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:15:45.541043] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:15:45.713992] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-15T18:15:46.513961] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-15T18:15:46.579906] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:15:47.313963] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-15T18:15:47.516749] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:15:47.523226] [INFO ] [REMOTE ] CTRE: Full fetch complete (71374 records). [2025-10-15T18:15:47.523366] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-15T18:15:47.717785] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T18:15:47.938388] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-15T18:15:47.938470] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-15T18:15:47.939450] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-15T18:15:47.939517] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-15T18:15:47.940948] [DEBUG] [LOCAL ] CTRE: Trimmed 71374 records to 49482 (keeping 200 days of data) [2025-10-15T18:15:48.114878] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-15T18:15:48.244911] [DEBUG] [LOCAL ] CTRE: Primary data saved (49482 records). [2025-10-15T18:15:48.245042] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-15T18:15:48.245409] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRE took 40.5s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-15T18:15:48.420984] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:48.421153] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-15T18:15:48.421202] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-15T18:15:48.421332] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-15T18:15:48.421396] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-15T18:15:48.421447] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-15T18:15:48.421479] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-15T18:15:48.791325] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:48.812618] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T18:15:48.913967] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-15T18:15:49.341543] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T18:15:49.642917] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:15:49.714000] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-15T18:15:50.514061] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-15T18:15:50.770458] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-15T18:15:51.313990] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-15T18:15:51.564327] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T18:15:51.629608] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-15T18:15:52.114001] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-15T18:15:52.914048] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-15T18:15:53.254781] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T18:15:53.714059] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-15T18:15:53.778069] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:15:54.513990] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-15T18:15:55.313991] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-15T18:15:55.363624] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T18:15:55.774513] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T18:15:56.114032] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-15T18:15:56.394808] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-15T18:15:56.913970] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-15T18:15:57.092338] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:15:57.713996] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-15T18:15:58.033404] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T18:15:58.250684] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:15:58.513964] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-15T18:15:58.762521] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-15T18:15:59.314008] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-15T18:16:00.114004] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-15T18:16:00.914010] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-15T18:16:01.412785] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T18:16:01.459975] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:16:01.476665] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:16:01.713982] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-15T18:16:02.036680] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-15T18:16:02.514064] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-15T18:16:03.314060] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-15T18:16:03.444933] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:16:04.114004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-15T18:16:04.452863] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:16:04.913993] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-15T18:16:05.379113] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-15T18:16:05.714015] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-15T18:16:06.514004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-15T18:16:06.564481] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T18:16:06.569971] [INFO ] [REMOTE ] CTRI: Full fetch complete (53092 records). [2025-10-15T18:16:06.570102] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-15T18:16:06.570810] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:16:06.570893] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:16:06.570934] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:16:06.570996] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-15T18:16:06.571059] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-15T18:16:06.571093] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-15T18:16:06.571246] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-15T18:16:06.571334] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRI took 39.9s. Estimated remaining: 4h 10m 52s. Rate: 7.2 symbols/min [2025-10-15T18:16:06.739055] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:06.760081] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:16:06.809460] [DEBUG] [LOCAL ] CUBE: Loaded 50859 existing records from primary storage. [2025-10-15T18:16:06.809839] [INFO ] [MAIN ] CUBE: Loaded 50859 existing records. [2025-10-15T18:16:06.932020] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T18:16:06.959798] [INFO ] [REMOTE ] CUBB: Full fetch complete (950 records). [2025-10-15T18:16:06.962916] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-15T18:16:07.071067] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:07.090086] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-15T18:16:07.092389] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-15T18:16:07.098236] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-15T18:16:07.108509] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-15T18:16:07.273469] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-15T18:16:07.274071] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:16:07.284741] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:16:07.295128] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-15T18:16:07.323034] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-15T18:16:07.322976] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-15T18:16:07.350716] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-15T18:16:07.358245] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-15T18:16:07.391462] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CUBB took 19.1s. Estimated remaining: 4h 10m 19s. Rate: 7.3 symbols/min [2025-10-15T18:16:07.690381] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:07.707319] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:07.733702] [DEBUG] [LOCAL ] CUBI: Loaded 27208 existing records from primary storage. [2025-10-15T18:16:07.733974] [INFO ] [MAIN ] CUBI: Loaded 27208 existing records. [2025-10-15T18:16:07.911052] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:07.911379] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-15T18:16:07.911445] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-15T18:16:07.911827] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-15T18:16:07.911900] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-15T18:16:08.119749] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-15T18:16:08.304084] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:08.454516] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:16:08.914055] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-15T18:16:09.714011] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-15T18:16:10.132316] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T18:16:10.139626] [INFO ] [REMOTE ] CTVA: Full fetch complete (77189 records). [2025-10-15T18:16:10.139854] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-15T18:16:10.414750] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T18:16:10.519159] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-15T18:16:10.597752] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-15T18:16:10.597849] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-15T18:16:10.599080] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-15T18:16:10.599194] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-15T18:16:10.601107] [DEBUG] [LOCAL ] CTVA: Trimmed 77189 records to 53298 (keeping 200 days of data) [2025-10-15T18:16:10.925199] [DEBUG] [LOCAL ] CTVA: Primary data saved (53298 records). [2025-10-15T18:16:10.925333] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-15T18:16:10.925412] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CTVA took 32.9s. Estimated remaining: 4h 9m 56s. Rate: 7.3 symbols/min [2025-10-15T18:16:11.113767] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:11.173697] [DEBUG] [LOCAL ] CUK: Loaded 51044 existing records from primary storage. [2025-10-15T18:16:11.174240] [INFO ] [MAIN ] CUK: Loaded 51044 existing records. [2025-10-15T18:16:11.319145] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-15T18:16:11.410859] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:11.412082] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-15T18:16:11.412346] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-15T18:16:11.412954] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-15T18:16:11.413030] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-15T18:16:11.708574] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T18:16:11.723847] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:16:12.034573] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:12.114086] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-15T18:16:12.375626] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:16:12.914072] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-15T18:16:13.240617] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:16:13.243401] [INFO ] [REMOTE ] CTS: Full fetch complete (26993 records). [2025-10-15T18:16:13.243486] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-15T18:16:13.603704] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-15T18:16:13.603786] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-15T18:16:13.604292] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-15T18:16:13.604330] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-15T18:16:13.605045] [DEBUG] [LOCAL ] CTS: Trimmed 26993 records to 19649 (keeping 200 days of data) [2025-10-15T18:16:13.713983] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-15T18:16:13.729740] [DEBUG] [LOCAL ] CTS: Primary data saved (19649 records). [2025-10-15T18:16:13.729847] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-15T18:16:13.729923] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CTS took 44.6s. Estimated remaining: 4h 9m 30s. Rate: 7.3 symbols/min [2025-10-15T18:16:13.922534] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:13.922751] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-15T18:16:13.922795] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-15T18:16:13.922913] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-15T18:16:13.922974] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-15T18:16:13.923017] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-15T18:16:13.923048] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-15T18:16:14.283588] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:14.333265] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T18:16:14.513989] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-15T18:16:14.758708] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:16:15.314001] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-15T18:16:16.009881] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T18:16:16.113962] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-15T18:16:16.471743] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T18:16:16.582095] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T18:16:16.913986] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-15T18:16:17.316532] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T18:16:17.713996] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-15T18:16:18.337846] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T18:16:18.514075] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-15T18:16:19.314028] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-15T18:16:19.990338] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:16:20.114002] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-15T18:16:20.594748] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:16:20.914013] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-15T18:16:21.581865] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T18:16:21.713997] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-15T18:16:21.889834] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T18:16:22.513972] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-15T18:16:23.217172] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T18:16:23.314028] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-15T18:16:23.914225] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:16:24.114019] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-15T18:16:24.890866] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:16:24.913953] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-15T18:16:25.117823] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:16:25.713990] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-15T18:16:26.513975] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-15T18:16:26.744244] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:16:26.938767] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T18:16:26.988286] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T18:16:27.314055] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-15T18:16:28.114018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-15T18:16:28.194505] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T18:16:28.913992] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-15T18:16:29.714022] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-15T18:16:29.870254] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T18:16:30.159465] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T18:16:30.514024] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-15T18:16:30.637543] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:16:31.314028] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-15T18:16:31.910324] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T18:16:32.114003] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-15T18:16:32.349019] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T18:16:32.913991] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-15T18:16:33.016930] [DEBUG] [REMOTE ] CULP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-15T18:16:33.017240] [WARN ] [REMOTE ] CULP: No data returned for month 2025-08 [2025-10-15T18:16:33.017328] [FATAL] [REMOTE ] CULP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:16:33.017446] [FATAL] [MAIN ] CULP: Failed to fetch primary data. [2025-10-15T18:16:33.017525] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:16:33.017610] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-15T18:16:33.017755] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-15T18:16:33.017809] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-15T18:16:33.017864] [DEBUG] [LOCAL ] CULP: No derivative data file found to delete. [2025-10-15T18:16:33.017925] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CULP took 19.3s. Estimated remaining: 4h 9m 57s. Rate: 7.3 symbols/min [2025-10-15T18:16:33.187310] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:33.187470] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-15T18:16:33.187507] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-15T18:16:33.187613] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-15T18:16:33.187711] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-15T18:16:33.187758] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-15T18:16:33.187791] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-15T18:16:33.542159] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:16:33.569534] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:33.714000] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-15T18:16:34.513980] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-15T18:16:34.824341] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T18:16:35.314044] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-15T18:16:36.059788] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:16:36.113957] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-15T18:16:36.467998] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:16:36.914000] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-15T18:16:37.713994] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-15T18:16:37.897848] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T18:16:37.901109] [INFO ] [REMOTE ] CUBI: Full fetch complete (39121 records). [2025-10-15T18:16:37.901210] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-15T18:16:38.289857] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-15T18:16:38.289968] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-15T18:16:38.290700] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-15T18:16:38.290781] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-15T18:16:38.323592] [DEBUG] [LOCAL ] CUBI: Trimmed 39121 records to 27163 (keeping 200 days of data) [2025-10-15T18:16:38.326800] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T18:16:38.497882] [DEBUG] [LOCAL ] CUBI: Primary data saved (27163 records). [2025-10-15T18:16:38.498034] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-15T18:16:38.498118] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUBI took 31.1s. Estimated remaining: 4h 9m 40s. Rate: 7.3 symbols/min [2025-10-15T18:16:38.519178] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-15T18:16:38.668068] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:38.695290] [DEBUG] [LOCAL ] CURV: Loaded 26882 existing records from primary storage. [2025-10-15T18:16:38.695559] [INFO ] [MAIN ] CURV: Loaded 26882 existing records. [2025-10-15T18:16:38.869726] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:38.869946] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-15T18:16:38.869993] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-15T18:16:38.870235] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-15T18:16:38.870291] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-15T18:16:39.218946] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:39.313984] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-15T18:16:39.580913] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T18:16:39.842280] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T18:16:40.114006] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-15T18:16:40.640344] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:16:40.914001] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-15T18:16:41.411570] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:16:41.713996] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-15T18:16:42.513963] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-15T18:16:42.813039] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T18:16:42.902539] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:16:43.313965] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-15T18:16:43.474593] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:16:44.114003] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-15T18:16:44.749355] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:16:44.792059] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T18:16:44.913997] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-15T18:16:45.714004] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-15T18:16:46.093343] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T18:16:46.514066] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-15T18:16:46.893803] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T18:16:47.314054] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-15T18:16:47.977326] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:16:48.113996] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-15T18:16:48.720559] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T18:16:48.913995] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-15T18:16:49.719678] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-15T18:16:49.724757] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:16:49.774474] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T18:16:50.514048] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-15T18:16:51.264562] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:16:51.286512] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T18:16:51.313977] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-15T18:16:52.114003] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-15T18:16:52.913969] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-15T18:16:53.206106] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T18:16:53.222953] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-15T18:16:53.229834] [INFO ] [REMOTE ] CUK: Full fetch complete (74254 records). [2025-10-15T18:16:53.230024] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-15T18:16:53.660261] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-15T18:16:53.660355] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-15T18:16:53.661463] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-15T18:16:53.661533] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-15T18:16:53.663061] [DEBUG] [LOCAL ] CUK: Trimmed 74254 records to 51046 (keeping 200 days of data) [2025-10-15T18:16:53.721794] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-15T18:16:53.985743] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:16:54.010844] [DEBUG] [LOCAL ] CUK: Primary data saved (51046 records). [2025-10-15T18:16:54.010980] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-15T18:16:54.011110] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUK took 43.1s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-15T18:16:54.514012] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-15T18:16:54.836572] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T18:16:55.314012] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-15T18:16:55.817708] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T18:16:55.824147] [INFO ] [REMOTE ] CUBE: Full fetch complete (73222 records). [2025-10-15T18:16:55.824325] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-15T18:16:56.119164] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-15T18:16:56.278589] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-15T18:16:56.278717] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-15T18:16:56.279667] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-15T18:16:56.279877] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-15T18:16:56.281439] [DEBUG] [LOCAL ] CUBE: Trimmed 73222 records to 50909 (keeping 200 days of data) [2025-10-15T18:16:56.600045] [DEBUG] [LOCAL ] CUBE: Primary data saved (50909 records). [2025-10-15T18:16:56.614899] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-15T18:16:56.615252] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUBE took 50.0s. Estimated remaining: 4h 9m 29s. Rate: 7.3 symbols/min [2025-10-15T18:16:56.617136] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:16:56.914020] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-15T18:16:57.229293] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:16:57.714008] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-15T18:16:58.295368] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T18:16:58.514005] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-15T18:16:58.805822] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T18:16:59.313991] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-15T18:16:59.813581] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T18:16:59.817899] [INFO ] [REMOTE ] CURV: Full fetch complete (39002 records). [2025-10-15T18:16:59.818035] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-15T18:17:00.180767] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-15T18:17:00.180853] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-15T18:17:00.181459] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-15T18:17:00.181500] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-15T18:17:00.182437] [DEBUG] [LOCAL ] CURV: Trimmed 39002 records to 26989 (keeping 200 days of data) [2025-10-15T18:17:00.335855] [DEBUG] [LOCAL ] CURV: Primary data saved (26989 records). [2025-10-15T18:17:00.335990] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-15T18:17:00.336071] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURV took 21.8s. Estimated remaining: 4h 9m 6s. Rate: 7.3 symbols/min [2025-10-15T18:17:00.735816] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:17:00.743443] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-15T18:17:02.204254] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T18:17:02.211610] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-15T18:17:03.536687] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T18:17:03.543175] [INFO ] [REMOTE ] CURB: Full fetch complete (47288 records). [2025-10-15T18:17:03.543347] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-15T18:17:03.981677] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-15T18:17:03.981798] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-15T18:17:03.982596] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-15T18:17:03.982718] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-15T18:17:03.984040] [DEBUG] [LOCAL ] CURB: Trimmed 47288 records to 32854 (keeping 200 days of data) [2025-10-15T18:17:04.208985] [DEBUG] [LOCAL ] CURB: Primary data saved (32854 records). [2025-10-15T18:17:04.209144] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-15T18:17:04.209250] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURB took 31.2s. Estimated remaining: 4h 8m 43s. Rate: 7.3 symbols/min [2025-10-15T18:17:05.070715] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.168625] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.144294] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.251708] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.302876] [DEBUG] [LOCAL ] CVEO: Loaded 15396 existing records from primary storage. [2025-10-15T18:17:05.303373] [INFO ] [MAIN ] CVEO: Loaded 15396 existing records. [2025-10-15T18:17:05.459226] [DEBUG] [LOCAL ] CUZ: Loaded 49608 existing records from primary storage. [2025-10-15T18:17:05.458491] [DEBUG] [LOCAL ] CVE: Loaded 53562 existing records from primary storage. [2025-10-15T18:17:05.473395] [INFO ] [MAIN ] CVE: Loaded 53562 existing records. [2025-10-15T18:17:05.473270] [INFO ] [MAIN ] CUZ: Loaded 49608 existing records. [2025-10-15T18:17:05.530005] [DEBUG] [LOCAL ] CVI: Loaded 46631 existing records from primary storage. [2025-10-15T18:17:05.644893] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:05.659527] [INFO ] [MAIN ] CVI: Loaded 46631 existing records. [2025-10-15T18:17:05.685843] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-15T18:17:05.736743] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-15T18:17:05.793432] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-15T18:17:05.834972] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-15T18:17:06.037427] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:06.126119] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-15T18:17:06.150145] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:06.155700] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-15T18:17:06.134046] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-15T18:17:06.175593] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-15T18:17:06.241890] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:06.238560] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-15T18:17:06.271137] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-15T18:17:06.238492] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-15T18:17:06.290469] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-15T18:17:06.304410] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-15T18:17:06.281503] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-15T18:17:06.368751] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-15T18:17:06.433708] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-15T18:17:06.961468] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.018416] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-15T18:17:07.456023] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.522526] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.528045] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-15T18:17:07.533397] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-15T18:17:07.600129] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.600448] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-15T18:17:08.017868] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:17:08.020429] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-15T18:17:08.761721] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T18:17:08.763983] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-15T18:17:08.972320] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T18:17:08.982006] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-15T18:17:09.056088] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:17:09.066628] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-15T18:17:09.230752] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:17:09.240636] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-15T18:17:09.580389] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:17:09.583514] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-15T18:17:10.228380] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:17:10.232219] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-15T18:17:10.438540] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T18:17:10.513950] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-15T18:17:10.819318] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T18:17:10.914830] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T18:17:11.215253] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:17:11.314012] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-15T18:17:11.850202] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T18:17:12.072010] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T18:17:12.114012] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-15T18:17:12.914016] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-15T18:17:13.432299] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:17:13.714009] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-15T18:17:13.867029] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:17:14.514003] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-15T18:17:15.039078] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:17:15.063000] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T18:17:15.313994] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-15T18:17:16.114019] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-15T18:17:16.215326] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T18:17:16.913983] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-15T18:17:17.611403] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:17:17.713967] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-15T18:17:18.513994] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-15T18:17:18.783963] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:17:19.314029] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-15T18:17:19.501574] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T18:17:20.094758] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:17:20.113970] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-15T18:17:20.156210] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T18:17:20.913997] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-15T18:17:21.713967] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-15T18:17:21.766053] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:17:22.327188] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:17:22.514014] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-15T18:17:23.313957] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-15T18:17:23.480764] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:17:23.934590] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:17:24.114009] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-15T18:17:24.241306] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T18:17:24.245093] [INFO ] [REMOTE ] CVEO: Full fetch complete (20770 records). [2025-10-15T18:17:24.245294] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-15T18:17:24.658379] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-15T18:17:24.658482] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-15T18:17:24.658960] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-15T18:17:24.659023] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-15T18:17:24.659704] [DEBUG] [LOCAL ] CVEO: Trimmed 20770 records to 15382 (keeping 200 days of data) [2025-10-15T18:17:24.747075] [DEBUG] [LOCAL ] CVEO: Primary data saved (15382 records). [2025-10-15T18:17:24.747221] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-15T18:17:24.747315] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVEO took 20.5s. Estimated remaining: 4h 9m 15s. Rate: 7.3 symbols/min [2025-10-15T18:17:24.912230] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:24.914005] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-15T18:17:24.928741] [DEBUG] [LOCAL ] CVLG: Loaded 15571 existing records from primary storage. [2025-10-15T18:17:24.928972] [INFO ] [MAIN ] CVLG: Loaded 15571 existing records. [2025-10-15T18:17:25.104451] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:25.104746] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-15T18:17:25.104817] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-15T18:17:25.105034] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-15T18:17:25.105075] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-15T18:17:25.471248] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:25.659060] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:17:25.713992] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-15T18:17:26.518838] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-15T18:17:26.531256] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:17:26.986952] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T18:17:27.079859] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-15T18:17:27.314055] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-15T18:17:28.114010] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-15T18:17:28.661732] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T18:17:28.913969] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-15T18:17:28.981128] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T18:17:29.714069] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-15T18:17:30.513979] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-15T18:17:30.626636] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:17:31.062867] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:17:31.313979] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-15T18:17:31.495450] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T18:17:32.113974] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-15T18:17:32.608027] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T18:17:32.613629] [INFO ] [REMOTE ] CVI: Full fetch complete (67271 records). [2025-10-15T18:17:32.613764] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-15T18:17:32.918223] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-15T18:17:33.014052] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-15T18:17:33.014133] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-15T18:17:33.015028] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-15T18:17:33.015092] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-15T18:17:33.016351] [DEBUG] [LOCAL ] CVI: Trimmed 67271 records to 46660 (keeping 200 days of data) [2025-10-15T18:17:33.292417] [DEBUG] [LOCAL ] CVI: Primary data saved (46660 records). [2025-10-15T18:17:33.292547] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-15T18:17:33.293539] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVI took 29.1s. Estimated remaining: 4h 9m 7s. Rate: 7.3 symbols/min [2025-10-15T18:17:33.463876] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:33.522409] [DEBUG] [LOCAL ] CVNA: Loaded 52872 existing records from primary storage. [2025-10-15T18:17:33.522764] [INFO ] [MAIN ] CVNA: Loaded 52872 existing records. [2025-10-15T18:17:33.711284] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:33.711587] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-15T18:17:33.711687] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-15T18:17:33.712116] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-15T18:17:33.712187] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-15T18:17:33.724731] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-15T18:17:34.065090] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:17:34.111436] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:34.342549] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T18:17:34.514023] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-15T18:17:34.692965] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T18:17:35.314052] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-15T18:17:35.967709] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T18:17:36.114025] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-15T18:17:36.914009] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-15T18:17:37.344189] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:17:37.714081] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-15T18:17:37.737836] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T18:17:37.818603] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T18:17:38.513991] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-15T18:17:39.193236] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:17:39.314024] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-15T18:17:39.530599] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T18:17:40.113996] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-15T18:17:40.913967] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-15T18:17:41.117046] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:17:41.415182] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T18:17:41.714003] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-15T18:17:42.412468] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:17:42.418916] [INFO ] [REMOTE ] CUZ: Full fetch complete (70912 records). [2025-10-15T18:17:42.419033] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-15T18:17:42.519131] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-15T18:17:42.625095] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T18:17:42.843274] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-15T18:17:42.843357] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-15T18:17:42.844227] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-15T18:17:42.844303] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-15T18:17:42.845713] [DEBUG] [LOCAL ] CUZ: Trimmed 70912 records to 49639 (keeping 200 days of data) [2025-10-15T18:17:43.149801] [DEBUG] [LOCAL ] CUZ: Primary data saved (49639 records). [2025-10-15T18:17:43.149939] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-15T18:17:43.150024] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CUZ took 38.9s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-15T18:17:43.328449] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-15T18:17:43.332047] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:43.382058] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-15T18:17:43.382402] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-15T18:17:43.557039] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:43.557267] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-15T18:17:43.557317] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-15T18:17:43.557684] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-15T18:17:43.557742] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-15T18:17:43.909189] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:44.114002] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-15T18:17:44.310594] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T18:17:44.914003] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-15T18:17:45.227449] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T18:17:45.494715] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T18:17:45.713977] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-15T18:17:46.513966] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-15T18:17:46.561170] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-15T18:17:46.586598] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T18:17:47.314014] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-15T18:17:48.114086] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-15T18:17:48.427389] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T18:17:48.913971] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-15T18:17:48.939043] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:17:48.941107] [INFO ] [REMOTE ] CVLG: Full fetch complete (21218 records). [2025-10-15T18:17:48.941182] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-15T18:17:48.941626] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:17:48.941726] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:17:48.941768] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:17:48.941830] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-15T18:17:48.941928] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-15T18:17:48.941969] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-15T18:17:48.942145] [DEBUG] [LOCAL ] CVLG: Deleted derivative data file. [2025-10-15T18:17:48.942229] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVLG took 24.2s. Estimated remaining: 4h 8m 48s. Rate: 7.3 symbols/min [2025-10-15T18:17:49.113291] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:49.166958] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-15T18:17:49.167272] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-15T18:17:49.342414] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:49.342829] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-15T18:17:49.342894] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-15T18:17:49.343409] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-15T18:17:49.343524] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-15T18:17:49.543516] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T18:17:49.715190] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-15T18:17:49.739157] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:50.514057] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-15T18:17:50.635832] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:17:51.314005] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-15T18:17:52.041376] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-15T18:17:52.113962] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-15T18:17:52.511954] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T18:17:52.913997] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-15T18:17:53.109081] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:17:53.117588] [INFO ] [REMOTE ] CVE: Full fetch complete (77326 records). [2025-10-15T18:17:53.117844] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-15T18:17:53.119324] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:17:53.119462] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:17:53.119530] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:17:53.119613] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-15T18:17:53.119735] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-15T18:17:53.119795] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-15T18:17:53.119965] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-15T18:17:53.120080] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVE took 48.9s. Estimated remaining: 4h 8m 26s. Rate: 7.3 symbols/min [2025-10-15T18:17:53.291308] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:53.314063] [DEBUG] [LOCAL ] CW: Loaded 22123 existing records from primary storage. [2025-10-15T18:17:53.314341] [INFO ] [MAIN ] CW: Loaded 22123 existing records. [2025-10-15T18:17:53.488852] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:53.489070] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-15T18:17:53.489116] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-15T18:17:53.489426] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-15T18:17:53.489480] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-15T18:17:53.729954] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-15T18:17:53.870025] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:54.300931] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-15T18:17:54.513977] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-15T18:17:55.121961] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-15T18:17:55.314009] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-15T18:17:55.627860] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T18:17:56.114003] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-15T18:17:56.451729] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-15T18:17:56.914013] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-15T18:17:57.297550] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-15T18:17:57.714018] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-15T18:17:58.087433] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T18:17:58.149448] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T18:17:58.513997] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-15T18:17:59.313993] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-15T18:18:00.038053] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-15T18:18:00.113989] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-15T18:18:00.264053] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T18:18:00.729181] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T18:18:00.913992] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-15T18:18:01.714028] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-15T18:18:02.016480] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T18:18:02.514001] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-15T18:18:02.979996] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:18:03.152475] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-15T18:18:03.314185] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-15T18:18:04.114056] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-15T18:18:04.464325] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T18:18:04.914096] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-15T18:18:05.140902] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:18:05.714053] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-15T18:18:06.265429] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T18:18:06.514060] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-15T18:18:07.024948] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-15T18:18:07.031900] [INFO ] [REMOTE ] CVNA: Full fetch complete (76396 records). [2025-10-15T18:18:07.032135] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-15T18:18:07.033262] [FATAL] [VALIDATOR ] CVNA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:18:07.033367] [FATAL] [MAIN ] CVNA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:18:07.033431] [WARN ] [MAIN ] CVNA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:18:07.033519] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-15T18:18:07.033601] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-15T18:18:07.033725] [INFO ] [LOCAL ] CVNA: Starting deletion of derivative data. [2025-10-15T18:18:07.033892] [DEBUG] [LOCAL ] CVNA: Deleted derivative data file. [2025-10-15T18:18:07.034795] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVNA took 33.7s. Estimated remaining: 4h 8m 36s. Rate: 7.3 symbols/min [2025-10-15T18:18:07.214668] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:07.268326] [DEBUG] [LOCAL ] CWAN: Loaded 52586 existing records from primary storage. [2025-10-15T18:18:07.268695] [INFO ] [MAIN ] CWAN: Loaded 52586 existing records. [2025-10-15T18:18:07.336708] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-15T18:18:07.456163] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:07.456443] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-15T18:18:07.456543] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-15T18:18:07.456812] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-15T18:18:07.456869] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-15T18:18:07.820279] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:07.854104] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T18:18:08.114014] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-15T18:18:08.599031] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T18:18:08.914010] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-15T18:18:09.043158] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-15T18:18:09.713987] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-15T18:18:10.145697] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T18:18:10.271525] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:18:10.514045] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-15T18:18:11.217096] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T18:18:11.314001] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-15T18:18:11.561192] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:18:12.114072] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-15T18:18:12.914048] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-15T18:18:13.714049] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-15T18:18:13.836833] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T18:18:13.876787] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:18:14.514404] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-15T18:18:14.991595] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T18:18:15.027071] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:18:15.313996] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-15T18:18:16.114004] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-15T18:18:16.729803] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-15T18:18:16.925944] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-15T18:18:16.948255] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T18:18:16.949283] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T18:18:16.966425] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-15T18:18:16.966563] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-15T18:18:17.390783] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-15T18:18:17.390882] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-15T18:18:17.391821] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-15T18:18:17.391885] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-15T18:18:17.393454] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-15T18:18:17.714065] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-15T18:18:17.733587] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-15T18:18:17.733777] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-15T18:18:17.733867] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVS took 34.6s. Estimated remaining: 4h 8m 36s. Rate: 7.2 symbols/min [2025-10-15T18:18:17.921850] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:17.922022] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-15T18:18:17.922058] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-15T18:18:17.922171] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-15T18:18:17.922231] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-15T18:18:17.922273] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-15T18:18:17.922307] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-15T18:18:18.275971] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:18.514018] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-15T18:18:19.264893] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-15T18:18:19.319146] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-15T18:18:19.338419] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T18:18:19.934395] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T18:18:20.114007] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-15T18:18:20.913993] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-15T18:18:21.323337] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:18:21.555243] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T18:18:21.713993] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-15T18:18:21.744278] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T18:18:22.514008] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-15T18:18:22.930991] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T18:18:23.313997] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-15T18:18:24.113991] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-15T18:18:24.726600] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-15T18:18:24.840938] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T18:18:24.896111] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T18:18:24.913949] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-15T18:18:25.714059] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-15T18:18:26.328284] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:18:26.514018] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-15T18:18:26.529731] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:18:27.313977] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-15T18:18:27.810579] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T18:18:28.114026] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-15T18:18:28.443392] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:18:28.446007] [INFO ] [REMOTE ] CW: Full fetch complete (33157 records). [2025-10-15T18:18:28.446087] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-15T18:18:28.835685] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-15T18:18:28.835824] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-15T18:18:28.836545] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-15T18:18:28.836691] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-15T18:18:28.840920] [DEBUG] [LOCAL ] CW: Trimmed 33157 records to 22100 (keeping 200 days of data) [2025-10-15T18:18:28.931810] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-15T18:18:28.953043] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T18:18:28.963156] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-15T18:18:28.965235] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-15T18:18:29.392856] [DEBUG] [LOCAL ] CW: Primary data saved (22100 records). [2025-10-15T18:18:29.414544] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-15T18:18:29.410935] [INFO ] [MAIN ] CW: Full history saved. [2025-10-15T18:18:29.414613] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-15T18:18:29.415723] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-15T18:18:29.415801] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-15T18:18:29.415925] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CW took 36.3s. Estimated remaining: 4h 8m 38s. Rate: 7.2 symbols/min [2025-10-15T18:18:29.528452] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-15T18:18:29.703913] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:29.704612] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-15T18:18:29.705275] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-15T18:18:29.705705] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-15T18:18:29.707165] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-15T18:18:29.709078] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-15T18:18:29.709951] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-15T18:18:29.715431] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-15T18:18:30.309729] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:30.328631] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-15T18:18:30.328766] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-15T18:18:30.329227] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CVX took 41.4s. Estimated remaining: 4h 8m 7s. Rate: 7.3 symbols/min [2025-10-15T18:18:30.507956] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:30.508244] [DEBUG] [LOCAL ] CWK: No existing data file found in primary storage. [2025-10-15T18:18:30.508297] [WARN ] [MAIN ] CWK: No existing data found, performing full refresh instead. [2025-10-15T18:18:30.508477] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-15T18:18:30.508529] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-15T18:18:30.508579] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-15T18:18:30.508617] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-15T18:18:30.539254] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-15T18:18:30.893496] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:30.918683] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T18:18:31.301827] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T18:18:31.313954] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-15T18:18:32.113968] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-15T18:18:32.459491] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-15T18:18:32.658152] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:18:32.914015] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-15T18:18:33.592861] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T18:18:33.713958] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-15T18:18:34.430144] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T18:18:34.513963] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-15T18:18:35.303683] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T18:18:35.313954] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-15T18:18:35.827884] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:18:36.113992] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-15T18:18:36.884380] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:18:36.913961] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-15T18:18:37.533094] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:18:37.714011] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-15T18:18:38.413166] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T18:18:38.513990] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-15T18:18:39.093450] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:18:39.314008] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-15T18:18:39.947074] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T18:18:40.113985] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-15T18:18:40.913981] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-15T18:18:40.983137] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T18:18:41.545883] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:18:41.713967] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-15T18:18:42.392872] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T18:18:42.513981] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-15T18:18:43.313963] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-15T18:18:43.670842] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:18:44.113976] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-15T18:18:44.219400] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:18:44.686354] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T18:18:44.914039] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-15T18:18:45.714026] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-15T18:18:45.836633] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T18:18:46.430067] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:18:46.513985] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-15T18:18:47.313976] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-15T18:18:47.460803] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:18:48.114028] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-15T18:18:48.144853] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T18:18:48.914027] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-15T18:18:49.083515] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T18:18:49.586256] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T18:18:49.713988] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-15T18:18:50.345614] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:18:50.514064] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-15T18:18:51.322989] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-15T18:18:51.334904] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T18:18:51.341594] [INFO ] [REMOTE ] CWAN: Full fetch complete (75488 records). [2025-10-15T18:18:51.341740] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-15T18:18:51.724431] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-15T18:18:51.724544] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-15T18:18:51.725531] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-15T18:18:51.725614] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-15T18:18:51.727372] [DEBUG] [LOCAL ] CWAN: Trimmed 75488 records to 52616 (keeping 200 days of data) [2025-10-15T18:18:51.958531] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:18:52.070323] [DEBUG] [LOCAL ] CWAN: Primary data saved (52616 records). [2025-10-15T18:18:52.070454] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-15T18:18:52.071225] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 45.0s. Estimated remaining: 4h 8m 41s. Rate: 7.2 symbols/min [2025-10-15T18:18:52.121606] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-15T18:18:52.245413] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:52.276458] [DEBUG] [LOCAL ] CWT: Loaded 28136 existing records from primary storage. [2025-10-15T18:18:52.276792] [INFO ] [MAIN ] CWT: Loaded 28136 existing records. [2025-10-15T18:18:52.453502] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:52.453809] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-15T18:18:52.453866] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-15T18:18:52.454338] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-15T18:18:52.454394] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-15T18:18:52.802442] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:52.913954] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-15T18:18:52.986756] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:18:53.713978] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-15T18:18:53.873961] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:18:53.898531] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T18:18:54.513992] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-15T18:18:55.313968] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-15T18:18:55.423805] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:18:55.429917] [INFO ] [REMOTE ] CWEN: Full fetch complete (65378 records). [2025-10-15T18:18:55.430053] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-15T18:18:55.820823] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-15T18:18:55.820899] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-15T18:18:55.821714] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-15T18:18:55.821776] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-15T18:18:55.823037] [DEBUG] [LOCAL ] CWEN: Trimmed 65378 records to 45322 (keeping 200 days of data) [2025-10-15T18:18:55.962124] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:18:56.119729] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-15T18:18:56.129854] [DEBUG] [LOCAL ] CWEN: Primary data saved (45322 records). [2025-10-15T18:18:56.129935] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-15T18:18:56.130002] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 38.4s. Estimated remaining: 4h 8m 19s. Rate: 7.2 symbols/min [2025-10-15T18:18:56.292926] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:56.339429] [DEBUG] [LOCAL ] CX: Loaded 52837 existing records from primary storage. [2025-10-15T18:18:56.339781] [INFO ] [MAIN ] CX: Loaded 52837 existing records. [2025-10-15T18:18:56.509939] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:56.510129] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-15T18:18:56.510174] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-15T18:18:56.510514] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-15T18:18:56.510568] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-15T18:18:56.858422] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:56.913947] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-15T18:18:57.081470] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:18:57.087351] [INFO ] [REMOTE ] CWH: Full fetch complete (73222 records). [2025-10-15T18:18:57.087462] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-15T18:18:57.470144] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-15T18:18:57.470243] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-15T18:18:57.471238] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-15T18:18:57.471318] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-15T18:18:57.488614] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T18:18:57.494794] [DEBUG] [LOCAL ] CWH: Trimmed 73222 records to 51349 (keeping 200 days of data) [2025-10-15T18:18:57.714690] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-15T18:18:57.801391] [DEBUG] [LOCAL ] CWH: Primary data saved (51349 records). [2025-10-15T18:18:57.801513] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-15T18:18:57.801580] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 28.4s. Estimated remaining: 4h 7m 50s. Rate: 7.3 symbols/min [2025-10-15T18:18:57.969562] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:57.977190] [DEBUG] [LOCAL ] CXE: Loaded 6134 existing records from primary storage. [2025-10-15T18:18:57.977381] [INFO ] [MAIN ] CXE: Loaded 6134 existing records. [2025-10-15T18:18:58.156185] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:58.156411] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-15T18:18:58.156538] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-15T18:18:58.156722] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-15T18:18:58.156784] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-15T18:18:58.527226] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-15T18:18:58.527163] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:58.547425] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:18:58.845512] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T18:18:59.314017] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-15T18:19:00.114008] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-15T18:19:00.175927] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:19:00.202405] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:19:00.209975] [INFO ] [REMOTE ] CWK: Full fetch complete (71238 records). [2025-10-15T18:19:00.210203] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-15T18:19:00.660976] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-15T18:19:00.661106] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-15T18:19:00.662365] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-15T18:19:00.662431] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-15T18:19:00.664355] [DEBUG] [LOCAL ] CWK: Trimmed 71238 records to 49628 (keeping 200 days of data) [2025-10-15T18:19:00.914038] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-15T18:19:00.989930] [DEBUG] [LOCAL ] CWK: Primary data saved (49628 records). [2025-10-15T18:19:00.990144] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-15T18:19:00.990271] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 30.7s. Estimated remaining: 4h 7m 26s. Rate: 7.3 symbols/min [2025-10-15T18:19:01.171765] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:01.180390] [DEBUG] [LOCAL ] CXH: Loaded 4435 existing records from primary storage. [2025-10-15T18:19:01.180778] [INFO ] [MAIN ] CXH: Loaded 4435 existing records. [2025-10-15T18:19:01.383435] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:01.383880] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-15T18:19:01.383965] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-15T18:19:01.384301] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-15T18:19:01.384423] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-15T18:19:01.588484] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:19:01.717132] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-15T18:19:01.746377] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:19:01.833559] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:02.514016] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-15T18:19:03.228350] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:19:03.314005] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-15T18:19:03.573863] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T18:19:04.113989] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-15T18:19:04.651898] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T18:19:04.914000] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-15T18:19:04.984002] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T18:19:05.714027] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-15T18:19:06.038826] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T18:19:06.501504] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:19:06.513944] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-15T18:19:07.118226] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T18:19:07.314057] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-15T18:19:07.627162] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T18:19:08.114039] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-15T18:19:08.914067] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-15T18:19:09.520147] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T18:19:09.713993] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-15T18:19:09.901531] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:19:10.121426] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T18:19:10.514045] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-15T18:19:11.043087] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T18:19:11.314030] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-15T18:19:12.114045] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-15T18:19:12.467597] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:19:12.519319] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T18:19:12.913988] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-15T18:19:13.714035] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-15T18:19:14.176057] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T18:19:14.446627] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:19:14.513966] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-15T18:19:15.314000] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-15T18:19:16.123292] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-15T18:19:16.128003] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:19:16.135059] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:19:16.913990] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-15T18:19:17.445037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T18:19:17.714012] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-15T18:19:18.324042] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T18:19:18.514035] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-15T18:19:18.548182] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T18:19:19.314054] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-15T18:19:20.114877] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-15T18:19:20.115742] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:19:20.355682] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:19:20.914026] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-15T18:19:21.121773] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:19:21.267793] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-15T18:19:21.713978] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-15T18:19:22.514014] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-15T18:19:23.134065] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:19:23.314008] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-15T18:19:23.736975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T18:19:23.744364] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T18:19:24.114003] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-15T18:19:24.620785] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:19:24.621566] [INFO ] [REMOTE ] CXH: Full fetch complete (5336 records). [2025-10-15T18:19:24.621631] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-15T18:19:24.919228] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-15T18:19:24.978347] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-15T18:19:24.978431] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-15T18:19:24.978618] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-15T18:19:24.978683] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-15T18:19:24.979070] [DEBUG] [LOCAL ] CXH: Trimmed 5336 records to 4432 (keeping 200 days of data) [2025-10-15T18:19:25.008228] [DEBUG] [LOCAL ] CXH: Primary data saved (4432 records). [2025-10-15T18:19:25.008376] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-15T18:19:25.008473] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CXH took 24.0s. Estimated remaining: 4h 8m 7s. Rate: 7.2 symbols/min [2025-10-15T18:19:25.176528] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:25.217935] [DEBUG] [LOCAL ] CXM: Loaded 47569 existing records from primary storage. [2025-10-15T18:19:25.218223] [INFO ] [MAIN ] CXM: Loaded 47569 existing records. [2025-10-15T18:19:25.392769] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:25.398251] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-15T18:19:25.398480] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T18:19:25.398566] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-15T18:19:25.402019] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-15T18:19:25.402086] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-15T18:19:25.719113] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-15T18:19:25.754131] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:26.514041] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-15T18:19:27.281579] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:19:27.313950] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-15T18:19:27.895626] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:19:27.899366] [INFO ] [REMOTE ] CWT: Full fetch complete (41021 records). [2025-10-15T18:19:27.899445] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-15T18:19:28.120854] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-15T18:19:28.272440] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-15T18:19:28.272537] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-15T18:19:28.273484] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-15T18:19:28.273551] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-15T18:19:28.274679] [DEBUG] [LOCAL ] CWT: Trimmed 41021 records to 28121 (keeping 200 days of data) [2025-10-15T18:19:28.463564] [DEBUG] [LOCAL ] CWT: Primary data saved (28121 records). [2025-10-15T18:19:28.463730] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-15T18:19:28.463839] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWT took 36.4s. Estimated remaining: 4h 7m 43s. Rate: 7.2 symbols/min [2025-10-15T18:19:28.649994] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:28.683427] [DEBUG] [LOCAL ] CXT: Loaded 31022 existing records from primary storage. [2025-10-15T18:19:28.683737] [INFO ] [MAIN ] CXT: Loaded 31022 existing records. [2025-10-15T18:19:28.894875] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:28.895158] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-15T18:19:28.895229] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-15T18:19:28.900538] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-15T18:19:28.908859] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-15T18:19:28.915061] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T18:19:28.915169] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-15T18:19:28.981986] [INFO ] [REMOTE ] CX: Full fetch complete (76169 records). [2025-10-15T18:19:29.017854] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-15T18:19:29.031749] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:19:29.047170] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:19:29.063985] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:19:29.075506] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-15T18:19:29.094740] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-15T18:19:29.164144] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-10-15T18:19:29.194683] [DEBUG] [LOCAL ] CX: Deleted derivative data file. [2025-10-15T18:19:29.194850] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CX took 33.1s. Estimated remaining: 4h 7m 12s. Rate: 7.3 symbols/min [2025-10-15T18:19:29.389298] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:29.473005] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:29.473236] [DEBUG] [LOCAL ] CXW: No existing data file found in primary storage. [2025-10-15T18:19:29.473307] [WARN ] [MAIN ] CXW: No existing data found, performing full refresh instead. [2025-10-15T18:19:29.473446] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-15T18:19:29.473528] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-15T18:19:29.473794] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-10-15T18:19:29.473878] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-15T18:19:29.722419] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-15T18:19:29.764372] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:19:29.813780] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T18:19:29.898998] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:30.514047] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-15T18:19:30.920191] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:19:31.314024] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-15T18:19:31.793933] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T18:19:32.121050] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-15T18:19:32.126043] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:19:32.914048] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-15T18:19:33.497107] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:19:33.621727] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:19:33.714000] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-15T18:19:34.514015] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-15T18:19:34.786426] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:19:35.313998] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-15T18:19:35.669042] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:19:36.114006] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-15T18:19:36.352562] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T18:19:36.913984] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-15T18:19:37.529536] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T18:19:37.530711] [INFO ] [REMOTE ] CXE: Full fetch complete (11480 records). [2025-10-15T18:19:37.530784] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-15T18:19:37.708332] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T18:19:37.717692] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-15T18:19:37.936241] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-15T18:19:37.936327] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-15T18:19:37.936595] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-15T18:19:37.936633] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-15T18:19:37.937114] [DEBUG] [LOCAL ] CXE: Trimmed 11480 records to 6145 (keeping 200 days of data) [2025-10-15T18:19:37.973308] [DEBUG] [LOCAL ] CXE: Primary data saved (6145 records). [2025-10-15T18:19:37.973439] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-15T18:19:37.973518] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CXE took 40.2s. Estimated remaining: 4h 7m 5s. Rate: 7.3 symbols/min [2025-10-15T18:19:38.145849] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:38.172753] [DEBUG] [LOCAL ] CYD: Loaded 26757 existing records from primary storage. [2025-10-15T18:19:38.173007] [INFO ] [MAIN ] CYD: Loaded 26757 existing records. [2025-10-15T18:19:38.348193] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:38.348429] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-15T18:19:38.348502] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-15T18:19:38.348852] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-15T18:19:38.348920] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-15T18:19:38.519859] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-15T18:19:38.702841] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:39.290235] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:19:39.313963] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-15T18:19:40.113973] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-15T18:19:40.198113] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T18:19:40.653150] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:19:40.914058] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-15T18:19:41.714012] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-15T18:19:42.320062] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T18:19:42.469465] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T18:19:42.513991] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-15T18:19:42.912706] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-15T18:19:43.313999] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-15T18:19:43.344400] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (3.23 seconds). [2025-10-15T18:19:44.088518] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:19:44.113951] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-15T18:19:44.914028] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-15T18:19:45.330017] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:19:45.714010] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-15T18:19:46.080493] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:19:46.514052] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-15T18:19:47.114436] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:19:47.313982] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-15T18:19:47.961223] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:19:48.113966] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-15T18:19:48.622817] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:19:48.913996] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-15T18:19:49.457982] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:19:49.713986] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-15T18:19:50.200249] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T18:19:50.514038] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-15T18:19:51.161504] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T18:19:51.313951] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-15T18:19:52.017270] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:19:52.113949] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-15T18:19:52.875427] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T18:19:52.913951] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-15T18:19:53.451520] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:19:53.713992] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-15T18:19:54.102890] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T18:19:54.513993] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-15T18:19:55.198695] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T18:19:55.314000] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-15T18:19:56.114026] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-15T18:19:56.237759] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:19:56.244016] [INFO ] [REMOTE ] CXM: Full fetch complete (68677 records). [2025-10-15T18:19:56.244195] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-15T18:19:56.710342] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-15T18:19:56.710577] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-15T18:19:56.711932] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-15T18:19:56.712070] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-15T18:19:56.714324] [DEBUG] [LOCAL ] CXM: Trimmed 68677 records to 47569 (keeping 200 days of data) [2025-10-15T18:19:56.746515] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:19:56.923467] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-15T18:19:57.048181] [DEBUG] [LOCAL ] CXM: Primary data saved (47569 records). [2025-10-15T18:19:57.048420] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-15T18:19:57.048913] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 32.0s. Estimated remaining: 4h 7m 30s. Rate: 7.2 symbols/min [2025-10-15T18:19:57.235166] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:57.288071] [DEBUG] [LOCAL ] CYH: Loaded 47721 existing records from primary storage. [2025-10-15T18:19:57.288545] [INFO ] [MAIN ] CYH: Loaded 47721 existing records. [2025-10-15T18:19:57.488156] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:57.488573] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-15T18:19:57.488872] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-15T18:19:57.489264] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-15T18:19:57.489318] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-15T18:19:57.633328] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:19:57.724493] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-15T18:19:57.889294] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:58.281819] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:19:58.514041] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-15T18:19:58.737284] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:19:59.314076] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-15T18:19:59.909245] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:20:00.114013] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-15T18:20:00.696861] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:20:00.702773] [INFO ] [REMOTE ] CXW: Full fetch complete (65007 records). [2025-10-15T18:20:00.702941] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-15T18:20:00.919173] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-15T18:20:01.114064] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-15T18:20:01.114163] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-15T18:20:01.115128] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-15T18:20:01.115193] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-15T18:20:01.116676] [DEBUG] [LOCAL ] CXW: Trimmed 65007 records to 43921 (keeping 200 days of data) [2025-10-15T18:20:01.411440] [DEBUG] [LOCAL ] CXW: Primary data saved (43921 records). [2025-10-15T18:20:01.411627] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-15T18:20:01.411957] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXW took 32.2s. Estimated remaining: 4h 7m 10s. Rate: 7.2 symbols/min [2025-10-15T18:20:01.690811] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:01.725740] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-15T18:20:01.731043] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T18:20:01.820908] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-10-15T18:20:01.821403] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-10-15T18:20:02.101386] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:02.101720] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-15T18:20:02.101799] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-15T18:20:02.102391] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-15T18:20:02.102469] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-15T18:20:02.519219] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-15T18:20:02.590056] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:02.984673] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:20:03.067949] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T18:20:03.314043] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-15T18:20:04.002278] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T18:20:04.008432] [INFO ] [REMOTE ] CXT: Full fetch complete (45658 records). [2025-10-15T18:20:04.008617] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-15T18:20:04.119079] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-15T18:20:04.390950] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-15T18:20:04.391027] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-15T18:20:04.391716] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-15T18:20:04.391777] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-15T18:20:04.392718] [DEBUG] [LOCAL ] CXT: Trimmed 45658 records to 31065 (keeping 200 days of data) [2025-10-15T18:20:04.577093] [DEBUG] [LOCAL ] CXT: Primary data saved (31065 records). [2025-10-15T18:20:04.577222] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-15T18:20:04.577298] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CXT took 36.1s. Estimated remaining: 4h 6m 46s. Rate: 7.2 symbols/min [2025-10-15T18:20:04.747133] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:04.747308] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-10-15T18:20:04.747345] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-10-15T18:20:04.747452] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-15T18:20:04.747493] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-15T18:20:04.747534] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-15T18:20:04.747566] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-15T18:20:04.919626] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-15T18:20:05.126777] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:20:05.150176] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:05.714003] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-15T18:20:05.860021] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:20:05.949952] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:20:06.513970] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-15T18:20:07.141149] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:20:07.314177] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-15T18:20:08.114182] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-15T18:20:08.146107] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:20:08.440376] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T18:20:08.914010] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-15T18:20:09.719256] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-15T18:20:09.736391] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T18:20:10.167687] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T18:20:10.514225] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-15T18:20:11.252780] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:20:11.257196] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:20:11.313951] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-15T18:20:12.114034] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-15T18:20:12.914016] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-15T18:20:13.120558] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T18:20:13.439756] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:20:13.713976] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-15T18:20:13.748495] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:20:14.514021] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-15T18:20:15.314000] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-15T18:20:15.525486] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T18:20:16.114704] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-15T18:20:16.116503] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-15T18:20:16.121260] [INFO ] [REMOTE ] CYD: Full fetch complete (34930 records). [2025-10-15T18:20:16.121364] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-15T18:20:16.489212] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-15T18:20:16.489288] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-15T18:20:16.489886] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-15T18:20:16.489949] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-15T18:20:16.490720] [DEBUG] [LOCAL ] CYD: Trimmed 34930 records to 26842 (keeping 200 days of data) [2025-10-15T18:20:16.644908] [DEBUG] [LOCAL ] CYD: Primary data saved (26842 records). [2025-10-15T18:20:16.645035] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-15T18:20:16.645108] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 38.7s. Estimated remaining: 4h 6m 49s. Rate: 7.2 symbols/min [2025-10-15T18:20:16.815153] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:16.815301] [DEBUG] [LOCAL ] DAL: No existing data file found in primary storage. [2025-10-15T18:20:16.815338] [WARN ] [MAIN ] DAL: No existing data found, performing full refresh instead. [2025-10-15T18:20:16.815446] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-15T18:20:16.815513] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-15T18:20:16.815574] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-15T18:20:16.815618] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-15T18:20:16.919546] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-15T18:20:16.924515] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T18:20:17.174718] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:17.376435] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T18:20:17.714072] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-15T18:20:18.514050] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-15T18:20:19.314066] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-15T18:20:19.355486] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T18:20:19.990767] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-15T18:20:20.114026] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-15T18:20:20.352726] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-10-15T18:20:20.865254] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T18:20:20.913958] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-15T18:20:21.172260] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T18:20:21.713977] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-15T18:20:21.741161] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T18:20:22.514055] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-15T18:20:23.090826] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:20:23.314014] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-15T18:20:24.114008] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-15T18:20:24.322286] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:20:24.918511] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-15T18:20:24.926222] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:20:25.008270] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T18:20:25.714006] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-15T18:20:26.514055] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-15T18:20:26.650400] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T18:20:27.323465] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-15T18:20:27.352422] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T18:20:27.504734] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T18:20:28.114032] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-15T18:20:28.697308] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T18:20:28.913985] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-15T18:20:29.149459] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:20:29.713983] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-15T18:20:30.514048] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-15T18:20:31.311875] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-15T18:20:31.314185] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-15T18:20:31.798210] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T18:20:31.837726] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T18:20:32.113969] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-15T18:20:32.186354] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:20:32.188328] [INFO ] [REMOTE ] DAC: Full fetch complete (19353 records). [2025-10-15T18:20:32.188416] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-15T18:20:32.539381] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-15T18:20:32.539459] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-15T18:20:32.540018] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-15T18:20:32.540079] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-15T18:20:32.540612] [DEBUG] [LOCAL ] DAC: Trimmed 19353 records to 12616 (keeping 200 days of data) [2025-10-15T18:20:32.618006] [DEBUG] [LOCAL ] DAC: Primary data saved (12616 records). [2025-10-15T18:20:32.618156] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-15T18:20:32.618228] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. DAC took 28.0s. Estimated remaining: 4h 7m 4s. Rate: 7.2 symbols/min [2025-10-15T18:20:32.783258] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:32.783421] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-15T18:20:32.783470] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-15T18:20:32.783577] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-15T18:20:32.783618] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-15T18:20:32.783697] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-15T18:20:32.783742] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-15T18:20:32.919140] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-15T18:20:33.131721] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:33.634768] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:20:33.713978] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-15T18:20:34.513994] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-15T18:20:35.314076] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-15T18:20:35.406378] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-15T18:20:35.419434] [DEBUG] [REMOTE ] DAN: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T18:20:35.420343] [WARN ] [REMOTE ] DAN: No data returned for month 2024-12 [2025-10-15T18:20:35.420446] [FATAL] [REMOTE ] DAN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:20:35.420547] [FATAL] [MAIN ] DAN: Failed to fetch primary data. [2025-10-15T18:20:35.420614] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:20:35.420720] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-15T18:20:35.420794] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-15T18:20:35.420832] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-15T18:20:35.420871] [DEBUG] [LOCAL ] DAN: No derivative data file found to delete. [2025-10-15T18:20:35.420924] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. DAN took 2.8s. Estimated remaining: 4h 6m 39s. Rate: 7.2 symbols/min [2025-10-15T18:20:35.592164] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:35.631673] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T18:20:35.650721] [DEBUG] [LOCAL ] DAO: Loaded 19845 existing records from primary storage. [2025-10-15T18:20:35.651061] [INFO ] [MAIN ] DAO: Loaded 19845 existing records. [2025-10-15T18:20:35.836613] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:35.836981] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-15T18:20:35.837059] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-15T18:20:35.837396] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-15T18:20:35.837463] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-15T18:20:35.965231] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:20:36.119180] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-15T18:20:36.225465] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:36.914006] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-15T18:20:37.711355] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T18:20:37.716801] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-15T18:20:37.718512] [INFO ] [REMOTE ] CYH: Full fetch complete (69944 records). [2025-10-15T18:20:37.718631] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-15T18:20:38.109409] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-15T18:20:38.109485] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-15T18:20:38.110356] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-15T18:20:38.110419] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-15T18:20:38.111704] [DEBUG] [LOCAL ] CYH: Trimmed 69944 records to 47734 (keeping 200 days of data) [2025-10-15T18:20:38.225783] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T18:20:38.391877] [DEBUG] [LOCAL ] CYH: Primary data saved (47734 records). [2025-10-15T18:20:38.392010] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-15T18:20:38.392238] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. CYH took 41.3s. Estimated remaining: 4h 6m 15s. Rate: 7.2 symbols/min [2025-10-15T18:20:38.527428] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-15T18:20:38.558592] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:38.606595] [DEBUG] [LOCAL ] DAR: Loaded 51977 existing records from primary storage. [2025-10-15T18:20:38.606924] [INFO ] [MAIN ] DAR: Loaded 51977 existing records. [2025-10-15T18:20:38.775926] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:38.776148] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-15T18:20:38.776203] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-15T18:20:38.776993] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-15T18:20:38.777052] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-15T18:20:39.119006] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:39.313956] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-15T18:20:39.552413] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:20:40.113968] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-15T18:20:40.156724] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-15T18:20:40.913996] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-15T18:20:40.982437] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:20:40.988959] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-15T18:20:40.989097] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-15T18:20:41.324177] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:20:41.428663] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-15T18:20:41.428772] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-15T18:20:41.429717] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-15T18:20:41.429780] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-15T18:20:41.431193] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53646 (keeping 200 days of data) [2025-10-15T18:20:41.730725] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-15T18:20:41.756215] [DEBUG] [LOCAL ] D: Primary data saved (53646 records). [2025-10-15T18:20:41.756357] [INFO ] [MAIN ] D: Full history saved. [2025-10-15T18:20:41.757478] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. D took 40.3s. Estimated remaining: 4h 5m 51s. Rate: 7.3 symbols/min [2025-10-15T18:20:41.921634] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:41.959737] [DEBUG] [LOCAL ] DAVA: Loaded 41776 existing records from primary storage. [2025-10-15T18:20:41.960038] [INFO ] [MAIN ] DAVA: Loaded 41776 existing records. [2025-10-15T18:20:42.131698] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:42.131931] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-15T18:20:42.131978] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-15T18:20:42.132692] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-15T18:20:42.132750] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-15T18:20:42.479225] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:42.513950] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-15T18:20:42.920122] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T18:20:43.019184] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T18:20:43.314005] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-15T18:20:43.604398] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T18:20:44.114047] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-15T18:20:44.388090] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T18:20:44.913992] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-15T18:20:45.360300] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:20:45.642981] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T18:20:45.713973] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-15T18:20:46.514077] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-15T18:20:47.037268] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:20:47.314002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-15T18:20:47.968955] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:20:47.986766] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T18:20:48.114002] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-15T18:20:48.913989] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-15T18:20:49.270781] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T18:20:49.711618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:20:49.715015] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-15T18:20:50.514014] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-15T18:20:51.008298] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T18:20:51.314020] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-15T18:20:52.114030] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-15T18:20:52.270778] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:20:52.347080] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T18:20:52.914000] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-15T18:20:53.713971] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-15T18:20:54.025083] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:20:54.498111] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-15T18:20:54.513952] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-15T18:20:55.314005] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-15T18:20:55.356272] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:20:56.114089] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-15T18:20:56.638244] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T18:20:56.913988] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-15T18:20:57.008819] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T18:20:57.714010] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-15T18:20:57.791785] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T18:20:57.825598] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T18:20:57.829267] [INFO ] [REMOTE ] DAO: Full fetch complete (32308 records). [2025-10-15T18:20:57.829397] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-15T18:20:58.219909] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-15T18:20:58.219990] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-15T18:20:58.220663] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-15T18:20:58.220726] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-15T18:20:58.221597] [DEBUG] [LOCAL ] DAO: Trimmed 32308 records to 19797 (keeping 200 days of data) [2025-10-15T18:20:58.330677] [DEBUG] [LOCAL ] DAO: Primary data saved (19797 records). [2025-10-15T18:20:58.330836] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-15T18:20:58.330922] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAO took 22.9s. Estimated remaining: 4h 6m 8s. Rate: 7.2 symbols/min [2025-10-15T18:20:58.512053] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:58.512245] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-15T18:20:58.512301] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-15T18:20:58.512422] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-15T18:20:58.512465] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-15T18:20:58.512507] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-15T18:20:58.512541] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-15T18:20:58.524020] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-15T18:20:58.923815] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:59.245310] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T18:20:59.314037] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-15T18:21:00.113977] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-15T18:21:00.252878] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T18:21:00.506929] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:21:00.914005] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-15T18:21:01.714058] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-15T18:21:02.050255] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:21:02.145240] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T18:21:02.514017] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-15T18:21:03.314000] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-15T18:21:03.324945] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:21:04.009002] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T18:21:04.033636] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:21:04.041292] [INFO ] [REMOTE ] DAL: Full fetch complete (77928 records). [2025-10-15T18:21:04.041467] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-15T18:21:04.119132] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-15T18:21:04.449957] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-15T18:21:04.450092] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-15T18:21:04.451083] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-15T18:21:04.451161] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-15T18:21:04.452721] [DEBUG] [LOCAL ] DAL: Trimmed 77928 records to 53753 (keeping 200 days of data) [2025-10-15T18:21:04.770112] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-15T18:21:04.770254] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-15T18:21:04.770326] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAL took 48.1s. Estimated remaining: 4h 5m 55s. Rate: 7.2 symbols/min [2025-10-15T18:21:04.919130] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-15T18:21:04.945337] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:04.994139] [DEBUG] [LOCAL ] DB: Loaded 52500 existing records from primary storage. [2025-10-15T18:21:04.994457] [INFO ] [MAIN ] DB: Loaded 52500 existing records. [2025-10-15T18:21:05.176498] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:05.176778] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-15T18:21:05.176837] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-15T18:21:05.177794] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-15T18:21:05.177857] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-15T18:21:05.552904] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:05.598150] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:21:05.713994] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-15T18:21:06.287983] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:21:06.514042] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-15T18:21:06.912757] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T18:21:07.314027] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-15T18:21:08.114044] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-15T18:21:08.263895] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:21:08.739054] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T18:21:08.914026] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-15T18:21:09.713990] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-15T18:21:09.994238] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T18:21:10.514023] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-15T18:21:10.568041] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:21:11.225169] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:21:11.313948] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-15T18:21:12.113979] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-15T18:21:12.253418] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T18:21:12.259124] [INFO ] [REMOTE ] DAVA: Full fetch complete (56922 records). [2025-10-15T18:21:12.259225] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-15T18:21:12.645191] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-15T18:21:12.645273] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-15T18:21:12.646144] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-15T18:21:12.646208] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-15T18:21:12.650285] [DEBUG] [LOCAL ] DAVA: Trimmed 56922 records to 41847 (keeping 200 days of data) [2025-10-15T18:21:12.899576] [DEBUG] [LOCAL ] DAVA: Primary data saved (41847 records). [2025-10-15T18:21:12.899828] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-15T18:21:12.900090] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAVA took 31.1s. Estimated remaining: 4h 5m 46s. Rate: 7.2 symbols/min [2025-10-15T18:21:12.936259] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-15T18:21:13.075693] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:13.075948] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-15T18:21:13.076040] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-15T18:21:13.076288] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-15T18:21:13.076333] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-15T18:21:13.103796] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-15T18:21:13.103909] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-15T18:21:13.172992] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T18:21:13.470755] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:13.714024] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-15T18:21:13.862516] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T18:21:14.441199] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T18:21:14.513955] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-15T18:21:14.854062] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:21:15.313993] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-15T18:21:16.039034] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:21:16.113966] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-15T18:21:16.914051] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-15T18:21:17.171914] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T18:21:17.178200] [INFO ] [REMOTE ] DAR: Full fetch complete (74918 records). [2025-10-15T18:21:17.178336] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-15T18:21:17.572915] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-15T18:21:17.573040] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-15T18:21:17.574069] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-15T18:21:17.574132] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-15T18:21:17.575807] [DEBUG] [LOCAL ] DAR: Trimmed 74918 records to 51991 (keeping 200 days of data) [2025-10-15T18:21:17.755592] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-15T18:21:17.826311] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T18:21:17.935061] [DEBUG] [LOCAL ] DAR: Primary data saved (51991 records). [2025-10-15T18:21:17.935195] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-15T18:21:17.935562] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 39.5s. Estimated remaining: 4h 5m 28s. Rate: 7.3 symbols/min [2025-10-15T18:21:18.101190] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:18.101345] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-10-15T18:21:18.101382] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-10-15T18:21:18.101486] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-15T18:21:18.101527] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-15T18:21:18.101571] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-15T18:21:18.101603] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-15T18:21:18.491931] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:18.513947] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-15T18:21:18.539304] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T18:21:18.626306] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T18:21:19.313995] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-15T18:21:20.114013] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-15T18:21:20.393529] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:21:20.430272] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:21:20.913991] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-15T18:21:21.714001] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-15T18:21:22.035782] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:21:22.257754] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:21:22.513996] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-15T18:21:22.803419] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T18:21:23.314016] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-15T18:21:24.114012] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-15T18:21:24.160698] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:21:24.876593] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T18:21:24.913952] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-15T18:21:24.990434] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T18:21:25.714017] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-15T18:21:26.445100] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:21:26.513980] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-15T18:21:26.731278] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T18:21:27.314008] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-15T18:21:28.114031] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-15T18:21:28.341228] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:21:28.532016] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T18:21:28.914041] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-15T18:21:29.487071] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:21:29.714150] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-15T18:21:29.925244] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T18:21:30.514045] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-15T18:21:31.122516] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:21:31.313972] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-15T18:21:31.355905] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:21:32.113996] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-15T18:21:32.914291] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-15T18:21:32.919522] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:21:33.241881] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T18:21:33.714011] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-15T18:21:34.276050] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:21:34.513993] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-15T18:21:34.993828] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T18:21:34.996906] [INFO ] [REMOTE ] DBD: Full fetch complete (31464 records). [2025-10-15T18:21:34.997023] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-15T18:21:34.997542] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:21:34.997666] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:21:34.997727] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:21:34.997798] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-15T18:21:34.997872] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-15T18:21:34.997933] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-15T18:21:34.998021] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-15T18:21:34.998112] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DBD took 22.1s. Estimated remaining: 4h 5m 46s. Rate: 7.2 symbols/min [2025-10-15T18:21:35.167141] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:35.178749] [DEBUG] [LOCAL ] DBL: Loaded 9380 existing records from primary storage. [2025-10-15T18:21:35.178971] [INFO ] [MAIN ] DBL: Loaded 9380 existing records. [2025-10-15T18:21:35.319137] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-15T18:21:35.357189] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:35.357440] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-15T18:21:35.357500] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-15T18:21:35.357853] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-15T18:21:35.357910] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-15T18:21:35.700910] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:36.114014] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-15T18:21:36.269423] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T18:21:36.850406] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T18:21:36.857743] [INFO ] [REMOTE ] DAY: Full fetch complete (71380 records). [2025-10-15T18:21:36.857928] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-15T18:21:36.858879] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:21:36.858973] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:21:36.859017] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:21:36.859063] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-15T18:21:36.859156] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-15T18:21:36.859215] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-15T18:21:36.859260] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-15T18:21:36.859320] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DAY took 38.5s. Estimated remaining: 4h 5m 18s. Rate: 7.2 symbols/min [2025-10-15T18:21:36.919202] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-15T18:21:36.976917] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:21:37.062870] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:37.111742] [DEBUG] [LOCAL ] DBRG: Loaded 49878 existing records from primary storage. [2025-10-15T18:21:37.112067] [INFO ] [MAIN ] DBRG: Loaded 49878 existing records. [2025-10-15T18:21:37.281898] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:37.282106] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-15T18:21:37.282156] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-15T18:21:37.282930] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-15T18:21:37.282987] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-15T18:21:37.641178] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:37.714002] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-15T18:21:38.287713] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:21:38.513969] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-15T18:21:38.715749] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:21:39.306811] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:21:39.313946] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-15T18:21:39.927185] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T18:21:40.113988] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-15T18:21:40.914036] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-15T18:21:41.699132] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T18:21:41.713982] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-15T18:21:42.159425] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-15T18:21:42.427054] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T18:21:42.514026] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-15T18:21:43.313968] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-15T18:21:43.917323] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T18:21:44.114040] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-15T18:21:44.347297] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:21:44.662388] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T18:21:44.913984] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-15T18:21:45.714001] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-15T18:21:46.269148] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T18:21:46.514003] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-15T18:21:47.314013] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-15T18:21:47.631531] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T18:21:47.638086] [INFO ] [REMOTE ] DB: Full fetch complete (75295 records). [2025-10-15T18:21:47.638252] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-15T18:21:48.035832] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-15T18:21:48.036102] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-15T18:21:48.037209] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-15T18:21:48.037326] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-15T18:21:48.039735] [DEBUG] [LOCAL ] DB: Trimmed 75295 records to 52503 (keeping 200 days of data) [2025-10-15T18:21:48.132343] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-15T18:21:48.149074] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:21:48.189603] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:21:48.451765] [DEBUG] [LOCAL ] DB: Primary data saved (52503 records). [2025-10-15T18:21:48.451919] [INFO ] [MAIN ] DB: Full history saved. [2025-10-15T18:21:48.452006] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DB took 43.7s. Estimated remaining: 4h 5m 20s. Rate: 7.2 symbols/min [2025-10-15T18:21:48.635848] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:48.673288] [DEBUG] [LOCAL ] DCI: Loaded 37060 existing records from primary storage. [2025-10-15T18:21:48.673622] [INFO ] [MAIN ] DCI: Loaded 37060 existing records. [2025-10-15T18:21:48.923847] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-15T18:21:48.934811] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:48.936665] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-15T18:21:48.936787] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-15T18:21:48.937814] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-15T18:21:48.937897] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-15T18:21:49.395198] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:49.714009] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-15T18:21:49.801738] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:21:50.312134] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:21:50.513992] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-15T18:21:51.321837] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-15T18:21:51.326746] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:21:51.778377] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:21:52.113997] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-15T18:21:52.913959] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-15T18:21:52.947932] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T18:21:53.025797] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T18:21:53.713993] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-15T18:21:54.514080] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-15T18:21:54.557728] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:21:54.864224] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T18:21:54.994940] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T18:21:55.314007] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-15T18:21:56.114044] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-15T18:21:56.607516] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:21:56.914070] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-15T18:21:57.558493] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:21:57.559845] [INFO ] [REMOTE ] DBL: Full fetch complete (12573 records). [2025-10-15T18:21:57.559917] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-15T18:21:57.560336] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:21:57.560420] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:21:57.560480] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:21:57.560566] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-15T18:21:57.560667] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-15T18:21:57.560738] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-15T18:21:57.560928] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-15T18:21:57.561032] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DBL took 22.6s. Estimated remaining: 4h 5m 14s. Rate: 7.2 symbols/min [2025-10-15T18:21:57.720783] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-15T18:21:57.746154] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:57.746494] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-15T18:21:57.746627] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-15T18:21:57.746890] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-15T18:21:57.747007] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-15T18:21:57.747108] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-15T18:21:57.747176] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-15T18:21:58.150903] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T18:21:58.197815] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:58.514005] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-15T18:21:59.317392] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-15T18:21:59.323921] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T18:21:59.377377] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:22:00.114030] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-15T18:22:00.914022] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-15T18:22:00.938906] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T18:22:00.955416] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T18:22:01.714051] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-15T18:22:02.451712] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T18:22:02.521791] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-15T18:22:02.546380] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:22:03.314005] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-15T18:22:04.114013] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-15T18:22:04.190598] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:22:04.197294] [INFO ] [REMOTE ] DBI: Full fetch complete (65273 records). [2025-10-15T18:22:04.197478] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-15T18:22:04.618114] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-15T18:22:04.618210] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-15T18:22:04.619064] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-15T18:22:04.619131] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-15T18:22:04.620455] [DEBUG] [LOCAL ] DBI: Trimmed 65273 records to 43916 (keeping 200 days of data) [2025-10-15T18:22:04.883819] [DEBUG] [LOCAL ] DBI: Primary data saved (43916 records). [2025-10-15T18:22:04.883954] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-15T18:22:04.884029] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBI took 46.9s. Estimated remaining: 4h 5m 3s. Rate: 7.2 symbols/min [2025-10-15T18:22:04.919134] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-15T18:22:05.070267] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:05.070484] [DEBUG] [LOCAL ] DD: No existing data file found in primary storage. [2025-10-15T18:22:05.070549] [WARN ] [MAIN ] DD: No existing data found, performing full refresh instead. [2025-10-15T18:22:05.070854] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-15T18:22:05.070925] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-15T18:22:05.071013] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-15T18:22:05.071058] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-15T18:22:05.400417] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-15T18:22:05.506587] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:05.713954] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-15T18:22:05.746453] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T18:22:05.782918] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T18:22:06.514009] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-15T18:22:06.979561] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T18:22:07.314102] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-15T18:22:08.113982] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-15T18:22:08.296627] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T18:22:08.321613] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T18:22:08.914133] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-15T18:22:09.713975] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-15T18:22:09.843808] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T18:22:10.065471] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T18:22:10.514029] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-15T18:22:11.314050] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-15T18:22:11.536881] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T18:22:11.922002] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T18:22:12.114060] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-15T18:22:12.912526] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T18:22:12.922125] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-15T18:22:13.062099] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:22:13.714007] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-15T18:22:14.363782] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T18:22:14.514006] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-15T18:22:15.251968] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:22:15.314030] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-15T18:22:16.114080] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-15T18:22:16.337614] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:22:16.823063] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:22:16.913997] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-15T18:22:17.466569] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T18:22:17.713980] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-15T18:22:17.954943] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T18:22:18.513999] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-15T18:22:19.313979] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-15T18:22:19.523616] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T18:22:19.530008] [INFO ] [REMOTE ] DBRG: Full fetch complete (72474 records). [2025-10-15T18:22:19.530126] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-15T18:22:19.947543] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-15T18:22:19.947696] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-15T18:22:19.948863] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-15T18:22:19.948932] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-15T18:22:19.950496] [DEBUG] [LOCAL ] DBRG: Trimmed 72474 records to 49905 (keeping 200 days of data) [2025-10-15T18:22:20.138171] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-15T18:22:20.299270] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T18:22:20.324990] [DEBUG] [LOCAL ] DBRG: Primary data saved (49905 records). [2025-10-15T18:22:20.325187] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-15T18:22:20.326121] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DBRG took 43.5s. Estimated remaining: 4h 5m 16s. Rate: 7.2 symbols/min [2025-10-15T18:22:20.519521] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:20.519720] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-15T18:22:20.519769] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-15T18:22:20.519880] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-15T18:22:20.519923] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-15T18:22:20.519965] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-15T18:22:20.519999] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-15T18:22:20.920734] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-15T18:22:20.926721] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:20.951240] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:22:21.263470] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:22:21.713991] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-15T18:22:22.514013] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-15T18:22:22.688761] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T18:22:22.815596] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-15T18:22:23.314035] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-15T18:22:24.114004] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-15T18:22:24.224526] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T18:22:24.686283] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:22:24.690600] [INFO ] [REMOTE ] DCI: Full fetch complete (53657 records). [2025-10-15T18:22:24.690793] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-15T18:22:24.927528] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-15T18:22:25.110173] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-15T18:22:25.110254] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-15T18:22:25.111021] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-15T18:22:25.111083] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-15T18:22:25.112226] [DEBUG] [LOCAL ] DCI: Trimmed 53657 records to 37027 (keeping 200 days of data) [2025-10-15T18:22:25.352964] [DEBUG] [LOCAL ] DCI: Primary data saved (37027 records). [2025-10-15T18:22:25.353133] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-15T18:22:25.353221] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DCI took 36.9s. Estimated remaining: 4h 4m 58s. Rate: 7.2 symbols/min [2025-10-15T18:22:25.525350] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:25.558979] [DEBUG] [LOCAL ] DDL: Loaded 36889 existing records from primary storage. [2025-10-15T18:22:25.559305] [INFO ] [MAIN ] DDL: Loaded 36889 existing records. [2025-10-15T18:22:25.716100] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-15T18:22:25.760004] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:25.760609] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-15T18:22:25.760734] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-15T18:22:25.771053] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-15T18:22:25.788224] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-15T18:22:25.822794] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T18:22:26.176161] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:26.354445] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:22:26.514002] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-15T18:22:27.193133] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T18:22:27.195631] [INFO ] [REMOTE ] DCO: Full fetch complete (19533 records). [2025-10-15T18:22:27.195727] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-15T18:22:27.319089] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-15T18:22:27.654123] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-15T18:22:27.654248] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-15T18:22:27.655072] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-15T18:22:27.655141] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-15T18:22:27.656011] [DEBUG] [LOCAL ] DCO: Trimmed 19533 records to 14597 (keeping 200 days of data) [2025-10-15T18:22:27.770760] [DEBUG] [LOCAL ] DCO: Primary data saved (14597 records). [2025-10-15T18:22:27.770935] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-15T18:22:27.771057] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DCO took 30.2s. Estimated remaining: 4h 4m 32s. Rate: 7.2 symbols/min [2025-10-15T18:22:27.967278] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:22:28.114005] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-15T18:22:28.913964] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-15T18:22:28.962605] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:22:29.713969] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-15T18:22:30.048930] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:22:30.377484] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T18:22:30.513963] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-15T18:22:31.110506] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:22:31.314003] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-15T18:22:32.113961] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-15T18:22:32.230193] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:22:32.474194] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:22:32.914043] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-15T18:22:33.714029] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-15T18:22:33.841187] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:22:34.513962] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-15T18:22:34.591216] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T18:22:35.030488] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T18:22:35.313992] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-15T18:22:36.114078] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-15T18:22:36.332963] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:22:36.914045] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-15T18:22:37.211797] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T18:22:37.552027] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T18:22:37.713996] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-15T18:22:37.826180] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T18:22:37.832514] [INFO ] [REMOTE ] DD: Full fetch complete (76584 records). [2025-10-15T18:22:37.832688] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-15T18:22:38.248515] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-15T18:22:38.248590] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-15T18:22:38.249563] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-15T18:22:38.249630] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-15T18:22:38.251054] [DEBUG] [LOCAL ] DD: Trimmed 76584 records to 52926 (keeping 200 days of data) [2025-10-15T18:22:38.527412] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-15T18:22:38.573951] [DEBUG] [LOCAL ] DD: Primary data saved (52926 records). [2025-10-15T18:22:38.574061] [INFO ] [MAIN ] DD: Full history saved. [2025-10-15T18:22:38.574145] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DD took 33.7s. Estimated remaining: 4h 4m 32s. Rate: 7.2 symbols/min [2025-10-15T18:22:39.384154] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T18:22:39.393965] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-15T18:22:40.580330] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T18:22:40.586559] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-15T18:22:40.624206] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T18:22:40.914009] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-15T18:22:41.836725] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T18:22:41.843262] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-15T18:22:42.528394] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T18:22:42.539483] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-15T18:22:43.086101] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:22:43.313998] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-15T18:22:44.420354] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T18:22:44.431813] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-15T18:22:44.886115] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:22:44.913951] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-15T18:22:46.174559] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T18:22:46.180598] [INFO ] [REMOTE ] DDL: Full fetch complete (53395 records). [2025-10-15T18:22:46.180752] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-15T18:22:46.587610] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-15T18:22:46.625050] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-15T18:22:46.625400] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-15T18:22:46.626182] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-15T18:22:46.626244] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-15T18:22:46.627008] [INFO ] [REMOTE ] DDD: Full fetch complete (73919 records). [2025-10-15T18:22:46.627195] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-15T18:22:46.627741] [DEBUG] [LOCAL ] DDL: Trimmed 53395 records to 36922 (keeping 200 days of data) [2025-10-15T18:22:47.146235] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-15T18:22:47.146834] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-15T18:22:47.150917] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-15T18:22:47.151059] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-15T18:22:47.217306] [DEBUG] [LOCAL ] DDD: Trimmed 73919 records to 50928 (keeping 200 days of data) [2025-10-15T18:22:47.350939] [DEBUG] [LOCAL ] DDL: Primary data saved (36922 records). [2025-10-15T18:22:47.353108] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-15T18:22:47.353503] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 22.0s. Estimated remaining: 4h 4m 25s. Rate: 7.2 symbols/min [2025-10-15T18:22:47.534104] [DEBUG] [LOCAL ] DDD: Primary data saved (50928 records). [2025-10-15T18:22:47.534240] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-15T18:22:47.534315] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 27.2s. Estimated remaining: 4h 3m 53s. Rate: 7.3 symbols/min [2025-10-15T18:22:48.132673] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.204284] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-15T18:22:48.204154] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.224471] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-15T18:22:48.224293] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.225204] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-15T18:22:48.245982] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.246162] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-15T18:22:48.247086] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-15T18:22:48.247197] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-15T18:22:48.262324] [DEBUG] [LOCAL ] DDT: Loaded 2089 existing records from primary storage. [2025-10-15T18:22:48.283677] [INFO ] [MAIN ] DDT: Loaded 2089 existing records. [2025-10-15T18:22:48.657188] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:48.683264] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-15T18:22:48.691897] [DEBUG] [LOCAL ] DEA: Loaded 40455 existing records from primary storage. [2025-10-15T18:22:48.692019] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-15T18:22:48.694925] [DEBUG] [LOCAL ] DE: Loaded 47686 existing records from primary storage. [2025-10-15T18:22:48.701959] [INFO ] [MAIN ] DEA: Loaded 40455 existing records. [2025-10-15T18:22:48.723288] [INFO ] [MAIN ] DE: Loaded 47686 existing records. [2025-10-15T18:22:48.797557] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-15T18:22:48.904229] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-15T18:22:49.345976] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:49.314627] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:49.388095] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-15T18:22:49.391161] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:49.428672] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-15T18:22:49.429746] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-15T18:22:49.426021] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-15T18:22:49.452726] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-15T18:22:49.463334] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-15T18:22:49.480225] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-15T18:22:49.490586] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-15T18:22:49.501128] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-15T18:22:49.913595] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:49.960189] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-15T18:22:50.429146] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:50.441390] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-15T18:22:50.530444] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:50.531084] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-15T18:22:50.571131] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T18:22:50.574799] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-15T18:22:50.729384] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:22:50.730525] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-15T18:22:51.072861] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T18:22:51.074030] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-15T18:22:51.446591] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T18:22:51.450183] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-15T18:22:51.999116] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T18:22:52.113959] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-15T18:22:52.139781] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:22:52.913982] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-15T18:23:04.655350] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (13.58 seconds). [2025-10-15T18:23:04.656421] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-15T18:23:05.763463] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (14.31 seconds). [2025-10-15T18:23:05.766626] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-15T18:23:06.152499] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:23:06.153703] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-15T18:23:06.234952] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (14.12 seconds). [2025-10-15T18:23:06.244221] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-15T18:23:06.870850] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T18:23:06.874663] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-15T18:23:07.132151] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:23:07.134029] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (14.22 seconds). [2025-10-15T18:23:07.136058] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-15T18:23:07.146691] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-15T18:23:07.817408] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T18:23:07.821341] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-15T18:23:08.084856] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:23:08.085923] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-15T18:23:08.486027] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-15T18:23:08.496037] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-15T18:23:08.782804] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:23:08.783927] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-15T18:23:08.798961] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:23:08.803805] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-15T18:23:09.406876] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:23:09.408505] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-15T18:23:09.466500] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-15T18:23:09.476541] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-15T18:23:09.499527] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:23:09.504714] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-15T18:23:09.747478] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T18:23:09.748685] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-15T18:23:09.940474] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:23:09.950762] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-15T18:23:10.180227] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T18:23:10.181549] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-15T18:23:10.419352] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T18:23:10.422775] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-15T18:23:10.630105] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T18:23:10.630909] [INFO ] [REMOTE ] DDT: Full fetch complete (2830 records). [2025-10-15T18:23:10.630977] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-15T18:23:10.631320] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:23:10.631399] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:23:10.631461] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:23:10.631545] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-15T18:23:10.631620] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-15T18:23:10.631706] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-15T18:23:10.631879] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-15T18:23:10.631987] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 23.1s. Estimated remaining: 4h 4m 28s. Rate: 7.2 symbols/min [2025-10-15T18:23:10.801695] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:10.831801] [DEBUG] [LOCAL ] DEC: Loaded 30408 existing records from primary storage. [2025-10-15T18:23:10.832101] [INFO ] [MAIN ] DEC: Loaded 30408 existing records. [2025-10-15T18:23:11.027151] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:11.027935] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-15T18:23:11.028174] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-15T18:23:11.028824] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-15T18:23:11.029041] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-15T18:23:11.084915] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T18:23:11.143444] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-15T18:23:11.465667] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:11.469547] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-15T18:23:11.469256] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T18:23:11.481432] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-15T18:23:11.549431] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T18:23:11.560446] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-15T18:23:11.731169] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T18:23:12.114108] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-15T18:23:12.742361] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T18:23:12.789683] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T18:23:12.913955] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-15T18:23:13.005663] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T18:23:13.007168] [INFO ] [REMOTE ] DDS: Full fetch complete (18601 records). [2025-10-15T18:23:13.007241] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-15T18:23:13.007719] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:23:13.007801] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:23:13.007843] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:23:13.007880] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-15T18:23:13.007934] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-15T18:23:13.007968] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-15T18:23:13.008006] [DEBUG] [LOCAL ] DDS: No derivative data file found to delete. [2025-10-15T18:23:13.008056] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDS took 25.5s. Estimated remaining: 4h 4m 2s. Rate: 7.2 symbols/min [2025-10-15T18:23:13.183593] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:13.226387] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:23:13.274296] [DEBUG] [LOCAL ] DECK: Loaded 53293 existing records from primary storage. [2025-10-15T18:23:13.274635] [INFO ] [MAIN ] DECK: Loaded 53293 existing records. [2025-10-15T18:23:13.449897] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:13.450184] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-15T18:23:13.450231] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-15T18:23:13.450611] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-15T18:23:13.450700] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-15T18:23:13.719134] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-15T18:23:13.800128] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:14.296748] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:23:14.513999] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-15T18:23:14.604512] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T18:23:15.314005] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-15T18:23:16.046551] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:23:16.114009] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-15T18:23:16.914005] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-15T18:23:17.086710] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T18:23:17.450727] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T18:23:17.714014] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-15T18:23:18.117197] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T18:23:18.514014] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-15T18:23:19.179639] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:23:19.314007] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-15T18:23:20.069346] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T18:23:20.113964] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-15T18:23:20.844124] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:23:20.913981] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-15T18:23:21.714085] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-15T18:23:21.986638] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:23:22.514001] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-15T18:23:22.683522] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:23:23.314029] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-15T18:23:23.830433] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T18:23:23.835543] [INFO ] [REMOTE ] DEA: Full fetch complete (62017 records). [2025-10-15T18:23:23.835712] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-15T18:23:24.142672] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-15T18:23:24.187549] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-15T18:23:24.269004] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-15T18:23:24.269205] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-15T18:23:24.270332] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-15T18:23:24.270415] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-15T18:23:24.272161] [DEBUG] [LOCAL ] DEA: Trimmed 62017 records to 40436 (keeping 200 days of data) [2025-10-15T18:23:24.525611] [DEBUG] [LOCAL ] DEA: Primary data saved (40436 records). [2025-10-15T18:23:24.526060] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-15T18:23:24.526177] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DEA took 37.0s. Estimated remaining: 4h 4m 3s. Rate: 7.2 symbols/min [2025-10-15T18:23:24.706775] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:24.754686] [DEBUG] [LOCAL ] DEI: Loaded 48296 existing records from primary storage. [2025-10-15T18:23:24.755084] [INFO ] [MAIN ] DEI: Loaded 48296 existing records. [2025-10-15T18:23:24.921608] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-15T18:23:24.965104] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:24.976271] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-15T18:23:24.976591] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-15T18:23:24.978550] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T18:23:24.978601] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-15T18:23:24.978913] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-15T18:23:25.339879] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:25.714022] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-15T18:23:25.926431] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T18:23:26.385364] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T18:23:26.513994] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-15T18:23:27.037971] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T18:23:27.314034] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-15T18:23:28.113980] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-15T18:23:28.384152] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:23:28.681459] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T18:23:28.914003] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-15T18:23:29.444605] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:23:29.713998] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-15T18:23:30.256663] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:23:30.514109] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-15T18:23:31.314032] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-15T18:23:31.450554] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T18:23:31.456297] [INFO ] [REMOTE ] DE: Full fetch complete (69786 records). [2025-10-15T18:23:31.456429] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-15T18:23:31.858004] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-15T18:23:31.858153] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-15T18:23:31.859120] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-15T18:23:31.859202] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-15T18:23:31.860719] [DEBUG] [LOCAL ] DE: Trimmed 69786 records to 47661 (keeping 200 days of data) [2025-10-15T18:23:32.123880] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-15T18:23:32.132227] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T18:23:32.208325] [DEBUG] [LOCAL ] DE: Primary data saved (47661 records). [2025-10-15T18:23:32.208472] [INFO ] [MAIN ] DE: Full history saved. [2025-10-15T18:23:32.208570] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 44.6s. Estimated remaining: 4h 3m 53s. Rate: 7.2 symbols/min [2025-10-15T18:23:32.373116] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:32.424662] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-15T18:23:32.424980] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-15T18:23:32.596696] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:32.596949] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-15T18:23:32.596996] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-15T18:23:32.597437] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-15T18:23:32.597493] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-15T18:23:32.923565] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-15T18:23:32.956229] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:33.440767] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T18:23:33.496145] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T18:23:33.714059] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-15T18:23:34.514003] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-15T18:23:34.639666] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:23:35.169587] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:23:35.314011] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-15T18:23:36.113973] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-15T18:23:36.476932] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:23:36.741098] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T18:23:36.913994] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-15T18:23:37.714025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-15T18:23:37.896356] [DEBUG] [REMOTE ] DEI: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-15T18:23:37.896750] [WARN ] [REMOTE ] DEI: No data returned for month 2025-04 [2025-10-15T18:23:37.896852] [FATAL] [REMOTE ] DEI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:23:37.896929] [FATAL] [MAIN ] DEI: Failed to fetch primary data. [2025-10-15T18:23:37.896995] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:23:37.897067] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-15T18:23:37.897129] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-15T18:23:37.897165] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-15T18:23:37.897362] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-10-15T18:23:37.898438] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEI took 13.4s. Estimated remaining: 4h 3m 38s. Rate: 7.2 symbols/min [2025-10-15T18:23:38.089842] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:38.142446] [DEBUG] [LOCAL ] DEO: Loaded 49214 existing records from primary storage. [2025-10-15T18:23:38.142820] [INFO ] [MAIN ] DEO: Loaded 49214 existing records. [2025-10-15T18:23:38.337848] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:38.338040] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-15T18:23:38.338086] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-15T18:23:38.338436] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-15T18:23:38.338475] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-15T18:23:38.525480] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-15T18:23:38.729130] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:38.762661] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-15T18:23:38.890074] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T18:23:39.314000] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-15T18:23:39.771539] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:23:40.114168] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-15T18:23:40.914020] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-15T18:23:41.523506] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T18:23:41.713992] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-15T18:23:42.349056] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T18:23:42.514003] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-15T18:23:42.802683] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T18:23:43.314017] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-15T18:23:43.382953] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T18:23:44.114004] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-15T18:23:44.529834] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:23:44.534620] [INFO ] [REMOTE ] DEC: Full fetch complete (44215 records). [2025-10-15T18:23:44.534735] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-15T18:23:44.874598] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-15T18:23:44.914872] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-15T18:23:44.946885] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-15T18:23:44.946968] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-15T18:23:44.947691] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-15T18:23:44.947752] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-15T18:23:44.948895] [DEBUG] [LOCAL ] DEC: Trimmed 44215 records to 30346 (keeping 200 days of data) [2025-10-15T18:23:45.128728] [DEBUG] [LOCAL ] DEC: Primary data saved (30346 records). [2025-10-15T18:23:45.128914] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-15T18:23:45.128995] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEC took 34.5s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-15T18:23:45.292795] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:45.292990] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-15T18:23:45.293026] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-15T18:23:45.293136] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-15T18:23:45.293176] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-15T18:23:45.293215] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-15T18:23:45.293245] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-15T18:23:45.642352] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:45.713971] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-15T18:23:46.420148] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-15T18:23:46.514031] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-15T18:23:46.698718] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T18:23:47.314031] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-15T18:23:48.020551] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-15T18:23:48.114052] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-15T18:23:48.196944] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:23:48.914014] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-15T18:23:49.396283] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-15T18:23:49.402592] [INFO ] [REMOTE ] DECK: Full fetch complete (77029 records). [2025-10-15T18:23:49.402747] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-15T18:23:49.719221] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-15T18:23:49.790981] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-15T18:23:49.791127] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-15T18:23:49.792111] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-15T18:23:49.792172] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-15T18:23:49.793606] [DEBUG] [LOCAL ] DECK: Trimmed 77029 records to 53297 (keeping 200 days of data) [2025-10-15T18:23:50.116356] [DEBUG] [LOCAL ] DECK: Primary data saved (53297 records). [2025-10-15T18:23:50.116492] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-15T18:23:50.116568] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 37.1s. Estimated remaining: 4h 3m 8s. Rate: 7.2 symbols/min [2025-10-15T18:23:50.292912] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:50.322064] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:23:50.366841] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-15T18:23:50.388277] [DEBUG] [LOCAL ] DFIN: Loaded 22636 existing records from primary storage. [2025-10-15T18:23:50.388497] [INFO ] [MAIN ] DFIN: Loaded 22636 existing records. [2025-10-15T18:23:50.527003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-15T18:23:50.568114] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:50.568372] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-15T18:23:50.568427] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-15T18:23:50.568633] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-15T18:23:50.568741] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-15T18:23:50.922249] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:51.314026] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-15T18:23:51.525103] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:23:51.957413] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:23:52.114065] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-15T18:23:52.506710] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T18:23:52.914122] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-15T18:23:53.714026] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-15T18:23:53.766626] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:23:54.263826] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T18:23:54.513968] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-15T18:23:54.730880] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:23:55.314060] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-15T18:23:56.113965] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-15T18:23:56.288022] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:23:56.342596] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:23:56.913985] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-15T18:23:57.429130] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T18:23:57.713993] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-15T18:23:58.521446] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-15T18:23:58.527946] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:23:59.314031] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-15T18:23:59.840414] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:23:59.966494] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-15T18:24:00.114017] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-15T18:24:00.377866] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T18:24:00.914001] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-15T18:24:01.714075] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-15T18:24:01.846989] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:24:02.514030] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-15T18:24:02.866461] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:24:03.083450] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:24:03.314069] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-15T18:24:04.114010] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-15T18:24:04.223540] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:24:04.754761] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T18:24:04.914045] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-15T18:24:05.714026] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-15T18:24:06.045355] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:24:06.425470] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T18:24:06.513992] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-15T18:24:07.314025] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-15T18:24:07.378296] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T18:24:07.477606] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T18:24:08.114043] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-15T18:24:08.342860] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:24:08.913972] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-15T18:24:09.112317] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T18:24:09.714028] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-15T18:24:10.514023] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-15T18:24:11.176468] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-15T18:24:11.314004] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-15T18:24:11.568109] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T18:24:11.924609] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:24:11.928596] [INFO ] [REMOTE ] DFH: Full fetch complete (48023 records). [2025-10-15T18:24:11.928761] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-15T18:24:12.118308] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-15T18:24:12.309435] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-15T18:24:12.314694] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-15T18:24:12.322369] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-15T18:24:12.323095] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-15T18:24:12.323604] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T18:24:12.329804] [DEBUG] [LOCAL ] DFH: Trimmed 48023 records to 32196 (keeping 200 days of data) [2025-10-15T18:24:12.538465] [DEBUG] [LOCAL ] DFH: Primary data saved (32196 records). [2025-10-15T18:24:12.538624] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-15T18:24:12.538739] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DFH took 27.4s. Estimated remaining: 4h 3m 41s. Rate: 7.2 symbols/min [2025-10-15T18:24:12.735587] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:12.749583] [DEBUG] [LOCAL ] DFP: Loaded 11209 existing records from primary storage. [2025-10-15T18:24:12.749843] [INFO ] [MAIN ] DFP: Loaded 11209 existing records. [2025-10-15T18:24:12.919175] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-15T18:24:12.923858] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:12.924087] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-15T18:24:12.924170] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-15T18:24:12.925002] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-15T18:24:12.925059] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-15T18:24:13.268937] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:13.714011] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-15T18:24:13.887582] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:24:14.321966] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-15T18:24:14.328427] [INFO ] [REMOTE ] DEO: Full fetch complete (71734 records). [2025-10-15T18:24:14.328572] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-15T18:24:14.520692] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-15T18:24:14.730457] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-15T18:24:14.730545] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-15T18:24:14.731439] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-15T18:24:14.731503] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-15T18:24:14.733065] [DEBUG] [LOCAL ] DEO: Trimmed 71734 records to 49216 (keeping 200 days of data) [2025-10-15T18:24:15.036194] [DEBUG] [LOCAL ] DEO: Primary data saved (49216 records). [2025-10-15T18:24:15.036341] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-15T18:24:15.037351] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 37.1s. Estimated remaining: 4h 3m 16s. Rate: 7.2 symbols/min [2025-10-15T18:24:15.209299] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:15.266371] [DEBUG] [LOCAL ] DG: Loaded 53278 existing records from primary storage. [2025-10-15T18:24:15.266702] [INFO ] [MAIN ] DG: Loaded 53278 existing records. [2025-10-15T18:24:15.336091] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-15T18:24:15.450187] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:15.450414] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-15T18:24:15.450488] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-15T18:24:15.450918] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-15T18:24:15.450976] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-15T18:24:15.822175] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:24:15.861754] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:16.001570] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T18:24:16.020219] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T18:24:16.113974] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-15T18:24:16.760485] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T18:24:16.914023] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-15T18:24:17.714016] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-15T18:24:18.478870] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T18:24:18.513966] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-15T18:24:19.249269] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-15T18:24:19.261044] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-15T18:24:19.267921] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-15T18:24:19.268361] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:24:19.319129] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-15T18:24:19.695503] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-15T18:24:19.695627] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-15T18:24:19.696712] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-15T18:24:19.696780] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-15T18:24:19.698410] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-15T18:24:20.043584] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-15T18:24:20.043751] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-15T18:24:20.043840] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DELL took 47.8s. Estimated remaining: 4h 2m 58s. Rate: 7.2 symbols/min [2025-10-15T18:24:20.119101] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-15T18:24:20.240711] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:20.241057] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-15T18:24:20.241112] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-15T18:24:20.241230] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-15T18:24:20.241271] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-15T18:24:20.241312] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-15T18:24:20.241344] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-15T18:24:20.582506] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T18:24:20.658537] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:20.774356] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T18:24:20.914010] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-15T18:24:21.713299] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T18:24:21.714353] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-15T18:24:22.514004] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-15T18:24:23.305680] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T18:24:23.314058] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-15T18:24:23.578302] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T18:24:23.581152] [INFO ] [REMOTE ] DFIN: Full fetch complete (33412 records). [2025-10-15T18:24:23.581234] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-15T18:24:24.017489] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-15T18:24:24.017569] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-15T18:24:24.018277] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-15T18:24:24.018341] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-15T18:24:24.019153] [DEBUG] [LOCAL ] DFIN: Trimmed 33412 records to 22637 (keeping 200 days of data) [2025-10-15T18:24:24.118210] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:24:24.115689] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-15T18:24:24.172685] [DEBUG] [LOCAL ] DFIN: Primary data saved (22637 records). [2025-10-15T18:24:24.172803] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-15T18:24:24.172878] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFIN took 34.1s. Estimated remaining: 4h 2m 38s. Rate: 7.2 symbols/min [2025-10-15T18:24:24.347587] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:24.370762] [DEBUG] [LOCAL ] DHF: Loaded 21165 existing records from primary storage. [2025-10-15T18:24:24.371107] [INFO ] [MAIN ] DHF: Loaded 21165 existing records. [2025-10-15T18:24:24.547754] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:24.547970] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-15T18:24:24.548020] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-15T18:24:24.548206] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-15T18:24:24.548259] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-15T18:24:24.904262] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:24.913948] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-15T18:24:25.714041] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-15T18:24:25.978361] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T18:24:26.232553] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T18:24:26.514000] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-15T18:24:26.923303] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T18:24:27.313981] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-15T18:24:27.572169] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:24:28.114041] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-15T18:24:28.847151] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:24:28.913950] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-15T18:24:29.074110] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:24:29.713986] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-15T18:24:29.789168] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T18:24:30.514002] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-15T18:24:31.313992] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-15T18:24:31.450077] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T18:24:31.985009] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T18:24:32.113973] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-15T18:24:32.145793] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:24:32.913995] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-15T18:24:33.714062] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-15T18:24:33.942920] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T18:24:34.202134] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T18:24:34.513980] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-15T18:24:34.670801] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T18:24:35.161821] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T18:24:35.163238] [INFO ] [REMOTE ] DFP: Full fetch complete (15863 records). [2025-10-15T18:24:35.163306] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-15T18:24:35.317783] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-15T18:24:35.526414] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-15T18:24:35.526493] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-15T18:24:35.526885] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-15T18:24:35.526945] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-15T18:24:35.527431] [DEBUG] [LOCAL ] DFP: Trimmed 15863 records to 11194 (keeping 200 days of data) [2025-10-15T18:24:35.596951] [DEBUG] [LOCAL ] DFP: Primary data saved (11194 records). [2025-10-15T18:24:35.597102] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-15T18:24:35.597184] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 23.1s. Estimated remaining: 4h 2m 39s. Rate: 7.2 symbols/min [2025-10-15T18:24:35.783072] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:35.835462] [DEBUG] [LOCAL ] DHI: Loaded 53364 existing records from primary storage. [2025-10-15T18:24:35.835779] [INFO ] [MAIN ] DHI: Loaded 53364 existing records. [2025-10-15T18:24:36.009885] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:36.010194] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-15T18:24:36.010252] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-15T18:24:36.010694] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-15T18:24:36.010751] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-15T18:24:36.119073] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-15T18:24:36.363976] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:36.657314] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T18:24:36.914008] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-15T18:24:37.713978] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-15T18:24:37.990981] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:24:38.514010] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-15T18:24:38.921710] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:24:39.248759] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T18:24:39.313960] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-15T18:24:39.449026] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T18:24:40.114009] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-15T18:24:40.839508] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T18:24:40.913966] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-15T18:24:41.092003] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:24:41.713977] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-15T18:24:42.514027] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-15T18:24:42.610341] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T18:24:42.720578] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:24:43.314003] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-15T18:24:44.113978] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-15T18:24:44.262839] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:24:44.914077] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-15T18:24:45.379837] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T18:24:45.383044] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T18:24:45.714020] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-15T18:24:46.431922] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:24:46.514009] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-15T18:24:47.314066] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-15T18:24:47.883091] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-15T18:24:48.059158] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T18:24:48.113948] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-15T18:24:48.919116] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-15T18:24:48.932520] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T18:24:49.713962] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-15T18:24:50.157774] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T18:24:50.409484] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T18:24:50.513992] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-15T18:24:51.264166] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T18:24:51.313955] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-15T18:24:51.601853] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T18:24:52.114014] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-15T18:24:52.913954] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-15T18:24:52.931980] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T18:24:52.937557] [INFO ] [REMOTE ] DGX: Full fetch complete (65280 records). [2025-10-15T18:24:52.940879] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-15T18:24:53.224794] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T18:24:53.248824] [INFO ] [REMOTE ] DHF: Full fetch complete (29972 records). [2025-10-15T18:24:53.259190] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-15T18:24:53.483796] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-15T18:24:53.491505] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-15T18:24:53.493201] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-15T18:24:53.493585] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-15T18:24:53.616562] [DEBUG] [LOCAL ] DGX: Trimmed 65280 records to 44657 (keeping 200 days of data) [2025-10-15T18:24:53.721374] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-15T18:24:53.797173] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-15T18:24:53.797245] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-15T18:24:53.797874] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-15T18:24:53.797940] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-15T18:24:53.798884] [DEBUG] [LOCAL ] DHF: Trimmed 29972 records to 21070 (keeping 200 days of data) [2025-10-15T18:24:54.055918] [DEBUG] [LOCAL ] DHF: Primary data saved (21070 records). [2025-10-15T18:24:54.056527] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-15T18:24:54.056876] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DHF took 29.9s. Estimated remaining: 4h 2m 59s. Rate: 7.2 symbols/min [2025-10-15T18:24:54.237027] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:54.238173] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-10-15T18:24:54.238462] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-10-15T18:24:54.238598] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-15T18:24:54.240301] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-15T18:24:54.240670] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-15T18:24:54.240958] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-15T18:24:54.449117] [DEBUG] [LOCAL ] DGX: Primary data saved (44657 records). [2025-10-15T18:24:54.481833] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-15T18:24:54.555829] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 34.5s. Estimated remaining: 4h 2m 29s. Rate: 7.2 symbols/min [2025-10-15T18:24:54.771589] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:54.807319] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-15T18:24:54.835297] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:54.868168] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:24:54.916155] [DEBUG] [LOCAL ] DHT: Loaded 47891 existing records from primary storage. [2025-10-15T18:24:54.916477] [INFO ] [MAIN ] DHT: Loaded 47891 existing records. [2025-10-15T18:24:55.089489] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:55.089724] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-15T18:24:55.089777] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-15T18:24:55.090205] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-15T18:24:55.090260] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-15T18:24:55.319074] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-15T18:24:55.446803] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:55.688744] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T18:24:56.114086] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-15T18:24:56.714927] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T18:24:56.918157] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-15T18:24:56.923856] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:24:57.713986] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-15T18:24:57.859965] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T18:24:58.382226] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T18:24:58.514002] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-15T18:24:59.313972] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-15T18:24:59.772919] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T18:25:00.113975] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-15T18:25:00.571693] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-15T18:25:00.913988] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-15T18:25:01.315315] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:25:01.713998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-15T18:25:02.035729] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T18:25:02.258372] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T18:25:02.514073] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-15T18:25:03.314060] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-15T18:25:03.891078] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T18:25:04.114042] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-15T18:25:04.468056] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T18:25:04.913975] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-15T18:25:04.965387] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:25:05.714033] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-15T18:25:05.863935] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T18:25:06.513999] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-15T18:25:06.636046] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:25:06.641923] [INFO ] [REMOTE ] DG: Full fetch complete (76958 records). [2025-10-15T18:25:06.642040] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-15T18:25:06.642868] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:25:06.642956] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:25:06.643032] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:25:06.643104] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-15T18:25:06.643167] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-15T18:25:06.643204] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-15T18:25:06.643372] [DEBUG] [LOCAL ] DG: Deleted derivative data file. [2025-10-15T18:25:06.644136] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DG took 51.6s. Estimated remaining: 4h 2m 31s. Rate: 7.2 symbols/min [2025-10-15T18:25:06.809147] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:06.826299] [DEBUG] [LOCAL ] DHX: Loaded 13307 existing records from primary storage. [2025-10-15T18:25:06.826570] [INFO ] [MAIN ] DHX: Loaded 13307 existing records. [2025-10-15T18:25:06.998831] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:06.999064] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-15T18:25:06.999110] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-15T18:25:06.999272] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-15T18:25:06.999311] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-15T18:25:07.317918] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-15T18:25:07.370271] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:07.721960] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T18:25:08.095011] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:25:08.113965] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-15T18:25:08.913970] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-15T18:25:09.600880] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T18:25:09.713966] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-15T18:25:10.017445] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T18:25:10.513978] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-15T18:25:10.858696] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T18:25:11.313973] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-15T18:25:11.388880] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:25:11.394756] [INFO ] [REMOTE ] DHI: Full fetch complete (77001 records). [2025-10-15T18:25:11.394887] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-15T18:25:11.395691] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:25:11.395782] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:25:11.395825] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:25:11.395889] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-15T18:25:11.395954] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-15T18:25:11.395991] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-15T18:25:11.396104] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-15T18:25:11.396503] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 35.8s. Estimated remaining: 4h 2m 13s. Rate: 7.2 symbols/min [2025-10-15T18:25:11.525756] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T18:25:11.587363] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:11.602666] [DEBUG] [LOCAL ] DIAX: Loaded 13088 existing records from primary storage. [2025-10-15T18:25:11.602914] [INFO ] [MAIN ] DIAX: Loaded 13088 existing records. [2025-10-15T18:25:11.775060] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:11.775284] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-15T18:25:11.775331] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-15T18:25:11.775484] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-15T18:25:11.775520] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-15T18:25:12.124543] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-15T18:25:12.129215] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:12.914015] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-15T18:25:13.088559] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:25:13.372502] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-15T18:25:13.714037] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-15T18:25:13.805308] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T18:25:14.514005] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-15T18:25:15.313998] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-15T18:25:15.604058] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:25:15.951208] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:25:16.103119] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T18:25:16.113952] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-15T18:25:16.913989] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-15T18:25:17.500728] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:25:17.645343] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:25:17.714018] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-15T18:25:18.514038] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-15T18:25:18.551346] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T18:25:19.314011] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-15T18:25:19.333309] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:25:20.114007] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-15T18:25:20.913961] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-15T18:25:21.058190] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T18:25:21.109936] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:25:21.714003] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-15T18:25:22.440269] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T18:25:22.514008] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-15T18:25:22.637617] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:25:23.313970] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-15T18:25:23.544635] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:25:24.058063] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T18:25:24.113977] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-15T18:25:24.913980] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-15T18:25:24.958744] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:25:25.714047] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-15T18:25:26.395813] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:25:26.514157] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-15T18:25:26.719267] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T18:25:27.169583] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T18:25:27.314004] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-15T18:25:27.966511] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:25:28.114048] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-15T18:25:28.913994] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-15T18:25:29.714018] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-15T18:25:29.883638] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T18:25:30.031501] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T18:25:30.513995] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-15T18:25:31.209482] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:25:31.215497] [INFO ] [REMOTE ] DHT: Full fetch complete (70174 records). [2025-10-15T18:25:31.215614] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-15T18:25:31.318833] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-15T18:25:31.621776] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-15T18:25:31.622117] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-15T18:25:31.623171] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-15T18:25:31.623252] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-15T18:25:31.624813] [DEBUG] [LOCAL ] DHT: Trimmed 70174 records to 47932 (keeping 200 days of data) [2025-10-15T18:25:31.915225] [DEBUG] [LOCAL ] DHT: Primary data saved (47932 records). [2025-10-15T18:25:31.915346] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-15T18:25:31.915429] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHT took 37.4s. Estimated remaining: 4h 2m 39s. Rate: 7.2 symbols/min [2025-10-15T18:25:32.052983] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T18:25:32.110016] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:32.113960] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-15T18:25:32.172413] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:25:32.171348] [DEBUG] [LOCAL ] DIN: Loaded 37391 existing records from primary storage. [2025-10-15T18:25:32.183279] [INFO ] [MAIN ] DIN: Loaded 37391 existing records. [2025-10-15T18:25:32.366006] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:32.366659] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-15T18:25:32.366722] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-15T18:25:32.367191] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-15T18:25:32.367248] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-15T18:25:32.719360] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:32.727251] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T18:25:32.913956] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-15T18:25:33.714001] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-15T18:25:34.204876] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:25:34.300353] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:25:34.513996] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-15T18:25:35.291901] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T18:25:35.298481] [INFO ] [REMOTE ] DHR: Full fetch complete (77429 records). [2025-10-15T18:25:35.298688] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-15T18:25:35.319604] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-15T18:25:35.692404] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-15T18:25:35.692517] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-15T18:25:35.693462] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-15T18:25:35.693529] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-15T18:25:35.695494] [DEBUG] [LOCAL ] DHR: Trimmed 77429 records to 53378 (keeping 200 days of data) [2025-10-15T18:25:36.031891] [DEBUG] [LOCAL ] DHR: Primary data saved (53378 records). [2025-10-15T18:25:36.032039] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-15T18:25:36.032113] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHR took 42.0s. Estimated remaining: 4h 2m 19s. Rate: 7.2 symbols/min [2025-10-15T18:25:36.119089] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-15T18:25:36.209575] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:36.259806] [DEBUG] [LOCAL ] DINO: Loaded 52845 existing records from primary storage. [2025-10-15T18:25:36.260139] [INFO ] [MAIN ] DINO: Loaded 52845 existing records. [2025-10-15T18:25:36.450525] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:36.450758] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-15T18:25:36.450817] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-15T18:25:36.451256] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-15T18:25:36.451314] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-15T18:25:36.848402] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:36.850346] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:25:36.913951] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-15T18:25:37.174825] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T18:25:37.176965] [INFO ] [REMOTE ] DIAX: Full fetch complete (17722 records). [2025-10-15T18:25:37.177034] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-15T18:25:37.544978] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-15T18:25:37.545068] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-15T18:25:37.545555] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-15T18:25:37.545594] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-15T18:25:37.546249] [DEBUG] [LOCAL ] DIAX: Trimmed 17722 records to 13028 (keeping 200 days of data) [2025-10-15T18:25:37.634325] [DEBUG] [LOCAL ] DIAX: Primary data saved (13028 records). [2025-10-15T18:25:37.634530] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-15T18:25:37.634675] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DIAX took 26.2s. Estimated remaining: 4h 1m 52s. Rate: 7.2 symbols/min [2025-10-15T18:25:37.720199] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-15T18:25:37.842534] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:37.905440] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-15T18:25:37.905923] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-15T18:25:38.152880] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:38.153116] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-15T18:25:38.153236] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-15T18:25:38.153631] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-15T18:25:38.153743] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-15T18:25:38.396239] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:25:38.523244] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-15T18:25:38.675452] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:39.314008] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-15T18:25:39.395245] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:25:39.770392] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:25:40.096288] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T18:25:40.113967] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-15T18:25:40.913998] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-15T18:25:41.585075] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:25:41.713993] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-15T18:25:42.513975] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-15T18:25:42.610755] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T18:25:43.058675] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:25:43.171028] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T18:25:43.173544] [INFO ] [REMOTE ] DHX: Full fetch complete (21344 records). [2025-10-15T18:25:43.173617] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-15T18:25:43.319112] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-15T18:25:43.543924] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-15T18:25:43.543996] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-15T18:25:43.544427] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-15T18:25:43.544466] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-15T18:25:43.545030] [DEBUG] [LOCAL ] DHX: Trimmed 21344 records to 13388 (keeping 200 days of data) [2025-10-15T18:25:43.617872] [DEBUG] [LOCAL ] DHX: Primary data saved (13388 records). [2025-10-15T18:25:43.618000] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-15T18:25:43.618078] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DHX took 37.0s. Estimated remaining: 4h 1m 37s. Rate: 7.2 symbols/min [2025-10-15T18:25:43.810340] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:43.810526] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-15T18:25:43.810564] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-15T18:25:43.810703] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-15T18:25:43.810754] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-15T18:25:43.810795] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-15T18:25:43.810826] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-15T18:25:44.128432] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-15T18:25:44.169959] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:44.560868] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T18:25:44.913988] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-15T18:25:45.248491] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T18:25:45.714049] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-15T18:25:46.379895] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-15T18:25:46.513987] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-15T18:25:47.044188] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T18:25:47.313985] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-15T18:25:48.114092] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-15T18:25:48.232994] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:25:48.598599] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T18:25:48.914054] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-15T18:25:49.360420] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-15T18:25:49.714069] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-15T18:25:50.113247] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T18:25:50.429143] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-15T18:25:50.513993] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-15T18:25:51.314005] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-15T18:25:52.113997] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-15T18:25:52.553002] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-15T18:25:52.810217] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-15T18:25:52.914006] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-15T18:25:53.208485] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T18:25:53.714048] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-15T18:25:54.514009] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-15T18:25:55.156182] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-15T18:25:55.313983] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-15T18:25:55.478272] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T18:25:56.113969] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-15T18:25:56.236906] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:25:56.504809] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T18:25:56.914009] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-15T18:25:57.222539] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-15T18:25:57.631875] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T18:25:57.714031] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-15T18:25:58.514036] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-15T18:25:59.314008] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-15T18:25:59.454120] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:25:59.647953] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-15T18:26:00.114039] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-15T18:26:00.914016] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-15T18:26:01.036793] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T18:26:01.713991] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-15T18:26:02.282752] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-15T18:26:02.514010] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-15T18:26:02.546011] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T18:26:02.550888] [INFO ] [REMOTE ] DIN: Full fetch complete (55201 records). [2025-10-15T18:26:02.551025] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-15T18:26:02.918179] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T18:26:02.955634] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-15T18:26:02.957469] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-15T18:26:02.958492] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-15T18:26:02.958567] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-15T18:26:02.959883] [DEBUG] [LOCAL ] DIN: Trimmed 55201 records to 37272 (keeping 200 days of data) [2025-10-15T18:26:03.192451] [DEBUG] [LOCAL ] DIN: Primary data saved (37272 records). [2025-10-15T18:26:03.192602] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-15T18:26:03.192728] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 31.3s. Estimated remaining: 4h 2m 1s. Rate: 7.2 symbols/min [2025-10-15T18:26:03.316574] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-15T18:26:03.387073] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:03.387314] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-10-15T18:26:03.387359] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-10-15T18:26:03.387465] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-15T18:26:03.387505] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-15T18:26:03.387545] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-15T18:26:03.387576] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-15T18:26:03.746516] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:03.935348] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-15T18:26:03.948550] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T18:26:04.113999] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-15T18:26:04.476084] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-15T18:26:04.914015] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-15T18:26:05.449419] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:26:05.450374] [INFO ] [REMOTE ] DIVY: Full fetch complete (1704 records). [2025-10-15T18:26:05.450451] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-15T18:26:05.641021] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T18:26:05.641255] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:26:05.641323] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:26:05.641379] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-15T18:26:05.641436] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-15T18:26:05.641472] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-15T18:26:05.641512] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-15T18:26:05.641568] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIVY took 22.0s. Estimated remaining: 4h 1m 36s. Rate: 7.2 symbols/min [2025-10-15T18:26:05.719153] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-15T18:26:05.823591] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:05.844394] [DEBUG] [LOCAL ] DKL: Loaded 17667 existing records from primary storage. [2025-10-15T18:26:05.844686] [INFO ] [MAIN ] DKL: Loaded 17667 existing records. [2025-10-15T18:26:06.049967] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:06.050220] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-15T18:26:06.050269] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-15T18:26:06.050527] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-15T18:26:06.050613] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-15T18:26:06.439019] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:06.513966] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-15T18:26:07.314000] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-15T18:26:07.646491] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T18:26:08.123517] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-15T18:26:08.129153] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T18:26:08.914010] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-15T18:26:09.031417] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:26:09.113624] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T18:26:09.713997] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-15T18:26:10.514046] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-15T18:26:11.181210] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-15T18:26:11.281456] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T18:26:11.314011] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-15T18:26:11.334086] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:26:12.114033] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-15T18:26:12.859478] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T18:26:12.913982] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-15T18:26:13.714001] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-15T18:26:14.420874] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:26:14.480720] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-15T18:26:14.513976] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-15T18:26:14.595899] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T18:26:15.314073] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-15T18:26:15.949747] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:26:16.114049] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-15T18:26:16.913987] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-15T18:26:17.353422] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T18:26:17.424426] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T18:26:17.714069] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-15T18:26:18.117817] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T18:26:18.514006] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-15T18:26:19.269446] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:26:19.313950] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-15T18:26:19.565557] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:26:20.114048] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-15T18:26:20.905122] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T18:26:20.912214] [INFO ] [REMOTE ] DINO: Full fetch complete (76721 records). [2025-10-15T18:26:20.912360] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-15T18:26:20.924527] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-15T18:26:21.262835] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:26:21.348040] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-15T18:26:21.348137] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-15T18:26:21.349073] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-15T18:26:21.349140] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-15T18:26:21.350676] [DEBUG] [LOCAL ] DINO: Trimmed 76721 records to 52842 (keeping 200 days of data) [2025-10-15T18:26:21.674668] [DEBUG] [LOCAL ] DINO: Primary data saved (52842 records). [2025-10-15T18:26:21.674803] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-15T18:26:21.674881] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 45.6s. Estimated remaining: 4h 1m 49s. Rate: 7.2 symbols/min [2025-10-15T18:26:21.720919] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-15T18:26:21.849427] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:21.899878] [DEBUG] [LOCAL ] DKS: Loaded 49710 existing records from primary storage. [2025-10-15T18:26:21.900215] [INFO ] [MAIN ] DKS: Loaded 49710 existing records. [2025-10-15T18:26:22.071941] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:22.072163] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-15T18:26:22.072224] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-15T18:26:22.072470] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-15T18:26:22.072527] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-15T18:26:22.421194] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:22.513969] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-15T18:26:22.556964] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:26:22.666555] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T18:26:23.313992] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-15T18:26:23.930383] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T18:26:23.936848] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-15T18:26:23.937012] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-15T18:26:24.117311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-15T18:26:24.340506] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-15T18:26:24.340610] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-15T18:26:24.341605] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-15T18:26:24.341711] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-15T18:26:24.343352] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-15T18:26:24.589062] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-15T18:26:24.717579] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-15T18:26:24.717789] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-15T18:26:24.718146] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 47.1s. Estimated remaining: 4h 1m 26s. Rate: 7.2 symbols/min [2025-10-15T18:26:24.887808] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:24.888017] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-15T18:26:24.888054] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-15T18:26:24.888161] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-15T18:26:24.888201] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-15T18:26:24.888241] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-15T18:26:24.888273] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-15T18:26:24.919147] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-15T18:26:25.141329] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T18:26:25.291144] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:25.714001] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-15T18:26:26.514016] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-15T18:26:26.644040] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:26:26.685841] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T18:26:27.314004] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-15T18:26:27.864554] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:26:28.114054] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-15T18:26:28.913974] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-15T18:26:28.940472] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T18:26:29.581216] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T18:26:29.713997] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-15T18:26:30.368405] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T18:26:30.513964] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-15T18:26:30.975818] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T18:26:31.314004] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-15T18:26:31.857752] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T18:26:32.113964] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-15T18:26:32.351842] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:26:32.353976] [INFO ] [REMOTE ] DKL: Full fetch complete (27909 records). [2025-10-15T18:26:32.354059] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-15T18:26:32.722729] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-15T18:26:32.722809] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-15T18:26:32.723342] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-15T18:26:32.723381] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-15T18:26:32.724016] [DEBUG] [LOCAL ] DKL: Trimmed 27909 records to 17546 (keeping 200 days of data) [2025-10-15T18:26:32.825710] [DEBUG] [LOCAL ] DKL: Primary data saved (17546 records). [2025-10-15T18:26:32.825835] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-15T18:26:32.825913] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DKL took 27.2s. Estimated remaining: 4h 1m 17s. Rate: 7.2 symbols/min [2025-10-15T18:26:32.920379] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-15T18:26:32.992490] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:33.000197] [DEBUG] [LOCAL ] DLNG: Loaded 6189 existing records from primary storage. [2025-10-15T18:26:33.000392] [INFO ] [MAIN ] DLNG: Loaded 6189 existing records. [2025-10-15T18:26:33.180697] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:33.180994] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-15T18:26:33.181159] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-15T18:26:33.181433] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-15T18:26:33.181501] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-15T18:26:33.486302] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T18:26:33.573339] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:33.714006] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-15T18:26:34.514033] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-15T18:26:34.658450] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:26:35.095476] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:26:35.313986] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-15T18:26:36.079439] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:26:36.114045] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-15T18:26:36.312104] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:26:36.796470] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T18:26:36.914011] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-15T18:26:37.713964] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-15T18:26:37.872717] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:26:38.514006] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-15T18:26:39.314027] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-15T18:26:39.421263] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:26:39.427294] [INFO ] [REMOTE ] DK: Full fetch complete (71020 records). [2025-10-15T18:26:39.427432] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-15T18:26:39.833587] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-15T18:26:39.833747] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-15T18:26:39.834772] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-15T18:26:39.834835] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-15T18:26:39.836230] [DEBUG] [LOCAL ] DK: Trimmed 71020 records to 49447 (keeping 200 days of data) [2025-10-15T18:26:39.978895] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:26:40.113028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T18:26:40.116202] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-15T18:26:40.184889] [DEBUG] [LOCAL ] DK: Primary data saved (49447 records). [2025-10-15T18:26:40.185036] [INFO ] [MAIN ] DK: Full history saved. [2025-10-15T18:26:40.185110] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 37.0s. Estimated remaining: 4h 1m 7s. Rate: 7.2 symbols/min [2025-10-15T18:26:40.357375] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:40.407102] [DEBUG] [LOCAL ] DLR: Loaded 50730 existing records from primary storage. [2025-10-15T18:26:40.407450] [INFO ] [MAIN ] DLR: Loaded 50730 existing records. [2025-10-15T18:26:40.579517] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:40.579904] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-15T18:26:40.579962] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-15T18:26:40.580524] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-15T18:26:40.580579] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-15T18:26:40.925144] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-15T18:26:40.929724] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:41.714007] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-15T18:26:41.993733] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T18:26:42.468729] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T18:26:42.514782] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-15T18:26:42.515885] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T18:26:43.314220] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-15T18:26:43.791695] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T18:26:44.114003] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-15T18:26:44.914003] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-15T18:26:45.041245] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:26:45.380796] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T18:26:45.665502] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T18:26:45.713974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-15T18:26:46.454245] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T18:26:46.514003] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-15T18:26:47.314053] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-15T18:26:48.115887] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-15T18:26:48.122581] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:26:48.660386] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T18:26:48.914052] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-15T18:26:49.714010] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-15T18:26:50.035093] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T18:26:50.145465] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T18:26:50.218758] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T18:26:50.514067] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-15T18:26:51.314039] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-15T18:26:51.917955] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T18:26:52.114059] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-15T18:26:52.570935] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T18:26:52.914067] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-15T18:26:53.215434] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:26:53.220066] [INFO ] [REMOTE ] DLB: Full fetch complete (47249 records). [2025-10-15T18:26:53.220186] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-15T18:26:53.634001] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-15T18:26:53.634145] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-15T18:26:53.635394] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-15T18:26:53.635464] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-15T18:26:53.636963] [DEBUG] [LOCAL ] DLB: Trimmed 47249 records to 32247 (keeping 200 days of data) [2025-10-15T18:26:53.729577] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-15T18:26:53.853922] [DEBUG] [LOCAL ] DLB: Primary data saved (32247 records). [2025-10-15T18:26:53.854206] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-15T18:26:53.854314] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 29.1s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-15T18:26:54.044612] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:54.082404] [DEBUG] [LOCAL ] DLX: Loaded 28438 existing records from primary storage. [2025-10-15T18:26:54.082825] [INFO ] [MAIN ] DLX: Loaded 28438 existing records. [2025-10-15T18:26:54.272170] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:54.272398] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-15T18:26:54.272453] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-15T18:26:54.272790] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-15T18:26:54.272849] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-15T18:26:54.516702] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-15T18:26:54.544405] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T18:26:54.723782] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:54.751348] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T18:26:55.314057] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-15T18:26:56.113992] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-15T18:26:56.366581] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T18:26:56.710676] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:26:56.914050] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-15T18:26:57.146237] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:26:57.463156] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T18:26:57.465110] [INFO ] [REMOTE ] DLNG: Full fetch complete (11769 records). [2025-10-15T18:26:57.465217] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-15T18:26:57.722935] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-15T18:26:57.848319] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-15T18:26:57.848395] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-15T18:26:57.848695] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-15T18:26:57.848755] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-15T18:26:57.849175] [DEBUG] [LOCAL ] DLNG: Trimmed 11769 records to 6188 (keeping 200 days of data) [2025-10-15T18:26:57.884235] [DEBUG] [LOCAL ] DLNG: Primary data saved (6188 records). [2025-10-15T18:26:57.884338] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-15T18:26:57.884418] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 25.1s. Estimated remaining: 4h 0m 53s. Rate: 7.2 symbols/min [2025-10-15T18:26:58.049217] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:58.070196] [DEBUG] [LOCAL ] DLY: Loaded 20477 existing records from primary storage. [2025-10-15T18:26:58.070461] [INFO ] [MAIN ] DLY: Loaded 20477 existing records. [2025-10-15T18:26:58.244800] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:58.245011] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-15T18:26:58.245061] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-15T18:26:58.245306] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-15T18:26:58.245362] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-15T18:26:58.519170] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-15T18:26:58.592499] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:59.314053] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-15T18:26:59.561177] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T18:27:00.055048] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:27:00.114027] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-15T18:27:00.458114] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T18:27:00.914035] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-15T18:27:01.713988] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-15T18:27:01.875544] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T18:27:02.514086] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-15T18:27:02.902048] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T18:27:02.908427] [INFO ] [REMOTE ] DKS: Full fetch complete (71783 records). [2025-10-15T18:27:02.908587] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-15T18:27:03.204000] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:27:03.321876] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-15T18:27:03.346514] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-15T18:27:03.346610] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-15T18:27:03.347757] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-15T18:27:03.347823] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-15T18:27:03.349287] [DEBUG] [LOCAL ] DKS: Trimmed 71783 records to 49719 (keeping 200 days of data) [2025-10-15T18:27:03.653462] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:27:03.702067] [DEBUG] [LOCAL ] DKS: Primary data saved (49719 records). [2025-10-15T18:27:03.702290] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-15T18:27:03.702407] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 42.0s. Estimated remaining: 4h 0m 38s. Rate: 7.2 symbols/min [2025-10-15T18:27:03.911727] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:03.919995] [DEBUG] [LOCAL ] DMA: Loaded 4725 existing records from primary storage. [2025-10-15T18:27:03.920241] [INFO ] [MAIN ] DMA: Loaded 4725 existing records. [2025-10-15T18:27:04.109405] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:04.109667] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-15T18:27:04.109734] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-15T18:27:04.110100] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-15T18:27:04.110373] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-15T18:27:04.123426] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-15T18:27:04.377549] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:27:04.539991] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:04.914013] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-15T18:27:05.714014] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-15T18:27:06.019944] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T18:27:06.113854] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-15T18:27:06.246207] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:27:06.514021] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-15T18:27:07.314041] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-15T18:27:07.425913] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T18:27:07.865343] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:27:08.114032] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-15T18:27:08.913975] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-15T18:27:09.122515] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T18:27:09.493306] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T18:27:09.713982] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-15T18:27:10.514028] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-15T18:27:10.929688] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:27:11.077678] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T18:27:11.314041] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-15T18:27:12.114000] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-15T18:27:12.336581] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T18:27:12.736771] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T18:27:12.914011] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-15T18:27:13.520472] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:27:13.713989] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-15T18:27:14.178853] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T18:27:14.514028] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-15T18:27:15.314006] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-15T18:27:16.114016] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-15T18:27:16.334549] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T18:27:16.536976] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T18:27:16.913967] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-15T18:27:17.236936] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T18:27:17.713994] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-15T18:27:18.214609] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T18:27:18.237098] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T18:27:18.514072] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-15T18:27:19.103185] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:27:19.313976] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-15T18:27:19.959971] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:27:20.114033] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-15T18:27:20.914009] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-15T18:27:21.038556] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:27:21.714071] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-15T18:27:22.252990] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:27:22.514001] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-15T18:27:23.176484] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:27:23.314051] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-15T18:27:23.508248] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T18:27:24.114003] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-15T18:27:24.913969] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-15T18:27:25.239929] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T18:27:25.276431] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T18:27:25.714000] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-15T18:27:26.208435] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:27:26.513981] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-15T18:27:26.677092] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:27:27.226824] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T18:27:27.232289] [INFO ] [REMOTE ] DLR: Full fetch complete (73773 records). [2025-10-15T18:27:27.232410] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-15T18:27:27.233126] [FATAL] [VALIDATOR ] DLR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:27:27.233210] [FATAL] [MAIN ] DLR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:27:27.233251] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:27:27.233316] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-15T18:27:27.233378] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-10-15T18:27:27.233414] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-10-15T18:27:27.233567] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-10-15T18:27:27.233691] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLR took 47.0s. Estimated remaining: 4h 1m 12s. Rate: 7.2 symbols/min [2025-10-15T18:27:27.319134] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-15T18:27:27.406710] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:27.407064] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-15T18:27:27.407131] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-15T18:27:27.407256] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-15T18:27:27.407298] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-15T18:27:27.407346] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-15T18:27:27.407414] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-15T18:27:27.783485] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:28.113967] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-15T18:27:28.351410] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T18:27:28.913996] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-15T18:27:29.296806] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T18:27:29.713990] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-15T18:27:30.011013] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:27:30.014062] [INFO ] [REMOTE ] DLX: Full fetch complete (41290 records). [2025-10-15T18:27:30.014147] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-15T18:27:30.385888] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-15T18:27:30.385967] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-15T18:27:30.386633] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-15T18:27:30.386712] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-15T18:27:30.387828] [DEBUG] [LOCAL ] DLX: Trimmed 41290 records to 28382 (keeping 200 days of data) [2025-10-15T18:27:30.501908] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T18:27:30.516006] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-15T18:27:30.576290] [DEBUG] [LOCAL ] DLX: Primary data saved (28382 records). [2025-10-15T18:27:30.576456] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-15T18:27:30.576562] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DLX took 36.7s. Estimated remaining: 4h 0m 50s. Rate: 7.2 symbols/min [2025-10-15T18:27:30.744698] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:30.756113] [DEBUG] [LOCAL ] DMO: Loaded 9973 existing records from primary storage. [2025-10-15T18:27:30.756306] [INFO ] [MAIN ] DMO: Loaded 9973 existing records. [2025-10-15T18:27:30.933267] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:30.933492] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-15T18:27:30.933549] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-15T18:27:30.933750] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-15T18:27:30.933806] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-15T18:27:31.311733] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:31.313972] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-15T18:27:31.334630] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:27:31.335822] [INFO ] [REMOTE ] DMA: Full fetch complete (6730 records). [2025-10-15T18:27:31.335891] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-15T18:27:31.336255] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:27:31.336362] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:27:31.336435] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:27:31.336512] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-15T18:27:31.336593] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-15T18:27:31.336671] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-10-15T18:27:31.337258] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-10-15T18:27:31.337345] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DMA took 27.6s. Estimated remaining: 4h 0m 20s. Rate: 7.2 symbols/min [2025-10-15T18:27:31.507334] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:31.553849] [DEBUG] [LOCAL ] DNA: Loaded 48569 existing records from primary storage. [2025-10-15T18:27:31.554244] [INFO ] [MAIN ] DNA: Loaded 48569 existing records. [2025-10-15T18:27:31.729497] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:31.729723] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-15T18:27:31.729778] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-15T18:27:31.730149] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-15T18:27:31.730190] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-15T18:27:32.086187] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T18:27:32.090507] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:32.113956] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-15T18:27:32.766459] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T18:27:32.913996] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-15T18:27:33.713998] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-15T18:27:34.514013] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-15T18:27:34.666752] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:27:34.704259] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T18:27:34.707858] [INFO ] [REMOTE ] DLY: Full fetch complete (28270 records). [2025-10-15T18:27:34.708049] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-15T18:27:34.708582] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:27:34.708687] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:27:34.708770] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:27:34.708871] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-15T18:27:34.708949] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-15T18:27:34.708986] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-15T18:27:34.709114] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-15T18:27:34.709244] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 36.8s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-15T18:27:34.887595] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:34.931154] [DEBUG] [LOCAL ] DNOW: Loaded 43649 existing records from primary storage. [2025-10-15T18:27:34.931467] [INFO ] [MAIN ] DNOW: Loaded 43649 existing records. [2025-10-15T18:27:35.107270] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:35.107737] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-15T18:27:35.107877] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-15T18:27:35.114873] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-15T18:27:35.114956] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-15T18:27:35.158694] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T18:27:35.319130] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-15T18:27:35.480390] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:36.113994] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-15T18:27:36.913971] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-15T18:27:36.965353] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T18:27:37.126244] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:27:37.693132] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T18:27:37.713953] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-15T18:27:38.305667] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:27:38.514008] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-15T18:27:39.096524] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T18:27:39.313999] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-15T18:27:40.005554] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T18:27:40.114007] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-15T18:27:40.913999] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-15T18:27:41.603343] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:27:41.713971] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-15T18:27:42.514075] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-15T18:27:42.886435] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T18:27:42.959156] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:27:43.313990] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-15T18:27:43.323926] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T18:27:44.114010] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-15T18:27:44.855000] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:27:44.913962] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-15T18:27:45.518311] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T18:27:45.714008] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-15T18:27:46.369228] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T18:27:46.405987] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:27:46.513956] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-15T18:27:47.239726] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T18:27:47.314012] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-15T18:27:48.030039] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:27:48.114010] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-15T18:27:48.914006] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-15T18:27:49.368724] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:27:49.669058] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T18:27:49.713972] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-15T18:27:50.246798] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T18:27:50.513996] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-15T18:27:51.277496] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T18:27:51.313969] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-15T18:27:52.088214] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T18:27:52.113974] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-15T18:27:52.914028] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-15T18:27:52.931418] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:27:53.688583] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T18:27:53.713960] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-15T18:27:54.360605] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:27:54.514038] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-15T18:27:55.314025] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-15T18:27:55.376275] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:27:55.377896] [INFO ] [REMOTE ] DMO: Full fetch complete (14554 records). [2025-10-15T18:27:55.377964] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-15T18:27:55.730465] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-15T18:27:55.730536] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-15T18:27:55.730871] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-15T18:27:55.730930] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-15T18:27:55.731392] [DEBUG] [LOCAL ] DMO: Trimmed 14554 records to 9967 (keeping 200 days of data) [2025-10-15T18:27:55.794473] [DEBUG] [LOCAL ] DMO: Primary data saved (9967 records). [2025-10-15T18:27:55.794616] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-15T18:27:55.794820] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMO took 25.2s. Estimated remaining: 4h 0m 25s. Rate: 7.2 symbols/min [2025-10-15T18:27:55.960892] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:55.992418] [DEBUG] [LOCAL ] DNP: Loaded 33224 existing records from primary storage. [2025-10-15T18:27:55.992859] [INFO ] [MAIN ] DNP: Loaded 33224 existing records. [2025-10-15T18:27:56.128610] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-15T18:27:56.168374] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:56.168577] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-15T18:27:56.168627] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-15T18:27:56.168964] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-15T18:27:56.169016] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-15T18:27:56.517897] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:56.913964] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-15T18:27:57.032968] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T18:27:57.034667] [INFO ] [REMOTE ] DMB: Full fetch complete (14776 records). [2025-10-15T18:27:57.034741] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-15T18:27:57.336622] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T18:27:57.440784] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-15T18:27:57.440896] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-15T18:27:57.441286] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-15T18:27:57.441330] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-15T18:27:57.441966] [DEBUG] [LOCAL ] DMB: Trimmed 14776 records to 10304 (keeping 200 days of data) [2025-10-15T18:27:57.509615] [DEBUG] [LOCAL ] DMB: Primary data saved (10304 records). [2025-10-15T18:27:57.509838] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-15T18:27:57.509953] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMB took 30.3s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-15T18:27:57.677724] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:57.714137] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-15T18:27:57.730989] [DEBUG] [LOCAL ] DOC: Loaded 53552 existing records from primary storage. [2025-10-15T18:27:57.731270] [INFO ] [MAIN ] DOC: Loaded 53552 existing records. [2025-10-15T18:27:57.911836] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:57.912075] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-15T18:27:57.912145] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-15T18:27:57.912452] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-15T18:27:57.912531] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-15T18:27:58.288880] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:58.310541] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T18:27:58.514035] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-15T18:27:59.314013] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-15T18:27:59.427470] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T18:27:59.590601] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T18:28:00.114034] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-15T18:28:00.914033] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-15T18:28:01.189506] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:28:01.714027] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-15T18:28:02.411488] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-15T18:28:02.514024] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-15T18:28:02.676168] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T18:28:02.852836] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T18:28:03.314051] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-15T18:28:04.113972] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-15T18:28:04.227209] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:28:04.664351] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:28:04.914051] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-15T18:28:05.714005] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-15T18:28:05.980665] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T18:28:06.514000] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-15T18:28:06.605168] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:28:06.684009] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:28:07.314029] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-15T18:28:07.612618] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T18:28:08.114043] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-15T18:28:08.551090] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T18:28:08.914045] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-15T18:28:09.657387] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:28:09.713952] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-15T18:28:10.392876] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T18:28:10.514039] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-15T18:28:11.185691] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:28:11.314072] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-15T18:28:12.113998] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-15T18:28:12.348072] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:28:12.619997] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:28:12.914042] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-15T18:28:13.715490] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-15T18:28:13.717805] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T18:28:14.514018] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-15T18:28:14.928327] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T18:28:15.314058] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-15T18:28:15.780397] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T18:28:15.786251] [INFO ] [REMOTE ] DNA: Full fetch complete (70858 records). [2025-10-15T18:28:15.786358] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-15T18:28:15.787276] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:28:15.787360] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:28:15.787426] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:28:15.787499] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-15T18:28:15.787562] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-15T18:28:15.787598] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-10-15T18:28:15.787768] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-10-15T18:28:15.787867] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNA took 44.5s. Estimated remaining: 4h 0m 18s. Rate: 7.2 symbols/min [2025-10-15T18:28:15.962617] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:15.994712] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:28:16.045570] [DEBUG] [LOCAL ] DOCN: Loaded 50992 existing records from primary storage. [2025-10-15T18:28:16.045916] [INFO ] [MAIN ] DOCN: Loaded 50992 existing records. [2025-10-15T18:28:16.119172] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-15T18:28:16.233104] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:16.233264] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-15T18:28:16.233310] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-15T18:28:16.233684] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-15T18:28:16.233739] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-15T18:28:16.579302] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:16.914053] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-15T18:28:17.321876] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T18:28:17.713975] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-15T18:28:17.798507] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:28:17.804101] [INFO ] [REMOTE ] DNOW: Full fetch complete (63186 records). [2025-10-15T18:28:17.804257] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-15T18:28:18.213904] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-15T18:28:18.214013] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-15T18:28:18.214931] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-15T18:28:18.215012] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-15T18:28:18.226709] [DEBUG] [LOCAL ] DNOW: Trimmed 63186 records to 43750 (keeping 200 days of data) [2025-10-15T18:28:18.247171] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T18:28:18.502300] [DEBUG] [LOCAL ] DNOW: Primary data saved (43750 records). [2025-10-15T18:28:18.502424] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-15T18:28:18.502499] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNOW took 43.8s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-15T18:28:18.513962] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-15T18:28:19.235272] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:28:19.313995] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-15T18:28:20.119149] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-15T18:28:20.122362] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:28:20.913975] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-15T18:28:21.220976] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T18:28:21.252969] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:28:21.714000] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-15T18:28:22.482247] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:28:22.514021] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-15T18:28:23.314064] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-15T18:28:23.525253] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:28:23.813808] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T18:28:24.114059] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-15T18:28:24.617059] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T18:28:24.914054] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-15T18:28:25.149570] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:28:25.153445] [INFO ] [REMOTE ] DNP: Full fetch complete (48879 records). [2025-10-15T18:28:25.153526] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-15T18:28:25.549869] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-15T18:28:25.549972] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-15T18:28:25.551402] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-15T18:28:25.551470] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-15T18:28:25.552481] [DEBUG] [LOCAL ] DNP: Trimmed 48879 records to 33232 (keeping 200 days of data) [2025-10-15T18:28:25.724570] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-15T18:28:25.748826] [DEBUG] [LOCAL ] DNP: Primary data saved (33232 records). [2025-10-15T18:28:25.748967] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-15T18:28:25.749322] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 30.0s. Estimated remaining: 3h 59m 43s. Rate: 7.2 symbols/min [2025-10-15T18:28:26.311055] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:28:26.513993] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-15T18:28:27.763511] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T18:28:27.775095] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-15T18:28:28.159253] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:28:28.169780] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-15T18:28:29.541799] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:28:29.548376] [INFO ] [REMOTE ] DOC: Full fetch complete (77562 records). [2025-10-15T18:28:29.548527] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-15T18:28:29.968528] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-15T18:28:29.968669] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-15T18:28:29.969839] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-15T18:28:29.970007] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-15T18:28:29.971638] [DEBUG] [LOCAL ] DOC: Trimmed 77562 records to 53554 (keeping 200 days of data) [2025-10-15T18:28:30.119686] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T18:28:30.135703] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-15T18:28:30.355729] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-15T18:28:30.355872] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-15T18:28:30.355952] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 32.8s. Estimated remaining: 3h 59m 25s. Rate: 7.2 symbols/min [2025-10-15T18:28:31.832495] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:28:31.842902] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-15T18:28:33.588801] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:28:33.606251] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-15T18:28:35.643097] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T18:28:35.656290] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-15T18:28:37.443179] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:28:37.455587] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-15T18:28:39.179966] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:28:39.186360] [INFO ] [REMOTE ] DOCN: Full fetch complete (72193 records). [2025-10-15T18:28:39.186566] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-15T18:28:39.187627] [FATAL] [VALIDATOR ] DOCN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:28:39.187810] [FATAL] [MAIN ] DOCN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:28:39.187854] [WARN ] [MAIN ] DOCN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:28:39.187910] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-15T18:28:39.187999] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-15T18:28:39.188039] [INFO ] [LOCAL ] DOCN: Starting deletion of derivative data. [2025-10-15T18:28:39.188186] [DEBUG] [LOCAL ] DOCN: Deleted derivative data file. [2025-10-15T18:28:39.188271] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 23.4s. Estimated remaining: 3h 59m 18s. Rate: 7.2 symbols/min [2025-10-15T18:28:39.826792] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:39.931815] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:39.979294] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:39.972518] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:40.041439] [DEBUG] [LOCAL ] DOUG: Loaded 34291 existing records from primary storage. [2025-10-15T18:28:40.042018] [INFO ] [MAIN ] DOUG: Loaded 34291 existing records. [2025-10-15T18:28:40.138622] [DEBUG] [LOCAL ] DOLE: Loaded 39166 existing records from primary storage. [2025-10-15T18:28:40.172160] [INFO ] [MAIN ] DOLE: Loaded 39166 existing records. [2025-10-15T18:28:40.179094] [DEBUG] [LOCAL ] DOCS: Loaded 50810 existing records from primary storage. [2025-10-15T18:28:40.210978] [INFO ] [MAIN ] DOCS: Loaded 50810 existing records. [2025-10-15T18:28:40.318241] [DEBUG] [LOCAL ] DOV: Loaded 45600 existing records from primary storage. [2025-10-15T18:28:40.410711] [INFO ] [MAIN ] DOV: Loaded 45600 existing records. [2025-10-15T18:28:40.584007] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.790772] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.803567] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.845788] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.836425] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-15T18:28:40.872630] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.867177] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.887789] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-15T18:28:40.908260] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-15T18:28:40.911901] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-15T18:28:40.911526] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.924276] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-15T18:28:40.912039] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-15T18:28:40.944096] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.924465] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-15T18:28:40.949692] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-15T18:28:41.002874] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-15T18:28:40.997595] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-15T18:28:41.051732] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-15T18:28:41.075693] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-15T18:28:42.282780] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.272325] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.303747] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-15T18:28:42.314369] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-15T18:28:42.415533] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.434892] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.435131] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-15T18:28:42.435371] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-15T18:28:43.728151] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:28:43.736506] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-15T18:28:43.825596] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T18:28:43.832468] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-15T18:28:43.996768] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:28:44.005301] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-15T18:28:44.276054] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T18:28:44.286337] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-15T18:28:45.074849] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:28:45.083063] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-15T18:28:45.117133] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:28:45.127152] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-15T18:28:45.241128] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:28:45.248445] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-15T18:28:45.598978] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T18:28:45.608602] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-15T18:28:46.012383] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T18:28:46.019833] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-15T18:28:46.200803] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:28:46.209493] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-15T18:28:46.515083] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:28:46.521382] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-15T18:28:46.952631] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T18:28:46.960390] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-15T18:28:47.407410] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T18:28:47.417300] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-15T18:28:47.841297] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T18:28:47.851106] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-15T18:28:47.917739] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T18:28:47.925010] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-15T18:28:47.958431] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:28:48.114012] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-15T18:28:49.345268] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:28:49.365287] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-15T18:28:49.449392] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T18:28:49.543981] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T18:28:49.577229] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:28:49.713954] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-15T18:28:50.514048] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-15T18:28:50.788098] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:28:51.314051] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-15T18:28:51.360178] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:28:52.045232] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:28:52.113961] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-15T18:28:52.231435] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T18:28:52.914042] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-15T18:28:53.714022] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-15T18:28:54.007577] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-15T18:28:54.108639] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:28:54.514040] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-15T18:28:55.320423] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-15T18:28:55.322950] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T18:28:56.076778] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:28:56.114003] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-15T18:28:56.704348] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:28:56.914112] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-15T18:28:57.630910] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:28:57.713964] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-15T18:28:58.289076] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T18:28:58.513970] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-15T18:28:59.313996] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-15T18:28:59.368755] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T18:28:59.971840] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:29:00.113999] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-15T18:29:00.646603] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:29:00.914029] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-15T18:29:01.714040] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-15T18:29:01.859194] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:29:02.262576] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T18:29:02.267016] [INFO ] [REMOTE ] DOUG: Full fetch complete (50576 records). [2025-10-15T18:29:02.267210] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-15T18:29:02.519341] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-15T18:29:02.690616] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-15T18:29:02.690725] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-15T18:29:02.691513] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-15T18:29:02.691576] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-15T18:29:02.692594] [DEBUG] [LOCAL ] DOUG: Trimmed 50576 records to 34244 (keeping 200 days of data) [2025-10-15T18:29:02.879124] [DEBUG] [LOCAL ] DOUG: Primary data saved (34244 records). [2025-10-15T18:29:02.879284] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-15T18:29:02.879370] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOUG took 23.7s. Estimated remaining: 3h 59m 51s. Rate: 7.2 symbols/min [2025-10-15T18:29:03.063705] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:03.117315] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-15T18:29:03.117739] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-15T18:29:03.305516] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:03.305943] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-15T18:29:03.306083] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-15T18:29:03.306507] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-15T18:29:03.306570] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-15T18:29:03.319807] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-15T18:29:03.518701] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T18:29:03.727841] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:03.770865] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:29:04.113999] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-15T18:29:04.658467] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:29:04.913984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-15T18:29:05.713966] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-15T18:29:06.132495] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-15T18:29:06.375223] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:29:06.513979] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-15T18:29:07.169687] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T18:29:07.175089] [INFO ] [REMOTE ] DOV: Full fetch complete (65710 records). [2025-10-15T18:29:07.175198] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-15T18:29:07.319121] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-15T18:29:07.570731] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-15T18:29:07.570815] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-15T18:29:07.571634] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-15T18:29:07.571716] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-15T18:29:07.572965] [DEBUG] [LOCAL ] DOV: Trimmed 65710 records to 45611 (keeping 200 days of data) [2025-10-15T18:29:07.856306] [DEBUG] [LOCAL ] DOV: Primary data saved (45611 records). [2025-10-15T18:29:07.856437] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-15T18:29:07.856518] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOV took 28.6s. Estimated remaining: 3h 59m 34s. Rate: 7.2 symbols/min [2025-10-15T18:29:08.029826] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:08.045181] [DEBUG] [LOCAL ] DPG: Loaded 13595 existing records from primary storage. [2025-10-15T18:29:08.045398] [INFO ] [MAIN ] DPG: Loaded 13595 existing records. [2025-10-15T18:29:08.119109] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-15T18:29:08.228528] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:08.229056] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-15T18:29:08.229198] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-15T18:29:08.229561] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-15T18:29:08.229786] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-15T18:29:08.382700] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:29:08.669801] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:08.913984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-15T18:29:09.505896] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-15T18:29:09.714007] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-15T18:29:10.082508] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:29:10.091176] [INFO ] [REMOTE ] DOCS: Full fetch complete (74059 records). [2025-10-15T18:29:10.091351] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-15T18:29:10.517913] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-15T18:29:10.522220] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-15T18:29:10.525296] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-15T18:29:10.528894] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:29:10.527431] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-15T18:29:10.529159] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-15T18:29:10.535408] [INFO ] [REMOTE ] DOLE: Full fetch complete (54641 records). [2025-10-15T18:29:10.535575] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-15T18:29:10.548034] [DEBUG] [LOCAL ] DOCS: Trimmed 74059 records to 50742 (keeping 200 days of data) [2025-10-15T18:29:10.820616] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T18:29:11.052900] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-15T18:29:11.053558] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-15T18:29:11.055400] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-15T18:29:11.055487] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-15T18:29:11.064192] [DEBUG] [LOCAL ] DOLE: Trimmed 54641 records to 39209 (keeping 200 days of data) [2025-10-15T18:29:11.345976] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-15T18:29:11.483803] [DEBUG] [LOCAL ] DOLE: Primary data saved (39209 records). [2025-10-15T18:29:11.484821] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-15T18:29:11.485244] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOLE took 32.3s. Estimated remaining: 3h 59m 13s. Rate: 7.2 symbols/min [2025-10-15T18:29:11.616904] [DEBUG] [LOCAL ] DOCS: Primary data saved (50742 records). [2025-10-15T18:29:11.635921] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-15T18:29:11.636036] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 32.4s. Estimated remaining: 3h 58m 43s. Rate: 7.2 symbols/min [2025-10-15T18:29:11.743918] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:11.843522] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:11.887620] [DEBUG] [LOCAL ] DQ: Loaded 43704 existing records from primary storage. [2025-10-15T18:29:11.887976] [INFO ] [MAIN ] DQ: Loaded 43704 existing records. [2025-10-15T18:29:12.010953] [DEBUG] [LOCAL ] DRD: Loaded 37699 existing records from primary storage. [2025-10-15T18:29:12.026984] [INFO ] [MAIN ] DRD: Loaded 37699 existing records. [2025-10-15T18:29:12.166695] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:12.205880] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T18:29:12.205277] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-15T18:29:12.215278] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-15T18:29:12.261372] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-15T18:29:12.284414] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-15T18:29:12.286270] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-15T18:29:12.290151] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:12.343960] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-15T18:29:12.363864] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-15T18:29:12.389464] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-15T18:29:12.389720] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-15T18:29:12.883847] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-15T18:29:12.984092] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-15T18:29:12.973485] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:13.066325] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:13.074443] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T18:29:13.714003] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-15T18:29:14.514002] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-15T18:29:15.142760] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T18:29:15.313963] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-15T18:29:15.418271] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T18:29:15.509936] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:29:16.114011] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-15T18:29:16.914008] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-15T18:29:17.520682] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T18:29:17.554713] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T18:29:17.714061] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-15T18:29:18.203846] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:29:18.514066] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-15T18:29:19.103143] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:29:19.314064] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-15T18:29:20.113966] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-15T18:29:20.256380] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T18:29:20.647469] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-15T18:29:20.914036] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-15T18:29:21.194601] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:29:21.714049] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-15T18:29:22.514020] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-15T18:29:22.803257] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:29:22.996303] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:29:23.314015] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-15T18:29:23.705504] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T18:29:24.113982] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-15T18:29:24.874352] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T18:29:24.913956] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-15T18:29:25.713960] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-15T18:29:25.850274] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:29:26.513983] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-15T18:29:26.636785] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:29:27.314025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-15T18:29:28.114004] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-15T18:29:28.185387] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-15T18:29:28.187040] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T18:29:28.762877] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T18:29:28.914028] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-15T18:29:29.064614] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:29:29.714041] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-15T18:29:30.513962] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-15T18:29:31.066261] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:29:31.093855] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T18:29:31.313988] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-15T18:29:31.398575] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T18:29:32.113990] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-15T18:29:32.913979] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-15T18:29:33.027797] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:29:33.547070] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:29:33.714000] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-15T18:29:34.449874] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:29:34.514024] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-15T18:29:34.683500] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:29:35.314010] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-15T18:29:36.020678] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T18:29:36.113982] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-15T18:29:36.685262] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-15T18:29:36.691853] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-15T18:29:36.691996] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-15T18:29:36.919128] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-15T18:29:37.072480] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T18:29:37.115034] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-15T18:29:37.115110] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-15T18:29:37.116022] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-15T18:29:37.116104] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-15T18:29:37.117448] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-15T18:29:37.444565] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-15T18:29:37.444749] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-15T18:29:37.444840] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DOW took 34.6s. Estimated remaining: 3h 59m 21s. Rate: 7.2 symbols/min [2025-10-15T18:29:37.611538] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:37.655827] [DEBUG] [LOCAL ] DRH: Loaded 50409 existing records from primary storage. [2025-10-15T18:29:37.656122] [INFO ] [MAIN ] DRH: Loaded 50409 existing records. [2025-10-15T18:29:37.719066] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-15T18:29:37.831937] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:37.832133] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-15T18:29:37.832204] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-15T18:29:37.832571] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-15T18:29:37.832626] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-15T18:29:38.207360] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:38.209029] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T18:29:38.440889] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:29:38.442969] [INFO ] [REMOTE ] DPG: Full fetch complete (19030 records). [2025-10-15T18:29:38.443038] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-15T18:29:38.519123] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-15T18:29:38.793177] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-15T18:29:38.793246] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-15T18:29:38.793529] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-15T18:29:38.793567] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-15T18:29:38.794128] [DEBUG] [LOCAL ] DPG: Trimmed 19030 records to 13576 (keeping 200 days of data) [2025-10-15T18:29:38.872882] [DEBUG] [LOCAL ] DPG: Primary data saved (13576 records). [2025-10-15T18:29:38.873003] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-15T18:29:38.873078] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DPG took 31.0s. Estimated remaining: 3h 58m 54s. Rate: 7.2 symbols/min [2025-10-15T18:29:39.035545] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:39.035692] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-15T18:29:39.035742] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-15T18:29:39.035844] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-15T18:29:39.035885] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-15T18:29:39.035926] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-15T18:29:39.035957] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-15T18:29:39.319111] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-15T18:29:39.379994] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:40.114021] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-15T18:29:40.181009] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:29:40.901505] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:29:40.913949] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-15T18:29:41.481314] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:29:41.713979] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-15T18:29:42.514001] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-15T18:29:42.571474] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:29:43.314045] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-15T18:29:43.390430] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:29:44.046796] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T18:29:44.113963] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-15T18:29:44.839964] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:29:44.913977] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-15T18:29:45.557385] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:29:45.563014] [INFO ] [REMOTE ] DQ: Full fetch complete (63544 records). [2025-10-15T18:29:45.563121] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-15T18:29:45.714025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-15T18:29:45.937742] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-15T18:29:45.937839] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-15T18:29:45.938703] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-15T18:29:45.938764] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-15T18:29:45.940155] [DEBUG] [LOCAL ] DQ: Trimmed 63544 records to 43738 (keeping 200 days of data) [2025-10-15T18:29:46.190172] [DEBUG] [LOCAL ] DQ: Primary data saved (43738 records). [2025-10-15T18:29:46.190299] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-15T18:29:46.190775] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DQ took 34.7s. Estimated remaining: 3h 58m 43s. Rate: 7.2 symbols/min [2025-10-15T18:29:46.357534] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:46.369670] [DEBUG] [LOCAL ] DRLL: Loaded 9185 existing records from primary storage. [2025-10-15T18:29:46.369891] [INFO ] [MAIN ] DRLL: Loaded 9185 existing records. [2025-10-15T18:29:46.515498] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-15T18:29:46.544358] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:46.545395] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-15T18:29:46.545609] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-15T18:29:46.546058] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-15T18:29:46.546168] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-15T18:29:46.721342] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:29:46.947914] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:47.183990] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T18:29:47.189264] [INFO ] [REMOTE ] DRD: Full fetch complete (51246 records). [2025-10-15T18:29:47.189348] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-15T18:29:47.325123] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-15T18:29:47.564586] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-15T18:29:47.564714] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-15T18:29:47.565497] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-15T18:29:47.565560] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-15T18:29:47.567617] [DEBUG] [LOCAL ] DRD: Trimmed 51246 records to 37717 (keeping 200 days of data) [2025-10-15T18:29:47.794075] [DEBUG] [LOCAL ] DRD: Primary data saved (37717 records). [2025-10-15T18:29:47.794214] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-15T18:29:47.794292] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRD took 36.2s. Estimated remaining: 3h 58m 17s. Rate: 7.2 symbols/min [2025-10-15T18:29:47.998446] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:48.030582] [DEBUG] [LOCAL ] DSL: Loaded 28774 existing records from primary storage. [2025-10-15T18:29:48.030964] [INFO ] [MAIN ] DSL: Loaded 28774 existing records. [2025-10-15T18:29:48.119192] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-15T18:29:48.221760] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:48.231745] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-15T18:29:48.236948] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-15T18:29:48.247487] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-15T18:29:48.247625] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-15T18:29:48.325288] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:29:48.609313] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:48.913975] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-15T18:29:48.946928] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:29:49.053350] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:29:49.714060] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-15T18:29:50.430548] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:29:50.513964] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-15T18:29:50.589311] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T18:29:51.313993] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-15T18:29:52.114034] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-15T18:29:52.264740] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:29:52.690147] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T18:29:52.914005] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-15T18:29:53.692906] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T18:29:53.713981] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-15T18:29:54.423486] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T18:29:54.514038] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-15T18:29:55.054743] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:29:55.314020] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-15T18:29:55.506578] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T18:29:56.113993] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-15T18:29:56.770093] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T18:29:56.913999] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-15T18:29:57.261368] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T18:29:57.713996] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-15T18:29:58.352184] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T18:29:58.514031] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-15T18:29:59.006344] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T18:29:59.314014] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-15T18:30:00.069940] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T18:30:00.114061] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-15T18:30:00.170520] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:30:00.914003] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-15T18:30:01.313849] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T18:30:01.714000] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-15T18:30:02.513994] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-15T18:30:02.774432] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:30:03.069092] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T18:30:03.314025] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-15T18:30:04.030233] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:30:04.114002] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-15T18:30:04.303983] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T18:30:04.913976] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-15T18:30:05.714005] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-15T18:30:06.030708] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T18:30:06.514026] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-15T18:30:06.718697] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T18:30:06.756333] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:30:07.254891] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T18:30:07.313993] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-15T18:30:08.113982] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-15T18:30:08.914013] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-15T18:30:08.989238] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:30:09.003521] [INFO ] [REMOTE ] DRH: Full fetch complete (72089 records). [2025-10-15T18:30:09.003860] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:30:09.006866] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-15T18:30:09.393541] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-15T18:30:09.393673] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-15T18:30:09.394770] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-15T18:30:09.394846] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-15T18:30:09.396327] [DEBUG] [LOCAL ] DRH: Trimmed 72089 records to 50410 (keeping 200 days of data) [2025-10-15T18:30:09.690394] [DEBUG] [LOCAL ] DRH: Primary data saved (50410 records). [2025-10-15T18:30:09.690524] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-15T18:30:09.690635] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRH took 32.2s. Estimated remaining: 3h 58m 45s. Rate: 7.2 symbols/min [2025-10-15T18:30:09.719357] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-15T18:30:09.863409] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:09.879242] [DEBUG] [LOCAL ] DSM: Loaded 14198 existing records from primary storage. [2025-10-15T18:30:09.879475] [INFO ] [MAIN ] DSM: Loaded 14198 existing records. [2025-10-15T18:30:10.084461] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:30:10.084708] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-15T18:30:10.084796] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-15T18:30:10.084985] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-15T18:30:10.085055] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-15T18:30:10.476173] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:10.505149] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T18:30:10.514035] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-15T18:30:10.641570] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:30:11.314017] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-15T18:30:11.341012] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:30:12.084460] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T18:30:12.113995] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-15T18:30:12.914008] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-15T18:30:13.452055] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:30:13.714057] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-15T18:30:14.251023] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T18:30:14.514036] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-15T18:30:14.526160] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T18:30:15.314034] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-15T18:30:15.838744] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T18:30:16.114029] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-15T18:30:16.150468] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:30:16.913981] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-15T18:30:17.308720] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:30:17.410432] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-15T18:30:17.713996] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-15T18:30:18.514053] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-15T18:30:18.829694] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T18:30:18.833796] [INFO ] [REMOTE ] DSL: Full fetch complete (41650 records). [2025-10-15T18:30:18.833917] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-15T18:30:19.215569] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-15T18:30:19.215713] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-15T18:30:19.216370] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-15T18:30:19.216413] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-15T18:30:19.217352] [DEBUG] [LOCAL ] DSL: Trimmed 41650 records to 28822 (keeping 200 days of data) [2025-10-15T18:30:19.314207] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-15T18:30:19.317618] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T18:30:19.408136] [DEBUG] [LOCAL ] DSL: Primary data saved (28822 records). [2025-10-15T18:30:19.408283] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-15T18:30:19.408370] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DSL took 31.6s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-15T18:30:19.574262] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:19.574421] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-15T18:30:19.574458] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-15T18:30:19.574565] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-15T18:30:19.574606] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-15T18:30:19.574672] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-15T18:30:19.574724] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-15T18:30:19.930674] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:20.114006] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-15T18:30:20.456117] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T18:30:20.567399] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T18:30:20.914000] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-15T18:30:21.675179] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T18:30:21.681103] [INFO ] [REMOTE ] DRI: Full fetch complete (69501 records). [2025-10-15T18:30:21.681240] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-15T18:30:21.719115] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-15T18:30:22.078580] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-15T18:30:22.078680] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-15T18:30:22.079574] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-15T18:30:22.079616] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-15T18:30:22.081316] [DEBUG] [LOCAL ] DRI: Trimmed 69501 records to 47693 (keeping 200 days of data) [2025-10-15T18:30:22.389138] [DEBUG] [LOCAL ] DRI: Primary data saved (47693 records). [2025-10-15T18:30:22.389283] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-15T18:30:22.389382] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DRI took 43.5s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-10-15T18:30:22.514771] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-15T18:30:22.514698] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:30:22.571390] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:22.573120] [INFO ] [REMOTE ] DRLL: Full fetch complete (14806 records). [2025-10-15T18:30:22.573064] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-15T18:30:22.573327] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-15T18:30:22.573237] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-15T18:30:22.573719] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-15T18:30:22.585960] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-15T18:30:22.607561] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-15T18:30:22.619106] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-15T18:30:23.074473] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:30:23.313567] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-15T18:30:23.313414] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:23.313702] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-15T18:30:23.314048] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-15T18:30:23.314509] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-15T18:30:23.315414] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-15T18:30:23.315968] [DEBUG] [LOCAL ] DRLL: Trimmed 14806 records to 9148 (keeping 200 days of data) [2025-10-15T18:30:23.375332] [DEBUG] [LOCAL ] DRLL: Primary data saved (9148 records). [2025-10-15T18:30:23.375447] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-15T18:30:23.375521] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DRLL took 37.2s. Estimated remaining: 3h 57m 50s. Rate: 7.2 symbols/min [2025-10-15T18:30:23.583100] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:23.583270] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-15T18:30:23.583326] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-15T18:30:23.583438] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-15T18:30:23.583493] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-15T18:30:23.583560] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-15T18:30:23.583596] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-15T18:30:23.932953] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:24.113962] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-15T18:30:24.521788] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:30:24.913969] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-15T18:30:25.007802] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:30:25.713981] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-15T18:30:26.085750] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:30:26.195938] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T18:30:26.514007] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-15T18:30:27.313995] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-15T18:30:27.537816] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:30:27.768373] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:30:28.114028] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-15T18:30:28.914043] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-15T18:30:29.624181] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:30:29.713989] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-15T18:30:29.871786] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T18:30:30.514014] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-15T18:30:30.878507] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:30:31.109483] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T18:30:31.314005] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-15T18:30:31.856682] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T18:30:32.114003] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-15T18:30:32.554068] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T18:30:32.914007] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-15T18:30:33.713974] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-15T18:30:33.806422] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T18:30:34.507533] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T18:30:34.513945] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-15T18:30:35.313970] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-15T18:30:35.422454] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T18:30:36.114012] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-15T18:30:36.264058] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T18:30:36.449731] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T18:30:36.914016] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-15T18:30:37.714014] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-15T18:30:38.117719] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T18:30:38.254540] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T18:30:38.514046] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-15T18:30:38.960858] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T18:30:39.314047] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-15T18:30:39.812679] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-15T18:30:40.114034] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-15T18:30:40.839457] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T18:30:40.914013] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-15T18:30:41.713979] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-15T18:30:41.779367] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:30:41.781146] [INFO ] [REMOTE ] DSM: Full fetch complete (23919 records). [2025-10-15T18:30:41.781216] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-15T18:30:42.147551] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-15T18:30:42.147661] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-15T18:30:42.148173] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-15T18:30:42.148214] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-15T18:30:42.148851] [DEBUG] [LOCAL ] DSM: Trimmed 23919 records to 14125 (keeping 200 days of data) [2025-10-15T18:30:42.230476] [DEBUG] [LOCAL ] DSM: Primary data saved (14125 records). [2025-10-15T18:30:42.230605] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-15T18:30:42.230707] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DSM took 32.5s. Estimated remaining: 3h 58m 10s. Rate: 7.2 symbols/min [2025-10-15T18:30:42.374755] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T18:30:42.400284] [INFO ] [REMOTE ] DSMC: Full fetch complete (2855 records). [2025-10-15T18:30:42.407683] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-15T18:30:42.531329] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-15T18:30:42.471861] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:42.551961] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-15T18:30:42.557344] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-15T18:30:42.568086] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-15T18:30:42.579296] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-15T18:30:42.592672] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-15T18:30:42.598440] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-15T18:30:43.207714] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-15T18:30:43.211221] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-15T18:30:43.231395] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-15T18:30:43.231207] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:43.231544] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-15T18:30:43.232071] [DEBUG] [LOCAL ] DSMC: Trimmed 2855 records to 1837 (keeping 200 days of data) [2025-10-15T18:30:43.243968] [DEBUG] [LOCAL ] DSMC: Primary data saved (1837 records). [2025-10-15T18:30:43.244080] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-15T18:30:43.244151] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSMC took 23.8s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-15T18:30:43.319120] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-15T18:30:43.437343] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:43.437498] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-15T18:30:43.437535] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-15T18:30:43.437696] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-15T18:30:43.437749] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-15T18:30:43.437792] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-15T18:30:43.437823] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-15T18:30:43.832732] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:43.835936] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T18:30:44.114068] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-15T18:30:44.856791] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:30:44.913953] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-15T18:30:45.172037] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T18:30:45.461328] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:30:45.714047] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-15T18:30:46.246815] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T18:30:46.513998] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-15T18:30:47.314029] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-15T18:30:47.705073] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T18:30:47.926669] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:30:48.113992] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-15T18:30:48.914036] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-15T18:30:49.713995] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-15T18:30:49.798839] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T18:30:49.899014] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:30:50.513979] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-15T18:30:50.622127] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T18:30:51.062285] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T18:30:51.314034] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-15T18:30:52.113986] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-15T18:30:52.914049] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-15T18:30:53.147541] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:30:53.171730] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:30:53.607952] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T18:30:53.713962] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-15T18:30:54.514016] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-15T18:30:54.769435] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:30:55.183678] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T18:30:55.313994] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-15T18:30:55.929954] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T18:30:56.114076] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-15T18:30:56.914045] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-15T18:30:57.338911] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:30:57.713966] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-15T18:30:58.004620] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T18:30:58.514016] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-15T18:30:59.268031] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T18:30:59.313961] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-15T18:30:59.611848] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T18:31:00.113994] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-15T18:31:00.913972] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-15T18:31:01.250900] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:31:01.292985] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T18:31:01.346157] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T18:31:01.714072] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-15T18:31:02.514006] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-15T18:31:03.069607] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:31:03.314016] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-15T18:31:03.906044] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:31:04.113977] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-15T18:31:04.625532] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T18:31:04.914026] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-15T18:31:05.309389] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:31:05.312813] [INFO ] [REMOTE ] DSX: Full fetch complete (35821 records). [2025-10-15T18:31:05.312942] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-15T18:31:05.683271] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-15T18:31:05.683347] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-15T18:31:05.683973] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-15T18:31:05.684034] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-15T18:31:05.684796] [DEBUG] [LOCAL ] DSX: Trimmed 35821 records to 23924 (keeping 200 days of data) [2025-10-15T18:31:05.730873] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-15T18:31:05.822067] [DEBUG] [LOCAL ] DSX: Primary data saved (23924 records). [2025-10-15T18:31:05.822191] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-15T18:31:05.822260] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSX took 42.4s. Estimated remaining: 3h 58m 11s. Rate: 7.2 symbols/min [2025-10-15T18:31:05.988697] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:06.041082] [DEBUG] [LOCAL ] DTE: Loaded 47472 existing records from primary storage. [2025-10-15T18:31:06.041369] [INFO ] [MAIN ] DTE: Loaded 47472 existing records. [2025-10-15T18:31:06.226410] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:06.242279] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-15T18:31:06.242422] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-15T18:31:06.243907] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-15T18:31:06.243845] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:31:06.244102] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-15T18:31:06.363358] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T18:31:06.519259] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-15T18:31:06.611537] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:07.218003] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T18:31:07.219572] [INFO ] [REMOTE ] DTB: Full fetch complete (6690 records). [2025-10-15T18:31:07.219697] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-15T18:31:07.323082] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-15T18:31:07.592206] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-15T18:31:07.592291] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-15T18:31:07.592490] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-15T18:31:07.592552] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-15T18:31:07.593041] [DEBUG] [LOCAL ] DTB: Trimmed 6690 records to 5012 (keeping 200 days of data) [2025-10-15T18:31:07.624274] [DEBUG] [LOCAL ] DTB: Primary data saved (5012 records). [2025-10-15T18:31:07.624387] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-15T18:31:07.624456] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DTB took 24.4s. Estimated remaining: 3h 57m 46s. Rate: 7.2 symbols/min [2025-10-15T18:31:07.794715] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:07.794879] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-15T18:31:07.794917] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-15T18:31:07.795024] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-15T18:31:07.795067] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-15T18:31:07.795108] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-15T18:31:07.795141] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-15T18:31:08.121867] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-15T18:31:08.156527] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:08.913994] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-15T18:31:09.199362] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:31:09.240794] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T18:31:09.243946] [INFO ] [REMOTE ] DSU: Full fetch complete (33044 records). [2025-10-15T18:31:09.244039] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-15T18:31:09.604265] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-15T18:31:09.604358] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-15T18:31:09.604982] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-15T18:31:09.605046] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-15T18:31:09.605992] [DEBUG] [LOCAL ] DSU: Trimmed 33044 records to 23007 (keeping 200 days of data) [2025-10-15T18:31:09.713984] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-15T18:31:09.745482] [DEBUG] [LOCAL ] DSU: Primary data saved (23007 records). [2025-10-15T18:31:09.745597] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-15T18:31:09.745688] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSU took 47.4s. Estimated remaining: 3h 57m 21s. Rate: 7.2 symbols/min [2025-10-15T18:31:09.912511] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:09.920818] [DEBUG] [LOCAL ] DTG: Loaded 5793 existing records from primary storage. [2025-10-15T18:31:09.921044] [INFO ] [MAIN ] DTG: Loaded 5793 existing records. [2025-10-15T18:31:10.091890] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:10.092081] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-15T18:31:10.092152] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-15T18:31:10.092381] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-15T18:31:10.092438] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-15T18:31:10.440737] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:10.513956] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-15T18:31:10.832250] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T18:31:10.889548] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:31:11.225329] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T18:31:11.313979] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-15T18:31:12.113995] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-15T18:31:12.594420] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:31:12.708809] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T18:31:12.914039] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-15T18:31:13.714049] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-15T18:31:14.514007] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-15T18:31:14.693316] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:31:14.712287] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:31:15.314043] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-15T18:31:15.957547] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:31:16.113992] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-15T18:31:16.913972] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-15T18:31:17.098777] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T18:31:17.290797] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-15T18:31:17.714007] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-15T18:31:17.907916] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:31:18.052182] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T18:31:18.514024] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-15T18:31:18.960499] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:31:19.314005] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-15T18:31:20.006813] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T18:31:20.114054] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-15T18:31:20.582492] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T18:31:20.914021] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-15T18:31:21.714010] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-15T18:31:22.403789] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T18:31:22.514078] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-15T18:31:22.716766] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:31:22.722634] [INFO ] [REMOTE ] DT: Full fetch complete (76453 records). [2025-10-15T18:31:22.722803] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-15T18:31:22.723588] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:31:22.723703] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:31:22.723750] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:31:22.723791] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-15T18:31:22.723849] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-15T18:31:22.723884] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-10-15T18:31:22.723924] [DEBUG] [LOCAL ] DT: No derivative data file found to delete. [2025-10-15T18:31:22.723980] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DT took 40.5s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-15T18:31:22.888986] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:22.889176] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-15T18:31:22.889214] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-15T18:31:22.889325] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-15T18:31:22.889365] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-15T18:31:22.889405] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-15T18:31:22.889440] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-15T18:31:23.273504] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:23.313977] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-15T18:31:23.507461] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:31:23.507887] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-15T18:31:23.507977] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:31:23.508089] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-15T18:31:23.508158] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:31:23.508231] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-15T18:31:23.508311] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-15T18:31:23.508365] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-15T18:31:23.508408] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-15T18:31:23.508456] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTK took 0.8s. Estimated remaining: 3h 56m 57s. Rate: 7.2 symbols/min [2025-10-15T18:31:23.680092] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:23.680281] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-15T18:31:23.680318] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-15T18:31:23.680427] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-15T18:31:23.680467] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-15T18:31:23.680508] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-15T18:31:23.680539] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-15T18:31:24.053216] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:24.113995] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-15T18:31:24.340950] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:31:24.914003] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-15T18:31:25.574738] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T18:31:25.634732] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T18:31:25.713991] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-15T18:31:26.299040] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T18:31:26.514011] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-15T18:31:27.314022] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-15T18:31:27.942320] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T18:31:28.010706] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:31:28.114007] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-15T18:31:28.914038] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-15T18:31:29.342972] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T18:31:29.694721] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T18:31:29.714026] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-15T18:31:30.074586] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T18:31:30.513994] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-15T18:31:31.314005] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-15T18:31:31.698093] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T18:31:32.113977] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-15T18:31:32.325893] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:31:32.913989] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-15T18:31:33.570012] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-15T18:31:33.713991] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-15T18:31:33.842147] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T18:31:34.200716] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:31:34.514062] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-15T18:31:35.314023] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-15T18:31:35.982712] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T18:31:36.114038] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-15T18:31:36.773133] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T18:31:36.913982] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-15T18:31:37.095802] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:31:37.430540] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T18:31:37.714012] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-15T18:31:38.514020] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-15T18:31:39.268186] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T18:31:39.303284] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:31:39.313958] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-15T18:31:39.731308] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T18:31:39.736792] [INFO ] [REMOTE ] DTE: Full fetch complete (68693 records). [2025-10-15T18:31:39.736947] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-15T18:31:39.737814] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:31:39.737909] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:31:39.737951] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:31:39.737991] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-15T18:31:39.738046] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-15T18:31:39.738080] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-15T18:31:39.738225] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-15T18:31:39.738851] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTE took 33.9s. Estimated remaining: 3h 57m 9s. Rate: 7.2 symbols/min [2025-10-15T18:31:39.916493] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:39.925323] [DEBUG] [LOCAL ] DTW: Loaded 4895 existing records from primary storage. [2025-10-15T18:31:39.925543] [INFO ] [MAIN ] DTW: Loaded 4895 existing records. [2025-10-15T18:31:40.098210] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:40.098448] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-15T18:31:40.098501] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-15T18:31:40.098677] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-15T18:31:40.098733] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-15T18:31:40.119173] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-15T18:31:40.459065] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:40.914050] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-15T18:31:41.408894] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:31:41.409622] [INFO ] [REMOTE ] DTF: Full fetch complete (1805 records). [2025-10-15T18:31:41.409717] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-15T18:31:41.586396] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-15T18:31:41.586580] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:31:41.586687] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:31:41.586775] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-15T18:31:41.586852] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-15T18:31:41.586900] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-15T18:31:41.586954] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-15T18:31:41.587026] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTF took 34.0s. Estimated remaining: 3h 56m 44s. Rate: 7.2 symbols/min [2025-10-15T18:31:41.726446] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-15T18:31:41.759955] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:41.760341] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-15T18:31:41.760459] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-15T18:31:41.760583] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-15T18:31:41.760679] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-15T18:31:41.760755] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-15T18:31:41.760803] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-15T18:31:42.148971] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:42.186921] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T18:31:42.251288] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T18:31:42.252811] [INFO ] [REMOTE ] DTG: Full fetch complete (8768 records). [2025-10-15T18:31:42.252883] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-15T18:31:42.523710] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-15T18:31:42.649386] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-15T18:31:42.649457] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-15T18:31:42.649696] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-15T18:31:42.649755] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-15T18:31:42.650144] [DEBUG] [LOCAL ] DTG: Trimmed 8768 records to 5805 (keeping 200 days of data) [2025-10-15T18:31:42.684368] [DEBUG] [LOCAL ] DTG: Primary data saved (5805 records). [2025-10-15T18:31:42.684489] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-15T18:31:42.684568] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 32.9s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-15T18:31:42.851250] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:42.859737] [DEBUG] [LOCAL ] DUKB: Loaded 6297 existing records from primary storage. [2025-10-15T18:31:42.859951] [INFO ] [MAIN ] DUKB: Loaded 6297 existing records. [2025-10-15T18:31:43.033171] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:43.033391] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-15T18:31:43.033446] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-15T18:31:43.033610] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-15T18:31:43.033700] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-15T18:31:43.319167] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-15T18:31:43.388345] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:44.114089] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-15T18:31:44.478988] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T18:31:44.854695] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:31:44.914192] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-15T18:31:44.970634] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:31:45.714013] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-15T18:31:46.513994] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-15T18:31:46.632441] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:31:47.062576] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:31:47.313985] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-15T18:31:47.479851] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T18:31:47.825315] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T18:31:48.114020] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-15T18:31:48.770014] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T18:31:48.914004] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-15T18:31:49.714049] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-15T18:31:50.451262] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:31:50.513993] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-15T18:31:50.612178] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:31:51.314010] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-15T18:31:52.058058] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T18:31:52.114005] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-15T18:31:52.632878] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:31:52.914006] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-15T18:31:53.347479] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T18:31:53.676295] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:31:53.714020] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-15T18:31:54.341110] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T18:31:54.513998] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-15T18:31:55.314026] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-15T18:31:55.932087] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T18:31:56.114014] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-15T18:31:56.362763] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:31:56.368432] [INFO ] [REMOTE ] DTM: Full fetch complete (64996 records). [2025-10-15T18:31:56.368585] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-15T18:31:56.755954] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-15T18:31:56.756036] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-15T18:31:56.756979] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-15T18:31:56.757044] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-15T18:31:56.758351] [DEBUG] [LOCAL ] DTM: Trimmed 64996 records to 43930 (keeping 200 days of data) [2025-10-15T18:31:56.935456] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-15T18:31:57.037013] [DEBUG] [LOCAL ] DTM: Primary data saved (43930 records). [2025-10-15T18:31:57.037160] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-15T18:31:57.037232] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 33.5s. Estimated remaining: 3h 56m 25s. Rate: 7.2 symbols/min [2025-10-15T18:31:57.207324] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:57.259223] [DEBUG] [LOCAL ] DV: Loaded 51304 existing records from primary storage. [2025-10-15T18:31:57.259571] [INFO ] [MAIN ] DV: Loaded 51304 existing records. [2025-10-15T18:31:57.437950] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:57.438173] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-15T18:31:57.438220] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-15T18:31:57.438593] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-15T18:31:57.438687] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-15T18:31:57.716290] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-15T18:31:57.803539] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T18:31:57.823043] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T18:31:57.845903] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:58.514020] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-15T18:31:58.961171] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T18:31:59.313976] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-15T18:31:59.723330] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T18:32:00.114000] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-15T18:32:00.913986] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-15T18:32:01.000197] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:32:01.702421] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T18:32:01.713962] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-15T18:32:02.131791] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T18:32:02.255198] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:32:02.514034] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-15T18:32:03.314019] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-15T18:32:03.966891] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T18:32:04.114036] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-15T18:32:04.477000] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:32:04.914012] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-15T18:32:05.359100] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T18:32:05.713974] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-15T18:32:06.117215] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T18:32:06.513982] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-15T18:32:07.094364] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T18:32:07.282687] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:32:07.313974] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-15T18:32:08.114002] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-15T18:32:08.821748] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:32:08.913972] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-15T18:32:09.044616] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:32:09.430462] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T18:32:09.714068] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-15T18:32:10.310528] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T18:32:10.311504] [INFO ] [REMOTE ] DUKB: Full fetch complete (9266 records). [2025-10-15T18:32:10.311572] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-15T18:32:10.311979] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:32:10.312060] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:32:10.312103] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:32:10.312140] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-15T18:32:10.312214] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-15T18:32:10.312267] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-15T18:32:10.312590] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-15T18:32:10.312720] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 27.6s. Estimated remaining: 3h 56m 29s. Rate: 7.2 symbols/min [2025-10-15T18:32:10.479706] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:10.519101] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-15T18:32:10.521706] [DEBUG] [LOCAL ] DVA: Loaded 40980 existing records from primary storage. [2025-10-15T18:32:10.522063] [INFO ] [MAIN ] DVA: Loaded 40980 existing records. [2025-10-15T18:32:10.697970] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:10.698173] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-15T18:32:10.698221] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-15T18:32:10.698489] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-15T18:32:10.698545] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-15T18:32:11.050620] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:11.313991] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-15T18:32:12.113969] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-15T18:32:12.171412] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:32:12.914058] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-15T18:32:13.075963] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T18:32:13.488683] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:32:13.503334] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:32:13.714017] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-15T18:32:14.514014] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-15T18:32:15.087898] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T18:32:15.313966] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-15T18:32:15.412958] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T18:32:15.928166] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T18:32:15.929250] [INFO ] [REMOTE ] DTW: Full fetch complete (7265 records). [2025-10-15T18:32:15.929317] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-15T18:32:16.121822] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-15T18:32:16.293461] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-15T18:32:16.293534] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-15T18:32:16.293745] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-15T18:32:16.293813] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-15T18:32:16.294197] [DEBUG] [LOCAL ] DTW: Trimmed 7265 records to 4821 (keeping 200 days of data) [2025-10-15T18:32:16.322482] [DEBUG] [LOCAL ] DTW: Primary data saved (4821 records). [2025-10-15T18:32:16.322556] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-15T18:32:16.322639] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DTW took 36.6s. Estimated remaining: 3h 56m 15s. Rate: 7.2 symbols/min [2025-10-15T18:32:16.485257] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:16.485416] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-15T18:32:16.485453] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-15T18:32:16.485559] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-15T18:32:16.485603] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-15T18:32:16.485667] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-15T18:32:16.485721] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-15T18:32:16.830748] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:16.913958] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-15T18:32:17.690201] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:32:17.713963] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-15T18:32:18.513991] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-15T18:32:18.869096] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:32:19.046989] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T18:32:19.314024] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-15T18:32:19.906614] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:32:20.114001] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-15T18:32:20.914011] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-15T18:32:21.397229] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-15T18:32:21.487046] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:32:21.714061] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-15T18:32:22.437283] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:32:22.514075] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-15T18:32:23.313975] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-15T18:32:23.837478] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T18:32:24.114044] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-15T18:32:24.523133] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-15T18:32:24.913981] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-15T18:32:25.098958] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:32:25.714041] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-15T18:32:26.155357] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T18:32:26.476484] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:32:26.513974] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-15T18:32:27.301103] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:32:27.313953] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-15T18:32:27.985873] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T18:32:27.992711] [INFO ] [REMOTE ] DUK: Full fetch complete (77565 records). [2025-10-15T18:32:27.992916] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-15T18:32:28.119107] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-15T18:32:28.422901] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-15T18:32:28.423101] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-15T18:32:28.424216] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-15T18:32:28.424328] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-15T18:32:28.426280] [DEBUG] [LOCAL ] DUK: Trimmed 77565 records to 53437 (keeping 200 days of data) [2025-10-15T18:32:28.577546] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T18:32:28.815048] [DEBUG] [LOCAL ] DUK: Primary data saved (53437 records). [2025-10-15T18:32:28.815200] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-15T18:32:28.815307] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DUK took 47.2s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-15T18:32:28.920032] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-15T18:32:28.995761] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:29.047689] [DEBUG] [LOCAL ] DX: Loaded 52505 existing records from primary storage. [2025-10-15T18:32:29.048060] [INFO ] [MAIN ] DX: Loaded 52505 existing records. [2025-10-15T18:32:29.231030] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:29.231259] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-15T18:32:29.231310] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-15T18:32:29.231525] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-15T18:32:29.231584] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-15T18:32:29.586845] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:29.713986] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-15T18:32:29.977433] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T18:32:30.513978] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-15T18:32:30.573396] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:32:31.313995] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-15T18:32:31.853369] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T18:32:32.113974] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-15T18:32:32.914075] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-15T18:32:33.266353] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-15T18:32:33.714057] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-15T18:32:33.864146] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-15T18:32:34.330588] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-15T18:32:34.514034] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-15T18:32:34.642148] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T18:32:35.313996] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-15T18:32:35.703594] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T18:32:35.710020] [INFO ] [REMOTE ] DV: Full fetch complete (73839 records). [2025-10-15T18:32:35.710152] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-15T18:32:36.103225] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-15T18:32:36.118426] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-15T18:32:36.128498] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-15T18:32:36.118280] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-15T18:32:36.129882] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-15T18:32:36.131555] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T18:32:36.141888] [DEBUG] [LOCAL ] DV: Trimmed 73839 records to 51301 (keeping 200 days of data) [2025-10-15T18:32:36.455451] [DEBUG] [LOCAL ] DV: Primary data saved (51301 records). [2025-10-15T18:32:36.455549] [INFO ] [MAIN ] DV: Full history saved. [2025-10-15T18:32:36.455627] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 39.4s. Estimated remaining: 3h 56m 7s. Rate: 7.2 symbols/min [2025-10-15T18:32:36.621230] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:36.621394] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-15T18:32:36.621430] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-15T18:32:36.621535] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-15T18:32:36.621577] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-15T18:32:36.621617] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-15T18:32:36.621675] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-15T18:32:36.915554] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-15T18:32:37.004566] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:37.038477] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T18:32:37.714004] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-15T18:32:37.787965] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T18:32:38.513992] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-15T18:32:38.627453] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:32:39.314046] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-15T18:32:39.692709] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T18:32:40.002609] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:32:40.114055] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-15T18:32:40.909252] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:32:40.919312] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-15T18:32:41.714027] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-15T18:32:41.747386] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:32:42.513958] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-15T18:32:42.961289] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T18:32:43.313972] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-15T18:32:43.792106] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-15T18:32:43.995528] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:32:44.114034] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-15T18:32:44.745850] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:32:44.914004] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-15T18:32:45.413134] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:32:45.713982] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-15T18:32:46.514016] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-15T18:32:46.784908] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:32:47.314052] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-15T18:32:47.825283] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-15T18:32:47.831439] [INFO ] [REMOTE ] DVA: Full fetch complete (59775 records). [2025-10-15T18:32:47.831555] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-15T18:32:48.115383] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-15T18:32:48.220229] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-15T18:32:48.220326] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-15T18:32:48.221137] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-15T18:32:48.221216] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-15T18:32:48.222543] [DEBUG] [LOCAL ] DVA: Trimmed 59775 records to 41059 (keeping 200 days of data) [2025-10-15T18:32:48.346498] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T18:32:48.355900] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-15T18:32:48.356782] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-15T18:32:48.359991] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:32:48.361884] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:32:48.362233] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:32:48.363059] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-15T18:32:48.363681] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-15T18:32:48.364243] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-15T18:32:48.365123] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-15T18:32:48.365444] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 32.0s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-15T18:32:48.550574] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:48.676837] [DEBUG] [LOCAL ] DXYZ: Loaded 37165 existing records from primary storage. [2025-10-15T18:32:48.679226] [INFO ] [MAIN ] DXYZ: Loaded 37165 existing records. [2025-10-15T18:32:48.878354] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:48.882591] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-15T18:32:48.883032] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-15T18:32:48.884483] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-15T18:32:48.884619] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-15T18:32:49.023408] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-15T18:32:49.049071] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-15T18:32:49.137191] [DEBUG] [LOCAL ] DVA: Primary data saved (41059 records). [2025-10-15T18:32:49.188839] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-15T18:32:49.216167] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DVA took 38.9s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-15T18:32:49.471526] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:49.504184] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:49.533078] [DEBUG] [LOCAL ] DY: Loaded 28437 existing records from primary storage. [2025-10-15T18:32:49.533342] [INFO ] [MAIN ] DY: Loaded 28437 existing records. [2025-10-15T18:32:49.710690] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:49.710923] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-15T18:32:49.710979] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-15T18:32:49.711209] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-15T18:32:49.711249] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-15T18:32:49.724535] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-15T18:32:50.078117] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:50.104827] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:32:50.513988] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-15T18:32:51.314032] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-15T18:32:52.286130] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T18:32:52.298122] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-15T18:32:52.491246] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-15T18:32:52.554944] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (3.51 seconds). [2025-10-15T18:32:52.633691] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:32:52.913996] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-15T18:32:53.324406] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T18:32:53.714041] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-15T18:32:54.514000] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-15T18:32:54.817585] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T18:32:55.314008] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-15T18:32:55.441166] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:32:55.946014] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:32:56.114016] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-15T18:32:56.914084] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-15T18:32:57.234418] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T18:32:57.314119] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T18:32:57.714005] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-15T18:32:58.513974] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-15T18:32:58.676467] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T18:32:58.928375] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T18:32:59.314004] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-15T18:33:00.113968] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-15T18:33:00.528261] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T18:33:00.913976] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-15T18:33:01.036373] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:33:01.714058] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-15T18:33:01.951697] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T18:33:02.514011] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-15T18:33:02.782486] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T18:33:02.965270] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T18:33:03.314019] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-15T18:33:04.114058] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-15T18:33:04.455494] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T18:33:04.514119] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T18:33:04.914029] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-15T18:33:05.713983] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-15T18:33:05.856078] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:33:06.513969] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-15T18:33:06.734381] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:33:06.843047] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T18:33:07.314018] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-15T18:33:08.114047] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-15T18:33:08.460927] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:33:08.467481] [INFO ] [REMOTE ] DX: Full fetch complete (75762 records). [2025-10-15T18:33:08.467686] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-15T18:33:08.835978] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:33:08.889540] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-15T18:33:08.889621] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-15T18:33:08.890854] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-15T18:33:08.890916] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-15T18:33:08.892253] [DEBUG] [LOCAL ] DX: Trimmed 75762 records to 52502 (keeping 200 days of data) [2025-10-15T18:33:08.945879] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-15T18:33:09.210326] [DEBUG] [LOCAL ] DX: Primary data saved (52502 records). [2025-10-15T18:33:09.210457] [INFO ] [MAIN ] DX: Full history saved. [2025-10-15T18:33:09.211400] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DX took 40.4s. Estimated remaining: 3h 56m 2s. Rate: 7.2 symbols/min [2025-10-15T18:33:09.376462] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:09.410982] [DEBUG] [LOCAL ] E: Loaded 33236 existing records from primary storage. [2025-10-15T18:33:09.411262] [INFO ] [MAIN ] E: Loaded 33236 existing records. [2025-10-15T18:33:09.592476] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:09.592799] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-15T18:33:09.592871] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-15T18:33:09.593171] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-15T18:33:09.593228] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-15T18:33:09.720805] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-15T18:33:09.903419] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:33:09.956880] [INFO ] [REMOTE ] DXC: Full fetch complete (69974 records). [2025-10-15T18:33:09.972352] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-15T18:33:09.977152] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:10.357594] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-15T18:33:10.357705] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-15T18:33:10.358589] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-15T18:33:10.358631] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-15T18:33:10.359928] [DEBUG] [LOCAL ] DXC: Trimmed 69974 records to 49875 (keeping 200 days of data) [2025-10-15T18:33:10.525559] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-15T18:33:10.659635] [DEBUG] [LOCAL ] DXC: Primary data saved (49875 records). [2025-10-15T18:33:10.659830] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-15T18:33:10.659918] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DXC took 34.2s. Estimated remaining: 3h 55m 36s. Rate: 7.2 symbols/min [2025-10-15T18:33:10.824445] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T18:33:10.864445] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:10.906325] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T18:33:10.926832] [DEBUG] [LOCAL ] EAF: Loaded 41759 existing records from primary storage. [2025-10-15T18:33:10.927133] [INFO ] [MAIN ] EAF: Loaded 41759 existing records. [2025-10-15T18:33:11.103861] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:11.104110] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-15T18:33:11.104159] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-15T18:33:11.104346] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-15T18:33:11.104383] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-15T18:33:11.319698] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-15T18:33:11.459515] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:12.078063] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T18:33:12.113987] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-15T18:33:12.881395] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:33:12.913962] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-15T18:33:13.475735] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:33:13.713994] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-15T18:33:14.514042] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-15T18:33:14.743333] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:33:14.873799] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:33:15.314064] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-15T18:33:15.854579] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:33:15.859087] [INFO ] [REMOTE ] DY: Full fetch complete (43553 records). [2025-10-15T18:33:15.859272] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-15T18:33:16.119147] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-15T18:33:16.271138] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-15T18:33:16.271211] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-15T18:33:16.271881] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-15T18:33:16.271941] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-15T18:33:16.272792] [DEBUG] [LOCAL ] DY: Trimmed 43553 records to 28456 (keeping 200 days of data) [2025-10-15T18:33:16.443130] [DEBUG] [LOCAL ] DY: Primary data saved (28456 records). [2025-10-15T18:33:16.443281] [INFO ] [MAIN ] DY: Full history saved. [2025-10-15T18:33:16.443373] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DY took 27.2s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-15T18:33:16.608848] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:16.615119] [DEBUG] [LOCAL ] EAI: Loaded 3991 existing records from primary storage. [2025-10-15T18:33:16.615287] [INFO ] [MAIN ] EAI: Loaded 3991 existing records. [2025-10-15T18:33:16.788120] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:16.788292] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-15T18:33:16.788343] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-15T18:33:16.788483] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-15T18:33:16.788537] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-15T18:33:16.923984] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-15T18:33:17.143079] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:17.195669] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T18:33:17.713985] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-15T18:33:17.992433] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T18:33:18.062294] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T18:33:18.514075] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-15T18:33:19.313977] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-15T18:33:19.344139] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T18:33:19.941124] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:33:20.114002] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-15T18:33:20.914015] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-15T18:33:20.995154] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:33:21.654454] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T18:33:21.713970] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-15T18:33:22.445843] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T18:33:22.513984] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-15T18:33:23.023549] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T18:33:23.166601] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-15T18:33:23.171885] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57242 records). [2025-10-15T18:33:23.171987] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-15T18:33:23.319138] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-15T18:33:23.547028] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-15T18:33:23.547107] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-15T18:33:23.547934] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-15T18:33:23.547998] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-15T18:33:23.549190] [DEBUG] [LOCAL ] DXYZ: Trimmed 57242 records to 37126 (keeping 200 days of data) [2025-10-15T18:33:23.763791] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37126 records). [2025-10-15T18:33:23.763936] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-15T18:33:23.764288] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DXYZ took 35.4s. Estimated remaining: 3h 55m 10s. Rate: 7.2 symbols/min [2025-10-15T18:33:23.931803] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:23.959745] [DEBUG] [LOCAL ] EARN: Loaded 28749 existing records from primary storage. [2025-10-15T18:33:23.960005] [INFO ] [MAIN ] EARN: Loaded 28749 existing records. [2025-10-15T18:33:24.115489] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-15T18:33:24.138129] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:24.139115] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-15T18:33:24.139187] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-15T18:33:24.139471] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-15T18:33:24.139532] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-15T18:33:24.506419] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:24.913975] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-15T18:33:24.978596] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T18:33:25.714024] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-15T18:33:25.734881] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:33:25.962784] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T18:33:26.514047] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-15T18:33:27.314006] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-15T18:33:27.370665] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:33:27.528459] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:33:28.114015] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-15T18:33:28.765702] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:33:28.914009] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-15T18:33:29.566685] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:33:29.713975] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-15T18:33:30.371746] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:33:30.513993] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-15T18:33:31.303443] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T18:33:31.313970] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-15T18:33:32.096270] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:33:32.113957] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-15T18:33:32.820542] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T18:33:32.913970] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-15T18:33:33.488511] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T18:33:33.713998] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-15T18:33:34.416526] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:33:34.514009] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-15T18:33:35.119243] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:33:35.123400] [INFO ] [REMOTE ] E: Full fetch complete (47890 records). [2025-10-15T18:33:35.123542] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-15T18:33:35.231006] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T18:33:35.321758] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-15T18:33:35.553464] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-15T18:33:35.553562] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-15T18:33:35.554360] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-15T18:33:35.554426] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-15T18:33:35.555630] [DEBUG] [LOCAL ] E: Trimmed 47890 records to 33280 (keeping 200 days of data) [2025-10-15T18:33:35.763505] [DEBUG] [LOCAL ] E: Primary data saved (33280 records). [2025-10-15T18:33:35.763673] [INFO ] [MAIN ] E: Full history saved. [2025-10-15T18:33:35.763780] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. E took 26.6s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-15T18:33:35.931447] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:35.979669] [DEBUG] [LOCAL ] EAT: Loaded 49892 existing records from primary storage. [2025-10-15T18:33:35.980002] [INFO ] [MAIN ] EAT: Loaded 49892 existing records. [2025-10-15T18:33:36.121827] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-15T18:33:36.162945] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:36.163149] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-15T18:33:36.163195] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-15T18:33:36.163382] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-15T18:33:36.163419] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-15T18:33:36.526960] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:36.902392] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T18:33:36.907395] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T18:33:36.914093] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-15T18:33:37.714048] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-15T18:33:38.514055] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-15T18:33:38.630331] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:33:38.795608] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:33:39.313999] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-15T18:33:40.113968] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-15T18:33:40.185606] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:33:40.245353] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T18:33:40.685775] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:33:40.914012] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-15T18:33:41.714048] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-15T18:33:42.133799] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:33:42.514079] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-15T18:33:43.313987] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-15T18:33:43.426098] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:33:43.628735] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:33:43.822254] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T18:33:44.114057] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-15T18:33:44.914049] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-15T18:33:45.713993] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-15T18:33:45.942190] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T18:33:46.491775] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:33:46.495417] [INFO ] [REMOTE ] EARN: Full fetch complete (45618 records). [2025-10-15T18:33:46.495505] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-15T18:33:46.524339] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-15T18:33:46.618408] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T18:33:46.897914] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-15T18:33:46.897988] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-15T18:33:46.898736] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-15T18:33:46.898809] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-15T18:33:46.899748] [DEBUG] [LOCAL ] EARN: Trimmed 45618 records to 28609 (keeping 200 days of data) [2025-10-15T18:33:47.058493] [DEBUG] [LOCAL ] EARN: Primary data saved (28609 records). [2025-10-15T18:33:47.058626] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-15T18:33:47.058740] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EARN took 23.3s. Estimated remaining: 3h 55m 10s. Rate: 7.2 symbols/min [2025-10-15T18:33:47.225093] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:47.258455] [DEBUG] [LOCAL ] EB: Loaded 36591 existing records from primary storage. [2025-10-15T18:33:47.258759] [INFO ] [MAIN ] EB: Loaded 36591 existing records. [2025-10-15T18:33:47.321042] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-15T18:33:47.440832] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:47.441049] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-15T18:33:47.441096] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-15T18:33:47.441396] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-15T18:33:47.441452] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-15T18:33:47.807277] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:48.114011] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-15T18:33:48.245396] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:33:48.677317] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:33:48.913977] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-15T18:33:49.308336] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T18:33:49.351030] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T18:33:49.714002] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-15T18:33:50.514002] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-15T18:33:50.964850] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:33:51.313968] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-15T18:33:51.394724] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:33:52.113990] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-15T18:33:52.330986] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T18:33:52.913995] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-15T18:33:53.615613] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:33:53.713976] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-15T18:33:54.091156] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T18:33:54.095992] [INFO ] [REMOTE ] EAF: Full fetch complete (62794 records). [2025-10-15T18:33:54.096140] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-15T18:33:54.519099] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-15T18:33:54.520619] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-15T18:33:54.520709] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-15T18:33:54.521533] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-15T18:33:54.521674] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-15T18:33:54.522989] [DEBUG] [LOCAL ] EAF: Trimmed 62794 records to 41701 (keeping 200 days of data) [2025-10-15T18:33:54.760004] [DEBUG] [LOCAL ] EAF: Primary data saved (41701 records). [2025-10-15T18:33:54.760131] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-15T18:33:54.760211] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EAF took 44.1s. Estimated remaining: 3h 55m 1s. Rate: 7.2 symbols/min [2025-10-15T18:33:54.930482] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:54.949830] [DEBUG] [LOCAL ] EBF: Loaded 18912 existing records from primary storage. [2025-10-15T18:33:54.950058] [INFO ] [MAIN ] EBF: Loaded 18912 existing records. [2025-10-15T18:33:55.077255] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:33:55.125746] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T18:33:55.162514] [INFO ] [REMOTE ] EAI: Full fetch complete (6013 records). [2025-10-15T18:33:55.165960] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:55.166063] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-15T18:33:55.166759] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-15T18:33:55.166602] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:33:55.166860] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:33:55.166959] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-15T18:33:55.167076] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:33:55.167168] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-15T18:33:55.167239] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-15T18:33:55.167381] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-15T18:33:55.167346] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-15T18:33:55.229440] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-15T18:33:55.263536] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-15T18:33:55.265793] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAI took 38.8s. Estimated remaining: 3h 54m 33s. Rate: 7.2 symbols/min [2025-10-15T18:33:55.337987] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-15T18:33:55.521278] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:56.114079] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-15T18:33:56.663679] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T18:33:56.914044] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-15T18:33:57.446385] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:33:57.714018] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-15T18:33:58.059730] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T18:33:58.514105] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-15T18:33:58.734445] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:33:59.314094] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-15T18:34:00.067197] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T18:34:00.113970] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-15T18:34:00.474295] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T18:34:00.913994] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-15T18:34:01.099156] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T18:34:01.714092] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-15T18:34:02.514078] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-15T18:34:02.762353] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T18:34:03.315019] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-15T18:34:03.316359] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T18:34:03.358038] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T18:34:04.113994] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-15T18:34:04.660485] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:34:04.914044] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-15T18:34:05.263700] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T18:34:05.714046] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-15T18:34:06.380233] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T18:34:06.412850] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T18:34:06.514027] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-15T18:34:07.314021] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-15T18:34:08.113984] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-15T18:34:08.264063] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T18:34:08.758715] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:34:08.913960] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-15T18:34:09.147100] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T18:34:09.714003] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-15T18:34:10.514051] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-15T18:34:10.644927] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:34:10.829051] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T18:34:11.313962] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-15T18:34:11.519023] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T18:34:12.113993] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-15T18:34:12.914034] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-15T18:34:13.165252] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T18:34:13.491972] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:34:13.496085] [INFO ] [REMOTE ] EB: Full fetch complete (55422 records). [2025-10-15T18:34:13.496176] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-15T18:34:13.687768] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T18:34:13.719459] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-15T18:34:13.896365] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-15T18:34:13.896440] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-15T18:34:13.897197] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-15T18:34:13.897257] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-15T18:34:13.898336] [DEBUG] [LOCAL ] EB: Trimmed 55422 records to 36538 (keeping 200 days of data) [2025-10-15T18:34:14.104045] [DEBUG] [LOCAL ] EB: Primary data saved (36538 records). [2025-10-15T18:34:14.104218] [INFO ] [MAIN ] EB: Full history saved. [2025-10-15T18:34:14.104631] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 27.0s. Estimated remaining: 3h 54m 51s. Rate: 7.2 symbols/min [2025-10-15T18:34:14.513998] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-15T18:34:15.580483] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T18:34:15.583200] [INFO ] [REMOTE ] EBF: Full fetch complete (27657 records). [2025-10-15T18:34:15.583284] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-15T18:34:15.583786] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:34:15.583866] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:34:15.583908] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:34:15.583947] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-15T18:34:15.584001] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-15T18:34:15.584035] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-15T18:34:15.584180] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-15T18:34:15.584264] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 20.8s. Estimated remaining: 3h 54m 25s. Rate: 7.2 symbols/min [2025-10-15T18:34:15.687458] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T18:34:15.702811] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-15T18:34:17.525175] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:34:17.536116] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-15T18:34:19.111407] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:34:19.116870] [INFO ] [REMOTE ] EAT: Full fetch complete (72058 records). [2025-10-15T18:34:19.116997] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-15T18:34:19.117789] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:34:19.117876] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:34:19.117918] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:34:19.117954] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-15T18:34:19.118007] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-15T18:34:19.118042] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-10-15T18:34:19.118191] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-10-15T18:34:19.118849] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EAT took 43.4s. Estimated remaining: 3h 54m 5s. Rate: 7.2 symbols/min [2025-10-15T18:34:19.855914] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.847179] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.797893] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.855006] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.967146] [DEBUG] [LOCAL ] EBR: Loaded 43246 existing records from primary storage. [2025-10-15T18:34:19.964982] [DEBUG] [LOCAL ] ECAT: Loaded 29496 existing records from primary storage. [2025-10-15T18:34:19.966285] [DEBUG] [LOCAL ] EBS: Loaded 46752 existing records from primary storage. [2025-10-15T18:34:19.967963] [INFO ] [MAIN ] ECAT: Loaded 29496 existing records. [2025-10-15T18:34:19.968194] [INFO ] [MAIN ] EBS: Loaded 46752 existing records. [2025-10-15T18:34:19.968428] [INFO ] [MAIN ] EBR: Loaded 43246 existing records. [2025-10-15T18:34:20.048338] [DEBUG] [LOCAL ] EC: Loaded 49029 existing records from primary storage. [2025-10-15T18:34:20.134723] [INFO ] [MAIN ] EC: Loaded 49029 existing records. [2025-10-15T18:34:20.640425] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.678017] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.717083] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.730361] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.726957] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-15T18:34:20.709333] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.723529] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.730949] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-15T18:34:20.731098] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.731203] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.731446] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-15T18:34:20.731333] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-15T18:34:20.732070] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-15T18:34:20.731577] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-15T18:34:20.732139] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-15T18:34:20.732166] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-15T18:34:20.737837] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-15T18:34:20.743794] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-15T18:34:20.749250] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-15T18:34:20.830699] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-15T18:34:22.037859] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.213295] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.159814] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-15T18:34:22.237837] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.242144] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.243095] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-15T18:34:22.242599] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-15T18:34:22.244179] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-15T18:34:23.466864] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T18:34:23.472234] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-15T18:34:24.145480] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T18:34:24.157823] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-15T18:34:24.225394] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-15T18:34:24.236465] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-15T18:34:24.272943] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-15T18:34:24.283437] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-15T18:34:24.369426] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T18:34:24.376740] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-15T18:34:25.469101] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T18:34:25.475791] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-15T18:34:25.512668] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T18:34:25.533794] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-15T18:34:25.556953] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:34:25.624405] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T18:34:25.714011] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-15T18:34:26.514058] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-15T18:34:26.885820] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T18:34:26.938835] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T18:34:27.090602] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:34:27.313991] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-15T18:34:28.001610] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:34:28.114003] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-15T18:34:28.772115] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T18:34:28.913983] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-15T18:34:29.713966] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-15T18:34:29.920725] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T18:34:30.392731] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T18:34:30.514014] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-15T18:34:31.314027] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-15T18:34:31.364068] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:34:32.084421] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T18:34:32.113957] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-15T18:34:32.789249] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T18:34:32.913996] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-15T18:34:33.714014] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-15T18:34:33.783497] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T18:34:34.273300] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:34:34.513985] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-15T18:34:35.314007] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-15T18:34:35.701566] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T18:34:36.114004] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-15T18:34:36.158442] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T18:34:36.483204] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:34:36.914005] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-15T18:34:37.713967] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-15T18:34:37.765090] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:34:38.154864] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T18:34:38.514044] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-15T18:34:39.314041] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-15T18:34:39.394708] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T18:34:39.873980] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T18:34:40.114011] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-15T18:34:40.804594] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T18:34:40.913962] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-15T18:34:41.714034] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-15T18:34:41.768825] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T18:34:42.432494] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:34:42.513999] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-15T18:34:42.927629] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:34:43.314047] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-15T18:34:43.916381] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:34:44.114022] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-15T18:34:44.914027] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-15T18:34:44.975136] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:34:45.539504] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:34:45.714060] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-15T18:34:46.403448] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T18:34:46.513967] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-15T18:34:46.958521] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:34:46.962136] [INFO ] [REMOTE ] ECAT: Full fetch complete (43054 records). [2025-10-15T18:34:46.962217] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-15T18:34:47.319180] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-15T18:34:47.365806] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-15T18:34:47.365878] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-15T18:34:47.366531] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-15T18:34:47.366573] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-15T18:34:47.367454] [DEBUG] [LOCAL ] ECAT: Trimmed 43054 records to 29496 (keeping 200 days of data) [2025-10-15T18:34:47.550687] [DEBUG] [LOCAL ] ECAT: Primary data saved (29496 records). [2025-10-15T18:34:47.550832] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-15T18:34:47.550930] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. ECAT took 28.4s. Estimated remaining: 3h 54m 47s. Rate: 7.2 symbols/min [2025-10-15T18:34:47.736879] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:47.776160] [DEBUG] [LOCAL ] ECC: Loaded 43220 existing records from primary storage. [2025-10-15T18:34:47.776443] [INFO ] [MAIN ] ECC: Loaded 43220 existing records. [2025-10-15T18:34:47.967126] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:47.967568] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-15T18:34:47.967726] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-15T18:34:47.968025] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-15T18:34:47.968085] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-15T18:34:48.093716] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T18:34:48.119082] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-15T18:34:48.353155] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:48.913964] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-15T18:34:49.078776] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T18:34:49.714033] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-15T18:34:49.750433] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:34:50.513963] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-15T18:34:50.554577] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:34:51.283450] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T18:34:51.291515] [INFO ] [REMOTE ] EBS: Full fetch complete (67445 records). [2025-10-15T18:34:51.291712] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-15T18:34:51.320906] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-15T18:34:51.684849] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-15T18:34:51.684928] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-15T18:34:51.685820] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-15T18:34:51.685881] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-15T18:34:51.687078] [DEBUG] [LOCAL ] EBS: Trimmed 67445 records to 46759 (keeping 200 days of data) [2025-10-15T18:34:51.970459] [DEBUG] [LOCAL ] EBS: Primary data saved (46759 records). [2025-10-15T18:34:51.970579] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-15T18:34:51.970967] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. EBS took 32.9s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-15T18:34:52.122372] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-15T18:34:52.139438] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:52.139616] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-15T18:34:52.140397] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-15T18:34:52.140525] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-15T18:34:52.140718] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-15T18:34:52.140783] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-15T18:34:52.140826] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-15T18:34:52.364620] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:34:52.462164] [INFO ] [REMOTE ] EC: Full fetch complete (71944 records). [2025-10-15T18:34:52.464449] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-15T18:34:52.635547] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:52.923726] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-15T18:34:52.947013] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-15T18:34:52.947105] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-15T18:34:52.948307] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-15T18:34:52.948520] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-15T18:34:52.976333] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:34:52.975133] [DEBUG] [LOCAL ] EC: Trimmed 71944 records to 49000 (keeping 200 days of data) [2025-10-15T18:34:53.266038] [DEBUG] [LOCAL ] EC: Primary data saved (49000 records). [2025-10-15T18:34:53.266162] [INFO ] [MAIN ] EC: Full history saved. [2025-10-15T18:34:53.266249] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EC took 34.1s. Estimated remaining: 3h 54m 3s. Rate: 7.2 symbols/min [2025-10-15T18:34:53.435810] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:53.440433] [DEBUG] [LOCAL ] ECCU: Loaded 2215 existing records from primary storage. [2025-10-15T18:34:53.440640] [INFO ] [MAIN ] ECCU: Loaded 2215 existing records. [2025-10-15T18:34:53.618603] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:53.618854] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-15T18:34:53.619078] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-15T18:34:53.619247] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-15T18:34:53.619332] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-15T18:34:53.690041] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:34:53.714076] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-15T18:34:53.801866] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:34:54.043506] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:54.514006] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-15T18:34:55.058330] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T18:34:55.314024] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-15T18:34:55.400547] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T18:34:55.407463] [INFO ] [REMOTE ] EBR: Full fetch complete (62619 records). [2025-10-15T18:34:55.407564] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-15T18:34:55.806771] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-15T18:34:55.806845] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-15T18:34:55.807632] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-15T18:34:55.807740] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-15T18:34:55.808959] [DEBUG] [LOCAL ] EBR: Trimmed 62619 records to 43297 (keeping 200 days of data) [2025-10-15T18:34:56.077469] [DEBUG] [LOCAL ] EBR: Primary data saved (43297 records). [2025-10-15T18:34:56.077610] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-15T18:34:56.077747] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EBR took 37.0s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-15T18:34:56.119113] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-15T18:34:56.261204] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:56.261396] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-15T18:34:56.261433] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-15T18:34:56.261541] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-15T18:34:56.261582] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-15T18:34:56.261623] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-15T18:34:56.261686] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-15T18:34:56.642541] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:56.759943] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:34:56.866455] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:34:56.913957] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-15T18:34:57.714007] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-15T18:34:58.153592] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T18:34:58.497547] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:34:58.513959] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-15T18:34:59.314014] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-15T18:34:59.653141] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T18:35:00.113991] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-15T18:35:00.198695] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:35:00.451833] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T18:35:00.914056] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-15T18:35:01.337067] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T18:35:01.714009] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-15T18:35:02.018590] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-15T18:35:02.514003] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-15T18:35:02.892658] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-15T18:35:03.313991] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-15T18:35:03.691638] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-15T18:35:04.114025] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-15T18:35:04.686773] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T18:35:04.913989] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-15T18:35:05.414357] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T18:35:05.714001] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-15T18:35:05.999719] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-15T18:35:06.513993] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-15T18:35:06.992219] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T18:35:07.314004] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-15T18:35:08.114114] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-15T18:35:08.594587] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T18:35:08.914028] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-15T18:35:09.031699] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:35:09.249812] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:35:09.714029] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-15T18:35:10.267956] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T18:35:10.268691] [INFO ] [REMOTE ] ECCW: Full fetch complete (1413 records). [2025-10-15T18:35:10.268759] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-15T18:35:10.269153] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:35:10.269232] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:10.269273] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:10.269323] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-15T18:35:10.269399] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-15T18:35:10.269434] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-15T18:35:10.269472] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-15T18:35:10.269522] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCW took 14.2s. Estimated remaining: 3h 53m 47s. Rate: 7.2 symbols/min [2025-10-15T18:35:10.431822] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:10.431999] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-15T18:35:10.432053] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-15T18:35:10.432162] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-15T18:35:10.432203] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-15T18:35:10.432242] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-15T18:35:10.432274] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-15T18:35:10.519125] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-15T18:35:10.777959] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:11.314045] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-15T18:35:11.646223] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T18:35:12.029331] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:35:12.113949] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-15T18:35:12.914018] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-15T18:35:13.679015] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T18:35:13.713989] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-15T18:35:14.205567] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-15T18:35:14.256458] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:35:14.513990] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-15T18:35:14.869052] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T18:35:15.314003] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-15T18:35:16.113996] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-15T18:35:16.552933] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:35:16.914081] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-15T18:35:17.061786] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:35:17.492269] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T18:35:17.714025] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-15T18:35:18.514001] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-15T18:35:19.119954] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T18:35:19.313979] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-15T18:35:19.422940] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:35:19.604093] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T18:35:20.113990] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-15T18:35:20.631785] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T18:35:20.632502] [INFO ] [REMOTE ] ECCC: Full fetch complete (1302 records). [2025-10-15T18:35:20.632570] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-15T18:35:20.632929] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:35:20.633008] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:20.633050] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:20.633087] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-15T18:35:20.633139] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-15T18:35:20.633173] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-15T18:35:20.633210] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-15T18:35:20.633261] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCC took 28.7s. Estimated remaining: 3h 53m 44s. Rate: 7.2 symbols/min [2025-10-15T18:35:20.803542] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:20.835614] [DEBUG] [LOCAL ] ECG: Loaded 33259 existing records from primary storage. [2025-10-15T18:35:20.835907] [INFO ] [MAIN ] ECG: Loaded 33259 existing records. [2025-10-15T18:35:20.919111] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-15T18:35:21.026323] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:21.026526] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-15T18:35:21.026574] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-15T18:35:21.027235] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-15T18:35:21.027312] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-15T18:35:21.437691] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:21.589388] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T18:35:21.713994] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-15T18:35:22.514045] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-15T18:35:22.941002] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:35:23.314036] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-15T18:35:23.338539] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T18:35:24.113985] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-15T18:35:24.917688] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-15T18:35:24.919435] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:35:24.924873] [INFO ] [REMOTE ] ECC: Full fetch complete (61004 records). [2025-10-15T18:35:24.924963] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-15T18:35:24.925665] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:35:24.925744] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:24.925786] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:24.925825] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-15T18:35:24.925905] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-15T18:35:24.926153] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-10-15T18:35:24.926299] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-10-15T18:35:24.927189] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECC took 37.4s. Estimated remaining: 3h 53m 25s. Rate: 7.2 symbols/min [2025-10-15T18:35:25.102635] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:25.155033] [DEBUG] [LOCAL ] ECL: Loaded 46660 existing records from primary storage. [2025-10-15T18:35:25.155384] [INFO ] [MAIN ] ECL: Loaded 46660 existing records. [2025-10-15T18:35:25.331959] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:25.332174] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-15T18:35:25.332231] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-15T18:35:25.332621] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-15T18:35:25.332712] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-15T18:35:25.433367] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T18:35:25.720067] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T18:35:25.715944] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-15T18:35:25.730888] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:25.981254] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-15T18:35:26.514001] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-15T18:35:26.917427] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T18:35:27.313997] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-15T18:35:28.113993] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-15T18:35:28.509624] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T18:35:28.913990] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-15T18:35:28.956507] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:35:29.343091] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T18:35:29.714030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-15T18:35:30.098758] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-15T18:35:30.514049] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-15T18:35:31.313994] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-15T18:35:31.951359] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T18:35:32.114024] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-15T18:35:32.501524] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:35:32.735805] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:35:32.913992] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-15T18:35:33.341560] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T18:35:33.714082] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-15T18:35:34.514017] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-15T18:35:34.997707] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T18:35:35.035756] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:35:35.314048] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-15T18:35:35.638941] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T18:35:36.114022] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-15T18:35:36.914076] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-15T18:35:37.682727] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:35:37.713950] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-15T18:35:38.513983] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-15T18:35:38.692099] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:35:38.934166] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:35:39.314017] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-15T18:35:39.568736] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T18:35:39.752534] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T18:35:40.114026] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-15T18:35:40.607353] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:35:40.608160] [INFO ] [REMOTE ] ECCU: Full fetch complete (4374 records). [2025-10-15T18:35:40.608228] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-15T18:35:40.922384] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-15T18:35:40.965486] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-15T18:35:40.965575] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-15T18:35:40.965784] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-15T18:35:40.965846] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-15T18:35:40.966295] [DEBUG] [LOCAL ] ECCU: Trimmed 4374 records to 2218 (keeping 200 days of data) [2025-10-15T18:35:40.980432] [DEBUG] [LOCAL ] ECCU: Primary data saved (2218 records). [2025-10-15T18:35:40.980491] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-15T18:35:40.980561] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCU took 47.7s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-15T18:35:41.150959] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:41.170598] [DEBUG] [LOCAL ] ECO: Loaded 18316 existing records from primary storage. [2025-10-15T18:35:41.170931] [INFO ] [MAIN ] ECO: Loaded 18316 existing records. [2025-10-15T18:35:41.340424] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:41.340596] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-15T18:35:41.340660] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-15T18:35:41.340843] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-15T18:35:41.340881] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-15T18:35:41.684032] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:41.714013] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-15T18:35:42.388892] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T18:35:42.419042] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T18:35:42.514036] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-15T18:35:42.932582] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-15T18:35:43.314000] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-15T18:35:43.749963] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T18:35:43.750749] [INFO ] [REMOTE ] ECCX: Full fetch complete (1455 records). [2025-10-15T18:35:43.750819] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-15T18:35:43.958346] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-15T18:35:43.958625] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:43.958722] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:43.958794] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-15T18:35:43.958877] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-15T18:35:43.958935] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-15T18:35:43.958980] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-15T18:35:43.959037] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECCX took 33.7s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-15T18:35:44.126860] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-15T18:35:44.130324] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:44.171510] [DEBUG] [LOCAL ] ECVT: Loaded 43323 existing records from primary storage. [2025-10-15T18:35:44.171869] [INFO ] [MAIN ] ECVT: Loaded 43323 existing records. [2025-10-15T18:35:44.354961] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:44.355232] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-15T18:35:44.355281] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-15T18:35:44.355488] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-15T18:35:44.355549] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-15T18:35:44.712726] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:44.914003] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-15T18:35:45.454373] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:35:45.713998] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-15T18:35:46.513979] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-15T18:35:46.628847] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T18:35:47.313972] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-15T18:35:47.406553] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T18:35:47.773523] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T18:35:48.114052] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-15T18:35:48.896454] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T18:35:48.913940] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-15T18:35:49.714020] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-15T18:35:49.894801] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:35:49.950209] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T18:35:50.514004] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-15T18:35:50.929048] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T18:35:51.314028] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-15T18:35:51.868220] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T18:35:52.114007] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-15T18:35:52.384911] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:35:52.913974] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-15T18:35:53.690249] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T18:35:53.713950] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-15T18:35:54.296409] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:35:54.514047] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-15T18:35:54.936320] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:35:55.314009] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-15T18:35:55.935168] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:35:56.114007] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-15T18:35:56.525699] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:35:56.919145] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-15T18:35:56.925969] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T18:35:57.714006] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-15T18:35:58.513993] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-15T18:35:58.587018] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T18:35:58.758887] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T18:35:59.314029] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-15T18:35:59.687414] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T18:35:59.691398] [INFO ] [REMOTE ] ECG: Full fetch complete (50981 records). [2025-10-15T18:35:59.691503] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-15T18:36:00.060671] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-15T18:36:00.060766] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-15T18:36:00.061488] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-15T18:36:00.061530] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-15T18:36:00.062629] [DEBUG] [LOCAL ] ECG: Trimmed 50981 records to 33179 (keeping 200 days of data) [2025-10-15T18:36:00.119131] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-15T18:36:00.258337] [DEBUG] [LOCAL ] ECG: Primary data saved (33179 records). [2025-10-15T18:36:00.258488] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-15T18:36:00.258816] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECG took 39.6s. Estimated remaining: 3h 53m 26s. Rate: 7.2 symbols/min [2025-10-15T18:36:00.421594] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:00.472001] [DEBUG] [LOCAL ] ED: Loaded 52685 existing records from primary storage. [2025-10-15T18:36:00.472301] [INFO ] [MAIN ] ED: Loaded 52685 existing records. [2025-10-15T18:36:00.649439] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:00.649684] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-15T18:36:00.649740] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-15T18:36:00.649953] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-15T18:36:00.650007] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-15T18:36:00.919099] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-15T18:36:01.003017] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:01.029524] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:36:01.415048] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T18:36:01.714026] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-15T18:36:02.514013] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-15T18:36:02.750993] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:36:03.268752] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T18:36:03.313960] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-15T18:36:04.012613] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-15T18:36:04.034113] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T18:36:04.113971] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-15T18:36:04.914007] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-15T18:36:05.714013] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-15T18:36:05.774934] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T18:36:06.218568] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T18:36:06.224696] [INFO ] [REMOTE ] ECL: Full fetch complete (68201 records). [2025-10-15T18:36:06.224814] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-15T18:36:06.519829] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-15T18:36:06.621153] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-15T18:36:06.621230] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-15T18:36:06.622106] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-15T18:36:06.622169] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-15T18:36:06.623498] [DEBUG] [LOCAL ] ECL: Trimmed 68201 records to 46668 (keeping 200 days of data) [2025-10-15T18:36:06.965703] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T18:36:06.976005] [DEBUG] [LOCAL ] ECL: Primary data saved (46668 records). [2025-10-15T18:36:06.976218] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-15T18:36:06.977159] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECL took 42.0s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-15T18:36:07.143554] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:07.170054] [DEBUG] [LOCAL ] EDD: Loaded 26812 existing records from primary storage. [2025-10-15T18:36:07.170323] [INFO ] [MAIN ] EDD: Loaded 26812 existing records. [2025-10-15T18:36:07.315105] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-15T18:36:07.352504] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:07.352697] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-15T18:36:07.352754] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-15T18:36:07.353041] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-15T18:36:07.353099] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-15T18:36:07.705219] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:07.900924] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:36:08.113980] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-15T18:36:08.554584] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:36:08.914068] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-15T18:36:09.472179] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T18:36:09.714084] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-15T18:36:10.427210] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:36:10.514009] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-15T18:36:10.807920] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T18:36:11.314002] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-15T18:36:12.115228] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-15T18:36:12.133739] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T18:36:12.135805] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T18:36:12.913999] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-15T18:36:13.104021] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T18:36:13.106381] [INFO ] [REMOTE ] ECO: Full fetch complete (28374 records). [2025-10-15T18:36:13.106463] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-15T18:36:13.106936] [FATAL] [VALIDATOR ] ECO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:36:13.107017] [FATAL] [MAIN ] ECO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:36:13.107059] [WARN ] [MAIN ] ECO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:36:13.107116] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-15T18:36:13.107170] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-10-15T18:36:13.107204] [INFO ] [LOCAL ] ECO: Starting deletion of derivative data. [2025-10-15T18:36:13.107378] [DEBUG] [LOCAL ] ECO: Deleted derivative data file. [2025-10-15T18:36:13.107464] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECO took 32.1s. Estimated remaining: 3h 52m 60s. Rate: 7.2 symbols/min [2025-10-15T18:36:13.278129] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:13.292063] [DEBUG] [LOCAL ] EDF: Loaded 13096 existing records from primary storage. [2025-10-15T18:36:13.292281] [INFO ] [MAIN ] EDF: Loaded 13096 existing records. [2025-10-15T18:36:13.491033] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:13.491227] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-15T18:36:13.491272] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-15T18:36:13.491449] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-15T18:36:13.491504] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-15T18:36:13.720540] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-15T18:36:13.846520] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:14.513984] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-15T18:36:14.941989] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T18:36:14.979063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T18:36:15.313992] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-15T18:36:15.717181] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:36:16.113994] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-15T18:36:16.914001] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-15T18:36:17.192333] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:36:17.349213] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T18:36:17.714017] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-15T18:36:18.416514] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:36:18.514050] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-15T18:36:19.313995] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-15T18:36:19.448881] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T18:36:19.874319] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:36:20.113965] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-15T18:36:20.498291] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T18:36:20.714464] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T18:36:20.913983] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-15T18:36:21.713973] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-15T18:36:22.253148] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:36:22.514120] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-15T18:36:23.313969] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-15T18:36:23.540184] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:36:24.113963] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-15T18:36:24.149248] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T18:36:24.167211] [INFO ] [REMOTE ] ECVT: Full fetch complete (60199 records). [2025-10-15T18:36:24.170262] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T18:36:24.169700] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-15T18:36:24.557475] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-15T18:36:24.557564] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-15T18:36:24.558392] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-15T18:36:24.558453] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-15T18:36:24.559620] [DEBUG] [LOCAL ] ECVT: Trimmed 60199 records to 43302 (keeping 200 days of data) [2025-10-15T18:36:24.796551] [DEBUG] [LOCAL ] ECVT: Primary data saved (43302 records). [2025-10-15T18:36:24.796698] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-15T18:36:24.796788] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECVT took 40.8s. Estimated remaining: 3h 52m 59s. Rate: 7.2 symbols/min [2025-10-15T18:36:24.919091] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-15T18:36:24.963599] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:24.981778] [DEBUG] [LOCAL ] EDN: Loaded 18885 existing records from primary storage. [2025-10-15T18:36:24.982004] [INFO ] [MAIN ] EDN: Loaded 18885 existing records. [2025-10-15T18:36:25.152958] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:25.153177] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-15T18:36:25.153223] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-15T18:36:25.153369] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-15T18:36:25.153405] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-15T18:36:25.511561] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:25.713968] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-15T18:36:25.728748] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T18:36:26.183440] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T18:36:26.513987] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-15T18:36:27.117412] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:36:27.313958] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-15T18:36:28.113949] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-15T18:36:28.219722] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:36:28.307314] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T18:36:28.914020] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-15T18:36:29.115820] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:36:29.714050] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-15T18:36:30.513988] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-15T18:36:30.570802] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:36:31.240871] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T18:36:31.314016] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-15T18:36:31.487168] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T18:36:32.114032] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-15T18:36:32.690806] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:36:32.913994] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-15T18:36:33.095206] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:36:33.714006] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-15T18:36:34.052185] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T18:36:34.514074] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-15T18:36:35.313959] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-15T18:36:35.347020] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T18:36:35.420127] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:36:35.425925] [INFO ] [REMOTE ] ED: Full fetch complete (76057 records). [2025-10-15T18:36:35.426048] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-15T18:36:35.426880] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:36:35.426982] [FATAL] [MAIN ] ED: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:36:35.427030] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:36:35.427076] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-15T18:36:35.427132] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-10-15T18:36:35.427166] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-10-15T18:36:35.427342] [DEBUG] [LOCAL ] ED: Deleted derivative data file. [2025-10-15T18:36:35.427694] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. ED took 35.2s. Estimated remaining: 3h 52m 57s. Rate: 7.2 symbols/min [2025-10-15T18:36:35.602350] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:35.643450] [DEBUG] [LOCAL ] EDU: Loaded 44755 existing records from primary storage. [2025-10-15T18:36:35.643758] [INFO ] [MAIN ] EDU: Loaded 44755 existing records. [2025-10-15T18:36:35.817075] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:35.817272] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-15T18:36:35.817320] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-15T18:36:35.817637] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-15T18:36:35.817741] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-15T18:36:36.117557] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-15T18:36:36.182295] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:36.193470] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T18:36:36.914009] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-15T18:36:37.474014] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:36:37.554814] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T18:36:37.714046] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-15T18:36:38.514040] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-15T18:36:38.846237] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:36:38.850108] [INFO ] [REMOTE ] EDD: Full fetch complete (38562 records). [2025-10-15T18:36:38.850236] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-15T18:36:39.266174] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-15T18:36:39.266305] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-15T18:36:39.267384] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-15T18:36:39.267489] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-15T18:36:39.268546] [DEBUG] [LOCAL ] EDD: Trimmed 38562 records to 26779 (keeping 200 days of data) [2025-10-15T18:36:39.330988] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-15T18:36:39.470150] [DEBUG] [LOCAL ] EDD: Primary data saved (26779 records). [2025-10-15T18:36:39.470313] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-15T18:36:39.470415] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. EDD took 32.5s. Estimated remaining: 3h 52m 38s. Rate: 7.2 symbols/min [2025-10-15T18:36:39.604985] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T18:36:39.686469] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:39.717414] [DEBUG] [LOCAL ] EE: Loaded 32960 existing records from primary storage. [2025-10-15T18:36:39.717736] [INFO ] [MAIN ] EE: Loaded 32960 existing records. [2025-10-15T18:36:39.891263] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:39.891474] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-15T18:36:39.891520] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-15T18:36:39.892108] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-15T18:36:39.892165] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-15T18:36:40.125777] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-15T18:36:40.247800] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:40.914075] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-15T18:36:41.189864] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T18:36:41.190508] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:36:41.650833] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T18:36:41.713970] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-15T18:36:42.504183] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T18:36:42.513995] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-15T18:36:43.315173] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-15T18:36:43.317415] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:36:44.114051] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-15T18:36:44.194257] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T18:36:44.914051] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-15T18:36:45.713982] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-15T18:36:45.732910] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:36:45.734669] [INFO ] [REMOTE ] EDF: Full fetch complete (20418 records). [2025-10-15T18:36:45.734742] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-15T18:36:45.990180] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T18:36:46.140796] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-15T18:36:46.140888] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-15T18:36:46.141397] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-15T18:36:46.141458] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-15T18:36:46.142052] [DEBUG] [LOCAL ] EDF: Trimmed 20418 records to 13052 (keeping 200 days of data) [2025-10-15T18:36:46.216294] [DEBUG] [LOCAL ] EDF: Primary data saved (13052 records). [2025-10-15T18:36:46.216420] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-15T18:36:46.216497] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDF took 33.1s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-15T18:36:46.383055] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:46.383241] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-15T18:36:46.383279] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-15T18:36:46.383411] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-15T18:36:46.383451] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-15T18:36:46.383492] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-15T18:36:46.383523] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-15T18:36:46.519739] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-15T18:36:46.742799] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:46.883936] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T18:36:47.313961] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-15T18:36:47.602900] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T18:36:48.110012] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T18:36:48.114506] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-15T18:36:48.664553] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T18:36:48.913998] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-15T18:36:49.714004] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-15T18:36:49.914875] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:36:50.513999] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-15T18:36:50.545522] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T18:36:51.175294] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T18:36:51.314101] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-15T18:36:51.593023] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-15T18:36:52.114090] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-15T18:36:52.914034] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-15T18:36:53.376788] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T18:36:53.380200] [INFO ] [REMOTE ] EDN: Full fetch complete (30041 records). [2025-10-15T18:36:53.380294] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-15T18:36:53.714741] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-15T18:36:53.764227] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-15T18:36:53.764361] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-15T18:36:53.765095] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-15T18:36:53.765160] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-15T18:36:53.766143] [DEBUG] [LOCAL ] EDN: Trimmed 30041 records to 19013 (keeping 200 days of data) [2025-10-15T18:36:53.882539] [DEBUG] [LOCAL ] EDN: Primary data saved (19013 records). [2025-10-15T18:36:53.882715] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-15T18:36:53.882841] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EDN took 29.1s. Estimated remaining: 3h 52m 16s. Rate: 7.2 symbols/min [2025-10-15T18:36:54.060081] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:54.071696] [DEBUG] [LOCAL ] EEX: Loaded 10260 existing records from primary storage. [2025-10-15T18:36:54.072002] [INFO ] [MAIN ] EEX: Loaded 10260 existing records. [2025-10-15T18:36:54.247763] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:54.247973] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-15T18:36:54.248019] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-15T18:36:54.248327] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-15T18:36:54.248385] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-15T18:36:54.515775] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-15T18:36:54.607226] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:54.709575] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T18:36:54.831966] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:36:55.063798] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T18:36:55.314008] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-15T18:36:56.113998] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-15T18:36:56.716027] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:36:56.914059] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-15T18:36:57.713979] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-15T18:36:57.870209] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:36:57.962785] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T18:36:58.298369] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T18:36:58.513982] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-15T18:36:59.314038] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-15T18:37:00.114022] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-15T18:37:00.264006] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:37:00.720703] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:37:00.842207] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T18:37:00.913964] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-15T18:37:01.714049] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-15T18:37:02.287816] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:37:02.514062] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-15T18:37:02.984666] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T18:37:03.314061] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-15T18:37:03.405585] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T18:37:04.114012] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-15T18:37:04.344266] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T18:37:04.914010] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-15T18:37:05.714084] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-15T18:37:05.768369] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:37:05.883836] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T18:37:06.514035] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-15T18:37:06.863266] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T18:37:07.244120] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T18:37:07.314005] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-15T18:37:07.788526] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T18:37:08.114029] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-15T18:37:08.914008] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-15T18:37:09.207177] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T18:37:09.714079] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-15T18:37:10.181531] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:37:10.514022] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-15T18:37:10.624670] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:37:11.314055] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-15T18:37:11.937236] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:37:12.012157] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T18:37:12.114045] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-15T18:37:12.914041] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-15T18:37:13.357245] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T18:37:13.714001] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-15T18:37:14.479513] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T18:37:14.513988] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-15T18:37:14.982361] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T18:37:14.989590] [INFO ] [REMOTE ] EE: Full fetch complete (44117 records). [2025-10-15T18:37:14.989862] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-15T18:37:15.266241] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T18:37:15.319157] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-15T18:37:15.388799] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-15T18:37:15.388890] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-15T18:37:15.389719] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-15T18:37:15.389782] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-15T18:37:15.390926] [DEBUG] [LOCAL ] EE: Trimmed 44117 records to 32990 (keeping 200 days of data) [2025-10-15T18:37:15.592733] [DEBUG] [LOCAL ] EE: Primary data saved (32990 records). [2025-10-15T18:37:15.592898] [INFO ] [MAIN ] EE: Full history saved. [2025-10-15T18:37:15.593022] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EE took 36.1s. Estimated remaining: 3h 52m 39s. Rate: 7.2 symbols/min [2025-10-15T18:37:15.760737] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:15.760897] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-15T18:37:15.760935] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-15T18:37:15.761044] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-15T18:37:15.761084] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-15T18:37:15.761124] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-15T18:37:15.761199] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-15T18:37:16.024149] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T18:37:16.122617] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:16.122756] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-15T18:37:16.914027] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-15T18:37:16.940105] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T18:37:17.714038] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-15T18:37:18.155235] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T18:37:18.155993] [INFO ] [REMOTE ] EEA: Full fetch complete (3807 records). [2025-10-15T18:37:18.156061] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-15T18:37:18.346032] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T18:37:18.346391] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:37:18.346476] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:37:18.346568] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-15T18:37:18.346680] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-15T18:37:18.346753] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-15T18:37:18.346811] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-15T18:37:18.346871] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EEA took 32.1s. Estimated remaining: 3h 52m 18s. Rate: 7.2 symbols/min [2025-10-15T18:37:18.527967] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-15T18:37:18.531611] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:18.549263] [DEBUG] [LOCAL ] EFR: Loaded 15055 existing records from primary storage. [2025-10-15T18:37:18.549520] [INFO ] [MAIN ] EFR: Loaded 15055 existing records. [2025-10-15T18:37:18.759306] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T18:37:18.781445] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:18.782216] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-15T18:37:18.782273] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-15T18:37:18.782691] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-15T18:37:18.782755] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-15T18:37:19.132532] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:19.313986] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-15T18:37:20.114005] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-15T18:37:20.287318] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T18:37:20.520830] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:37:20.914025] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-15T18:37:21.501376] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T18:37:21.514737] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T18:37:21.514858] [INFO ] [REMOTE ] EDU: Full fetch complete (66910 records). [2025-10-15T18:37:21.517915] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-15T18:37:21.719096] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-15T18:37:21.914871] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-15T18:37:21.914948] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-15T18:37:21.915796] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-15T18:37:21.915857] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-15T18:37:21.917090] [DEBUG] [LOCAL ] EDU: Trimmed 66910 records to 44813 (keeping 200 days of data) [2025-10-15T18:37:22.175285] [DEBUG] [LOCAL ] EDU: Primary data saved (44813 records). [2025-10-15T18:37:22.175428] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-15T18:37:22.175817] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EDU took 46.7s. Estimated remaining: 3h 51m 59s. Rate: 7.2 symbols/min [2025-10-15T18:37:22.351895] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:22.366592] [DEBUG] [LOCAL ] EFT: Loaded 13142 existing records from primary storage. [2025-10-15T18:37:22.366887] [INFO ] [MAIN ] EFT: Loaded 13142 existing records. [2025-10-15T18:37:22.521438] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-15T18:37:22.543364] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:22.543873] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-15T18:37:22.543972] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-15T18:37:22.544342] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-15T18:37:22.544399] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-15T18:37:22.904452] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:23.314007] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-15T18:37:23.371628] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T18:37:23.486548] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:37:24.113990] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-15T18:37:24.475591] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T18:37:24.822472] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:37:24.913975] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-15T18:37:25.666621] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T18:37:25.668068] [INFO ] [REMOTE ] EEX: Full fetch complete (18629 records). [2025-10-15T18:37:25.668138] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-15T18:37:25.720702] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-15T18:37:26.024353] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-15T18:37:26.024428] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-15T18:37:26.024779] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-15T18:37:26.024866] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-15T18:37:26.025355] [DEBUG] [LOCAL ] EEX: Trimmed 18629 records to 10208 (keeping 200 days of data) [2025-10-15T18:37:26.085348] [DEBUG] [LOCAL ] EEX: Primary data saved (10208 records). [2025-10-15T18:37:26.085462] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-15T18:37:26.085542] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EEX took 32.2s. Estimated remaining: 3h 51m 40s. Rate: 7.2 symbols/min [2025-10-15T18:37:26.249578] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:26.290846] [DEBUG] [LOCAL ] EFX: Loaded 44621 existing records from primary storage. [2025-10-15T18:37:26.291130] [INFO ] [MAIN ] EFX: Loaded 44621 existing records. [2025-10-15T18:37:26.470627] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:26.471119] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-15T18:37:26.471267] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-15T18:37:26.472229] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-15T18:37:26.472286] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-15T18:37:26.525940] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-15T18:37:26.765448] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T18:37:26.864263] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:27.314025] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-15T18:37:28.114018] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-15T18:37:28.181375] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:37:28.655611] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T18:37:28.914034] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-15T18:37:29.051817] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:37:29.649791] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T18:37:29.714009] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-15T18:37:30.514052] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-15T18:37:31.314044] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-15T18:37:31.501277] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:37:31.503074] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T18:37:32.114036] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-15T18:37:32.914055] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-15T18:37:33.025582] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:37:33.042013] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T18:37:33.684499] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:37:33.714007] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-15T18:37:34.513968] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-15T18:37:34.647295] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:37:35.314068] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-15T18:37:35.371369] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T18:37:36.114014] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-15T18:37:36.913974] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-15T18:37:36.939536] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T18:37:37.232753] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:37:37.714023] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-15T18:37:38.475421] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T18:37:38.509169] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:37:38.515197] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-15T18:37:39.313970] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-15T18:37:39.447251] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T18:37:40.114057] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-15T18:37:40.256592] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:37:40.914028] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-15T18:37:41.713973] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-15T18:37:41.854066] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:37:41.981956] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T18:37:41.984673] [INFO ] [REMOTE ] EFR: Full fetch complete (19402 records). [2025-10-15T18:37:41.984764] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-15T18:37:42.393307] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-15T18:37:42.393445] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-15T18:37:42.394385] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-15T18:37:42.394452] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-15T18:37:42.395159] [DEBUG] [LOCAL ] EFR: Trimmed 19402 records to 15060 (keeping 200 days of data) [2025-10-15T18:37:42.498105] [DEBUG] [LOCAL ] EFR: Primary data saved (15060 records). [2025-10-15T18:37:42.498305] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-15T18:37:42.498405] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFR took 24.2s. Estimated remaining: 3h 51m 51s. Rate: 7.2 symbols/min [2025-10-15T18:37:42.526492] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-15T18:37:42.630442] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:37:42.709121] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:42.746304] [DEBUG] [LOCAL ] EFXT: Loaded 29628 existing records from primary storage. [2025-10-15T18:37:42.746805] [INFO ] [MAIN ] EFXT: Loaded 29628 existing records. [2025-10-15T18:37:42.936907] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:42.937286] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-15T18:37:42.937363] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-15T18:37:42.938115] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-15T18:37:42.938180] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-15T18:37:43.303182] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:43.313967] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-15T18:37:44.114026] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-15T18:37:44.228016] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:37:44.914003] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-15T18:37:44.994122] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:37:45.713981] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-15T18:37:45.781096] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:37:46.312090] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:37:46.514049] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-15T18:37:46.687045] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:37:47.314103] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-15T18:37:48.114192] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-15T18:37:48.114056] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T18:37:48.406836] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:37:48.913984] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-15T18:37:48.985382] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T18:37:49.713989] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-15T18:37:50.513966] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-15T18:37:50.705579] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:37:51.313971] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-15T18:37:51.617099] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T18:37:51.733456] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T18:37:52.114030] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-15T18:37:52.914027] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-15T18:37:53.271918] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:37:53.277679] [INFO ] [REMOTE ] EFC: Full fetch complete (66784 records). [2025-10-15T18:37:53.277790] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-15T18:37:53.705811] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-15T18:37:53.705930] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-15T18:37:53.706833] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-15T18:37:53.706982] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-15T18:37:53.721673] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-15T18:37:53.733147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:37:53.733405] [DEBUG] [LOCAL ] EFC: Trimmed 66784 records to 46431 (keeping 200 days of data) [2025-10-15T18:37:54.024252] [DEBUG] [LOCAL ] EFC: Primary data saved (46431 records). [2025-10-15T18:37:54.024385] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-15T18:37:54.024457] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFC took 38.4s. Estimated remaining: 3h 51m 50s. Rate: 7.2 symbols/min [2025-10-15T18:37:54.192112] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:54.211126] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:37:54.242125] [DEBUG] [LOCAL ] EG: Loaded 27796 existing records from primary storage. [2025-10-15T18:37:54.243064] [INFO ] [MAIN ] EG: Loaded 27796 existing records. [2025-10-15T18:37:54.448251] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:54.448468] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-15T18:37:54.448515] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-15T18:37:54.449103] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-15T18:37:54.449161] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-15T18:37:54.517456] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-15T18:37:54.580506] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T18:37:54.841797] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:55.314070] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-15T18:37:56.100354] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T18:37:56.113943] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-15T18:37:56.913998] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-15T18:37:56.996123] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T18:37:57.005703] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T18:37:57.697437] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T18:37:57.713950] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-15T18:37:58.513998] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-15T18:37:58.604457] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T18:37:58.606688] [INFO ] [REMOTE ] EFT: Full fetch complete (17973 records). [2025-10-15T18:37:58.606767] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-15T18:37:58.965424] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-15T18:37:58.965500] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-15T18:37:58.965844] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-15T18:37:58.965905] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-15T18:37:58.966404] [DEBUG] [LOCAL ] EFT: Trimmed 17973 records to 13087 (keeping 200 days of data) [2025-10-15T18:37:59.043766] [DEBUG] [LOCAL ] EFT: Primary data saved (13087 records). [2025-10-15T18:37:59.043902] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-15T18:37:59.043985] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFT took 36.9s. Estimated remaining: 3h 51m 34s. Rate: 7.2 symbols/min [2025-10-15T18:37:59.207766] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:59.254730] [DEBUG] [LOCAL ] EGO: Loaded 51710 existing records from primary storage. [2025-10-15T18:37:59.255043] [INFO ] [MAIN ] EGO: Loaded 51710 existing records. [2025-10-15T18:37:59.316427] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-15T18:37:59.438107] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:59.438483] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-15T18:37:59.438588] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-15T18:37:59.444678] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-15T18:37:59.453291] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-15T18:37:59.496618] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T18:37:59.802760] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:00.113989] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-15T18:38:00.914059] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-15T18:38:01.121391] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:38:01.603194] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:38:01.713962] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-15T18:38:02.513991] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-15T18:38:02.923628] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:38:03.094864] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:38:03.314021] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-15T18:38:03.739793] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T18:38:04.114001] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-15T18:38:04.914022] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-15T18:38:05.060295] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T18:38:05.714054] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-15T18:38:06.186546] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T18:38:06.514025] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-15T18:38:06.667782] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:38:07.314022] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-15T18:38:07.543478] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:38:08.114009] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-15T18:38:08.614822] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T18:38:08.913989] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-15T18:38:09.465084] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:38:09.713962] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-15T18:38:09.783043] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-15T18:38:09.788838] [INFO ] [REMOTE ] EFX: Full fetch complete (64835 records). [2025-10-15T18:38:09.788949] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-15T18:38:10.165566] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-15T18:38:10.165732] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-15T18:38:10.166572] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-15T18:38:10.166669] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-15T18:38:10.168038] [DEBUG] [LOCAL ] EFX: Trimmed 64835 records to 44637 (keeping 200 days of data) [2025-10-15T18:38:10.276427] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:38:10.465741] [DEBUG] [LOCAL ] EFX: Primary data saved (44637 records). [2025-10-15T18:38:10.465874] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-15T18:38:10.465955] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFX took 44.4s. Estimated remaining: 3h 51m 32s. Rate: 7.2 symbols/min [2025-10-15T18:38:10.519099] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-15T18:38:10.633306] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:10.662474] [DEBUG] [LOCAL ] EGP: Loaded 30391 existing records from primary storage. [2025-10-15T18:38:10.662750] [INFO ] [MAIN ] EGP: Loaded 30391 existing records. [2025-10-15T18:38:10.834431] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:10.834662] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-15T18:38:10.834722] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-15T18:38:10.835310] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-15T18:38:10.835367] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-15T18:38:11.183022] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:11.256299] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T18:38:11.313960] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-15T18:38:11.743064] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:38:11.747261] [INFO ] [REMOTE ] EFXT: Full fetch complete (44286 records). [2025-10-15T18:38:11.747346] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-15T18:38:12.109988] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-15T18:38:12.110067] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-15T18:38:12.110763] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-15T18:38:12.110826] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-15T18:38:12.111815] [DEBUG] [LOCAL ] EFXT: Trimmed 44286 records to 29684 (keeping 200 days of data) [2025-10-15T18:38:12.114037] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-15T18:38:12.284943] [DEBUG] [LOCAL ] EFXT: Primary data saved (29684 records). [2025-10-15T18:38:12.285093] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-15T18:38:12.285177] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EFXT took 29.8s. Estimated remaining: 3h 51m 9s. Rate: 7.2 symbols/min [2025-10-15T18:38:12.453136] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:12.489006] [DEBUG] [LOCAL ] EGY: Loaded 41537 existing records from primary storage. [2025-10-15T18:38:12.489339] [INFO ] [MAIN ] EGY: Loaded 41537 existing records. [2025-10-15T18:38:12.670226] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:12.670489] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-15T18:38:12.670661] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-15T18:38:12.676509] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-15T18:38:12.685736] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-15T18:38:12.719933] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:38:12.919173] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-15T18:38:13.048538] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:13.714028] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-15T18:38:13.765117] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:38:14.223623] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:38:14.514042] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-15T18:38:15.313997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-15T18:38:15.435675] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:38:15.789632] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:38:16.113981] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-15T18:38:16.577316] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T18:38:16.913990] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-15T18:38:17.555305] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:38:17.713992] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-15T18:38:18.273266] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T18:38:18.514011] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-15T18:38:19.314021] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-15T18:38:19.446674] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T18:38:20.080966] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:38:20.113985] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-15T18:38:20.527857] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:38:20.913969] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-15T18:38:21.353326] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T18:38:21.714003] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-15T18:38:22.426742] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:38:22.513993] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-15T18:38:22.746308] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T18:38:23.314058] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-15T18:38:24.114015] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-15T18:38:24.244112] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:38:24.914003] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-15T18:38:24.994239] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T18:38:25.124732] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T18:38:25.127909] [INFO ] [REMOTE ] EG: Full fetch complete (43188 records). [2025-10-15T18:38:25.127984] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-15T18:38:25.488491] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-15T18:38:25.488563] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-15T18:38:25.489246] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-15T18:38:25.489329] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-15T18:38:25.490187] [DEBUG] [LOCAL ] EG: Trimmed 43188 records to 27797 (keeping 200 days of data) [2025-10-15T18:38:25.657761] [DEBUG] [LOCAL ] EG: Primary data saved (27797 records). [2025-10-15T18:38:25.657885] [INFO ] [MAIN ] EG: Full history saved. [2025-10-15T18:38:25.657962] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EG took 31.6s. Estimated remaining: 3h 51m 12s. Rate: 7.2 symbols/min [2025-10-15T18:38:25.721024] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-15T18:38:25.833248] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:25.860922] [DEBUG] [LOCAL ] EHAB: Loaded 29326 existing records from primary storage. [2025-10-15T18:38:25.861174] [INFO ] [MAIN ] EHAB: Loaded 29326 existing records. [2025-10-15T18:38:26.031136] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:26.031350] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-15T18:38:26.031404] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-15T18:38:26.031732] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-15T18:38:26.031790] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-15T18:38:26.374397] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:26.513955] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-15T18:38:26.775445] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T18:38:27.066467] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:38:27.314008] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-15T18:38:27.645324] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T18:38:28.114019] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-15T18:38:28.614948] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T18:38:28.914076] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-15T18:38:29.714010] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-15T18:38:29.947738] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:38:30.380328] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:38:30.513963] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-15T18:38:30.894999] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:38:31.313992] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-15T18:38:31.980495] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:38:32.113981] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-15T18:38:32.778385] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:38:32.914002] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-15T18:38:33.386185] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T18:38:33.714062] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-15T18:38:34.189151] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T18:38:34.514021] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-15T18:38:35.107598] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:38:35.314073] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-15T18:38:36.113993] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-15T18:38:36.137263] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:38:36.378803] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:38:36.914078] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-15T18:38:37.150166] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:38:37.714053] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-15T18:38:38.240343] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T18:38:38.514008] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-15T18:38:38.979025] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T18:38:38.982847] [INFO ] [REMOTE ] EGP: Full fetch complete (45568 records). [2025-10-15T18:38:38.982974] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-15T18:38:39.323764] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-15T18:38:39.376570] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-15T18:38:39.376799] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-15T18:38:39.377498] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-15T18:38:39.377541] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-15T18:38:39.378676] [DEBUG] [LOCAL ] EGP: Trimmed 45568 records to 30418 (keeping 200 days of data) [2025-10-15T18:38:39.579461] [DEBUG] [LOCAL ] EGP: Primary data saved (30418 records). [2025-10-15T18:38:39.579711] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-15T18:38:39.579817] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGP took 29.1s. Estimated remaining: 3h 51m 17s. Rate: 7.2 symbols/min [2025-10-15T18:38:39.760391] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:39.801010] [DEBUG] [LOCAL ] EHC: Loaded 40988 existing records from primary storage. [2025-10-15T18:38:39.801308] [INFO ] [MAIN ] EHC: Loaded 40988 existing records. [2025-10-15T18:38:39.996772] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:39.997023] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-15T18:38:39.997071] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-15T18:38:39.997437] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-15T18:38:39.997507] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-15T18:38:40.115563] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-15T18:38:40.169157] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:38:40.379101] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:40.811513] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T18:38:40.913996] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-15T18:38:41.156989] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T18:38:41.714028] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-15T18:38:42.513986] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-15T18:38:42.710793] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:38:42.940697] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T18:38:43.314118] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-15T18:38:44.114015] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-15T18:38:44.417747] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T18:38:44.544006] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T18:38:44.914023] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-15T18:38:45.156746] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T18:38:45.713999] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-15T18:38:46.514041] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-15T18:38:46.726235] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T18:38:47.125984] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T18:38:47.314087] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-15T18:38:47.741777] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T18:38:48.113974] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-15T18:38:48.802542] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:38:48.914016] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-15T18:38:49.628566] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T18:38:49.633481] [INFO ] [REMOTE ] EGY: Full fetch complete (61085 records). [2025-10-15T18:38:49.633571] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-15T18:38:49.723446] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-15T18:38:50.017892] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-15T18:38:50.017975] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-15T18:38:50.019166] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-15T18:38:50.019243] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-15T18:38:50.020475] [DEBUG] [LOCAL ] EGY: Trimmed 61085 records to 41558 (keeping 200 days of data) [2025-10-15T18:38:50.259409] [DEBUG] [LOCAL ] EGY: Primary data saved (41558 records). [2025-10-15T18:38:50.259543] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-15T18:38:50.259623] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGY took 38.0s. Estimated remaining: 3h 51m 14s. Rate: 7.2 symbols/min [2025-10-15T18:38:50.436555] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:50.448886] [DEBUG] [LOCAL ] EHI: Loaded 10642 existing records from primary storage. [2025-10-15T18:38:50.449150] [INFO ] [MAIN ] EHI: Loaded 10642 existing records. [2025-10-15T18:38:50.514172] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-15T18:38:50.667938] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:38:50.672177] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:50.680871] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-15T18:38:50.681456] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-15T18:38:50.682444] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-15T18:38:50.682509] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-15T18:38:51.041904] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:51.314045] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-15T18:38:51.588632] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T18:38:51.595226] [INFO ] [REMOTE ] EGO: Full fetch complete (74323 records). [2025-10-15T18:38:51.595373] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-15T18:38:51.987262] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-15T18:38:51.987554] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-15T18:38:51.988660] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-15T18:38:51.988824] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-15T18:38:52.010303] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:38:52.017278] [DEBUG] [LOCAL ] EGO: Trimmed 74323 records to 51726 (keeping 200 days of data) [2025-10-15T18:38:52.114191] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-15T18:38:52.341631] [DEBUG] [LOCAL ] EGO: Primary data saved (51726 records). [2025-10-15T18:38:52.341791] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-15T18:38:52.342272] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EGO took 53.3s. Estimated remaining: 3h 50m 51s. Rate: 7.2 symbols/min [2025-10-15T18:38:52.522582] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:52.546785] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T18:38:52.558813] [DEBUG] [LOCAL ] EIC: Loaded 22893 existing records from primary storage. [2025-10-15T18:38:52.559069] [INFO ] [MAIN ] EIC: Loaded 22893 existing records. [2025-10-15T18:38:52.733271] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:52.733514] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-15T18:38:52.733563] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-15T18:38:52.733924] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-15T18:38:52.733991] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-15T18:38:52.918009] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-15T18:38:53.097108] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:53.714002] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-15T18:38:53.856278] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T18:38:54.012704] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T18:38:54.513998] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-15T18:38:54.964722] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:38:55.314065] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-15T18:38:56.080355] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:38:56.114000] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-15T18:38:56.454594] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T18:38:56.913991] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-15T18:38:57.481780] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:38:57.714023] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-15T18:38:57.997716] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T18:38:58.000839] [INFO ] [REMOTE ] EHAB: Full fetch complete (40989 records). [2025-10-15T18:38:58.000916] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-15T18:38:58.367285] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-15T18:38:58.367381] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-15T18:38:58.368093] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-15T18:38:58.368154] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-15T18:38:58.369061] [DEBUG] [LOCAL ] EHAB: Trimmed 40989 records to 29337 (keeping 200 days of data) [2025-10-15T18:38:58.515083] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-15T18:38:58.531196] [DEBUG] [LOCAL ] EHAB: Primary data saved (29337 records). [2025-10-15T18:38:58.531287] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-15T18:38:58.531358] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHAB took 32.9s. Estimated remaining: 3h 50m 38s. Rate: 7.2 symbols/min [2025-10-15T18:38:58.717829] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:58.717992] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-15T18:38:58.718028] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-15T18:38:58.718164] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-15T18:38:58.718235] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-15T18:38:58.718303] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-15T18:38:58.718343] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-15T18:38:59.082862] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:59.160954] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T18:38:59.267464] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T18:38:59.313956] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-15T18:39:00.114022] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-15T18:39:00.418731] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T18:39:00.568765] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T18:39:00.914043] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-15T18:39:01.714058] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-15T18:39:02.143805] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T18:39:02.244621] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T18:39:02.513994] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-15T18:39:02.770567] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-15T18:39:03.314004] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-15T18:39:04.114000] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-15T18:39:04.436945] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-15T18:39:04.475538] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:39:04.914008] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-15T18:39:05.696859] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T18:39:05.713983] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-15T18:39:06.487705] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T18:39:06.514020] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-15T18:39:07.314039] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-15T18:39:07.352085] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T18:39:08.114021] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-15T18:39:08.478209] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T18:39:08.914069] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-15T18:39:09.260311] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T18:39:09.714016] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-15T18:39:09.746545] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:39:10.068438] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T18:39:10.514029] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-15T18:39:11.313999] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-15T18:39:12.001143] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T18:39:12.114031] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-15T18:39:12.380182] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:39:12.533395] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:39:12.914004] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-15T18:39:13.713996] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-15T18:39:14.277504] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:39:14.290935] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:39:14.296942] [INFO ] [REMOTE ] EHC: Full fetch complete (58563 records). [2025-10-15T18:39:14.297088] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-15T18:39:14.298045] [FATAL] [VALIDATOR ] EHC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:39:14.298165] [FATAL] [MAIN ] EHC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:14.298237] [WARN ] [MAIN ] EHC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:14.298303] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-15T18:39:14.298387] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-15T18:39:14.298427] [INFO ] [LOCAL ] EHC: Starting deletion of derivative data. [2025-10-15T18:39:14.298628] [DEBUG] [LOCAL ] EHC: Deleted derivative data file. [2025-10-15T18:39:14.298792] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHC took 34.7s. Estimated remaining: 3h 50m 47s. Rate: 7.2 symbols/min [2025-10-15T18:39:14.494402] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:14.494579] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-15T18:39:14.494618] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-15T18:39:14.494803] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-15T18:39:14.494852] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-15T18:39:14.494895] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-15T18:39:14.494926] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-15T18:39:14.519069] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-15T18:39:14.853629] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:15.313987] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-15T18:39:15.791424] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T18:39:15.810114] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T18:39:16.113994] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-15T18:39:16.439668] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-15T18:39:16.913994] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-15T18:39:17.308432] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T18:39:17.309250] [INFO ] [REMOTE ] EICA: Full fetch complete (1283 records). [2025-10-15T18:39:17.309320] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-15T18:39:17.485866] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-15T18:39:17.486033] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:17.486079] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:17.486120] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-15T18:39:17.486176] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-15T18:39:17.486211] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-15T18:39:17.486250] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-15T18:39:17.486304] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EICA took 19.0s. Estimated remaining: 3h 50m 26s. Rate: 7.2 symbols/min [2025-10-15T18:39:17.659148] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:17.659346] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-15T18:39:17.659392] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-15T18:39:17.659502] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-15T18:39:17.659541] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-15T18:39:17.659581] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-15T18:39:17.659611] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-15T18:39:17.721051] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-15T18:39:18.018749] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:18.513996] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-15T18:39:18.759926] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T18:39:18.956140] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T18:39:19.314025] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-15T18:39:19.858714] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T18:39:20.113990] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-15T18:39:20.601202] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T18:39:20.914073] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-15T18:39:21.556833] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T18:39:21.714007] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-15T18:39:22.504142] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T18:39:22.513948] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-15T18:39:23.276350] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:39:23.313969] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-15T18:39:24.086918] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T18:39:24.089951] [INFO ] [REMOTE ] EHI: Full fetch complete (16104 records). [2025-10-15T18:39:24.090050] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-15T18:39:24.121007] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-15T18:39:24.493194] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-15T18:39:24.493279] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-15T18:39:24.493688] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-15T18:39:24.493749] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-15T18:39:24.494273] [DEBUG] [LOCAL ] EHI: Trimmed 16104 records to 10605 (keeping 200 days of data) [2025-10-15T18:39:24.553295] [DEBUG] [LOCAL ] EHI: Primary data saved (10605 records). [2025-10-15T18:39:24.553425] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-15T18:39:24.553504] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EHI took 34.3s. Estimated remaining: 3h 50m 15s. Rate: 7.2 symbols/min [2025-10-15T18:39:24.719020] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:24.739466] [DEBUG] [LOCAL ] EIG: Loaded 20149 existing records from primary storage. [2025-10-15T18:39:24.739754] [INFO ] [MAIN ] EIG: Loaded 20149 existing records. [2025-10-15T18:39:24.843384] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T18:39:24.916813] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-15T18:39:24.921375] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:39:24.921665] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-15T18:39:24.921725] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-15T18:39:24.921993] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-15T18:39:24.922031] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-15T18:39:25.270863] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:25.570988] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:39:25.713986] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-15T18:39:26.398072] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T18:39:26.514023] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-15T18:39:27.314029] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-15T18:39:27.905691] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T18:39:28.114009] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-15T18:39:28.455995] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T18:39:28.914008] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-15T18:39:29.123002] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:39:29.714070] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-15T18:39:30.051761] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:39:30.134393] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:39:30.514012] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-15T18:39:31.092943] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T18:39:31.314100] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-15T18:39:31.753767] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T18:39:32.114008] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-15T18:39:32.463730] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T18:39:32.914066] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-15T18:39:33.713997] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-15T18:39:33.835679] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T18:39:34.470001] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T18:39:34.514028] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-15T18:39:35.313970] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-15T18:39:35.476458] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T18:39:35.479170] [INFO ] [REMOTE ] EIC: Full fetch complete (34403 records). [2025-10-15T18:39:35.479264] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-15T18:39:35.843724] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-15T18:39:35.843804] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-15T18:39:35.844393] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-15T18:39:35.844432] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-15T18:39:35.845175] [DEBUG] [LOCAL ] EIC: Trimmed 34403 records to 22908 (keeping 200 days of data) [2025-10-15T18:39:35.988042] [DEBUG] [LOCAL ] EIC: Primary data saved (22908 records). [2025-10-15T18:39:35.988193] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-15T18:39:35.988286] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 43.6s. Estimated remaining: 3h 50m 14s. Rate: 7.2 symbols/min [2025-10-15T18:39:36.118936] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-15T18:39:36.164553] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:36.213924] [DEBUG] [LOCAL ] EIX: Loaded 53370 existing records from primary storage. [2025-10-15T18:39:36.214310] [INFO ] [MAIN ] EIX: Loaded 53370 existing records. [2025-10-15T18:39:36.330123] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:39:36.414540] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:39:36.414810] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-15T18:39:36.414864] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-15T18:39:36.415189] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-15T18:39:36.415251] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-15T18:39:36.772922] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:36.799815] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T18:39:36.913983] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-15T18:39:37.343025] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:39:37.714049] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-15T18:39:38.195665] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T18:39:38.514015] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-15T18:39:39.314014] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-15T18:39:39.911696] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T18:39:40.114067] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-15T18:39:40.337031] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T18:39:40.815210] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T18:39:40.913982] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-15T18:39:41.560587] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T18:39:41.561982] [INFO ] [REMOTE ] EICC: Full fetch complete (8459 records). [2025-10-15T18:39:41.562050] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-15T18:39:41.562514] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:39:41.562594] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:41.562635] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:41.562724] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-15T18:39:41.562784] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-15T18:39:41.562817] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-15T18:39:41.562855] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-15T18:39:41.562905] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICC took 24.1s. Estimated remaining: 3h 49m 59s. Rate: 7.2 symbols/min [2025-10-15T18:39:41.719985] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-15T18:39:41.746173] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:41.819865] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-15T18:39:41.820453] [INFO ] [MAIN ] EL: Loaded 53376 existing records. [2025-10-15T18:39:42.015734] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:39:42.016045] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-15T18:39:42.016106] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-15T18:39:42.016503] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-15T18:39:42.016560] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-15T18:39:42.381321] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:42.513979] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-15T18:39:42.804551] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-15T18:39:42.837901] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:39:43.314005] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-15T18:39:44.114000] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-15T18:39:44.565069] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T18:39:44.913973] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-15T18:39:45.103500] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T18:39:45.358334] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:39:45.714031] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-15T18:39:46.514009] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-15T18:39:47.030606] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T18:39:47.314039] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-15T18:39:47.532355] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T18:39:47.803478] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:39:47.804527] [INFO ] [REMOTE ] EICB: Full fetch complete (2737 records). [2025-10-15T18:39:47.804595] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-15T18:39:47.985894] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T18:39:47.986091] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:47.986136] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:47.986200] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-15T18:39:47.986279] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-15T18:39:47.986314] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-15T18:39:47.986353] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-15T18:39:47.986408] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EICB took 33.7s. Estimated remaining: 3h 49m 46s. Rate: 7.2 symbols/min [2025-10-15T18:39:48.114032] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-15T18:39:48.913969] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-15T18:39:49.189209] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:39:49.714058] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-15T18:39:50.514079] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-15T18:39:50.550742] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T18:39:50.913436] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T18:39:51.314035] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-15T18:39:52.114076] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-15T18:39:52.336159] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:39:52.407420] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T18:39:52.914016] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-15T18:39:53.714046] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-15T18:39:54.073113] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:39:54.513956] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-15T18:39:54.902523] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:39:54.927698] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T18:39:55.314063] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-15T18:39:56.114058] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-15T18:39:56.522211] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T18:39:56.606175] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:39:56.914001] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-15T18:39:57.713968] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-15T18:39:57.898436] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T18:39:57.931250] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T18:39:58.514050] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-15T18:39:59.314049] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-15T18:39:59.918414] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-15T18:40:00.116434] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-15T18:40:00.120929] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T18:40:00.123964] [INFO ] [REMOTE ] EIG: Full fetch complete (27124 records). [2025-10-15T18:40:00.124087] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-15T18:40:00.600448] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-15T18:40:00.600563] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-15T18:40:00.601287] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-15T18:40:00.601389] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-15T18:40:00.602365] [DEBUG] [LOCAL ] EIG: Trimmed 27124 records to 20221 (keeping 200 days of data) [2025-10-15T18:40:00.754096] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-15T18:40:00.781223] [DEBUG] [LOCAL ] EIG: Primary data saved (20221 records). [2025-10-15T18:40:00.781364] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-15T18:40:00.781447] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EIG took 36.2s. Estimated remaining: 3h 49m 48s. Rate: 7.2 symbols/min [2025-10-15T18:40:00.914020] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-15T18:40:02.325563] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T18:40:02.337085] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-15T18:40:03.304335] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-15T18:40:03.318450] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-15T18:40:04.165332] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:40:04.176301] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-15T18:40:05.176357] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T18:40:05.187831] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-15T18:40:06.284541] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T18:40:06.295376] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-15T18:40:06.761945] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:40:06.774905] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-15T18:40:07.450250] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T18:40:07.456589] [INFO ] [REMOTE ] EIX: Full fetch complete (77401 records). [2025-10-15T18:40:07.456744] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-15T18:40:07.841360] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-15T18:40:07.841446] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-15T18:40:07.842408] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-15T18:40:07.842473] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-15T18:40:07.843914] [DEBUG] [LOCAL ] EIX: Trimmed 77401 records to 53375 (keeping 200 days of data) [2025-10-15T18:40:08.197715] [DEBUG] [LOCAL ] EIX: Primary data saved (53375 records). [2025-10-15T18:40:08.197938] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-15T18:40:08.198342] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 32.2s. Estimated remaining: 3h 49m 38s. Rate: 7.2 symbols/min [2025-10-15T18:40:08.556695] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-15T18:40:08.568425] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-15T18:40:10.490299] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T18:40:10.501808] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-15T18:40:12.571836] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-15T18:40:12.583465] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-15T18:40:13.466319] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T18:40:13.472665] [INFO ] [REMOTE ] EL: Full fetch complete (77433 records). [2025-10-15T18:40:13.472781] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-15T18:40:13.856434] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-15T18:40:13.856535] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-15T18:40:13.857490] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-15T18:40:13.857580] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-15T18:40:13.859755] [DEBUG] [LOCAL ] EL: Trimmed 77433 records to 53376 (keeping 200 days of data) [2025-10-15T18:40:14.175191] [DEBUG] [LOCAL ] EL: Primary data saved (53376 records). [2025-10-15T18:40:14.175321] [INFO ] [MAIN ] EL: Full history saved. [2025-10-15T18:40:14.176179] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EL took 32.6s. Estimated remaining: 3h 49m 24s. Rate: 7.2 symbols/min [2025-10-15T18:40:14.835324] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.875758] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.879882] [DEBUG] [LOCAL ] ELAN: No existing data file found in primary storage. [2025-10-15T18:40:14.879713] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.823841] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.880744] [WARN ] [MAIN ] ELAN: No existing data found, performing full refresh instead. [2025-10-15T18:40:14.880983] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-15T18:40:14.881119] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-15T18:40:14.881176] [DEBUG] [LOCAL ] ELAN: No primary data file found to delete. [2025-10-15T18:40:14.881210] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-15T18:40:14.949341] [DEBUG] [LOCAL ] ELC: Loaded 3486 existing records from primary storage. [2025-10-15T18:40:14.970503] [INFO ] [MAIN ] ELC: Loaded 3486 existing records. [2025-10-15T18:40:15.387419] [DEBUG] [LOCAL ] ELME: Loaded 39385 existing records from primary storage. [2025-10-15T18:40:15.380871] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:15.403794] [INFO ] [MAIN ] ELME: Loaded 39385 existing records. [2025-10-15T18:40:15.445661] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-15T18:40:15.436177] [DEBUG] [LOCAL ] ELF: Loaded 52038 existing records from primary storage. [2025-10-15T18:40:15.486183] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-15T18:40:15.522488] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-15T18:40:15.540908] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-15T18:40:15.503264] [INFO ] [MAIN ] ELF: Loaded 52038 existing records. [2025-10-15T18:40:15.635624] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:15.674556] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-15T18:40:15.934160] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:15.979391] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-15T18:40:16.043689] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-15T18:40:16.101323] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:16.113853] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-15T18:40:16.114086] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-15T18:40:16.128048] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-15T18:40:16.155126] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-15T18:40:16.260272] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-15T18:40:16.263696] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-15T18:40:16.429250] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:16.467992] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-15T18:40:16.930595] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:16.941338] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-15T18:40:17.008750] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:17.009014] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-15T18:40:17.486119] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T18:40:17.487775] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-15T18:40:18.055265] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:40:18.056988] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-15T18:40:18.391963] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T18:40:18.393341] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-15T18:40:18.536769] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T18:40:18.545278] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-15T18:40:18.922751] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T18:40:18.924149] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-15T18:40:19.171069] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-15T18:40:19.181293] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-15T18:40:19.275022] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (3.60 seconds). [2025-10-15T18:40:19.285764] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-15T18:40:19.385716] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T18:40:19.387200] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-15T18:40:19.635579] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:40:19.642331] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-15T18:40:19.949421] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T18:40:19.950919] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-15T18:40:20.515133] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T18:40:20.517038] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-15T18:40:20.815364] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:40:20.879105] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:40:20.913985] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-15T18:40:21.027779] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:40:21.091612] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T18:40:21.714027] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-15T18:40:22.138168] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:40:22.513996] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-15T18:40:22.917632] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T18:40:22.967887] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:40:23.314040] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-15T18:40:24.113988] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-15T18:40:24.911327] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T18:40:24.921722] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-15T18:40:25.362997] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:40:25.684428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:40:25.713955] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-15T18:40:26.199939] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:40:26.200893] [INFO ] [REMOTE ] ELC: Full fetch complete (5029 records). [2025-10-15T18:40:26.200961] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-15T18:40:26.519119] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-15T18:40:26.558587] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-15T18:40:26.558751] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-15T18:40:26.558927] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-15T18:40:26.558969] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-15T18:40:26.559317] [DEBUG] [LOCAL ] ELC: Trimmed 5029 records to 3506 (keeping 200 days of data) [2025-10-15T18:40:26.580609] [DEBUG] [LOCAL ] ELC: Primary data saved (3506 records). [2025-10-15T18:40:26.580721] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-15T18:40:26.580804] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 12.4s. Estimated remaining: 3h 49m 25s. Rate: 7.2 symbols/min [2025-10-15T18:40:26.744987] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:26.768917] [DEBUG] [LOCAL ] ELP: Loaded 25653 existing records from primary storage. [2025-10-15T18:40:26.769227] [INFO ] [MAIN ] ELP: Loaded 25653 existing records. [2025-10-15T18:40:26.946683] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:26.946937] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-15T18:40:26.947015] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-15T18:40:26.947221] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-15T18:40:26.947280] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-15T18:40:27.320409] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-15T18:40:27.325113] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:28.113997] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-15T18:40:28.260464] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:40:28.925941] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-15T18:40:28.927517] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:40:29.713999] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-15T18:40:29.745126] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:40:30.514032] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-15T18:40:31.206203] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-15T18:40:31.290422] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T18:40:31.313972] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-15T18:40:31.947587] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:40:32.113976] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-15T18:40:32.914020] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-15T18:40:33.298926] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T18:40:33.714026] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-15T18:40:33.744709] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T18:40:34.006261] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:40:34.514008] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-15T18:40:34.786489] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T18:40:35.314008] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-15T18:40:35.611193] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T18:40:36.114006] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-15T18:40:36.842107] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:40:36.913964] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-15T18:40:37.714017] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-15T18:40:38.316732] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-15T18:40:38.513980] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-15T18:40:38.640692] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:40:39.037854] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T18:40:39.313995] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-15T18:40:40.114005] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-15T18:40:40.588201] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T18:40:40.913964] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-15T18:40:41.108465] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:40:41.286520] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T18:40:41.714170] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-15T18:40:42.514013] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-15T18:40:42.646829] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T18:40:42.748100] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:40:43.314020] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-15T18:40:44.073323] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T18:40:44.079819] [INFO ] [REMOTE ] ELAN: Full fetch complete (77057 records). [2025-10-15T18:40:44.079967] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-15T18:40:44.123412] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-15T18:40:44.473705] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-15T18:40:44.473971] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-15T18:40:44.474927] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-15T18:40:44.475048] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-15T18:40:44.476491] [DEBUG] [LOCAL ] ELAN: Trimmed 77057 records to 53301 (keeping 200 days of data) [2025-10-15T18:40:44.672596] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T18:40:44.810598] [DEBUG] [LOCAL ] ELAN: Primary data saved (53301 records). [2025-10-15T18:40:44.810753] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-15T18:40:44.810831] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELAN took 30.6s. Estimated remaining: 3h 49m 39s. Rate: 7.2 symbols/min [2025-10-15T18:40:44.919149] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-15T18:40:44.981967] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:44.982152] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-15T18:40:44.982215] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-15T18:40:44.982719] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-15T18:40:44.982790] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-15T18:40:44.982845] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-15T18:40:44.982892] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-15T18:40:45.335351] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:45.681195] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:40:45.714015] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-15T18:40:46.173059] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T18:40:46.513974] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-15T18:40:47.276078] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T18:40:47.282038] [INFO ] [REMOTE ] ELME: Full fetch complete (56134 records). [2025-10-15T18:40:47.282170] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-15T18:40:47.319118] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-15T18:40:47.679700] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-15T18:40:47.679928] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-15T18:40:47.681039] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-15T18:40:47.681151] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-15T18:40:47.682400] [DEBUG] [LOCAL ] ELME: Trimmed 56134 records to 39404 (keeping 200 days of data) [2025-10-15T18:40:47.817510] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T18:40:47.938756] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T18:40:47.981138] [DEBUG] [LOCAL ] ELME: Primary data saved (39404 records). [2025-10-15T18:40:47.981319] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-15T18:40:47.981430] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELME took 33.8s. Estimated remaining: 3h 49m 19s. Rate: 7.2 symbols/min [2025-10-15T18:40:48.128849] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-15T18:40:48.160277] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:48.210879] [DEBUG] [LOCAL ] ELS: Loaded 49892 existing records from primary storage. [2025-10-15T18:40:48.211243] [INFO ] [MAIN ] ELS: Loaded 49892 existing records. [2025-10-15T18:40:48.381385] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:48.381579] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-15T18:40:48.381625] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-15T18:40:48.381950] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-15T18:40:48.381995] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-15T18:40:48.723989] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:48.913990] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-15T18:40:49.714069] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-15T18:40:50.162319] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-15T18:40:50.254740] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-15T18:40:50.514024] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-15T18:40:50.961225] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T18:40:51.314032] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-15T18:40:51.629855] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T18:40:52.114021] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-15T18:40:52.914465] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-15T18:40:52.919671] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T18:40:53.713976] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-15T18:40:53.949888] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:40:54.278437] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-15T18:40:54.513991] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-15T18:40:54.977107] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:40:55.314012] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-15T18:40:56.114088] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-15T18:40:56.371216] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T18:40:56.522354] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T18:40:56.526108] [INFO ] [REMOTE ] ELP: Full fetch complete (36848 records). [2025-10-15T18:40:56.526210] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-15T18:40:56.901028] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-15T18:40:56.901117] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-15T18:40:56.901789] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-15T18:40:56.901852] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-15T18:40:56.902841] [DEBUG] [LOCAL ] ELP: Trimmed 36848 records to 25680 (keeping 200 days of data) [2025-10-15T18:40:56.949696] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-15T18:40:57.051909] [DEBUG] [LOCAL ] ELP: Primary data saved (25680 records). [2025-10-15T18:40:57.052049] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-15T18:40:57.052128] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELP took 30.5s. Estimated remaining: 3h 49m 12s. Rate: 7.2 symbols/min [2025-10-15T18:40:57.221260] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:57.269945] [DEBUG] [LOCAL ] ELV: Loaded 50685 existing records from primary storage. [2025-10-15T18:40:57.270245] [INFO ] [MAIN ] ELV: Loaded 50685 existing records. [2025-10-15T18:40:57.448270] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:57.448490] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-15T18:40:57.448537] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-15T18:40:57.449197] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-15T18:40:57.449257] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-15T18:40:57.729694] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-15T18:40:57.815370] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:57.845434] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:40:58.214790] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T18:40:58.513989] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-15T18:40:58.801489] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:40:58.807454] [INFO ] [REMOTE ] ELF: Full fetch complete (75497 records). [2025-10-15T18:40:58.807596] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-15T18:40:59.230906] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-15T18:40:59.231002] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-15T18:40:59.232000] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-15T18:40:59.232064] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-15T18:40:59.233474] [DEBUG] [LOCAL ] ELF: Trimmed 75497 records to 52028 (keeping 200 days of data) [2025-10-15T18:40:59.316638] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-15T18:40:59.544440] [DEBUG] [LOCAL ] ELF: Primary data saved (52028 records). [2025-10-15T18:40:59.544626] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-15T18:40:59.544744] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELF took 45.4s. Estimated remaining: 3h 48m 50s. Rate: 7.2 symbols/min [2025-10-15T18:40:59.650155] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T18:40:59.719971] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:59.720132] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-15T18:40:59.720168] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-15T18:40:59.720280] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-15T18:40:59.720361] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-15T18:40:59.720411] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-15T18:40:59.720444] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-15T18:41:00.072951] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:00.113959] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-15T18:41:00.317707] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T18:41:00.439234] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:41:00.439540] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-15T18:41:00.439669] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:41:00.439774] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-15T18:41:00.439857] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:41:00.439952] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-15T18:41:00.440035] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-15T18:41:00.440073] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-15T18:41:00.440116] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-15T18:41:00.440160] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 0.9s. Estimated remaining: 3h 48m 25s. Rate: 7.2 symbols/min [2025-10-15T18:41:00.611829] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:00.631467] [DEBUG] [LOCAL ] EMD: Loaded 20965 existing records from primary storage. [2025-10-15T18:41:00.631709] [INFO ] [MAIN ] EMD: Loaded 20965 existing records. [2025-10-15T18:41:00.806720] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:00.806939] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-15T18:41:00.807000] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-15T18:41:00.807245] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-15T18:41:00.807313] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-15T18:41:00.919106] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-15T18:41:01.161084] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:01.714032] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-15T18:41:02.514028] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-15T18:41:02.711244] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:41:02.940520] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:41:03.183117] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T18:41:03.314072] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-15T18:41:04.114016] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-15T18:41:04.469156] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:41:04.484150] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T18:41:04.913994] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-15T18:41:05.413349] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T18:41:05.714017] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-15T18:41:06.046142] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T18:41:06.514034] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-15T18:41:07.313993] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-15T18:41:08.114003] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-15T18:41:08.527200] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:41:08.698454] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:41:08.913989] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-15T18:41:09.119591] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:41:09.713984] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-15T18:41:10.513966] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-15T18:41:10.960856] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:41:11.314001] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-15T18:41:11.752008] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:41:12.113975] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-15T18:41:12.280790] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:41:12.914015] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-15T18:41:13.387184] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T18:41:13.679433] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (4.77 seconds). [2025-10-15T18:41:13.714034] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-15T18:41:14.001965] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T18:41:14.513977] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-15T18:41:15.314001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-15T18:41:16.114024] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-15T18:41:16.211932] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (3.30 seconds). [2025-10-15T18:41:16.398478] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:41:16.538842] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T18:41:16.539476] [INFO ] [REMOTE ] ELPC: Full fetch complete (1404 records). [2025-10-15T18:41:16.539541] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-15T18:41:16.720430] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-15T18:41:16.720721] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:41:16.720797] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:41:16.720845] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-15T18:41:16.720899] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-15T18:41:16.720938] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-15T18:41:16.720981] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-15T18:41:16.721034] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELPC took 31.9s. Estimated remaining: 3h 48m 35s. Rate: 7.2 symbols/min [2025-10-15T18:41:16.886719] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:16.915966] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-15T18:41:16.917554] [DEBUG] [LOCAL ] EME: Loaded 30969 existing records from primary storage. [2025-10-15T18:41:16.917830] [INFO ] [MAIN ] EME: Loaded 30969 existing records. [2025-10-15T18:41:17.095041] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:17.095242] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-15T18:41:17.095295] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-15T18:41:17.095761] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-15T18:41:17.095819] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-15T18:41:17.439146] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:17.713983] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-15T18:41:17.934691] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (3.42 seconds). [2025-10-15T18:41:17.985293] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:41:18.514045] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-15T18:41:19.313990] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-15T18:41:19.558935] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T18:41:20.114050] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-15T18:41:20.211941] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T18:41:20.560942] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T18:41:20.914009] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-15T18:41:21.713982] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-15T18:41:21.795801] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:41:21.802168] [INFO ] [REMOTE ] ELS: Full fetch complete (71187 records). [2025-10-15T18:41:21.802274] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-15T18:41:22.109509] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T18:41:22.205635] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-15T18:41:22.205744] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-15T18:41:22.206592] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-15T18:41:22.206634] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-15T18:41:22.208057] [DEBUG] [LOCAL ] ELS: Trimmed 71187 records to 49862 (keeping 200 days of data) [2025-10-15T18:41:22.511135] [DEBUG] [LOCAL ] ELS: Primary data saved (49862 records). [2025-10-15T18:41:22.511288] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-15T18:41:22.512173] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELS took 34.5s. Estimated remaining: 3h 48m 21s. Rate: 7.2 symbols/min [2025-10-15T18:41:22.523985] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-15T18:41:22.699772] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:22.705779] [DEBUG] [LOCAL ] EMF: Loaded 3283 existing records from primary storage. [2025-10-15T18:41:22.706023] [INFO ] [MAIN ] EMF: Loaded 3283 existing records. [2025-10-15T18:41:22.893472] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:22.893679] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-15T18:41:22.893739] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-15T18:41:22.893898] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-15T18:41:22.893957] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-15T18:41:23.278047] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:23.313961] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-15T18:41:23.500827] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T18:41:23.644225] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T18:41:24.114004] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-15T18:41:24.496268] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T18:41:24.914005] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-15T18:41:25.714058] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-15T18:41:26.064235] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T18:41:26.514030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-15T18:41:26.741579] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:41:26.765571] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T18:41:27.314055] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-15T18:41:27.927108] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T18:41:28.114007] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-15T18:41:28.914030] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-15T18:41:29.285274] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-15T18:41:29.627257] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T18:41:29.714045] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-15T18:41:29.741786] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T18:41:30.348164] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T18:41:30.513993] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-15T18:41:31.234577] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T18:41:31.313990] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-15T18:41:32.114109] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-15T18:41:32.350669] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:41:32.353746] [INFO ] [REMOTE ] EMD: Full fetch complete (32060 records). [2025-10-15T18:41:32.353863] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-15T18:41:32.762053] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-15T18:41:32.762143] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-15T18:41:32.762847] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-15T18:41:32.762913] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-15T18:41:32.763891] [DEBUG] [LOCAL ] EMD: Trimmed 32060 records to 20863 (keeping 200 days of data) [2025-10-15T18:41:32.890235] [DEBUG] [LOCAL ] EMD: Primary data saved (20863 records). [2025-10-15T18:41:32.890359] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-15T18:41:32.890487] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. EMD took 32.5s. Estimated remaining: 3h 48m 17s. Rate: 7.2 symbols/min [2025-10-15T18:41:32.924303] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-15T18:41:33.071232] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:33.117702] [DEBUG] [LOCAL ] EMN: Loaded 50738 existing records from primary storage. [2025-10-15T18:41:33.118063] [INFO ] [MAIN ] EMN: Loaded 50738 existing records. [2025-10-15T18:41:33.300996] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:33.301385] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-15T18:41:33.301510] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-15T18:41:33.301977] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-15T18:41:33.302037] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-15T18:41:33.597079] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T18:41:33.706596] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:33.719698] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-15T18:41:33.722091] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:41:34.201881] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T18:41:34.514006] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-15T18:41:35.314009] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-15T18:41:35.326912] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:41:36.114012] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-15T18:41:36.913971] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-15T18:41:37.066968] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:41:37.713960] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-15T18:41:38.272865] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T18:41:38.426671] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T18:41:38.513955] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-15T18:41:39.036080] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T18:41:39.314069] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-15T18:41:39.611049] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T18:41:40.114039] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-15T18:41:40.913959] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-15T18:41:41.250808] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T18:41:41.438792] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T18:41:41.714021] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-15T18:41:42.498394] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T18:41:42.513952] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-15T18:41:43.314018] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-15T18:41:43.643773] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T18:41:44.114018] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-15T18:41:44.349166] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T18:41:44.521071] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:41:44.674279] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:41:44.914109] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-15T18:41:45.483122] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T18:41:45.713986] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-15T18:41:46.250570] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T18:41:46.514047] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-15T18:41:47.314043] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-15T18:41:48.114060] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-15T18:41:48.431927] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T18:41:48.438085] [INFO ] [REMOTE ] ELV: Full fetch complete (73227 records). [2025-10-15T18:41:48.438204] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-15T18:41:48.542382] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T18:41:48.558957] [INFO ] [REMOTE ] EMF: Full fetch complete (6498 records). [2025-10-15T18:41:48.564268] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-15T18:41:48.924338] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-15T18:41:49.136051] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-15T18:41:49.141807] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-15T18:41:49.153118] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-15T18:41:49.175842] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-15T18:41:49.216356] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-15T18:41:49.216459] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-15T18:41:49.216759] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-15T18:41:49.216914] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-15T18:41:49.218062] [DEBUG] [LOCAL ] EMF: Trimmed 6498 records to 3211 (keeping 200 days of data) [2025-10-15T18:41:49.218637] [DEBUG] [LOCAL ] ELV: Trimmed 73227 records to 50691 (keeping 200 days of data) [2025-10-15T18:41:49.356302] [DEBUG] [LOCAL ] EMF: Primary data saved (3211 records). [2025-10-15T18:41:49.364158] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-15T18:41:49.364922] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMF took 26.9s. Estimated remaining: 3h 48m 27s. Rate: 7.2 symbols/min [2025-10-15T18:41:49.613372] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-15T18:41:49.699388] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:49.714670] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-15T18:41:49.782985] [DEBUG] [LOCAL ] EMO: Loaded 13223 existing records from primary storage. [2025-10-15T18:41:49.786466] [INFO ] [MAIN ] EMO: Loaded 13223 existing records. [2025-10-15T18:41:49.977065] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:49.978820] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-15T18:41:49.978900] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-15T18:41:49.981112] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-15T18:41:49.981236] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-15T18:41:49.981191] [DEBUG] [LOCAL ] ELV: Primary data saved (50691 records). [2025-10-15T18:41:50.012559] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-15T18:41:50.036300] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. ELV took 53.0s. Estimated remaining: 3h 48m 1s. Rate: 7.2 symbols/min [2025-10-15T18:41:50.431676] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:50.510509] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:50.517294] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-15T18:41:50.529615] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:41:50.539115] [DEBUG] [LOCAL ] EMP: Loaded 3054 existing records from primary storage. [2025-10-15T18:41:50.539449] [INFO ] [MAIN ] EMP: Loaded 3054 existing records. [2025-10-15T18:41:50.714985] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:50.715197] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-15T18:41:50.715248] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-15T18:41:50.715410] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-15T18:41:50.715465] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-15T18:41:51.086905] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:51.137429] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:41:51.186148] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T18:41:51.313992] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-15T18:41:52.087622] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:41:52.114006] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-15T18:41:52.913986] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-15T18:41:53.670075] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:41:53.714024] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-15T18:41:53.769266] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:41:53.776377] [INFO ] [REMOTE ] EME: Full fetch complete (47035 records). [2025-10-15T18:41:53.776718] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-15T18:41:54.175922] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-15T18:41:54.176008] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-15T18:41:54.176732] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-15T18:41:54.176793] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-15T18:41:54.178040] [DEBUG] [LOCAL ] EME: Trimmed 47035 records to 30952 (keeping 200 days of data) [2025-10-15T18:41:54.391857] [DEBUG] [LOCAL ] EME: Primary data saved (30952 records). [2025-10-15T18:41:54.392006] [INFO ] [MAIN ] EME: Full history saved. [2025-10-15T18:41:54.392099] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EME took 37.7s. Estimated remaining: 3h 47m 44s. Rate: 7.2 symbols/min [2025-10-15T18:41:54.500938] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:41:54.518636] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-15T18:41:54.573467] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:54.625304] [DEBUG] [LOCAL ] EMR: Loaded 53209 existing records from primary storage. [2025-10-15T18:41:54.625598] [INFO ] [MAIN ] EMR: Loaded 53209 existing records. [2025-10-15T18:41:54.797552] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:54.797768] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-15T18:41:54.797824] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-15T18:41:54.798260] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-15T18:41:54.798297] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-15T18:41:55.155039] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:55.313995] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-15T18:41:56.114002] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-15T18:41:56.311397] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T18:41:56.913631] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T18:41:56.917018] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-15T18:41:57.066830] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:41:57.372778] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T18:41:57.713992] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-15T18:41:58.025983] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T18:41:58.514016] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-15T18:41:59.314004] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-15T18:41:59.352256] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T18:41:59.775310] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T18:42:00.114020] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-15T18:42:00.913989] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-15T18:42:00.957487] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T18:42:01.714029] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-15T18:42:02.514038] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-15T18:42:03.011259] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T18:42:03.016724] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T18:42:03.314000] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-15T18:42:04.119950] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-15T18:42:04.125353] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T18:42:04.171584] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T18:42:04.451319] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-15T18:42:04.913991] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-15T18:42:05.285291] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-15T18:42:05.714007] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-15T18:42:06.514043] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-15T18:42:06.973586] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T18:42:07.314006] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-15T18:42:07.733857] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-15T18:42:08.113984] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-15T18:42:08.867389] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T18:42:08.913983] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-15T18:42:09.052987] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T18:42:09.713996] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-15T18:42:10.513849] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:42:10.513997] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-15T18:42:10.637753] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:42:11.314004] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-15T18:42:12.113969] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-15T18:42:12.403148] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T18:42:12.913998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-15T18:42:12.949139] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T18:42:12.955355] [INFO ] [REMOTE ] EMN: Full fetch complete (72347 records). [2025-10-15T18:42:12.955496] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-15T18:42:13.264291] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:42:13.362931] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-15T18:42:13.363026] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-15T18:42:13.363947] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-15T18:42:13.364011] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-15T18:42:13.365364] [DEBUG] [LOCAL ] EMN: Trimmed 72347 records to 50780 (keeping 200 days of data) [2025-10-15T18:42:13.672573] [DEBUG] [LOCAL ] EMN: Primary data saved (50780 records). [2025-10-15T18:42:13.672750] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-15T18:42:13.673194] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMN took 40.8s. Estimated remaining: 3h 47m 60s. Rate: 7.2 symbols/min [2025-10-15T18:42:13.719100] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-15T18:42:13.840112] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:13.891067] [DEBUG] [LOCAL ] ENB: Loaded 53512 existing records from primary storage. [2025-10-15T18:42:13.891413] [INFO ] [MAIN ] ENB: Loaded 53512 existing records. [2025-10-15T18:42:14.066873] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:14.067070] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-15T18:42:14.067153] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-15T18:42:14.067703] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-15T18:42:14.067764] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-15T18:42:14.417448] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:14.513954] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-15T18:42:14.643968] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T18:42:15.120301] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T18:42:15.122721] [INFO ] [REMOTE ] EMO: Full fetch complete (17695 records). [2025-10-15T18:42:15.122816] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-15T18:42:15.321083] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-15T18:42:15.481100] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-15T18:42:15.481173] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-15T18:42:15.481553] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-15T18:42:15.481592] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-15T18:42:15.482134] [DEBUG] [LOCAL ] EMO: Trimmed 17695 records to 13265 (keeping 200 days of data) [2025-10-15T18:42:15.560306] [DEBUG] [LOCAL ] EMO: Primary data saved (13265 records). [2025-10-15T18:42:15.560431] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-15T18:42:15.560506] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMO took 26.2s. Estimated remaining: 3h 47m 37s. Rate: 7.2 symbols/min [2025-10-15T18:42:15.725598] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:15.760960] [DEBUG] [LOCAL ] ENIC: Loaded 36677 existing records from primary storage. [2025-10-15T18:42:15.761253] [INFO ] [MAIN ] ENIC: Loaded 36677 existing records. [2025-10-15T18:42:15.940187] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:15.940404] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-15T18:42:15.940455] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-15T18:42:15.940720] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-15T18:42:15.940783] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-15T18:42:16.142764] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-15T18:42:16.296927] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:16.393187] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:42:16.594209] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T18:42:16.914033] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-15T18:42:17.258362] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T18:42:17.525932] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T18:42:17.713993] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-15T18:42:18.176348] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T18:42:18.177229] [INFO ] [REMOTE ] EMP: Full fetch complete (4233 records). [2025-10-15T18:42:18.177295] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-15T18:42:18.517779] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-15T18:42:18.540916] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-15T18:42:18.541532] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-15T18:42:18.541721] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-15T18:42:18.541782] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-15T18:42:18.542150] [DEBUG] [LOCAL ] EMP: Trimmed 4233 records to 3037 (keeping 200 days of data) [2025-10-15T18:42:18.561071] [DEBUG] [LOCAL ] EMP: Primary data saved (3037 records). [2025-10-15T18:42:18.561492] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-15T18:42:18.561579] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. EMP took 28.5s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-15T18:42:18.728833] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:18.733050] [DEBUG] [LOCAL ] ENO: Loaded 1862 existing records from primary storage. [2025-10-15T18:42:18.733209] [INFO ] [MAIN ] ENO: Loaded 1862 existing records. [2025-10-15T18:42:18.912183] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:18.912506] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-15T18:42:18.912566] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-15T18:42:18.912771] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-15T18:42:18.912835] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-15T18:42:19.255061] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:19.314035] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-15T18:42:20.105052] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T18:42:20.113946] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-15T18:42:20.509214] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T18:42:20.583995] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T18:42:20.914092] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-15T18:42:21.714030] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-15T18:42:22.268517] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T18:42:22.514027] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-15T18:42:22.850853] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T18:42:23.015573] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T18:42:23.314042] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-15T18:42:23.912148] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T18:42:24.114000] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-15T18:42:24.913990] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-15T18:42:25.611390] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T18:42:25.713951] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-15T18:42:26.513977] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-15T18:42:26.673221] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:42:27.094138] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:42:27.314029] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-15T18:42:28.113959] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-15T18:42:28.219200] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T18:42:28.532593] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:42:28.914044] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-15T18:42:29.302835] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:42:29.713980] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-15T18:42:30.037132] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:42:30.514001] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-15T18:42:31.313956] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-15T18:42:31.664779] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T18:42:31.801842] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T18:42:32.113968] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-15T18:42:32.475806] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:42:32.913991] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-15T18:42:33.714002] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-15T18:42:33.941588] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T18:42:34.514033] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-15T18:42:34.693415] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:42:34.724186] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T18:42:35.314051] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-15T18:42:36.012413] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T18:42:36.113954] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-15T18:42:36.830994] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T18:42:36.913960] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-15T18:42:37.713968] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-15T18:42:38.038937] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T18:42:38.045592] [INFO ] [REMOTE ] EMR: Full fetch complete (77241 records). [2025-10-15T18:42:38.045806] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-15T18:42:38.220356] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:42:38.476162] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-15T18:42:38.476243] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-15T18:42:38.477201] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-15T18:42:38.477267] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-15T18:42:38.478814] [DEBUG] [LOCAL ] EMR: Trimmed 77241 records to 53206 (keeping 200 days of data) [2025-10-15T18:42:38.538000] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-15T18:42:38.818333] [DEBUG] [LOCAL ] EMR: Primary data saved (53206 records). [2025-10-15T18:42:38.818513] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-15T18:42:38.818611] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 44.4s. Estimated remaining: 3h 47m 35s. Rate: 7.2 symbols/min [2025-10-15T18:42:38.986148] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:39.027340] [DEBUG] [LOCAL ] ENOV: Loaded 44904 existing records from primary storage. [2025-10-15T18:42:39.027695] [INFO ] [MAIN ] ENOV: Loaded 44904 existing records. [2025-10-15T18:42:39.203851] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:39.204264] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-15T18:42:39.204343] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-15T18:42:39.204888] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-15T18:42:39.204946] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-15T18:42:39.318311] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-15T18:42:39.563459] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:39.594131] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T18:42:39.862420] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T18:42:40.034944] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:42:40.114023] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-15T18:42:40.914013] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-15T18:42:41.504775] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:42:41.714048] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-15T18:42:42.306455] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T18:42:42.514038] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-15T18:42:43.142777] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:42:43.313972] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-15T18:42:43.923548] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:42:44.113970] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-15T18:42:44.309243] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T18:42:44.914053] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-15T18:42:45.562486] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:42:45.713992] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-15T18:42:46.513981] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-15T18:42:46.749312] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T18:42:47.311904] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:42:47.320405] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-15T18:42:47.734620] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:42:47.738818] [INFO ] [REMOTE ] ENIC: Full fetch complete (51605 records). [2025-10-15T18:42:47.738909] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-15T18:42:48.106987] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-15T18:42:48.107063] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-15T18:42:48.107835] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-15T18:42:48.107897] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-15T18:42:48.109011] [DEBUG] [LOCAL ] ENIC: Trimmed 51605 records to 36700 (keeping 200 days of data) [2025-10-15T18:42:48.114046] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-15T18:42:48.333454] [DEBUG] [LOCAL ] ENIC: Primary data saved (36700 records). [2025-10-15T18:42:48.333582] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-15T18:42:48.333688] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 32.8s. Estimated remaining: 3h 47m 29s. Rate: 7.2 symbols/min [2025-10-15T18:42:48.497932] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:48.539675] [DEBUG] [LOCAL ] ENR: Loaded 43622 existing records from primary storage. [2025-10-15T18:42:48.539951] [INFO ] [MAIN ] ENR: Loaded 43622 existing records. [2025-10-15T18:42:48.712958] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:48.713175] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-15T18:42:48.713221] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-15T18:42:48.713601] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-15T18:42:48.713689] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-15T18:42:48.923822] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-15T18:42:49.067798] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:49.071194] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:42:49.113549] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:42:49.714050] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-15T18:42:50.261701] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:42:50.513984] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-15T18:42:51.314001] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-15T18:42:51.404221] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T18:42:51.410550] [INFO ] [REMOTE ] ENB: Full fetch complete (77653 records). [2025-10-15T18:42:51.410693] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-15T18:42:51.820474] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-15T18:42:51.820717] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-15T18:42:51.821777] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-15T18:42:51.821958] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-15T18:42:51.823973] [DEBUG] [LOCAL ] ENB: Trimmed 77653 records to 53513 (keeping 200 days of data) [2025-10-15T18:42:52.057890] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T18:42:52.134928] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-15T18:42:52.184686] [DEBUG] [LOCAL ] ENB: Primary data saved (53513 records). [2025-10-15T18:42:52.184844] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-15T18:42:52.185267] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 38.5s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-15T18:42:52.358697] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:52.390473] [DEBUG] [LOCAL ] ENS: Loaded 29567 existing records from primary storage. [2025-10-15T18:42:52.390773] [INFO ] [MAIN ] ENS: Loaded 29567 existing records. [2025-10-15T18:42:52.584609] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:52.584872] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-15T18:42:52.584939] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-15T18:42:52.585212] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-15T18:42:52.585268] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-15T18:42:52.784088] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T18:42:52.919119] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-15T18:42:53.018664] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:53.380957] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T18:42:53.713997] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-15T18:42:53.782569] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:42:54.514074] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-15T18:42:55.121162] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:42:55.314024] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-15T18:42:56.092405] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T18:42:56.113950] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-15T18:42:56.662710] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:42:56.914022] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-15T18:42:56.938224] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T18:42:57.714004] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-15T18:42:58.260436] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T18:42:58.514069] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-15T18:42:59.319077] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-15T18:42:59.338501] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T18:42:59.945771] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:42:59.957013] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:42:59.958316] [INFO ] [REMOTE ] ENO: Full fetch complete (3051 records). [2025-10-15T18:42:59.958389] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-15T18:43:00.119138] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-15T18:43:00.322153] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-15T18:43:00.322228] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-15T18:43:00.322343] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-15T18:43:00.322380] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-15T18:43:00.322729] [DEBUG] [LOCAL ] ENO: Trimmed 3051 records to 1855 (keeping 200 days of data) [2025-10-15T18:43:00.333885] [DEBUG] [LOCAL ] ENO: Primary data saved (1855 records). [2025-10-15T18:43:00.333952] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-15T18:43:00.334020] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 41.8s. Estimated remaining: 3h 47m 2s. Rate: 7.2 symbols/min [2025-10-15T18:43:00.496380] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:00.522487] [DEBUG] [LOCAL ] ENVA: Loaded 25448 existing records from primary storage. [2025-10-15T18:43:00.522757] [INFO ] [MAIN ] ENVA: Loaded 25448 existing records. [2025-10-15T18:43:00.693288] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:00.693493] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-15T18:43:00.693558] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-15T18:43:00.693827] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-15T18:43:00.693883] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-15T18:43:00.922940] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-15T18:43:01.039668] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:01.713969] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-15T18:43:01.900271] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T18:43:01.975936] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T18:43:02.514046] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-15T18:43:03.085025] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:43:03.314077] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-15T18:43:04.113986] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-15T18:43:04.197160] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:43:04.248469] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:43:04.914007] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-15T18:43:05.409990] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:43:05.714050] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-15T18:43:06.256442] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:43:06.514005] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-15T18:43:07.131059] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T18:43:07.313995] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-15T18:43:08.031946] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T18:43:08.113960] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-15T18:43:08.915658] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-15T18:43:08.918251] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:43:08.982453] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T18:43:09.713985] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-15T18:43:10.410554] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T18:43:10.415380] [INFO ] [REMOTE ] ENOV: Full fetch complete (63482 records). [2025-10-15T18:43:10.415483] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-15T18:43:10.514374] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-15T18:43:10.805435] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-15T18:43:10.805666] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-15T18:43:10.806527] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-15T18:43:10.806666] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-15T18:43:10.808074] [DEBUG] [LOCAL ] ENOV: Trimmed 63482 records to 44851 (keeping 200 days of data) [2025-10-15T18:43:10.922517] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T18:43:11.088581] [DEBUG] [LOCAL ] ENOV: Primary data saved (44851 records). [2025-10-15T18:43:11.088740] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-15T18:43:11.088828] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 32.3s. Estimated remaining: 3h 46m 59s. Rate: 7.2 symbols/min [2025-10-15T18:43:11.252508] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:11.269110] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-10-15T18:43:11.269331] [INFO ] [MAIN ] EOD: Loaded 15024 existing records. [2025-10-15T18:43:11.321990] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-15T18:43:11.445914] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:11.446131] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-15T18:43:11.446179] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-15T18:43:11.446405] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-15T18:43:11.446461] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-15T18:43:11.791921] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:12.113979] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-15T18:43:12.178605] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:43:12.337235] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T18:43:12.914065] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-15T18:43:13.198921] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T18:43:13.686339] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:43:13.713975] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-15T18:43:14.513996] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-15T18:43:14.626316] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T18:43:15.314043] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-15T18:43:15.882166] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:43:16.108798] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:43:16.113954] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-15T18:43:16.913979] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-15T18:43:17.028605] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T18:43:17.714070] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-15T18:43:18.487253] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:43:18.513958] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-15T18:43:18.771111] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T18:43:19.313992] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-15T18:43:19.964210] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:43:20.095905] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:43:20.101203] [INFO ] [REMOTE ] ENR: Full fetch complete (59278 records). [2025-10-15T18:43:20.101352] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-15T18:43:20.123261] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-15T18:43:20.494810] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-15T18:43:20.494884] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-15T18:43:20.495732] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-15T18:43:20.495914] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-15T18:43:20.497350] [DEBUG] [LOCAL ] ENR: Trimmed 59278 records to 43703 (keeping 200 days of data) [2025-10-15T18:43:20.761149] [DEBUG] [LOCAL ] ENR: Primary data saved (43703 records). [2025-10-15T18:43:20.761313] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-15T18:43:20.761408] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENR took 32.4s. Estimated remaining: 3h 46m 53s. Rate: 7.2 symbols/min [2025-10-15T18:43:20.870517] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T18:43:20.919532] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-15T18:43:20.944254] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:20.996145] [DEBUG] [LOCAL ] EOG: Loaded 53364 existing records from primary storage. [2025-10-15T18:43:20.996482] [INFO ] [MAIN ] EOG: Loaded 53364 existing records. [2025-10-15T18:43:21.166573] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:21.166823] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-15T18:43:21.166871] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-15T18:43:21.167184] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-15T18:43:21.167238] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-15T18:43:21.514690] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:21.713969] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-15T18:43:22.163451] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:43:22.513958] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-15T18:43:23.313959] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-15T18:43:23.596082] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:43:23.993228] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:43:24.113957] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-15T18:43:24.429515] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:43:24.914044] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-15T18:43:25.618324] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:43:25.622412] [INFO ] [REMOTE ] ENS: Full fetch complete (42509 records). [2025-10-15T18:43:25.622503] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-15T18:43:25.719860] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-15T18:43:25.996700] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-15T18:43:25.996993] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-15T18:43:25.997719] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-15T18:43:25.997779] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-15T18:43:25.999008] [DEBUG] [LOCAL ] ENS: Trimmed 42509 records to 29689 (keeping 200 days of data) [2025-10-15T18:43:26.178119] [DEBUG] [LOCAL ] ENS: Primary data saved (29689 records). [2025-10-15T18:43:26.178251] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-15T18:43:26.178332] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 34.0s. Estimated remaining: 3h 46m 39s. Rate: 7.2 symbols/min [2025-10-15T18:43:26.348373] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:26.361387] [DEBUG] [LOCAL ] EOI: Loaded 10770 existing records from primary storage. [2025-10-15T18:43:26.361782] [INFO ] [MAIN ] EOI: Loaded 10770 existing records. [2025-10-15T18:43:26.532688] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-15T18:43:26.568448] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T18:43:26.573958] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:26.580060] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-15T18:43:26.580360] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-15T18:43:26.580764] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-15T18:43:26.580823] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-15T18:43:26.926599] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:27.314069] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-15T18:43:27.480024] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:43:27.732243] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T18:43:28.114033] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-15T18:43:28.574710] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T18:43:28.914009] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-15T18:43:29.082060] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:43:29.713971] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-15T18:43:29.759705] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:43:30.513993] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-15T18:43:31.313960] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-15T18:43:31.416411] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T18:43:31.638863] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T18:43:32.113951] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-15T18:43:32.124158] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T18:43:32.913981] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-15T18:43:33.713981] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-15T18:43:33.982825] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:43:34.034327] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T18:43:34.506935] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T18:43:34.513944] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-15T18:43:35.139613] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T18:43:35.314028] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-15T18:43:36.113984] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-15T18:43:36.321454] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:43:36.914014] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-15T18:43:37.714004] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-15T18:43:37.884199] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:43:38.223130] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T18:43:38.328938] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:43:38.513981] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-15T18:43:39.242479] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T18:43:39.314036] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-15T18:43:40.113969] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-15T18:43:40.182458] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T18:43:40.719885] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T18:43:40.913989] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-15T18:43:41.714015] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-15T18:43:42.474379] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T18:43:42.513958] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-15T18:43:42.744023] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:43:43.314025] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-15T18:43:43.555439] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:43:43.558452] [INFO ] [REMOTE ] ENVA: Full fetch complete (36680 records). [2025-10-15T18:43:43.558548] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-15T18:43:43.919122] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-15T18:43:43.919198] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-15T18:43:43.919826] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-15T18:43:43.919887] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-15T18:43:43.920638] [DEBUG] [LOCAL ] ENVA: Trimmed 36680 records to 25474 (keeping 200 days of data) [2025-10-15T18:43:44.071132] [DEBUG] [LOCAL ] ENVA: Primary data saved (25474 records). [2025-10-15T18:43:44.071259] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-15T18:43:44.071373] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENVA took 43.7s. Estimated remaining: 3h 46m 51s. Rate: 7.2 symbols/min [2025-10-15T18:43:44.119131] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-15T18:43:44.250342] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:44.266503] [DEBUG] [LOCAL ] EOS: Loaded 15287 existing records from primary storage. [2025-10-15T18:43:44.266756] [INFO ] [MAIN ] EOS: Loaded 15287 existing records. [2025-10-15T18:43:44.379158] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T18:43:44.398203] [INFO ] [REMOTE ] EOD: Full fetch complete (20966 records). [2025-10-15T18:43:44.403440] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-15T18:43:44.546226] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:44.568756] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-15T18:43:44.568916] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-15T18:43:44.569245] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-15T18:43:44.590120] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-15T18:43:44.919185] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-15T18:43:45.151483] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-15T18:43:45.156723] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-15T18:43:45.170165] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-15T18:43:45.180891] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-15T18:43:45.212943] [DEBUG] [LOCAL ] EOD: Trimmed 20966 records to 15054 (keeping 200 days of data) [2025-10-15T18:43:45.212815] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:45.303698] [DEBUG] [LOCAL ] EOD: Primary data saved (15054 records). [2025-10-15T18:43:45.303866] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-15T18:43:45.303972] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 34.2s. Estimated remaining: 3h 46m 27s. Rate: 7.2 symbols/min [2025-10-15T18:43:45.471106] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:45.481862] [DEBUG] [LOCAL ] EOT: Loaded 6895 existing records from primary storage. [2025-10-15T18:43:45.482056] [INFO ] [MAIN ] EOT: Loaded 6895 existing records. [2025-10-15T18:43:45.660245] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:45.661216] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-15T18:43:45.661365] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-15T18:43:45.661574] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-15T18:43:45.661691] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-15T18:43:45.722901] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-15T18:43:45.782683] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T18:43:46.051777] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-15T18:43:46.055260] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:46.514027] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-15T18:43:47.137277] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:43:47.314039] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-15T18:43:47.544182] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T18:43:48.114011] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-15T18:43:48.750209] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:43:48.913984] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-15T18:43:49.172387] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T18:43:49.714057] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-15T18:43:49.819952] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T18:43:49.821898] [INFO ] [REMOTE ] EOI: Full fetch complete (16241 records). [2025-10-15T18:43:49.821987] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-15T18:43:50.182528] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-15T18:43:50.182608] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-15T18:43:50.183000] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-15T18:43:50.183060] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-15T18:43:50.183616] [DEBUG] [LOCAL ] EOI: Trimmed 16241 records to 10670 (keeping 200 days of data) [2025-10-15T18:43:50.249054] [DEBUG] [LOCAL ] EOI: Primary data saved (10670 records). [2025-10-15T18:43:50.249197] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-15T18:43:50.249330] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOI took 24.1s. Estimated remaining: 3h 46m 11s. Rate: 7.2 symbols/min [2025-10-15T18:43:50.425218] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:50.455433] [DEBUG] [LOCAL ] EPAC: Loaded 26413 existing records from primary storage. [2025-10-15T18:43:50.455801] [INFO ] [MAIN ] EPAC: Loaded 26413 existing records. [2025-10-15T18:43:50.519114] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-15T18:43:50.633711] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:50.633868] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-15T18:43:50.633990] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-15T18:43:50.634254] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-15T18:43:50.634293] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-15T18:43:50.987324] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:51.291695] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:43:51.314074] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-15T18:43:51.522138] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:43:51.913554] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T18:43:52.113997] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-15T18:43:52.883457] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:43:52.913995] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-15T18:43:53.713980] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-15T18:43:54.034158] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:43:54.514008] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-15T18:43:55.214400] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T18:43:55.314098] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-15T18:43:55.533634] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:43:55.895870] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T18:43:56.114083] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-15T18:43:56.678344] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T18:43:56.914070] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-15T18:43:57.713964] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-15T18:43:57.935894] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T18:43:57.942321] [INFO ] [REMOTE ] EOG: Full fetch complete (77460 records). [2025-10-15T18:43:57.942445] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-15T18:43:58.327035] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-15T18:43:58.327122] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-15T18:43:58.328100] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-15T18:43:58.328162] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-15T18:43:58.329593] [DEBUG] [LOCAL ] EOG: Trimmed 77460 records to 53373 (keeping 200 days of data) [2025-10-15T18:43:58.522505] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-15T18:43:58.554572] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T18:43:58.674071] [DEBUG] [LOCAL ] EOG: Primary data saved (53373 records). [2025-10-15T18:43:58.674207] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-15T18:43:58.674284] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOG took 37.9s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-15T18:43:58.838775] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:58.838921] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-15T18:43:58.838957] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-15T18:43:58.839062] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-15T18:43:58.839102] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-15T18:43:58.839142] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-15T18:43:58.839225] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-15T18:43:59.185703] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:59.313957] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-15T18:43:59.894175] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:44:00.114045] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-15T18:44:00.913976] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-15T18:44:01.100514] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T18:44:01.364186] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:44:01.714016] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-15T18:44:02.453377] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:44:02.513974] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-15T18:44:02.552362] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:44:03.313988] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-15T18:44:03.403801] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T18:44:04.113990] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-15T18:44:04.835507] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T18:44:04.913990] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-15T18:44:04.947915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T18:44:05.713998] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-15T18:44:06.345527] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:44:06.513993] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-15T18:44:06.782495] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:44:07.314000] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-15T18:44:08.089871] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T18:44:08.113983] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-15T18:44:08.150233] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:44:08.698362] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T18:44:08.914032] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-15T18:44:09.714112] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-15T18:44:10.314436] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:44:10.495490] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T18:44:10.497087] [INFO ] [REMOTE ] EOT: Full fetch complete (10832 records). [2025-10-15T18:44:10.497154] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-15T18:44:10.519162] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-15T18:44:10.883495] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-15T18:44:10.883573] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-15T18:44:10.883839] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-15T18:44:10.883898] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-15T18:44:10.884318] [DEBUG] [LOCAL ] EOT: Trimmed 10832 records to 6957 (keeping 200 days of data) [2025-10-15T18:44:10.928370] [DEBUG] [LOCAL ] EOT: Primary data saved (6957 records). [2025-10-15T18:44:10.928473] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-15T18:44:10.928571] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOT took 25.6s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-15T18:44:11.093807] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:11.093963] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-15T18:44:11.093999] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-15T18:44:11.094102] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-15T18:44:11.094142] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-15T18:44:11.094182] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-15T18:44:11.094214] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-15T18:44:11.322133] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-15T18:44:11.451216] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:11.567263] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:44:12.113996] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-15T18:44:12.630971] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T18:44:12.914015] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-15T18:44:13.713969] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-15T18:44:13.768181] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T18:44:13.922808] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:44:14.517104] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-15T18:44:14.520976] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T18:44:15.314073] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-15T18:44:16.113977] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-15T18:44:16.142410] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T18:44:16.465278] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:44:16.914065] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-15T18:44:17.049230] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:44:17.714027] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-15T18:44:18.273828] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:44:18.519106] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-15T18:44:18.530999] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T18:44:19.314087] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-15T18:44:19.878773] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:44:20.114058] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-15T18:44:20.728814] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:44:20.913979] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-15T18:44:21.535304] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:44:21.714009] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-15T18:44:22.388512] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:44:22.514048] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-15T18:44:23.164017] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:44:23.313990] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-15T18:44:23.368412] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T18:44:24.114006] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-15T18:44:24.849105] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:44:24.913992] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-15T18:44:25.604783] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T18:44:25.713954] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-15T18:44:26.348315] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T18:44:26.514044] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-15T18:44:27.313977] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-15T18:44:27.347412] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:44:27.557409] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:44:27.559918] [INFO ] [REMOTE ] EOS: Full fetch complete (23099 records). [2025-10-15T18:44:27.560001] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-15T18:44:27.918029] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-15T18:44:27.918136] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-15T18:44:27.918676] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-15T18:44:27.918748] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-15T18:44:27.919540] [DEBUG] [LOCAL ] EOS: Trimmed 23099 records to 15153 (keeping 200 days of data) [2025-10-15T18:44:28.012470] [DEBUG] [LOCAL ] EOS: Primary data saved (15153 records). [2025-10-15T18:44:28.012606] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-15T18:44:28.012706] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOS took 43.9s. Estimated remaining: 3h 46m 14s. Rate: 7.2 symbols/min [2025-10-15T18:44:28.119122] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-15T18:44:28.183067] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:28.234067] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-15T18:44:28.234367] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-15T18:44:28.409572] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:28.409896] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-15T18:44:28.409975] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-15T18:44:28.410376] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-15T18:44:28.410417] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-15T18:44:28.684413] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:44:28.715408] [INFO ] [REMOTE ] EPAC: Full fetch complete (38668 records). [2025-10-15T18:44:28.715544] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-15T18:44:28.895708] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:28.919097] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-15T18:44:29.161530] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-15T18:44:29.161612] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-15T18:44:29.162244] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-15T18:44:29.162304] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-15T18:44:29.163128] [DEBUG] [LOCAL ] EPAC: Trimmed 38668 records to 26461 (keeping 200 days of data) [2025-10-15T18:44:29.326388] [DEBUG] [LOCAL ] EPAC: Primary data saved (26461 records). [2025-10-15T18:44:29.326523] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-15T18:44:29.326606] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 39.1s. Estimated remaining: 3h 45m 50s. Rate: 7.2 symbols/min [2025-10-15T18:44:29.495215] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:29.519599] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T18:44:29.566161] [DEBUG] [LOCAL ] EPR: Loaded 43858 existing records from primary storage. [2025-10-15T18:44:29.566450] [INFO ] [MAIN ] EPR: Loaded 43858 existing records. [2025-10-15T18:44:29.720505] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-15T18:44:29.742539] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:29.742855] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-15T18:44:29.742915] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-15T18:44:29.743293] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-15T18:44:29.743330] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-15T18:44:30.091285] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:30.514049] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-15T18:44:30.959758] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-15T18:44:31.314007] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-15T18:44:31.379432] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:44:31.384558] [INFO ] [REMOTE ] EPAM: Full fetch complete (56306 records). [2025-10-15T18:44:31.384672] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-15T18:44:31.769737] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-15T18:44:31.769838] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-15T18:44:31.770585] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-15T18:44:31.770728] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-15T18:44:31.772090] [DEBUG] [LOCAL ] EPAM: Trimmed 56306 records to 39462 (keeping 200 days of data) [2025-10-15T18:44:31.880554] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:44:32.037358] [DEBUG] [LOCAL ] EPAM: Primary data saved (39462 records). [2025-10-15T18:44:32.037492] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-15T18:44:32.037562] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPAM took 33.4s. Estimated remaining: 3h 45m 29s. Rate: 7.2 symbols/min [2025-10-15T18:44:32.119152] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-15T18:44:32.206534] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:32.249094] [DEBUG] [LOCAL ] EPRT: Loaded 48439 existing records from primary storage. [2025-10-15T18:44:32.249389] [INFO ] [MAIN ] EPRT: Loaded 48439 existing records. [2025-10-15T18:44:32.421485] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:32.421726] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-15T18:44:32.421779] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-15T18:44:32.422034] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-15T18:44:32.422070] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-15T18:44:32.780046] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:32.913980] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-15T18:44:32.990132] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:44:33.523317] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:44:33.713978] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-15T18:44:34.163271] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:44:34.513995] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-15T18:44:35.234684] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:44:35.313970] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-15T18:44:36.119106] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-15T18:44:36.130987] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T18:44:36.856379] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:44:36.913954] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-15T18:44:37.275135] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T18:44:37.714050] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-15T18:44:38.514002] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-15T18:44:38.577410] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:44:38.889976] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T18:44:39.314058] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-15T18:44:39.970583] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T18:44:40.114017] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-15T18:44:40.908742] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T18:44:40.917179] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-15T18:44:41.714031] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-15T18:44:42.234598] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T18:44:42.322192] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:44:42.513996] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-15T18:44:43.261085] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:44:43.314009] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-15T18:44:44.114068] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-15T18:44:44.561883] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T18:44:44.729680] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T18:44:44.914027] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-15T18:44:45.537056] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:44:45.714022] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-15T18:44:46.514054] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-15T18:44:46.831059] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T18:44:47.158690] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:44:47.314004] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-15T18:44:48.114025] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-15T18:44:48.252056] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T18:44:48.919213] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-15T18:44:48.931494] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T18:44:49.556803] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T18:44:49.713976] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-15T18:44:50.514033] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-15T18:44:50.542678] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T18:44:50.547402] [INFO ] [REMOTE ] EPC: Full fetch complete (57157 records). [2025-10-15T18:44:50.547513] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-15T18:44:50.924781] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-15T18:44:50.924857] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-15T18:44:50.925609] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-15T18:44:50.925674] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-15T18:44:50.926768] [DEBUG] [LOCAL ] EPC: Trimmed 57157 records to 39741 (keeping 200 days of data) [2025-10-15T18:44:51.175635] [DEBUG] [LOCAL ] EPC: Primary data saved (39741 records). [2025-10-15T18:44:51.175836] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-15T18:44:51.175927] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPC took 40.2s. Estimated remaining: 3h 45m 44s. Rate: 7.2 symbols/min [2025-10-15T18:44:51.319250] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-15T18:44:51.381482] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:51.394914] [DEBUG] [LOCAL ] EQBK: Loaded 11133 existing records from primary storage. [2025-10-15T18:44:51.395203] [INFO ] [MAIN ] EQBK: Loaded 11133 existing records. [2025-10-15T18:44:51.580123] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:51.581189] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-15T18:44:51.581273] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-15T18:44:51.581531] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-15T18:44:51.581628] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-15T18:44:51.972805] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:51.991421] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-15T18:44:52.079554] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:44:52.113950] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-15T18:44:52.696520] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T18:44:52.913988] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-15T18:44:53.713993] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-15T18:44:53.815407] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:44:54.513998] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-15T18:44:54.993700] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T18:44:55.054473] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:44:55.314032] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-15T18:44:55.412411] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:44:56.114042] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-15T18:44:56.834599] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T18:44:56.913962] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-15T18:44:57.166886] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T18:44:57.642290] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:44:57.713964] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-15T18:44:58.465528] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:44:58.513957] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-15T18:44:59.248560] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T18:44:59.313974] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-15T18:45:00.114016] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-15T18:45:00.835706] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T18:45:00.914036] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-15T18:45:01.178361] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T18:45:01.186067] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-15T18:45:01.186417] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-15T18:45:01.618165] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-15T18:45:01.618289] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-15T18:45:01.619798] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-15T18:45:01.619878] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-15T18:45:01.622238] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53611 (keeping 200 days of data) [2025-10-15T18:45:01.722407] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-15T18:45:02.065275] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-15T18:45:02.065485] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-15T18:45:02.065586] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPD took 34.1s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-15T18:45:02.241990] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:02.299834] [DEBUG] [LOCAL ] EQH: Loaded 52687 existing records from primary storage. [2025-10-15T18:45:02.300304] [INFO ] [MAIN ] EQH: Loaded 52687 existing records. [2025-10-15T18:45:02.492121] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:02.492424] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-15T18:45:02.492480] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-15T18:45:02.493038] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-15T18:45:02.493098] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-15T18:45:02.526387] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-15T18:45:02.779006] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:45:02.909273] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:03.056386] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-15T18:45:03.063450] [INFO ] [REMOTE ] EPR: Full fetch complete (63242 records). [2025-10-15T18:45:03.063736] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-15T18:45:03.320862] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-15T18:45:03.514860] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-15T18:45:03.515000] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-15T18:45:03.516341] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-15T18:45:03.516465] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-15T18:45:03.518548] [DEBUG] [LOCAL ] EPR: Trimmed 63242 records to 43877 (keeping 200 days of data) [2025-10-15T18:45:03.819519] [DEBUG] [LOCAL ] EPR: Primary data saved (43877 records). [2025-10-15T18:45:03.819773] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-15T18:45:03.820392] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPR took 34.5s. Estimated remaining: 3h 45m 19s. Rate: 7.2 symbols/min [2025-10-15T18:45:04.015444] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:04.074575] [DEBUG] [LOCAL ] EQNR: Loaded 53039 existing records from primary storage. [2025-10-15T18:45:04.075053] [INFO ] [MAIN ] EQNR: Loaded 53039 existing records. [2025-10-15T18:45:04.120227] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-15T18:45:04.283398] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:04.284229] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-15T18:45:04.284284] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-15T18:45:04.284465] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-15T18:45:04.284525] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-15T18:45:04.570045] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T18:45:04.710694] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:04.746078] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-15T18:45:04.914005] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-15T18:45:05.713983] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-15T18:45:05.892084] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T18:45:05.924270] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:45:06.514055] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-15T18:45:07.299725] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T18:45:07.314078] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-15T18:45:07.744001] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:45:08.114061] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-15T18:45:08.358772] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:45:08.360669] [INFO ] [REMOTE ] EQBK: Full fetch complete (15574 records). [2025-10-15T18:45:08.360741] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-15T18:45:08.740261] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-15T18:45:08.740353] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-15T18:45:08.740730] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-15T18:45:08.740792] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-15T18:45:08.741744] [DEBUG] [LOCAL ] EQBK: Trimmed 15574 records to 11247 (keeping 200 days of data) [2025-10-15T18:45:08.817713] [DEBUG] [LOCAL ] EQBK: Primary data saved (11247 records). [2025-10-15T18:45:08.817866] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-15T18:45:08.817947] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EQBK took 17.6s. Estimated remaining: 3h 45m 3s. Rate: 7.2 symbols/min [2025-10-15T18:45:08.922179] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-15T18:45:09.000895] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:09.053572] [DEBUG] [LOCAL ] EQR: Loaded 51695 existing records from primary storage. [2025-10-15T18:45:09.053946] [INFO ] [MAIN ] EQR: Loaded 51695 existing records. [2025-10-15T18:45:09.276204] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:09.276629] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-15T18:45:09.276719] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-15T18:45:09.277012] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-15T18:45:09.277070] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-15T18:45:09.671561] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:09.713960] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-15T18:45:09.804257] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T18:45:10.514028] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-15T18:45:10.798990] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T18:45:11.313968] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-15T18:45:11.568476] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T18:45:11.736903] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T18:45:12.113977] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-15T18:45:12.834231] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:45:12.913963] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-15T18:45:13.714056] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-15T18:45:13.792381] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:45:14.514036] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-15T18:45:14.742467] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:45:15.313976] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-15T18:45:15.377479] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:45:15.383096] [INFO ] [REMOTE ] EPRT: Full fetch complete (68943 records). [2025-10-15T18:45:15.383202] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-15T18:45:15.383862] [FATAL] [VALIDATOR ] EPRT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:45:15.383958] [FATAL] [MAIN ] EPRT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:45:15.384033] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:45:15.384127] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-15T18:45:15.384226] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-15T18:45:15.384271] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-10-15T18:45:15.384421] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-10-15T18:45:15.384507] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPRT took 43.3s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-15T18:45:15.548994] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:15.549153] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-15T18:45:15.549198] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-15T18:45:15.549353] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-15T18:45:15.549430] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-15T18:45:15.549476] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-15T18:45:15.549507] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-15T18:45:15.897561] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:16.059440] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:45:16.113965] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-15T18:45:16.913976] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-15T18:45:17.082907] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:45:17.714042] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-15T18:45:17.865231] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T18:45:18.334575] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T18:45:18.516172] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-15T18:45:18.524893] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T18:45:18.883439] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T18:45:19.314047] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-15T18:45:19.644842] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T18:45:20.114044] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-15T18:45:20.447797] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T18:45:20.914035] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-15T18:45:21.237968] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-15T18:45:21.714068] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-15T18:45:22.086539] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-15T18:45:22.514058] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-15T18:45:23.314101] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-15T18:45:23.857327] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:45:24.021129] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T18:45:24.113958] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-15T18:45:24.914013] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-15T18:45:25.719783] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-15T18:45:25.739314] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:45:26.230339] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:45:26.513983] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-15T18:45:26.751373] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T18:45:27.313976] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-15T18:45:28.079688] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T18:45:28.113980] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-15T18:45:28.913959] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-15T18:45:29.272938] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:45:29.405099] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:45:29.714076] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-15T18:45:29.890934] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:45:30.514034] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-15T18:45:31.314027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-15T18:45:31.491771] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:45:31.651237] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:45:32.113956] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-15T18:45:32.218036] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T18:45:32.578136] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T18:45:32.578941] [INFO ] [REMOTE ] EQS: Full fetch complete (2440 records). [2025-10-15T18:45:32.579008] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-15T18:45:32.777046] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-15T18:45:32.777270] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:45:32.777316] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:45:32.777354] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-15T18:45:32.777407] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-15T18:45:32.777440] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-15T18:45:32.777478] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-15T18:45:32.777528] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQS took 17.4s. Estimated remaining: 3h 45m 2s. Rate: 7.2 symbols/min [2025-10-15T18:45:32.919133] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-15T18:45:32.942605] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:32.992804] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-15T18:45:32.993150] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-15T18:45:33.167107] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:33.167354] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-15T18:45:33.167416] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-15T18:45:33.167953] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-15T18:45:33.168012] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-15T18:45:33.529206] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:33.714000] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-15T18:45:34.347927] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:45:34.513968] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-15T18:45:35.313985] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-15T18:45:35.740435] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:45:36.114016] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-15T18:45:36.403721] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:45:36.716215] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:45:36.913990] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-15T18:45:37.713978] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-15T18:45:37.886893] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T18:45:38.513976] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-15T18:45:38.775283] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T18:45:39.314007] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-15T18:45:39.931210] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T18:45:39.962056] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-15T18:45:40.113991] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-15T18:45:40.913974] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-15T18:45:41.128419] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T18:45:41.134746] [INFO ] [REMOTE ] EQH: Full fetch complete (76596 records). [2025-10-15T18:45:41.134864] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-15T18:45:41.511800] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-15T18:45:41.511895] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-15T18:45:41.512824] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-15T18:45:41.512896] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-15T18:45:41.514418] [DEBUG] [LOCAL ] EQH: Trimmed 76596 records to 52699 (keeping 200 days of data) [2025-10-15T18:45:41.720279] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-15T18:45:41.829556] [DEBUG] [LOCAL ] EQH: Primary data saved (52699 records). [2025-10-15T18:45:41.829739] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-15T18:45:41.829845] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQH took 39.8s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-15T18:45:41.857766] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T18:45:42.513981] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-15T18:45:42.940492] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T18:45:43.213320] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:45:43.313949] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-15T18:45:44.113987] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-15T18:45:44.247701] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:45:44.914022] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-15T18:45:45.188988] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T18:45:45.714035] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-15T18:45:46.067735] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T18:45:46.483549] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:45:46.513958] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-15T18:45:47.314030] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-15T18:45:47.841588] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T18:45:48.114035] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-15T18:45:48.287927] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:45:48.294238] [INFO ] [REMOTE ] EQR: Full fetch complete (74386 records). [2025-10-15T18:45:48.294369] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-15T18:45:48.677582] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-15T18:45:48.677706] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-15T18:45:48.679564] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-15T18:45:48.679632] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-15T18:45:48.681120] [DEBUG] [LOCAL ] EQR: Trimmed 74386 records to 51721 (keeping 200 days of data) [2025-10-15T18:45:48.997205] [DEBUG] [LOCAL ] EQR: Primary data saved (51721 records). [2025-10-15T18:45:48.997342] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-15T18:45:48.997439] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQR took 40.2s. Estimated remaining: 3h 44m 44s. Rate: 7.2 symbols/min [2025-10-15T18:45:49.212284] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-15T18:45:49.220364] [INFO ] [REMOTE ] EQNR: Full fetch complete (77001 records). [2025-10-15T18:45:49.220606] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-15T18:45:49.620577] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-15T18:45:49.620765] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-15T18:45:49.621914] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-15T18:45:49.622069] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-15T18:45:49.623739] [DEBUG] [LOCAL ] EQNR: Trimmed 77001 records to 53047 (keeping 200 days of data) [2025-10-15T18:45:49.777064] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T18:45:49.791588] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-15T18:45:49.994715] [DEBUG] [LOCAL ] EQNR: Primary data saved (53047 records). [2025-10-15T18:45:49.994895] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-15T18:45:49.995430] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQNR took 46.2s. Estimated remaining: 3h 44m 20s. Rate: 7.2 symbols/min [2025-10-15T18:45:51.676253] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:45:51.688881] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-15T18:45:53.710719] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T18:45:53.730885] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-15T18:45:55.749897] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T18:45:55.761230] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-15T18:45:57.734677] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T18:45:57.746103] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-15T18:45:59.757553] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T18:45:59.764566] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-15T18:45:59.764797] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-15T18:46:00.170074] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-15T18:46:00.170150] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-15T18:46:00.171191] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-15T18:46:00.171263] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-15T18:46:00.172768] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 53685 (keeping 200 days of data) [2025-10-15T18:46:00.490054] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-15T18:46:00.490181] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-15T18:46:00.491114] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 27.7s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-15T18:46:01.091282] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.200668] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.175223] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.222389] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.229280] [DEBUG] [LOCAL ] EQV: Loaded 2660 existing records from primary storage. [2025-10-15T18:46:01.229723] [INFO ] [MAIN ] EQV: Loaded 2660 existing records. [2025-10-15T18:46:01.464976] [DEBUG] [LOCAL ] ERO: Loaded 41797 existing records from primary storage. [2025-10-15T18:46:01.502195] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:01.502598] [INFO ] [MAIN ] ERO: Loaded 41797 existing records. [2025-10-15T18:46:01.546131] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-15T18:46:01.628460] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-15T18:46:01.640596] [DEBUG] [LOCAL ] ERJ: Loaded 50329 existing records from primary storage. [2025-10-15T18:46:01.659408] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-15T18:46:01.653527] [DEBUG] [LOCAL ] ES: Loaded 52697 existing records from primary storage. [2025-10-15T18:46:01.659735] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-15T18:46:01.670585] [INFO ] [MAIN ] ES: Loaded 52697 existing records. [2025-10-15T18:46:01.697188] [INFO ] [MAIN ] ERJ: Loaded 50329 existing records. [2025-10-15T18:46:01.997547] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:02.076575] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-15T18:46:02.134041] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-15T18:46:02.263284] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-15T18:46:02.323240] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:02.344241] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-15T18:46:02.347699] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:02.373545] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-15T18:46:02.378933] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-15T18:46:02.409796] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-15T18:46:02.420333] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-15T18:46:02.415026] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-15T18:46:02.443449] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-15T18:46:02.537832] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-15T18:46:02.616706] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-15T18:46:02.959430] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.027849] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-15T18:46:03.602419] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.612804] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-15T18:46:03.612440] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.640302] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-15T18:46:03.719740] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.720188] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-15T18:46:03.878765] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T18:46:03.880855] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-15T18:46:04.644014] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:46:04.646361] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-15T18:46:05.053975] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T18:46:05.062096] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-15T18:46:05.081479] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:46:05.082981] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-15T18:46:05.152331] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:46:05.162839] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-15T18:46:05.290995] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:46:05.300225] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-15T18:46:05.629590] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T18:46:05.631317] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-15T18:46:06.022083] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T18:46:06.023349] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-15T18:46:06.230266] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:46:06.238062] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-15T18:46:06.340297] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T18:46:06.341773] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-15T18:46:06.885075] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:46:06.886562] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-15T18:46:06.922901] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:46:06.933613] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-15T18:46:06.970856] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T18:46:06.980631] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-15T18:46:07.236390] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:46:07.244670] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-15T18:46:07.308224] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T18:46:07.313939] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-15T18:46:07.866686] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T18:46:08.114052] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-15T18:46:08.561226] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:46:08.712688] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T18:46:08.728011] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T18:46:08.813208] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:46:08.913986] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-15T18:46:09.714043] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-15T18:46:10.427731] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T18:46:10.428506] [INFO ] [REMOTE ] EQV: Full fetch complete (5489 records). [2025-10-15T18:46:10.428573] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-15T18:46:10.519185] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-15T18:46:10.756572] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T18:46:10.837724] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-15T18:46:10.837806] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-15T18:46:10.837977] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-15T18:46:10.838015] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-15T18:46:10.838369] [DEBUG] [LOCAL ] EQV: Trimmed 5489 records to 2688 (keeping 200 days of data) [2025-10-15T18:46:10.853900] [DEBUG] [LOCAL ] EQV: Primary data saved (2688 records). [2025-10-15T18:46:10.853966] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-15T18:46:10.854035] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 10.4s. Estimated remaining: 3h 44m 12s. Rate: 7.2 symbols/min [2025-10-15T18:46:11.017995] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:11.043730] [DEBUG] [LOCAL ] ESAB: Loaded 26055 existing records from primary storage. [2025-10-15T18:46:11.043996] [INFO ] [MAIN ] ESAB: Loaded 26055 existing records. [2025-10-15T18:46:11.217303] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:11.217543] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-15T18:46:11.217591] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-15T18:46:11.218133] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-15T18:46:11.218190] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-15T18:46:11.319580] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-15T18:46:11.583629] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:12.093304] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:46:12.114001] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-15T18:46:12.874854] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T18:46:12.913991] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-15T18:46:13.714029] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-15T18:46:13.974199] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T18:46:14.359997] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:46:14.513989] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-15T18:46:14.680157] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T18:46:15.313998] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-15T18:46:16.111506] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:46:16.120551] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-15T18:46:16.881451] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:46:16.913964] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-15T18:46:17.090333] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T18:46:17.714064] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-15T18:46:18.135061] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:46:18.514040] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-15T18:46:18.747954] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:46:19.313996] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-15T18:46:20.114029] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-15T18:46:20.265414] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:46:20.309286] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:46:20.914022] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-15T18:46:21.657557] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:46:21.713978] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-15T18:46:22.514087] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-15T18:46:22.746665] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:46:23.323925] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-15T18:46:23.349571] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T18:46:23.466966] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T18:46:24.114061] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-15T18:46:24.914074] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-15T18:46:25.021094] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T18:46:25.027201] [INFO ] [REMOTE ] ERO: Full fetch complete (60294 records). [2025-10-15T18:46:25.027358] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-15T18:46:25.405335] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-15T18:46:25.405416] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-15T18:46:25.406226] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-15T18:46:25.406288] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-15T18:46:25.407432] [DEBUG] [LOCAL ] ERO: Trimmed 60294 records to 41875 (keeping 200 days of data) [2025-10-15T18:46:25.648085] [DEBUG] [LOCAL ] ERO: Primary data saved (41875 records). [2025-10-15T18:46:25.648253] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-15T18:46:25.648343] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 25.2s. Estimated remaining: 3h 44m 17s. Rate: 7.2 symbols/min [2025-10-15T18:46:25.718209] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-15T18:46:25.828226] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:25.844496] [DEBUG] [LOCAL ] ESE: Loaded 16489 existing records from primary storage. [2025-10-15T18:46:25.844739] [INFO ] [MAIN ] ESE: Loaded 16489 existing records. [2025-10-15T18:46:26.023283] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:26.023682] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-15T18:46:26.023763] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-15T18:46:26.024313] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-15T18:46:26.024380] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-15T18:46:26.194085] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T18:46:26.487596] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:26.513959] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-15T18:46:26.653096] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T18:46:26.884190] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:46:27.313973] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-15T18:46:27.339149] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:46:28.113993] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-15T18:46:28.914026] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-15T18:46:29.183338] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T18:46:29.228734] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:46:29.433308] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T18:46:29.713993] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-15T18:46:30.514066] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-15T18:46:31.314091] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-15T18:46:31.519292] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:46:32.114018] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-15T18:46:32.318493] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:46:32.505341] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:46:32.914010] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-15T18:46:33.115711] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:46:33.714071] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-15T18:46:34.513967] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-15T18:46:34.554619] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:46:34.733567] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T18:46:35.314057] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-15T18:46:35.907514] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T18:46:36.114005] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-15T18:46:36.706458] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T18:46:36.712517] [INFO ] [REMOTE ] ERJ: Full fetch complete (72735 records). [2025-10-15T18:46:36.712716] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-15T18:46:36.919068] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-15T18:46:37.113982] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-15T18:46:37.114097] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-15T18:46:37.115218] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-15T18:46:37.115281] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-15T18:46:37.116695] [DEBUG] [LOCAL ] ERJ: Trimmed 72735 records to 50317 (keeping 200 days of data) [2025-10-15T18:46:37.215524] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T18:46:37.433204] [DEBUG] [LOCAL ] ERJ: Primary data saved (50317 records). [2025-10-15T18:46:37.433352] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-15T18:46:37.433437] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ERJ took 36.9s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-15T18:46:37.601016] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:37.646298] [DEBUG] [LOCAL ] ESI: Loaded 50665 existing records from primary storage. [2025-10-15T18:46:37.646626] [INFO ] [MAIN ] ESI: Loaded 50665 existing records. [2025-10-15T18:46:37.719134] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-15T18:46:37.822170] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:37.822371] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-15T18:46:37.822417] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-15T18:46:37.823254] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-15T18:46:37.823326] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-15T18:46:38.210031] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:38.514009] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-15T18:46:38.551342] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:46:38.575076] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T18:46:39.313992] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-15T18:46:40.091502] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T18:46:40.113940] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-15T18:46:40.166981] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T18:46:40.913993] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-15T18:46:41.708790] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T18:46:41.719185] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-15T18:46:41.870793] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T18:46:42.514020] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-15T18:46:43.314030] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-15T18:46:43.358541] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:46:43.460932] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:46:44.113992] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-15T18:46:44.286103] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T18:46:44.290972] [INFO ] [REMOTE ] ESAB: Full fetch complete (36059 records). [2025-10-15T18:46:44.291064] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-15T18:46:44.660615] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-15T18:46:44.660725] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-15T18:46:44.661347] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-15T18:46:44.661389] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-15T18:46:44.662230] [DEBUG] [LOCAL ] ESAB: Trimmed 36059 records to 26058 (keeping 200 days of data) [2025-10-15T18:46:44.825568] [DEBUG] [LOCAL ] ESAB: Primary data saved (26058 records). [2025-10-15T18:46:44.825726] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-15T18:46:44.825816] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ESAB took 34.0s. Estimated remaining: 3h 44m 6s. Rate: 7.2 symbols/min [2025-10-15T18:46:44.919360] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-15T18:46:44.953805] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:46:45.025836] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:45.063028] [DEBUG] [LOCAL ] ESNT: Loaded 38293 existing records from primary storage. [2025-10-15T18:46:45.063324] [INFO ] [MAIN ] ESNT: Loaded 38293 existing records. [2025-10-15T18:46:45.238911] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:45.239127] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-15T18:46:45.239177] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-15T18:46:45.239465] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-15T18:46:45.239503] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-15T18:46:45.600573] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:45.714048] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-15T18:46:45.744453] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T18:46:45.756002] [INFO ] [REMOTE ] ES: Full fetch complete (76443 records). [2025-10-15T18:46:45.756338] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-15T18:46:46.248528] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-15T18:46:46.248716] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-15T18:46:46.250193] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-15T18:46:46.250341] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-15T18:46:46.252073] [DEBUG] [LOCAL ] ES: Trimmed 76443 records to 52695 (keeping 200 days of data) [2025-10-15T18:46:46.550288] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-15T18:46:46.702052] [DEBUG] [LOCAL ] ES: Primary data saved (52695 records). [2025-10-15T18:46:46.702268] [INFO ] [MAIN ] ES: Full history saved. [2025-10-15T18:46:46.702388] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ES took 46.2s. Estimated remaining: 3h 43m 44s. Rate: 7.2 symbols/min [2025-10-15T18:46:46.917874] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:46.966120] [DEBUG] [LOCAL ] ESRT: Loaded 46416 existing records from primary storage. [2025-10-15T18:46:46.966539] [INFO ] [MAIN ] ESRT: Loaded 46416 existing records. [2025-10-15T18:46:47.181601] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:47.182081] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-15T18:46:47.182188] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-15T18:46:47.182756] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-15T18:46:47.182817] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-15T18:46:47.317116] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-15T18:46:47.321125] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:46:47.625014] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:48.040755] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:46:48.087211] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T18:46:48.113999] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-15T18:46:48.913970] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-15T18:46:49.153566] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:46:49.156166] [INFO ] [REMOTE ] ESE: Full fetch complete (22602 records). [2025-10-15T18:46:49.156271] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-15T18:46:49.527807] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-15T18:46:49.527924] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-15T18:46:49.528617] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-15T18:46:49.528711] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-15T18:46:49.529607] [DEBUG] [LOCAL ] ESE: Trimmed 22602 records to 16509 (keeping 200 days of data) [2025-10-15T18:46:49.640582] [DEBUG] [LOCAL ] ESE: Primary data saved (16509 records). [2025-10-15T18:46:49.640761] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-15T18:46:49.640866] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 24.0s. Estimated remaining: 3h 43m 24s. Rate: 7.2 symbols/min [2025-10-15T18:46:49.719156] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-15T18:46:49.825580] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:49.863165] [DEBUG] [LOCAL ] ESS: Loaded 29971 existing records from primary storage. [2025-10-15T18:46:49.863460] [INFO ] [MAIN ] ESS: Loaded 29971 existing records. [2025-10-15T18:46:50.071503] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:50.071739] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-15T18:46:50.071791] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-15T18:46:50.072134] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-15T18:46:50.072195] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-15T18:46:50.442591] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:50.474295] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T18:46:50.514015] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-15T18:46:51.314033] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-15T18:46:51.473028] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:46:51.767211] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:46:52.114047] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-15T18:46:52.427558] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T18:46:52.914016] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-15T18:46:53.717755] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-15T18:46:53.723290] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:46:54.342477] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:46:54.514026] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-15T18:46:55.313993] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-15T18:46:55.417187] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T18:46:55.958243] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:46:56.114048] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-15T18:46:56.685418] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T18:46:56.914047] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-15T18:46:57.659880] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T18:46:57.713949] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-15T18:46:58.271964] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T18:46:58.514090] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-15T18:46:59.167431] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T18:46:59.314025] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-15T18:46:59.727218] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T18:47:00.114151] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-15T18:47:00.788082] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:47:00.913969] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-15T18:47:01.573928] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T18:47:01.714064] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-15T18:47:02.408067] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T18:47:02.514015] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-15T18:47:02.997926] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T18:47:03.314043] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-15T18:47:04.113973] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-15T18:47:04.225623] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T18:47:04.287063] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:47:04.914071] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-15T18:47:05.552882] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T18:47:05.714018] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-15T18:47:05.918883] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T18:47:06.514052] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-15T18:47:07.018554] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T18:47:07.314072] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-15T18:47:08.114085] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-15T18:47:08.160345] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:47:08.856261] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:47:08.913985] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-15T18:47:09.430438] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T18:47:09.714008] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-15T18:47:10.513976] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-15T18:47:10.828862] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T18:47:11.042963] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T18:47:11.046728] [INFO ] [REMOTE ] ESS: Full fetch complete (43582 records). [2025-10-15T18:47:11.046813] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-15T18:47:11.321544] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-15T18:47:11.423281] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-15T18:47:11.423358] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-15T18:47:11.424064] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-15T18:47:11.424125] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-15T18:47:11.425077] [DEBUG] [LOCAL ] ESS: Trimmed 43582 records to 30136 (keeping 200 days of data) [2025-10-15T18:47:11.613435] [DEBUG] [LOCAL ] ESS: Primary data saved (30136 records). [2025-10-15T18:47:11.613565] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-15T18:47:11.613664] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESS took 22.0s. Estimated remaining: 3h 43m 44s. Rate: 7.2 symbols/min [2025-10-15T18:47:11.780730] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:11.829295] [DEBUG] [LOCAL ] ESTC: Loaded 50322 existing records from primary storage. [2025-10-15T18:47:11.829672] [INFO ] [MAIN ] ESTC: Loaded 50322 existing records. [2025-10-15T18:47:12.009007] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:12.009278] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-15T18:47:12.009472] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-15T18:47:12.009888] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-15T18:47:12.009955] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-15T18:47:12.114791] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-15T18:47:12.340955] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T18:47:12.423131] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:12.618147] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:47:12.913992] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-15T18:47:13.618449] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:47:13.713962] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-15T18:47:14.515769] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-15T18:47:14.523180] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:47:15.088075] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T18:47:15.314037] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-15T18:47:16.113985] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-15T18:47:16.147155] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:47:16.680103] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:47:16.913975] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-15T18:47:17.714027] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-15T18:47:17.937847] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-15T18:47:17.945628] [INFO ] [REMOTE ] ESI: Full fetch complete (73133 records). [2025-10-15T18:47:17.945835] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-15T18:47:18.338053] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-15T18:47:18.338215] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-15T18:47:18.339171] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-15T18:47:18.339267] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-15T18:47:18.352726] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:47:18.358075] [INFO ] [REMOTE ] ESNT: Full fetch complete (57191 records). [2025-10-15T18:47:18.358255] [DEBUG] [LOCAL ] ESI: Trimmed 73133 records to 50648 (keeping 200 days of data) [2025-10-15T18:47:18.358541] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-15T18:47:18.520293] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-15T18:47:19.002033] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-15T18:47:19.003556] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-15T18:47:19.004680] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-15T18:47:19.004758] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-15T18:47:19.034009] [DEBUG] [LOCAL ] ESNT: Trimmed 57191 records to 38289 (keeping 200 days of data) [2025-10-15T18:47:19.187239] [DEBUG] [LOCAL ] ESI: Primary data saved (50648 records). [2025-10-15T18:47:19.187928] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-15T18:47:19.188054] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 41.8s. Estimated remaining: 3h 43m 34s. Rate: 7.2 symbols/min [2025-10-15T18:47:19.450860] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:19.480969] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:47:19.497391] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-15T18:47:19.537739] [DEBUG] [LOCAL ] ESNT: Primary data saved (38289 records). [2025-10-15T18:47:19.537913] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-15T18:47:19.538013] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESNT took 34.7s. Estimated remaining: 3h 43m 9s. Rate: 7.2 symbols/min [2025-10-15T18:47:19.661204] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-15T18:47:19.677331] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-15T18:47:19.788929] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:19.907468] [DEBUG] [LOCAL ] ETB: Loaded 12065 existing records from primary storage. [2025-10-15T18:47:19.938542] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:19.939333] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-15T18:47:19.939038] [INFO ] [MAIN ] ETB: Loaded 12065 existing records. [2025-10-15T18:47:19.939488] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-15T18:47:19.971348] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-15T18:47:19.982795] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-15T18:47:20.232716] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:20.258939] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-15T18:47:20.272218] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-15T18:47:20.342842] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-15T18:47:20.392878] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-15T18:47:20.479676] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-15T18:47:20.628359] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-15T18:47:20.696632] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:20.900946] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:20.913949] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-15T18:47:21.112617] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T18:47:21.714021] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-15T18:47:21.992920] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T18:47:22.158678] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:47:22.514005] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-15T18:47:23.313996] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-15T18:47:23.500806] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:47:23.938529] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T18:47:24.081431] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T18:47:24.113961] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-15T18:47:24.914040] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-15T18:47:25.656470] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:47:25.713990] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-15T18:47:26.524913] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-15T18:47:26.533892] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T18:47:27.314010] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-15T18:47:27.382490] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:47:27.389558] [INFO ] [REMOTE ] ESRT: Full fetch complete (66551 records). [2025-10-15T18:47:27.389895] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-15T18:47:27.786278] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-15T18:47:27.786432] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-15T18:47:27.787297] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-15T18:47:27.787362] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-15T18:47:27.792333] [DEBUG] [LOCAL ] ESRT: Trimmed 66551 records to 46481 (keeping 200 days of data) [2025-10-15T18:47:28.060867] [DEBUG] [LOCAL ] ESRT: Primary data saved (46481 records). [2025-10-15T18:47:28.061017] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-15T18:47:28.062324] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESRT took 41.4s. Estimated remaining: 3h 43m 1s. Rate: 7.2 symbols/min [2025-10-15T18:47:28.119082] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-15T18:47:28.241473] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:28.272845] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:47:28.285955] [DEBUG] [LOCAL ] ETD: Loaded 27280 existing records from primary storage. [2025-10-15T18:47:28.286197] [INFO ] [MAIN ] ETD: Loaded 27280 existing records. [2025-10-15T18:47:28.462855] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:28.463013] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-15T18:47:28.463059] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-15T18:47:28.463402] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-15T18:47:28.463628] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-15T18:47:28.833766] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:28.913978] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-15T18:47:28.963807] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-15T18:47:29.622085] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T18:47:29.714077] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-15T18:47:29.926778] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T18:47:30.513981] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-15T18:47:30.554513] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T18:47:31.314020] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-15T18:47:31.952151] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:47:32.114006] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-15T18:47:32.658539] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-15T18:47:32.913978] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-15T18:47:33.059067] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T18:47:33.713975] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-15T18:47:34.104206] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:47:34.513960] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-15T18:47:35.257596] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:47:35.258433] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T18:47:35.313948] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-15T18:47:36.114073] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-15T18:47:36.138163] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T18:47:36.914066] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-15T18:47:37.714012] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-15T18:47:37.743665] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T18:47:37.993560] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T18:47:38.514059] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-15T18:47:39.314119] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-15T18:47:39.433131] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:47:39.951896] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T18:47:40.114105] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-15T18:47:40.723518] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-15T18:47:40.914010] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-15T18:47:41.714030] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-15T18:47:41.843596] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:47:42.256870] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T18:47:42.514014] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-15T18:47:43.219588] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-15T18:47:43.314028] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-15T18:47:44.114061] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-15T18:47:44.185870] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T18:47:44.246488] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T18:47:44.248969] [INFO ] [REMOTE ] ETB: Full fetch complete (18298 records). [2025-10-15T18:47:44.249060] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-15T18:47:44.667971] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-15T18:47:44.668072] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-15T18:47:44.668619] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-15T18:47:44.668707] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-15T18:47:44.669251] [DEBUG] [LOCAL ] ETB: Trimmed 18298 records to 11985 (keeping 200 days of data) [2025-10-15T18:47:44.748104] [DEBUG] [LOCAL ] ETB: Primary data saved (11985 records). [2025-10-15T18:47:44.748241] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-15T18:47:44.748325] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ETB took 25.2s. Estimated remaining: 3h 43m 10s. Rate: 7.2 symbols/min [2025-10-15T18:47:44.925513] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-15T18:47:44.946485] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:44.965957] [DEBUG] [LOCAL ] ETG: Loaded 16697 existing records from primary storage. [2025-10-15T18:47:44.966209] [INFO ] [MAIN ] ETG: Loaded 16697 existing records. [2025-10-15T18:47:45.161223] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:45.161459] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-15T18:47:45.161517] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-15T18:47:45.161807] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-15T18:47:45.161879] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-15T18:47:45.543041] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:45.714005] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-15T18:47:46.400283] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-15T18:47:46.430023] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:47:46.436117] [INFO ] [REMOTE ] ESTC: Full fetch complete (72405 records). [2025-10-15T18:47:46.436233] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-15T18:47:46.520110] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-15T18:47:46.820491] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-15T18:47:46.820568] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-15T18:47:46.821455] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-15T18:47:46.821518] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-15T18:47:46.822862] [DEBUG] [LOCAL ] ESTC: Trimmed 72405 records to 50337 (keeping 200 days of data) [2025-10-15T18:47:46.918591] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:47:47.129525] [DEBUG] [LOCAL ] ESTC: Primary data saved (50337 records). [2025-10-15T18:47:47.129717] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-15T18:47:47.130226] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ESTC took 35.5s. Estimated remaining: 3h 42m 49s. Rate: 7.2 symbols/min [2025-10-15T18:47:47.308206] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:47.314039] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-15T18:47:47.327589] [DEBUG] [LOCAL ] ETJ: Loaded 16926 existing records from primary storage. [2025-10-15T18:47:47.327862] [INFO ] [MAIN ] ETJ: Loaded 16926 existing records. [2025-10-15T18:47:47.508501] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:47.508740] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-15T18:47:47.508793] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-15T18:47:47.508970] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-15T18:47:47.509025] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-15T18:47:47.853201] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T18:47:47.917296] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:48.113979] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-15T18:47:48.379037] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:47:48.914025] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-15T18:47:49.266637] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T18:47:49.713982] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-15T18:47:50.513967] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-15T18:47:50.687541] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T18:47:51.011380] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T18:47:51.313998] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-15T18:47:51.475745] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T18:47:52.114013] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-15T18:47:52.914013] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-15T18:47:53.421483] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:47:53.540230] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T18:47:53.707145] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T18:47:53.713941] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-15T18:47:54.518134] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-15T18:47:54.521018] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T18:47:55.314001] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-15T18:47:56.113987] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-15T18:47:56.368005] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:47:56.755901] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-15T18:47:56.914015] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-15T18:47:57.214809] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T18:47:57.714025] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-15T18:47:57.912013] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:47:58.514076] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-15T18:47:59.314067] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-15T18:47:59.671794] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T18:47:59.717829] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T18:48:00.114074] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-15T18:48:00.285224] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T18:48:00.914095] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-15T18:48:00.956873] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:48:01.713987] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-15T18:48:01.939169] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:48:02.514086] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-15T18:48:03.313980] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-15T18:48:03.591793] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T18:48:04.063782] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-15T18:48:04.070602] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-15T18:48:04.070810] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-15T18:48:04.115122] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-15T18:48:04.208895] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T18:48:04.510362] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-15T18:48:04.510447] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-15T18:48:04.511387] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-15T18:48:04.511450] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-15T18:48:04.512947] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-15T18:48:04.839716] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-15T18:48:04.839905] [INFO ] [MAIN ] ET: Full history saved. [2025-10-15T18:48:04.840017] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 45.7s. Estimated remaining: 3h 42m 60s. Rate: 7.2 symbols/min [2025-10-15T18:48:04.919112] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-15T18:48:05.008463] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:05.059105] [DEBUG] [LOCAL ] ETN: Loaded 52656 existing records from primary storage. [2025-10-15T18:48:05.059433] [INFO ] [MAIN ] ETN: Loaded 52656 existing records. [2025-10-15T18:48:05.239179] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:05.239431] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-15T18:48:05.239503] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-15T18:48:05.245316] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-15T18:48:05.254268] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-15T18:48:05.254832] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T18:48:05.641633] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:05.714020] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-15T18:48:06.046745] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:48:06.049532] [INFO ] [REMOTE ] ETG: Full fetch complete (24848 records). [2025-10-15T18:48:06.049682] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-15T18:48:06.455920] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-15T18:48:06.456026] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-15T18:48:06.456587] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-15T18:48:06.456628] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-15T18:48:06.457260] [DEBUG] [LOCAL ] ETG: Trimmed 24848 records to 16670 (keeping 200 days of data) [2025-10-15T18:48:06.535062] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-15T18:48:06.568678] [DEBUG] [LOCAL ] ETG: Primary data saved (16670 records). [2025-10-15T18:48:06.568837] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-15T18:48:06.568925] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETG took 21.8s. Estimated remaining: 3h 42m 38s. Rate: 7.2 symbols/min [2025-10-15T18:48:06.738334] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:06.747036] [DEBUG] [LOCAL ] ETO: Loaded 6995 existing records from primary storage. [2025-10-15T18:48:06.747234] [INFO ] [MAIN ] ETO: Loaded 6995 existing records. [2025-10-15T18:48:06.918944] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:06.919139] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-15T18:48:06.919186] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-15T18:48:06.919332] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-15T18:48:06.919368] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-15T18:48:07.274160] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:07.313954] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-15T18:48:07.327138] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T18:48:07.431840] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:48:07.920558] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T18:48:08.114034] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-15T18:48:08.913971] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-15T18:48:09.142049] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:48:09.713998] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-15T18:48:10.513985] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-15T18:48:10.874854] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:48:10.907759] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:48:11.089456] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T18:48:11.314051] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-15T18:48:12.114010] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-15T18:48:12.530973] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:48:12.914009] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-15T18:48:13.045992] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T18:48:13.713984] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-15T18:48:14.507523] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T18:48:14.517235] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-15T18:48:14.532010] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:48:15.314040] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-15T18:48:15.689877] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T18:48:16.114056] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-15T18:48:16.914034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-15T18:48:17.339179] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T18:48:17.398008] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T18:48:17.714064] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-15T18:48:18.320184] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:48:18.324276] [INFO ] [REMOTE ] ETD: Full fetch complete (38651 records). [2025-10-15T18:48:18.324421] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-15T18:48:18.520274] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-15T18:48:18.714339] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-15T18:48:18.714457] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-15T18:48:18.715474] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-15T18:48:18.715539] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-15T18:48:18.716874] [DEBUG] [LOCAL ] ETD: Trimmed 38651 records to 27336 (keeping 200 days of data) [2025-10-15T18:48:18.819341] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T18:48:18.919527] [DEBUG] [LOCAL ] ETD: Primary data saved (27336 records). [2025-10-15T18:48:18.919714] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-15T18:48:18.919831] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETD took 50.9s. Estimated remaining: 3h 42m 38s. Rate: 7.2 symbols/min [2025-10-15T18:48:19.088590] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:19.138357] [DEBUG] [LOCAL ] ETR: Loaded 53213 existing records from primary storage. [2025-10-15T18:48:19.138748] [INFO ] [MAIN ] ETR: Loaded 53213 existing records. [2025-10-15T18:48:19.315311] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-15T18:48:19.341292] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:19.342758] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-15T18:48:19.342851] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-15T18:48:19.343080] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-15T18:48:19.343122] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-15T18:48:19.692763] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T18:48:19.738240] [INFO ] [REMOTE ] ETJ: Full fetch complete (25580 records). [2025-10-15T18:48:19.750698] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-15T18:48:19.781966] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:20.119118] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-15T18:48:20.155266] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-15T18:48:20.155347] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-15T18:48:20.155997] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-15T18:48:20.156060] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-15T18:48:20.156743] [DEBUG] [LOCAL ] ETJ: Trimmed 25580 records to 16847 (keeping 200 days of data) [2025-10-15T18:48:20.260682] [DEBUG] [LOCAL ] ETJ: Primary data saved (16847 records). [2025-10-15T18:48:20.260824] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-15T18:48:20.260906] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETJ took 33.1s. Estimated remaining: 3h 42m 15s. Rate: 7.2 symbols/min [2025-10-15T18:48:20.431794] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:20.482089] [DEBUG] [LOCAL ] ETSY: Loaded 53577 existing records from primary storage. [2025-10-15T18:48:20.482453] [INFO ] [MAIN ] ETSY: Loaded 53577 existing records. [2025-10-15T18:48:20.675091] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:20.675316] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-15T18:48:20.675364] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-15T18:48:20.675847] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-15T18:48:20.675904] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-15T18:48:20.922603] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-15T18:48:21.037050] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:21.454097] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T18:48:21.488920] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-15T18:48:21.714014] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-15T18:48:21.984175] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T18:48:22.514025] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-15T18:48:23.314010] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-15T18:48:23.564735] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T18:48:23.892334] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T18:48:24.113963] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-15T18:48:24.274991] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:48:24.913995] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-15T18:48:25.714045] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-15T18:48:25.894232] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T18:48:26.514047] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-15T18:48:26.950126] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T18:48:27.228236] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T18:48:27.323154] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-15T18:48:27.344444] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T18:48:28.114061] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-15T18:48:28.823940] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T18:48:28.913993] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-15T18:48:29.109207] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T18:48:29.714010] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-15T18:48:30.513976] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-15T18:48:30.778820] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T18:48:31.221814] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T18:48:31.313981] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-15T18:48:31.566154] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T18:48:32.114189] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-15T18:48:32.914059] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-15T18:48:33.071753] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T18:48:33.608400] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:48:33.713956] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-15T18:48:34.360704] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:48:34.513998] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-15T18:48:35.313994] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-15T18:48:35.584690] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T18:48:35.756159] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:48:36.114093] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-15T18:48:36.335442] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T18:48:36.914013] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-15T18:48:37.582519] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:48:37.713976] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-15T18:48:38.514016] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-15T18:48:38.656065] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T18:48:39.116221] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:48:39.313978] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-15T18:48:39.459998] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T18:48:40.114012] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-15T18:48:40.807575] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T18:48:40.809359] [INFO ] [REMOTE ] ETO: Full fetch complete (9733 records). [2025-10-15T18:48:40.809427] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-15T18:48:40.917804] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-15T18:48:41.182484] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-15T18:48:41.182586] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-15T18:48:41.182973] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-15T18:48:41.183052] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-15T18:48:41.183689] [DEBUG] [LOCAL ] ETO: Trimmed 9733 records to 6976 (keeping 200 days of data) [2025-10-15T18:48:41.249512] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T18:48:41.271092] [DEBUG] [LOCAL ] ETO: Primary data saved (6976 records). [2025-10-15T18:48:41.271211] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-15T18:48:41.271287] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETO took 34.7s. Estimated remaining: 3h 42m 32s. Rate: 7.2 symbols/min [2025-10-15T18:48:41.439025] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:41.461619] [DEBUG] [LOCAL ] ETV: Loaded 22316 existing records from primary storage. [2025-10-15T18:48:41.461884] [INFO ] [MAIN ] ETV: Loaded 22316 existing records. [2025-10-15T18:48:41.654262] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:41.654506] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-15T18:48:41.654554] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-15T18:48:41.654889] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-15T18:48:41.654947] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-15T18:48:41.719358] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-15T18:48:42.013571] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:42.514094] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-15T18:48:43.120225] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-15T18:48:43.314018] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-15T18:48:43.681951] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T18:48:43.757580] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:48:44.114063] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-15T18:48:44.913991] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-15T18:48:45.321694] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T18:48:45.713999] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-15T18:48:45.899726] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T18:48:46.514000] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-15T18:48:46.868193] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T18:48:47.314003] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-15T18:48:47.489398] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T18:48:47.674372] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:48:47.680865] [INFO ] [REMOTE ] ETN: Full fetch complete (76659 records). [2025-10-15T18:48:47.680987] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-15T18:48:48.065469] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-15T18:48:48.065564] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-15T18:48:48.066542] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-15T18:48:48.066606] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-15T18:48:48.068163] [DEBUG] [LOCAL ] ETN: Trimmed 76659 records to 52641 (keeping 200 days of data) [2025-10-15T18:48:48.124120] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-15T18:48:48.395969] [DEBUG] [LOCAL ] ETN: Primary data saved (52641 records). [2025-10-15T18:48:48.396143] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-15T18:48:48.396245] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETN took 43.6s. Estimated remaining: 3h 42m 21s. Rate: 7.2 symbols/min [2025-10-15T18:48:48.561187] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:48.587977] [DEBUG] [LOCAL ] ETW: Loaded 25635 existing records from primary storage. [2025-10-15T18:48:48.588260] [INFO ] [MAIN ] ETW: Loaded 25635 existing records. [2025-10-15T18:48:48.767818] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:48.768156] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-15T18:48:48.768233] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-15T18:48:48.768575] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-15T18:48:48.768688] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-15T18:48:48.927829] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-15T18:48:49.105730] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:48:49.182809] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T18:48:49.214908] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:49.714018] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-15T18:48:50.514003] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-15T18:48:50.737844] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T18:48:50.784629] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T18:48:51.313992] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-15T18:48:51.537227] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T18:48:52.059743] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T18:48:52.113980] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-15T18:48:52.914008] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-15T18:48:53.139596] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:48:53.713976] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-15T18:48:54.052846] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T18:48:54.514050] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-15T18:48:55.314255] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-15T18:48:55.320200] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:48:55.327029] [INFO ] [REMOTE ] ETR: Full fetch complete (77274 records). [2025-10-15T18:48:55.327193] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-15T18:48:55.745217] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-15T18:48:55.746304] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T18:48:55.746389] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-15T18:48:55.753394] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-15T18:48:55.754011] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-15T18:48:55.755511] [DEBUG] [LOCAL ] ETR: Trimmed 77274 records to 53210 (keeping 200 days of data) [2025-10-15T18:48:56.095083] [DEBUG] [LOCAL ] ETR: Primary data saved (53210 records). [2025-10-15T18:48:56.095222] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-15T18:48:56.096104] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETR took 37.2s. Estimated remaining: 3h 42m 11s. Rate: 7.2 symbols/min [2025-10-15T18:48:56.119114] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-15T18:48:56.265902] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:56.274528] [DEBUG] [LOCAL ] ETX: Loaded 5253 existing records from primary storage. [2025-10-15T18:48:56.274774] [INFO ] [MAIN ] ETX: Loaded 5253 existing records. [2025-10-15T18:48:56.457471] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:56.458014] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-15T18:48:56.458119] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-15T18:48:56.463511] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-15T18:48:56.470629] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-15T18:48:56.477366] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T18:48:56.873705] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:56.913974] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-15T18:48:57.713977] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-15T18:48:57.736558] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T18:48:58.172792] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T18:48:58.179230] [INFO ] [REMOTE ] ETSY: Full fetch complete (77667 records). [2025-10-15T18:48:58.179347] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-15T18:48:58.523108] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-15T18:48:58.561483] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-15T18:48:58.561605] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-15T18:48:58.562607] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-15T18:48:58.562764] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-15T18:48:58.564190] [DEBUG] [LOCAL ] ETSY: Trimmed 77667 records to 53577 (keeping 200 days of data) [2025-10-15T18:48:58.789029] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:48:58.903516] [DEBUG] [LOCAL ] ETSY: Primary data saved (53577 records). [2025-10-15T18:48:58.903672] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-15T18:48:58.904129] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETSY took 38.6s. Estimated remaining: 3h 41m 52s. Rate: 7.2 symbols/min [2025-10-15T18:48:59.071332] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:59.094360] [DEBUG] [LOCAL ] ETY: Loaded 23026 existing records from primary storage. [2025-10-15T18:48:59.094593] [INFO ] [MAIN ] ETY: Loaded 23026 existing records. [2025-10-15T18:48:59.265850] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:59.266023] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-15T18:48:59.266070] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-15T18:48:59.266332] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-15T18:48:59.266387] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-15T18:48:59.327065] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-15T18:48:59.616437] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:59.891351] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:48:59.906757] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T18:49:00.114030] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-15T18:49:00.913968] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-15T18:49:01.010202] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:49:01.446478] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T18:49:01.714062] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-15T18:49:02.513966] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-15T18:49:02.882936] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T18:49:03.147872] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:49:03.314005] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-15T18:49:04.113959] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-15T18:49:04.453414] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:49:04.717362] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T18:49:04.913990] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-15T18:49:05.713968] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-15T18:49:05.971846] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T18:49:06.513963] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-15T18:49:06.709774] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T18:49:07.050756] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T18:49:07.314007] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-15T18:49:08.113987] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-15T18:49:08.250733] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:49:08.914085] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-15T18:49:09.296853] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T18:49:09.619263] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T18:49:09.714020] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-15T18:49:10.514020] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-15T18:49:10.795248] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:49:11.314016] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-15T18:49:11.783577] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T18:49:11.787633] [INFO ] [REMOTE ] ETV: Full fetch complete (32478 records). [2025-10-15T18:49:11.787788] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-15T18:49:12.120678] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-15T18:49:12.171906] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-15T18:49:12.172116] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-15T18:49:12.173058] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-15T18:49:12.173214] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-15T18:49:12.174543] [DEBUG] [LOCAL ] ETV: Trimmed 32478 records to 22258 (keeping 200 days of data) [2025-10-15T18:49:12.311353] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:49:12.342769] [DEBUG] [LOCAL ] ETV: Primary data saved (22258 records). [2025-10-15T18:49:12.342885] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-15T18:49:12.342963] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETV took 31.1s. Estimated remaining: 3h 41m 54s. Rate: 7.2 symbols/min [2025-10-15T18:49:12.526204] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:12.545287] [DEBUG] [LOCAL ] EVC: Loaded 18136 existing records from primary storage. [2025-10-15T18:49:12.545515] [INFO ] [MAIN ] EVC: Loaded 18136 existing records. [2025-10-15T18:49:12.721177] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:12.721455] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-15T18:49:12.721505] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-15T18:49:12.721884] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-15T18:49:12.721947] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-15T18:49:12.826030] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T18:49:12.919145] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-15T18:49:13.083931] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:13.713999] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-15T18:49:14.120423] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T18:49:14.514035] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-15T18:49:14.931479] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T18:49:15.314017] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-15T18:49:15.921467] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:49:16.113966] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-15T18:49:16.563725] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T18:49:16.599465] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:49:16.914014] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-15T18:49:17.258200] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:49:17.714045] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-15T18:49:18.513968] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-15T18:49:18.893492] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:49:19.314018] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-15T18:49:19.596044] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T18:49:20.113984] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-15T18:49:20.349831] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T18:49:20.868093] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T18:49:20.913954] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-15T18:49:21.713993] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-15T18:49:21.770168] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:49:21.773770] [INFO ] [REMOTE ] ETW: Full fetch complete (36855 records). [2025-10-15T18:49:21.773848] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-15T18:49:22.143637] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-15T18:49:22.143776] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-15T18:49:22.144484] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-15T18:49:22.144553] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-15T18:49:22.145711] [DEBUG] [LOCAL ] ETW: Trimmed 36855 records to 25583 (keeping 200 days of data) [2025-10-15T18:49:22.292383] [DEBUG] [LOCAL ] ETW: Primary data saved (25583 records). [2025-10-15T18:49:22.292502] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-15T18:49:22.292576] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETW took 33.9s. Estimated remaining: 3h 41m 48s. Rate: 7.2 symbols/min [2025-10-15T18:49:22.412990] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T18:49:22.437454] [INFO ] [REMOTE ] ETX: Full fetch complete (6924 records). [2025-10-15T18:49:22.450178] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-15T18:49:22.519170] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-15T18:49:22.522367] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:22.789929] [DEBUG] [LOCAL ] EVEX: Loaded 32175 existing records from primary storage. [2025-10-15T18:49:22.811038] [INFO ] [MAIN ] EVEX: Loaded 32175 existing records. [2025-10-15T18:49:22.976858] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-15T18:49:22.992788] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-15T18:49:22.998269] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-15T18:49:23.003475] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-15T18:49:23.028181] [DEBUG] [LOCAL ] ETX: Trimmed 6924 records to 5256 (keeping 200 days of data) [2025-10-15T18:49:23.058535] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:23.059160] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-15T18:49:23.076339] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-15T18:49:23.087721] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-15T18:49:23.093414] [DEBUG] [LOCAL ] ETX: Primary data saved (5256 records). [2025-10-15T18:49:23.093350] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-15T18:49:23.093560] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-15T18:49:23.111743] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETX took 27.0s. Estimated remaining: 3h 41m 25s. Rate: 7.2 symbols/min [2025-10-15T18:49:23.327360] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-15T18:49:23.495523] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:23.538504] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:49:23.618890] [DEBUG] [LOCAL ] EVF: Loaded 9853 existing records from primary storage. [2025-10-15T18:49:23.640856] [INFO ] [MAIN ] EVF: Loaded 9853 existing records. [2025-10-15T18:49:23.811798] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:23.926044] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:23.926318] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-15T18:49:23.926369] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-15T18:49:23.926538] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-15T18:49:23.926577] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-15T18:49:24.122509] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-15T18:49:24.282467] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:24.533551] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T18:49:24.914051] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-15T18:49:25.286771] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T18:49:25.714035] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-15T18:49:25.766909] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T18:49:26.513993] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-15T18:49:26.883793] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:49:27.314024] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-15T18:49:27.735945] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:49:28.114050] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-15T18:49:28.147860] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:49:28.914025] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-15T18:49:29.114032] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:49:29.714051] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-15T18:49:29.988589] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T18:49:30.513970] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-15T18:49:30.756517] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:49:31.314017] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-15T18:49:31.648214] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T18:49:32.114000] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-15T18:49:32.353509] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T18:49:32.914017] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-15T18:49:33.234131] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:49:33.495945] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T18:49:33.714028] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-15T18:49:34.514083] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-15T18:49:34.682438] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:49:35.313977] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-15T18:49:35.552499] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:49:35.556408] [INFO ] [REMOTE ] ETY: Full fetch complete (34302 records). [2025-10-15T18:49:35.556513] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-15T18:49:35.967901] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-15T18:49:35.968005] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-15T18:49:35.968901] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-15T18:49:35.968966] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-15T18:49:35.970084] [DEBUG] [LOCAL ] ETY: Trimmed 34302 records to 22961 (keeping 200 days of data) [2025-10-15T18:49:36.095304] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T18:49:36.115258] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-15T18:49:36.140637] [DEBUG] [LOCAL ] ETY: Primary data saved (22961 records). [2025-10-15T18:49:36.140857] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-15T18:49:36.140962] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. ETY took 37.2s. Estimated remaining: 3h 41m 26s. Rate: 7.2 symbols/min [2025-10-15T18:49:36.327449] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:36.337182] [DEBUG] [LOCAL ] EVG: Loaded 5939 existing records from primary storage. [2025-10-15T18:49:36.337446] [INFO ] [MAIN ] EVG: Loaded 5939 existing records. [2025-10-15T18:49:36.524070] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:36.524371] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-15T18:49:36.524422] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-15T18:49:36.524717] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-15T18:49:36.524776] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-15T18:49:36.835061] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T18:49:36.914737] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-15T18:49:36.941832] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:37.547393] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:49:37.714030] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-15T18:49:38.449244] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:49:38.514005] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-15T18:49:39.087903] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:49:39.314012] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-15T18:49:39.762365] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:49:40.114017] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-15T18:49:40.717862] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T18:49:40.914019] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-15T18:49:41.633556] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T18:49:41.714073] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-15T18:49:42.320200] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:49:42.514047] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-15T18:49:43.314039] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-15T18:49:43.524446] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T18:49:44.114023] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-15T18:49:44.394945] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:49:44.728535] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:49:44.913998] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-15T18:49:45.714035] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-15T18:49:45.909190] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T18:49:46.054310] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T18:49:46.513993] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-15T18:49:47.313983] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-15T18:49:47.732013] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T18:49:47.898966] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T18:49:48.113994] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-15T18:49:48.914022] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-15T18:49:49.065089] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T18:49:49.713994] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-15T18:49:50.359503] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T18:49:50.514036] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-15T18:49:50.757051] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:49:51.235725] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:49:51.313995] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-15T18:49:52.114023] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-15T18:49:52.829186] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:49:52.914002] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-15T18:49:53.054198] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T18:49:53.056326] [INFO ] [REMOTE ] EVC: Full fetch complete (29003 records). [2025-10-15T18:49:53.056401] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-15T18:49:53.420114] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-15T18:49:53.420191] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-15T18:49:53.420769] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-15T18:49:53.420831] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-15T18:49:53.421549] [DEBUG] [LOCAL ] EVC: Trimmed 29003 records to 18093 (keeping 200 days of data) [2025-10-15T18:49:53.527044] [DEBUG] [LOCAL ] EVC: Primary data saved (18093 records). [2025-10-15T18:49:53.527187] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-15T18:49:53.527270] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 41.2s. Estimated remaining: 3h 41m 36s. Rate: 7.1 symbols/min [2025-10-15T18:49:53.696772] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:53.719889] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-15T18:49:53.740624] [DEBUG] [LOCAL ] EVH: Loaded 49624 existing records from primary storage. [2025-10-15T18:49:53.740986] [INFO ] [MAIN ] EVH: Loaded 49624 existing records. [2025-10-15T18:49:53.848338] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T18:49:53.928506] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:53.928737] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-15T18:49:53.928796] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-15T18:49:53.929205] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-15T18:49:53.929262] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-15T18:49:54.280764] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:54.334033] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T18:49:54.513995] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-15T18:49:55.314066] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-15T18:49:55.925431] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:49:56.029001] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T18:49:56.030462] [INFO ] [REMOTE ] EVG: Full fetch complete (8174 records). [2025-10-15T18:49:56.030532] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-15T18:49:56.119173] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-15T18:49:56.382942] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-15T18:49:56.383016] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-15T18:49:56.383233] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-15T18:49:56.383272] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-15T18:49:56.383684] [DEBUG] [LOCAL ] EVG: Trimmed 8174 records to 5933 (keeping 200 days of data) [2025-10-15T18:49:56.420582] [DEBUG] [LOCAL ] EVG: Primary data saved (5933 records). [2025-10-15T18:49:56.420700] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-15T18:49:56.420786] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVG took 20.3s. Estimated remaining: 3h 41m 16s. Rate: 7.2 symbols/min [2025-10-15T18:49:56.589412] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:56.601244] [DEBUG] [LOCAL ] EVN: Loaded 10794 existing records from primary storage. [2025-10-15T18:49:56.601440] [INFO ] [MAIN ] EVN: Loaded 10794 existing records. [2025-10-15T18:49:56.775023] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:56.775222] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-15T18:49:56.775270] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-15T18:49:56.775414] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-15T18:49:56.775452] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-15T18:49:56.917015] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-15T18:49:57.126906] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:57.714004] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-15T18:49:57.797022] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T18:49:57.796698] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:49:58.370740] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T18:49:58.514032] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-15T18:49:59.314076] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-15T18:49:59.448128] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:50:00.071755] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:50:00.114024] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-15T18:50:00.914086] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-15T18:50:01.234292] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:50:01.714010] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-15T18:50:02.513983] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-15T18:50:02.569560] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:50:02.571671] [INFO ] [REMOTE ] EVF: Full fetch complete (12845 records). [2025-10-15T18:50:02.571773] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-15T18:50:02.912868] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T18:50:02.964570] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-15T18:50:02.964672] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-15T18:50:02.964970] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-15T18:50:02.965010] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-15T18:50:02.965471] [DEBUG] [LOCAL ] EVF: Trimmed 12845 records to 9830 (keeping 200 days of data) [2025-10-15T18:50:03.022135] [DEBUG] [LOCAL ] EVF: Primary data saved (9830 records). [2025-10-15T18:50:03.022253] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-15T18:50:03.022362] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVF took 39.9s. Estimated remaining: 3h 41m 4s. Rate: 7.2 symbols/min [2025-10-15T18:50:03.185246] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:03.224996] [DEBUG] [LOCAL ] EVR: Loaded 34470 existing records from primary storage. [2025-10-15T18:50:03.225321] [INFO ] [MAIN ] EVR: Loaded 34470 existing records. [2025-10-15T18:50:03.320281] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-15T18:50:03.400736] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:03.400918] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-15T18:50:03.400970] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-15T18:50:03.401143] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-15T18:50:03.401181] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-15T18:50:03.744250] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:04.114008] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-15T18:50:04.159328] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T18:50:04.914033] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-15T18:50:05.047077] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:50:05.267480] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T18:50:05.714008] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-15T18:50:06.514051] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-15T18:50:06.532366] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T18:50:06.699467] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:50:06.705306] [INFO ] [REMOTE ] EVEX: Full fetch complete (43332 records). [2025-10-15T18:50:06.705418] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-15T18:50:07.131099] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-15T18:50:07.131201] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-15T18:50:07.131938] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-15T18:50:07.132002] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-15T18:50:07.133309] [DEBUG] [LOCAL ] EVEX: Trimmed 43332 records to 32374 (keeping 200 days of data) [2025-10-15T18:50:07.309735] [DEBUG] [LOCAL ] EVEX: Primary data saved (32374 records). [2025-10-15T18:50:07.309876] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-15T18:50:07.309959] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVEX took 45.0s. Estimated remaining: 3h 40m 47s. Rate: 7.2 symbols/min [2025-10-15T18:50:07.321211] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-15T18:50:07.478286] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:07.495203] [DEBUG] [LOCAL ] EVT: Loaded 16854 existing records from primary storage. [2025-10-15T18:50:07.495466] [INFO ] [MAIN ] EVT: Loaded 16854 existing records. [2025-10-15T18:50:07.667914] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:07.668116] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-15T18:50:07.668163] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-15T18:50:07.668417] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-15T18:50:07.668472] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-15T18:50:08.025024] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:08.113981] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-15T18:50:08.207513] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:50:08.252465] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:50:08.910051] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T18:50:08.914498] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-15T18:50:09.713977] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-15T18:50:09.984101] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:50:10.137849] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:50:10.514011] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-15T18:50:11.314003] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-15T18:50:12.113975] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-15T18:50:12.220863] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T18:50:12.317470] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T18:50:12.913994] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-15T18:50:13.632530] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T18:50:13.653625] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T18:50:13.713959] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-15T18:50:14.513962] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-15T18:50:15.287225] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:50:15.313997] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-15T18:50:15.624967] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T18:50:16.114043] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-15T18:50:16.913966] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-15T18:50:16.980618] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:50:17.150205] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T18:50:17.714012] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-15T18:50:18.364853] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:50:18.514038] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-15T18:50:18.680635] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:50:19.314046] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-15T18:50:20.024456] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T18:50:20.070928] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:50:20.113999] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-15T18:50:20.914054] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-15T18:50:21.601932] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T18:50:21.713993] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-15T18:50:22.513981] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-15T18:50:22.610593] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T18:50:22.739500] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:50:23.308555] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T18:50:23.313940] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-15T18:50:24.114053] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-15T18:50:24.282745] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T18:50:24.913972] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-15T18:50:25.061875] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T18:50:25.714053] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-15T18:50:26.513963] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-15T18:50:26.712965] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T18:50:26.733714] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T18:50:27.082526] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T18:50:27.313995] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-15T18:50:28.113995] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-15T18:50:28.811180] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T18:50:28.913977] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-15T18:50:29.573094] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:50:29.714005] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-15T18:50:29.735056] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:50:29.736882] [INFO ] [REMOTE ] EVN: Full fetch complete (17392 records). [2025-10-15T18:50:29.736951] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-15T18:50:30.094911] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-15T18:50:30.095024] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-15T18:50:30.095406] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-15T18:50:30.095447] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-15T18:50:30.095955] [DEBUG] [LOCAL ] EVN: Trimmed 17392 records to 10787 (keeping 200 days of data) [2025-10-15T18:50:30.158893] [DEBUG] [LOCAL ] EVN: Primary data saved (10787 records). [2025-10-15T18:50:30.159015] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-15T18:50:30.159091] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVN took 33.7s. Estimated remaining: 3h 41m 8s. Rate: 7.1 symbols/min [2025-10-15T18:50:30.324376] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:30.349549] [DEBUG] [LOCAL ] EVTC: Loaded 26612 existing records from primary storage. [2025-10-15T18:50:30.349835] [INFO ] [MAIN ] EVTC: Loaded 26612 existing records. [2025-10-15T18:50:30.519210] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-15T18:50:30.523254] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:30.524347] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-15T18:50:30.524405] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-15T18:50:30.524694] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-15T18:50:30.524752] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-15T18:50:30.891190] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:30.908276] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T18:50:31.314029] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-15T18:50:32.113971] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-15T18:50:32.268727] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T18:50:32.275588] [INFO ] [REMOTE ] EVH: Full fetch complete (71855 records). [2025-10-15T18:50:32.275790] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-15T18:50:32.722336] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:50:32.761871] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:50:32.789475] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-15T18:50:32.789949] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-15T18:50:32.790966] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-15T18:50:32.791028] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-15T18:50:32.792380] [DEBUG] [LOCAL ] EVH: Trimmed 71855 records to 49624 (keeping 200 days of data) [2025-10-15T18:50:32.950527] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-15T18:50:33.074278] [DEBUG] [LOCAL ] EVH: Primary data saved (49624 records). [2025-10-15T18:50:33.074446] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-15T18:50:33.074528] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVH took 39.5s. Estimated remaining: 3h 40m 49s. Rate: 7.2 symbols/min [2025-10-15T18:50:33.238754] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:33.276430] [DEBUG] [LOCAL ] EVTL: Loaded 40083 existing records from primary storage. [2025-10-15T18:50:33.276743] [INFO ] [MAIN ] EVTL: Loaded 40083 existing records. [2025-10-15T18:50:33.449500] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:33.449725] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-15T18:50:33.449778] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-15T18:50:33.450000] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-15T18:50:33.450037] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-15T18:50:33.720502] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-15T18:50:33.834315] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:34.093082] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:50:34.514015] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-15T18:50:34.518434] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:50:34.521757] [INFO ] [REMOTE ] EVT: Full fetch complete (25278 records). [2025-10-15T18:50:34.521874] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-15T18:50:35.051639] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-15T18:50:35.051792] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-15T18:50:35.052471] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-15T18:50:35.052544] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-15T18:50:35.053594] [DEBUG] [LOCAL ] EVT: Trimmed 25278 records to 16833 (keeping 200 days of data) [2025-10-15T18:50:35.172715] [DEBUG] [LOCAL ] EVT: Primary data saved (16833 records). [2025-10-15T18:50:35.172863] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-15T18:50:35.172945] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVT took 27.9s. Estimated remaining: 3h 40m 28s. Rate: 7.2 symbols/min [2025-10-15T18:50:35.319123] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-15T18:50:35.345796] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:35.371005] [DEBUG] [LOCAL ] EVTR: Loaded 24584 existing records from primary storage. [2025-10-15T18:50:35.371331] [INFO ] [MAIN ] EVTR: Loaded 24584 existing records. [2025-10-15T18:50:35.549858] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:35.550103] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-15T18:50:35.550168] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-15T18:50:35.550444] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-15T18:50:35.550500] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-15T18:50:35.937191] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:35.954048] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T18:50:36.113974] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-15T18:50:36.394823] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:50:36.913978] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-15T18:50:37.153472] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T18:50:37.713963] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-15T18:50:37.829162] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T18:50:38.273820] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:50:38.514078] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-15T18:50:39.313975] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-15T18:50:39.731179] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T18:50:40.114012] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-15T18:50:40.289744] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T18:50:40.293462] [INFO ] [REMOTE ] EVR: Full fetch complete (50797 records). [2025-10-15T18:50:40.293538] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-15T18:50:40.666391] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-15T18:50:40.666473] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-15T18:50:40.667212] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-15T18:50:40.667276] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-15T18:50:40.668423] [DEBUG] [LOCAL ] EVR: Trimmed 50797 records to 34420 (keeping 200 days of data) [2025-10-15T18:50:40.881664] [DEBUG] [LOCAL ] EVR: Primary data saved (34420 records). [2025-10-15T18:50:40.881797] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-15T18:50:40.881876] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVR took 37.9s. Estimated remaining: 3h 40m 14s. Rate: 7.2 symbols/min [2025-10-15T18:50:40.914113] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-15T18:50:41.056036] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:41.104208] [DEBUG] [LOCAL ] EW: Loaded 53406 existing records from primary storage. [2025-10-15T18:50:41.104500] [INFO ] [MAIN ] EW: Loaded 53406 existing records. [2025-10-15T18:50:41.234761] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:50:41.292606] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:41.292813] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-15T18:50:41.292859] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-15T18:50:41.293174] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-15T18:50:41.293225] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-15T18:50:41.636943] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:41.713966] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-15T18:50:42.254069] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T18:50:42.514040] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-15T18:50:43.241681] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:50:43.263373] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:50:43.313999] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-15T18:50:44.113974] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-15T18:50:44.155343] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T18:50:44.914036] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-15T18:50:45.711332] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T18:50:45.717558] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-15T18:50:45.904029] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T18:50:46.514060] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-15T18:50:47.148819] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:50:47.313948] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-15T18:50:47.685877] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:50:48.113986] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-15T18:50:48.897524] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T18:50:48.913932] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-15T18:50:49.191283] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:50:49.713999] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-15T18:50:50.064037] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:50:50.514016] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-15T18:50:51.101713] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:50:51.314006] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-15T18:50:52.113975] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-15T18:50:52.215791] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:50:52.226686] [DEBUG] [REMOTE ] EVTR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-15T18:50:52.227057] [WARN ] [REMOTE ] EVTR: No data returned for month 2025-07 [2025-10-15T18:50:52.227550] [FATAL] [REMOTE ] EVTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:50:52.228080] [FATAL] [MAIN ] EVTR: Failed to fetch primary data. [2025-10-15T18:50:52.228149] [WARN ] [MAIN ] EVTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:50:52.228220] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-15T18:50:52.228282] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-10-15T18:50:52.228318] [INFO ] [LOCAL ] EVTR: Starting deletion of derivative data. [2025-10-15T18:50:52.228440] [DEBUG] [LOCAL ] EVTR: Deleted derivative data file. [2025-10-15T18:50:52.228519] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTR took 17.1s. Estimated remaining: 3h 40m 12s. Rate: 7.2 symbols/min [2025-10-15T18:50:52.392675] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:52.425116] [DEBUG] [LOCAL ] EXG: Loaded 34136 existing records from primary storage. [2025-10-15T18:50:52.425393] [INFO ] [MAIN ] EXG: Loaded 34136 existing records. [2025-10-15T18:50:52.596989] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:50:52.622451] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:52.623343] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-15T18:50:52.623403] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-15T18:50:52.623838] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-15T18:50:52.623895] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-15T18:50:52.919163] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-15T18:50:52.972068] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:53.714046] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-15T18:50:54.514044] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-15T18:50:54.911493] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T18:50:55.079334] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T18:50:55.314052] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-15T18:50:55.457438] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T18:50:56.114073] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-15T18:50:56.913985] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-15T18:50:56.991586] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T18:50:57.406607] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:50:57.714074] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-15T18:50:57.946262] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:50:58.514045] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-15T18:50:58.841760] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:50:59.314024] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-15T18:50:59.892467] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:51:00.114009] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-15T18:51:00.914052] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-15T18:51:01.003960] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T18:51:01.719127] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-15T18:51:01.731461] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T18:51:02.306618] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:51:02.513993] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-15T18:51:03.313960] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-15T18:51:03.419532] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T18:51:03.631967] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T18:51:04.114041] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-15T18:51:04.386063] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T18:51:04.913995] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-15T18:51:05.714001] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-15T18:51:05.866024] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:51:06.378011] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:51:06.514027] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-15T18:51:06.956190] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:51:06.963756] [INFO ] [REMOTE ] EVTC: Full fetch complete (38371 records). [2025-10-15T18:51:06.963889] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-15T18:51:07.320403] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-15T18:51:07.322853] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-15T18:51:07.323572] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-15T18:51:07.324267] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-15T18:51:07.324382] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-15T18:51:07.325504] [DEBUG] [LOCAL ] EVTC: Trimmed 38371 records to 26787 (keeping 200 days of data) [2025-10-15T18:51:07.481856] [DEBUG] [LOCAL ] EVTC: Primary data saved (26787 records). [2025-10-15T18:51:07.482001] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-15T18:51:07.482088] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTC took 37.3s. Estimated remaining: 3h 40m 17s. Rate: 7.1 symbols/min [2025-10-15T18:51:07.646308] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:07.701631] [DEBUG] [LOCAL ] EXK: Loaded 53169 existing records from primary storage. [2025-10-15T18:51:07.702001] [INFO ] [MAIN ] EXK: Loaded 53169 existing records. [2025-10-15T18:51:07.882389] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:07.882874] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-15T18:51:07.882951] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-15T18:51:07.883584] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-15T18:51:07.883691] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-15T18:51:08.087019] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:51:08.121036] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-15T18:51:08.275256] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:08.913985] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-15T18:51:09.333090] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T18:51:09.497402] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T18:51:09.714027] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-15T18:51:09.860088] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:51:10.356546] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:51:10.363168] [INFO ] [REMOTE ] EW: Full fetch complete (77521 records). [2025-10-15T18:51:10.363299] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-15T18:51:10.521312] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-15T18:51:10.772418] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-15T18:51:10.772531] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-15T18:51:10.773506] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-15T18:51:10.773571] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-15T18:51:10.774998] [DEBUG] [LOCAL ] EW: Trimmed 77521 records to 53406 (keeping 200 days of data) [2025-10-15T18:51:11.087138] [DEBUG] [LOCAL ] EW: Primary data saved (53406 records). [2025-10-15T18:51:11.087277] [INFO ] [MAIN ] EW: Full history saved. [2025-10-15T18:51:11.087355] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EW took 30.2s. Estimated remaining: 3h 39m 59s. Rate: 7.2 symbols/min [2025-10-15T18:51:11.251931] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:11.282103] [DEBUG] [LOCAL ] EXP: Loaded 29541 existing records from primary storage. [2025-10-15T18:51:11.282400] [INFO ] [MAIN ] EXP: Loaded 29541 existing records. [2025-10-15T18:51:11.319269] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-15T18:51:11.482982] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:11.483228] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-15T18:51:11.483304] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-15T18:51:11.483750] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-15T18:51:11.483807] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-15T18:51:11.881353] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:12.114021] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-15T18:51:12.347076] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T18:51:12.866595] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T18:51:12.914005] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-15T18:51:13.389964] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T18:51:13.713995] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-15T18:51:14.514053] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-15T18:51:14.640461] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T18:51:14.901290] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T18:51:15.314009] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-15T18:51:16.040527] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T18:51:16.114024] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-15T18:51:16.913971] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-15T18:51:17.112101] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T18:51:17.376456] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:51:17.714007] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-15T18:51:18.205522] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:51:18.514052] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-15T18:51:19.314052] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-15T18:51:19.483999] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T18:51:19.826590] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T18:51:20.113995] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-15T18:51:20.913960] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-15T18:51:21.406856] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T18:51:21.713983] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-15T18:51:21.890405] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T18:51:21.896508] [INFO ] [REMOTE ] EVTL: Full fetch complete (54328 records). [2025-10-15T18:51:21.896611] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-15T18:51:22.261594] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T18:51:22.299859] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-15T18:51:22.299940] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-15T18:51:22.300738] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-15T18:51:22.300818] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-15T18:51:22.302039] [DEBUG] [LOCAL ] EVTL: Trimmed 54328 records to 40293 (keeping 200 days of data) [2025-10-15T18:51:22.523604] [DEBUG] [LOCAL ] EVTL: Primary data saved (40293 records). [2025-10-15T18:51:22.518258] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-15T18:51:22.524294] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-15T18:51:22.525243] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EVTL took 49.5s. Estimated remaining: 3h 39m 57s. Rate: 7.2 symbols/min [2025-10-15T18:51:22.696373] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:22.741667] [DEBUG] [LOCAL ] EXPD: Loaded 47953 existing records from primary storage. [2025-10-15T18:51:22.741983] [INFO ] [MAIN ] EXPD: Loaded 47953 existing records. [2025-10-15T18:51:22.947436] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:22.947730] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-15T18:51:22.947867] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-15T18:51:22.948361] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-15T18:51:22.948422] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-15T18:51:23.088778] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:51:23.339829] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-15T18:51:23.344905] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:23.865475] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T18:51:23.869584] [INFO ] [REMOTE ] EXG: Full fetch complete (49887 records). [2025-10-15T18:51:23.869701] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-15T18:51:24.119070] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-15T18:51:24.273688] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-15T18:51:24.273783] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-15T18:51:24.274628] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-15T18:51:24.274716] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-15T18:51:24.275922] [DEBUG] [LOCAL ] EXG: Trimmed 49887 records to 34033 (keeping 200 days of data) [2025-10-15T18:51:24.477703] [DEBUG] [LOCAL ] EXG: Primary data saved (34033 records). [2025-10-15T18:51:24.477855] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-15T18:51:24.477936] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXG took 32.2s. Estimated remaining: 3h 39m 36s. Rate: 7.2 symbols/min [2025-10-15T18:51:24.914047] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-15T18:51:24.952717] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:51:25.651778] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:51:25.713955] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-15T18:51:26.261517] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:51:26.514033] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-15T18:51:27.314087] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-15T18:51:27.424369] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:51:27.852853] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:51:28.114047] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-15T18:51:28.913993] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-15T18:51:29.176983] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T18:51:29.217308] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T18:51:29.714017] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-15T18:51:30.514004] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-15T18:51:30.577188] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:51:30.877765] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T18:51:31.314021] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-15T18:51:32.114027] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-15T18:51:32.371972] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:51:32.913966] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-15T18:51:32.954822] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:51:33.329022] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:51:33.713998] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-15T18:51:34.513980] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-15T18:51:34.892811] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T18:51:35.002154] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T18:51:35.314000] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-15T18:51:35.753462] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:51:35.757252] [INFO ] [REMOTE ] EXP: Full fetch complete (42963 records). [2025-10-15T18:51:35.757348] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-15T18:51:36.119169] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-15T18:51:36.138222] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-15T18:51:36.138331] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-15T18:51:36.139058] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-15T18:51:36.139121] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-15T18:51:36.140203] [DEBUG] [LOCAL ] EXP: Trimmed 42963 records to 29600 (keeping 200 days of data) [2025-10-15T18:51:36.323866] [DEBUG] [LOCAL ] EXP: Primary data saved (29600 records). [2025-10-15T18:51:36.324001] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-15T18:51:36.324079] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 25.2s. Estimated remaining: 3h 39m 34s. Rate: 7.2 symbols/min [2025-10-15T18:51:36.990474] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T18:51:37.001526] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-15T18:51:38.025056] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T18:51:38.036170] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-15T18:51:38.292184] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T18:51:38.514024] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-15T18:51:39.620546] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T18:51:39.632218] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-15T18:51:40.153450] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T18:51:40.164250] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-15T18:51:41.479833] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T18:51:41.490285] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-15T18:51:41.579826] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:51:41.586169] [INFO ] [REMOTE ] EXK: Full fetch complete (76786 records). [2025-10-15T18:51:41.586290] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-15T18:51:41.974517] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-15T18:51:41.974608] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-15T18:51:41.975669] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-15T18:51:41.975735] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-15T18:51:41.977151] [DEBUG] [LOCAL ] EXK: Trimmed 76786 records to 53171 (keeping 200 days of data) [2025-10-15T18:51:42.285113] [DEBUG] [LOCAL ] EXK: Primary data saved (53171 records). [2025-10-15T18:51:42.285250] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-15T18:51:42.285545] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXK took 34.8s. Estimated remaining: 3h 39m 21s. Rate: 7.2 symbols/min [2025-10-15T18:51:43.162066] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T18:51:43.172599] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-15T18:51:43.722501] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T18:51:43.731318] [INFO ] [REMOTE ] EXPD: Full fetch complete (69534 records). [2025-10-15T18:51:43.731478] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-15T18:51:44.150780] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-15T18:51:44.150878] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-15T18:51:44.151899] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-15T18:51:44.151968] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-15T18:51:44.153491] [DEBUG] [LOCAL ] EXPD: Trimmed 69534 records to 47973 (keeping 200 days of data) [2025-10-15T18:51:44.470803] [DEBUG] [LOCAL ] EXPD: Primary data saved (47973 records). [2025-10-15T18:51:44.470961] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-15T18:51:44.471047] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXPD took 21.9s. Estimated remaining: 3h 39m 0s. Rate: 7.2 symbols/min [2025-10-15T18:51:45.039282] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.116490] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.202437] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.201609] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.296299] [DEBUG] [LOCAL ] EXR: Loaded 45464 existing records from primary storage. [2025-10-15T18:51:45.297548] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-15T18:51:45.298088] [INFO ] [MAIN ] EXR: Loaded 45464 existing records. [2025-10-15T18:51:45.339063] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-15T18:51:45.445091] [DEBUG] [LOCAL ] FBIN: Loaded 50395 existing records from primary storage. [2025-10-15T18:51:45.464814] [DEBUG] [LOCAL ] FAF: Loaded 41537 existing records from primary storage. [2025-10-15T18:51:45.518321] [INFO ] [MAIN ] FAF: Loaded 41537 existing records. [2025-10-15T18:51:45.518024] [INFO ] [MAIN ] FBIN: Loaded 50395 existing records. [2025-10-15T18:51:45.785909] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:45.921689] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-15T18:51:45.921880] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-15T18:51:45.978181] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:46.044668] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-15T18:51:46.056484] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-15T18:51:46.015233] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-15T18:51:46.077988] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-15T18:51:46.095697] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-15T18:51:46.103420] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-15T18:51:46.126720] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:46.211055] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-15T18:51:46.224782] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-15T18:51:46.305769] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-15T18:51:46.246295] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:46.359888] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-15T18:51:46.359799] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-15T18:51:46.360472] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-15T18:51:46.371086] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-15T18:51:46.376339] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-15T18:51:47.404006] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.488971] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-15T18:51:47.483261] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.514727] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-15T18:51:47.660091] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.686494] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-15T18:51:47.691782] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.692176] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-15T18:51:49.052095] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:51:49.059635] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-15T18:51:49.148970] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:51:49.157770] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-15T18:51:49.233000] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T18:51:49.242461] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-15T18:51:49.824595] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-15T18:51:49.835867] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-15T18:51:50.426300] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T18:51:50.434345] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-15T18:51:50.591164] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T18:51:50.601843] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-15T18:51:50.671534] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:51:50.680983] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-15T18:51:51.695474] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:51:51.702871] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-15T18:51:52.159134] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:51:52.168522] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-15T18:51:52.204501] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T18:51:52.245407] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-15T18:51:52.822935] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:51:52.913998] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-15T18:51:53.714052] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-15T18:51:53.768329] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:51:54.236698] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T18:51:54.514015] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-15T18:51:55.314036] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-15T18:51:56.113725] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-15T18:51:56.123565] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-15T18:51:56.155002] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:51:56.792024] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T18:51:56.913956] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-15T18:51:57.714049] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-15T18:51:57.803483] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:51:58.408003] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T18:51:58.513961] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-15T18:51:59.314079] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-15T18:51:59.908764] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:52:00.113010] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-15T18:52:00.117118] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-15T18:52:00.914031] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-15T18:52:00.996882] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:52:01.714030] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-15T18:52:01.799236] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:52:02.514010] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-15T18:52:03.313983] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-15T18:52:03.419558] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-15T18:52:03.543590] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:52:03.942560] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:52:04.114008] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-15T18:52:04.726140] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:52:04.914007] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-15T18:52:05.714025] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-15T18:52:06.513993] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-15T18:52:06.598899] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T18:52:06.644536] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-15T18:52:07.260632] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:52:07.313979] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-15T18:52:07.748801] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T18:52:07.753169] [INFO ] [REMOTE ] FAF: Full fetch complete (57911 records). [2025-10-15T18:52:07.753262] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-15T18:52:08.126759] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-15T18:52:08.130823] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-15T18:52:08.130891] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-15T18:52:08.131739] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-15T18:52:08.131804] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-15T18:52:08.133142] [DEBUG] [LOCAL ] FAF: Trimmed 57911 records to 41492 (keeping 200 days of data) [2025-10-15T18:52:08.387205] [DEBUG] [LOCAL ] FAF: Primary data saved (41492 records). [2025-10-15T18:52:08.387327] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-15T18:52:08.387708] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FAF took 23.9s. Estimated remaining: 3h 39m 22s. Rate: 7.1 symbols/min [2025-10-15T18:52:08.555547] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:08.582907] [DEBUG] [LOCAL ] FBK: Loaded 27211 existing records from primary storage. [2025-10-15T18:52:08.583163] [INFO ] [MAIN ] FBK: Loaded 27211 existing records. [2025-10-15T18:52:08.758527] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:08.758903] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-15T18:52:08.759007] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-15T18:52:08.759349] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-15T18:52:08.759406] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-15T18:52:08.933359] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-15T18:52:09.158373] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:09.160171] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T18:52:09.714027] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-15T18:52:09.956146] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:52:10.514018] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-15T18:52:10.747837] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T18:52:11.271434] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T18:52:11.313988] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-15T18:52:12.114008] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-15T18:52:12.232433] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:52:12.914057] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-15T18:52:13.714033] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-15T18:52:13.789832] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:52:13.900490] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-15T18:52:14.124195] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:52:14.513965] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-15T18:52:14.759368] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T18:52:15.314035] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-15T18:52:16.113977] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-15T18:52:16.231033] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:52:16.249727] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T18:52:16.914037] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-15T18:52:17.713975] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-15T18:52:17.916556] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:52:18.513965] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-15T18:52:18.544215] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-15T18:52:19.314013] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-15T18:52:19.341396] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T18:52:19.347426] [INFO ] [REMOTE ] FBIN: Full fetch complete (72924 records). [2025-10-15T18:52:19.347568] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-15T18:52:19.757830] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-15T18:52:19.757922] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-15T18:52:19.758921] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-15T18:52:19.758990] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-15T18:52:19.760562] [DEBUG] [LOCAL ] FBIN: Trimmed 72924 records to 50393 (keeping 200 days of data) [2025-10-15T18:52:20.083598] [DEBUG] [LOCAL ] FBIN: Primary data saved (50393 records). [2025-10-15T18:52:20.083774] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-15T18:52:20.084840] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FBIN took 35.6s. Estimated remaining: 3h 39m 20s. Rate: 7.1 symbols/min [2025-10-15T18:52:20.119118] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-15T18:52:20.234883] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:52:20.282754] [INFO ] [REMOTE ] EXR: Full fetch complete (66120 records). [2025-10-15T18:52:20.302203] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-15T18:52:20.308915] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:20.693916] [DEBUG] [LOCAL ] FBP: Loaded 45726 existing records from primary storage. [2025-10-15T18:52:20.714771] [INFO ] [MAIN ] FBP: Loaded 45726 existing records. [2025-10-15T18:52:20.997435] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-15T18:52:21.024794] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-15T18:52:21.046476] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-15T18:52:21.064701] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-15T18:52:21.068469] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:21.068799] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-15T18:52:21.068866] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-15T18:52:21.069297] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-15T18:52:21.069431] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-15T18:52:21.101477] [DEBUG] [LOCAL ] EXR: Trimmed 66120 records to 45550 (keeping 200 days of data) [2025-10-15T18:52:21.561389] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:21.563890] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-15T18:52:21.591030] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:52:21.713957] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-15T18:52:21.816307] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-15T18:52:21.833996] [DEBUG] [LOCAL ] EXR: Primary data saved (45550 records). [2025-10-15T18:52:21.834140] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-15T18:52:21.834250] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. EXR took 37.4s. Estimated remaining: 3h 38m 59s. Rate: 7.2 symbols/min [2025-10-15T18:52:21.996917] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:21.997036] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-15T18:52:21.997073] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-15T18:52:21.997177] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-15T18:52:21.997218] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-15T18:52:21.997257] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-15T18:52:21.997288] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-15T18:52:22.347969] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:22.514000] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-15T18:52:22.615695] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:52:22.801777] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:52:23.314011] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-15T18:52:23.804046] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:52:24.114012] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-15T18:52:24.314938] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:52:24.593799] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T18:52:24.600314] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-15T18:52:24.600479] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-15T18:52:24.919242] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-15T18:52:25.000299] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-15T18:52:25.000393] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-15T18:52:25.001458] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-15T18:52:25.001524] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-15T18:52:25.003186] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-15T18:52:25.338172] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-15T18:52:25.338347] [INFO ] [MAIN ] F: Full history saved. [2025-10-15T18:52:25.338435] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 40.9s. Estimated remaining: 3h 38m 41s. Rate: 7.2 symbols/min [2025-10-15T18:52:25.503851] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:25.519471] [DEBUG] [LOCAL ] FC: Loaded 14892 existing records from primary storage. [2025-10-15T18:52:25.519709] [INFO ] [MAIN ] FC: Loaded 14892 existing records. [2025-10-15T18:52:25.700816] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:25.701025] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-15T18:52:25.701074] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-15T18:52:25.701252] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-15T18:52:25.701312] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-15T18:52:25.722638] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-15T18:52:26.062109] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:26.513971] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-15T18:52:26.638614] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:52:27.037351] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T18:52:27.314031] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-15T18:52:27.557623] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T18:52:28.094151] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T18:52:28.113956] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-15T18:52:28.913972] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-15T18:52:28.959963] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:52:29.714044] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-15T18:52:30.389035] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:52:30.482951] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:52:30.513957] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-15T18:52:31.313987] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-15T18:52:31.853481] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T18:52:32.113976] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-15T18:52:32.563339] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T18:52:32.913991] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-15T18:52:33.459907] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T18:52:33.714013] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-15T18:52:34.513990] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-15T18:52:34.604458] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:52:34.651471] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T18:52:35.313997] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-15T18:52:35.637512] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T18:52:36.089244] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T18:52:36.113954] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-15T18:52:36.913182] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T18:52:36.915801] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-15T18:52:37.714021] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-15T18:52:38.259787] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:52:38.264850] [INFO ] [REMOTE ] FBK: Full fetch complete (34919 records). [2025-10-15T18:52:38.264958] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-15T18:52:38.519275] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-15T18:52:38.686052] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-15T18:52:38.686126] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-15T18:52:38.686735] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-15T18:52:38.686796] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-15T18:52:38.687517] [DEBUG] [LOCAL ] FBK: Trimmed 34919 records to 27411 (keeping 200 days of data) [2025-10-15T18:52:38.855565] [DEBUG] [LOCAL ] FBK: Primary data saved (27411 records). [2025-10-15T18:52:38.855751] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-15T18:52:38.855844] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBK took 30.5s. Estimated remaining: 3h 38m 43s. Rate: 7.2 symbols/min [2025-10-15T18:52:39.022385] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:39.060793] [DEBUG] [LOCAL ] FCF: Loaded 39283 existing records from primary storage. [2025-10-15T18:52:39.061066] [INFO ] [MAIN ] FCF: Loaded 39283 existing records. [2025-10-15T18:52:39.239906] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:52:39.255911] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:39.256195] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-15T18:52:39.256921] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-15T18:52:39.257735] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-15T18:52:39.257794] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-15T18:52:39.319730] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-15T18:52:39.638562] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:39.668889] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T18:52:40.114005] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-15T18:52:40.876739] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:52:40.914002] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-15T18:52:41.540904] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T18:52:41.713995] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-15T18:52:41.934007] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T18:52:42.513995] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-15T18:52:43.215638] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:52:43.313952] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-15T18:52:43.381191] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T18:52:44.113987] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-15T18:52:44.272988] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:52:44.914010] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-15T18:52:45.083439] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:52:45.713996] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-15T18:52:46.280197] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T18:52:46.513999] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-15T18:52:46.816790] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T18:52:47.314066] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-15T18:52:47.796581] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T18:52:48.114064] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-15T18:52:48.832370] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T18:52:48.913980] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-15T18:52:49.574107] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T18:52:49.714029] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-15T18:52:50.514044] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-15T18:52:50.516950] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T18:52:50.624021] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T18:52:51.314020] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-15T18:52:51.773311] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T18:52:52.113989] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-15T18:52:52.207591] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T18:52:52.914053] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-15T18:52:53.713971] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-15T18:52:53.818910] [DEBUG] [REMOTE ] FCF: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-15T18:52:53.822728] [WARN ] [REMOTE ] FCF: No data returned for month 2025-05 [2025-10-15T18:52:53.824795] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:52:53.823252] [FATAL] [REMOTE ] FCF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:52:53.825009] [FATAL] [MAIN ] FCF: Failed to fetch primary data. [2025-10-15T18:52:53.839462] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:52:53.839733] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-15T18:52:53.839826] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-15T18:52:53.839874] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-10-15T18:52:53.840408] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-10-15T18:52:53.840696] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FCF took 15.0s. Estimated remaining: 3h 38m 47s. Rate: 7.1 symbols/min [2025-10-15T18:52:54.023083] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:54.051324] [DEBUG] [LOCAL ] FCN: Loaded 25989 existing records from primary storage. [2025-10-15T18:52:54.051584] [INFO ] [MAIN ] FCN: Loaded 25989 existing records. [2025-10-15T18:52:54.225790] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:54.225982] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-15T18:52:54.226028] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-15T18:52:54.226290] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-15T18:52:54.226328] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-15T18:52:54.518764] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-15T18:52:54.520724] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:52:54.600017] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:54.600230] [INFO ] [REMOTE ] FBRT: Full fetch complete (49526 records). [2025-10-15T18:52:54.600758] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-15T18:52:54.971767] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-15T18:52:54.971869] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-15T18:52:54.972685] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-15T18:52:54.972748] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-15T18:52:54.973793] [DEBUG] [LOCAL ] FBRT: Trimmed 49526 records to 35439 (keeping 200 days of data) [2025-10-15T18:52:55.206162] [DEBUG] [LOCAL ] FBRT: Primary data saved (35439 records). [2025-10-15T18:52:55.206303] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-15T18:52:55.206379] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBRT took 33.4s. Estimated remaining: 3h 38m 25s. Rate: 7.2 symbols/min [2025-10-15T18:52:55.315693] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-15T18:52:55.387099] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:55.422960] [DEBUG] [LOCAL ] FCPT: Loaded 37291 existing records from primary storage. [2025-10-15T18:52:55.423329] [INFO ] [MAIN ] FCPT: Loaded 37291 existing records. [2025-10-15T18:52:55.605812] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:55.607293] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-15T18:52:55.607136] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T18:52:55.607456] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-15T18:52:55.610024] [INFO ] [REMOTE ] FC: Full fetch complete (21815 records). [2025-10-15T18:52:55.610161] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-15T18:52:55.610136] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-15T18:52:55.610334] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-15T18:52:56.116757] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-15T18:52:56.338259] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:56.367567] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-15T18:52:56.367793] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-15T18:52:56.368513] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-15T18:52:56.368684] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-15T18:52:56.369338] [DEBUG] [LOCAL ] FC: Trimmed 21815 records to 14873 (keeping 200 days of data) [2025-10-15T18:52:56.451813] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T18:52:56.478879] [DEBUG] [LOCAL ] FC: Primary data saved (14873 records). [2025-10-15T18:52:56.479032] [INFO ] [MAIN ] FC: Full history saved. [2025-10-15T18:52:56.479122] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FC took 31.1s. Estimated remaining: 3h 38m 3s. Rate: 7.2 symbols/min [2025-10-15T18:52:56.645266] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:56.645475] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-15T18:52:56.645551] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-15T18:52:56.645733] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-15T18:52:56.645827] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-15T18:52:56.645917] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-15T18:52:56.645986] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-15T18:52:56.919180] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-15T18:52:57.021317] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:57.714006] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-15T18:52:57.786180] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T18:52:58.293927] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:52:58.480890] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T18:52:58.513973] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-15T18:52:59.313986] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-15T18:52:59.379947] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T18:53:00.114017] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-15T18:53:00.914115] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-15T18:53:00.951038] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:53:01.231499] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T18:53:01.297324] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:53:01.714033] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-15T18:53:02.513960] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-15T18:53:02.990734] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:53:03.314029] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-15T18:53:03.744794] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T18:53:03.835375] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T18:53:03.841189] [INFO ] [REMOTE ] FBP: Full fetch complete (66660 records). [2025-10-15T18:53:03.841319] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-15T18:53:04.119115] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-15T18:53:04.227903] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-15T18:53:04.227990] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-15T18:53:04.228889] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-15T18:53:04.228958] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-15T18:53:04.230311] [DEBUG] [LOCAL ] FBP: Trimmed 66660 records to 45728 (keeping 200 days of data) [2025-10-15T18:53:04.523795] [DEBUG] [LOCAL ] FBP: Primary data saved (45728 records). [2025-10-15T18:53:04.523926] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-15T18:53:04.524004] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FBP took 44.4s. Estimated remaining: 3h 37m 54s. Rate: 7.2 symbols/min [2025-10-15T18:53:04.686547] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:04.700974] [DEBUG] [LOCAL ] FCT: Loaded 14666 existing records from primary storage. [2025-10-15T18:53:04.701180] [INFO ] [MAIN ] FCT: Loaded 14666 existing records. [2025-10-15T18:53:04.875355] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:04.875602] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-15T18:53:04.875682] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-15T18:53:04.875907] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-15T18:53:04.875962] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-15T18:53:04.919222] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-15T18:53:05.228496] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:05.245900] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T18:53:05.714054] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-15T18:53:06.429745] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:53:06.514026] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-15T18:53:07.052725] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:53:07.314016] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-15T18:53:08.120454] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-15T18:53:08.122845] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:53:08.555921] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:53:08.608005] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T18:53:08.914014] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-15T18:53:09.713966] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-15T18:53:09.992764] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:53:10.045151] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T18:53:10.514027] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-15T18:53:11.313979] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-15T18:53:11.681109] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T18:53:11.912265] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:53:12.114014] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-15T18:53:12.914016] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-15T18:53:13.497159] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:53:13.713975] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-15T18:53:13.932857] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T18:53:14.513977] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-15T18:53:14.703805] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T18:53:15.313964] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-15T18:53:15.622498] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T18:53:16.113966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-15T18:53:16.314938] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T18:53:16.913973] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-15T18:53:17.267305] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:53:17.714044] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-15T18:53:17.977399] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T18:53:18.514059] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-15T18:53:18.915822] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:53:18.919229] [INFO ] [REMOTE ] FCN: Full fetch complete (35917 records). [2025-10-15T18:53:18.919312] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-15T18:53:19.282248] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-15T18:53:19.288710] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-15T18:53:19.289380] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-15T18:53:19.289930] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-15T18:53:19.290301] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T18:53:19.293831] [DEBUG] [LOCAL ] FCN: Trimmed 35917 records to 26052 (keeping 200 days of data) [2025-10-15T18:53:19.342991] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-15T18:53:19.447800] [DEBUG] [LOCAL ] FCN: Primary data saved (26052 records). [2025-10-15T18:53:19.447928] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-15T18:53:19.448005] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCN took 25.6s. Estimated remaining: 3h 37m 58s. Rate: 7.2 symbols/min [2025-10-15T18:53:19.611639] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:19.659991] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-15T18:53:19.660305] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-15T18:53:19.836105] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:19.836322] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-15T18:53:19.836375] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-15T18:53:19.836559] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-15T18:53:19.836596] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-15T18:53:20.119111] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-15T18:53:20.179664] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:20.395819] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T18:53:20.479612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:53:20.914042] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-15T18:53:21.714023] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-15T18:53:22.513969] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-15T18:53:22.622939] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T18:53:22.749009] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T18:53:22.925961] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T18:53:23.314035] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-15T18:53:24.113996] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-15T18:53:24.612051] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T18:53:24.913992] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-15T18:53:25.714000] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-15T18:53:26.028567] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T18:53:26.093696] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T18:53:26.513963] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-15T18:53:26.841879] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T18:53:26.944077] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T18:53:27.313986] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-15T18:53:28.114061] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-15T18:53:28.758978] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:53:28.766212] [INFO ] [REMOTE ] FCPT: Full fetch complete (53877 records). [2025-10-15T18:53:28.766419] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-15T18:53:28.919139] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-15T18:53:29.149162] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-15T18:53:29.149238] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-15T18:53:29.150004] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-15T18:53:29.150067] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-15T18:53:29.151154] [DEBUG] [LOCAL ] FCPT: Trimmed 53877 records to 37344 (keeping 200 days of data) [2025-10-15T18:53:29.375560] [DEBUG] [LOCAL ] FCPT: Primary data saved (37344 records). [2025-10-15T18:53:29.375745] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-15T18:53:29.375836] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCPT took 34.2s. Estimated remaining: 3h 37m 53s. Rate: 7.2 symbols/min [2025-10-15T18:53:29.523375] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:53:29.587814] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:29.622482] [DEBUG] [LOCAL ] FDP: Loaded 29846 existing records from primary storage. [2025-10-15T18:53:29.622798] [INFO ] [MAIN ] FDP: Loaded 29846 existing records. [2025-10-15T18:53:29.719009] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-15T18:53:29.879706] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:29.880553] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-15T18:53:29.880719] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-15T18:53:29.881368] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-15T18:53:29.881442] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-15T18:53:30.390207] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:30.386489] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-15T18:53:30.419556] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T18:53:30.514034] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-15T18:53:31.314017] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-15T18:53:31.661872] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T18:53:31.662504] [INFO ] [REMOTE ] FCRX: Full fetch complete (1671 records). [2025-10-15T18:53:31.662569] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-15T18:53:31.837167] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-15T18:53:31.837330] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:53:31.837395] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:53:31.837444] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-15T18:53:31.837501] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-15T18:53:31.837538] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-15T18:53:31.837625] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-15T18:53:31.837739] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCRX took 35.4s. Estimated remaining: 3h 37m 33s. Rate: 7.2 symbols/min [2025-10-15T18:53:32.003144] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:32.029696] [DEBUG] [LOCAL ] FDS: Loaded 27588 existing records from primary storage. [2025-10-15T18:53:32.029944] [INFO ] [MAIN ] FDS: Loaded 27588 existing records. [2025-10-15T18:53:32.119103] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-15T18:53:32.205273] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:32.205449] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-15T18:53:32.205493] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-15T18:53:32.205715] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-15T18:53:32.205770] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-15T18:53:32.555917] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:32.597328] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T18:53:32.914028] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-15T18:53:33.092105] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:53:33.714032] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-15T18:53:33.788227] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T18:53:34.514080] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-15T18:53:35.313982] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-15T18:53:35.699527] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:53:35.726149] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T18:53:36.113972] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-15T18:53:36.510366] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:53:36.913999] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-15T18:53:37.033123] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T18:53:37.714016] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-15T18:53:38.514020] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-15T18:53:38.797265] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:53:38.875540] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:53:39.318130] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-15T18:53:39.322347] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T18:53:40.114020] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-15T18:53:40.593857] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:53:40.914012] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-15T18:53:41.199225] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:53:41.713963] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-15T18:53:41.846178] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T18:53:42.513967] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-15T18:53:42.829817] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:53:43.314005] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-15T18:53:43.768985] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T18:53:44.114027] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-15T18:53:44.312964] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T18:53:44.315360] [INFO ] [REMOTE ] FCT: Full fetch complete (21060 records). [2025-10-15T18:53:44.315440] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-15T18:53:44.667532] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-15T18:53:44.667603] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-15T18:53:44.668067] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-15T18:53:44.668128] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-15T18:53:44.668677] [DEBUG] [LOCAL ] FCT: Trimmed 21060 records to 14677 (keeping 200 days of data) [2025-10-15T18:53:44.752814] [DEBUG] [LOCAL ] FCT: Primary data saved (14677 records). [2025-10-15T18:53:44.752937] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-15T18:53:44.753014] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCT took 40.2s. Estimated remaining: 3h 37m 33s. Rate: 7.2 symbols/min [2025-10-15T18:53:44.920097] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-15T18:53:44.920020] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:44.968601] [DEBUG] [LOCAL ] FDX: Loaded 51393 existing records from primary storage. [2025-10-15T18:53:44.969083] [INFO ] [MAIN ] FDX: Loaded 51393 existing records. [2025-10-15T18:53:45.141540] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:45.141763] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-15T18:53:45.141814] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-15T18:53:45.142186] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-15T18:53:45.142241] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-15T18:53:45.491626] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:45.559445] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:53:45.713956] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-15T18:53:46.514019] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-15T18:53:46.554960] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T18:53:47.314037] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-15T18:53:47.540727] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:53:47.578403] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T18:53:48.114024] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-15T18:53:48.913997] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-15T18:53:49.512869] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:53:49.675277] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-15T18:53:49.713997] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-15T18:53:50.514025] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-15T18:53:50.634480] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:53:50.698183] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T18:53:51.314008] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-15T18:53:52.113957] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-15T18:53:52.323174] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:53:52.657028] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:53:52.913955] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-15T18:53:53.161027] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:53:53.714043] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-15T18:53:54.513996] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-15T18:53:54.900884] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T18:53:55.120004] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T18:53:55.314009] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-15T18:53:55.728875] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:53:56.114021] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-15T18:53:56.199964] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T18:53:56.913991] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-15T18:53:57.714045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-15T18:53:58.486785] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:53:58.519090] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-15T18:53:58.530429] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-15T18:53:58.537307] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-15T18:53:58.537438] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-15T18:53:58.943224] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T18:53:58.953354] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-15T18:53:58.953612] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-15T18:53:58.955060] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-15T18:53:58.955501] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-15T18:53:58.956980] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53701 (keeping 200 days of data) [2025-10-15T18:53:59.284637] [DEBUG] [LOCAL ] FCX: Primary data saved (53701 records). [2025-10-15T18:53:59.284797] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-15T18:53:59.285245] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FCX took 39.8s. Estimated remaining: 3h 37m 37s. Rate: 7.1 symbols/min [2025-10-15T18:53:59.319257] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-15T18:53:59.452153] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:59.501533] [DEBUG] [LOCAL ] FE: Loaded 53434 existing records from primary storage. [2025-10-15T18:53:59.501870] [INFO ] [MAIN ] FE: Loaded 53434 existing records. [2025-10-15T18:53:59.677169] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:59.677421] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-15T18:53:59.677485] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-15T18:53:59.677870] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-15T18:53:59.677927] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-15T18:54:00.019959] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:54:00.055708] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:00.056950] [INFO ] [REMOTE ] FDS: Full fetch complete (38612 records). [2025-10-15T18:54:00.057105] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-15T18:54:00.123578] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-15T18:54:00.498694] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T18:54:00.520139] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-15T18:54:00.520891] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-15T18:54:00.522005] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-15T18:54:00.522097] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-15T18:54:00.523493] [DEBUG] [LOCAL ] FDS: Trimmed 38612 records to 27640 (keeping 200 days of data) [2025-10-15T18:54:00.693012] [DEBUG] [LOCAL ] FDS: Primary data saved (27640 records). [2025-10-15T18:54:00.693154] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-15T18:54:00.693239] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDS took 28.9s. Estimated remaining: 3h 37m 15s. Rate: 7.2 symbols/min [2025-10-15T18:54:00.860467] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:00.860688] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-15T18:54:00.860742] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-15T18:54:00.860852] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-15T18:54:00.860894] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-15T18:54:00.860935] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-15T18:54:00.860967] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-15T18:54:00.921317] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-15T18:54:01.208010] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:01.714044] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-15T18:54:01.826673] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:54:02.081891] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-15T18:54:02.446862] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T18:54:02.514007] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-15T18:54:02.935878] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T18:54:03.314055] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-15T18:54:04.113982] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-15T18:54:04.530164] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:54:04.533564] [INFO ] [REMOTE ] FDP: Full fetch complete (42655 records). [2025-10-15T18:54:04.533665] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-15T18:54:04.897297] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-15T18:54:04.897372] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-15T18:54:04.898091] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-15T18:54:04.898155] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-15T18:54:04.899428] [DEBUG] [LOCAL ] FDP: Trimmed 42655 records to 29807 (keeping 200 days of data) [2025-10-15T18:54:04.955831] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-15T18:54:05.085662] [DEBUG] [LOCAL ] FDP: Primary data saved (29807 records). [2025-10-15T18:54:05.085803] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-15T18:54:05.085887] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDP took 35.7s. Estimated remaining: 3h 36m 59s. Rate: 7.2 symbols/min [2025-10-15T18:54:05.251184] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:05.296893] [DEBUG] [LOCAL ] FERG: Loaded 48763 existing records from primary storage. [2025-10-15T18:54:05.297189] [INFO ] [MAIN ] FERG: Loaded 48763 existing records. [2025-10-15T18:54:05.379550] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T18:54:05.477931] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:05.478166] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-15T18:54:05.478230] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-15T18:54:05.478630] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-15T18:54:05.478738] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-15T18:54:05.717561] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-15T18:54:05.841856] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:06.083042] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T18:54:06.216504] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T18:54:06.513999] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-15T18:54:07.313983] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-15T18:54:08.113982] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-15T18:54:08.187136] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:54:08.913994] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-15T18:54:09.227620] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T18:54:09.713975] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-15T18:54:09.855381] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:54:10.299454] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:54:10.514017] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-15T18:54:10.964962] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T18:54:11.313986] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-15T18:54:11.663717] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:54:11.729792] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:54:12.114022] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-15T18:54:12.914046] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-15T18:54:13.233498] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T18:54:13.719746] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-15T18:54:13.732347] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T18:54:14.514038] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-15T18:54:15.267213] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T18:54:15.314052] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-15T18:54:16.113975] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-15T18:54:16.411872] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T18:54:16.470115] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T18:54:16.913978] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-15T18:54:17.237639] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T18:54:17.714017] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-15T18:54:18.513995] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-15T18:54:18.661033] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:54:19.314064] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-15T18:54:19.583833] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-15T18:54:19.585323] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:54:20.114029] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-15T18:54:20.392081] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T18:54:20.499345] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-15T18:54:20.914055] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-15T18:54:21.714011] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-15T18:54:22.508702] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:54:22.523953] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-15T18:54:23.314001] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-15T18:54:23.599622] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T18:54:24.113980] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-15T18:54:24.210531] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T18:54:24.914007] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-15T18:54:25.299133] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T18:54:25.305349] [INFO ] [REMOTE ] FDX: Full fetch complete (74413 records). [2025-10-15T18:54:25.305794] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-15T18:54:25.710013] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-15T18:54:25.710176] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-15T18:54:25.711369] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-15T18:54:25.711456] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-15T18:54:25.713225] [DEBUG] [LOCAL ] FDX: Trimmed 74413 records to 51368 (keeping 200 days of data) [2025-10-15T18:54:25.713980] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-15T18:54:25.970481] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T18:54:26.079364] [DEBUG] [LOCAL ] FDX: Primary data saved (51368 records). [2025-10-15T18:54:26.079508] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-15T18:54:26.079589] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDX took 41.3s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-15T18:54:26.254125] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:26.257797] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:54:26.258876] [INFO ] [REMOTE ] FENG: Full fetch complete (2280 records). [2025-10-15T18:54:26.259112] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-15T18:54:26.388072] [DEBUG] [LOCAL ] FET: Loaded 12800 existing records from primary storage. [2025-10-15T18:54:26.424095] [INFO ] [MAIN ] FET: Loaded 12800 existing records. [2025-10-15T18:54:26.473159] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T18:54:26.496792] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:54:26.509177] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:54:26.529504] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-15T18:54:26.529262] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-15T18:54:26.564558] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-15T18:54:26.573676] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-15T18:54:26.574203] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-15T18:54:26.584780] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FENG took 25.9s. Estimated remaining: 3h 36m 51s. Rate: 7.2 symbols/min [2025-10-15T18:54:26.705842] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:26.758566] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-15T18:54:26.765032] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-15T18:54:26.789473] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-15T18:54:26.795983] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-15T18:54:26.795820] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T18:54:27.023066] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:27.221538] [DEBUG] [LOCAL ] FF: Loaded 24316 existing records from primary storage. [2025-10-15T18:54:27.242625] [INFO ] [MAIN ] FF: Loaded 24316 existing records. [2025-10-15T18:54:27.322186] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-15T18:54:27.325888] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:27.445815] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:27.445993] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-15T18:54:27.446061] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-15T18:54:27.446374] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-15T18:54:27.446445] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-15T18:54:27.797787] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:28.113966] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-15T18:54:28.188994] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:54:28.897536] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T18:54:28.913952] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-15T18:54:28.927967] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:54:29.714021] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-15T18:54:30.514028] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-15T18:54:30.749581] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:54:30.969230] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T18:54:31.072397] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:54:31.313972] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-15T18:54:32.114025] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-15T18:54:32.926026] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-15T18:54:32.928968] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T18:54:32.956430] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T18:54:33.714003] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-15T18:54:34.514022] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-15T18:54:34.744380] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:54:35.311320] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T18:54:35.317095] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-15T18:54:35.512131] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T18:54:36.027229] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T18:54:36.113967] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-15T18:54:36.914011] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-15T18:54:37.181022] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:54:37.713996] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-15T18:54:37.733158] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T18:54:38.513997] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-15T18:54:38.990524] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:54:39.268547] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T18:54:39.313951] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-15T18:54:40.078199] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T18:54:40.113960] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-15T18:54:40.914029] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-15T18:54:41.714022] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-15T18:54:41.983939] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:54:42.269870] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:54:42.495869] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T18:54:42.513953] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-15T18:54:43.313968] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-15T18:54:43.409941] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T18:54:44.113985] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-15T18:54:44.911075] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:54:44.917289] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-15T18:54:44.919012] [INFO ] [REMOTE ] FE: Full fetch complete (77465 records). [2025-10-15T18:54:44.919138] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-15T18:54:45.117954] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:54:45.227692] [INFO ] [REMOTE ] FERG: Full fetch complete (71030 records). [2025-10-15T18:54:45.248940] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-15T18:54:45.484816] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-15T18:54:45.508057] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-15T18:54:45.517173] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-15T18:54:45.517830] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-15T18:54:45.611708] [DEBUG] [LOCAL ] FE: Trimmed 77465 records to 53432 (keeping 200 days of data) [2025-10-15T18:54:45.718107] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-15T18:54:45.855238] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-15T18:54:45.857266] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-15T18:54:45.858531] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-15T18:54:45.859958] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-15T18:54:45.867363] [DEBUG] [LOCAL ] FERG: Trimmed 71030 records to 48746 (keeping 200 days of data) [2025-10-15T18:54:46.004235] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T18:54:46.418191] [DEBUG] [LOCAL ] FE: Primary data saved (53432 records). [2025-10-15T18:54:46.420986] [INFO ] [MAIN ] FE: Full history saved. [2025-10-15T18:54:46.421822] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FE took 47.1s. Estimated remaining: 3h 37m 4s. Rate: 7.1 symbols/min [2025-10-15T18:54:46.516350] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-15T18:54:46.516273] [DEBUG] [LOCAL ] FERG: Primary data saved (48746 records). [2025-10-15T18:54:46.537365] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-15T18:54:46.543672] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FERG took 41.5s. Estimated remaining: 3h 36m 40s. Rate: 7.1 symbols/min [2025-10-15T18:54:46.689809] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:46.783019] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:46.800223] [DEBUG] [LOCAL ] FFA: Loaded 6023 existing records from primary storage. [2025-10-15T18:54:46.802101] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:54:46.802260] [INFO ] [MAIN ] FFA: Loaded 6023 existing records. [2025-10-15T18:54:46.938425] [DEBUG] [LOCAL ] FFC: Loaded 16759 existing records from primary storage. [2025-10-15T18:54:46.961590] [INFO ] [MAIN ] FFC: Loaded 16759 existing records. [2025-10-15T18:54:46.998440] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:47.047619] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-15T18:54:47.072461] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-15T18:54:47.101892] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-15T18:54:47.101967] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-15T18:54:47.289812] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:47.311379] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-15T18:54:47.316680] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-15T18:54:47.345163] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-15T18:54:47.367355] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-15T18:54:47.409092] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-15T18:54:47.720019] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:47.750793] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T18:54:47.953115] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:48.113953] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-15T18:54:48.131502] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:54:48.913988] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-15T18:54:49.134364] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T18:54:49.674766] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T18:54:49.713947] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-15T18:54:50.514022] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-15T18:54:50.807833] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T18:54:51.314028] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-15T18:54:51.493425] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T18:54:51.949576] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T18:54:52.114002] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-15T18:54:52.872552] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:54:52.913953] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-15T18:54:53.713987] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-15T18:54:53.911945] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T18:54:53.915521] [INFO ] [REMOTE ] FF: Full fetch complete (36552 records). [2025-10-15T18:54:53.915751] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-15T18:54:54.280750] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-15T18:54:54.280841] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-15T18:54:54.281514] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-15T18:54:54.281553] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-15T18:54:54.282335] [DEBUG] [LOCAL ] FF: Trimmed 36552 records to 24337 (keeping 200 days of data) [2025-10-15T18:54:54.423374] [DEBUG] [LOCAL ] FF: Primary data saved (24337 records). [2025-10-15T18:54:54.423504] [INFO ] [MAIN ] FF: Full history saved. [2025-10-15T18:54:54.423589] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FF took 27.8s. Estimated remaining: 3h 36m 31s. Rate: 7.1 symbols/min [2025-10-15T18:54:54.516841] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-15T18:54:54.599354] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:54.632895] [DEBUG] [LOCAL ] FFWM: Loaded 35818 existing records from primary storage. [2025-10-15T18:54:54.633188] [INFO ] [MAIN ] FFWM: Loaded 35818 existing records. [2025-10-15T18:54:54.708591] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T18:54:54.740436] [INFO ] [REMOTE ] FET: Full fetch complete (18366 records). [2025-10-15T18:54:54.742938] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-15T18:54:54.932874] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:54.948466] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-15T18:54:54.961359] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-15T18:54:54.981103] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-15T18:54:54.996159] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-15T18:54:55.322724] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-15T18:54:55.504060] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-15T18:54:55.507065] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-15T18:54:55.507924] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-15T18:54:55.508115] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-15T18:54:55.557915] [DEBUG] [LOCAL ] FET: Trimmed 18366 records to 12838 (keeping 200 days of data) [2025-10-15T18:54:55.587740] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:55.598598] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:54:55.680826] [DEBUG] [LOCAL ] FET: Primary data saved (12838 records). [2025-10-15T18:54:55.681011] [INFO ] [MAIN ] FET: Full history saved. [2025-10-15T18:54:55.681151] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FET took 29.6s. Estimated remaining: 3h 36m 9s. Rate: 7.2 symbols/min [2025-10-15T18:54:55.859867] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:55.881583] [DEBUG] [LOCAL ] FG: Loaded 22259 existing records from primary storage. [2025-10-15T18:54:55.881885] [INFO ] [MAIN ] FG: Loaded 22259 existing records. [2025-10-15T18:54:56.054935] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:56.060053] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-15T18:54:56.060734] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T18:54:56.060520] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-15T18:54:56.063323] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-15T18:54:56.063379] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-15T18:54:56.122113] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-15T18:54:56.409197] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:56.732775] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T18:54:56.913985] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-15T18:54:57.672853] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T18:54:57.714065] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-15T18:54:58.456908] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:54:58.513957] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-15T18:54:59.291765] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T18:54:59.313964] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-15T18:55:00.050524] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T18:55:00.113992] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-15T18:55:00.914015] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-15T18:55:01.312194] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T18:55:01.714009] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-15T18:55:02.037369] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T18:55:02.486448] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T18:55:02.513954] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-15T18:55:03.314040] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-15T18:55:03.860485] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:55:03.915231] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T18:55:04.114032] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-15T18:55:04.914016] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-15T18:55:05.272500] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T18:55:05.714009] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-15T18:55:06.514037] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-15T18:55:06.555593] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T18:55:06.726038] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T18:55:07.105537] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T18:55:07.313995] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-15T18:55:07.952404] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T18:55:08.113997] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-15T18:55:08.914007] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-15T18:55:09.184000] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:55:09.713985] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-15T18:55:10.173870] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T18:55:10.513983] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-15T18:55:11.181055] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:55:11.313961] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-15T18:55:11.560029] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T18:55:12.114008] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-15T18:55:12.313739] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:55:12.914053] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-15T18:55:13.502502] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:55:13.561152] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T18:55:13.714013] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-15T18:55:14.514020] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-15T18:55:14.577621] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T18:55:15.314060] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-15T18:55:15.589748] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T18:55:16.114026] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-15T18:55:16.551545] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T18:55:16.740990] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T18:55:16.913999] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-15T18:55:17.632526] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:55:17.634130] [INFO ] [REMOTE ] FFA: Full fetch complete (8790 records). [2025-10-15T18:55:17.634265] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-15T18:55:17.719214] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-15T18:55:18.072781] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-15T18:55:18.072899] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-15T18:55:18.073208] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-15T18:55:18.073250] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-15T18:55:18.073922] [DEBUG] [LOCAL ] FFA: Trimmed 8790 records to 5921 (keeping 200 days of data) [2025-10-15T18:55:18.114871] [DEBUG] [LOCAL ] FFA: Primary data saved (5921 records). [2025-10-15T18:55:18.115083] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-15T18:55:18.115195] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFA took 31.7s. Estimated remaining: 3h 36m 27s. Rate: 7.1 symbols/min [2025-10-15T18:55:18.300346] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:18.311024] [DEBUG] [LOCAL ] FGN: Loaded 3718 existing records from primary storage. [2025-10-15T18:55:18.311289] [INFO ] [MAIN ] FGN: Loaded 3718 existing records. [2025-10-15T18:55:18.499670] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:18.500058] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-15T18:55:18.500122] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-15T18:55:18.500289] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-15T18:55:18.500327] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-15T18:55:18.520804] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-15T18:55:18.871027] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:18.892102] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T18:55:19.313970] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-15T18:55:19.620871] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:55:19.624468] [INFO ] [REMOTE ] FG: Full fetch complete (28567 records). [2025-10-15T18:55:19.624684] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-15T18:55:19.993991] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-15T18:55:19.994075] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-15T18:55:19.994874] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-15T18:55:19.995064] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-15T18:55:19.996002] [DEBUG] [LOCAL ] FG: Trimmed 28567 records to 22183 (keeping 200 days of data) [2025-10-15T18:55:20.116694] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-15T18:55:20.145472] [DEBUG] [LOCAL ] FG: Primary data saved (22183 records). [2025-10-15T18:55:20.145729] [INFO ] [MAIN ] FG: Full history saved. [2025-10-15T18:55:20.145899] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FG took 24.5s. Estimated remaining: 3h 36m 7s. Rate: 7.1 symbols/min [2025-10-15T18:55:20.280167] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T18:55:20.356747] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:20.356956] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-15T18:55:20.357031] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-15T18:55:20.357161] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-15T18:55:20.357204] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-15T18:55:20.357248] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-15T18:55:20.357280] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-15T18:55:20.713606] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:20.913949] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-15T18:55:21.098709] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:55:21.099035] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-15T18:55:21.099147] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:55:21.099231] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-15T18:55:21.099316] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:55:21.099430] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-15T18:55:21.099529] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-15T18:55:21.099573] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-15T18:55:21.099617] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-15T18:55:21.099694] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGSN took 1.0s. Estimated remaining: 3h 35m 44s. Rate: 7.2 symbols/min [2025-10-15T18:55:21.269309] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:21.311169] [DEBUG] [LOCAL ] FHI: Loaded 39897 existing records from primary storage. [2025-10-15T18:55:21.311451] [INFO ] [MAIN ] FHI: Loaded 39897 existing records. [2025-10-15T18:55:21.491192] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:21.491414] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-15T18:55:21.491474] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-15T18:55:21.491886] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-15T18:55:21.491943] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-15T18:55:21.695559] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T18:55:21.720906] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-15T18:55:21.895029] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:22.514001] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-15T18:55:22.779592] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:55:23.081269] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T18:55:23.314004] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-15T18:55:24.113997] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-15T18:55:24.691795] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T18:55:24.914064] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-15T18:55:25.478123] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T18:55:25.713970] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-15T18:55:25.906945] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T18:55:26.514018] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-15T18:55:27.062446] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T18:55:27.314002] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-15T18:55:27.766575] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:55:28.114071] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-15T18:55:28.887860] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:55:28.913952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-15T18:55:29.053726] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T18:55:29.713999] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-15T18:55:30.449313] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:55:30.513992] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-15T18:55:30.762897] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T18:55:30.767736] [INFO ] [REMOTE ] FFWM: Full fetch complete (51874 records). [2025-10-15T18:55:30.767910] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-15T18:55:31.156250] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-15T18:55:31.156334] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-15T18:55:31.157099] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-15T18:55:31.157162] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-15T18:55:31.158352] [DEBUG] [LOCAL ] FFWM: Trimmed 51874 records to 35915 (keeping 200 days of data) [2025-10-15T18:55:31.327446] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-15T18:55:31.355134] [DEBUG] [LOCAL ] FFWM: Primary data saved (35915 records). [2025-10-15T18:55:31.355261] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-15T18:55:31.355343] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FFWM took 36.9s. Estimated remaining: 3h 35m 40s. Rate: 7.2 symbols/min [2025-10-15T18:55:31.519193] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:31.569154] [DEBUG] [LOCAL ] FHN: Loaded 53391 existing records from primary storage. [2025-10-15T18:55:31.569670] [INFO ] [MAIN ] FHN: Loaded 53391 existing records. [2025-10-15T18:55:31.749466] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:31.749723] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-15T18:55:31.749788] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-15T18:55:31.750246] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-15T18:55:31.750316] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-15T18:55:31.911207] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:55:32.115681] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-15T18:55:32.137311] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:32.268906] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:55:32.914026] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-15T18:55:33.385436] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T18:55:33.704513] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T18:55:33.714016] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-15T18:55:34.179511] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T18:55:34.514067] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-15T18:55:35.314059] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-15T18:55:36.114033] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-15T18:55:36.180311] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:55:36.454660] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T18:55:36.692579] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:55:36.914087] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-15T18:55:37.713989] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-15T18:55:38.299850] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T18:55:38.341639] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:55:38.514018] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-15T18:55:39.314003] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-15T18:55:39.780538] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T18:55:40.114092] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-15T18:55:40.285288] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:55:40.914000] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-15T18:55:41.367493] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T18:55:41.714034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-15T18:55:42.513962] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-15T18:55:42.549284] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:55:42.731263] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T18:55:42.733463] [INFO ] [REMOTE ] FFC: Full fetch complete (24602 records). [2025-10-15T18:55:42.733560] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-15T18:55:43.099424] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-15T18:55:43.099547] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-15T18:55:43.100073] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-15T18:55:43.100133] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-15T18:55:43.100941] [DEBUG] [LOCAL ] FFC: Trimmed 24602 records to 16719 (keeping 200 days of data) [2025-10-15T18:55:43.203028] [DEBUG] [LOCAL ] FFC: Primary data saved (16719 records). [2025-10-15T18:55:43.203162] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-15T18:55:43.203254] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FFC took 56.7s. Estimated remaining: 3h 35m 38s. Rate: 7.2 symbols/min [2025-10-15T18:55:43.319127] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-15T18:55:43.377253] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:43.431363] [DEBUG] [LOCAL ] FI: Loaded 53575 existing records from primary storage. [2025-10-15T18:55:43.431763] [INFO ] [MAIN ] FI: Loaded 53575 existing records. [2025-10-15T18:55:43.605959] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:43.606208] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-15T18:55:43.606289] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-15T18:55:43.606796] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-15T18:55:43.606870] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-15T18:55:43.867793] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T18:55:43.988703] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:44.008421] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T18:55:44.113981] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-15T18:55:44.914051] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-15T18:55:45.442278] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T18:55:45.544728] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T18:55:45.549607] [INFO ] [REMOTE ] FHI: Full fetch complete (57695 records). [2025-10-15T18:55:45.549762] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-15T18:55:45.721318] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-15T18:55:45.936689] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-15T18:55:45.936786] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-15T18:55:45.937568] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-15T18:55:45.937611] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-15T18:55:45.938872] [DEBUG] [LOCAL ] FHI: Trimmed 57695 records to 39897 (keeping 200 days of data) [2025-10-15T18:55:46.177352] [DEBUG] [LOCAL ] FHI: Primary data saved (39897 records). [2025-10-15T18:55:46.177492] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-15T18:55:46.177572] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FHI took 25.1s. Estimated remaining: 3h 35m 19s. Rate: 7.2 symbols/min [2025-10-15T18:55:46.346636] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:46.367453] [DEBUG] [LOCAL ] FICO: Loaded 21736 existing records from primary storage. [2025-10-15T18:55:46.367715] [INFO ] [MAIN ] FICO: Loaded 21736 existing records. [2025-10-15T18:55:46.464731] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-15T18:55:46.519119] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-15T18:55:46.556416] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:46.556698] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-15T18:55:46.556755] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-15T18:55:46.557294] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-15T18:55:46.557351] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-15T18:55:46.905242] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:47.314053] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-15T18:55:48.114027] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-15T18:55:48.175796] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T18:55:48.196416] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T18:55:48.636008] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T18:55:48.914045] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-15T18:55:49.714058] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-15T18:55:50.514038] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-15T18:55:50.710436] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T18:55:50.784871] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:55:50.973108] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T18:55:50.974310] [INFO ] [REMOTE ] FGN: Full fetch complete (5633 records). [2025-10-15T18:55:50.974398] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-15T18:55:51.322202] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-15T18:55:51.329241] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-15T18:55:51.329345] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-15T18:55:51.329510] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-15T18:55:51.329549] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-15T18:55:51.329942] [DEBUG] [LOCAL ] FGN: Trimmed 5633 records to 3724 (keeping 200 days of data) [2025-10-15T18:55:51.351994] [DEBUG] [LOCAL ] FGN: Primary data saved (3724 records). [2025-10-15T18:55:51.352069] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-15T18:55:51.352141] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FGN took 33.2s. Estimated remaining: 3h 35m 5s. Rate: 7.2 symbols/min [2025-10-15T18:55:51.516162] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:51.516318] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-15T18:55:51.516355] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-15T18:55:51.516466] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-15T18:55:51.516507] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-15T18:55:51.516548] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-15T18:55:51.516580] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-15T18:55:51.861033] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:52.114024] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-15T18:55:52.913985] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-15T18:55:53.204907] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:55:53.290461] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T18:55:53.714067] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-15T18:55:54.455544] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T18:55:54.476960] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T18:55:54.513966] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-15T18:55:55.314019] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-15T18:55:55.609593] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T18:55:56.114006] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-15T18:55:56.914000] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-15T18:55:57.025660] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:55:57.182021] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:55:57.713986] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-15T18:55:58.514068] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-15T18:55:58.706118] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T18:55:58.842940] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T18:55:59.314045] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-15T18:55:59.635726] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T18:55:59.862474] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:56:00.114031] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-15T18:56:00.353919] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-15T18:56:00.914056] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-15T18:56:01.713994] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-15T18:56:02.513971] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-15T18:56:02.743914] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:56:03.157191] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T18:56:03.313978] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-15T18:56:03.573835] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-15T18:56:04.113978] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-15T18:56:04.205361] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:56:04.913992] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-15T18:56:05.515456] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T18:56:05.714016] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-15T18:56:06.514089] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-15T18:56:06.574976] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:56:06.791009] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-15T18:56:07.277281] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:56:07.313990] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-15T18:56:08.114051] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-15T18:56:08.914010] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-15T18:56:09.231377] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T18:56:09.273829] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:56:09.714052] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-15T18:56:10.513985] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-15T18:56:10.662117] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:56:11.314044] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-15T18:56:11.631350] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T18:56:11.632383] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T18:56:11.647343] [INFO ] [REMOTE ] FICO: Full fetch complete (29810 records). [2025-10-15T18:56:11.647437] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-15T18:56:12.063836] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-15T18:56:12.063949] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-15T18:56:12.064790] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-15T18:56:12.064857] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-15T18:56:12.065770] [DEBUG] [LOCAL ] FICO: Trimmed 29810 records to 21752 (keeping 200 days of data) [2025-10-15T18:56:12.120946] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-15T18:56:12.217293] [DEBUG] [LOCAL ] FICO: Primary data saved (21752 records). [2025-10-15T18:56:12.217428] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-15T18:56:12.217509] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FICO took 26.0s. Estimated remaining: 3h 35m 20s. Rate: 7.1 symbols/min [2025-10-15T18:56:12.381529] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:12.422569] [DEBUG] [LOCAL ] FIGS: Loaded 48563 existing records from primary storage. [2025-10-15T18:56:12.422932] [INFO ] [MAIN ] FIGS: Loaded 48563 existing records. [2025-10-15T18:56:12.521324] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-15T18:56:12.602729] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:12.602961] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-15T18:56:12.603009] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-15T18:56:12.603765] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-15T18:56:12.603823] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-15T18:56:12.915394] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-15T18:56:12.986120] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:13.079277] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:56:13.085849] [INFO ] [REMOTE ] FHN: Full fetch complete (77471 records). [2025-10-15T18:56:13.086007] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-15T18:56:13.485611] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-15T18:56:13.485733] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-15T18:56:13.486706] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-15T18:56:13.486774] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-15T18:56:13.488391] [DEBUG] [LOCAL ] FHN: Trimmed 77471 records to 53392 (keeping 200 days of data) [2025-10-15T18:56:13.718793] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-15T18:56:13.828995] [DEBUG] [LOCAL ] FHN: Primary data saved (53392 records). [2025-10-15T18:56:13.829158] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-15T18:56:13.830129] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FHN took 42.5s. Estimated remaining: 3h 34m 59s. Rate: 7.2 symbols/min [2025-10-15T18:56:13.998298] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:14.039790] [DEBUG] [LOCAL ] FIHL: Loaded 39429 existing records from primary storage. [2025-10-15T18:56:14.040083] [INFO ] [MAIN ] FIHL: Loaded 39429 existing records. [2025-10-15T18:56:14.222131] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:14.222331] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-15T18:56:14.222378] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-15T18:56:14.223043] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-15T18:56:14.223101] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-15T18:56:14.519189] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-15T18:56:14.586232] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:14.881623] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:56:15.141052] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T18:56:15.232618] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:56:15.314004] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-15T18:56:16.114058] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-15T18:56:16.865083] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T18:56:16.913977] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-15T18:56:17.714053] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-15T18:56:18.109214] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:56:18.451189] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T18:56:18.514040] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-15T18:56:18.670117] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:56:19.314073] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-15T18:56:20.113963] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-15T18:56:20.318966] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:56:20.919487] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-15T18:56:20.921590] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T18:56:21.306235] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T18:56:21.713993] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-15T18:56:22.340343] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T18:56:22.346904] [INFO ] [REMOTE ] FI: Full fetch complete (77421 records). [2025-10-15T18:56:22.347051] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-15T18:56:22.530835] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-15T18:56:22.797263] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:56:22.830748] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-15T18:56:22.830929] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-15T18:56:22.831903] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-15T18:56:22.831984] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-15T18:56:22.833339] [DEBUG] [LOCAL ] FI: Trimmed 77421 records to 53580 (keeping 200 days of data) [2025-10-15T18:56:23.157514] [DEBUG] [LOCAL ] FI: Primary data saved (53580 records). [2025-10-15T18:56:23.157681] [INFO ] [MAIN ] FI: Full history saved. [2025-10-15T18:56:23.157782] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FI took 40.0s. Estimated remaining: 3h 34m 52s. Rate: 7.2 symbols/min [2025-10-15T18:56:23.320001] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-15T18:56:23.322514] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:23.332752] [DEBUG] [LOCAL ] FINS: Loaded 8322 existing records from primary storage. [2025-10-15T18:56:23.332949] [INFO ] [MAIN ] FINS: Loaded 8322 existing records. [2025-10-15T18:56:23.508204] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:23.508522] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-15T18:56:23.508595] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-15T18:56:23.509030] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-15T18:56:23.509090] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-15T18:56:23.868285] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:23.914969] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:56:24.113993] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-15T18:56:24.325440] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:56:24.325812] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-15T18:56:24.325899] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:56:24.326000] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-15T18:56:24.326069] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:56:24.326144] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-15T18:56:24.326208] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-15T18:56:24.326244] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-15T18:56:24.326282] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-15T18:56:24.326327] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIG took 33.0s. Estimated remaining: 3h 34m 30s. Rate: 7.2 symbols/min [2025-10-15T18:56:24.511509] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:24.550631] [DEBUG] [LOCAL ] FINV: Loaded 45286 existing records from primary storage. [2025-10-15T18:56:24.550949] [INFO ] [MAIN ] FINV: Loaded 45286 existing records. [2025-10-15T18:56:24.726670] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:24.726936] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-15T18:56:24.726999] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-15T18:56:24.727879] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-15T18:56:24.727939] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-15T18:56:24.885893] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:56:24.923089] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-15T18:56:25.196034] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:25.714015] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-15T18:56:25.923950] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:56:26.514015] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-15T18:56:26.797866] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T18:56:27.314006] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-15T18:56:28.016424] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:56:28.113984] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-15T18:56:28.858267] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T18:56:28.913961] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-15T18:56:29.664018] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T18:56:29.713973] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-15T18:56:30.426101] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:56:30.513994] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-15T18:56:31.108631] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T18:56:31.313988] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-15T18:56:32.085202] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T18:56:32.112364] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:56:32.121175] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-15T18:56:32.778606] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T18:56:32.914007] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-15T18:56:33.714016] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-15T18:56:34.514002] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-15T18:56:34.606262] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T18:56:35.192364] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T18:56:35.313973] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-15T18:56:36.056125] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:56:36.113989] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-15T18:56:36.913972] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-15T18:56:37.063154] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:56:37.531864] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T18:56:37.556173] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:56:37.714013] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-15T18:56:38.514009] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-15T18:56:39.224074] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:56:39.314010] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-15T18:56:40.095251] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:56:40.113975] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-15T18:56:40.729598] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T18:56:40.914080] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-15T18:56:41.719151] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-15T18:56:41.736318] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T18:56:42.150186] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:56:42.154899] [INFO ] [REMOTE ] FIHL: Full fetch complete (56417 records). [2025-10-15T18:56:42.154991] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-15T18:56:42.516454] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-15T18:56:42.549595] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T18:56:42.573870] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-15T18:56:42.574125] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-15T18:56:42.575409] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-15T18:56:42.575502] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-15T18:56:42.579350] [DEBUG] [LOCAL ] FIHL: Trimmed 56417 records to 39437 (keeping 200 days of data) [2025-10-15T18:56:42.845557] [DEBUG] [LOCAL ] FIHL: Primary data saved (39437 records). [2025-10-15T18:56:42.845799] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-15T18:56:42.845954] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FIHL took 29.0s. Estimated remaining: 3h 34m 41s. Rate: 7.2 symbols/min [2025-10-15T18:56:43.028478] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:43.085050] [DEBUG] [LOCAL ] FIS: Loaded 53343 existing records from primary storage. [2025-10-15T18:56:43.085512] [INFO ] [MAIN ] FIS: Loaded 53343 existing records. [2025-10-15T18:56:43.281980] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:43.282278] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-15T18:56:43.282333] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-15T18:56:43.283375] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-15T18:56:43.283440] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-15T18:56:43.319160] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-15T18:56:43.662189] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:43.897983] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T18:56:44.113985] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-15T18:56:44.657415] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:56:44.663602] [INFO ] [REMOTE ] FIGS: Full fetch complete (70888 records). [2025-10-15T18:56:44.663768] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-15T18:56:44.922582] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-15T18:56:45.043217] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-15T18:56:45.043302] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-15T18:56:45.044257] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-15T18:56:45.044324] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-15T18:56:45.045751] [DEBUG] [LOCAL ] FIGS: Trimmed 70888 records to 48583 (keeping 200 days of data) [2025-10-15T18:56:45.315357] [DEBUG] [LOCAL ] FIGS: Primary data saved (48583 records). [2025-10-15T18:56:45.315529] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-15T18:56:45.315667] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FIGS took 33.1s. Estimated remaining: 3h 34m 21s. Rate: 7.2 symbols/min [2025-10-15T18:56:45.484044] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:45.510543] [DEBUG] [LOCAL ] FIX: Loaded 28900 existing records from primary storage. [2025-10-15T18:56:45.510863] [INFO ] [MAIN ] FIX: Loaded 28900 existing records. [2025-10-15T18:56:45.686774] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:45.687116] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-15T18:56:45.687238] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-15T18:56:45.688017] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-15T18:56:45.688074] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-15T18:56:45.718526] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-15T18:56:45.892393] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T18:56:46.082800] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:46.279816] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T18:56:46.416546] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T18:56:46.514011] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-15T18:56:47.314062] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-15T18:56:47.313992] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:56:48.114013] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-15T18:56:48.914029] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-15T18:56:49.031602] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:56:49.422026] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T18:56:49.714322] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:56:49.714048] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-15T18:56:50.514008] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-15T18:56:51.047810] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T18:56:51.313995] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-15T18:56:51.902323] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:56:52.114005] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-15T18:56:52.176117] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:56:52.914015] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-15T18:56:53.599582] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:56:53.631185] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T18:56:53.713970] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-15T18:56:54.514052] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-15T18:56:55.318351] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-15T18:56:55.324156] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T18:56:55.881450] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T18:56:56.114028] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-15T18:56:56.914027] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-15T18:56:57.150888] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:56:57.713971] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-15T18:56:57.855546] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T18:56:58.059622] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T18:56:58.514000] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-15T18:56:59.054995] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:56:59.056276] [INFO ] [REMOTE ] FINS: Full fetch complete (11780 records). [2025-10-15T18:56:59.056345] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-15T18:56:59.324337] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-15T18:56:59.416326] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-15T18:56:59.416458] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-15T18:56:59.416762] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-15T18:56:59.416822] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-15T18:56:59.417695] [DEBUG] [LOCAL ] FINS: Trimmed 11780 records to 8292 (keeping 200 days of data) [2025-10-15T18:56:59.476011] [DEBUG] [LOCAL ] FINS: Primary data saved (8292 records). [2025-10-15T18:56:59.476186] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-15T18:56:59.476317] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FINS took 36.3s. Estimated remaining: 3h 34m 24s. Rate: 7.2 symbols/min [2025-10-15T18:56:59.645475] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:59.645790] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-15T18:56:59.645971] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-15T18:56:59.646088] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-15T18:56:59.656541] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-15T18:56:59.671204] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-15T18:56:59.674514] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-15T18:56:59.704248] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:57:00.093684] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:00.113957] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-15T18:57:00.316220] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:57:00.316553] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-15T18:57:00.316694] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:57:00.316779] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-15T18:57:00.316854] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:57:00.316930] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-15T18:57:00.316992] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-15T18:57:00.317034] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-15T18:57:00.317127] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-15T18:57:00.317215] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 0.8s. Estimated remaining: 3h 34m 1s. Rate: 7.2 symbols/min [2025-10-15T18:57:00.696769] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T18:57:00.914012] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-15T18:57:01.714007] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-15T18:57:02.514109] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-15T18:57:02.575777] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:57:03.111490] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:57:03.314038] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-15T18:57:03.814350] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T18:57:04.114020] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-15T18:57:04.913989] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-15T18:57:05.047327] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:57:05.598265] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T18:57:05.714008] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-15T18:57:06.405421] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T18:57:06.411694] [INFO ] [REMOTE ] FINV: Full fetch complete (64518 records). [2025-10-15T18:57:06.411804] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-15T18:57:06.515540] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-15T18:57:06.801429] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-15T18:57:06.801513] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-15T18:57:06.802392] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-15T18:57:06.802454] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-15T18:57:06.803778] [DEBUG] [LOCAL ] FINV: Trimmed 64518 records to 45270 (keeping 200 days of data) [2025-10-15T18:57:07.056248] [DEBUG] [LOCAL ] FINV: Primary data saved (45270 records). [2025-10-15T18:57:07.056391] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-15T18:57:07.056762] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FINV took 42.7s. Estimated remaining: 3h 33m 50s. Rate: 7.2 symbols/min [2025-10-15T18:57:07.597808] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T18:57:07.610979] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-15T18:57:07.630104] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T18:57:08.114013] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-15T18:57:09.491947] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T18:57:09.498175] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-15T18:57:09.538965] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T18:57:09.714031] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-15T18:57:11.309826] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T18:57:11.313088] [INFO ] [REMOTE ] FIX: Full fetch complete (45389 records). [2025-10-15T18:57:11.313193] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-15T18:57:11.709101] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-15T18:57:11.709193] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-15T18:57:11.720737] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-15T18:57:11.725948] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-15T18:57:11.741425] [DEBUG] [LOCAL ] FIX: Trimmed 45389 records to 28800 (keeping 200 days of data) [2025-10-15T18:57:11.742550] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T18:57:11.843530] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-15T18:57:11.931870] [DEBUG] [LOCAL ] FIX: Primary data saved (28800 records). [2025-10-15T18:57:11.931997] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-15T18:57:11.932075] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIX took 26.6s. Estimated remaining: 3h 33m 35s. Rate: 7.2 symbols/min [2025-10-15T18:57:12.665912] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:57:12.672635] [INFO ] [REMOTE ] FIS: Full fetch complete (77375 records). [2025-10-15T18:57:12.672847] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-15T18:57:13.078675] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-15T18:57:13.078763] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-15T18:57:13.079791] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-15T18:57:13.079856] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-15T18:57:13.081351] [DEBUG] [LOCAL ] FIS: Trimmed 77375 records to 53339 (keeping 200 days of data) [2025-10-15T18:57:13.411508] [DEBUG] [LOCAL ] FIS: Primary data saved (53339 records). [2025-10-15T18:57:13.411670] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-15T18:57:13.412553] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 30.6s. Estimated remaining: 3h 33m 14s. Rate: 7.2 symbols/min [2025-10-15T18:57:14.028074] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.115047] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.103398] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.141114] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.149196] [DEBUG] [LOCAL ] FLC: Loaded 5437 existing records from primary storage. [2025-10-15T18:57:14.149425] [INFO ] [MAIN ] FLC: Loaded 5437 existing records. [2025-10-15T18:57:14.308563] [DEBUG] [LOCAL ] FLNG: Loaded 33716 existing records from primary storage. [2025-10-15T18:57:14.337987] [INFO ] [MAIN ] FLNG: Loaded 33716 existing records. [2025-10-15T18:57:14.386855] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:14.450463] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-15T18:57:14.460226] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-15T18:57:14.472210] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-15T18:57:14.472305] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-15T18:57:14.551836] [DEBUG] [LOCAL ] FLO: Loaded 52059 existing records from primary storage. [2025-10-15T18:57:14.664691] [DEBUG] [LOCAL ] FLG: Loaded 53324 existing records from primary storage. [2025-10-15T18:57:14.629403] [INFO ] [MAIN ] FLO: Loaded 52059 existing records. [2025-10-15T18:57:14.675459] [INFO ] [MAIN ] FLG: Loaded 53324 existing records. [2025-10-15T18:57:14.815261] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:14.985173] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-15T18:57:15.031885] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-15T18:57:15.158726] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-15T18:57:15.228600] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-15T18:57:15.332765] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:15.362844] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-15T18:57:15.357236] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:15.381966] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-15T18:57:15.406444] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-15T18:57:15.411622] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-15T18:57:15.432401] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-15T18:57:15.432336] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-15T18:57:15.438015] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-15T18:57:15.477856] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-15T18:57:15.621098] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:15.708119] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-15T18:57:16.307858] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:16.313538] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-15T18:57:16.511725] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:16.517184] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-15T18:57:16.553786] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:16.554108] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-15T18:57:16.670289] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:57:16.672279] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-15T18:57:17.284814] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T18:57:17.286595] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-15T18:57:17.751991] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T18:57:17.759689] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-15T18:57:17.880788] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:57:17.882499] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-15T18:57:18.184854] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:57:18.195008] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-15T18:57:18.290891] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:57:18.444230] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T18:57:18.513964] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-15T18:57:19.042455] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T18:57:19.225073] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T18:57:19.314058] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-15T18:57:19.694765] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:57:19.695773] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T18:57:20.114043] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-15T18:57:20.694723] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T18:57:20.913990] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-15T18:57:21.393530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T18:57:21.714031] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-15T18:57:22.475493] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T18:57:22.514052] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-15T18:57:23.314058] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-15T18:57:23.689720] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T18:57:23.951759] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T18:57:24.114044] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-15T18:57:24.754252] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:57:24.755335] [INFO ] [REMOTE ] FLC: Full fetch complete (7845 records). [2025-10-15T18:57:24.755406] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-15T18:57:24.915720] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-15T18:57:25.119875] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-15T18:57:25.119954] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-15T18:57:25.120155] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-15T18:57:25.120193] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-15T18:57:25.120574] [DEBUG] [LOCAL ] FLC: Trimmed 7845 records to 5420 (keeping 200 days of data) [2025-10-15T18:57:25.153123] [DEBUG] [LOCAL ] FLC: Primary data saved (5420 records). [2025-10-15T18:57:25.153246] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-15T18:57:25.153337] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLC took 11.7s. Estimated remaining: 3h 33m 12s. Rate: 7.2 symbols/min [2025-10-15T18:57:25.320880] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:25.321047] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-15T18:57:25.321086] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-15T18:57:25.321200] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-15T18:57:25.321242] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-15T18:57:25.321285] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-15T18:57:25.321320] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-15T18:57:25.679574] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:25.713954] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-15T18:57:25.899938] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:57:25.900187] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-15T18:57:25.900288] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:57:25.900339] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-15T18:57:25.900399] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:57:25.900494] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-15T18:57:25.900562] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-15T18:57:25.900598] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-15T18:57:25.900637] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-15T18:57:25.900729] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLOC took 0.7s. Estimated remaining: 3h 32m 50s. Rate: 7.2 symbols/min [2025-10-15T18:57:26.066210] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:26.118208] [DEBUG] [LOCAL ] FLR: Loaded 53229 existing records from primary storage. [2025-10-15T18:57:26.118536] [INFO ] [MAIN ] FLR: Loaded 53229 existing records. [2025-10-15T18:57:26.312707] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:26.313009] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-15T18:57:26.313077] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-15T18:57:26.313590] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-15T18:57:26.313760] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-15T18:57:26.529157] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-15T18:57:26.614663] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T18:57:26.725794] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:27.314027] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-15T18:57:28.042999] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:57:28.113987] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-15T18:57:28.914024] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-15T18:57:29.094163] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:57:29.176863] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T18:57:29.714014] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-15T18:57:30.514119] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-15T18:57:30.576339] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:57:31.062750] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:57:31.314041] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-15T18:57:31.719355] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T18:57:32.114026] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-15T18:57:32.919278] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-15T18:57:32.945083] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:57:33.030456] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T18:57:33.714007] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-15T18:57:34.513993] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-15T18:57:34.683267] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T18:57:34.815159] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T18:57:35.313983] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-15T18:57:36.115329] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-15T18:57:36.120402] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T18:57:36.717039] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T18:57:36.913971] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-15T18:57:37.622671] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:57:37.713994] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-15T18:57:38.514026] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-15T18:57:38.796813] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:57:39.314117] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-15T18:57:39.437349] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T18:57:39.954913] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T18:57:40.113977] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-15T18:57:40.696751] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:57:40.914031] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-15T18:57:41.713969] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-15T18:57:41.776320] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:57:42.233298] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T18:57:42.237137] [INFO ] [REMOTE ] FLNG: Full fetch complete (50201 records). [2025-10-15T18:57:42.237216] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-15T18:57:42.519211] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-15T18:57:42.628054] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-15T18:57:42.628126] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-15T18:57:42.628862] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-15T18:57:42.628923] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-15T18:57:42.629902] [DEBUG] [LOCAL ] FLNG: Trimmed 50201 records to 33712 (keeping 200 days of data) [2025-10-15T18:57:42.828737] [DEBUG] [LOCAL ] FLNG: Primary data saved (33712 records). [2025-10-15T18:57:42.828860] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-15T18:57:42.828936] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLNG took 29.4s. Estimated remaining: 3h 32m 57s. Rate: 7.2 symbols/min [2025-10-15T18:57:42.995902] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:43.038604] [DEBUG] [LOCAL ] FLS: Loaded 50337 existing records from primary storage. [2025-10-15T18:57:43.038945] [INFO ] [MAIN ] FLS: Loaded 50337 existing records. [2025-10-15T18:57:43.240974] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:43.241345] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-15T18:57:43.241454] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-15T18:57:43.241751] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-15T18:57:43.241812] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-15T18:57:43.316832] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-15T18:57:43.430849] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:57:43.664087] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:44.114023] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-15T18:57:44.217185] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T18:57:44.914054] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-15T18:57:45.118012] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:57:45.323977] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:57:45.714018] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-15T18:57:46.340332] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T18:57:46.514025] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-15T18:57:47.239938] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:57:47.314019] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-15T18:57:48.114000] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-15T18:57:48.240453] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:57:48.914035] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-15T18:57:49.027458] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T18:57:49.637467] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T18:57:49.713956] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-15T18:57:50.514038] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-15T18:57:50.758414] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:57:51.313969] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-15T18:57:51.566267] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:57:51.576252] [INFO ] [REMOTE ] FLO: Full fetch complete (75254 records). [2025-10-15T18:57:51.576452] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-15T18:57:51.988002] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-15T18:57:51.988098] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-15T18:57:51.989168] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-15T18:57:51.989249] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-15T18:57:52.015325] [DEBUG] [LOCAL ] FLO: Trimmed 75254 records to 52082 (keeping 200 days of data) [2025-10-15T18:57:52.017057] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:57:52.119343] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-15T18:57:52.353466] [DEBUG] [LOCAL ] FLO: Primary data saved (52082 records). [2025-10-15T18:57:52.353623] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-15T18:57:52.353744] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLO took 38.9s. Estimated remaining: 3h 32m 51s. Rate: 7.2 symbols/min [2025-10-15T18:57:52.522906] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:52.571167] [DEBUG] [LOCAL ] FLUT: Loaded 50767 existing records from primary storage. [2025-10-15T18:57:52.571463] [INFO ] [MAIN ] FLUT: Loaded 50767 existing records. [2025-10-15T18:57:52.743752] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:52.743990] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-15T18:57:52.744037] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-15T18:57:52.744386] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-15T18:57:52.744440] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-15T18:57:52.915233] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-15T18:57:53.092761] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:53.337225] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T18:57:53.506327] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:57:53.714036] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-15T18:57:54.513997] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-15T18:57:54.594373] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T18:57:55.314047] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-15T18:57:55.402937] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:57:56.005873] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T18:57:56.114002] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-15T18:57:56.913965] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-15T18:57:57.098782] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:57:57.714027] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-15T18:57:57.911725] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:57:57.918136] [INFO ] [REMOTE ] FLR: Full fetch complete (76779 records). [2025-10-15T18:57:57.918277] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-15T18:57:58.312498] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-15T18:57:58.312580] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-15T18:57:58.313687] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-15T18:57:58.313755] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-15T18:57:58.315215] [DEBUG] [LOCAL ] FLR: Trimmed 76779 records to 53241 (keeping 200 days of data) [2025-10-15T18:57:58.517234] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-15T18:57:58.623318] [DEBUG] [LOCAL ] FLR: Primary data saved (53241 records). [2025-10-15T18:57:58.623596] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-15T18:57:58.623822] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 32.7s. Estimated remaining: 3h 32m 38s. Rate: 7.2 symbols/min [2025-10-15T18:57:58.818244] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:58.821046] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T18:57:58.851583] [DEBUG] [LOCAL ] FLXR: Loaded 20956 existing records from primary storage. [2025-10-15T18:57:58.851847] [INFO ] [MAIN ] FLXR: Loaded 20956 existing records. [2025-10-15T18:57:59.029785] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:59.030202] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-15T18:57:59.030355] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-15T18:57:59.030679] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-15T18:57:59.030737] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-15T18:57:59.334699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-15T18:57:59.400173] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:57:59.436389] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:59.929406] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:58:00.114042] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-15T18:58:00.592721] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:58:00.914010] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-15T18:58:01.562227] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:58:01.714048] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-15T18:58:02.265524] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:58:02.514071] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-15T18:58:03.011326] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:58:03.314006] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-15T18:58:04.114043] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-15T18:58:04.315804] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:58:04.914037] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-15T18:58:04.966778] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T18:58:05.713969] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-15T18:58:05.862606] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T18:58:05.868924] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-15T18:58:05.869027] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-15T18:58:06.266047] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-15T18:58:06.266144] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-15T18:58:06.267966] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-15T18:58:06.268034] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-15T18:58:06.269621] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 53327 (keeping 200 days of data) [2025-10-15T18:58:06.514016] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-15T18:58:06.601241] [DEBUG] [LOCAL ] FLG: Primary data saved (53327 records). [2025-10-15T18:58:06.601530] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-15T18:58:06.601670] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLG took 53.2s. Estimated remaining: 3h 32m 29s. Rate: 7.2 symbols/min [2025-10-15T18:58:06.735190] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:58:06.824971] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:06.873557] [DEBUG] [LOCAL ] FMC: Loaded 51832 existing records from primary storage. [2025-10-15T18:58:06.873921] [INFO ] [MAIN ] FMC: Loaded 51832 existing records. [2025-10-15T18:58:07.055215] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:07.055559] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-15T18:58:07.055699] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-15T18:58:07.056102] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-15T18:58:07.056157] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-15T18:58:07.172577] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T18:58:07.320998] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-15T18:58:07.426284] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:07.505633] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:58:08.114007] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-15T18:58:08.866734] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T18:58:08.913976] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-15T18:58:09.094440] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T18:58:09.414720] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T18:58:09.713992] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-15T18:58:10.514015] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-15T18:58:11.313974] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-15T18:58:11.393484] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:58:12.114054] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-15T18:58:12.763467] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-15T18:58:12.774609] [INFO ] [REMOTE ] FLS: Full fetch complete (72308 records). [2025-10-15T18:58:12.774881] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-15T18:58:12.930105] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-15T18:58:13.142933] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:58:13.235580] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-15T18:58:13.235774] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-15T18:58:13.236746] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-15T18:58:13.236879] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-15T18:58:13.238337] [DEBUG] [LOCAL ] FLS: Trimmed 72308 records to 50373 (keeping 200 days of data) [2025-10-15T18:58:13.370630] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T18:58:13.579086] [DEBUG] [LOCAL ] FLS: Primary data saved (50373 records). [2025-10-15T18:58:13.579215] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-15T18:58:13.579294] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLS took 30.8s. Estimated remaining: 3h 32m 19s. Rate: 7.2 symbols/min [2025-10-15T18:58:13.722402] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-15T18:58:13.748412] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:13.756730] [DEBUG] [LOCAL ] FMN: Loaded 5384 existing records from primary storage. [2025-10-15T18:58:13.756926] [INFO ] [MAIN ] FMN: Loaded 5384 existing records. [2025-10-15T18:58:13.929091] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:13.929284] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-15T18:58:13.929334] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-15T18:58:13.929469] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-15T18:58:13.929506] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-15T18:58:14.277774] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:14.513969] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-15T18:58:14.613058] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:58:15.251354] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:58:15.313964] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-15T18:58:15.578238] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T18:58:16.102520] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T18:58:16.113948] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-15T18:58:16.701339] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:58:16.914022] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-15T18:58:17.714021] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-15T18:58:18.300591] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T18:58:18.514008] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-15T18:58:19.314009] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-15T18:58:19.652603] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T18:58:19.702922] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T18:58:20.114020] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-15T18:58:20.759607] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:58:20.913972] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-15T18:58:21.248249] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:58:21.713978] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-15T18:58:21.947261] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:58:22.513994] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-15T18:58:23.313972] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-15T18:58:23.517440] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:58:23.713873] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:58:24.113970] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-15T18:58:24.796151] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T18:58:24.834228] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T18:58:24.913967] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-15T18:58:25.714004] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-15T18:58:26.004760] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T18:58:26.514029] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-15T18:58:27.313972] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-15T18:58:27.364354] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T18:58:28.113970] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-15T18:58:28.357897] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:58:28.357225] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T18:58:28.588265] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T18:58:28.913988] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-15T18:58:29.714001] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-15T18:58:30.514026] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-15T18:58:30.680032] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T18:58:30.890895] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T18:58:30.894877] [INFO ] [REMOTE ] FLXR: Full fetch complete (26806 records). [2025-10-15T18:58:30.895010] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-15T18:58:31.269446] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-15T18:58:31.269520] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-15T18:58:31.270150] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-15T18:58:31.270212] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-15T18:58:31.270958] [DEBUG] [LOCAL ] FLXR: Trimmed 26806 records to 21029 (keeping 200 days of data) [2025-10-15T18:58:31.322632] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-15T18:58:31.399600] [DEBUG] [LOCAL ] FLXR: Primary data saved (21029 records). [2025-10-15T18:58:31.399746] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-15T18:58:31.399829] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLXR took 32.8s. Estimated remaining: 3h 32m 27s. Rate: 7.2 symbols/min [2025-10-15T18:58:31.573697] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:31.605401] [DEBUG] [LOCAL ] FMS: Loaded 30222 existing records from primary storage. [2025-10-15T18:58:31.605674] [INFO ] [MAIN ] FMS: Loaded 30222 existing records. [2025-10-15T18:58:31.783044] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:31.783295] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-15T18:58:31.783341] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-15T18:58:31.783786] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-15T18:58:31.783842] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-15T18:58:32.130151] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-15T18:58:32.160053] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:32.294299] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T18:58:32.300735] [INFO ] [REMOTE ] FLUT: Full fetch complete (73277 records). [2025-10-15T18:58:32.300867] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-15T18:58:32.598353] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T18:58:32.694139] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-15T18:58:32.694377] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-15T18:58:32.695452] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-15T18:58:32.695540] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-15T18:58:32.697478] [DEBUG] [LOCAL ] FLUT: Trimmed 73277 records to 50758 (keeping 200 days of data) [2025-10-15T18:58:32.816198] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T18:58:32.921715] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-15T18:58:33.058920] [DEBUG] [LOCAL ] FLUT: Primary data saved (50758 records). [2025-10-15T18:58:33.059068] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-15T18:58:33.059936] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FLUT took 40.7s. Estimated remaining: 3h 32m 7s. Rate: 7.2 symbols/min [2025-10-15T18:58:33.246291] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:33.293909] [DEBUG] [LOCAL ] FMX: Loaded 40494 existing records from primary storage. [2025-10-15T18:58:33.294253] [INFO ] [MAIN ] FMX: Loaded 40494 existing records. [2025-10-15T18:58:33.499221] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:33.499423] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-15T18:58:33.499472] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-15T18:58:33.500115] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-15T18:58:33.500171] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-15T18:58:33.623728] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:58:33.719531] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-15T18:58:33.924374] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:34.514016] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-15T18:58:35.313997] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-15T18:58:35.500069] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:58:35.832972] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T18:58:35.936470] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:58:36.114001] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-15T18:58:36.912357] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:58:36.914439] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-15T18:58:37.504462] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T18:58:37.713977] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-15T18:58:38.514057] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-15T18:58:38.636772] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T18:58:38.638332] [INFO ] [REMOTE ] FMN: Full fetch complete (10137 records). [2025-10-15T18:58:38.638410] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-15T18:58:38.996029] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-15T18:58:38.996177] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-15T18:58:38.996441] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-15T18:58:38.996485] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-15T18:58:38.996944] [DEBUG] [LOCAL ] FMN: Trimmed 10137 records to 5431 (keeping 200 days of data) [2025-10-15T18:58:39.029856] [DEBUG] [LOCAL ] FMN: Primary data saved (5431 records). [2025-10-15T18:58:39.029979] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-15T18:58:39.030060] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMN took 25.5s. Estimated remaining: 3h 31m 54s. Rate: 7.2 symbols/min [2025-10-15T18:58:39.222802] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:39.226296] [DEBUG] [LOCAL ] FMY: Loaded 1390 existing records from primary storage. [2025-10-15T18:58:39.226434] [INFO ] [MAIN ] FMY: Loaded 1390 existing records. [2025-10-15T18:58:39.321185] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-15T18:58:39.404963] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:39.405217] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-15T18:58:39.405266] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-15T18:58:39.405431] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-15T18:58:39.405487] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-15T18:58:39.753274] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:40.113983] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-15T18:58:40.224896] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:58:40.279708] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:58:40.914015] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-15T18:58:41.469839] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:58:41.714063] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-15T18:58:42.032844] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T18:58:42.514048] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-15T18:58:42.700747] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:58:43.314053] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-15T18:58:43.653849] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:58:44.113986] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-15T18:58:44.478839] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-15T18:58:44.749614] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T18:58:44.914019] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-15T18:58:45.714044] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-15T18:58:46.162131] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:58:46.453157] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:58:46.513966] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-15T18:58:47.314040] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-15T18:58:47.675364] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T18:58:48.013627] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T18:58:48.113972] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-15T18:58:48.547612] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:58:48.914056] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-15T18:58:49.263610] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T18:58:49.713998] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-15T18:58:50.076333] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T18:58:50.514018] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-15T18:58:51.009547] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T18:58:51.313984] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-15T18:58:52.114026] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-15T18:58:52.731597] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:58:52.914017] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-15T18:58:53.703358] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:58:53.713947] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-15T18:58:53.868982] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T18:58:53.875518] [INFO ] [REMOTE ] FMC: Full fetch complete (75348 records). [2025-10-15T18:58:53.875636] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-15T18:58:54.288660] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-15T18:58:54.288762] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-15T18:58:54.289985] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-15T18:58:54.290051] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-15T18:58:54.291818] [DEBUG] [LOCAL ] FMC: Trimmed 75348 records to 51849 (keeping 200 days of data) [2025-10-15T18:58:54.519251] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-15T18:58:54.610359] [DEBUG] [LOCAL ] FMC: Primary data saved (51849 records). [2025-10-15T18:58:54.610493] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-15T18:58:54.610964] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMC took 48.0s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-15T18:58:54.777621] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:54.815139] [DEBUG] [LOCAL ] FN: Loaded 37848 existing records from primary storage. [2025-10-15T18:58:54.815428] [INFO ] [MAIN ] FN: Loaded 37848 existing records. [2025-10-15T18:58:54.990529] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:54.990846] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-15T18:58:54.990925] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-15T18:58:54.999492] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-15T18:58:54.999595] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-15T18:58:55.096362] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:58:55.319157] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-15T18:58:55.371471] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:55.805791] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:58:55.899083] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:58:56.113997] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-15T18:58:56.913996] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-15T18:58:57.363178] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:58:57.649552] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:58:57.713979] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-15T18:58:58.513989] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-15T18:58:58.902686] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T18:58:58.903401] [INFO ] [REMOTE ] FMY: Full fetch complete (1967 records). [2025-10-15T18:58:58.903469] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-15T18:58:59.259718] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T18:58:59.296473] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-15T18:58:59.296543] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-15T18:58:59.296666] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-15T18:58:59.296727] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-15T18:58:59.297053] [DEBUG] [LOCAL ] FMY: Trimmed 1967 records to 1388 (keeping 200 days of data) [2025-10-15T18:58:59.305802] [DEBUG] [LOCAL ] FMY: Primary data saved (1388 records). [2025-10-15T18:58:59.305870] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-15T18:58:59.305945] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMY took 20.3s. Estimated remaining: 3h 31m 44s. Rate: 7.2 symbols/min [2025-10-15T18:58:59.319134] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-15T18:58:59.476783] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:59.526854] [DEBUG] [LOCAL ] FNB: Loaded 52591 existing records from primary storage. [2025-10-15T18:58:59.527178] [INFO ] [MAIN ] FNB: Loaded 52591 existing records. [2025-10-15T18:58:59.703917] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:59.704164] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-15T18:58:59.704223] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-15T18:58:59.704597] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-15T18:58:59.704709] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-15T18:59:00.049411] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:00.113956] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-15T18:59:00.886981] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:59:00.913967] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-15T18:59:01.376503] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T18:59:01.713976] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-15T18:59:02.267385] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:59:02.514047] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-15T18:59:03.000204] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T18:59:03.314040] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-15T18:59:03.819332] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T18:59:04.114051] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-15T18:59:04.914046] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-15T18:59:05.079707] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:59:05.666822] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:59:05.714033] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-15T18:59:06.241197] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T18:59:06.513997] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-15T18:59:06.962382] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:59:07.313989] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-15T18:59:07.823109] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T18:59:08.114025] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-15T18:59:08.919432] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-15T18:59:08.925677] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T18:59:09.518153] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T18:59:09.522557] [INFO ] [REMOTE ] FMX: Full fetch complete (57807 records). [2025-10-15T18:59:09.522680] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-15T18:59:09.719121] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-15T18:59:09.915385] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-15T18:59:09.915538] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-15T18:59:09.916400] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-15T18:59:09.916547] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-15T18:59:09.932916] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T18:59:09.938838] [DEBUG] [LOCAL ] FMX: Trimmed 57807 records to 40547 (keeping 200 days of data) [2025-10-15T18:59:10.180635] [DEBUG] [LOCAL ] FMX: Primary data saved (40547 records). [2025-10-15T18:59:10.180787] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-15T18:59:10.180895] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMX took 37.1s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-15T18:59:10.344880] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:10.393706] [DEBUG] [LOCAL ] FND: Loaded 52153 existing records from primary storage. [2025-10-15T18:59:10.394074] [INFO ] [MAIN ] FND: Loaded 52153 existing records. [2025-10-15T18:59:10.527617] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-15T18:59:10.571754] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:10.571942] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-15T18:59:10.572016] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-15T18:59:10.572431] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-15T18:59:10.572486] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-15T18:59:10.914484] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:11.313974] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-15T18:59:11.454292] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:59:12.043355] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T18:59:12.113982] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-15T18:59:12.914000] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-15T18:59:13.017926] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T18:59:13.676726] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:59:13.713949] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-15T18:59:14.519125] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-15T18:59:14.523487] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:59:15.313971] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-15T18:59:15.455874] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:59:15.495030] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T18:59:16.114025] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-15T18:59:16.618540] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:59:16.914035] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-15T18:59:17.572112] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T18:59:17.713951] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-15T18:59:18.514065] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-15T18:59:18.603614] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:59:19.096249] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:59:19.313989] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-15T18:59:19.719497] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:59:20.114010] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-15T18:59:20.913989] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-15T18:59:21.114593] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:59:21.669889] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T18:59:21.714028] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-15T18:59:22.257037] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:59:22.260957] [INFO ] [REMOTE ] FMS: Full fetch complete (42602 records). [2025-10-15T18:59:22.261044] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-15T18:59:22.522849] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-15T18:59:22.648801] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-15T18:59:22.648903] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-15T18:59:22.649770] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-15T18:59:22.649835] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-15T18:59:22.650971] [DEBUG] [LOCAL ] FMS: Trimmed 42602 records to 30232 (keeping 200 days of data) [2025-10-15T18:59:22.838303] [DEBUG] [LOCAL ] FMS: Primary data saved (30232 records). [2025-10-15T18:59:22.838451] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-15T18:59:22.838537] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FMS took 51.4s. Estimated remaining: 3h 31m 39s. Rate: 7.2 symbols/min [2025-10-15T18:59:23.016369] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:23.063849] [DEBUG] [LOCAL ] FNF: Loaded 48980 existing records from primary storage. [2025-10-15T18:59:23.064329] [INFO ] [MAIN ] FNF: Loaded 48980 existing records. [2025-10-15T18:59:23.245099] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:23.245558] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-15T18:59:23.245722] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-15T18:59:23.246292] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-15T18:59:23.246407] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-15T18:59:23.314686] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-15T18:59:23.587277] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T18:59:23.651837] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:24.119110] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-15T18:59:24.131163] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:59:24.913975] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-15T18:59:24.989237] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:59:25.625023] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:59:25.713954] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-15T18:59:26.008702] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T18:59:26.012542] [INFO ] [REMOTE ] FN: Full fetch complete (56075 records). [2025-10-15T18:59:26.012691] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-15T18:59:26.406815] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-15T18:59:26.406906] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-15T18:59:26.407829] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-15T18:59:26.407896] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-15T18:59:26.409165] [DEBUG] [LOCAL ] FN: Trimmed 56075 records to 37711 (keeping 200 days of data) [2025-10-15T18:59:26.514012] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-15T18:59:26.636372] [DEBUG] [LOCAL ] FN: Primary data saved (37711 records). [2025-10-15T18:59:26.636521] [INFO ] [MAIN ] FN: Full history saved. [2025-10-15T18:59:26.636840] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 32.0s. Estimated remaining: 3h 31m 22s. Rate: 7.2 symbols/min [2025-10-15T18:59:26.810766] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:26.857923] [DEBUG] [LOCAL ] FNV: Loaded 46127 existing records from primary storage. [2025-10-15T18:59:26.858275] [INFO ] [MAIN ] FNV: Loaded 46127 existing records. [2025-10-15T18:59:27.042847] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:27.043120] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-15T18:59:27.043199] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-15T18:59:27.043693] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-15T18:59:27.043799] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-15T18:59:27.168040] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T18:59:27.319074] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-15T18:59:27.435134] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:28.114026] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-15T18:59:28.237829] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:59:28.695725] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T18:59:28.913999] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-15T18:59:29.672622] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T18:59:29.713960] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-15T18:59:30.514003] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-15T18:59:30.625836] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:59:31.313994] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-15T18:59:31.388183] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:59:31.996522] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T18:59:32.114000] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-15T18:59:32.883442] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:59:32.913973] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-15T18:59:33.236944] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T18:59:33.714034] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-15T18:59:34.514009] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-15T18:59:34.627061] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:59:34.634148] [INFO ] [REMOTE ] FNB: Full fetch complete (76128 records). [2025-10-15T18:59:34.634321] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-15T18:59:35.043339] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-15T18:59:35.043460] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-15T18:59:35.045226] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-15T18:59:35.045474] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-15T18:59:35.047579] [DEBUG] [LOCAL ] FNB: Trimmed 76128 records to 52596 (keeping 200 days of data) [2025-10-15T18:59:35.356574] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-15T18:59:35.408310] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T18:59:35.443737] [DEBUG] [LOCAL ] FNB: Primary data saved (52596 records). [2025-10-15T18:59:35.443970] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-15T18:59:35.444118] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FNB took 36.1s. Estimated remaining: 3h 31m 15s. Rate: 7.2 symbols/min [2025-10-15T18:59:35.625461] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:35.641358] [DEBUG] [LOCAL ] FOA: Loaded 13105 existing records from primary storage. [2025-10-15T18:59:35.641737] [INFO ] [MAIN ] FOA: Loaded 13105 existing records. [2025-10-15T18:59:35.825114] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:35.825390] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-15T18:59:35.825477] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-15T18:59:35.825771] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-15T18:59:35.825829] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-15T18:59:36.115807] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-15T18:59:36.218478] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:36.242871] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T18:59:36.914014] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-15T18:59:36.952094] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T18:59:37.713993] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-15T18:59:37.776123] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:59:37.885597] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T18:59:38.514042] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-15T18:59:39.314028] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-15T18:59:39.429457] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:59:39.701483] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T18:59:40.114019] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-15T18:59:40.914041] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-15T18:59:41.035236] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T18:59:41.422123] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T18:59:41.714046] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-15T18:59:42.193324] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T18:59:42.514006] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-15T18:59:43.271362] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:59:43.313975] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-15T18:59:43.520948] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T18:59:44.114014] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-15T18:59:44.862817] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T18:59:44.914041] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-15T18:59:45.714011] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-15T18:59:45.833886] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:59:45.859105] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T18:59:46.514056] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-15T18:59:47.121963] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:59:47.314072] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-15T18:59:48.113984] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-15T18:59:48.277367] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T18:59:48.284625] [INFO ] [REMOTE ] FND: Full fetch complete (74976 records). [2025-10-15T18:59:48.284882] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-15T18:59:48.713619] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-15T18:59:48.713804] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-15T18:59:48.715299] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-15T18:59:48.715385] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-15T18:59:48.745928] [DEBUG] [LOCAL ] FND: Trimmed 74976 records to 52150 (keeping 200 days of data) [2025-10-15T18:59:48.745757] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:59:48.939505] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-15T18:59:49.096416] [DEBUG] [LOCAL ] FND: Primary data saved (52150 records). [2025-10-15T18:59:49.096629] [INFO ] [MAIN ] FND: Full history saved. [2025-10-15T18:59:49.097730] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FND took 38.9s. Estimated remaining: 3h 31m 16s. Rate: 7.2 symbols/min [2025-10-15T18:59:49.273316] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:49.287224] [DEBUG] [LOCAL ] FOF: Loaded 8607 existing records from primary storage. [2025-10-15T18:59:49.287530] [INFO ] [MAIN ] FOF: Loaded 8607 existing records. [2025-10-15T18:59:49.477046] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:49.477432] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-15T18:59:49.477995] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-15T18:59:49.478398] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-15T18:59:49.478490] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-15T18:59:49.729431] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-15T18:59:49.751114] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:59:49.908546] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:50.000801] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T18:59:50.514011] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-15T18:59:51.313991] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-15T18:59:51.518815] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T18:59:51.541843] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T18:59:52.114029] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-15T18:59:52.754856] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:59:52.761132] [INFO ] [REMOTE ] FNF: Full fetch complete (69901 records). [2025-10-15T18:59:52.761342] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-15T18:59:52.914968] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-15T18:59:53.059273] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:59:53.195844] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-15T18:59:53.195963] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-15T18:59:53.197256] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-15T18:59:53.197326] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-15T18:59:53.199383] [DEBUG] [LOCAL ] FNF: Trimmed 69901 records to 48942 (keeping 200 days of data) [2025-10-15T18:59:53.537785] [DEBUG] [LOCAL ] FNF: Primary data saved (48942 records). [2025-10-15T18:59:53.537999] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-15T18:59:53.538119] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FNF took 30.7s. Estimated remaining: 3h 31m 0s. Rate: 7.2 symbols/min [2025-10-15T18:59:53.718702] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-15T18:59:53.749636] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:59:53.749077] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:53.776946] [DEBUG] [LOCAL ] FOR: Loaded 19838 existing records from primary storage. [2025-10-15T18:59:53.777293] [INFO ] [MAIN ] FOR: Loaded 19838 existing records. [2025-10-15T18:59:53.959069] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:53.959326] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-15T18:59:53.959376] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-15T18:59:53.959570] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-15T18:59:53.959608] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-15T18:59:54.342039] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:54.514008] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-15T18:59:55.081592] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T18:59:55.314043] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-15T18:59:55.399516] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:59:56.114037] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-15T18:59:56.477222] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:59:56.812344] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T18:59:56.914044] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-15T18:59:57.714107] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-15T18:59:57.951554] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:59:58.443791] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T18:59:58.514263] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-15T18:59:58.625508] [DEBUG] [REMOTE ] FNV: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-15T18:59:58.626271] [WARN ] [REMOTE ] FNV: No data returned for month 2025-09 [2025-10-15T18:59:58.626398] [FATAL] [REMOTE ] FNV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:59:58.626517] [FATAL] [MAIN ] FNV: Failed to fetch primary data. [2025-10-15T18:59:58.626583] [WARN ] [MAIN ] FNV: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:59:58.626686] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-15T18:59:58.626777] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-10-15T18:59:58.626908] [INFO ] [LOCAL ] FNV: Starting deletion of derivative data. [2025-10-15T18:59:58.627308] [DEBUG] [LOCAL ] FNV: Deleted derivative data file. [2025-10-15T18:59:58.628038] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FNV took 32.0s. Estimated remaining: 3h 30m 46s. Rate: 7.2 symbols/min [2025-10-15T18:59:58.807631] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:58.856024] [DEBUG] [LOCAL ] FOUR: Loaded 49680 existing records from primary storage. [2025-10-15T18:59:58.856366] [INFO ] [MAIN ] FOUR: Loaded 49680 existing records. [2025-10-15T18:59:59.034160] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:59.034413] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-15T18:59:59.034473] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-15T18:59:59.034888] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-15T18:59:59.034946] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-15T18:59:59.319214] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-15T18:59:59.405903] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:00.114029] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-15T19:00:00.229755] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T19:00:00.914027] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-15T19:00:01.714017] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-15T19:00:02.050356] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T19:00:02.172299] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T19:00:02.514028] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-15T19:00:02.609263] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:00:03.314035] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-15T19:00:03.636516] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T19:00:04.114024] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-15T19:00:04.188193] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T19:00:04.756824] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T19:00:04.914022] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-15T19:00:05.714071] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-15T19:00:05.739585] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T19:00:06.514031] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-15T19:00:07.313979] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-15T19:00:07.418629] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T19:00:07.634909] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T19:00:07.808788] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T19:00:08.114039] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-15T19:00:08.909429] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T19:00:08.913945] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-15T19:00:09.612416] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T19:00:09.713972] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-15T19:00:10.513972] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-15T19:00:10.727945] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:00:11.314004] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-15T19:00:11.469193] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:00:12.114018] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-15T19:00:12.722878] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:00:12.913996] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-15T19:00:13.126588] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:00:13.646355] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T19:00:13.713993] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-15T19:00:14.514002] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-15T19:00:15.033686] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:00:15.224966] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T19:00:15.313991] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-15T19:00:16.113987] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-15T19:00:16.352967] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T19:00:16.354474] [INFO ] [REMOTE ] FOF: Full fetch complete (11913 records). [2025-10-15T19:00:16.354569] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-15T19:00:16.714541] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-15T19:00:16.714616] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-15T19:00:16.714944] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-15T19:00:16.714999] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-15T19:00:16.715447] [DEBUG] [LOCAL ] FOF: Trimmed 11913 records to 8595 (keeping 200 days of data) [2025-10-15T19:00:16.768947] [DEBUG] [LOCAL ] FOF: Primary data saved (8595 records). [2025-10-15T19:00:16.769061] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-15T19:00:16.769136] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOF took 27.7s. Estimated remaining: 3h 30m 55s. Rate: 7.2 symbols/min [2025-10-15T19:00:16.917897] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-15T19:00:16.944800] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:16.958915] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T19:00:16.981033] [DEBUG] [LOCAL ] FPF: Loaded 18807 existing records from primary storage. [2025-10-15T19:00:16.981304] [INFO ] [MAIN ] FPF: Loaded 18807 existing records. [2025-10-15T19:00:17.177359] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:17.177587] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-15T19:00:17.177635] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-15T19:00:17.177867] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-15T19:00:17.177915] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-15T19:00:17.575561] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:17.713997] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-15T19:00:18.514022] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-15T19:00:18.643620] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:00:18.746011] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:00:19.188394] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T19:00:19.190545] [INFO ] [REMOTE ] FOA: Full fetch complete (21747 records). [2025-10-15T19:00:19.190628] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-15T19:00:19.319155] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-15T19:00:19.586067] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-15T19:00:19.586143] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-15T19:00:19.586668] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-15T19:00:19.586730] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-15T19:00:19.587280] [DEBUG] [LOCAL ] FOA: Trimmed 21747 records to 13050 (keeping 200 days of data) [2025-10-15T19:00:19.668956] [DEBUG] [LOCAL ] FOA: Primary data saved (13050 records). [2025-10-15T19:00:19.669090] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-15T19:00:19.669173] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOA took 44.2s. Estimated remaining: 3h 30m 37s. Rate: 7.2 symbols/min [2025-10-15T19:00:19.840508] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:19.861852] [DEBUG] [LOCAL ] FPH: Loaded 19342 existing records from primary storage. [2025-10-15T19:00:19.862130] [INFO ] [MAIN ] FPH: Loaded 19342 existing records. [2025-10-15T19:00:20.037253] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:20.037454] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-15T19:00:20.037504] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-15T19:00:20.037750] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-15T19:00:20.037842] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-15T19:00:20.119115] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-15T19:00:20.381521] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T19:00:20.423921] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:20.914005] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-15T19:00:21.272112] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T19:00:21.274581] [INFO ] [REMOTE ] FOR: Full fetch complete (29832 records). [2025-10-15T19:00:21.274692] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-15T19:00:21.642354] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-15T19:00:21.642447] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-15T19:00:21.643072] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-15T19:00:21.643135] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-15T19:00:21.644001] [DEBUG] [LOCAL ] FOR: Trimmed 29832 records to 19813 (keeping 200 days of data) [2025-10-15T19:00:21.727373] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-15T19:00:21.763283] [DEBUG] [LOCAL ] FOR: Primary data saved (19813 records). [2025-10-15T19:00:21.763440] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-15T19:00:21.763523] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FOR took 28.2s. Estimated remaining: 3h 30m 18s. Rate: 7.2 symbols/min [2025-10-15T19:00:21.925319] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:00:21.956487] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:21.993595] [DEBUG] [LOCAL ] FPI: Loaded 31275 existing records from primary storage. [2025-10-15T19:00:21.993905] [INFO ] [MAIN ] FPI: Loaded 31275 existing records. [2025-10-15T19:00:22.164154] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:22.164359] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-15T19:00:22.164405] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-15T19:00:22.164701] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-15T19:00:22.164758] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-15T19:00:22.505637] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:22.513950] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-15T19:00:22.782105] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:00:23.314030] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-15T19:00:23.825070] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T19:00:24.113993] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-15T19:00:24.914021] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-15T19:00:25.039706] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:00:25.093900] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:00:25.714025] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-15T19:00:26.110447] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T19:00:26.513999] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-15T19:00:27.124715] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:00:27.208455] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T19:00:27.313975] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-15T19:00:28.113987] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-15T19:00:28.233704] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T19:00:28.914002] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-15T19:00:29.601898] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:00:29.713954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-15T19:00:29.884337] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T19:00:30.514005] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-15T19:00:31.178772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:00:31.313985] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-15T19:00:31.758353] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T19:00:32.113993] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-15T19:00:32.894228] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T19:00:32.913953] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-15T19:00:33.228188] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:00:33.714010] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-15T19:00:34.519062] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-15T19:00:34.537713] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T19:00:34.870419] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T19:00:35.313959] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-15T19:00:35.550864] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T19:00:36.114001] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-15T19:00:36.443080] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T19:00:36.913968] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-15T19:00:37.358692] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:00:37.714027] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-15T19:00:37.929718] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T19:00:38.514013] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-15T19:00:39.313966] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-15T19:00:39.554417] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:00:39.699107] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T19:00:39.705341] [INFO ] [REMOTE ] FOUR: Full fetch complete (72228 records). [2025-10-15T19:00:39.705478] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-15T19:00:40.116404] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-15T19:00:40.116742] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-15T19:00:40.116882] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-15T19:00:40.118798] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-15T19:00:40.118959] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-15T19:00:40.120377] [DEBUG] [LOCAL ] FOUR: Trimmed 72228 records to 49718 (keeping 200 days of data) [2025-10-15T19:00:40.397499] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T19:00:40.431957] [DEBUG] [LOCAL ] FOUR: Primary data saved (49718 records). [2025-10-15T19:00:40.432066] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-15T19:00:40.432349] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOUR took 41.8s. Estimated remaining: 3h 30m 27s. Rate: 7.2 symbols/min [2025-10-15T19:00:40.604947] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:40.648549] [DEBUG] [LOCAL ] FR: Loaded 46500 existing records from primary storage. [2025-10-15T19:00:40.648870] [INFO ] [MAIN ] FR: Loaded 46500 existing records. [2025-10-15T19:00:40.835950] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:40.836200] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-15T19:00:40.836263] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-15T19:00:40.836713] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-15T19:00:40.836784] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-15T19:00:40.926593] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-15T19:00:41.253037] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:41.397585] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:00:41.714039] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-15T19:00:41.865464] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T19:00:42.514025] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-15T19:00:42.919544] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T19:00:42.923256] [INFO ] [REMOTE ] FPF: Full fetch complete (26718 records). [2025-10-15T19:00:42.923402] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-15T19:00:43.307869] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-15T19:00:43.307952] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-15T19:00:43.308541] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-15T19:00:43.308581] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-15T19:00:43.309257] [DEBUG] [LOCAL ] FPF: Trimmed 26718 records to 18844 (keeping 200 days of data) [2025-10-15T19:00:43.359632] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-15T19:00:43.428712] [DEBUG] [LOCAL ] FPF: Primary data saved (18844 records). [2025-10-15T19:00:43.428871] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-15T19:00:43.428957] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPF took 26.7s. Estimated remaining: 3h 30m 9s. Rate: 7.2 symbols/min [2025-10-15T19:00:43.597110] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:43.617005] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T19:00:43.637025] [DEBUG] [LOCAL ] FRA: Loaded 14371 existing records from primary storage. [2025-10-15T19:00:43.637270] [INFO ] [MAIN ] FRA: Loaded 14371 existing records. [2025-10-15T19:00:43.813079] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:43.813691] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-15T19:00:43.813749] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-15T19:00:43.814066] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-15T19:00:43.814121] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-15T19:00:44.119092] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-15T19:00:44.157504] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:44.480255] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:00:44.914016] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-15T19:00:45.442840] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:00:45.714016] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-15T19:00:46.283431] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:00:46.514052] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-15T19:00:46.612601] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T19:00:47.205854] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T19:00:47.313972] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-15T19:00:48.114035] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-15T19:00:48.457955] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T19:00:48.914016] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-15T19:00:48.997511] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T19:00:49.713973] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-15T19:00:49.871464] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:00:50.442026] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T19:00:50.514046] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-15T19:00:51.314056] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-15T19:00:51.851533] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:00:52.114020] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-15T19:00:52.258328] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:00:52.914046] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-15T19:00:53.095011] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:00:53.714057] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-15T19:00:54.186519] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T19:00:54.514025] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-15T19:00:54.631669] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:00:55.314067] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-15T19:00:55.866078] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:00:56.113988] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-15T19:00:56.327218] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T19:00:56.913976] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-15T19:00:57.003223] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T19:00:57.714043] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-15T19:00:58.224510] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:00:58.229073] [INFO ] [REMOTE ] FPI: Full fetch complete (43905 records). [2025-10-15T19:00:58.229184] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-15T19:00:58.514581] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-15T19:00:58.608610] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-15T19:00:58.608718] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-15T19:00:58.609663] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-15T19:00:58.609723] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-15T19:00:58.610617] [DEBUG] [LOCAL ] FPI: Trimmed 43905 records to 31359 (keeping 200 days of data) [2025-10-15T19:00:58.796951] [DEBUG] [LOCAL ] FPI: Primary data saved (31359 records). [2025-10-15T19:00:58.797109] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-15T19:00:58.797193] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPI took 37.0s. Estimated remaining: 3h 30m 13s. Rate: 7.2 symbols/min [2025-10-15T19:00:58.963955] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:58.982314] [DEBUG] [LOCAL ] FRGE: Loaded 16201 existing records from primary storage. [2025-10-15T19:00:58.982590] [INFO ] [MAIN ] FRGE: Loaded 16201 existing records. [2025-10-15T19:00:59.160950] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:59.161221] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-15T19:00:59.161278] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-15T19:00:59.161526] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-15T19:00:59.161584] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-15T19:00:59.321777] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-15T19:00:59.488318] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T19:00:59.576318] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:59.605404] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:01:00.114026] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-15T19:01:00.439755] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T19:01:00.442212] [INFO ] [REMOTE ] FPH: Full fetch complete (31187 records). [2025-10-15T19:01:00.442281] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-15T19:01:00.802528] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-15T19:01:00.802623] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-15T19:01:00.803260] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-15T19:01:00.803319] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-15T19:01:00.804010] [DEBUG] [LOCAL ] FPH: Trimmed 31187 records to 19325 (keeping 200 days of data) [2025-10-15T19:01:00.908269] [DEBUG] [LOCAL ] FPH: Primary data saved (19325 records). [2025-10-15T19:01:00.908401] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-15T19:01:00.908480] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FPH took 41.2s. Estimated remaining: 3h 29m 54s. Rate: 7.2 symbols/min [2025-10-15T19:01:00.919789] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-15T19:01:01.078227] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:01.127132] [DEBUG] [LOCAL ] FRO: Loaded 51699 existing records from primary storage. [2025-10-15T19:01:01.127465] [INFO ] [MAIN ] FRO: Loaded 51699 existing records. [2025-10-15T19:01:01.313560] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:01:01.318842] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:01.322874] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-15T19:01:01.323193] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-15T19:01:01.323743] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-15T19:01:01.323802] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-15T19:01:01.662360] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:01.714036] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-15T19:01:02.513970] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-15T19:01:02.658472] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T19:01:03.314003] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-15T19:01:03.616246] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T19:01:03.742622] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T19:01:04.113964] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-15T19:01:04.421685] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:01:04.913999] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-15T19:01:05.604062] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:01:05.714009] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-15T19:01:05.982489] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T19:01:06.513986] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-15T19:01:06.636771] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:01:07.314000] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-15T19:01:08.114076] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-15T19:01:08.527356] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T19:01:08.729119] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:01:08.913985] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-15T19:01:08.993011] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T19:01:09.714008] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-15T19:01:10.514058] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-15T19:01:10.515145] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:01:10.609919] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T19:01:11.314038] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-15T19:01:12.114047] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-15T19:01:12.269118] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T19:01:12.325742] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:01:12.328452] [INFO ] [REMOTE ] FRA: Full fetch complete (23704 records). [2025-10-15T19:01:12.328624] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-15T19:01:12.729140] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-15T19:01:12.729264] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-15T19:01:12.730280] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-15T19:01:12.730355] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-15T19:01:12.731737] [DEBUG] [LOCAL ] FRA: Trimmed 23704 records to 14294 (keeping 200 days of data) [2025-10-15T19:01:12.829953] [DEBUG] [LOCAL ] FRA: Primary data saved (14294 records). [2025-10-15T19:01:12.830171] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-15T19:01:12.830333] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FRA took 29.4s. Estimated remaining: 3h 29m 52s. Rate: 7.2 symbols/min [2025-10-15T19:01:12.924086] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-15T19:01:13.015040] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:13.059899] [DEBUG] [LOCAL ] FRT: Loaded 41743 existing records from primary storage. [2025-10-15T19:01:13.060297] [INFO ] [MAIN ] FRT: Loaded 41743 existing records. [2025-10-15T19:01:13.249786] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:13.265553] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-15T19:01:13.265773] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-15T19:01:13.266977] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T19:01:13.272946] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-15T19:01:13.273287] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-15T19:01:13.657995] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:13.713978] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-15T19:01:14.464110] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T19:01:14.513953] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-15T19:01:14.576286] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:01:15.314025] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-15T19:01:15.894256] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:01:16.113972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-15T19:01:16.811816] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:01:16.913990] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-15T19:01:17.715251] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-15T19:01:17.716995] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:01:17.723168] [INFO ] [REMOTE ] FR: Full fetch complete (66981 records). [2025-10-15T19:01:17.723290] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-15T19:01:18.122174] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-15T19:01:18.122298] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-15T19:01:18.123418] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-15T19:01:18.123547] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-15T19:01:18.125514] [DEBUG] [LOCAL ] FR: Trimmed 66981 records to 46546 (keeping 200 days of data) [2025-10-15T19:01:18.247515] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:01:18.440507] [DEBUG] [LOCAL ] FR: Primary data saved (46546 records). [2025-10-15T19:01:18.440637] [INFO ] [MAIN ] FR: Full history saved. [2025-10-15T19:01:18.440907] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FR took 38.0s. Estimated remaining: 3h 29m 39s. Rate: 7.2 symbols/min [2025-10-15T19:01:18.519567] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-15T19:01:18.633136] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:18.675378] [DEBUG] [LOCAL ] FSCO: Loaded 38493 existing records from primary storage. [2025-10-15T19:01:18.675698] [INFO ] [MAIN ] FSCO: Loaded 38493 existing records. [2025-10-15T19:01:18.883727] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:18.883963] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-15T19:01:18.884014] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-15T19:01:18.884304] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-15T19:01:18.884360] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-15T19:01:19.232251] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:19.313956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-15T19:01:19.387103] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T19:01:19.720290] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T19:01:20.114039] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-15T19:01:20.710153] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:01:20.891807] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:01:20.913944] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-15T19:01:21.714058] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-15T19:01:21.888188] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T19:01:22.514018] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-15T19:01:23.198035] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T19:01:23.314049] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-15T19:01:23.505870] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:01:24.114048] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-15T19:01:24.669071] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T19:01:24.913991] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-15T19:01:25.560721] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:01:25.713959] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-15T19:01:26.478111] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:01:26.513977] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-15T19:01:26.974180] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:01:27.313964] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-15T19:01:27.358722] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:01:27.360545] [INFO ] [REMOTE ] FRGE: Full fetch complete (31070 records). [2025-10-15T19:01:27.360618] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-15T19:01:27.718263] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-15T19:01:27.718402] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-15T19:01:27.719122] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-15T19:01:27.719187] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-15T19:01:27.720903] [DEBUG] [LOCAL ] FRGE: Trimmed 31070 records to 16119 (keeping 200 days of data) [2025-10-15T19:01:27.813849] [DEBUG] [LOCAL ] FRGE: Primary data saved (16119 records). [2025-10-15T19:01:27.813990] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-15T19:01:27.814070] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRGE took 29.0s. Estimated remaining: 3h 29m 32s. Rate: 7.2 symbols/min [2025-10-15T19:01:27.980722] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:28.028833] [DEBUG] [LOCAL ] FSK: Loaded 49496 existing records from primary storage. [2025-10-15T19:01:28.029131] [INFO ] [MAIN ] FSK: Loaded 49496 existing records. [2025-10-15T19:01:28.122720] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-15T19:01:28.213943] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:28.214139] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-15T19:01:28.214196] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-15T19:01:28.214460] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-15T19:01:28.214515] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-15T19:01:28.564899] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:28.914081] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-15T19:01:29.059534] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:01:29.498493] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T19:01:29.713990] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-15T19:01:30.340293] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:01:30.514008] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-15T19:01:31.313963] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-15T19:01:31.533673] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:01:31.981038] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:01:32.113956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-15T19:01:32.580508] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:01:32.914007] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-15T19:01:33.526997] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:01:33.713997] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-15T19:01:34.513983] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-15T19:01:34.553332] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:01:35.314092] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-15T19:01:35.951812] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-15T19:01:36.013943] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:01:36.113981] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-15T19:01:36.920165] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-15T19:01:36.940493] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:01:37.539630] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:01:37.713985] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-15T19:01:38.525904] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-15T19:01:38.531977] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:01:39.062908] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:01:39.313991] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-15T19:01:40.107472] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:01:40.116665] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-15T19:01:40.919491] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-15T19:01:40.931742] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:01:41.645114] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T19:01:41.713989] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-15T19:01:42.514100] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-15T19:01:42.692426] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:01:42.834083] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T19:01:42.839798] [INFO ] [REMOTE ] FSCO: Full fetch complete (55216 records). [2025-10-15T19:01:42.839933] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-15T19:01:43.226544] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-15T19:01:43.226634] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-15T19:01:43.227503] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-15T19:01:43.227561] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-15T19:01:43.228827] [DEBUG] [LOCAL ] FSCO: Trimmed 55216 records to 38487 (keeping 200 days of data) [2025-10-15T19:01:43.317929] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-15T19:01:43.469668] [DEBUG] [LOCAL ] FSCO: Primary data saved (38487 records). [2025-10-15T19:01:43.469831] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-15T19:01:43.470150] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FSCO took 25.0s. Estimated remaining: 3h 29m 36s. Rate: 7.2 symbols/min [2025-10-15T19:01:43.637494] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:43.689997] [DEBUG] [LOCAL ] FSLY: Loaded 51306 existing records from primary storage. [2025-10-15T19:01:43.690357] [INFO ] [MAIN ] FSLY: Loaded 51306 existing records. [2025-10-15T19:01:43.868327] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:43.868524] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-15T19:01:43.868597] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-15T19:01:43.868943] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-15T19:01:43.869017] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-15T19:01:44.129416] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-15T19:01:44.239602] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:44.289141] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T19:01:44.295588] [INFO ] [REMOTE ] FRO: Full fetch complete (75374 records). [2025-10-15T19:01:44.295814] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-15T19:01:44.689590] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-15T19:01:44.689893] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-15T19:01:44.690920] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-15T19:01:44.691004] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-15T19:01:44.692531] [DEBUG] [LOCAL ] FRO: Trimmed 75374 records to 51696 (keeping 200 days of data) [2025-10-15T19:01:44.836461] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T19:01:44.937735] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-15T19:01:45.044783] [DEBUG] [LOCAL ] FRO: Primary data saved (51696 records). [2025-10-15T19:01:45.044930] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-15T19:01:45.045011] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRO took 44.1s. Estimated remaining: 3h 29m 16s. Rate: 7.2 symbols/min [2025-10-15T19:01:45.210508] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:45.259825] [DEBUG] [LOCAL ] FSM: Loaded 53300 existing records from primary storage. [2025-10-15T19:01:45.260144] [INFO ] [MAIN ] FSM: Loaded 53300 existing records. [2025-10-15T19:01:45.440442] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:45.440705] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-15T19:01:45.440765] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-15T19:01:45.441038] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-15T19:01:45.441078] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-15T19:01:45.716433] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-15T19:01:45.823085] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:45.984064] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T19:01:46.154549] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T19:01:46.514014] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-15T19:01:47.314024] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-15T19:01:47.474830] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:01:48.073565] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:01:48.113961] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-15T19:01:48.913966] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-15T19:01:49.020199] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:01:49.625781] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:01:49.713962] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-15T19:01:50.499734] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T19:01:50.513945] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-15T19:01:51.020326] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:01:51.027341] [INFO ] [REMOTE ] FRT: Full fetch complete (60509 records). [2025-10-15T19:01:51.027463] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-15T19:01:51.319176] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-15T19:01:51.445801] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-15T19:01:51.445885] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-15T19:01:51.446748] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-15T19:01:51.446810] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-15T19:01:51.448047] [DEBUG] [LOCAL ] FRT: Trimmed 60509 records to 41709 (keeping 200 days of data) [2025-10-15T19:01:51.705372] [DEBUG] [LOCAL ] FRT: Primary data saved (41709 records). [2025-10-15T19:01:51.705500] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-15T19:01:51.705577] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FRT took 38.9s. Estimated remaining: 3h 29m 5s. Rate: 7.2 symbols/min [2025-10-15T19:01:51.870805] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:51.905941] [DEBUG] [LOCAL ] FSS: Loaded 33656 existing records from primary storage. [2025-10-15T19:01:51.906214] [INFO ] [MAIN ] FSS: Loaded 33656 existing records. [2025-10-15T19:01:52.087978] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:52.088238] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-15T19:01:52.088310] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-15T19:01:52.088849] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-15T19:01:52.088906] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-15T19:01:52.119121] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-15T19:01:52.482979] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:52.485006] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T19:01:52.618148] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:01:52.914064] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-15T19:01:53.713977] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-15T19:01:53.786997] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:01:54.043481] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:01:54.514068] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-15T19:01:55.162375] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T19:01:55.314013] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-15T19:01:55.839367] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:01:56.114006] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-15T19:01:56.735434] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:01:56.914047] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-15T19:01:57.714012] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-15T19:01:57.860605] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:01:57.918670] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T19:01:58.514017] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-15T19:01:59.314026] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-15T19:01:59.384785] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:02:00.056521] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:02:00.114014] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-15T19:02:00.914056] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-15T19:02:01.338524] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T19:02:01.714097] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-15T19:02:01.980927] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T19:02:02.480277] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:02:02.514054] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-15T19:02:03.218994] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:02:03.314048] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-15T19:02:03.986609] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T19:02:04.114008] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-15T19:02:04.914058] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-15T19:02:05.241585] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T19:02:05.722485] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-15T19:02:05.729355] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T19:02:06.505078] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:02:06.517376] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-15T19:02:07.314055] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-15T19:02:07.503764] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T19:02:08.114034] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-15T19:02:08.366923] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T19:02:08.536819] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T19:02:08.914004] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-15T19:02:09.714013] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-15T19:02:09.952119] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:02:10.501880] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T19:02:10.508316] [INFO ] [REMOTE ] FSK: Full fetch complete (72006 records). [2025-10-15T19:02:10.508443] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-15T19:02:10.520270] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-15T19:02:10.904681] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-15T19:02:10.904795] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-15T19:02:10.906731] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-15T19:02:10.906861] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-15T19:02:10.908464] [DEBUG] [LOCAL ] FSK: Trimmed 72006 records to 49506 (keeping 200 days of data) [2025-10-15T19:02:11.150496] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:02:11.274477] [DEBUG] [LOCAL ] FSK: Primary data saved (49506 records). [2025-10-15T19:02:11.274686] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-15T19:02:11.274812] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSK took 43.5s. Estimated remaining: 3h 29m 15s. Rate: 7.1 symbols/min [2025-10-15T19:02:11.319180] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-15T19:02:11.475406] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:11.486172] [DEBUG] [LOCAL ] FT: Loaded 6802 existing records from primary storage. [2025-10-15T19:02:11.486462] [INFO ] [MAIN ] FT: Loaded 6802 existing records. [2025-10-15T19:02:11.663995] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:11.664218] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-15T19:02:11.664266] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-15T19:02:11.664461] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-15T19:02:11.664530] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-15T19:02:12.070612] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:12.100410] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:02:12.113952] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-15T19:02:12.914018] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-15T19:02:12.941324] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:02:13.527965] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T19:02:13.561869] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:02:13.713988] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-15T19:02:14.514017] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-15T19:02:15.314053] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-15T19:02:15.446054] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T19:02:16.113990] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-15T19:02:16.449467] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-15T19:02:16.456454] [INFO ] [REMOTE ] FSLY: Full fetch complete (74999 records). [2025-10-15T19:02:16.456630] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-15T19:02:16.772282] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T19:02:16.903107] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-15T19:02:16.903208] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-15T19:02:16.904246] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-15T19:02:16.904327] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-15T19:02:16.905839] [DEBUG] [LOCAL ] FSLY: Trimmed 74999 records to 51325 (keeping 200 days of data) [2025-10-15T19:02:16.953324] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-15T19:02:17.213208] [DEBUG] [LOCAL ] FSLY: Primary data saved (51325 records). [2025-10-15T19:02:17.213358] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-15T19:02:17.213833] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSLY took 33.7s. Estimated remaining: 3h 29m 3s. Rate: 7.2 symbols/min [2025-10-15T19:02:17.392588] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:17.407962] [DEBUG] [LOCAL ] FTHY: Loaded 12287 existing records from primary storage. [2025-10-15T19:02:17.408217] [INFO ] [MAIN ] FTHY: Loaded 12287 existing records. [2025-10-15T19:02:17.598202] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:17.598711] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-15T19:02:17.598770] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-15T19:02:17.598959] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-15T19:02:17.599042] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-15T19:02:17.714038] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-15T19:02:17.999098] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:02:18.032118] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:18.293201] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T19:02:18.387240] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:02:18.514008] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-15T19:02:19.314021] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-15T19:02:20.113999] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-15T19:02:20.355938] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T19:02:20.646326] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:02:20.650487] [INFO ] [REMOTE ] FSS: Full fetch complete (48543 records). [2025-10-15T19:02:20.650577] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-15T19:02:20.914747] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-15T19:02:21.039257] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-15T19:02:21.039378] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-15T19:02:21.040257] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-15T19:02:21.040355] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-15T19:02:21.052222] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T19:02:21.056988] [DEBUG] [LOCAL ] FSS: Trimmed 48543 records to 33666 (keeping 200 days of data) [2025-10-15T19:02:21.282673] [DEBUG] [LOCAL ] FSS: Primary data saved (33666 records). [2025-10-15T19:02:21.282823] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-15T19:02:21.282903] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FSS took 29.6s. Estimated remaining: 3h 28m 47s. Rate: 7.2 symbols/min [2025-10-15T19:02:21.449524] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:21.504112] [DEBUG] [LOCAL ] FTI: Loaded 53300 existing records from primary storage. [2025-10-15T19:02:21.504407] [INFO ] [MAIN ] FTI: Loaded 53300 existing records. [2025-10-15T19:02:21.676336] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:21.676501] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-15T19:02:21.676567] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-15T19:02:21.677122] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-15T19:02:21.677181] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-15T19:02:21.719380] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-15T19:02:22.026186] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:22.513973] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-15T19:02:22.691817] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:02:22.894694] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T19:02:22.905268] [INFO ] [REMOTE ] FSM: Full fetch complete (77069 records). [2025-10-15T19:02:22.905477] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-15T19:02:23.320741] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-15T19:02:23.321888] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-15T19:02:23.323399] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-15T19:02:23.324609] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-15T19:02:23.324813] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-15T19:02:23.326279] [DEBUG] [LOCAL ] FSM: Trimmed 77069 records to 53301 (keeping 200 days of data) [2025-10-15T19:02:23.649729] [DEBUG] [LOCAL ] FSM: Primary data saved (53301 records). [2025-10-15T19:02:23.649868] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-15T19:02:23.649947] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FSM took 38.6s. Estimated remaining: 3h 28m 28s. Rate: 7.2 symbols/min [2025-10-15T19:02:23.832283] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:23.864964] [DEBUG] [LOCAL ] FTK: Loaded 32864 existing records from primary storage. [2025-10-15T19:02:23.865250] [INFO ] [MAIN ] FTK: Loaded 32864 existing records. [2025-10-15T19:02:23.994258] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T19:02:24.081029] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:24.081279] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-15T19:02:24.081419] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-15T19:02:24.081710] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-15T19:02:24.081767] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-15T19:02:24.119118] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-15T19:02:24.273822] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:02:24.562169] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:24.766740] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T19:02:24.914022] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-15T19:02:25.713989] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-15T19:02:26.465728] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T19:02:26.513948] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-15T19:02:26.742585] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T19:02:27.208248] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:02:27.313948] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-15T19:02:28.114001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-15T19:02:28.261494] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:02:28.913965] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-15T19:02:29.247834] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:02:29.666159] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:02:29.714011] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-15T19:02:30.514008] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-15T19:02:30.750218] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T19:02:31.314041] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-15T19:02:32.113993] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-15T19:02:32.148604] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T19:02:32.179534] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:02:32.530889] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T19:02:32.914015] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-15T19:02:33.713974] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-15T19:02:34.125344] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T19:02:34.514026] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-15T19:02:35.214593] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T19:02:35.314048] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-15T19:02:35.726167] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T19:02:36.085819] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T19:02:36.113986] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-15T19:02:36.909181] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:02:36.913953] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-15T19:02:37.671111] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T19:02:37.713995] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-15T19:02:38.514033] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-15T19:02:38.627478] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T19:02:38.630940] [INFO ] [REMOTE ] FTHY: Full fetch complete (17358 records). [2025-10-15T19:02:38.631101] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-15T19:02:39.048346] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-15T19:02:39.048430] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-15T19:02:39.048860] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-15T19:02:39.048922] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-15T19:02:39.049521] [DEBUG] [LOCAL ] FTHY: Trimmed 17358 records to 12336 (keeping 200 days of data) [2025-10-15T19:02:39.128196] [DEBUG] [LOCAL ] FTHY: Primary data saved (12336 records). [2025-10-15T19:02:39.128348] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-15T19:02:39.128431] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 21.9s. Estimated remaining: 3h 28m 32s. Rate: 7.2 symbols/min [2025-10-15T19:02:39.314026] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-15T19:02:40.114081] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-15T19:02:40.306260] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:02:40.756186] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:02:40.769677] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T19:02:40.914056] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-15T19:02:41.630988] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:02:41.714067] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-15T19:02:42.514091] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-15T19:02:43.092036] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T19:02:43.314091] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-15T19:02:43.560073] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T19:02:44.114036] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-15T19:02:44.558404] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:02:44.754071] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T19:02:44.914062] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-15T19:02:45.714108] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-15T19:02:46.361398] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:02:46.432004] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T19:02:46.514034] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-15T19:02:46.992869] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T19:02:47.314020] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-15T19:02:48.114073] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-15T19:02:48.914102] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-15T19:02:49.010406] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:02:49.432069] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:02:49.434160] [INFO ] [REMOTE ] FT: Full fetch complete (9305 records). [2025-10-15T19:02:49.440991] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-15T19:02:49.453859] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T19:02:49.719149] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-15T19:02:49.826392] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-15T19:02:49.826469] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-15T19:02:49.826736] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-15T19:02:49.826798] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-15T19:02:49.827217] [DEBUG] [LOCAL ] FT: Trimmed 9305 records to 6804 (keeping 200 days of data) [2025-10-15T19:02:49.867014] [DEBUG] [LOCAL ] FT: Primary data saved (6804 records). [2025-10-15T19:02:49.867160] [INFO ] [MAIN ] FT: Full history saved. [2025-10-15T19:02:49.867241] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FT took 38.6s. Estimated remaining: 3h 28m 28s. Rate: 7.2 symbols/min [2025-10-15T19:02:50.514080] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-15T19:02:51.076007] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T19:02:51.314064] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-15T19:02:52.293588] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:02:52.305316] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-15T19:02:52.633169] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:02:52.638122] [INFO ] [REMOTE ] FTK: Full fetch complete (44059 records). [2025-10-15T19:02:52.638261] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-15T19:02:53.045347] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-15T19:02:53.045460] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-15T19:02:53.046203] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-15T19:02:53.046312] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-15T19:02:53.047376] [DEBUG] [LOCAL ] FTK: Trimmed 44059 records to 32908 (keeping 200 days of data) [2025-10-15T19:02:53.237426] [DEBUG] [LOCAL ] FTK: Primary data saved (32908 records). [2025-10-15T19:02:53.237567] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-15T19:02:53.237667] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTK took 29.6s. Estimated remaining: 3h 28m 11s. Rate: 7.2 symbols/min [2025-10-15T19:02:54.068256] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T19:02:54.085579] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-15T19:02:55.903727] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:02:55.916566] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-15T19:02:57.799083] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:02:57.808853] [INFO ] [REMOTE ] FTI: Full fetch complete (77302 records). [2025-10-15T19:02:57.809045] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-15T19:02:58.214617] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-15T19:02:58.214762] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-15T19:02:58.215789] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-15T19:02:58.215850] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-15T19:02:58.217779] [DEBUG] [LOCAL ] FTI: Trimmed 77302 records to 53296 (keeping 200 days of data) [2025-10-15T19:02:58.551608] [DEBUG] [LOCAL ] FTI: Primary data saved (53296 records). [2025-10-15T19:02:58.551789] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-15T19:02:58.552671] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTI took 37.3s. Estimated remaining: 3h 27m 57s. Rate: 7.2 symbols/min [2025-10-15T19:02:59.218924] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.335510] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.317252] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.341604] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.349944] [DEBUG] [LOCAL ] FTWO: Loaded 1904 existing records from primary storage. [2025-10-15T19:02:59.350492] [INFO ] [MAIN ] FTWO: Loaded 1904 existing records. [2025-10-15T19:02:59.583096] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:59.584719] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-15T19:02:59.585834] [DEBUG] [LOCAL ] FTS: Loaded 42555 existing records from primary storage. [2025-10-15T19:02:59.584800] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-15T19:02:59.600571] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-15T19:02:59.600510] [INFO ] [MAIN ] FTS: Loaded 42555 existing records. [2025-10-15T19:02:59.600721] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-15T19:02:59.812191] [DEBUG] [LOCAL ] FTV: Loaded 53038 existing records from primary storage. [2025-10-15T19:02:59.793711] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-15T19:02:59.831944] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-15T19:02:59.832096] [INFO ] [MAIN ] FTV: Loaded 53038 existing records. [2025-10-15T19:03:00.192001] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:00.207987] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-15T19:03:00.264112] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-15T19:03:00.380819] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-15T19:03:00.414111] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-15T19:03:00.532711] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:00.577184] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-15T19:03:00.683792] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:00.689071] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-15T19:03:00.720344] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-15T19:03:00.756752] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-15T19:03:00.725630] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-15T19:03:00.782965] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-15T19:03:00.789419] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-15T19:03:00.792225] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-15T19:03:00.852435] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.098857] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-15T19:03:01.724771] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.801078] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-15T19:03:01.882903] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.907580] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-15T19:03:01.959621] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.960019] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-15T19:03:01.965193] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T19:03:01.966857] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-15T19:03:02.582971] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:03:02.584549] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-15T19:03:03.036152] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T19:03:03.037410] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-15T19:03:03.201289] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:03:03.210880] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-15T19:03:03.293714] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T19:03:03.304799] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-15T19:03:03.412195] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-15T19:03:03.414050] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-15T19:03:03.751735] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T19:03:03.753079] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-15T19:03:03.801886] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:03:03.813504] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-15T19:03:04.097850] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T19:03:04.113955] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-15T19:03:04.579406] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:03:04.788408] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:03:04.895745] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T19:03:04.913963] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-15T19:03:05.714081] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-15T19:03:06.174087] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T19:03:06.179424] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-15T19:03:06.252583] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:03:06.514067] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-15T19:03:07.314020] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-15T19:03:07.898055] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:03:08.113988] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-15T19:03:08.914018] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-15T19:03:09.025482] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T19:03:09.188815] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:03:09.341780] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:03:09.714013] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-15T19:03:10.514008] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-15T19:03:11.229235] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:03:11.314027] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-15T19:03:12.114047] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-15T19:03:12.308170] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:03:12.702285] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T19:03:12.914051] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-15T19:03:13.714035] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-15T19:03:14.164166] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-15T19:03:14.441315] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:03:14.514012] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-15T19:03:15.249881] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:03:15.314001] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-15T19:03:15.781782] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T19:03:15.785912] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T19:03:16.114030] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-15T19:03:16.914013] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-15T19:03:17.407503] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T19:03:17.429771] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:03:17.430751] [INFO ] [REMOTE ] FTWO: Full fetch complete (3329 records). [2025-10-15T19:03:17.430820] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-15T19:03:17.719205] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-15T19:03:17.814377] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-15T19:03:17.814451] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-15T19:03:17.814589] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-15T19:03:17.814671] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-15T19:03:17.815028] [DEBUG] [LOCAL ] FTWO: Trimmed 3329 records to 1915 (keeping 200 days of data) [2025-10-15T19:03:17.827144] [DEBUG] [LOCAL ] FTWO: Primary data saved (1915 records). [2025-10-15T19:03:17.827278] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-15T19:03:17.827418] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 19.3s. Estimated remaining: 3h 28m 7s. Rate: 7.1 symbols/min [2025-10-15T19:03:18.013117] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:18.044668] [DEBUG] [LOCAL ] FUL: Loaded 32507 existing records from primary storage. [2025-10-15T19:03:18.044973] [INFO ] [MAIN ] FUL: Loaded 32507 existing records. [2025-10-15T19:03:18.223251] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:18.223468] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-15T19:03:18.223533] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-15T19:03:18.223879] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-15T19:03:18.223947] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-15T19:03:18.519104] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-15T19:03:18.594937] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:19.314002] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-15T19:03:19.404304] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:03:20.113981] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-15T19:03:20.789091] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-15T19:03:20.824702] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:03:20.913992] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-15T19:03:21.713974] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-15T19:03:21.894665] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:03:22.156094] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:03:22.161586] [INFO ] [REMOTE ] FTS: Full fetch complete (60575 records). [2025-10-15T19:03:22.161770] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-15T19:03:22.517632] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-15T19:03:22.565209] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-15T19:03:22.565567] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-15T19:03:22.566676] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-15T19:03:22.566840] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-15T19:03:22.573958] [DEBUG] [LOCAL ] FTS: Trimmed 60575 records to 42538 (keeping 200 days of data) [2025-10-15T19:03:22.585207] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T19:03:22.854116] [DEBUG] [LOCAL ] FTS: Primary data saved (42538 records). [2025-10-15T19:03:22.854248] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-15T19:03:22.854973] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTS took 24.3s. Estimated remaining: 3h 27m 53s. Rate: 7.2 symbols/min [2025-10-15T19:03:23.031745] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:23.087249] [DEBUG] [LOCAL ] FUN: Loaded 51869 existing records from primary storage. [2025-10-15T19:03:23.087627] [INFO ] [MAIN ] FUN: Loaded 51869 existing records. [2025-10-15T19:03:23.290761] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:23.290965] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-15T19:03:23.291012] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-15T19:03:23.291209] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-15T19:03:23.291263] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-15T19:03:23.320895] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-15T19:03:23.726032] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:24.114039] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-15T19:03:24.268695] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T19:03:24.914003] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-15T19:03:25.436206] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T19:03:25.521907] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:03:25.714005] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-15T19:03:25.829449] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T19:03:26.514064] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-15T19:03:27.313991] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-15T19:03:27.479134] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T19:03:27.836370] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T19:03:28.114038] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-15T19:03:28.698338] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:03:28.913999] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-15T19:03:29.714035] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-15T19:03:29.890556] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T19:03:29.897162] [INFO ] [REMOTE ] FTV: Full fetch complete (76635 records). [2025-10-15T19:03:29.897323] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-15T19:03:30.289419] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-15T19:03:30.289500] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-15T19:03:30.290482] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-15T19:03:30.290543] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-15T19:03:30.292322] [DEBUG] [LOCAL ] FTV: Trimmed 76635 records to 53067 (keeping 200 days of data) [2025-10-15T19:03:30.514224] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-15T19:03:30.620398] [DEBUG] [LOCAL ] FTV: Primary data saved (53067 records). [2025-10-15T19:03:30.620524] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-15T19:03:30.620600] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 32.1s. Estimated remaining: 3h 27m 44s. Rate: 7.2 symbols/min [2025-10-15T19:03:30.795272] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:30.817496] [DEBUG] [LOCAL ] FVR: Loaded 21188 existing records from primary storage. [2025-10-15T19:03:30.817770] [INFO ] [MAIN ] FVR: Loaded 21188 existing records. [2025-10-15T19:03:31.008364] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:31.008910] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-15T19:03:31.009273] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-15T19:03:31.034311] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-15T19:03:31.034551] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-15T19:03:31.084355] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-15T19:03:31.317976] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-15T19:03:31.444701] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:31.446216] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:03:32.001415] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T19:03:32.113963] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-15T19:03:32.914074] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-15T19:03:33.205105] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:03:33.387715] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-15T19:03:33.714012] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-15T19:03:34.371086] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:03:34.514015] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-15T19:03:34.676555] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T19:03:35.314036] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-15T19:03:35.520902] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T19:03:36.117744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-15T19:03:36.121357] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:03:36.914061] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-15T19:03:37.714064] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-15T19:03:37.762992] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T19:03:37.798714] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T19:03:38.513985] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-15T19:03:39.314006] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-15T19:03:39.796073] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T19:03:40.118034] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-15T19:03:40.126705] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T19:03:40.178728] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T19:03:40.914008] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-15T19:03:41.713992] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-15T19:03:41.960395] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T19:03:42.158394] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T19:03:42.514006] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-15T19:03:43.314049] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-15T19:03:43.731927] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T19:03:44.008606] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-15T19:03:44.114018] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-15T19:03:44.914061] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-15T19:03:45.714074] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-15T19:03:46.223834] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:03:46.384292] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-15T19:03:46.519074] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-15T19:03:46.541253] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-10-15T19:03:47.314085] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-15T19:03:47.414572] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:03:47.582584] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:03:48.114075] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-15T19:03:48.578905] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:03:48.914029] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-15T19:03:49.714018] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-15T19:03:49.977064] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T19:03:50.361672] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-15T19:03:50.368169] [INFO ] [REMOTE ] FUBO: Full fetch complete (77867 records). [2025-10-15T19:03:50.368313] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-15T19:03:50.519091] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-15T19:03:50.760088] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-15T19:03:50.760186] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-15T19:03:50.761169] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-15T19:03:50.761234] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-15T19:03:50.762796] [DEBUG] [LOCAL ] FUBO: Trimmed 77867 records to 53718 (keeping 200 days of data) [2025-10-15T19:03:51.075471] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-15T19:03:51.075632] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-15T19:03:51.075778] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 52.5s. Estimated remaining: 3h 27m 56s. Rate: 7.1 symbols/min [2025-10-15T19:03:51.245721] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:51.278972] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:03:51.321394] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-15T19:03:51.323912] [DEBUG] [LOCAL ] FVRR: Loaded 40624 existing records from primary storage. [2025-10-15T19:03:51.324262] [INFO ] [MAIN ] FVRR: Loaded 40624 existing records. [2025-10-15T19:03:51.506065] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:51.506372] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-15T19:03:51.506434] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-15T19:03:51.506778] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-15T19:03:51.506849] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-15T19:03:51.629291] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T19:03:51.875775] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:52.114002] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-15T19:03:52.914015] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-15T19:03:53.046054] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T19:03:53.048460] [INFO ] [REMOTE ] FVR: Full fetch complete (29573 records). [2025-10-15T19:03:53.048536] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-15T19:03:53.371379] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-15T19:03:53.474708] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-15T19:03:53.474817] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-15T19:03:53.475562] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-15T19:03:53.475664] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-15T19:03:53.476880] [DEBUG] [LOCAL ] FVR: Trimmed 29573 records to 21190 (keeping 200 days of data) [2025-10-15T19:03:53.630406] [DEBUG] [LOCAL ] FVR: Primary data saved (21190 records). [2025-10-15T19:03:53.630547] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-15T19:03:53.630637] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FVR took 23.0s. Estimated remaining: 3h 27m 37s. Rate: 7.1 symbols/min [2025-10-15T19:03:53.719106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-15T19:03:53.797163] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:53.800727] [DEBUG] [LOCAL ] FXED: Loaded 1253 existing records from primary storage. [2025-10-15T19:03:53.800861] [INFO ] [MAIN ] FXED: Loaded 1253 existing records. [2025-10-15T19:03:53.973034] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:53.973211] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-15T19:03:53.973257] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-15T19:03:53.973375] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-15T19:03:53.973412] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-15T19:03:54.346013] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:54.349808] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T19:03:54.513960] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-15T19:03:54.859121] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-15T19:03:55.314007] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-15T19:03:55.535774] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:03:55.723946] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T19:03:56.114102] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-15T19:03:56.449955] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:03:56.914004] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-15T19:03:57.714003] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-15T19:03:57.932462] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T19:03:58.514018] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-15T19:03:58.917797] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-15T19:03:59.313957] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-15T19:03:59.391972] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:03:59.398406] [INFO ] [REMOTE ] FUN: Full fetch complete (73326 records). [2025-10-15T19:03:59.398556] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-15T19:03:59.823717] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-15T19:03:59.823819] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-15T19:03:59.824801] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-15T19:03:59.824889] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-15T19:03:59.826391] [DEBUG] [LOCAL ] FUN: Trimmed 73326 records to 51916 (keeping 200 days of data) [2025-10-15T19:04:00.114697] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-15T19:04:00.126667] [DEBUG] [LOCAL ] FUN: Primary data saved (51916 records). [2025-10-15T19:04:00.126753] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-15T19:04:00.127022] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FUN took 37.3s. Estimated remaining: 3h 27m 26s. Rate: 7.1 symbols/min [2025-10-15T19:04:00.292579] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:00.337231] [DEBUG] [LOCAL ] G: Loaded 50036 existing records from primary storage. [2025-10-15T19:04:00.337544] [INFO ] [MAIN ] G: Loaded 50036 existing records. [2025-10-15T19:04:00.511378] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:00.511572] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-15T19:04:00.511618] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-15T19:04:00.512025] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-15T19:04:00.512074] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-15T19:04:00.867731] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:00.889688] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:04:00.913945] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-15T19:04:01.502998] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:04:01.507044] [INFO ] [REMOTE ] FUL: Full fetch complete (47828 records). [2025-10-15T19:04:01.507163] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-15T19:04:01.724730] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-15T19:04:01.891296] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-15T19:04:01.891390] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-15T19:04:01.892178] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-15T19:04:01.892244] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-15T19:04:01.893385] [DEBUG] [LOCAL ] FUL: Trimmed 47828 records to 32393 (keeping 200 days of data) [2025-10-15T19:04:02.090522] [DEBUG] [LOCAL ] FUL: Primary data saved (32393 records). [2025-10-15T19:04:02.090708] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-15T19:04:02.090805] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FUL took 44.3s. Estimated remaining: 3h 27m 7s. Rate: 7.2 symbols/min [2025-10-15T19:04:02.268202] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:02.297920] [DEBUG] [LOCAL ] GAB: Loaded 27719 existing records from primary storage. [2025-10-15T19:04:02.298259] [INFO ] [MAIN ] GAB: Loaded 27719 existing records. [2025-10-15T19:04:02.508423] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:02.509020] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-15T19:04:02.509229] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-15T19:04:02.509523] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-15T19:04:02.509600] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-15T19:04:02.531268] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-15T19:04:02.740943] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T19:04:02.961890] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:03.291639] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:04:03.314753] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-15T19:04:03.319274] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:04:03.690401] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T19:04:04.114055] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-15T19:04:04.914055] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-15T19:04:05.579450] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T19:04:05.714000] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-15T19:04:06.149431] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T19:04:06.514046] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-15T19:04:07.158636] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T19:04:07.313970] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-15T19:04:07.408808] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T19:04:08.113994] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-15T19:04:08.855451] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:04:08.914028] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-15T19:04:09.668494] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:04:09.714007] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-15T19:04:10.037195] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:04:10.156026] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:04:10.513990] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-15T19:04:11.314012] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-15T19:04:12.108586] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:04:12.119400] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-15T19:04:12.302905] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T19:04:12.914001] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-15T19:04:13.725175] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-15T19:04:13.751222] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:04:13.816507] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T19:04:14.514062] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-15T19:04:14.935090] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T19:04:15.314041] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-15T19:04:15.372565] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T19:04:16.114012] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-15T19:04:16.537014] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T19:04:16.913992] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-15T19:04:16.943073] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:04:17.348879] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T19:04:17.714007] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-15T19:04:18.514029] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-15T19:04:18.910704] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T19:04:18.912370] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:04:18.913514] [INFO ] [REMOTE ] FXED: Full fetch complete (1796 records). [2025-10-15T19:04:18.913707] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-15T19:04:19.273240] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-15T19:04:19.273314] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-15T19:04:19.273404] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-15T19:04:19.273441] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-15T19:04:19.273788] [DEBUG] [LOCAL ] FXED: Trimmed 1796 records to 1246 (keeping 200 days of data) [2025-10-15T19:04:19.281689] [DEBUG] [LOCAL ] FXED: Primary data saved (1246 records). [2025-10-15T19:04:19.281747] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-15T19:04:19.281807] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FXED took 25.7s. Estimated remaining: 3h 27m 13s. Rate: 7.1 symbols/min [2025-10-15T19:04:19.319205] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-15T19:04:19.450010] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:19.456938] [DEBUG] [LOCAL ] GAM: Loaded 3927 existing records from primary storage. [2025-10-15T19:04:19.457183] [INFO ] [MAIN ] GAM: Loaded 3927 existing records. [2025-10-15T19:04:19.627679] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:19.627871] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-15T19:04:19.627919] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-15T19:04:19.628081] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-15T19:04:19.628149] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-15T19:04:19.964161] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:20.113947] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-15T19:04:20.902295] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:04:20.913949] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-15T19:04:21.090160] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:04:21.714085] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-15T19:04:22.514103] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-15T19:04:22.650933] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T19:04:22.658482] [INFO ] [REMOTE ] FVRR: Full fetch complete (59304 records). [2025-10-15T19:04:22.658712] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-15T19:04:23.104020] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-15T19:04:23.104181] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-15T19:04:23.105320] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-15T19:04:23.105386] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-15T19:04:23.106707] [DEBUG] [LOCAL ] FVRR: Trimmed 59304 records to 40631 (keeping 200 days of data) [2025-10-15T19:04:23.314864] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-15T19:04:23.353926] [DEBUG] [LOCAL ] FVRR: Primary data saved (40631 records). [2025-10-15T19:04:23.354128] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-15T19:04:23.354217] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FVRR took 32.3s. Estimated remaining: 3h 26m 57s. Rate: 7.2 symbols/min [2025-10-15T19:04:23.531355] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:23.547427] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:04:23.582409] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:04:23.636148] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-15T19:04:23.636489] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-15T19:04:23.815723] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:23.815978] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-15T19:04:23.816047] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-15T19:04:23.816508] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-15T19:04:23.816568] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-15T19:04:23.965400] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T19:04:24.119209] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-15T19:04:24.232567] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:24.914063] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-15T19:04:25.584757] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T19:04:25.713962] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-15T19:04:25.853509] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T19:04:26.378729] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T19:04:26.513967] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-15T19:04:27.313976] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-15T19:04:27.741238] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T19:04:28.114010] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-15T19:04:28.703915] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T19:04:28.919184] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-15T19:04:28.936425] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:04:29.564115] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:04:29.714057] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-15T19:04:30.514074] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-15T19:04:31.123306] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:04:31.314030] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-15T19:04:31.851221] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:04:32.114056] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-15T19:04:32.913971] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-15T19:04:33.123967] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T19:04:33.714013] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-15T19:04:33.794827] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:04:33.796527] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:04:34.513965] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-15T19:04:34.695031] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:04:35.314053] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-15T19:04:35.847729] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:04:35.899240] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T19:04:36.114021] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-15T19:04:36.914086] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-15T19:04:37.714048] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-15T19:04:37.847095] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T19:04:38.346678] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:04:38.514051] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-15T19:04:38.979250] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:04:39.230203] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T19:04:39.237493] [INFO ] [REMOTE ] G: Full fetch complete (72078 records). [2025-10-15T19:04:39.237725] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-15T19:04:39.319232] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-15T19:04:39.653963] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-15T19:04:39.654053] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-15T19:04:39.655084] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-15T19:04:39.655146] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-15T19:04:39.656554] [DEBUG] [LOCAL ] G: Trimmed 72078 records to 50051 (keeping 200 days of data) [2025-10-15T19:04:39.960963] [DEBUG] [LOCAL ] G: Primary data saved (50051 records). [2025-10-15T19:04:39.961099] [INFO ] [MAIN ] G: Full history saved. [2025-10-15T19:04:39.961178] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. G took 39.8s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-15T19:04:40.116086] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-15T19:04:40.136778] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:40.156862] [DEBUG] [LOCAL ] GATX: Loaded 18097 existing records from primary storage. [2025-10-15T19:04:40.157154] [INFO ] [MAIN ] GATX: Loaded 18097 existing records. [2025-10-15T19:04:40.336132] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:40.336355] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-15T19:04:40.336402] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-15T19:04:40.336730] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-15T19:04:40.336786] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-15T19:04:40.699666] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:40.710035] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:04:40.713770] [INFO ] [REMOTE ] GAB: Full fetch complete (39356 records). [2025-10-15T19:04:40.713911] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-15T19:04:40.924493] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-15T19:04:41.075849] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-15T19:04:41.075921] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-15T19:04:41.076547] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-15T19:04:41.076586] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-15T19:04:41.077406] [DEBUG] [LOCAL ] GAB: Trimmed 39356 records to 27709 (keeping 200 days of data) [2025-10-15T19:04:41.231506] [DEBUG] [LOCAL ] GAB: Primary data saved (27709 records). [2025-10-15T19:04:41.231634] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-15T19:04:41.231752] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAB took 39.1s. Estimated remaining: 3h 26m 42s. Rate: 7.2 symbols/min [2025-10-15T19:04:41.399786] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:41.416341] [DEBUG] [LOCAL ] GBAB: Loaded 12962 existing records from primary storage. [2025-10-15T19:04:41.416553] [INFO ] [MAIN ] GBAB: Loaded 12962 existing records. [2025-10-15T19:04:41.509291] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:04:41.595717] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:41.595927] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-15T19:04:41.595973] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-15T19:04:41.596250] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-15T19:04:41.596307] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-15T19:04:41.714585] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-15T19:04:41.946885] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:41.974461] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T19:04:42.319989] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:04:42.321365] [INFO ] [REMOTE ] GAM: Full fetch complete (6552 records). [2025-10-15T19:04:42.321443] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-15T19:04:42.523397] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-15T19:04:42.714842] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-15T19:04:42.714946] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-15T19:04:42.715230] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-15T19:04:42.715293] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-15T19:04:42.715902] [DEBUG] [LOCAL ] GAM: Trimmed 6552 records to 3926 (keeping 200 days of data) [2025-10-15T19:04:42.743762] [DEBUG] [LOCAL ] GAM: Primary data saved (3926 records). [2025-10-15T19:04:42.743949] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-15T19:04:42.744047] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAM took 23.5s. Estimated remaining: 3h 26m 23s. Rate: 7.2 symbols/min [2025-10-15T19:04:42.923039] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:42.962179] [DEBUG] [LOCAL ] GBCI: Loaded 40713 existing records from primary storage. [2025-10-15T19:04:42.962533] [INFO ] [MAIN ] GBCI: Loaded 40713 existing records. [2025-10-15T19:04:43.143853] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:43.144088] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-15T19:04:43.144182] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-15T19:04:43.144450] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-15T19:04:43.144508] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-15T19:04:43.327238] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-15T19:04:43.507530] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:44.113975] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-15T19:04:44.215403] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T19:04:44.715920] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T19:04:44.913978] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-15T19:04:45.520353] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:04:45.600513] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T19:04:45.713980] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-15T19:04:46.514035] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-15T19:04:46.580141] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T19:04:47.314025] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-15T19:04:47.942261] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T19:04:48.114000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-15T19:04:48.913986] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-15T19:04:49.224217] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T19:04:49.502808] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:04:49.714060] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-15T19:04:49.884241] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:04:50.514014] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-15T19:04:51.313979] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-15T19:04:51.428295] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T19:04:51.663819] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T19:04:52.102598] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T19:04:52.113987] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-15T19:04:52.914002] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-15T19:04:53.077935] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T19:04:53.714034] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-15T19:04:54.513994] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-15T19:04:54.807676] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T19:04:54.854633] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T19:04:55.063542] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:04:55.314014] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-15T19:04:56.114052] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-15T19:04:56.391235] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:04:56.913969] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-15T19:04:57.590180] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T19:04:57.722573] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-15T19:04:57.724372] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T19:04:58.514005] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-15T19:04:58.646908] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T19:04:59.314051] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-15T19:04:59.998150] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T19:05:00.114000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-15T19:05:00.914022] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-15T19:05:01.418540] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:05:01.486966] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T19:05:01.653593] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:05:01.714010] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-15T19:05:02.513993] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-15T19:05:02.718601] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:05:03.314008] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-15T19:05:03.832437] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:05:04.114012] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-15T19:05:04.367967] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T19:05:04.914017] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-15T19:05:05.713979] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-15T19:05:06.029941] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T19:05:06.053721] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:05:06.514047] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-15T19:05:07.294770] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T19:05:07.313969] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-15T19:05:08.114021] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-15T19:05:08.301097] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:05:08.490668] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T19:05:08.914056] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-15T19:05:09.615938] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T19:05:09.713974] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-15T19:05:09.843434] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:05:10.513990] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-15T19:05:11.168014] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T19:05:11.313996] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-15T19:05:12.113983] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-15T19:05:12.261883] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T19:05:12.264033] [INFO ] [REMOTE ] GATX: Full fetch complete (24901 records). [2025-10-15T19:05:12.264110] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-15T19:05:12.643432] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-15T19:05:12.659393] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-15T19:05:12.659628] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-15T19:05:12.660433] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-15T19:05:12.660512] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-15T19:05:12.661186] [INFO ] [REMOTE ] GAP: Full fetch complete (77805 records). [2025-10-15T19:05:12.661378] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-15T19:05:12.661871] [DEBUG] [LOCAL ] GATX: Trimmed 24901 records to 18079 (keeping 200 days of data) [2025-10-15T19:05:12.882205] [DEBUG] [LOCAL ] GATX: Primary data saved (18079 records). [2025-10-15T19:05:12.898360] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-15T19:05:12.923095] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GATX took 33.0s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-15T19:05:12.928399] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-15T19:05:13.120365] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:05:13.333293] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:13.340579] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-15T19:05:13.341886] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-15T19:05:13.361379] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-15T19:05:13.380332] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-15T19:05:13.380240] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-15T19:05:13.380506] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-15T19:05:13.380408] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-15T19:05:13.380567] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-15T19:05:13.413431] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-15T19:05:13.425308] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-15T19:05:13.495257] [DEBUG] [LOCAL ] GAP: Trimmed 77805 records to 53653 (keeping 200 days of data) [2025-10-15T19:05:13.722635] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-15T19:05:13.858232] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:14.087186] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-15T19:05:14.087335] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-15T19:05:14.088472] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GAP took 50.7s. Estimated remaining: 3h 26m 30s. Rate: 7.1 symbols/min [2025-10-15T19:05:14.254885] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:14.298885] [DEBUG] [LOCAL ] GBTG: Loaded 40171 existing records from primary storage. [2025-10-15T19:05:14.299260] [INFO ] [MAIN ] GBTG: Loaded 40171 existing records. [2025-10-15T19:05:14.483193] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:14.483415] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-15T19:05:14.483473] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-15T19:05:14.483935] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-15T19:05:14.483992] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-15T19:05:14.515243] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-15T19:05:14.771298] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T19:05:14.783525] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:05:14.803599] [INFO ] [REMOTE ] GBCI: Full fetch complete (58927 records). [2025-10-15T19:05:14.819831] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-15T19:05:14.966322] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:15.026298] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T19:05:15.290985] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-15T19:05:15.291060] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-15T19:05:15.291860] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-15T19:05:15.291920] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-15T19:05:15.293037] [DEBUG] [LOCAL ] GBCI: Trimmed 58927 records to 40856 (keeping 200 days of data) [2025-10-15T19:05:15.345050] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-15T19:05:15.536145] [DEBUG] [LOCAL ] GBCI: Primary data saved (40856 records). [2025-10-15T19:05:15.536266] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-15T19:05:15.536369] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBCI took 32.8s. Estimated remaining: 3h 26m 10s. Rate: 7.1 symbols/min [2025-10-15T19:05:15.709010] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:15.742222] [DEBUG] [LOCAL ] GBX: Loaded 28986 existing records from primary storage. [2025-10-15T19:05:15.742473] [INFO ] [MAIN ] GBX: Loaded 28986 existing records. [2025-10-15T19:05:15.913454] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:15.913620] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-15T19:05:15.913696] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-15T19:05:15.913962] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-15T19:05:15.914000] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-15T19:05:16.124127] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-15T19:05:16.255639] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:16.697031] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:05:16.913986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-15T19:05:16.943442] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T19:05:16.945165] [INFO ] [REMOTE ] GBAB: Full fetch complete (18994 records). [2025-10-15T19:05:16.945233] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-15T19:05:17.307819] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-15T19:05:17.307894] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-15T19:05:17.308340] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-15T19:05:17.308380] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-15T19:05:17.308944] [DEBUG] [LOCAL ] GBAB: Trimmed 18994 records to 12868 (keeping 200 days of data) [2025-10-15T19:05:17.386379] [DEBUG] [LOCAL ] GBAB: Primary data saved (12868 records). [2025-10-15T19:05:17.386502] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-15T19:05:17.386580] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBAB took 36.2s. Estimated remaining: 3h 25m 51s. Rate: 7.2 symbols/min [2025-10-15T19:05:17.551968] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:17.590328] [DEBUG] [LOCAL ] GCI: Loaded 43904 existing records from primary storage. [2025-10-15T19:05:17.590614] [INFO ] [MAIN ] GCI: Loaded 43904 existing records. [2025-10-15T19:05:17.726302] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-15T19:05:17.766723] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:17.767599] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-15T19:05:17.767673] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-15T19:05:17.768204] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-15T19:05:17.768330] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-15T19:05:18.133149] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:18.165932] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T19:05:18.220264] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T19:05:18.513994] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-15T19:05:19.314024] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-15T19:05:19.573360] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-15T19:05:19.754414] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T19:05:20.113997] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-15T19:05:20.914036] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-15T19:05:21.239232] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:05:21.322842] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T19:05:21.714098] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-15T19:05:22.514003] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-15T19:05:22.702834] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:05:23.314001] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-15T19:05:23.982628] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:05:24.113992] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-15T19:05:24.532578] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T19:05:24.688317] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:05:24.914028] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-15T19:05:25.714013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-15T19:05:26.164159] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T19:05:26.514062] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-15T19:05:27.156189] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:05:27.314013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-15T19:05:27.975888] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:05:28.113956] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-15T19:05:28.731055] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:05:28.914012] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-15T19:05:29.531081] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:05:29.713977] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-15T19:05:30.079261] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T19:05:30.514006] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-15T19:05:31.170105] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:05:31.313994] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-15T19:05:32.113972] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-15T19:05:32.158822] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:05:32.470261] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T19:05:32.496427] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T19:05:32.913991] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-15T19:05:33.713986] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-15T19:05:33.948218] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-15T19:05:34.296548] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:05:34.513986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-15T19:05:35.314009] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-15T19:05:35.892727] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:05:36.114022] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-15T19:05:36.812622] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T19:05:36.913986] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-15T19:05:37.227551] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T19:05:37.714066] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-15T19:05:38.372390] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:05:38.513954] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-15T19:05:38.761957] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T19:05:39.314095] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-15T19:05:40.113981] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-15T19:05:40.161376] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T19:05:40.819618] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:05:40.914018] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-15T19:05:41.541723] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T19:05:41.546608] [INFO ] [REMOTE ] GBTG: Full fetch complete (56693 records). [2025-10-15T19:05:41.546774] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-15T19:05:41.718276] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-15T19:05:41.996871] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-15T19:05:41.997555] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-15T19:05:41.998446] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-15T19:05:41.999375] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T19:05:42.004355] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-15T19:05:42.007502] [DEBUG] [LOCAL ] GBTG: Trimmed 56693 records to 40255 (keeping 200 days of data) [2025-10-15T19:05:42.180137] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T19:05:42.242034] [DEBUG] [LOCAL ] GBTG: Primary data saved (40255 records). [2025-10-15T19:05:42.242163] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-15T19:05:42.242240] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBTG took 28.2s. Estimated remaining: 3h 26m 10s. Rate: 7.1 symbols/min [2025-10-15T19:05:42.418053] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:42.418211] [DEBUG] [LOCAL ] GCO: No existing data file found in primary storage. [2025-10-15T19:05:42.418250] [WARN ] [MAIN ] GCO: No existing data found, performing full refresh instead. [2025-10-15T19:05:42.418397] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-15T19:05:42.418446] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-15T19:05:42.418490] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-15T19:05:42.418522] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-15T19:05:42.519179] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-15T19:05:42.779093] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:43.314006] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-15T19:05:43.797417] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:05:44.113985] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-15T19:05:44.884704] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T19:05:44.914042] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-15T19:05:45.308347] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T19:05:45.714040] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-15T19:05:46.275545] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T19:05:46.279854] [INFO ] [REMOTE ] GBX: Full fetch complete (42855 records). [2025-10-15T19:05:46.280025] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-15T19:05:46.519231] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-15T19:05:46.667705] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-15T19:05:46.667797] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-15T19:05:46.668526] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-15T19:05:46.668567] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-15T19:05:46.669448] [DEBUG] [LOCAL ] GBX: Trimmed 42855 records to 28929 (keeping 200 days of data) [2025-10-15T19:05:46.841068] [DEBUG] [LOCAL ] GBX: Primary data saved (28929 records). [2025-10-15T19:05:46.841204] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-15T19:05:46.841287] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBX took 31.3s. Estimated remaining: 3h 25m 55s. Rate: 7.1 symbols/min [2025-10-15T19:05:47.007747] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:47.028711] [DEBUG] [LOCAL ] GCTS: Loaded 20462 existing records from primary storage. [2025-10-15T19:05:47.029036] [INFO ] [MAIN ] GCTS: Loaded 20462 existing records. [2025-10-15T19:05:47.206053] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:47.206396] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-15T19:05:47.206638] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-15T19:05:47.206967] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-15T19:05:47.207030] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-15T19:05:47.315688] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-15T19:05:47.399324] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T19:05:47.608072] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:47.647192] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:05:47.848150] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-15T19:05:48.113998] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-15T19:05:48.914005] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-15T19:05:49.552764] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:05:49.713991] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-15T19:05:49.889093] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:05:50.514061] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-15T19:05:51.060381] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:05:51.254076] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:05:51.314006] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-15T19:05:52.114078] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-15T19:05:52.478329] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-15T19:05:52.873256] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:05:52.879836] [INFO ] [REMOTE ] GCI: Full fetch complete (63375 records). [2025-10-15T19:05:52.880090] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-15T19:05:52.919242] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-15T19:05:53.259961] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-15T19:05:53.260046] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-15T19:05:53.260822] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-15T19:05:53.260886] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-15T19:05:53.262109] [DEBUG] [LOCAL ] GCI: Trimmed 63375 records to 43878 (keeping 200 days of data) [2025-10-15T19:05:53.354539] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T19:05:53.355887] [INFO ] [REMOTE ] GBLI: Full fetch complete (1280 records). [2025-10-15T19:05:53.355974] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-15T19:05:53.542347] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-15T19:05:53.545638] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:05:53.547875] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:05:53.547974] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-15T19:05:53.551908] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-15T19:05:53.552463] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-15T19:05:53.556414] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-15T19:05:53.556499] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GBLI took 40.6s. Estimated remaining: 3h 25m 44s. Rate: 7.1 symbols/min [2025-10-15T19:05:53.714702] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-15T19:05:53.825546] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:53.844372] [DEBUG] [LOCAL ] GCV: Loaded 7738 existing records from primary storage. [2025-10-15T19:05:53.845369] [INFO ] [MAIN ] GCV: Loaded 7738 existing records. [2025-10-15T19:05:54.052571] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:54.058280] [DEBUG] [LOCAL ] GCI: Primary data saved (43878 records). [2025-10-15T19:05:54.058425] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-15T19:05:54.058554] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-15T19:05:54.058724] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GCI took 36.7s. Estimated remaining: 3h 25m 23s. Rate: 7.2 symbols/min [2025-10-15T19:05:54.058614] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-15T19:05:54.089513] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-15T19:05:54.125957] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-15T19:05:54.364833] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:54.524829] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-15T19:05:54.664397] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:54.682380] [DEBUG] [LOCAL ] GD: Loaded 46751 existing records from primary storage. [2025-10-15T19:05:54.682785] [INFO ] [MAIN ] GD: Loaded 46751 existing records. [2025-10-15T19:05:54.789676] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:05:54.894770] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:54.894981] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-15T19:05:54.895030] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-15T19:05:54.896038] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-15T19:05:54.896097] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-15T19:05:55.235427] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:55.313958] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-15T19:05:55.910185] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:05:56.113990] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-15T19:05:56.914000] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-15T19:05:57.156242] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:05:57.221574] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T19:05:57.714036] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-15T19:05:58.042721] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T19:05:58.514046] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-15T19:05:58.668338] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:05:59.314047] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-15T19:05:59.649738] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T19:06:00.114053] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-15T19:06:00.412555] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T19:06:00.914076] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-15T19:06:01.453226] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T19:06:01.714086] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-15T19:06:02.514065] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-15T19:06:03.117900] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-15T19:06:03.314005] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-15T19:06:03.798260] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T19:06:04.114033] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-15T19:06:04.650868] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T19:06:04.732713] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-15T19:06:04.790779] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:06:04.914003] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-15T19:06:05.713984] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-15T19:06:06.034119] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T19:06:06.514006] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-15T19:06:07.287790] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:06:07.314056] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-15T19:06:07.328385] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:06:07.893258] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T19:06:08.114045] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-15T19:06:08.914087] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-15T19:06:09.456193] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T19:06:09.714005] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-15T19:06:09.882295] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:06:10.514044] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-15T19:06:10.869600] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T19:06:11.098239] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T19:06:11.313994] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-15T19:06:12.113994] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-15T19:06:12.432879] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T19:06:12.913992] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-15T19:06:13.185237] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T19:06:13.713993] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-15T19:06:14.513983] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-15T19:06:14.799024] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:06:14.849191] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:06:14.852282] [INFO ] [REMOTE ] GCTS: Full fetch complete (26984 records). [2025-10-15T19:06:14.852402] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-15T19:06:15.213886] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-15T19:06:15.213960] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-15T19:06:15.214480] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-15T19:06:15.214521] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-15T19:06:15.215182] [DEBUG] [LOCAL ] GCTS: Trimmed 26984 records to 20465 (keeping 200 days of data) [2025-10-15T19:06:15.315922] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-15T19:06:15.330945] [DEBUG] [LOCAL ] GCTS: Primary data saved (20465 records). [2025-10-15T19:06:15.331146] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-15T19:06:15.331359] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 28.5s. Estimated remaining: 3h 25m 35s. Rate: 7.1 symbols/min [2025-10-15T19:06:15.427573] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T19:06:15.456570] [INFO ] [REMOTE ] GCO: Full fetch complete (35142 records). [2025-10-15T19:06:15.467016] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-15T19:06:15.619317] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:15.922528] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-15T19:06:15.922680] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-15T19:06:15.923434] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-15T19:06:15.923540] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-15T19:06:15.924254] [DEBUG] [LOCAL ] GDDY: Loaded 49797 existing records from primary storage. [2025-10-15T19:06:15.924934] [INFO ] [MAIN ] GDDY: Loaded 49797 existing records. [2025-10-15T19:06:16.004086] [DEBUG] [LOCAL ] GCO: Trimmed 35142 records to 23651 (keeping 200 days of data) [2025-10-15T19:06:16.136542] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-15T19:06:16.197908] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:16.202258] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-15T19:06:16.202898] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-15T19:06:16.205752] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-15T19:06:16.208245] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-15T19:06:16.593348] [DEBUG] [LOCAL ] GCO: Primary data saved (23651 records). [2025-10-15T19:06:16.595571] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-15T19:06:16.614910] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:16.615026] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCO took 34.4s. Estimated remaining: 3h 25m 15s. Rate: 7.1 symbols/min [2025-10-15T19:06:16.783306] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:16.789361] [DEBUG] [LOCAL ] GDIV: Loaded 3599 existing records from primary storage. [2025-10-15T19:06:16.789532] [INFO ] [MAIN ] GDIV: Loaded 3599 existing records. [2025-10-15T19:06:16.914244] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-15T19:06:16.968378] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:16.968955] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-15T19:06:16.975073] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-15T19:06:16.975890] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T19:06:16.976867] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-15T19:06:16.978806] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-15T19:06:17.360605] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T19:06:17.359366] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:17.713994] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-15T19:06:18.188221] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T19:06:18.327756] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:06:18.513954] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-15T19:06:19.314066] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-15T19:06:19.893454] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T19:06:20.113958] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-15T19:06:20.259373] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:06:20.681045] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T19:06:20.914004] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-15T19:06:21.714030] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-15T19:06:22.329821] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T19:06:22.509202] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:06:22.518152] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-15T19:06:23.313994] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-15T19:06:24.062748] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T19:06:24.113958] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-15T19:06:24.914014] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-15T19:06:25.209810] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:06:25.417177] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T19:06:25.714010] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-15T19:06:25.861801] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:06:26.180746] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:06:26.514004] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-15T19:06:27.313997] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-15T19:06:27.775598] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-15T19:06:28.058344] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:06:28.113999] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-15T19:06:28.914053] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-15T19:06:29.558082] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:06:29.637785] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T19:06:29.714041] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-15T19:06:30.514047] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-15T19:06:31.313997] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-15T19:06:31.413922] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:06:31.778557] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T19:06:32.114001] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-15T19:06:32.152397] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:06:32.154177] [INFO ] [REMOTE ] GCV: Full fetch complete (9823 records). [2025-10-15T19:06:32.154244] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-15T19:06:32.512480] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-15T19:06:32.512591] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-15T19:06:32.512863] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-15T19:06:32.512923] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-15T19:06:32.513335] [DEBUG] [LOCAL ] GCV: Trimmed 9823 records to 7804 (keeping 200 days of data) [2025-10-15T19:06:32.557553] [DEBUG] [LOCAL ] GCV: Primary data saved (7804 records). [2025-10-15T19:06:32.557895] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-15T19:06:32.558128] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCV took 39.0s. Estimated remaining: 3h 25m 19s. Rate: 7.1 symbols/min [2025-10-15T19:06:32.726792] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:32.730758] [DEBUG] [LOCAL ] GDL: Loaded 2513 existing records from primary storage. [2025-10-15T19:06:32.730920] [INFO ] [MAIN ] GDL: Loaded 2513 existing records. [2025-10-15T19:06:32.910442] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:32.910760] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-15T19:06:32.910819] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-15T19:06:32.911004] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-15T19:06:32.911061] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-15T19:06:32.922140] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-15T19:06:33.267770] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:33.405474] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T19:06:33.531694] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T19:06:33.713973] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-15T19:06:34.514062] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-15T19:06:35.060354] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:06:35.120567] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T19:06:35.314073] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-15T19:06:36.114048] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-15T19:06:36.722821] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T19:06:36.913969] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-15T19:06:36.963302] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:06:36.968609] [INFO ] [REMOTE ] GD: Full fetch complete (69848 records). [2025-10-15T19:06:36.968740] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-15T19:06:37.352070] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-15T19:06:37.352146] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-15T19:06:37.353054] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-15T19:06:37.353234] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-15T19:06:37.354605] [DEBUG] [LOCAL ] GD: Trimmed 69848 records to 46735 (keeping 200 days of data) [2025-10-15T19:06:37.572719] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T19:06:37.651286] [DEBUG] [LOCAL ] GD: Primary data saved (46735 records). [2025-10-15T19:06:37.651413] [INFO ] [MAIN ] GD: Full history saved. [2025-10-15T19:06:37.651490] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GD took 43.6s. Estimated remaining: 3h 25m 5s. Rate: 7.1 symbols/min [2025-10-15T19:06:37.719097] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-15T19:06:37.821906] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:37.828840] [DEBUG] [LOCAL ] GDO: Loaded 5877 existing records from primary storage. [2025-10-15T19:06:37.829012] [INFO ] [MAIN ] GDO: Loaded 5877 existing records. [2025-10-15T19:06:38.003629] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:38.003890] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-15T19:06:38.003938] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-15T19:06:38.004171] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-15T19:06:38.004226] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-15T19:06:38.372598] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:38.513962] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-15T19:06:39.249519] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:06:39.314018] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-15T19:06:39.544931] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:06:39.857368] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T19:06:40.113998] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-15T19:06:40.914082] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-15T19:06:41.366361] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:06:41.586967] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T19:06:41.713991] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-15T19:06:42.514061] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-15T19:06:43.056318] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T19:06:43.314063] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-15T19:06:43.526194] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T19:06:43.538553] [INFO ] [REMOTE ] GDDY: Full fetch complete (72073 records). [2025-10-15T19:06:43.538981] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-15T19:06:43.977190] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T19:06:44.138104] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-15T19:06:44.164118] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-15T19:06:44.164216] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-15T19:06:44.165211] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-15T19:06:44.165378] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-15T19:06:44.166897] [DEBUG] [LOCAL ] GDDY: Trimmed 72073 records to 49776 (keeping 200 days of data) [2025-10-15T19:06:44.481966] [DEBUG] [LOCAL ] GDDY: Primary data saved (49776 records). [2025-10-15T19:06:44.482114] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-15T19:06:44.482200] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GDDY took 29.2s. Estimated remaining: 3h 24m 54s. Rate: 7.1 symbols/min [2025-10-15T19:06:44.667285] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:44.689750] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T19:06:44.706088] [DEBUG] [LOCAL ] GDOT: Loaded 37743 existing records from primary storage. [2025-10-15T19:06:44.706409] [INFO ] [MAIN ] GDOT: Loaded 37743 existing records. [2025-10-15T19:06:44.894113] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:44.894353] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-15T19:06:44.894404] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-15T19:06:44.895099] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-15T19:06:44.895161] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-15T19:06:44.919116] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-15T19:06:45.267413] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:45.714014] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-15T19:06:45.734025] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T19:06:46.235554] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:06:46.236484] [INFO ] [REMOTE ] GDIV: Full fetch complete (5432 records). [2025-10-15T19:06:46.236571] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-15T19:06:46.519249] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-15T19:06:46.598886] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-15T19:06:46.598957] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-15T19:06:46.599115] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-15T19:06:46.599152] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-15T19:06:46.599515] [DEBUG] [LOCAL ] GDIV: Trimmed 5432 records to 3598 (keeping 200 days of data) [2025-10-15T19:06:46.621252] [DEBUG] [LOCAL ] GDIV: Primary data saved (3598 records). [2025-10-15T19:06:46.621326] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-15T19:06:46.621395] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDIV took 30.0s. Estimated remaining: 3h 24m 36s. Rate: 7.2 symbols/min [2025-10-15T19:06:46.797476] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:46.816133] [DEBUG] [LOCAL ] GDV: Loaded 19583 existing records from primary storage. [2025-10-15T19:06:46.816377] [INFO ] [MAIN ] GDV: Loaded 19583 existing records. [2025-10-15T19:06:46.994522] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:46.994770] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-15T19:06:46.994820] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-15T19:06:46.995230] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-15T19:06:46.995286] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-15T19:06:47.319096] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-15T19:06:47.358369] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:47.721136] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T19:06:47.843862] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T19:06:48.114023] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-15T19:06:48.750998] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T19:06:48.914017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-15T19:06:49.506717] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T19:06:49.714022] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-15T19:06:50.470924] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T19:06:50.513979] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-15T19:06:51.314009] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-15T19:06:51.544541] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T19:06:51.885561] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T19:06:52.114067] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-15T19:06:52.724325] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T19:06:52.914059] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-15T19:06:53.210011] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-15T19:06:53.714007] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-15T19:06:54.513991] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-15T19:06:54.672412] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:06:55.073348] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T19:06:55.314009] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-15T19:06:56.114027] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-15T19:06:56.313208] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T19:06:56.574455] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T19:06:56.914007] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-15T19:06:57.714027] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-15T19:06:57.986918] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T19:06:58.513967] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-15T19:06:58.989213] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T19:06:59.110301] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T19:06:59.314003] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-15T19:06:59.737447] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T19:07:00.114054] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-15T19:07:00.667998] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T19:07:00.913963] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-15T19:07:01.713989] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-15T19:07:02.146540] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:07:02.156274] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:07:02.514032] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-15T19:07:03.313972] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-15T19:07:03.455933] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T19:07:04.114042] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-15T19:07:04.653471] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T19:07:04.857361] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:07:04.913995] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-15T19:07:05.714065] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-15T19:07:06.182468] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T19:07:06.439707] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:07:06.513992] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-15T19:07:07.313990] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-15T19:07:07.873388] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T19:07:07.874667] [INFO ] [REMOTE ] GDO: Full fetch complete (8606 records). [2025-10-15T19:07:07.874752] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-15T19:07:08.122977] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-15T19:07:08.153151] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:07:08.301809] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-15T19:07:08.301884] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-15T19:07:08.302088] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-15T19:07:08.302126] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-15T19:07:08.302512] [DEBUG] [LOCAL ] GDO: Trimmed 8606 records to 5849 (keeping 200 days of data) [2025-10-15T19:07:08.337514] [DEBUG] [LOCAL ] GDO: Primary data saved (5849 records). [2025-10-15T19:07:08.337667] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-15T19:07:08.337788] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 30.7s. Estimated remaining: 3h 24m 49s. Rate: 7.1 symbols/min [2025-10-15T19:07:08.500754] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:08.549824] [DEBUG] [LOCAL ] GE: Loaded 53701 existing records from primary storage. [2025-10-15T19:07:08.550141] [INFO ] [MAIN ] GE: Loaded 53701 existing records. [2025-10-15T19:07:08.724824] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:08.725026] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-15T19:07:08.725075] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-15T19:07:08.726230] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-15T19:07:08.726289] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-15T19:07:08.920138] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-15T19:07:09.079841] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:09.173494] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T19:07:09.713997] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-15T19:07:10.369705] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:07:10.513989] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-15T19:07:10.770037] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:07:10.966217] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:07:11.313986] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-15T19:07:12.114006] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-15T19:07:12.619309] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T19:07:12.662550] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:07:12.914018] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-15T19:07:13.714053] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-15T19:07:14.292478] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:07:14.326984] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:07:14.328074] [INFO ] [REMOTE ] GDL: Full fetch complete (3489 records). [2025-10-15T19:07:14.328151] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-15T19:07:14.521934] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-15T19:07:14.725539] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-15T19:07:14.725690] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-15T19:07:14.725879] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-15T19:07:14.725924] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-15T19:07:14.726370] [DEBUG] [LOCAL ] GDL: Trimmed 3489 records to 2523 (keeping 200 days of data) [2025-10-15T19:07:14.742457] [DEBUG] [LOCAL ] GDL: Primary data saved (2523 records). [2025-10-15T19:07:14.742590] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-15T19:07:14.742711] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDL took 42.2s. Estimated remaining: 3h 24m 37s. Rate: 7.1 symbols/min [2025-10-15T19:07:14.927867] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:14.952097] [DEBUG] [LOCAL ] GEF: Loaded 20792 existing records from primary storage. [2025-10-15T19:07:14.952421] [INFO ] [MAIN ] GEF: Loaded 20792 existing records. [2025-10-15T19:07:15.134845] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:15.135260] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-15T19:07:15.135326] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-15T19:07:15.135949] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-15T19:07:15.136013] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-15T19:07:15.314728] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-15T19:07:15.503442] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:16.113982] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-15T19:07:16.223821] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T19:07:16.919121] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-15T19:07:16.950483] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-15T19:07:17.214798] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:07:17.713975] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-15T19:07:18.013021] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:07:18.514036] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-15T19:07:18.551735] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T19:07:19.314068] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-15T19:07:19.682144] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T19:07:19.687012] [INFO ] [REMOTE ] GDOT: Full fetch complete (53450 records). [2025-10-15T19:07:19.687109] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-15T19:07:20.056728] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-15T19:07:20.056842] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-15T19:07:20.057628] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-15T19:07:20.057720] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-15T19:07:20.058806] [DEBUG] [LOCAL ] GDOT: Trimmed 53450 records to 37755 (keeping 200 days of data) [2025-10-15T19:07:20.139763] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-15T19:07:20.274717] [DEBUG] [LOCAL ] GDOT: Primary data saved (37755 records). [2025-10-15T19:07:20.274863] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-15T19:07:20.274946] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDOT took 35.8s. Estimated remaining: 3h 24m 24s. Rate: 7.1 symbols/min [2025-10-15T19:07:20.448342] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:20.449318] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:07:20.452568] [INFO ] [REMOTE ] GDV: Full fetch complete (28494 records). [2025-10-15T19:07:20.452663] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-15T19:07:20.679372] [DEBUG] [LOCAL ] GEL: Loaded 31852 existing records from primary storage. [2025-10-15T19:07:20.716101] [INFO ] [MAIN ] GEL: Loaded 31852 existing records. [2025-10-15T19:07:20.917990] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-15T19:07:21.088490] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:21.089084] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-15T19:07:21.089383] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-15T19:07:21.089244] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-15T19:07:21.089619] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-15T19:07:21.090680] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-15T19:07:21.090606] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-15T19:07:21.090974] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-15T19:07:21.090901] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-15T19:07:21.171828] [DEBUG] [LOCAL ] GDV: Trimmed 28494 records to 19531 (keeping 200 days of data) [2025-10-15T19:07:21.456321] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T19:07:21.502196] [DEBUG] [LOCAL ] GDV: Primary data saved (19531 records). [2025-10-15T19:07:21.515357] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-15T19:07:21.526533] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDV took 34.9s. Estimated remaining: 3h 24m 4s. Rate: 7.1 symbols/min [2025-10-15T19:07:21.744012] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:21.714252] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-15T19:07:21.797311] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:21.847290] [DEBUG] [LOCAL ] GENI: Loaded 52934 existing records from primary storage. [2025-10-15T19:07:21.847602] [INFO ] [MAIN ] GENI: Loaded 52934 existing records. [2025-10-15T19:07:22.025949] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:22.026114] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-15T19:07:22.026162] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-15T19:07:22.027035] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-15T19:07:22.027098] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-15T19:07:22.390255] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:22.514041] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-15T19:07:22.679789] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T19:07:23.170618] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-15T19:07:23.314006] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-15T19:07:23.478125] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T19:07:24.114009] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-15T19:07:24.914008] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-15T19:07:24.976262] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T19:07:25.041764] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T19:07:25.714037] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-15T19:07:26.520076] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-15T19:07:26.532579] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T19:07:27.004578] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:07:27.314062] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-15T19:07:28.113981] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-15T19:07:28.250963] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T19:07:28.914077] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-15T19:07:29.321831] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T19:07:29.356830] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:07:29.714044] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-15T19:07:30.085397] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T19:07:30.514037] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-15T19:07:31.314060] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-15T19:07:31.818578] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-15T19:07:31.867267] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T19:07:32.114024] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-15T19:07:32.914007] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-15T19:07:33.106255] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:07:33.714137] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-15T19:07:34.086676] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T19:07:34.415785] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-15T19:07:34.514048] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-15T19:07:35.055842] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T19:07:35.314048] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-15T19:07:36.114174] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-15T19:07:36.590366] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T19:07:36.712761] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-15T19:07:36.914027] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-15T19:07:37.713986] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-15T19:07:37.978877] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T19:07:38.514062] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-15T19:07:38.729521] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:07:38.764820] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T19:07:39.314065] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-15T19:07:39.926151] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:07:40.114011] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-15T19:07:40.914034] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-15T19:07:40.981208] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T19:07:41.539299] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T19:07:41.713989] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-15T19:07:42.514008] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-15T19:07:42.747003] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:07:43.314014] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-15T19:07:43.444122] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:07:43.891924] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T19:07:44.114004] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-15T19:07:44.914057] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-15T19:07:44.989865] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:07:45.454006] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T19:07:45.720139] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-15T19:07:45.724869] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:07:45.731781] [INFO ] [REMOTE ] GE: Full fetch complete (77862 records). [2025-10-15T19:07:45.731911] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-15T19:07:46.116452] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-15T19:07:46.116558] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-15T19:07:46.117658] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-15T19:07:46.117769] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-15T19:07:46.119460] [DEBUG] [LOCAL ] GE: Trimmed 77862 records to 53699 (keeping 200 days of data) [2025-10-15T19:07:46.453672] [DEBUG] [LOCAL ] GE: Primary data saved (53699 records). [2025-10-15T19:07:46.453816] [INFO ] [MAIN ] GE: Full history saved. [2025-10-15T19:07:46.453948] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GE took 38.1s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-15T19:07:46.519193] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-15T19:07:46.621929] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:46.667621] [DEBUG] [LOCAL ] GEO: Loaded 51866 existing records from primary storage. [2025-10-15T19:07:46.667968] [INFO ] [MAIN ] GEO: Loaded 51866 existing records. [2025-10-15T19:07:46.846052] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T19:07:46.858943] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:46.863755] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-15T19:07:46.864232] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-15T19:07:46.865169] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-15T19:07:46.865230] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-15T19:07:47.211484] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:47.313947] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-15T19:07:47.714834] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:07:48.114054] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-15T19:07:48.913971] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-15T19:07:49.024003] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T19:07:49.027373] [INFO ] [REMOTE ] GEL: Full fetch complete (48191 records). [2025-10-15T19:07:49.027458] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-15T19:07:49.244700] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T19:07:49.454542] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-15T19:07:49.454625] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-15T19:07:49.455382] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-15T19:07:49.455433] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-15T19:07:49.456411] [DEBUG] [LOCAL ] GEL: Trimmed 48191 records to 31836 (keeping 200 days of data) [2025-10-15T19:07:49.646417] [DEBUG] [LOCAL ] GEL: Primary data saved (31836 records). [2025-10-15T19:07:49.646619] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-15T19:07:49.646901] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GEL took 29.4s. Estimated remaining: 3h 24m 6s. Rate: 7.1 symbols/min [2025-10-15T19:07:49.716885] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-15T19:07:49.792277] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:07:49.843414] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:49.885183] [DEBUG] [LOCAL ] GES: Loaded 38327 existing records from primary storage. [2025-10-15T19:07:49.885497] [INFO ] [MAIN ] GES: Loaded 38327 existing records. [2025-10-15T19:07:50.068953] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:50.069189] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-15T19:07:50.069237] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-15T19:07:50.069891] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-15T19:07:50.069948] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-15T19:07:50.418008] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:50.514030] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-15T19:07:51.314066] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-15T19:07:51.691125] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T19:07:52.096133] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:07:52.113960] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-15T19:07:52.800354] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T19:07:52.913987] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-15T19:07:53.227681] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:07:53.713995] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-15T19:07:54.514008] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-15T19:07:54.607890] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T19:07:54.614182] [INFO ] [REMOTE ] GENI: Full fetch complete (75948 records). [2025-10-15T19:07:54.614296] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-15T19:07:54.995724] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-15T19:07:54.995841] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-15T19:07:54.996980] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-15T19:07:54.997103] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-15T19:07:54.998635] [DEBUG] [LOCAL ] GENI: Trimmed 75948 records to 52942 (keeping 200 days of data) [2025-10-15T19:07:55.230892] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:07:55.324857] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-15T19:07:55.347529] [DEBUG] [LOCAL ] GENI: Primary data saved (52942 records). [2025-10-15T19:07:55.347616] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-15T19:07:55.347734] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GENI took 33.8s. Estimated remaining: 3h 23m 53s. Rate: 7.1 symbols/min [2025-10-15T19:07:55.515220] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:55.547040] [DEBUG] [LOCAL ] GETY: Loaded 35043 existing records from primary storage. [2025-10-15T19:07:55.547401] [INFO ] [MAIN ] GETY: Loaded 35043 existing records. [2025-10-15T19:07:55.766814] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:55.768296] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:07:55.773514] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-15T19:07:55.774410] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-15T19:07:55.775080] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-15T19:07:55.775140] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-15T19:07:56.119446] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-15T19:07:56.125004] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:56.914031] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-15T19:07:57.026921] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:07:57.049583] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T19:07:57.714049] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-15T19:07:58.043765] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:07:58.513987] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-15T19:07:59.209468] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:07:59.314057] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-15T19:08:00.114016] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-15T19:08:00.300025] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:08:00.437018] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T19:08:00.914019] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-15T19:08:01.714081] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-15T19:08:01.870784] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:08:01.997384] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:08:02.000414] [INFO ] [REMOTE ] GEF: Full fetch complete (29357 records). [2025-10-15T19:08:02.000508] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-15T19:08:02.362313] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-15T19:08:02.362400] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-15T19:08:02.363005] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-15T19:08:02.363066] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-15T19:08:02.363845] [DEBUG] [LOCAL ] GEF: Trimmed 29357 records to 20790 (keeping 200 days of data) [2025-10-15T19:08:02.488257] [DEBUG] [LOCAL ] GEF: Primary data saved (20790 records). [2025-10-15T19:08:02.488384] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-15T19:08:02.488468] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEF took 47.7s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-15T19:08:02.519141] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-15T19:08:02.700687] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:02.752557] [DEBUG] [LOCAL ] GEV: Loaded 52998 existing records from primary storage. [2025-10-15T19:08:02.752939] [INFO ] [MAIN ] GEV: Loaded 52998 existing records. [2025-10-15T19:08:02.934142] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:02.934367] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-15T19:08:02.934420] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-15T19:08:02.935092] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-15T19:08:02.935150] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-15T19:08:03.293019] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:03.313955] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-15T19:08:03.551145] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:08:04.113989] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-15T19:08:04.482867] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T19:08:04.914011] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-15T19:08:05.403601] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-15T19:08:05.714026] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-15T19:08:05.862450] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:08:06.271625] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:08:06.514017] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-15T19:08:07.314057] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-15T19:08:08.038028] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-15T19:08:08.106743] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:08:08.115054] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-15T19:08:08.913969] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-15T19:08:09.089097] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:08:09.622064] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:08:09.713962] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-15T19:08:10.513970] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-15T19:08:10.969555] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T19:08:11.040367] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:08:11.313992] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-15T19:08:12.113972] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-15T19:08:12.276451] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T19:08:12.578176] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T19:08:12.913996] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-15T19:08:13.714051] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-15T19:08:14.027460] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T19:08:14.513978] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-15T19:08:14.677188] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T19:08:15.270622] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:08:15.313960] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-15T19:08:15.745562] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T19:08:16.114016] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-15T19:08:16.741262] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T19:08:16.913972] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-15T19:08:17.552053] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:08:17.558090] [INFO ] [REMOTE ] GEO: Full fetch complete (75575 records). [2025-10-15T19:08:17.558197] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-15T19:08:17.726533] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-15T19:08:17.949804] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-15T19:08:17.949905] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-15T19:08:17.950860] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-15T19:08:17.950921] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-15T19:08:17.952340] [DEBUG] [LOCAL ] GEO: Trimmed 75575 records to 51820 (keeping 200 days of data) [2025-10-15T19:08:18.245052] [DEBUG] [LOCAL ] GEO: Primary data saved (51820 records). [2025-10-15T19:08:18.245175] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-15T19:08:18.245251] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GEO took 31.8s. Estimated remaining: 3h 23m 46s. Rate: 7.1 symbols/min [2025-10-15T19:08:18.408734] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:18.412802] [DEBUG] [LOCAL ] GF: Loaded 2706 existing records from primary storage. [2025-10-15T19:08:18.412958] [INFO ] [MAIN ] GF: Loaded 2706 existing records. [2025-10-15T19:08:18.521062] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-15T19:08:18.591444] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:18.591606] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-15T19:08:18.591687] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-15T19:08:18.591900] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-15T19:08:18.591956] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-15T19:08:18.935293] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:19.157368] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T19:08:19.287546] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-15T19:08:19.313953] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-15T19:08:19.923950] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T19:08:20.114059] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-15T19:08:20.694922] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T19:08:20.914031] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-15T19:08:21.122530] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:08:21.714052] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-15T19:08:22.241342] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:08:22.245486] [INFO ] [REMOTE ] GES: Full fetch complete (58767 records). [2025-10-15T19:08:22.245575] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-15T19:08:22.522311] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-15T19:08:22.638621] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-15T19:08:22.638725] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-15T19:08:22.639541] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-15T19:08:22.639582] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-15T19:08:22.640697] [DEBUG] [LOCAL ] GES: Trimmed 58767 records to 38288 (keeping 200 days of data) [2025-10-15T19:08:22.866721] [DEBUG] [LOCAL ] GES: Primary data saved (38288 records). [2025-10-15T19:08:22.866851] [INFO ] [MAIN ] GES: Full history saved. [2025-10-15T19:08:22.866930] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GES took 33.2s. Estimated remaining: 3h 23m 31s. Rate: 7.1 symbols/min [2025-10-15T19:08:23.037403] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:23.060108] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T19:08:23.072614] [DEBUG] [LOCAL ] GFF: Loaded 30024 existing records from primary storage. [2025-10-15T19:08:23.072892] [INFO ] [MAIN ] GFF: Loaded 30024 existing records. [2025-10-15T19:08:23.245064] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:23.245321] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-15T19:08:23.245379] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-15T19:08:23.245616] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-15T19:08:23.245717] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-15T19:08:23.319228] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-15T19:08:23.599709] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:23.947791] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-15T19:08:24.114000] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-15T19:08:24.913986] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-15T19:08:24.916669] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:08:25.714032] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-15T19:08:26.126941] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:08:26.127550] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T19:08:26.402168] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T19:08:26.513958] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-15T19:08:27.314027] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-15T19:08:28.114044] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-15T19:08:28.491939] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T19:08:28.531755] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T19:08:28.914059] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-15T19:08:29.147080] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T19:08:29.608685] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:08:29.714017] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-15T19:08:30.513985] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-15T19:08:31.061388] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T19:08:31.314046] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-15T19:08:31.870615] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-15T19:08:32.114012] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-15T19:08:32.654272] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:08:32.914035] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-15T19:08:33.714042] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-15T19:08:34.332625] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:08:34.513970] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-15T19:08:34.552986] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-15T19:08:34.559619] [INFO ] [REMOTE ] GEV: Full fetch complete (77013 records). [2025-10-15T19:08:34.559759] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-15T19:08:34.983222] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-15T19:08:34.983409] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-15T19:08:34.984570] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-15T19:08:34.984697] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-15T19:08:34.986255] [DEBUG] [LOCAL ] GEV: Trimmed 77013 records to 53000 (keeping 200 days of data) [2025-10-15T19:08:35.139018] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:08:35.137917] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T19:08:35.315986] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-15T19:08:35.358306] [DEBUG] [LOCAL ] GEV: Primary data saved (53000 records). [2025-10-15T19:08:35.358430] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-15T19:08:35.358784] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GEV took 32.9s. Estimated remaining: 3h 23m 30s. Rate: 7.1 symbols/min [2025-10-15T19:08:35.795896] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T19:08:36.114047] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-15T19:08:36.555040] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T19:08:36.913995] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-15T19:08:37.385997] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:08:37.714057] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-15T19:08:38.066326] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T19:08:38.513999] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-15T19:08:38.969259] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T19:08:38.970071] [INFO ] [REMOTE ] GF: Full fetch complete (4985 records). [2025-10-15T19:08:38.970140] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-15T19:08:39.317186] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-15T19:08:39.317483] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-15T19:08:39.317809] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-15T19:08:39.318685] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-15T19:08:39.318754] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-15T19:08:39.319160] [DEBUG] [LOCAL ] GF: Trimmed 4985 records to 2697 (keeping 200 days of data) [2025-10-15T19:08:39.337173] [DEBUG] [LOCAL ] GF: Primary data saved (2697 records). [2025-10-15T19:08:39.337372] [INFO ] [MAIN ] GF: Full history saved. [2025-10-15T19:08:39.337460] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GF took 21.1s. Estimated remaining: 3h 23m 14s. Rate: 7.1 symbols/min [2025-10-15T19:08:40.114049] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-15T19:08:40.846936] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:08:40.913954] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-15T19:08:41.411223] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:08:41.713970] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-15T19:08:41.898006] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T19:08:42.514067] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-15T19:08:42.677841] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T19:08:42.682838] [INFO ] [REMOTE ] GETY: Full fetch complete (55501 records). [2025-10-15T19:08:42.683010] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-15T19:08:43.119422] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-15T19:08:43.119509] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-15T19:08:43.120555] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-15T19:08:43.120631] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-15T19:08:43.122005] [DEBUG] [LOCAL ] GETY: Trimmed 55501 records to 34990 (keeping 200 days of data) [2025-10-15T19:08:43.334537] [DEBUG] [LOCAL ] GETY: Primary data saved (34990 records). [2025-10-15T19:08:43.334712] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-15T19:08:43.334833] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GETY took 48.0s. Estimated remaining: 3h 22m 59s. Rate: 7.1 symbols/min [2025-10-15T19:08:43.701823] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T19:08:43.708782] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-15T19:08:44.703465] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T19:08:44.714770] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-15T19:08:46.031919] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:08:46.039979] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-15T19:08:47.177452] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:08:47.183563] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-15T19:08:48.424365] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:08:48.427830] [INFO ] [REMOTE ] GFF: Full fetch complete (44092 records). [2025-10-15T19:08:48.427929] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-15T19:08:48.795928] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-15T19:08:48.796011] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-15T19:08:48.796772] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-15T19:08:48.796835] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-15T19:08:48.797930] [DEBUG] [LOCAL ] GFF: Trimmed 44092 records to 30002 (keeping 200 days of data) [2025-10-15T19:08:48.980383] [DEBUG] [LOCAL ] GFF: Primary data saved (30002 records). [2025-10-15T19:08:48.980528] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-15T19:08:48.980628] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFF took 26.1s. Estimated remaining: 3h 22m 46s. Rate: 7.1 symbols/min [2025-10-15T19:08:49.506207] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.602349] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.683264] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.661402] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.691563] [DEBUG] [LOCAL ] GFR: Loaded 7814 existing records from primary storage. [2025-10-15T19:08:49.691865] [INFO ] [MAIN ] GFR: Loaded 7814 existing records. [2025-10-15T19:08:49.887253] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:49.926385] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-15T19:08:49.926479] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-15T19:08:49.927202] [DEBUG] [LOCAL ] GFL: Loaded 47717 existing records from primary storage. [2025-10-15T19:08:49.927503] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-15T19:08:49.927720] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-15T19:08:49.927632] [INFO ] [MAIN ] GFL: Loaded 47717 existing records. [2025-10-15T19:08:50.072855] [DEBUG] [LOCAL ] GGB: Loaded 51393 existing records from primary storage. [2025-10-15T19:08:50.126960] [INFO ] [MAIN ] GGB: Loaded 51393 existing records. [2025-10-15T19:08:50.171226] [DEBUG] [LOCAL ] GFI: Loaded 53117 existing records from primary storage. [2025-10-15T19:08:50.252827] [INFO ] [MAIN ] GFI: Loaded 53117 existing records. [2025-10-15T19:08:50.529123] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:50.578724] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-15T19:08:50.621005] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-15T19:08:50.745023] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-15T19:08:50.768074] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-15T19:08:50.744942] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:50.786974] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-15T19:08:50.862773] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:50.895511] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-15T19:08:50.921960] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-15T19:08:50.955581] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-15T19:08:50.960901] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-15T19:08:51.015609] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-15T19:08:51.010360] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-15T19:08:51.038363] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.038717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-15T19:08:51.064480] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-15T19:08:51.771291] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.817206] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-15T19:08:51.910638] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.931896] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-15T19:08:51.992136] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.992581] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-15T19:08:52.025304] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:08:52.028727] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-15T19:08:52.607190] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T19:08:52.609610] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-15T19:08:52.850683] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:08:52.859470] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-15T19:08:53.272710] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T19:08:53.275217] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-15T19:08:53.484124] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:08:53.494526] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-15T19:08:53.646372] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:08:53.714031] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-15T19:08:54.007914] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T19:08:54.330332] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:08:54.514018] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-15T19:08:54.989051] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:08:55.314009] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-15T19:08:55.627879] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T19:08:55.917400] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T19:08:56.102169] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T19:08:56.113981] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-15T19:08:56.874630] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T19:08:56.913992] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-15T19:08:57.377388] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T19:08:57.714026] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-15T19:08:58.288742] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T19:08:58.514021] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-15T19:08:59.313997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-15T19:09:00.114072] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-15T19:09:00.249902] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:09:00.703180] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T19:09:00.771337] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:09:00.914044] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-15T19:09:01.713987] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-15T19:09:01.753738] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T19:09:02.513997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-15T19:09:03.314018] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-15T19:09:03.558242] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T19:09:04.113978] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-15T19:09:04.223372] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T19:09:04.223931] [DEBUG] [REMOTE ] GFR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-15T19:09:04.227826] [WARN ] [REMOTE ] GFR: No data returned for month 2025-10 [2025-10-15T19:09:04.233931] [FATAL] [REMOTE ] GFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:09:04.234280] [FATAL] [MAIN ] GFR: Failed to fetch primary data. [2025-10-15T19:09:04.234533] [WARN ] [MAIN ] GFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:09:04.234748] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-15T19:09:04.235128] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-10-15T19:09:04.235199] [INFO ] [LOCAL ] GFR: Starting deletion of derivative data. [2025-10-15T19:09:04.235446] [DEBUG] [LOCAL ] GFR: Deleted derivative data file. [2025-10-15T19:09:04.235542] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 15.3s. Estimated remaining: 3h 22m 48s. Rate: 7.1 symbols/min [2025-10-15T19:09:04.410393] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:04.447397] [DEBUG] [LOCAL ] GGG: Loaded 40713 existing records from primary storage. [2025-10-15T19:09:04.447744] [INFO ] [MAIN ] GGG: Loaded 40713 existing records. [2025-10-15T19:09:04.658584] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:04.658907] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-15T19:09:04.658959] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-15T19:09:04.659336] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-15T19:09:04.659392] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-15T19:09:04.918121] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-15T19:09:05.033134] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:05.066111] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:09:05.714030] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-15T19:09:06.514003] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-15T19:09:06.596742] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:09:07.313996] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-15T19:09:07.502422] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:09:07.866301] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:09:08.114021] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-15T19:09:08.862846] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:09:08.914019] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-15T19:09:09.636691] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:09:09.714017] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-15T19:09:10.514030] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-15T19:09:10.663002] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:09:11.314008] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-15T19:09:11.473025] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:09:11.679893] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T19:09:12.114026] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-15T19:09:12.913971] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-15T19:09:12.996203] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:09:13.714068] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-15T19:09:14.004142] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T19:09:14.043055] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:09:14.513997] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-15T19:09:15.104925] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:09:15.314048] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-15T19:09:15.852558] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T19:09:16.114005] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-15T19:09:16.913976] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-15T19:09:17.035164] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T19:09:17.714067] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-15T19:09:18.118953] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T19:09:18.379154] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:09:18.514044] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-15T19:09:19.106510] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T19:09:19.314059] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-15T19:09:20.114062] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-15T19:09:20.320507] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:09:20.914031] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-15T19:09:21.139117] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:09:21.237258] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T19:09:21.714062] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-15T19:09:22.331378] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:09:22.514008] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-15T19:09:23.314031] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-15T19:09:23.684282] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T19:09:24.078749] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:09:24.113969] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-15T19:09:24.518723] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:09:24.914010] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-15T19:09:25.674131] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:09:25.713991] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-15T19:09:26.405943] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T19:09:26.513975] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-15T19:09:27.313970] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-15T19:09:27.514158] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T19:09:27.520494] [INFO ] [REMOTE ] GGB: Full fetch complete (74329 records). [2025-10-15T19:09:27.520619] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-15T19:09:27.921393] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-15T19:09:27.921595] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-15T19:09:27.922829] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-15T19:09:27.932589] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-15T19:09:27.952491] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:09:27.961760] [DEBUG] [LOCAL ] GGB: Trimmed 74329 records to 51471 (keeping 200 days of data) [2025-10-15T19:09:28.126678] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-15T19:09:28.267608] [DEBUG] [LOCAL ] GGB: Primary data saved (51471 records). [2025-10-15T19:09:28.267794] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-15T19:09:28.267885] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGB took 39.3s. Estimated remaining: 3h 23m 5s. Rate: 7.1 symbols/min [2025-10-15T19:09:28.433397] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:28.448639] [DEBUG] [LOCAL ] GGT: Loaded 14418 existing records from primary storage. [2025-10-15T19:09:28.448927] [INFO ] [MAIN ] GGT: Loaded 14418 existing records. [2025-10-15T19:09:28.627167] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:28.627421] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-15T19:09:28.627519] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-15T19:09:28.627802] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-15T19:09:28.627859] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-15T19:09:28.916533] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-15T19:09:28.996591] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:29.012004] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T19:09:29.018586] [INFO ] [REMOTE ] GFL: Full fetch complete (69416 records). [2025-10-15T19:09:29.018785] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-15T19:09:29.435404] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-15T19:09:29.435733] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-15T19:09:29.438292] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:09:29.437162] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-15T19:09:29.438455] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-15T19:09:29.448066] [DEBUG] [LOCAL ] GFL: Trimmed 69416 records to 47671 (keeping 200 days of data) [2025-10-15T19:09:29.714808] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-15T19:09:29.743689] [DEBUG] [LOCAL ] GFL: Primary data saved (47671 records). [2025-10-15T19:09:29.743866] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-15T19:09:29.743976] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFL took 40.8s. Estimated remaining: 3h 22m 45s. Rate: 7.1 symbols/min [2025-10-15T19:09:29.908761] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:29.913781] [DEBUG] [LOCAL ] GGZ: Loaded 2407 existing records from primary storage. [2025-10-15T19:09:29.913943] [INFO ] [MAIN ] GGZ: Loaded 2407 existing records. [2025-10-15T19:09:30.084022] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:30.084223] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-15T19:09:30.084271] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-15T19:09:30.084431] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-15T19:09:30.084486] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-15T19:09:30.439066] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:30.514021] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-15T19:09:30.558721] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T19:09:30.658126] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T19:09:30.664507] [INFO ] [REMOTE ] GFI: Full fetch complete (76755 records). [2025-10-15T19:09:30.664628] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-15T19:09:30.966952] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T19:09:31.059042] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-15T19:09:31.059127] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-15T19:09:31.060208] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-15T19:09:31.060277] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-15T19:09:31.061772] [DEBUG] [LOCAL ] GFI: Trimmed 76755 records to 53116 (keeping 200 days of data) [2025-10-15T19:09:31.338278] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-15T19:09:31.385302] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-15T19:09:31.385452] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-15T19:09:31.385533] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GFI took 42.4s. Estimated remaining: 3h 22m 26s. Rate: 7.1 symbols/min [2025-10-15T19:09:31.549217] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:31.554613] [DEBUG] [LOCAL ] GHC: Loaded 2917 existing records from primary storage. [2025-10-15T19:09:31.554811] [INFO ] [MAIN ] GHC: Loaded 2917 existing records. [2025-10-15T19:09:31.753079] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:31.753324] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-15T19:09:31.753374] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-15T19:09:31.753610] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-15T19:09:31.753708] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-15T19:09:32.106683] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:32.113953] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-15T19:09:32.146144] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T19:09:32.411666] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-15T19:09:32.913961] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-15T19:09:33.431852] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T19:09:33.714023] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-15T19:09:34.514049] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-15T19:09:34.535518] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T19:09:35.212573] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T19:09:35.314016] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-15T19:09:35.904008] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T19:09:36.114004] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-15T19:09:36.913968] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-15T19:09:37.066318] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T19:09:37.428999] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T19:09:37.714061] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-15T19:09:38.514057] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-15T19:09:39.167766] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T19:09:39.180935] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:09:39.185804] [INFO ] [REMOTE ] GGG: Full fetch complete (59470 records). [2025-10-15T19:09:39.185899] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-15T19:09:39.325291] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-15T19:09:39.569757] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-15T19:09:39.569881] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-15T19:09:39.570798] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-15T19:09:39.570863] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-15T19:09:39.572159] [DEBUG] [LOCAL ] GGG: Trimmed 59470 records to 40679 (keeping 200 days of data) [2025-10-15T19:09:39.816217] [DEBUG] [LOCAL ] GGG: Primary data saved (40679 records). [2025-10-15T19:09:39.816335] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-15T19:09:39.816433] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGG took 35.6s. Estimated remaining: 3h 22m 18s. Rate: 7.1 symbols/min [2025-10-15T19:09:39.987874] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:39.991153] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T19:09:39.997284] [DEBUG] [LOCAL ] GHG: Loaded 3280 existing records from primary storage. [2025-10-15T19:09:39.997440] [INFO ] [MAIN ] GHG: Loaded 3280 existing records. [2025-10-15T19:09:40.119159] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-15T19:09:40.173244] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:40.173458] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-15T19:09:40.173538] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-15T19:09:40.173724] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-15T19:09:40.173780] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-15T19:09:40.524975] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:40.577892] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T19:09:40.914053] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-15T19:09:41.328339] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-15T19:09:41.714057] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-15T19:09:42.082159] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T19:09:42.514048] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-15T19:09:42.881956] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:09:43.313994] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-15T19:09:43.674772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T19:09:44.113995] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-15T19:09:44.505449] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T19:09:44.914049] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-15T19:09:45.381948] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:09:45.713998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-15T19:09:46.318314] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T19:09:46.514013] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-15T19:09:47.044136] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T19:09:47.314098] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-15T19:09:47.875129] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T19:09:48.113994] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-15T19:09:48.616880] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-15T19:09:48.914182] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-15T19:09:49.499018] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T19:09:49.713975] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-15T19:09:50.495773] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T19:09:50.513950] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-15T19:09:51.314006] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-15T19:09:51.371614] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T19:09:51.881680] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T19:09:51.882781] [INFO ] [REMOTE ] GHC: Full fetch complete (3607 records). [2025-10-15T19:09:51.882849] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-15T19:09:52.124033] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-15T19:09:52.246252] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-15T19:09:52.246326] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-15T19:09:52.246449] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-15T19:09:52.246488] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-15T19:09:52.246857] [DEBUG] [LOCAL ] GHC: Trimmed 3607 records to 2926 (keeping 200 days of data) [2025-10-15T19:09:52.270553] [DEBUG] [LOCAL ] GHC: Primary data saved (2926 records). [2025-10-15T19:09:52.270953] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-15T19:09:52.271056] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GHC took 20.9s. Estimated remaining: 3h 22m 16s. Rate: 7.1 symbols/min [2025-10-15T19:09:52.452039] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:52.462722] [DEBUG] [LOCAL ] GHI: Loaded 7296 existing records from primary storage. [2025-10-15T19:09:52.462919] [INFO ] [MAIN ] GHI: Loaded 7296 existing records. [2025-10-15T19:09:52.644009] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T19:09:52.647565] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:52.649068] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-15T19:09:52.649123] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-15T19:09:52.649560] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-15T19:09:52.649617] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-15T19:09:52.921322] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-15T19:09:53.004048] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:53.713964] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-15T19:09:53.927401] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T19:09:54.514006] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-15T19:09:54.634469] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T19:09:55.133291] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T19:09:55.314005] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-15T19:09:55.747870] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T19:09:56.113968] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-15T19:09:56.865001] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T19:09:56.914001] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-15T19:09:57.714001] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-15T19:09:57.763122] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:09:58.152196] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T19:09:58.514028] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-15T19:09:59.183166] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T19:09:59.313985] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-15T19:10:00.071152] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T19:10:00.114010] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-15T19:10:00.671727] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T19:10:00.913993] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-15T19:10:01.501959] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T19:10:01.714014] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-15T19:10:02.294622] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:10:02.514019] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-15T19:10:03.031940] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:10:03.032814] [INFO ] [REMOTE ] GGZ: Full fetch complete (3980 records). [2025-10-15T19:10:03.032884] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-15T19:10:03.315630] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-15T19:10:03.396258] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-15T19:10:03.396327] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-15T19:10:03.396460] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-15T19:10:03.396501] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-15T19:10:03.396881] [DEBUG] [LOCAL ] GGZ: Trimmed 3980 records to 2401 (keeping 200 days of data) [2025-10-15T19:10:03.411586] [DEBUG] [LOCAL ] GGZ: Primary data saved (2401 records). [2025-10-15T19:10:03.411669] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-15T19:10:03.411770] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GGZ took 33.7s. Estimated remaining: 3h 22m 12s. Rate: 7.1 symbols/min [2025-10-15T19:10:03.576096] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:03.582403] [DEBUG] [LOCAL ] GHLD: Loaded 4238 existing records from primary storage. [2025-10-15T19:10:03.582569] [INFO ] [MAIN ] GHLD: Loaded 4238 existing records. [2025-10-15T19:10:03.755775] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:03.756010] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-15T19:10:03.756058] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-15T19:10:03.756213] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-15T19:10:03.756268] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-15T19:10:04.105514] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:04.112520] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:10:04.114534] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-15T19:10:04.480622] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-15T19:10:04.914025] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-15T19:10:05.695321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T19:10:05.713966] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-15T19:10:06.451395] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:10:06.513996] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-15T19:10:07.313995] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-15T19:10:07.436929] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T19:10:07.871448] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:10:08.114008] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-15T19:10:08.854632] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T19:10:08.913960] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-15T19:10:09.713970] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-15T19:10:09.738126] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:10:10.108279] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T19:10:10.513987] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-15T19:10:11.096943] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:10:11.314002] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-15T19:10:11.679827] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:10:12.114038] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-15T19:10:12.913971] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-15T19:10:13.065238] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T19:10:13.295857] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-15T19:10:13.714007] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-15T19:10:14.359417] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T19:10:14.360517] [INFO ] [REMOTE ] GHG: Full fetch complete (4175 records). [2025-10-15T19:10:14.360608] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-15T19:10:14.519187] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-15T19:10:14.732598] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-15T19:10:14.732702] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-15T19:10:14.732860] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-15T19:10:14.732898] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-15T19:10:14.733242] [DEBUG] [LOCAL ] GHG: Trimmed 4175 records to 3296 (keeping 200 days of data) [2025-10-15T19:10:14.751241] [DEBUG] [LOCAL ] GHG: Primary data saved (3296 records). [2025-10-15T19:10:14.751344] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-15T19:10:14.751465] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHG took 34.9s. Estimated remaining: 3h 22m 8s. Rate: 7.1 symbols/min [2025-10-15T19:10:14.920857] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:14.936364] [DEBUG] [LOCAL ] GHM: Loaded 14325 existing records from primary storage. [2025-10-15T19:10:14.936615] [INFO ] [MAIN ] GHM: Loaded 14325 existing records. [2025-10-15T19:10:15.103864] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T19:10:15.116977] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:15.119536] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-15T19:10:15.119590] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-15T19:10:15.119789] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-15T19:10:15.119849] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-15T19:10:15.314022] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-15T19:10:15.471919] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:16.114079] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-15T19:10:16.379681] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:10:16.382237] [INFO ] [REMOTE ] GGT: Full fetch complete (18914 records). [2025-10-15T19:10:16.382343] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-15T19:10:16.741436] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-15T19:10:16.741515] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-15T19:10:16.741954] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-15T19:10:16.742014] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-15T19:10:16.742572] [DEBUG] [LOCAL ] GGT: Trimmed 18914 records to 14408 (keeping 200 days of data) [2025-10-15T19:10:16.787546] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T19:10:16.833717] [DEBUG] [LOCAL ] GGT: Primary data saved (14408 records). [2025-10-15T19:10:16.833874] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-15T19:10:16.833960] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GGT took 48.6s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-15T19:10:16.919140] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-15T19:10:17.012045] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:17.035702] [DEBUG] [LOCAL ] GHY: Loaded 20943 existing records from primary storage. [2025-10-15T19:10:17.035975] [INFO ] [MAIN ] GHY: Loaded 20943 existing records. [2025-10-15T19:10:17.264557] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:17.264817] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-15T19:10:17.264873] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-15T19:10:17.265083] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-15T19:10:17.265140] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-15T19:10:17.611734] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:17.653819] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T19:10:17.713973] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-15T19:10:18.514008] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-15T19:10:18.559453] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T19:10:18.561444] [INFO ] [REMOTE ] GHI: Full fetch complete (11305 records). [2025-10-15T19:10:18.561521] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-15T19:10:18.950250] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-15T19:10:18.950515] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T19:10:18.950609] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-15T19:10:18.952723] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-15T19:10:18.952804] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-15T19:10:18.953415] [DEBUG] [LOCAL ] GHI: Trimmed 11305 records to 7364 (keeping 200 days of data) [2025-10-15T19:10:19.009309] [DEBUG] [LOCAL ] GHI: Primary data saved (7364 records). [2025-10-15T19:10:19.009577] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-15T19:10:19.009725] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHI took 26.7s. Estimated remaining: 3h 21m 31s. Rate: 7.1 symbols/min [2025-10-15T19:10:19.186191] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:19.224070] [DEBUG] [LOCAL ] GIB: Loaded 31638 existing records from primary storage. [2025-10-15T19:10:19.224449] [INFO ] [MAIN ] GIB: Loaded 31638 existing records. [2025-10-15T19:10:19.319359] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-15T19:10:19.420293] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:19.420612] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-15T19:10:19.420722] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-15T19:10:19.421049] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-15T19:10:19.421111] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-15T19:10:19.803405] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:20.114046] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-15T19:10:20.416154] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T19:10:20.914046] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-15T19:10:20.945142] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T19:10:21.553790] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T19:10:21.714026] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-15T19:10:22.514079] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-15T19:10:23.036502] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T19:10:23.093985] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T19:10:23.313982] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-15T19:10:23.785314] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:10:24.113995] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-15T19:10:24.689717] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:10:24.913995] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-15T19:10:25.426023] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T19:10:25.427096] [INFO ] [REMOTE ] GHLD: Full fetch complete (4991 records). [2025-10-15T19:10:25.427164] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-15T19:10:25.719084] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-15T19:10:25.775030] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-15T19:10:25.775112] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-15T19:10:25.775278] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-15T19:10:25.775332] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-15T19:10:25.775717] [DEBUG] [LOCAL ] GHLD: Trimmed 4991 records to 4222 (keeping 200 days of data) [2025-10-15T19:10:25.803256] [DEBUG] [LOCAL ] GHLD: Primary data saved (4222 records). [2025-10-15T19:10:25.803353] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-15T19:10:25.803427] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHLD took 22.4s. Estimated remaining: 3h 21m 21s. Rate: 7.1 symbols/min [2025-10-15T19:10:25.966397] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:25.980366] [DEBUG] [LOCAL ] GIC: Loaded 13431 existing records from primary storage. [2025-10-15T19:10:25.980579] [INFO ] [MAIN ] GIC: Loaded 13431 existing records. [2025-10-15T19:10:26.154186] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:26.154437] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-15T19:10:26.154507] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-15T19:10:26.154805] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-15T19:10:26.154883] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-15T19:10:26.510272] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:26.513955] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-15T19:10:26.897761] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:10:27.242879] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T19:10:27.313964] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-15T19:10:28.114017] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-15T19:10:28.269938] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T19:10:28.914024] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-15T19:10:29.065738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:10:29.714003] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-15T19:10:30.514065] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-15T19:10:30.722159] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T19:10:30.893768] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T19:10:31.314084] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-15T19:10:31.777861] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:10:32.113974] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-15T19:10:32.299889] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T19:10:32.914056] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-15T19:10:33.257255] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T19:10:33.714067] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-15T19:10:34.251291] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:10:34.514037] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-15T19:10:34.663500] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:10:35.314002] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-15T19:10:35.739403] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:10:36.114014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-15T19:10:36.671122] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T19:10:36.914062] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-15T19:10:37.104527] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T19:10:37.714022] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-15T19:10:38.388324] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:10:38.514064] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-15T19:10:38.619303] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T19:10:39.281002] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T19:10:39.313956] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-15T19:10:40.048137] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T19:10:40.113980] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-15T19:10:40.837621] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T19:10:40.914057] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-15T19:10:41.713430] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T19:10:41.716256] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-15T19:10:42.514017] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-15T19:10:42.976384] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:10:43.314015] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-15T19:10:43.494382] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:10:44.113997] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-15T19:10:44.705244] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:10:44.913976] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-15T19:10:45.062783] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T19:10:45.714017] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-15T19:10:46.265167] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:10:46.504177] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T19:10:46.513945] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-15T19:10:47.313991] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-15T19:10:47.341629] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T19:10:48.114016] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-15T19:10:48.412604] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T19:10:48.913990] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-15T19:10:48.950616] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:10:48.952424] [INFO ] [REMOTE ] GIC: Full fetch complete (19957 records). [2025-10-15T19:10:48.952498] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-15T19:10:49.356442] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-15T19:10:49.356529] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-15T19:10:49.357035] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-15T19:10:49.357097] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-15T19:10:49.357761] [DEBUG] [LOCAL ] GIC: Trimmed 19957 records to 13411 (keeping 200 days of data) [2025-10-15T19:10:49.445631] [DEBUG] [LOCAL ] GIC: Primary data saved (13411 records). [2025-10-15T19:10:49.445799] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-15T19:10:49.445884] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GIC took 23.6s. Estimated remaining: 3h 21m 36s. Rate: 7.1 symbols/min [2025-10-15T19:10:49.648526] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:49.692471] [DEBUG] [LOCAL ] GIL: Loaded 43802 existing records from primary storage. [2025-10-15T19:10:49.692859] [INFO ] [MAIN ] GIL: Loaded 43802 existing records. [2025-10-15T19:10:49.719098] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-15T19:10:49.829686] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T19:10:49.923688] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:49.923901] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-15T19:10:49.923952] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-15T19:10:49.924200] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-15T19:10:49.924258] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-15T19:10:50.294929] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:50.513979] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-15T19:10:51.171702] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T19:10:51.314000] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-15T19:10:51.852163] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T19:10:52.114049] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-15T19:10:52.638305] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:10:52.642135] [INFO ] [REMOTE ] GIB: Full fetch complete (46011 records). [2025-10-15T19:10:52.642239] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-15T19:10:52.919076] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-15T19:10:53.032810] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-15T19:10:53.032892] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-15T19:10:53.033668] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-15T19:10:53.033730] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-15T19:10:53.034755] [DEBUG] [LOCAL ] GIB: Trimmed 46011 records to 31659 (keeping 200 days of data) [2025-10-15T19:10:53.155392] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:10:53.265896] [DEBUG] [LOCAL ] GIB: Primary data saved (31659 records). [2025-10-15T19:10:53.266048] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-15T19:10:53.266143] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GIB took 34.3s. Estimated remaining: 3h 21m 20s. Rate: 7.1 symbols/min [2025-10-15T19:10:53.441535] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:53.496990] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-10-15T19:10:53.497412] [INFO ] [MAIN ] GIS: Loaded 53673 existing records. [2025-10-15T19:10:53.714345] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-15T19:10:53.746080] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:53.746411] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-15T19:10:53.746463] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-15T19:10:53.746810] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-15T19:10:53.746867] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-15T19:10:53.860151] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:10:54.112075] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:54.514012] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-15T19:10:55.076174] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T19:10:55.313984] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-15T19:10:56.113999] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-15T19:10:56.272616] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:10:56.776129] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:10:56.914033] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-15T19:10:56.936503] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:10:57.713995] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-15T19:10:58.513986] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-15T19:10:58.820772] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T19:10:58.857580] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:10:59.314003] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-15T19:10:59.651313] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T19:11:00.116929] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:11:00.115929] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-15T19:11:00.914028] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-15T19:11:01.713978] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-15T19:11:01.805396] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T19:11:01.874401] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T19:11:02.513991] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-15T19:11:02.968223] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:11:03.313990] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-15T19:11:04.114004] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-15T19:11:04.351944] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T19:11:04.377472] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:11:04.913991] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-15T19:11:05.103715] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T19:11:05.106214] [INFO ] [REMOTE ] GHM: Full fetch complete (22092 records). [2025-10-15T19:11:05.106297] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-15T19:11:05.471185] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-15T19:11:05.471263] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-15T19:11:05.471786] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-15T19:11:05.471847] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-15T19:11:05.472488] [DEBUG] [LOCAL ] GHM: Trimmed 22092 records to 14368 (keeping 200 days of data) [2025-10-15T19:11:05.555430] [DEBUG] [LOCAL ] GHM: Primary data saved (14368 records). [2025-10-15T19:11:05.555590] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-15T19:11:05.555706] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GHM took 50.8s. Estimated remaining: 3h 21m 18s. Rate: 7.1 symbols/min [2025-10-15T19:11:05.721755] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-15T19:11:05.724137] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:05.777277] [DEBUG] [LOCAL ] GKOS: Loaded 42609 existing records from primary storage. [2025-10-15T19:11:05.777561] [INFO ] [MAIN ] GKOS: Loaded 42609 existing records. [2025-10-15T19:11:05.951334] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:05.951581] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-15T19:11:05.951628] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-15T19:11:05.951911] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-15T19:11:05.951960] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-15T19:11:06.306226] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:06.513976] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-15T19:11:06.737451] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:11:06.914334] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:11:07.314008] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-15T19:11:07.971833] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:11:08.113956] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-15T19:11:08.914031] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-15T19:11:09.268249] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T19:11:09.480026] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:11:09.713977] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-15T19:11:09.979887] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:11:09.983807] [INFO ] [REMOTE ] GHY: Full fetch complete (32514 records). [2025-10-15T19:11:09.983899] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-15T19:11:10.343957] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-15T19:11:10.344030] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-15T19:11:10.344523] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-15T19:11:10.344561] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-15T19:11:10.345288] [DEBUG] [LOCAL ] GHY: Trimmed 32514 records to 20928 (keeping 200 days of data) [2025-10-15T19:11:10.468632] [DEBUG] [LOCAL ] GHY: Primary data saved (20928 records). [2025-10-15T19:11:10.468780] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-15T19:11:10.468899] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GHY took 53.6s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-15T19:11:10.522665] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-15T19:11:10.638974] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:10.677665] [DEBUG] [LOCAL ] GL: Loaded 37678 existing records from primary storage. [2025-10-15T19:11:10.677955] [INFO ] [MAIN ] GL: Loaded 37678 existing records. [2025-10-15T19:11:10.850701] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:10.850868] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-15T19:11:10.850913] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-15T19:11:10.851089] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-15T19:11:10.851126] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-15T19:11:11.206946] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:11.227324] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:11:11.313947] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-15T19:11:12.113982] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-15T19:11:12.651105] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T19:11:12.915491] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-15T19:11:12.921767] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:11:13.719127] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-15T19:11:13.733005] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:11:14.354307] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:11:14.514034] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-15T19:11:15.314037] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-15T19:11:15.582227] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T19:11:16.064686] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:11:16.114013] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-15T19:11:16.914979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-15T19:11:16.917534] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T19:11:17.614276] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T19:11:17.713980] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-15T19:11:18.388999] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:11:18.514056] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-15T19:11:19.078847] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T19:11:19.314039] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-15T19:11:20.114032] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-15T19:11:20.453813] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T19:11:20.852499] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T19:11:20.913959] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-15T19:11:21.657979] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T19:11:21.713956] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-15T19:11:22.136080] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T19:11:22.514064] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-15T19:11:23.283678] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:11:23.289393] [INFO ] [REMOTE ] GIL: Full fetch complete (62226 records). [2025-10-15T19:11:23.289546] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-15T19:11:23.319744] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-15T19:11:23.881203] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-15T19:11:23.881430] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-15T19:11:23.883501] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-15T19:11:23.883773] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-15T19:11:23.885832] [DEBUG] [LOCAL ] GIL: Trimmed 62226 records to 43829 (keeping 200 days of data) [2025-10-15T19:11:24.064814] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:11:24.160961] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-15T19:11:24.315841] [DEBUG] [LOCAL ] GIL: Primary data saved (43829 records). [2025-10-15T19:11:24.316021] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-15T19:11:24.316139] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 34.9s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-15T19:11:24.546821] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:24.592965] [DEBUG] [LOCAL ] GLOB: Loaded 47979 existing records from primary storage. [2025-10-15T19:11:24.593256] [INFO ] [MAIN ] GLOB: Loaded 47979 existing records. [2025-10-15T19:11:24.769874] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:24.770121] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-15T19:11:24.770392] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-15T19:11:24.770752] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-15T19:11:24.770855] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-15T19:11:24.919241] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-15T19:11:25.052845] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:11:25.161369] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:25.714061] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-15T19:11:26.240080] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T19:11:26.514013] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-15T19:11:26.648534] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T19:11:26.728311] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:11:27.314015] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-15T19:11:27.703525] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:11:28.114082] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-15T19:11:28.663519] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:11:28.914007] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-15T19:11:29.586018] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:11:29.717374] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-15T19:11:29.723337] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:11:29.732565] [INFO ] [REMOTE ] GIS: Full fetch complete (77832 records). [2025-10-15T19:11:29.732750] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-15T19:11:30.148505] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-15T19:11:30.148589] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-15T19:11:30.149567] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-15T19:11:30.149633] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-15T19:11:30.151103] [DEBUG] [LOCAL ] GIS: Trimmed 77832 records to 53673 (keeping 200 days of data) [2025-10-15T19:11:30.475409] [DEBUG] [LOCAL ] GIS: Primary data saved (53673 records). [2025-10-15T19:11:30.475556] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-15T19:11:30.475967] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GIS took 37.2s. Estimated remaining: 3h 20m 52s. Rate: 7.1 symbols/min [2025-10-15T19:11:30.519152] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-15T19:11:30.647851] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:30.659292] [DEBUG] [LOCAL ] GLP: Loaded 9246 existing records from primary storage. [2025-10-15T19:11:30.659517] [INFO ] [MAIN ] GLP: Loaded 9246 existing records. [2025-10-15T19:11:30.839593] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:30.839987] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-15T19:11:30.840054] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-15T19:11:30.840278] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-15T19:11:30.840397] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-15T19:11:31.122077] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T19:11:31.257287] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:31.314053] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-15T19:11:31.678557] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T19:11:32.114024] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-15T19:11:32.913995] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-15T19:11:33.046041] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:11:33.119853] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:11:33.346262] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T19:11:33.714007] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-15T19:11:34.514003] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-15T19:11:35.086618] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:11:35.313971] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-15T19:11:35.360998] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T19:11:35.928483] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T19:11:36.114015] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-15T19:11:36.914012] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-15T19:11:37.300966] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:11:37.673534] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T19:11:37.713995] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-15T19:11:38.514038] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-15T19:11:39.028086] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:11:39.032908] [INFO ] [REMOTE ] GL: Full fetch complete (55185 records). [2025-10-15T19:11:39.033023] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-15T19:11:39.162120] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T19:11:39.319207] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-15T19:11:39.425707] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-15T19:11:39.425789] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-15T19:11:39.426581] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-15T19:11:39.426620] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-15T19:11:39.427735] [DEBUG] [LOCAL ] GL: Trimmed 55185 records to 37640 (keeping 200 days of data) [2025-10-15T19:11:39.672785] [DEBUG] [LOCAL ] GL: Primary data saved (37640 records). [2025-10-15T19:11:39.672963] [INFO ] [MAIN ] GL: Full history saved. [2025-10-15T19:11:39.673066] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GL took 29.2s. Estimated remaining: 3h 20m 45s. Rate: 7.1 symbols/min [2025-10-15T19:11:39.840549] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:39.891635] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-15T19:11:39.891958] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-15T19:11:40.063982] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:40.064207] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-15T19:11:40.064254] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-15T19:11:40.064752] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-15T19:11:40.064808] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-15T19:11:40.125785] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-15T19:11:40.420716] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:40.814978] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:11:40.819978] [INFO ] [REMOTE ] GKOS: Full fetch complete (60356 records). [2025-10-15T19:11:40.820113] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-15T19:11:40.914756] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-15T19:11:40.927794] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:11:41.211310] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-15T19:11:41.211386] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-15T19:11:41.212237] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-15T19:11:41.212298] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-15T19:11:41.215473] [DEBUG] [LOCAL ] GKOS: Trimmed 60356 records to 42541 (keeping 200 days of data) [2025-10-15T19:11:41.463241] [DEBUG] [LOCAL ] GKOS: Primary data saved (42541 records). [2025-10-15T19:11:41.463364] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-15T19:11:41.463439] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GKOS took 35.9s. Estimated remaining: 3h 20m 26s. Rate: 7.1 symbols/min [2025-10-15T19:11:41.652767] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:41.704611] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-15T19:11:41.704936] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-15T19:11:41.719161] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-15T19:11:41.908886] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:41.909161] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-15T19:11:41.909219] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-15T19:11:41.909617] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-15T19:11:41.909708] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-15T19:11:42.257994] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:42.513967] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-15T19:11:42.577229] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T19:11:42.578006] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:11:43.314008] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-15T19:11:44.114030] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-15T19:11:44.647599] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T19:11:44.664804] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T19:11:44.913953] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-15T19:11:45.027805] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:11:45.547575] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-15T19:11:45.714080] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-15T19:11:46.514046] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-15T19:11:47.314074] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-15T19:11:47.544167] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T19:11:47.765538] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:11:48.113970] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-15T19:11:48.318330] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T19:11:48.913988] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-15T19:11:49.715505] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T19:11:49.714386] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-15T19:11:50.284048] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:11:50.319984] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T19:11:50.513998] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-15T19:11:51.286543] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T19:11:51.288185] [INFO ] [REMOTE ] GLP: Full fetch complete (14262 records). [2025-10-15T19:11:51.288252] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-15T19:11:51.319171] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-15T19:11:51.650302] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-15T19:11:51.650378] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-15T19:11:51.650717] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-15T19:11:51.650776] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-15T19:11:51.651247] [DEBUG] [LOCAL ] GLP: Trimmed 14262 records to 9278 (keeping 200 days of data) [2025-10-15T19:11:51.706499] [DEBUG] [LOCAL ] GLP: Primary data saved (9278 records). [2025-10-15T19:11:51.706623] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-15T19:11:51.706734] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 21.2s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-15T19:11:51.875099] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:51.926449] [DEBUG] [LOCAL ] GME: Loaded 53782 existing records from primary storage. [2025-10-15T19:11:51.926787] [INFO ] [MAIN ] GME: Loaded 53782 existing records. [2025-10-15T19:11:52.102034] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:52.102273] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-15T19:11:52.102326] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-15T19:11:52.102851] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-15T19:11:52.102909] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-15T19:11:52.122672] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-15T19:11:52.452949] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:52.914008] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-15T19:11:53.306839] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T19:11:53.714015] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-15T19:11:54.171896] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T19:11:54.222879] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:11:54.513983] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-15T19:11:55.314067] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-15T19:11:56.114202] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-15T19:11:56.432134] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T19:11:56.449318] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-15T19:11:56.853587] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:11:56.913966] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-15T19:11:57.714001] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-15T19:11:58.245818] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T19:11:58.514014] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-15T19:11:58.605823] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:11:59.019299] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:11:59.314021] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-15T19:12:00.114046] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-15T19:12:00.913983] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-15T19:12:01.359242] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-10-15T19:12:01.435591] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T19:12:01.713977] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-15T19:12:02.022353] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T19:12:02.514005] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-15T19:12:02.597518] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:12:03.313968] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-15T19:12:03.357984] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:12:04.114014] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-15T19:12:04.480038] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T19:12:04.914005] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-15T19:12:05.047511] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:12:05.714038] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-15T19:12:06.513993] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-15T19:12:06.592189] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-15T19:12:06.775713] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T19:12:07.313999] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-15T19:12:07.450025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:12:08.114025] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-15T19:12:08.131919] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T19:12:08.138697] [INFO ] [REMOTE ] GLOB: Full fetch complete (65479 records). [2025-10-15T19:12:08.138893] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-15T19:12:08.545438] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-15T19:12:08.545547] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-15T19:12:08.546461] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-15T19:12:08.546527] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-15T19:12:08.547939] [DEBUG] [LOCAL ] GLOB: Trimmed 65479 records to 47983 (keeping 200 days of data) [2025-10-15T19:12:08.854594] [DEBUG] [LOCAL ] GLOB: Primary data saved (47983 records). [2025-10-15T19:12:08.854765] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-15T19:12:08.854854] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLOB took 44.5s. Estimated remaining: 3h 20m 25s. Rate: 7.1 symbols/min [2025-10-15T19:12:08.921863] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-15T19:12:09.021831] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:09.064636] [DEBUG] [LOCAL ] GMED: Loaded 48308 existing records from primary storage. [2025-10-15T19:12:09.064971] [INFO ] [MAIN ] GMED: Loaded 48308 existing records. [2025-10-15T19:12:09.241095] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:09.241329] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-15T19:12:09.241383] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-15T19:12:09.241621] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-15T19:12:09.241704] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-15T19:12:09.596660] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:09.688620] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T19:12:09.696225] [INFO ] [REMOTE ] GLW: Full fetch complete (77789 records). [2025-10-15T19:12:09.696354] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-15T19:12:09.721923] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-15T19:12:10.046178] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-15T19:12:10.175990] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-15T19:12:10.176092] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-15T19:12:10.177098] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-15T19:12:10.177182] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-15T19:12:10.213554] [DEBUG] [LOCAL ] GLW: Trimmed 77789 records to 53636 (keeping 200 days of data) [2025-10-15T19:12:10.215361] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:12:10.523080] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-15T19:12:10.549169] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-15T19:12:10.549315] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-15T19:12:10.549439] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GLW took 30.9s. Estimated remaining: 3h 20m 7s. Rate: 7.1 symbols/min [2025-10-15T19:12:10.714877] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:10.754004] [DEBUG] [LOCAL ] GMRE: Loaded 37032 existing records from primary storage. [2025-10-15T19:12:10.754313] [INFO ] [MAIN ] GMRE: Loaded 37032 existing records. [2025-10-15T19:12:10.930267] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:10.930613] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-15T19:12:10.930702] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-15T19:12:10.930938] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-15T19:12:10.930981] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-15T19:12:11.285369] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:11.315854] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-15T19:12:11.318333] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T19:12:12.114026] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-15T19:12:12.914049] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-15T19:12:12.983693] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-15T19:12:13.713983] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-15T19:12:13.806525] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T19:12:13.949567] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-15T19:12:14.311747] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:12:14.514059] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-15T19:12:15.313990] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-15T19:12:15.690428] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T19:12:16.114051] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-15T19:12:16.421557] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T19:12:16.812915] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:12:16.913954] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-15T19:12:16.978506] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:12:16.984972] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-15T19:12:16.985100] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-15T19:12:17.378610] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-15T19:12:17.378719] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-15T19:12:17.379820] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-15T19:12:17.379883] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-15T19:12:17.381424] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-15T19:12:17.714424] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-15T19:12:17.714329] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-15T19:12:17.714632] [INFO ] [MAIN ] GM: Full history saved. [2025-10-15T19:12:17.716543] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GM took 36.3s. Estimated remaining: 3h 19m 57s. Rate: 7.1 symbols/min [2025-10-15T19:12:17.889215] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:17.911779] [DEBUG] [LOCAL ] GNE: Loaded 17991 existing records from primary storage. [2025-10-15T19:12:17.912023] [INFO ] [MAIN ] GNE: Loaded 17991 existing records. [2025-10-15T19:12:18.096476] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:18.105251] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-15T19:12:18.105344] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-15T19:12:18.115946] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-15T19:12:18.116036] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-15T19:12:18.160170] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T19:12:18.477824] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:18.514003] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-15T19:12:19.308337] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:12:19.317365] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-15T19:12:19.829074] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T19:12:20.114048] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-15T19:12:20.914008] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-15T19:12:21.572300] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:12:21.676726] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-15T19:12:21.713953] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-15T19:12:22.513972] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-15T19:12:22.597015] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T19:12:23.313995] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-15T19:12:23.564387] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T19:12:23.723271] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T19:12:24.113983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-15T19:12:24.147059] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T19:12:24.914020] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-15T19:12:25.714052] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-15T19:12:26.196387] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T19:12:26.488058] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:12:26.507439] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T19:12:26.513955] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-15T19:12:27.306234] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T19:12:27.313951] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-15T19:12:28.065101] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:12:28.114036] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-15T19:12:28.877012] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:12:28.913949] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-15T19:12:29.713967] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-15T19:12:29.864840] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T19:12:30.514065] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-15T19:12:31.314016] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-15T19:12:31.905781] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T19:12:31.999705] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:12:32.113969] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-15T19:12:32.498600] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T19:12:32.914057] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-15T19:12:33.408354] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T19:12:33.713991] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-15T19:12:34.337608] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:12:34.513996] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-15T19:12:35.103236] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:12:35.314025] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-15T19:12:35.788719] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T19:12:36.114100] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-15T19:12:36.394318] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T19:12:36.914042] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-15T19:12:37.409392] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T19:12:37.714047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-15T19:12:37.988473] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:12:38.514007] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-15T19:12:39.271127] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:12:39.313957] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-15T19:12:39.529764] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T19:12:40.114015] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-15T19:12:40.914056] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-15T19:12:40.958764] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:12:41.714028] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-15T19:12:42.488123] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:12:42.491722] [INFO ] [REMOTE ] GMRE: Full fetch complete (52705 records). [2025-10-15T19:12:42.491814] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-15T19:12:42.524336] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-15T19:12:42.886793] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-15T19:12:42.886978] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-15T19:12:42.887846] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-15T19:12:42.887930] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-15T19:12:42.905869] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-15T19:12:42.906043] [DEBUG] [LOCAL ] GMRE: Trimmed 52705 records to 37100 (keeping 200 days of data) [2025-10-15T19:12:42.913441] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-15T19:12:42.913614] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-15T19:12:43.449817] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T19:12:43.460967] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-15T19:12:43.462047] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:12:43.461346] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-15T19:12:43.463696] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-15T19:12:43.470937] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-15T19:12:43.471576] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-15T19:12:43.473718] [INFO ] [REMOTE ] GMED: Full fetch complete (69981 records). [2025-10-15T19:12:43.475028] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-15T19:12:43.482334] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 53781 (keeping 200 days of data) [2025-10-15T19:12:44.319619] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-15T19:12:44.321115] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-15T19:12:44.322392] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-15T19:12:44.323607] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-15T19:12:44.332989] [DEBUG] [LOCAL ] GMED: Trimmed 69981 records to 48294 (keeping 200 days of data) [2025-10-15T19:12:44.340958] [DEBUG] [LOCAL ] GMRE: Primary data saved (37100 records). [2025-10-15T19:12:44.342613] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-15T19:12:44.343479] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 33.8s. Estimated remaining: 3h 20m 16s. Rate: 7.1 symbols/min [2025-10-15T19:12:44.501117] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T19:12:44.516185] [INFO ] [REMOTE ] GNE: Full fetch complete (22492 records). [2025-10-15T19:12:44.539309] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-15T19:12:44.707594] [DEBUG] [LOCAL ] GME: Primary data saved (53781 records). [2025-10-15T19:12:44.753664] [INFO ] [MAIN ] GME: Full history saved. [2025-10-15T19:12:44.830086] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GME took 53.1s. Estimated remaining: 3h 19m 55s. Rate: 7.1 symbols/min [2025-10-15T19:12:44.899302] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:45.259524] [DEBUG] [LOCAL ] GMED: Primary data saved (48294 records). [2025-10-15T19:12:45.274002] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-15T19:12:45.274269] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GMED took 36.4s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-15T19:12:45.377061] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:45.531932] [DEBUG] [LOCAL ] GNK: Loaded 40176 existing records from primary storage. [2025-10-15T19:12:45.544561] [INFO ] [MAIN ] GNK: Loaded 40176 existing records. [2025-10-15T19:12:45.549948] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-15T19:12:45.592629] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-15T19:12:45.603455] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-15T19:12:45.618676] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-15T19:12:45.661586] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:45.680733] [DEBUG] [LOCAL ] GNE: Trimmed 22492 records to 18040 (keeping 200 days of data) [2025-10-15T19:12:45.878639] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:45.886343] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-15T19:12:45.910557] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-15T19:12:45.926099] [DEBUG] [LOCAL ] GNL: Loaded 46702 existing records from primary storage. [2025-10-15T19:12:45.924923] [DEBUG] [LOCAL ] GNE: Primary data saved (18040 records). [2025-10-15T19:12:45.926617] [INFO ] [MAIN ] GNL: Loaded 46702 existing records. [2025-10-15T19:12:45.926809] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-15T19:12:45.932576] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-15T19:12:45.932506] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GNE took 28.2s. Estimated remaining: 3h 19m 15s. Rate: 7.1 symbols/min [2025-10-15T19:12:45.938112] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-15T19:12:46.231665] [DEBUG] [LOCAL ] GNRC: Loaded 45433 existing records from primary storage. [2025-10-15T19:12:46.302406] [INFO ] [MAIN ] GNRC: Loaded 45433 existing records. [2025-10-15T19:12:46.477294] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:46.483941] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-15T19:12:46.521285] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-15T19:12:46.570904] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:46.562568] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-15T19:12:46.580618] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-15T19:12:46.884114] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:46.933919] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-15T19:12:46.939311] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-15T19:12:46.928529] [DEBUG] [LOCAL ] GNT: Loaded 8422 existing records from primary storage. [2025-10-15T19:12:46.963464] [INFO ] [MAIN ] GNT: Loaded 8422 existing records. [2025-10-15T19:12:46.996090] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-15T19:12:47.064112] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-15T19:12:47.245964] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:47.303117] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-15T19:12:47.542707] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:47.590788] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-15T19:12:47.593798] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:47.599154] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-15T19:12:47.652825] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-15T19:12:47.652137] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-15T19:12:47.653290] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-15T19:12:48.088067] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:48.122047] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-15T19:12:48.232011] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:48.232365] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-15T19:12:48.722708] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:12:48.729973] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-15T19:12:48.850392] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T19:12:48.852049] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-15T19:12:49.197137] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:12:49.207157] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-15T19:12:49.441036] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T19:12:49.714495] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-15T19:12:49.796440] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:12:49.828516] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:12:50.282515] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T19:12:50.513982] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-15T19:12:50.542122] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:12:51.313968] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-15T19:12:51.901636] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:12:52.113984] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-15T19:12:52.663383] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:12:52.688536] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T19:12:52.914041] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-15T19:12:53.513626] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T19:12:53.713991] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-15T19:12:54.436451] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:12:54.514004] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-15T19:12:55.314045] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-15T19:12:55.945269] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:12:56.114027] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-15T19:12:56.810206] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:12:56.913999] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-15T19:12:57.713996] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-15T19:12:57.774525] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T19:12:58.449105] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T19:12:58.513983] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-15T19:12:59.265020] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:12:59.313991] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-15T19:12:59.854695] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T19:13:00.114078] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-15T19:13:00.863457] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T19:13:00.913946] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-15T19:13:00.994862] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:13:01.712097] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T19:13:01.714824] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-15T19:13:02.514012] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-15T19:13:03.110447] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T19:13:03.294289] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T19:13:03.313951] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-15T19:13:04.114013] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-15T19:13:04.640855] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:13:04.913991] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-15T19:13:05.713994] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-15T19:13:05.867357] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:13:06.312925] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T19:13:06.498290] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:13:06.513951] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-15T19:13:07.284888] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T19:13:07.286596] [INFO ] [REMOTE ] GNT: Full fetch complete (11176 records). [2025-10-15T19:13:07.286689] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-15T19:13:07.321036] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-15T19:13:07.664528] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-15T19:13:07.664622] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-15T19:13:07.665110] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-15T19:13:07.665195] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-15T19:13:07.665837] [DEBUG] [LOCAL ] GNT: Trimmed 11176 records to 8426 (keeping 200 days of data) [2025-10-15T19:13:07.714633] [DEBUG] [LOCAL ] GNT: Primary data saved (8426 records). [2025-10-15T19:13:07.714807] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-15T19:13:07.714891] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNT took 21.7s. Estimated remaining: 3h 19m 26s. Rate: 7.1 symbols/min [2025-10-15T19:13:07.879179] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:07.928237] [DEBUG] [LOCAL ] GNW: Loaded 51401 existing records from primary storage. [2025-10-15T19:13:07.928537] [INFO ] [MAIN ] GNW: Loaded 51401 existing records. [2025-10-15T19:13:08.105383] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:08.105580] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-15T19:13:08.105632] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-15T19:13:08.105912] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-15T19:13:08.105966] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-15T19:13:08.119085] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-15T19:13:08.458369] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:08.772767] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T19:13:08.914000] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-15T19:13:09.693446] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:13:09.713950] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-15T19:13:10.345320] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:13:10.513985] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-15T19:13:11.278543] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T19:13:11.313956] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-15T19:13:11.792875] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T19:13:11.802387] [INFO ] [REMOTE ] GNL: Full fetch complete (68210 records). [2025-10-15T19:13:11.802707] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-15T19:13:12.119089] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-15T19:13:12.191054] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-15T19:13:12.191123] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-15T19:13:12.192129] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-15T19:13:12.192194] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-15T19:13:12.193570] [DEBUG] [LOCAL ] GNL: Trimmed 68210 records to 46728 (keeping 200 days of data) [2025-10-15T19:13:12.472014] [DEBUG] [LOCAL ] GNL: Primary data saved (46728 records). [2025-10-15T19:13:12.472117] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-15T19:13:12.472198] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 27.6s. Estimated remaining: 3h 19m 12s. Rate: 7.1 symbols/min [2025-10-15T19:13:12.642902] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:12.682829] [DEBUG] [LOCAL ] GOF: Loaded 42601 existing records from primary storage. [2025-10-15T19:13:12.683111] [INFO ] [MAIN ] GOF: Loaded 42601 existing records. [2025-10-15T19:13:12.858907] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:12.859224] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-15T19:13:12.859364] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-15T19:13:12.859793] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-15T19:13:12.859852] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-15T19:13:12.921173] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-15T19:13:13.108221] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T19:13:13.307778] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:13.533213] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:13:13.714004] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-15T19:13:14.514016] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-15T19:13:14.861427] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T19:13:15.319347] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-15T19:13:15.339319] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:13:15.697055] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:13:16.114015] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-15T19:13:16.716548] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T19:13:16.913965] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-15T19:13:17.714476] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-15T19:13:17.719734] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:13:18.334690] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:13:18.513984] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-15T19:13:19.314021] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-15T19:13:19.356687] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T19:13:20.019873] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:13:20.114013] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-15T19:13:20.913997] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-15T19:13:20.993330] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:13:21.536980] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:13:21.714014] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-15T19:13:22.092410] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:13:22.514022] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-15T19:13:23.249616] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:13:23.313978] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-15T19:13:23.895306] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:13:24.114003] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-15T19:13:24.914016] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-15T19:13:25.047346] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:13:25.714050] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-15T19:13:25.829479] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:13:25.837014] [INFO ] [REMOTE ] GNRC: Full fetch complete (65705 records). [2025-10-15T19:13:25.837223] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-15T19:13:26.276915] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-15T19:13:26.277143] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-15T19:13:26.278232] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-15T19:13:26.278332] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-15T19:13:26.279614] [DEBUG] [LOCAL ] GNRC: Trimmed 65705 records to 45508 (keeping 200 days of data) [2025-10-15T19:13:26.514123] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-15T19:13:26.600701] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:13:26.612949] [DEBUG] [LOCAL ] GNRC: Primary data saved (45508 records). [2025-10-15T19:13:26.613142] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-15T19:13:26.613366] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNRC took 41.3s. Estimated remaining: 3h 19m 13s. Rate: 7.1 symbols/min [2025-10-15T19:13:26.792956] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:26.823663] [DEBUG] [LOCAL ] GOLF: Loaded 30957 existing records from primary storage. [2025-10-15T19:13:26.823946] [INFO ] [MAIN ] GOLF: Loaded 30957 existing records. [2025-10-15T19:13:26.999428] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:26.999680] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-15T19:13:26.999738] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-15T19:13:26.999921] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-15T19:13:26.999960] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-15T19:13:27.334269] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-15T19:13:27.358084] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:27.376741] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T19:13:27.382785] [INFO ] [REMOTE ] GNK: Full fetch complete (57342 records). [2025-10-15T19:13:27.383011] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-15T19:13:27.809825] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-15T19:13:27.809965] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-15T19:13:27.810895] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-15T19:13:27.810957] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-15T19:13:27.812152] [DEBUG] [LOCAL ] GNK: Trimmed 57342 records to 40065 (keeping 200 days of data) [2025-10-15T19:13:28.057567] [DEBUG] [LOCAL ] GNK: Primary data saved (40065 records). [2025-10-15T19:13:28.057738] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-15T19:13:28.057845] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNK took 43.7s. Estimated remaining: 3h 18m 54s. Rate: 7.1 symbols/min [2025-10-15T19:13:28.122215] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-15T19:13:28.259829] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:28.256507] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T19:13:28.314099] [DEBUG] [LOCAL ] GOOS: Loaded 44689 existing records from primary storage. [2025-10-15T19:13:28.314400] [INFO ] [MAIN ] GOOS: Loaded 44689 existing records. [2025-10-15T19:13:28.491115] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:28.491323] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-15T19:13:28.491385] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-15T19:13:28.491885] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-15T19:13:28.491948] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-15T19:13:28.854315] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:28.894631] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:13:28.913953] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-15T19:13:29.228076] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:13:29.713997] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-15T19:13:30.239456] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:13:30.513989] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-15T19:13:31.014213] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:13:31.313990] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-15T19:13:32.113977] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-15T19:13:32.202610] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T19:13:32.913987] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-15T19:13:32.978937] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:13:33.071583] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T19:13:33.714007] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-15T19:13:34.212876] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:13:34.514066] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-15T19:13:35.210738] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:13:35.313979] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-15T19:13:35.832998] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:13:36.114003] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-15T19:13:36.722885] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:13:36.914011] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-15T19:13:37.474358] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T19:13:37.713991] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-15T19:13:38.514215] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-15T19:13:38.514147] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T19:13:39.134539] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:13:39.313981] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-15T19:13:40.113988] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-15T19:13:40.142491] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:13:40.913980] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-15T19:13:41.151428] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T19:13:41.553282] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T19:13:41.714049] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-15T19:13:42.513982] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-15T19:13:42.595770] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:13:43.176305] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:13:43.313984] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-15T19:13:44.113985] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-15T19:13:44.333314] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T19:13:44.626175] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:13:44.914029] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-15T19:13:45.714044] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-15T19:13:45.857094] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T19:13:46.368922] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:13:46.513968] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-15T19:13:47.313996] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-15T19:13:47.850965] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-15T19:13:47.856257] [INFO ] [REMOTE ] GOF: Full fetch complete (62306 records). [2025-10-15T19:13:47.856358] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-15T19:13:48.129966] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-15T19:13:48.275431] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-15T19:13:48.275568] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-15T19:13:48.276542] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-15T19:13:48.276607] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-15T19:13:48.277860] [DEBUG] [LOCAL ] GOF: Trimmed 62306 records to 42604 (keeping 200 days of data) [2025-10-15T19:13:48.535185] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:13:48.610605] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:13:48.612798] [DEBUG] [LOCAL ] GOF: Primary data saved (42604 records). [2025-10-15T19:13:48.619009] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-15T19:13:48.619589] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GOF took 36.1s. Estimated remaining: 3h 19m 3s. Rate: 7.1 symbols/min [2025-10-15T19:13:48.818114] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:48.854093] [DEBUG] [LOCAL ] GOTU: Loaded 37406 existing records from primary storage. [2025-10-15T19:13:48.854382] [INFO ] [MAIN ] GOTU: Loaded 37406 existing records. [2025-10-15T19:13:48.919087] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-15T19:13:49.032789] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:49.033063] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-15T19:13:49.033123] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-15T19:13:49.033525] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-15T19:13:49.033581] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-15T19:13:49.383892] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:49.709247] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:13:49.715678] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-15T19:13:49.717485] [INFO ] [REMOTE ] GNW: Full fetch complete (73865 records). [2025-10-15T19:13:49.717585] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-15T19:13:50.119876] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-15T19:13:50.119976] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-15T19:13:50.121617] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-15T19:13:50.121715] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-15T19:13:50.123292] [DEBUG] [LOCAL ] GNW: Trimmed 73865 records to 51403 (keeping 200 days of data) [2025-10-15T19:13:50.420665] [DEBUG] [LOCAL ] GNW: Primary data saved (51403 records). [2025-10-15T19:13:50.420830] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-15T19:13:50.421707] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GNW took 42.7s. Estimated remaining: 3h 18m 45s. Rate: 7.1 symbols/min [2025-10-15T19:13:50.519535] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-15T19:13:50.597830] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:50.598575] [DEBUG] [LOCAL ] GPC: No existing data file found in primary storage. [2025-10-15T19:13:50.598768] [WARN ] [MAIN ] GPC: No existing data found, performing full refresh instead. [2025-10-15T19:13:50.598924] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-15T19:13:50.598971] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-15T19:13:50.599014] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-15T19:13:50.599046] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-15T19:13:50.809120] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:13:51.000174] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:51.051453] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:13:51.313990] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-15T19:13:52.113983] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-15T19:13:52.224765] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:13:52.297673] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:13:52.914048] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-15T19:13:53.659590] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T19:13:53.713988] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-15T19:13:54.391167] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:13:54.514000] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-15T19:13:55.021462] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:13:55.027371] [INFO ] [REMOTE ] GOOS: Full fetch complete (64961 records). [2025-10-15T19:13:55.027518] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-15T19:13:55.315739] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-15T19:13:55.409405] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-15T19:13:55.409479] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-15T19:13:55.410414] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-15T19:13:55.410477] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-15T19:13:55.411749] [DEBUG] [LOCAL ] GOOS: Trimmed 64961 records to 44661 (keeping 200 days of data) [2025-10-15T19:13:55.631108] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T19:13:55.687346] [DEBUG] [LOCAL ] GOOS: Primary data saved (44661 records). [2025-10-15T19:13:55.687474] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-15T19:13:55.687599] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOOS took 27.6s. Estimated remaining: 3h 18m 32s. Rate: 7.1 symbols/min [2025-10-15T19:13:55.852577] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:55.868810] [DEBUG] [LOCAL ] GPI: Loaded 14831 existing records from primary storage. [2025-10-15T19:13:55.869032] [INFO ] [MAIN ] GPI: Loaded 14831 existing records. [2025-10-15T19:13:56.040967] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:56.041164] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-15T19:13:56.041211] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-15T19:13:56.041453] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-15T19:13:56.041510] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-15T19:13:56.119105] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-15T19:13:56.393073] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:56.785233] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:13:56.913981] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-15T19:13:57.379034] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:13:57.384152] [INFO ] [REMOTE ] GOLF: Full fetch complete (45310 records). [2025-10-15T19:13:57.384289] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-15T19:13:57.739693] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-15T19:13:57.755708] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-15T19:13:57.755763] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-15T19:13:57.756474] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-15T19:13:57.756599] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-15T19:13:57.757523] [DEBUG] [LOCAL ] GOLF: Trimmed 45310 records to 30944 (keeping 200 days of data) [2025-10-15T19:13:57.947586] [DEBUG] [LOCAL ] GOLF: Primary data saved (30944 records). [2025-10-15T19:13:57.947773] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-15T19:13:57.947873] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOLF took 31.3s. Estimated remaining: 3h 18m 15s. Rate: 7.1 symbols/min [2025-10-15T19:13:58.117312] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:58.124394] [DEBUG] [LOCAL ] GPJA: Loaded 4241 existing records from primary storage. [2025-10-15T19:13:58.124605] [INFO ] [MAIN ] GPJA: Loaded 4241 existing records. [2025-10-15T19:13:58.301897] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:58.302143] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-15T19:13:58.302199] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-15T19:13:58.302350] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-15T19:13:58.302403] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-15T19:13:58.519177] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-15T19:13:58.510090] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:13:58.697215] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:59.287311] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:13:59.313956] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-15T19:13:59.325433] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T19:14:00.114004] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-15T19:14:00.860484] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T19:14:00.913963] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-15T19:14:00.947332] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T19:14:01.714063] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-15T19:14:01.773476] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T19:14:02.317637] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T19:14:02.513996] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-15T19:14:03.211180] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T19:14:03.313998] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-15T19:14:03.890606] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T19:14:04.114060] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-15T19:14:04.914050] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-15T19:14:05.714024] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-15T19:14:06.201930] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T19:14:06.231412] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T19:14:06.381096] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T19:14:06.513983] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-15T19:14:07.314009] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-15T19:14:07.879164] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T19:14:08.113956] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-15T19:14:08.350520] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T19:14:08.914046] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-15T19:14:09.481190] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T19:14:09.714036] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-15T19:14:09.770482] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T19:14:10.176368] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T19:14:10.513984] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-15T19:14:11.313981] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-15T19:14:11.491202] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T19:14:11.843850] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T19:14:12.114031] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-15T19:14:12.719536] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T19:14:12.913969] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-15T19:14:13.714057] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-15T19:14:14.332273] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T19:14:14.481015] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:14:14.514040] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-15T19:14:15.110515] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T19:14:15.314045] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-15T19:14:16.114017] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-15T19:14:16.664579] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T19:14:16.913996] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-15T19:14:17.479627] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T19:14:17.714056] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-15T19:14:18.044170] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T19:14:18.331797] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T19:14:18.332983] [INFO ] [REMOTE ] GPJA: Full fetch complete (7065 records). [2025-10-15T19:14:18.333079] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-15T19:14:18.519166] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-15T19:14:18.779077] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-15T19:14:18.779178] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-15T19:14:18.779396] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-15T19:14:18.779437] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-15T19:14:18.779956] [DEBUG] [LOCAL ] GPJA: Trimmed 7065 records to 4202 (keeping 200 days of data) [2025-10-15T19:14:18.808785] [DEBUG] [LOCAL ] GPJA: Primary data saved (4202 records). [2025-10-15T19:14:18.808947] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-15T19:14:18.809066] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GPJA took 20.9s. Estimated remaining: 3h 18m 24s. Rate: 7.1 symbols/min [2025-10-15T19:14:18.985768] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:19.042682] [DEBUG] [LOCAL ] GPK: Loaded 52763 existing records from primary storage. [2025-10-15T19:14:19.043040] [INFO ] [MAIN ] GPK: Loaded 52763 existing records. [2025-10-15T19:14:19.231745] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:19.231973] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-15T19:14:19.232020] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-15T19:14:19.232445] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-15T19:14:19.232483] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-15T19:14:19.319194] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-15T19:14:19.557662] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:14:19.621362] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:20.114049] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-15T19:14:20.614819] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T19:14:20.913997] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-15T19:14:21.305113] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T19:14:21.714012] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-15T19:14:21.901145] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:14:22.514013] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-15T19:14:23.074276] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T19:14:23.314007] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-15T19:14:24.018287] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:14:24.114014] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-15T19:14:24.298170] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:14:24.302707] [INFO ] [REMOTE ] GOTU: Full fetch complete (58736 records). [2025-10-15T19:14:24.302845] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-15T19:14:24.696530] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-15T19:14:24.696604] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-15T19:14:24.697445] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-15T19:14:24.697507] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-15T19:14:24.698669] [DEBUG] [LOCAL ] GOTU: Trimmed 58736 records to 37301 (keeping 200 days of data) [2025-10-15T19:14:24.908725] [DEBUG] [LOCAL ] GOTU: Primary data saved (37301 records). [2025-10-15T19:14:24.908865] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-15T19:14:24.909311] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GOTU took 36.3s. Estimated remaining: 3h 18m 13s. Rate: 7.1 symbols/min [2025-10-15T19:14:24.913954] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-15T19:14:25.698586] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:14:25.713951] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-15T19:14:26.514044] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-15T19:14:26.564186] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T19:14:27.189443] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T19:14:27.314027] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-15T19:14:27.569237] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:14:28.113979] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-15T19:14:28.600161] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T19:14:28.812684] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T19:14:28.914053] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-15T19:14:29.714037] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-15T19:14:30.514028] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-15T19:14:30.607184] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:14:31.314001] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-15T19:14:31.326024] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T19:14:31.494879] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T19:14:32.114033] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-15T19:14:32.913970] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-15T19:14:33.230074] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T19:14:33.232913] [INFO ] [REMOTE ] GPI: Full fetch complete (21568 records). [2025-10-15T19:14:33.233001] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-15T19:14:33.387624] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T19:14:33.638588] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-15T19:14:33.638688] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-15T19:14:33.639174] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-15T19:14:33.639237] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-15T19:14:33.640673] [DEBUG] [LOCAL ] GPI: Trimmed 21568 records to 14894 (keeping 200 days of data) [2025-10-15T19:14:33.715798] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-15T19:14:33.738446] [DEBUG] [LOCAL ] GPI: Primary data saved (14894 records). [2025-10-15T19:14:33.738667] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-15T19:14:33.738774] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPI took 38.1s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-15T19:14:34.213152] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T19:14:34.219105] [INFO ] [REMOTE ] GPC: Full fetch complete (68723 records). [2025-10-15T19:14:34.219222] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-15T19:14:34.612456] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-15T19:14:34.612559] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-15T19:14:34.613511] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-15T19:14:34.613577] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-15T19:14:34.615216] [DEBUG] [LOCAL ] GPC: Trimmed 68723 records to 46017 (keeping 200 days of data) [2025-10-15T19:14:34.912743] [DEBUG] [LOCAL ] GPC: Primary data saved (46017 records). [2025-10-15T19:14:34.912892] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-15T19:14:34.912967] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPC took 44.5s. Estimated remaining: 3h 17m 46s. Rate: 7.1 symbols/min [2025-10-15T19:14:35.158242] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:14:35.169758] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-15T19:14:36.646426] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:14:36.657446] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-15T19:14:38.019627] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T19:14:38.031188] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-15T19:14:40.003007] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T19:14:40.014592] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-15T19:14:41.736247] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T19:14:41.748090] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-15T19:14:44.526619] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-15T19:14:44.532996] [INFO ] [REMOTE ] GPK: Full fetch complete (75914 records). [2025-10-15T19:14:44.533124] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-15T19:14:44.927851] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-15T19:14:44.927928] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-15T19:14:44.928927] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-15T19:14:44.928992] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-15T19:14:44.930467] [DEBUG] [LOCAL ] GPK: Trimmed 75914 records to 52775 (keeping 200 days of data) [2025-10-15T19:14:45.249200] [DEBUG] [LOCAL ] GPK: Primary data saved (52775 records). [2025-10-15T19:14:45.249360] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-15T19:14:45.249452] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 26.4s. Estimated remaining: 3h 17m 40s. Rate: 7.1 symbols/min [2025-10-15T19:14:45.849722] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.875805] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.937536] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.957144] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.980108] [DEBUG] [LOCAL ] GPOR: Loaded 23269 existing records from primary storage. [2025-10-15T19:14:45.987308] [INFO ] [MAIN ] GPOR: Loaded 23269 existing records. [2025-10-15T19:14:46.153301] [DEBUG] [LOCAL ] GPMT: Loaded 25901 existing records from primary storage. [2025-10-15T19:14:46.195306] [INFO ] [MAIN ] GPMT: Loaded 25901 existing records. [2025-10-15T19:14:46.196312] [DEBUG] [LOCAL ] GPRK: Loaded 39628 existing records from primary storage. [2025-10-15T19:14:46.212190] [INFO ] [MAIN ] GPRK: Loaded 39628 existing records. [2025-10-15T19:14:46.170600] [DEBUG] [LOCAL ] GPN: Loaded 52040 existing records from primary storage. [2025-10-15T19:14:46.267939] [INFO ] [MAIN ] GPN: Loaded 52040 existing records. [2025-10-15T19:14:46.294701] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.363947] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.387332] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-15T19:14:46.445880] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-15T19:14:46.451189] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-15T19:14:46.831144] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.822819] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.869053] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.907506] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.869234] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.907616] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-15T19:14:46.918592] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.918841] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-15T19:14:46.929750] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-15T19:14:46.940192] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-15T19:14:46.924555] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-15T19:14:46.945436] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-15T19:14:46.969159] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-15T19:14:47.050772] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-15T19:14:47.061349] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-15T19:14:47.870258] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:47.993317] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-15T19:14:48.199951] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:48.233830] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-15T19:14:48.290583] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:48.293487] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-15T19:14:48.320318] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:48.320833] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-15T19:14:49.535405] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:14:49.541356] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-15T19:14:49.566242] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:14:49.572321] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-15T19:14:49.926925] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:14:49.935007] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-15T19:14:49.966004] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:14:49.976420] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-15T19:14:50.476864] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T19:14:50.482266] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-15T19:14:50.894018] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:14:50.900059] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-15T19:14:51.475045] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T19:14:51.488777] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-15T19:14:51.493632] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:14:51.504833] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-15T19:14:51.520486] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:14:51.526022] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-15T19:14:51.815210] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T19:14:51.820170] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-15T19:14:52.618809] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:14:52.628299] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-15T19:14:52.795358] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:14:52.806903] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-15T19:14:52.877871] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T19:14:52.893814] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-15T19:14:52.909366] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:14:52.918009] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-15T19:14:53.963721] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T19:14:53.971310] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-15T19:14:54.017792] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T19:14:54.023565] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-15T19:14:54.131032] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T19:14:54.164619] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T19:14:54.514033] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-15T19:14:54.663417] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:14:55.266263] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:14:55.313962] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-15T19:14:55.687267] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T19:14:56.114037] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-15T19:14:56.671358] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:14:56.913994] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-15T19:14:57.724309] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-15T19:14:57.747588] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T19:14:57.977426] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T19:14:58.514001] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-15T19:14:59.034283] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:14:59.314009] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-15T19:14:59.603792] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T19:15:00.113984] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-15T19:15:00.448098] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T19:15:00.914014] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-15T19:15:01.714021] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-15T19:15:01.812618] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:15:02.016208] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T19:15:02.514005] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-15T19:15:03.296753] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T19:15:03.313956] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-15T19:15:03.500013] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:15:04.114015] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-15T19:15:04.576380] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T19:15:04.913992] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-15T19:15:05.206559] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T19:15:05.210209] [INFO ] [REMOTE ] GPMT: Full fetch complete (36768 records). [2025-10-15T19:15:05.210374] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-15T19:15:05.649999] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-15T19:15:05.650101] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-15T19:15:05.650915] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-15T19:15:05.650980] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-15T19:15:05.651997] [DEBUG] [LOCAL ] GPMT: Trimmed 36768 records to 25932 (keeping 200 days of data) [2025-10-15T19:15:05.740322] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-15T19:15:05.813595] [DEBUG] [LOCAL ] GPMT: Primary data saved (25932 records). [2025-10-15T19:15:05.813862] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-15T19:15:05.813978] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPMT took 20.6s. Estimated remaining: 3h 17m 50s. Rate: 7.1 symbols/min [2025-10-15T19:15:05.994433] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:06.020544] [DEBUG] [LOCAL ] GRBK: Loaded 27177 existing records from primary storage. [2025-10-15T19:15:06.020825] [INFO ] [MAIN ] GRBK: Loaded 27177 existing records. [2025-10-15T19:15:06.209872] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:06.210241] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-15T19:15:06.210470] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-15T19:15:06.210990] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-15T19:15:06.211050] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-15T19:15:06.349995] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:15:06.519153] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-15T19:15:06.608759] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:06.886239] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:15:07.313972] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-15T19:15:08.082697] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:15:08.113962] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-15T19:15:08.652427] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T19:15:08.914035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-15T19:15:09.714025] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-15T19:15:09.764038] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:15:09.771771] [INFO ] [REMOTE ] GPRK: Full fetch complete (58081 records). [2025-10-15T19:15:09.771952] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-15T19:15:10.126180] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:15:10.179071] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-15T19:15:10.179163] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-15T19:15:10.180266] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-15T19:15:10.180332] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-15T19:15:10.181623] [DEBUG] [LOCAL ] GPRK: Trimmed 58081 records to 39736 (keeping 200 days of data) [2025-10-15T19:15:10.422405] [DEBUG] [LOCAL ] GPRK: Primary data saved (39736 records). [2025-10-15T19:15:10.422586] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-15T19:15:10.423563] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPRK took 25.2s. Estimated remaining: 3h 17m 36s. Rate: 7.1 symbols/min [2025-10-15T19:15:10.519236] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-15T19:15:10.608871] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:10.624561] [DEBUG] [LOCAL ] GRC: Loaded 9280 existing records from primary storage. [2025-10-15T19:15:10.624844] [INFO ] [MAIN ] GRC: Loaded 9280 existing records. [2025-10-15T19:15:10.868360] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:10.868698] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-15T19:15:10.868778] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-15T19:15:10.869068] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-15T19:15:10.869148] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-15T19:15:11.329761] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-15T19:15:11.383358] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:11.472025] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:15:11.810849] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T19:15:11.814960] [INFO ] [REMOTE ] GPOR: Full fetch complete (35074 records). [2025-10-15T19:15:11.815093] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-15T19:15:12.119125] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-15T19:15:12.193954] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-15T19:15:12.194131] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-15T19:15:12.194807] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-15T19:15:12.194868] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-15T19:15:12.195897] [DEBUG] [LOCAL ] GPOR: Trimmed 35074 records to 23324 (keeping 200 days of data) [2025-10-15T19:15:12.333939] [DEBUG] [LOCAL ] GPOR: Primary data saved (23324 records). [2025-10-15T19:15:12.334126] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-15T19:15:12.334279] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPOR took 27.1s. Estimated remaining: 3h 17m 18s. Rate: 7.1 symbols/min [2025-10-15T19:15:12.501700] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:12.518680] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T19:15:12.540214] [DEBUG] [LOCAL ] GRDN: Loaded 20872 existing records from primary storage. [2025-10-15T19:15:12.540450] [INFO ] [MAIN ] GRDN: Loaded 20872 existing records. [2025-10-15T19:15:12.722208] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:12.722707] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-15T19:15:12.728238] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-15T19:15:12.728983] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T19:15:12.729022] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-15T19:15:12.729867] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-15T19:15:12.921159] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-15T19:15:13.074866] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:13.714039] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-15T19:15:13.891152] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:15:14.514018] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-15T19:15:14.736677] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:15:15.043916] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T19:15:15.314009] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-15T19:15:16.079302] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T19:15:16.113977] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-15T19:15:16.914008] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-15T19:15:16.964235] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T19:15:17.713998] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-15T19:15:18.429812] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:15:18.457003] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T19:15:18.514000] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-15T19:15:19.314041] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-15T19:15:19.803609] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:15:20.114030] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-15T19:15:20.756067] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T19:15:20.883498] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:15:20.913959] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-15T19:15:21.714025] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-15T19:15:22.513978] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-15T19:15:22.569691] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T19:15:22.634939] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T19:15:23.313992] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-15T19:15:23.861157] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:15:24.113995] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-15T19:15:24.784494] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:15:24.790629] [INFO ] [REMOTE ] GPN: Full fetch complete (75093 records). [2025-10-15T19:15:24.790773] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-15T19:15:24.919113] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-15T19:15:25.202821] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-15T19:15:25.202914] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-15T19:15:25.204025] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-15T19:15:25.204149] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-15T19:15:25.205608] [DEBUG] [LOCAL ] GPN: Trimmed 75093 records to 52001 (keeping 200 days of data) [2025-10-15T19:15:25.469453] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:15:25.555226] [DEBUG] [LOCAL ] GPN: Primary data saved (52001 records). [2025-10-15T19:15:25.555371] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-15T19:15:25.555455] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 40.3s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-15T19:15:25.723775] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:25.720162] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-15T19:15:25.732482] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:15:25.772213] [DEBUG] [LOCAL ] GRMN: Loaded 40470 existing records from primary storage. [2025-10-15T19:15:25.772503] [INFO ] [MAIN ] GRMN: Loaded 40470 existing records. [2025-10-15T19:15:25.943260] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:25.943456] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-15T19:15:25.943502] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-15T19:15:25.943717] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-15T19:15:25.943773] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-15T19:15:26.288214] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:26.508042] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T19:15:26.513954] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-15T19:15:27.313989] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-15T19:15:27.334843] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:15:28.114001] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-15T19:15:28.295730] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T19:15:28.891084] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:15:28.913975] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-15T19:15:29.714006] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-15T19:15:29.857456] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:15:29.859456] [INFO ] [REMOTE ] GRC: Full fetch complete (13334 records). [2025-10-15T19:15:29.859531] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-15T19:15:30.222281] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-15T19:15:30.222359] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-15T19:15:30.222677] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-15T19:15:30.222738] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-15T19:15:30.223215] [DEBUG] [LOCAL ] GRC: Trimmed 13334 records to 9292 (keeping 200 days of data) [2025-10-15T19:15:30.279892] [DEBUG] [LOCAL ] GRC: Primary data saved (9292 records). [2025-10-15T19:15:30.280014] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-15T19:15:30.280093] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRC took 19.9s. Estimated remaining: 3h 17m 2s. Rate: 7.1 symbols/min [2025-10-15T19:15:30.462007] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:15:30.463749] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:30.515157] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-15T19:15:30.518456] [DEBUG] [LOCAL ] GRND: Loaded 50090 existing records from primary storage. [2025-10-15T19:15:30.518773] [INFO ] [MAIN ] GRND: Loaded 50090 existing records. [2025-10-15T19:15:30.696145] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:30.696357] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-15T19:15:30.696408] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-15T19:15:30.696776] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-15T19:15:30.696835] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-15T19:15:31.050528] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:31.313994] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-15T19:15:31.582513] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:15:32.114069] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-15T19:15:32.848820] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T19:15:32.913967] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-15T19:15:33.037437] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T19:15:33.714010] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-15T19:15:34.247629] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T19:15:34.513968] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-15T19:15:35.288435] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T19:15:35.313983] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-15T19:15:35.342635] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T19:15:36.114056] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-15T19:15:36.870673] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T19:15:36.913960] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-15T19:15:37.102100] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:15:37.714019] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-15T19:15:38.102361] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:15:38.355765] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T19:15:38.513985] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-15T19:15:39.314006] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-15T19:15:39.579046] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:15:40.114035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-15T19:15:40.729931] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:15:40.914011] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-15T19:15:41.125347] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T19:15:41.714067] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-15T19:15:42.300147] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T19:15:42.514023] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-15T19:15:43.038191] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T19:15:43.313998] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-15T19:15:44.042897] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:15:44.113984] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-15T19:15:44.558755] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T19:15:44.914002] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-15T19:15:45.713976] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-15T19:15:45.895295] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T19:15:46.104433] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T19:15:46.108248] [INFO ] [REMOTE ] GRBK: Full fetch complete (40518 records). [2025-10-15T19:15:46.108333] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-15T19:15:46.488296] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-15T19:15:46.488370] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-15T19:15:46.489092] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-15T19:15:46.489158] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-15T19:15:46.490058] [DEBUG] [LOCAL ] GRBK: Trimmed 40518 records to 27164 (keeping 200 days of data) [2025-10-15T19:15:46.537093] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-15T19:15:46.664233] [DEBUG] [LOCAL ] GRBK: Primary data saved (27164 records). [2025-10-15T19:15:46.664371] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-15T19:15:46.664453] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 40.9s. Estimated remaining: 3h 17m 5s. Rate: 7.1 symbols/min [2025-10-15T19:15:46.846430] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:46.847321] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:15:46.851272] [INFO ] [REMOTE ] GRDN: Full fetch complete (26411 records). [2025-10-15T19:15:46.851376] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-15T19:15:47.087685] [DEBUG] [LOCAL ] GRNT: Loaded 33969 existing records from primary storage. [2025-10-15T19:15:47.125456] [INFO ] [MAIN ] GRNT: Loaded 33969 existing records. [2025-10-15T19:15:47.328908] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-15T19:15:47.396699] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-15T19:15:47.420610] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-15T19:15:47.426693] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-15T19:15:47.426776] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-15T19:15:47.426070] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:47.426997] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-15T19:15:47.427058] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-15T19:15:47.427417] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-15T19:15:47.427487] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-15T19:15:47.460713] [DEBUG] [LOCAL ] GRDN: Trimmed 26411 records to 20984 (keeping 200 days of data) [2025-10-15T19:15:47.845576] [DEBUG] [LOCAL ] GRDN: Primary data saved (20984 records). [2025-10-15T19:15:47.855948] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-15T19:15:47.868564] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 35.5s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-15T19:15:47.923054] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:48.095706] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:48.106074] [DEBUG] [LOCAL ] GROV: Loaded 8717 existing records from primary storage. [2025-10-15T19:15:48.106261] [INFO ] [MAIN ] GROV: Loaded 8717 existing records. [2025-10-15T19:15:48.136193] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-15T19:15:48.291558] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T19:15:48.323850] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:48.324553] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-15T19:15:48.324614] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-15T19:15:48.324790] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-15T19:15:48.324842] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-15T19:15:48.679337] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:48.716201] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:15:48.914001] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-15T19:15:49.510829] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T19:15:49.643857] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T19:15:49.713983] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-15T19:15:50.513996] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-15T19:15:51.302359] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:15:51.317972] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-15T19:15:51.352393] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T19:15:52.113990] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-15T19:15:52.390440] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:15:52.866683] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T19:15:52.913946] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-15T19:15:53.459025] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:15:53.713997] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-15T19:15:54.514047] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-15T19:15:55.313967] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-15T19:15:55.473003] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:15:55.521832] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:15:55.733456] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T19:15:56.114045] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-15T19:15:56.914010] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-15T19:15:57.665386] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:15:57.665751] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:15:57.714004] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-15T19:15:58.408150] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T19:15:58.513995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-15T19:15:59.313962] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-15T19:15:59.600268] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:16:00.114019] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-15T19:16:00.278714] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T19:16:00.913992] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-15T19:16:01.502953] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T19:16:01.713969] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-15T19:16:02.515754] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-15T19:16:02.538776] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:16:02.568582] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T19:16:03.308839] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T19:16:03.313950] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-15T19:16:03.925608] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T19:16:04.113987] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-15T19:16:04.913989] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-15T19:16:05.644435] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T19:16:05.713965] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-15T19:16:06.514024] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-15T19:16:06.585432] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T19:16:07.230208] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:16:07.234745] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:16:07.234944] [INFO ] [REMOTE ] GROV: Full fetch complete (14020 records). [2025-10-15T19:16:07.243252] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-15T19:16:07.319271] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-15T19:16:07.635638] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-15T19:16:07.635747] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-15T19:16:07.635975] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-15T19:16:07.636015] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-15T19:16:07.636444] [DEBUG] [LOCAL ] GROV: Trimmed 14020 records to 8760 (keeping 200 days of data) [2025-10-15T19:16:07.683773] [DEBUG] [LOCAL ] GROV: Primary data saved (8760 records). [2025-10-15T19:16:07.683877] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-15T19:16:07.683954] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GROV took 19.8s. Estimated remaining: 3h 16m 55s. Rate: 7.1 symbols/min [2025-10-15T19:16:07.847529] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:07.854148] [DEBUG] [LOCAL ] GRX: Loaded 4788 existing records from primary storage. [2025-10-15T19:16:07.854325] [INFO ] [MAIN ] GRX: Loaded 4788 existing records. [2025-10-15T19:16:08.025300] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:08.025477] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-15T19:16:08.025523] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-15T19:16:08.025694] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-15T19:16:08.025761] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-15T19:16:08.123503] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-15T19:16:08.372912] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:08.842676] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:16:08.914029] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-15T19:16:09.578437] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:16:09.714020] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-15T19:16:10.129427] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T19:16:10.371815] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:16:10.376402] [INFO ] [REMOTE ] GRMN: Full fetch complete (59691 records). [2025-10-15T19:16:10.376590] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-15T19:16:10.519139] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-15T19:16:10.762563] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-15T19:16:10.762635] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-15T19:16:10.763550] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-15T19:16:10.763597] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-15T19:16:10.764885] [DEBUG] [LOCAL ] GRMN: Trimmed 59691 records to 40425 (keeping 200 days of data) [2025-10-15T19:16:11.015429] [DEBUG] [LOCAL ] GRMN: Primary data saved (40425 records). [2025-10-15T19:16:11.015558] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-15T19:16:11.015633] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRMN took 45.5s. Estimated remaining: 3h 16m 39s. Rate: 7.1 symbols/min [2025-10-15T19:16:11.183457] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:11.188588] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:16:11.237977] [DEBUG] [LOCAL ] GS: Loaded 51784 existing records from primary storage. [2025-10-15T19:16:11.238310] [INFO ] [MAIN ] GS: Loaded 51784 existing records. [2025-10-15T19:16:11.319184] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-15T19:16:11.413259] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:11.413453] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-15T19:16:11.413498] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-15T19:16:11.414531] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-15T19:16:11.414588] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-15T19:16:11.764525] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:12.114017] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-15T19:16:12.755427] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T19:16:12.914013] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-15T19:16:13.391287] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T19:16:13.713963] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-15T19:16:13.927274] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:16:14.514052] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-15T19:16:15.060411] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:16:15.101890] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:16:15.314000] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-15T19:16:16.114039] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-15T19:16:16.517814] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:16:16.914005] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-15T19:16:17.471818] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:16:17.719319] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-15T19:16:17.732444] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:16:18.513985] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-15T19:16:19.319157] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-15T19:16:19.331164] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:16:19.822844] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:16:19.827114] [INFO ] [REMOTE ] GRNT: Full fetch complete (48269 records). [2025-10-15T19:16:19.827237] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-15T19:16:20.119142] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-15T19:16:20.206840] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-15T19:16:20.206939] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-15T19:16:20.208011] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-15T19:16:20.208077] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-15T19:16:20.209176] [DEBUG] [LOCAL ] GRNT: Trimmed 48269 records to 33966 (keeping 200 days of data) [2025-10-15T19:16:20.405976] [DEBUG] [LOCAL ] GRNT: Primary data saved (33966 records). [2025-10-15T19:16:20.406122] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-15T19:16:20.406462] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GRNT took 33.7s. Estimated remaining: 3h 16m 32s. Rate: 7.1 symbols/min [2025-10-15T19:16:20.572361] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:20.612919] [DEBUG] [LOCAL ] GSBD: Loaded 39648 existing records from primary storage. [2025-10-15T19:16:20.613241] [INFO ] [MAIN ] GSBD: Loaded 39648 existing records. [2025-10-15T19:16:20.789477] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:20.789708] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-15T19:16:20.789763] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-15T19:16:20.790163] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-15T19:16:20.790218] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-15T19:16:20.919233] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-15T19:16:21.155995] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:21.309317] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T19:16:21.502093] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:16:21.512129] [INFO ] [REMOTE ] GRND: Full fetch complete (71557 records). [2025-10-15T19:16:21.512326] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-15T19:16:21.642437] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:16:21.719140] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-15T19:16:22.054430] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-15T19:16:22.054559] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-15T19:16:22.056453] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-15T19:16:22.056557] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-15T19:16:22.058832] [DEBUG] [LOCAL ] GRND: Trimmed 71557 records to 50119 (keeping 200 days of data) [2025-10-15T19:16:22.447497] [DEBUG] [LOCAL ] GRND: Primary data saved (50119 records). [2025-10-15T19:16:22.447737] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-15T19:16:22.447867] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 52.2s. Estimated remaining: 3h 16m 14s. Rate: 7.1 symbols/min [2025-10-15T19:16:22.522736] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-15T19:16:22.676328] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:22.736732] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-15T19:16:22.737087] [INFO ] [MAIN ] GSK: Loaded 53502 existing records. [2025-10-15T19:16:22.911834] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:22.912047] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-15T19:16:22.912094] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-15T19:16:22.913205] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-15T19:16:22.913264] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-15T19:16:23.259250] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:23.314026] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-15T19:16:23.516738] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T19:16:24.113984] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-15T19:16:24.260578] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:16:24.914062] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-15T19:16:25.102756] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T19:16:25.454801] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T19:16:25.714043] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-15T19:16:26.513993] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-15T19:16:27.108429] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:16:27.122075] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T19:16:27.170301] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-15T19:16:27.314065] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-15T19:16:28.114110] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-15T19:16:28.852306] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:16:28.913970] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-15T19:16:29.714003] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-15T19:16:30.515937] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-15T19:16:30.544386] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-15T19:16:30.558109] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:16:31.015326] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T19:16:31.242604] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:16:31.314013] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-15T19:16:31.897033] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T19:16:32.113984] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-15T19:16:32.682567] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:16:32.913990] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-15T19:16:33.714014] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-15T19:16:34.513972] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-15T19:16:34.800243] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T19:16:35.212575] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T19:16:35.213810] [INFO ] [REMOTE ] GRX: Full fetch complete (6525 records). [2025-10-15T19:16:35.213880] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-15T19:16:35.319129] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-15T19:16:35.567339] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-15T19:16:35.567411] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-15T19:16:35.567580] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-15T19:16:35.567618] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-15T19:16:35.568054] [DEBUG] [LOCAL ] GRX: Trimmed 6525 records to 4797 (keeping 200 days of data) [2025-10-15T19:16:35.596368] [DEBUG] [LOCAL ] GRX: Primary data saved (4797 records). [2025-10-15T19:16:35.596487] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-15T19:16:35.596563] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 27.9s. Estimated remaining: 3h 16m 13s. Rate: 7.1 symbols/min [2025-10-15T19:16:35.762094] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:35.792738] [DEBUG] [LOCAL ] GSL: Loaded 33267 existing records from primary storage. [2025-10-15T19:16:35.793019] [INFO ] [MAIN ] GSL: Loaded 33267 existing records. [2025-10-15T19:16:35.968863] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:35.969138] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-15T19:16:35.969275] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-15T19:16:35.969898] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-15T19:16:35.969955] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-15T19:16:36.116552] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-15T19:16:36.324376] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:36.353632] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-15T19:16:36.913972] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-15T19:16:37.341990] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T19:16:37.375283] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:16:37.714008] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-15T19:16:38.514019] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-15T19:16:38.651171] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:16:38.855866] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:16:39.313994] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-15T19:16:40.113985] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-15T19:16:40.455570] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T19:16:40.792970] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:16:40.914085] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-15T19:16:41.714100] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-15T19:16:41.904009] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:16:42.134520] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:16:42.514018] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-15T19:16:42.768922] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T19:16:43.313996] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-15T19:16:44.113970] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-15T19:16:44.505803] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T19:16:44.599268] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T19:16:44.914023] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-15T19:16:45.713969] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-15T19:16:45.848885] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T19:16:46.513983] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-15T19:16:46.904451] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T19:16:47.302736] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T19:16:47.313941] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-15T19:16:47.415293] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:16:48.114029] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-15T19:16:48.740733] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T19:16:48.746802] [INFO ] [REMOTE ] GSBD: Full fetch complete (58688 records). [2025-10-15T19:16:48.746937] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-15T19:16:48.938312] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-15T19:16:49.175772] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-15T19:16:49.175853] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-15T19:16:49.176979] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-15T19:16:49.177066] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-15T19:16:49.178347] [DEBUG] [LOCAL ] GSBD: Trimmed 58688 records to 39619 (keeping 200 days of data) [2025-10-15T19:16:49.443905] [DEBUG] [LOCAL ] GSBD: Primary data saved (39619 records). [2025-10-15T19:16:49.444098] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-15T19:16:49.444406] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GSBD took 29.0s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-15T19:16:49.643354] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:49.691583] [DEBUG] [LOCAL ] GTES: Loaded 50384 existing records from primary storage. [2025-10-15T19:16:49.692084] [INFO ] [MAIN ] GTES: Loaded 50384 existing records. [2025-10-15T19:16:49.735931] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-15T19:16:49.791942] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:16:49.899773] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T19:16:49.936599] [INFO ] [REMOTE ] GS: Full fetch complete (75806 records). [2025-10-15T19:16:49.952747] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-15T19:16:49.977357] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:50.046167] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-15T19:16:50.059089] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-15T19:16:50.077022] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-15T19:16:50.085356] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-15T19:16:50.521786] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-15T19:16:50.731267] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-15T19:16:50.770604] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-15T19:16:50.774572] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:50.776022] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-15T19:16:50.776447] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-15T19:16:50.778041] [DEBUG] [LOCAL ] GS: Trimmed 75806 records to 51783 (keeping 200 days of data) [2025-10-15T19:16:51.033151] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T19:16:51.137822] [DEBUG] [LOCAL ] GS: Primary data saved (51783 records). [2025-10-15T19:16:51.137948] [INFO ] [MAIN ] GS: Full history saved. [2025-10-15T19:16:51.138025] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GS took 40.1s. Estimated remaining: 3h 15m 54s. Rate: 7.1 symbols/min [2025-10-15T19:16:51.304978] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:51.313974] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-15T19:16:51.347264] [DEBUG] [LOCAL ] GTLS: Loaded 43298 existing records from primary storage. [2025-10-15T19:16:51.347536] [INFO ] [MAIN ] GTLS: Loaded 43298 existing records. [2025-10-15T19:16:51.522842] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:51.523030] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-15T19:16:51.523078] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-15T19:16:51.523355] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-15T19:16:51.523395] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-15T19:16:51.875223] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:52.113964] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-15T19:16:52.545334] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:16:52.595343] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:16:52.913999] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-15T19:16:53.330599] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:16:53.714051] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-15T19:16:54.513980] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-15T19:16:54.782455] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:16:55.282891] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T19:16:55.313953] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-15T19:16:55.952559] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:16:56.113980] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-15T19:16:56.885295] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T19:16:56.913969] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-15T19:16:57.622562] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:16:57.713953] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-15T19:16:57.837243] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T19:16:58.513984] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-15T19:16:59.264224] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:16:59.313958] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-15T19:16:59.938576] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:17:00.113997] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-15T19:17:00.914018] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-15T19:17:01.473670] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T19:17:01.713982] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-15T19:17:01.774071] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T19:17:01.781220] [INFO ] [REMOTE ] GSK: Full fetch complete (77635 records). [2025-10-15T19:17:01.781428] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-15T19:17:02.202635] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-15T19:17:02.202874] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-15T19:17:02.204753] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-15T19:17:02.204831] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-15T19:17:02.207106] [DEBUG] [LOCAL ] GSK: Trimmed 77635 records to 53505 (keeping 200 days of data) [2025-10-15T19:17:02.485971] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T19:17:02.514110] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-15T19:17:02.618182] [DEBUG] [LOCAL ] GSK: Primary data saved (53505 records). [2025-10-15T19:17:02.618430] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-15T19:17:02.618592] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSK took 40.2s. Estimated remaining: 3h 15m 50s. Rate: 7.1 symbols/min [2025-10-15T19:17:02.821021] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:02.869034] [DEBUG] [LOCAL ] GTN: Loaded 45235 existing records from primary storage. [2025-10-15T19:17:02.869463] [INFO ] [MAIN ] GTN: Loaded 45235 existing records. [2025-10-15T19:17:03.060304] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:03.060590] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-15T19:17:03.060666] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-15T19:17:03.061906] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-15T19:17:03.061964] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-15T19:17:03.320325] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-15T19:17:03.463540] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:03.494123] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T19:17:04.079055] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:17:04.113961] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-15T19:17:04.759739] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T19:17:04.913981] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-15T19:17:05.713982] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-15T19:17:05.776928] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T19:17:06.513971] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-15T19:17:06.593540] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:17:07.204113] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:17:07.313973] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-15T19:17:07.959900] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:17:08.113984] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-15T19:17:08.719408] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:17:08.914021] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-15T19:17:09.714075] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-15T19:17:09.794534] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:17:10.500338] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:17:10.513938] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-15T19:17:11.314027] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-15T19:17:11.394284] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:17:12.113994] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-15T19:17:12.226468] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T19:17:12.392469] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:17:12.914020] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-15T19:17:13.436043] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:17:13.440159] [INFO ] [REMOTE ] GSL: Full fetch complete (48264 records). [2025-10-15T19:17:13.440248] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-15T19:17:13.722813] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-15T19:17:13.816083] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-15T19:17:13.816177] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-15T19:17:13.816956] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-15T19:17:13.817017] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-15T19:17:13.818185] [DEBUG] [LOCAL ] GSL: Trimmed 48264 records to 33284 (keeping 200 days of data) [2025-10-15T19:17:14.034624] [DEBUG] [LOCAL ] GSL: Primary data saved (33284 records). [2025-10-15T19:17:14.034799] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-15T19:17:14.034887] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GSL took 38.4s. Estimated remaining: 3h 15m 46s. Rate: 7.1 symbols/min [2025-10-15T19:17:14.241494] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:14.279873] [DEBUG] [LOCAL ] GTY: Loaded 30186 existing records from primary storage. [2025-10-15T19:17:14.280256] [INFO ] [MAIN ] GTY: Loaded 30186 existing records. [2025-10-15T19:17:14.508745] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:14.509041] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-15T19:17:14.509320] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-15T19:17:14.509549] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-15T19:17:14.509606] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-15T19:17:14.521920] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-15T19:17:14.871185] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T19:17:15.059792] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:15.319082] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-15T19:17:15.347821] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:17:16.113978] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-15T19:17:16.253327] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T19:17:16.470723] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T19:17:16.914044] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-15T19:17:17.438662] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:17:17.714008] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-15T19:17:18.520524] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-15T19:17:18.537267] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:17:19.155633] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T19:17:19.313993] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-15T19:17:19.781955] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:17:20.113999] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-15T19:17:20.913962] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-15T19:17:21.039301] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:17:21.470675] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T19:17:21.476753] [INFO ] [REMOTE ] GTES: Full fetch complete (73905 records). [2025-10-15T19:17:21.476872] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-15T19:17:21.727108] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-15T19:17:21.858919] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-15T19:17:21.858998] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-15T19:17:21.859984] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-15T19:17:21.860047] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-15T19:17:21.861389] [DEBUG] [LOCAL ] GTES: Trimmed 73905 records to 50380 (keeping 200 days of data) [2025-10-15T19:17:22.177825] [DEBUG] [LOCAL ] GTES: Primary data saved (50380 records). [2025-10-15T19:17:22.178032] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-15T19:17:22.178444] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTES took 32.7s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-10-15T19:17:22.359108] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:22.373975] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-10-15T19:17:22.374228] [INFO ] [MAIN ] GUG: Loaded 12212 existing records. [2025-10-15T19:17:22.519691] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-15T19:17:22.565623] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:22.565883] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-15T19:17:22.565933] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-15T19:17:22.566107] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-15T19:17:22.566162] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-15T19:17:22.752067] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:17:22.995691] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:23.010964] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:17:23.314080] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-15T19:17:23.959000] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T19:17:24.114045] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-15T19:17:24.919111] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-15T19:17:24.934155] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:17:25.088330] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T19:17:25.714074] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-15T19:17:26.492351] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:17:26.497527] [INFO ] [REMOTE ] GTLS: Full fetch complete (61577 records). [2025-10-15T19:17:26.497630] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-15T19:17:26.522484] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-15T19:17:26.911749] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-15T19:17:26.911841] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-15T19:17:26.912905] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-15T19:17:26.912970] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-15T19:17:26.914429] [DEBUG] [LOCAL ] GTLS: Trimmed 61577 records to 43272 (keeping 200 days of data) [2025-10-15T19:17:27.192757] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:17:27.247840] [DEBUG] [LOCAL ] GTLS: Primary data saved (43272 records). [2025-10-15T19:17:27.247989] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-15T19:17:27.248084] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTLS took 36.1s. Estimated remaining: 3h 15m 24s. Rate: 7.1 symbols/min [2025-10-15T19:17:27.319936] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-15T19:17:27.447550] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:27.465210] [DEBUG] [LOCAL ] GUT: Loaded 15591 existing records from primary storage. [2025-10-15T19:17:27.465538] [INFO ] [MAIN ] GUT: Loaded 15591 existing records. [2025-10-15T19:17:27.663985] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:27.664315] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-15T19:17:27.664366] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-15T19:17:27.665106] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-15T19:17:27.665165] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-15T19:17:28.098322] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:28.115160] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-15T19:17:28.134125] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:17:28.134962] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T19:17:28.913997] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-15T19:17:29.480628] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:17:29.713996] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-15T19:17:30.382587] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:17:30.513992] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-15T19:17:30.895215] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T19:17:31.314002] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-15T19:17:31.848301] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T19:17:32.076072] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T19:17:32.113968] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-15T19:17:32.752824] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T19:17:32.913994] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-15T19:17:33.714001] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-15T19:17:34.079979] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T19:17:34.230196] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T19:17:34.514055] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-15T19:17:35.314049] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-15T19:17:35.960718] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:17:36.114035] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-15T19:17:36.301843] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:17:36.714198] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T19:17:36.914051] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-15T19:17:37.713977] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-15T19:17:37.985472] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:17:38.514042] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-15T19:17:38.592359] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:17:39.313979] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-15T19:17:39.340774] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T19:17:40.114013] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-15T19:17:40.818736] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:17:40.824105] [INFO ] [REMOTE ] GTN: Full fetch complete (66210 records). [2025-10-15T19:17:40.824229] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-15T19:17:40.920206] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-15T19:17:41.218232] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-15T19:17:41.218314] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-15T19:17:41.219343] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-15T19:17:41.219407] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-15T19:17:41.220695] [DEBUG] [LOCAL ] GTN: Trimmed 66210 records to 45215 (keeping 200 days of data) [2025-10-15T19:17:41.437353] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:17:41.503127] [DEBUG] [LOCAL ] GTN: Primary data saved (45215 records). [2025-10-15T19:17:41.503256] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-15T19:17:41.503337] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 38.9s. Estimated remaining: 3h 15m 23s. Rate: 7.1 symbols/min [2025-10-15T19:17:41.672721] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:41.706060] [DEBUG] [LOCAL ] GVA: Loaded 32725 existing records from primary storage. [2025-10-15T19:17:41.706320] [INFO ] [MAIN ] GVA: Loaded 32725 existing records. [2025-10-15T19:17:41.719117] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-15T19:17:41.897185] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:17:41.901047] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:41.905337] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-15T19:17:41.905410] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-15T19:17:41.905698] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-15T19:17:41.905755] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-15T19:17:42.257006] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:42.513993] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-15T19:17:43.105428] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:17:43.109713] [INFO ] [REMOTE ] GTY: Full fetch complete (43926 records). [2025-10-15T19:17:43.109811] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-15T19:17:43.319059] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-15T19:17:43.463015] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:17:43.527468] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-15T19:17:43.527546] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-15T19:17:43.528365] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-15T19:17:43.528427] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-15T19:17:43.529408] [DEBUG] [LOCAL ] GTY: Trimmed 43926 records to 30274 (keeping 200 days of data) [2025-10-15T19:17:43.710110] [DEBUG] [LOCAL ] GTY: Primary data saved (30274 records). [2025-10-15T19:17:43.710247] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-15T19:17:43.710329] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTY took 29.7s. Estimated remaining: 3h 15m 6s. Rate: 7.1 symbols/min [2025-10-15T19:17:43.875931] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:43.894330] [DEBUG] [LOCAL ] GWH: Loaded 18271 existing records from primary storage. [2025-10-15T19:17:43.894566] [INFO ] [MAIN ] GWH: Loaded 18271 existing records. [2025-10-15T19:17:44.074760] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:44.074962] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-15T19:17:44.075008] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-15T19:17:44.075212] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-15T19:17:44.075268] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-15T19:17:44.117685] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-15T19:17:44.378250] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:17:44.462168] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:44.915948] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-15T19:17:44.919534] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:17:45.713988] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-15T19:17:46.249531] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:17:46.275814] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-15T19:17:46.513986] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-15T19:17:47.314037] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-15T19:17:47.365411] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T19:17:48.088028] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:17:48.113948] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-15T19:17:48.915410] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-15T19:17:48.918018] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:17:49.713985] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-15T19:17:49.724620] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:17:50.513986] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-15T19:17:51.063386] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:17:51.111172] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T19:17:51.314008] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-15T19:17:52.113995] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-15T19:17:52.333211] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T19:17:52.914030] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-15T19:17:53.387524] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T19:17:53.629024] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T19:17:53.713987] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-15T19:17:54.513992] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-15T19:17:55.224371] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T19:17:55.276750] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T19:17:55.278865] [INFO ] [REMOTE ] GUG: Full fetch complete (19185 records). [2025-10-15T19:17:55.278937] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-15T19:17:55.319156] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-15T19:17:55.717536] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-15T19:17:55.717615] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-15T19:17:55.718200] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-15T19:17:55.718264] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-15T19:17:55.719081] [DEBUG] [LOCAL ] GUG: Trimmed 19185 records to 12167 (keeping 200 days of data) [2025-10-15T19:17:55.802353] [DEBUG] [LOCAL ] GUG: Primary data saved (12167 records). [2025-10-15T19:17:55.802487] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-15T19:17:55.802568] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 33.6s. Estimated remaining: 3h 15m 3s. Rate: 7.1 symbols/min [2025-10-15T19:17:55.969371] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:56.009083] [DEBUG] [LOCAL ] GWRE: Loaded 39976 existing records from primary storage. [2025-10-15T19:17:56.009410] [INFO ] [MAIN ] GWRE: Loaded 39976 existing records. [2025-10-15T19:17:56.119122] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-15T19:17:56.189946] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:56.190511] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-15T19:17:56.190593] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-15T19:17:56.190880] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-15T19:17:56.190937] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-15T19:17:56.508261] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T19:17:56.583297] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:56.918754] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-15T19:17:56.921896] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:17:57.714012] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-15T19:17:58.449304] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:17:58.513985] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-15T19:17:58.710436] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:17:59.313996] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-15T19:17:59.726046] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T19:18:00.114024] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-15T19:18:00.380437] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:18:00.913962] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-15T19:18:01.244312] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T19:18:01.714004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-15T19:18:02.257283] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:18:02.513970] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-15T19:18:02.640631] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T19:18:03.314006] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-15T19:18:04.113988] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-15T19:18:04.258574] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T19:18:04.584580] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T19:18:04.791931] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T19:18:04.913994] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-15T19:18:05.713975] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-15T19:18:06.222999] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:18:06.514011] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-15T19:18:07.177400] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T19:18:07.314066] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-15T19:18:07.837407] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:18:08.032013] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:18:08.035922] [INFO ] [REMOTE ] GUT: Full fetch complete (22605 records). [2025-10-15T19:18:08.036127] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-15T19:18:08.119264] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-15T19:18:08.475938] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-15T19:18:08.476032] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-15T19:18:08.476504] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-15T19:18:08.476545] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-15T19:18:08.477347] [DEBUG] [LOCAL ] GUT: Trimmed 22605 records to 15593 (keeping 200 days of data) [2025-10-15T19:18:08.569694] [DEBUG] [LOCAL ] GUT: Primary data saved (15593 records). [2025-10-15T19:18:08.569850] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-15T19:18:08.569937] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUT took 41.3s. Estimated remaining: 3h 15m 1s. Rate: 7.1 symbols/min [2025-10-15T19:18:08.750391] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:08.770608] [DEBUG] [LOCAL ] GWW: Loaded 19603 existing records from primary storage. [2025-10-15T19:18:08.770878] [INFO ] [MAIN ] GWW: Loaded 19603 existing records. [2025-10-15T19:18:08.922693] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-15T19:18:08.947415] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:08.947915] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-15T19:18:08.947969] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-15T19:18:08.948248] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-15T19:18:08.948303] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-15T19:18:09.291010] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:09.713992] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-15T19:18:09.775290] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T19:18:10.072756] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T19:18:10.513983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-15T19:18:10.673582] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T19:18:11.314046] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-15T19:18:12.098394] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:18:12.103146] [INFO ] [REMOTE ] GWH: Full fetch complete (23302 records). [2025-10-15T19:18:12.103239] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-15T19:18:12.124275] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-15T19:18:12.488391] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-15T19:18:12.488554] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-15T19:18:12.489190] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-15T19:18:12.489296] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-15T19:18:12.502190] [DEBUG] [LOCAL ] GWH: Trimmed 23302 records to 18636 (keeping 200 days of data) [2025-10-15T19:18:12.502075] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T19:18:12.617511] [DEBUG] [LOCAL ] GWH: Primary data saved (18636 records). [2025-10-15T19:18:12.617675] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-15T19:18:12.617795] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GWH took 28.9s. Estimated remaining: 3h 14m 46s. Rate: 7.1 symbols/min [2025-10-15T19:18:12.783315] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:12.828632] [DEBUG] [LOCAL ] GXO: Loaded 46833 existing records from primary storage. [2025-10-15T19:18:12.828964] [INFO ] [MAIN ] GXO: Loaded 46833 existing records. [2025-10-15T19:18:12.919126] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-15T19:18:13.007754] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:13.007968] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-15T19:18:13.008016] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-15T19:18:13.008444] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-15T19:18:13.008500] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-15T19:18:13.359974] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:13.570225] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:18:13.574779] [INFO ] [REMOTE ] GVA: Full fetch complete (48468 records). [2025-10-15T19:18:13.574950] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-15T19:18:13.719167] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-15T19:18:13.957741] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-15T19:18:13.957823] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-15T19:18:13.958612] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-15T19:18:13.958699] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-15T19:18:13.959712] [DEBUG] [LOCAL ] GVA: Trimmed 48468 records to 32702 (keeping 200 days of data) [2025-10-15T19:18:14.190174] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:18:14.208301] [DEBUG] [LOCAL ] GVA: Primary data saved (32702 records). [2025-10-15T19:18:14.208441] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-15T19:18:14.208522] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GVA took 32.7s. Estimated remaining: 3h 14m 28s. Rate: 7.1 symbols/min [2025-10-15T19:18:14.379509] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:14.383253] [DEBUG] [LOCAL ] GYLD: Loaded 1542 existing records from primary storage. [2025-10-15T19:18:14.383386] [INFO ] [MAIN ] GYLD: Loaded 1542 existing records. [2025-10-15T19:18:14.521730] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-15T19:18:14.562401] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:14.562601] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-15T19:18:14.562672] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-15T19:18:14.562819] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-15T19:18:14.562857] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-15T19:18:14.903349] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:15.319226] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-15T19:18:15.325293] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:18:15.617593] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:18:15.616216] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-15T19:18:16.114020] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-15T19:18:16.914012] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-15T19:18:17.713987] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-15T19:18:17.814265] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:18:18.156897] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:18:18.513983] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-15T19:18:19.314026] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-15T19:18:19.365427] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T19:18:19.682879] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T19:18:20.114014] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-15T19:18:20.594744] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:18:20.914020] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-15T19:18:21.578753] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T19:18:21.714064] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-15T19:18:22.513986] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-15T19:18:22.564267] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T19:18:22.702701] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T19:18:23.313994] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-15T19:18:24.127327] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-15T19:18:24.129736] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:18:24.306214] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:18:24.485214] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-15T19:18:24.914003] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-15T19:18:25.256195] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:18:25.713992] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-15T19:18:26.513995] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-15T19:18:26.688271] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T19:18:27.313993] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-15T19:18:27.606568] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-15T19:18:28.067228] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:18:28.113981] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-15T19:18:28.914059] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-15T19:18:29.714028] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-15T19:18:29.803794] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:18:30.197766] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T19:18:30.230402] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:18:30.514003] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-15T19:18:31.313965] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-15T19:18:31.666442] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T19:18:31.690005] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:18:32.114075] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-15T19:18:32.913970] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-15T19:18:33.355561] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:18:33.410600] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:18:33.713979] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-15T19:18:34.163428] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T19:18:34.514038] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-15T19:18:35.314062] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-15T19:18:36.121461] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-15T19:18:36.127109] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:18:36.573367] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:18:36.729999] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:18:36.913998] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-15T19:18:37.713999] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-15T19:18:38.412985] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T19:18:38.513961] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-15T19:18:38.844384] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:18:38.847080] [INFO ] [REMOTE ] GWW: Full fetch complete (29153 records). [2025-10-15T19:18:38.847155] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-15T19:18:39.209211] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-15T19:18:39.209283] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-15T19:18:39.209826] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-15T19:18:39.209886] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-15T19:18:39.210529] [DEBUG] [LOCAL ] GWW: Trimmed 29153 records to 19562 (keeping 200 days of data) [2025-10-15T19:18:39.317231] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-15T19:18:39.334261] [DEBUG] [LOCAL ] GWW: Primary data saved (19562 records). [2025-10-15T19:18:39.334366] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-15T19:18:39.334440] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWW took 30.8s. Estimated remaining: 3h 14m 43s. Rate: 7.1 symbols/min [2025-10-15T19:18:39.499980] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:39.543168] [DEBUG] [LOCAL ] H: Loaded 44431 existing records from primary storage. [2025-10-15T19:18:39.543468] [INFO ] [MAIN ] H: Loaded 44431 existing records. [2025-10-15T19:18:39.720198] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:39.720488] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-15T19:18:39.720562] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-15T19:18:39.721045] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-15T19:18:39.721105] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-15T19:18:39.909535] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:18:39.994112] [INFO ] [REMOTE ] GWRE: Full fetch complete (60450 records). [2025-10-15T19:18:40.017249] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-15T19:18:40.126738] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-15T19:18:40.199985] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:40.499115] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-15T19:18:40.499194] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-15T19:18:40.500053] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-15T19:18:40.500116] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-15T19:18:40.501299] [DEBUG] [LOCAL ] GWRE: Trimmed 60450 records to 39928 (keeping 200 days of data) [2025-10-15T19:18:40.709014] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:18:40.745146] [DEBUG] [LOCAL ] GWRE: Primary data saved (39928 records). [2025-10-15T19:18:40.745263] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-15T19:18:40.745485] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GWRE took 44.9s. Estimated remaining: 3h 14m 25s. Rate: 7.1 symbols/min [2025-10-15T19:18:40.918440] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-15T19:18:40.922356] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:40.961749] [DEBUG] [LOCAL ] HAE: Loaded 39414 existing records from primary storage. [2025-10-15T19:18:40.962068] [INFO ] [MAIN ] HAE: Loaded 39414 existing records. [2025-10-15T19:18:41.176258] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:41.176510] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-15T19:18:41.176743] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-15T19:18:41.178699] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T19:18:41.178745] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-15T19:18:41.178871] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-15T19:18:41.375018] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T19:18:41.413273] [INFO ] [REMOTE ] GYLD: Full fetch complete (2109 records). [2025-10-15T19:18:41.439457] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-15T19:18:41.707604] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:41.722132] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-15T19:18:41.913706] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-15T19:18:41.914014] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-15T19:18:41.914136] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-15T19:18:41.914176] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-15T19:18:41.914493] [DEBUG] [LOCAL ] GYLD: Trimmed 2109 records to 1544 (keeping 200 days of data) [2025-10-15T19:18:41.924674] [DEBUG] [LOCAL ] GYLD: Primary data saved (1544 records). [2025-10-15T19:18:41.924737] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-15T19:18:41.924819] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GYLD took 27.7s. Estimated remaining: 3h 14m 6s. Rate: 7.1 symbols/min [2025-10-15T19:18:42.102295] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:42.140545] [DEBUG] [LOCAL ] HAFN: Loaded 43050 existing records from primary storage. [2025-10-15T19:18:42.140890] [INFO ] [MAIN ] HAFN: Loaded 43050 existing records. [2025-10-15T19:18:42.312187] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:42.312415] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-15T19:18:42.312463] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-15T19:18:42.312802] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-15T19:18:42.312858] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-15T19:18:42.519180] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-15T19:18:42.662308] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:43.314029] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-15T19:18:43.399720] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:18:43.978437] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:18:44.113967] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-15T19:18:44.913978] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-15T19:18:45.155251] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:18:45.221930] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:18:45.714045] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-15T19:18:46.174904] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T19:18:46.514001] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-15T19:18:47.273581] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T19:18:47.313994] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-15T19:18:48.071207] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:18:48.113978] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-15T19:18:48.887605] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:18:48.913950] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-15T19:18:49.307199] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:18:49.714053] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-15T19:18:50.075927] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T19:18:50.513995] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-15T19:18:51.282369] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:18:51.288053] [INFO ] [REMOTE ] GXO: Full fetch complete (69649 records). [2025-10-15T19:18:51.288182] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-15T19:18:51.319306] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-15T19:18:51.684228] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-15T19:18:51.684304] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-15T19:18:51.685249] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-15T19:18:51.685313] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-15T19:18:51.686602] [DEBUG] [LOCAL ] GXO: Trimmed 69649 records to 46756 (keeping 200 days of data) [2025-10-15T19:18:51.964051] [DEBUG] [LOCAL ] GXO: Primary data saved (46756 records). [2025-10-15T19:18:51.964173] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-15T19:18:51.964974] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GXO took 39.3s. Estimated remaining: 3h 13m 60s. Rate: 7.1 symbols/min [2025-10-15T19:18:52.116489] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-15T19:18:52.144114] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:52.178019] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:18:52.233319] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-15T19:18:52.233661] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-15T19:18:52.422221] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:52.422691] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-15T19:18:52.422779] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-15T19:18:52.423148] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-15T19:18:52.423262] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-15T19:18:52.728277] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:18:52.818386] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:52.914005] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-15T19:18:53.496223] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:18:53.713992] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-15T19:18:54.514011] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-15T19:18:54.616159] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T19:18:55.064216] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T19:18:55.314006] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-15T19:18:56.113984] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-15T19:18:56.244158] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:18:56.913974] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-15T19:18:57.194030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T19:18:57.397097] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T19:18:57.714035] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-15T19:18:58.513989] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-15T19:18:58.890844] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T19:18:59.314062] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-15T19:18:59.594839] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T19:19:00.114022] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-15T19:19:00.914066] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-15T19:19:01.221852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-15T19:19:01.476220] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T19:19:01.713991] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-15T19:19:02.289063] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T19:19:02.336020] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:19:02.513990] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-15T19:19:03.313987] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-15T19:19:03.383251] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:19:04.113994] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-15T19:19:04.152150] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:19:04.822089] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:19:04.914008] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-15T19:19:05.590148] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T19:19:05.714037] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-15T19:19:05.959001] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:19:06.514045] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-15T19:19:07.167934] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:19:07.173527] [INFO ] [REMOTE ] HAE: Full fetch complete (58849 records). [2025-10-15T19:19:07.173716] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-15T19:19:07.319063] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-15T19:19:07.605977] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-15T19:19:07.606064] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-15T19:19:07.606942] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-15T19:19:07.607009] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-15T19:19:07.608283] [DEBUG] [LOCAL ] HAE: Trimmed 58849 records to 39371 (keeping 200 days of data) [2025-10-15T19:19:07.847442] [DEBUG] [LOCAL ] HAE: Primary data saved (39371 records). [2025-10-15T19:19:07.847588] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-15T19:19:07.847898] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. HAE took 27.1s. Estimated remaining: 3h 14m 2s. Rate: 7.1 symbols/min [2025-10-15T19:19:08.020967] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:08.047694] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T19:19:08.094387] [DEBUG] [LOCAL ] HASI: Loaded 47577 existing records from primary storage. [2025-10-15T19:19:08.094734] [INFO ] [MAIN ] HASI: Loaded 47577 existing records. [2025-10-15T19:19:08.124605] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-15T19:19:08.268965] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:08.269193] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-15T19:19:08.269242] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-15T19:19:08.269485] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-15T19:19:08.269524] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-15T19:19:08.630829] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:08.735129] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:19:08.914019] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-15T19:19:09.714028] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-15T19:19:10.305715] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T19:19:10.386760] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:19:10.514044] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-15T19:19:11.231287] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:19:11.313997] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-15T19:19:11.768184] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:19:12.114001] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-15T19:19:12.817723] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:19:12.913973] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-15T19:19:13.714007] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-15T19:19:13.775421] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:19:14.383409] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:19:14.513995] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-15T19:19:15.314007] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-15T19:19:15.379926] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T19:19:15.688931] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T19:19:16.114102] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-15T19:19:16.914083] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-15T19:19:16.996530] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:19:17.714043] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-15T19:19:17.856456] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T19:19:18.286294] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T19:19:18.514061] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-15T19:19:19.314042] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-15T19:19:19.361851] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T19:19:19.612372] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T19:19:19.617796] [INFO ] [REMOTE ] HAFN: Full fetch complete (65007 records). [2025-10-15T19:19:19.617924] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-15T19:19:20.009278] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-15T19:19:20.009394] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-15T19:19:20.010354] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-15T19:19:20.010418] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-15T19:19:20.011867] [DEBUG] [LOCAL ] HAFN: Trimmed 65007 records to 42943 (keeping 200 days of data) [2025-10-15T19:19:20.116274] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-15T19:19:20.257942] [DEBUG] [LOCAL ] HAFN: Primary data saved (42943 records). [2025-10-15T19:19:20.258068] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-15T19:19:20.258151] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAFN took 38.3s. Estimated remaining: 3h 13m 59s. Rate: 7.1 symbols/min [2025-10-15T19:19:20.421197] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:20.466452] [DEBUG] [LOCAL ] HAYW: Loaded 48878 existing records from primary storage. [2025-10-15T19:19:20.466791] [INFO ] [MAIN ] HAYW: Loaded 48878 existing records. [2025-10-15T19:19:20.646923] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:20.647216] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-15T19:19:20.647268] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-15T19:19:20.647483] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-15T19:19:20.647541] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-15T19:19:20.921498] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-15T19:19:21.014573] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:21.052555] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T19:19:21.714017] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-15T19:19:22.154802] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T19:19:22.203086] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:19:22.513996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-15T19:19:22.987764] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T19:19:23.314081] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-15T19:19:24.089543] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:19:24.113996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-15T19:19:24.913996] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-15T19:19:25.185782] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:19:25.612744] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:19:25.713964] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-15T19:19:26.514031] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-15T19:19:26.567623] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:19:26.572856] [INFO ] [REMOTE ] H: Full fetch complete (62854 records). [2025-10-15T19:19:26.572963] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-15T19:19:26.975710] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-15T19:19:26.975842] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-15T19:19:26.977226] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-15T19:19:26.986118] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-15T19:19:27.005902] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:19:27.006101] [DEBUG] [LOCAL ] H: Trimmed 62854 records to 44421 (keeping 200 days of data) [2025-10-15T19:19:27.297157] [DEBUG] [LOCAL ] H: Primary data saved (44421 records). [2025-10-15T19:19:27.297321] [INFO ] [MAIN ] H: Full history saved. [2025-10-15T19:19:27.297418] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. H took 48.0s. Estimated remaining: 3h 13m 49s. Rate: 7.1 symbols/min [2025-10-15T19:19:27.319832] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-15T19:19:27.469593] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:27.480509] [DEBUG] [LOCAL ] HBB: Loaded 6478 existing records from primary storage. [2025-10-15T19:19:27.480761] [INFO ] [MAIN ] HBB: Loaded 6478 existing records. [2025-10-15T19:19:27.680581] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:27.680859] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-15T19:19:27.680932] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-15T19:19:27.681109] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-15T19:19:27.681150] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-15T19:19:28.048519] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:28.077994] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:19:28.113966] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-15T19:19:28.919086] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-15T19:19:28.935088] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T19:19:29.192108] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T19:19:29.714050] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-15T19:19:30.375029] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T19:19:30.513985] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-15T19:19:30.757367] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T19:19:31.187052] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:19:31.314031] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-15T19:19:31.909424] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T19:19:32.113997] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-15T19:19:32.792505] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T19:19:32.798932] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-15T19:19:32.799047] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-15T19:19:32.919132] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-15T19:19:33.205829] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-15T19:19:33.205899] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-15T19:19:33.206904] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-15T19:19:33.206967] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-15T19:19:33.208327] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-15T19:19:33.540816] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-15T19:19:33.541053] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-15T19:19:33.541951] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 41.6s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-15T19:19:33.714491] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-15T19:19:33.714332] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T19:19:33.714120] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:33.779029] [DEBUG] [LOCAL ] HBI: Loaded 52982 existing records from primary storage. [2025-10-15T19:19:33.779322] [INFO ] [MAIN ] HBI: Loaded 52982 existing records. [2025-10-15T19:19:33.950684] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:33.950867] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-15T19:19:33.950914] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-15T19:19:33.951186] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-15T19:19:33.951224] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-15T19:19:34.292591] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:34.514011] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-15T19:19:35.148240] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:19:35.313980] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-15T19:19:36.098726] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:19:36.113951] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-15T19:19:36.647722] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:19:36.653454] [INFO ] [REMOTE ] HASI: Full fetch complete (68293 records). [2025-10-15T19:19:36.653559] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-15T19:19:36.919125] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-15T19:19:37.034718] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-15T19:19:37.034803] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-15T19:19:37.035759] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-15T19:19:37.035820] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-15T19:19:37.037066] [DEBUG] [LOCAL ] HASI: Trimmed 68293 records to 47673 (keeping 200 days of data) [2025-10-15T19:19:37.319285] [DEBUG] [LOCAL ] HASI: Primary data saved (47673 records). [2025-10-15T19:19:37.319411] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-15T19:19:37.319863] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 29.5s. Estimated remaining: 3h 13m 22s. Rate: 7.1 symbols/min [2025-10-15T19:19:37.487418] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:37.538167] [DEBUG] [LOCAL ] HBM: Loaded 52944 existing records from primary storage. [2025-10-15T19:19:37.538480] [INFO ] [MAIN ] HBM: Loaded 52944 existing records. [2025-10-15T19:19:37.714878] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-15T19:19:37.721107] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:37.722433] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-15T19:19:37.722630] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-15T19:19:37.722918] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-15T19:19:37.722963] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-15T19:19:37.827327] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:19:38.109189] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:38.402307] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T19:19:38.513978] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-15T19:19:38.707333] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:19:39.314116] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-15T19:19:40.105985] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T19:19:40.115624] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-15T19:19:40.757332] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:19:40.847588] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T19:19:40.914027] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-15T19:19:41.713994] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-15T19:19:42.519083] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-15T19:19:42.531096] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T19:19:42.994011] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:19:43.313996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-15T19:19:43.410735] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:19:44.113999] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-15T19:19:44.655322] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T19:19:44.914017] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-15T19:19:45.532428] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T19:19:45.646099] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:19:45.713981] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-15T19:19:46.514016] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-15T19:19:47.313981] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-15T19:19:47.418260] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:19:47.604020] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:19:48.114047] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-15T19:19:48.600550] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T19:19:48.914052] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-15T19:19:49.713973] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-15T19:19:49.872682] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:19:50.098922] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T19:19:50.410765] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T19:19:50.514009] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-15T19:19:51.313998] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-15T19:19:51.888008] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:19:52.114175] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-15T19:19:52.153544] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T19:19:52.722841] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:19:52.724093] [INFO ] [REMOTE ] HBB: Full fetch complete (9384 records). [2025-10-15T19:19:52.724165] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-15T19:19:52.919175] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-15T19:19:53.087342] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-15T19:19:53.087421] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-15T19:19:53.091096] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-15T19:19:53.091354] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-15T19:19:53.092303] [DEBUG] [LOCAL ] HBB: Trimmed 9384 records to 6475 (keeping 200 days of data) [2025-10-15T19:19:53.131888] [DEBUG] [LOCAL ] HBB: Primary data saved (6475 records). [2025-10-15T19:19:53.132014] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-15T19:19:53.132099] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HBB took 25.8s. Estimated remaining: 3h 13m 24s. Rate: 7.1 symbols/min [2025-10-15T19:19:53.297838] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:53.342326] [DEBUG] [LOCAL ] HCA: Loaded 46950 existing records from primary storage. [2025-10-15T19:19:53.342613] [INFO ] [MAIN ] HCA: Loaded 46950 existing records. [2025-10-15T19:19:53.516000] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:53.516202] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-15T19:19:53.516248] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-15T19:19:53.516620] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-15T19:19:53.516702] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-15T19:19:53.721639] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-15T19:19:53.892433] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:54.513969] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-15T19:19:54.808229] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T19:19:55.313980] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-15T19:19:55.438678] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:19:56.113996] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-15T19:19:56.220532] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:19:56.746639] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T19:19:56.913988] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-15T19:19:57.714004] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-15T19:19:57.807271] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T19:19:58.513975] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-15T19:19:58.629497] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T19:19:59.314051] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-15T19:19:59.603847] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:20:00.113998] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-15T19:20:00.157618] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T19:20:00.913999] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-15T19:20:01.063475] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T19:20:01.713987] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-15T19:20:01.946592] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:20:01.953122] [INFO ] [REMOTE ] HBI: Full fetch complete (77020 records). [2025-10-15T19:20:01.953251] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-15T19:20:02.353797] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-15T19:20:02.353912] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-15T19:20:02.354928] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-15T19:20:02.354994] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-15T19:20:02.356489] [DEBUG] [LOCAL ] HBI: Trimmed 77020 records to 52974 (keeping 200 days of data) [2025-10-15T19:20:02.525272] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-15T19:20:02.678046] [DEBUG] [LOCAL ] HBI: Primary data saved (52974 records). [2025-10-15T19:20:02.678184] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-15T19:20:02.678968] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HBI took 29.1s. Estimated remaining: 3h 13m 17s. Rate: 7.1 symbols/min [2025-10-15T19:20:02.851604] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:02.898273] [DEBUG] [LOCAL ] HCC: Loaded 45223 existing records from primary storage. [2025-10-15T19:20:02.898859] [INFO ] [MAIN ] HCC: Loaded 45223 existing records. [2025-10-15T19:20:03.106040] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-15T19:20:03.153480] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:03.154448] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-15T19:20:03.154525] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-15T19:20:03.154995] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-15T19:20:03.155064] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-15T19:20:03.318069] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-15T19:20:03.523781] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:03.591987] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:20:03.598137] [INFO ] [REMOTE ] HAYW: Full fetch complete (70891 records). [2025-10-15T19:20:03.598271] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-15T19:20:03.988637] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-15T19:20:03.988765] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-15T19:20:03.989743] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-15T19:20:03.989808] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-15T19:20:03.991260] [DEBUG] [LOCAL ] HAYW: Trimmed 70891 records to 48908 (keeping 200 days of data) [2025-10-15T19:20:04.155635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-15T19:20:04.276354] [DEBUG] [LOCAL ] HAYW: Primary data saved (48908 records). [2025-10-15T19:20:04.276484] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-15T19:20:04.276562] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HAYW took 44.0s. Estimated remaining: 3h 12m 59s. Rate: 7.1 symbols/min [2025-10-15T19:20:04.449745] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:04.464790] [DEBUG] [LOCAL ] HCI: Loaded 14096 existing records from primary storage. [2025-10-15T19:20:04.465014] [INFO ] [MAIN ] HCI: Loaded 14096 existing records. [2025-10-15T19:20:04.650460] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:04.667090] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-15T19:20:04.676890] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-15T19:20:04.677275] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-15T19:20:04.678819] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-15T19:20:04.677780] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-15T19:20:04.919245] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-15T19:20:05.075396] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:05.283693] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T19:20:05.393053] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T19:20:05.714017] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-15T19:20:06.389218] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:20:06.513995] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-15T19:20:07.226402] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:20:07.313950] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-15T19:20:08.114016] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-15T19:20:08.305728] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T19:20:08.913971] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-15T19:20:08.991113] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:20:09.010898] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T19:20:09.714001] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-15T19:20:10.514063] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-15T19:20:10.760587] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T19:20:11.289477] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:20:11.313996] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-15T19:20:11.865335] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:20:12.038979] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T19:20:12.114041] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-15T19:20:12.776858] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T19:20:12.914041] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-15T19:20:13.524143] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T19:20:13.714062] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-15T19:20:14.514006] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-15T19:20:15.294003] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:20:15.313970] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-15T19:20:16.114029] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-15T19:20:16.345468] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:20:16.351811] [INFO ] [REMOTE ] HBM: Full fetch complete (76667 records). [2025-10-15T19:20:16.351928] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-15T19:20:16.651051] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T19:20:16.790463] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-15T19:20:16.790561] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-15T19:20:16.791593] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-15T19:20:16.791679] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-15T19:20:16.793233] [DEBUG] [LOCAL ] HBM: Trimmed 76667 records to 52958 (keeping 200 days of data) [2025-10-15T19:20:16.964044] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-15T19:20:17.115965] [DEBUG] [LOCAL ] HBM: Primary data saved (52958 records). [2025-10-15T19:20:17.116101] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-15T19:20:17.116333] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HBM took 39.8s. Estimated remaining: 3h 12m 57s. Rate: 7.1 symbols/min [2025-10-15T19:20:17.174616] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T19:20:17.714000] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-15T19:20:18.442352] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T19:20:18.513989] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-15T19:20:19.314030] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-15T19:20:19.506452] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T19:20:19.827474] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:20:20.114008] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-15T19:20:20.209288] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T19:20:20.914058] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-15T19:20:21.460981] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:20:21.713973] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-15T19:20:22.061112] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T19:20:22.514041] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-15T19:20:23.314079] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-15T19:20:23.376318] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:20:24.120795] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-15T19:20:24.144112] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:20:24.256716] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:20:24.913994] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-15T19:20:25.713993] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-15T19:20:25.767179] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:20:25.773080] [INFO ] [REMOTE ] HCA: Full fetch complete (68902 records). [2025-10-15T19:20:25.773230] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-15T19:20:25.980677] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:20:26.181270] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-15T19:20:26.181358] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-15T19:20:26.182327] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-15T19:20:26.182392] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-15T19:20:26.183767] [DEBUG] [LOCAL ] HCA: Trimmed 68902 records to 46992 (keeping 200 days of data) [2025-10-15T19:20:26.468848] [DEBUG] [LOCAL ] HCA: Primary data saved (46992 records). [2025-10-15T19:20:26.468969] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-15T19:20:26.469045] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCA took 33.3s. Estimated remaining: 3h 12m 50s. Rate: 7.1 symbols/min [2025-10-15T19:20:26.514028] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-15T19:20:27.366445] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T19:20:27.376115] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-15T19:20:27.434769] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T19:20:28.113993] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-15T19:20:28.895902] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:20:28.913958] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-15T19:20:28.945956] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T19:20:29.714027] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-15T19:20:30.470948] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:20:30.477078] [INFO ] [REMOTE ] HCC: Full fetch complete (64865 records). [2025-10-15T19:20:30.477215] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-15T19:20:30.720725] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:20:30.764433] [INFO ] [REMOTE ] HCI: Full fetch complete (19566 records). [2025-10-15T19:20:30.775884] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-15T19:20:31.079517] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-15T19:20:31.144903] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-15T19:20:31.157620] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-15T19:20:31.184273] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-15T19:20:31.244080] [DEBUG] [LOCAL ] HCC: Trimmed 64865 records to 45241 (keeping 200 days of data) [2025-10-15T19:20:31.269098] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-15T19:20:31.269217] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-15T19:20:31.269781] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-15T19:20:31.269879] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-15T19:20:31.270491] [DEBUG] [LOCAL ] HCI: Trimmed 19566 records to 14115 (keeping 200 days of data) [2025-10-15T19:20:31.468311] [DEBUG] [LOCAL ] HCI: Primary data saved (14115 records). [2025-10-15T19:20:31.472797] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-15T19:20:31.472925] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HCI took 27.2s. Estimated remaining: 3h 12m 36s. Rate: 7.1 symbols/min [2025-10-15T19:20:31.648618] [DEBUG] [LOCAL ] HCC: Primary data saved (45241 records). [2025-10-15T19:20:31.649005] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-15T19:20:31.650072] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCC took 29.0s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-15T19:20:32.363573] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.364372] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.359850] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.389791] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-15T19:20:32.388952] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.390045] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-15T19:20:32.392129] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-15T19:20:32.392207] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-15T19:20:32.392263] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-15T19:20:32.392304] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-15T19:20:32.766057] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-15T19:20:32.785987] [INFO ] [MAIN ] HD: Loaded 53493 existing records. [2025-10-15T19:20:32.773206] [DEBUG] [LOCAL ] HE: Loaded 48972 existing records from primary storage. [2025-10-15T19:20:32.867508] [DEBUG] [LOCAL ] HDB: Loaded 51927 existing records from primary storage. [2025-10-15T19:20:32.931896] [INFO ] [MAIN ] HDB: Loaded 51927 existing records. [2025-10-15T19:20:32.931780] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:32.867673] [INFO ] [MAIN ] HE: Loaded 48972 existing records. [2025-10-15T19:20:32.976702] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-15T19:20:33.266805] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:33.298283] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-15T19:20:33.338734] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-15T19:20:33.411830] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:33.413367] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-15T19:20:33.416296] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-15T19:20:33.416207] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:33.416634] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-15T19:20:33.416592] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-15T19:20:33.416543] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-15T19:20:33.416894] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-15T19:20:33.427849] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-15T19:20:33.460493] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-15T19:20:33.472409] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-15T19:20:33.481859] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-15T19:20:33.624902] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-15T19:20:33.719412] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-15T19:20:34.041533] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-15T19:20:34.216950] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-15T19:20:34.414551] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:34.433194] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-15T19:20:34.548929] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:34.553512] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:34.550534] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-15T19:20:34.553802] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-15T19:20:34.745588] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T19:20:35.314062] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-15T19:20:35.541310] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-15T19:20:36.114067] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-15T19:20:36.167740] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:20:36.237786] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T19:20:36.279449] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T19:20:36.356902] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-15T19:20:36.914001] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-15T19:20:37.714022] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-15T19:20:38.514002] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-15T19:20:38.655054] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T19:20:38.729399] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-15T19:20:39.313970] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-15T19:20:39.492528] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:20:40.114009] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-15T19:20:40.914013] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-15T19:20:41.216696] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T19:20:41.720316] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-15T19:20:41.726101] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:20:42.043560] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:20:42.513971] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-15T19:20:42.730092] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T19:20:42.844746] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T19:20:43.313990] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-15T19:20:44.113998] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-15T19:20:44.414151] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-15T19:20:44.913972] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-15T19:20:45.096267] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T19:20:45.714004] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-15T19:20:45.931108] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-15T19:20:46.374797] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:20:46.513954] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-15T19:20:47.314034] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-15T19:20:47.630304] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-15T19:20:47.631119] [INFO ] [REMOTE ] HCXY: Full fetch complete (520 records). [2025-10-15T19:20:47.631199] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-15T19:20:47.823314] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-10-15T19:20:47.823511] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:20:47.823598] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:20:47.823712] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-15T19:20:47.823795] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-15T19:20:47.823835] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-15T19:20:47.823874] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-15T19:20:47.823929] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 16.2s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-15T19:20:48.000117] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:48.035596] [DEBUG] [LOCAL ] HEI: Loaded 31298 existing records from primary storage. [2025-10-15T19:20:48.035972] [INFO ] [MAIN ] HEI: Loaded 31298 existing records. [2025-10-15T19:20:48.119122] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-15T19:20:48.218098] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:48.218318] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-15T19:20:48.218365] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-15T19:20:48.218619] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-15T19:20:48.218739] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-15T19:20:48.622296] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:48.627252] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T19:20:48.913976] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-15T19:20:49.714061] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-15T19:20:50.129135] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:20:50.200352] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T19:20:50.513996] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-15T19:20:51.313996] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-15T19:20:51.378108] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:20:52.027376] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T19:20:52.113975] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-15T19:20:52.913960] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-15T19:20:53.474238] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T19:20:53.713980] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-15T19:20:53.842508] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:20:54.315795] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T19:20:54.514064] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-15T19:20:55.227475] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:20:55.313987] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-15T19:20:56.113987] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-15T19:20:56.470313] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T19:20:56.577310] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-15T19:20:56.914007] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-15T19:20:57.713975] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-15T19:20:57.805836] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T19:20:58.514004] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-15T19:20:58.571637] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:20:58.839488] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:20:59.314003] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-15T19:20:59.893109] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:21:00.113997] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-15T19:21:00.914001] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-15T19:21:01.138468] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:21:01.651436] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:21:01.713992] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-15T19:21:02.227476] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:21:02.514066] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-15T19:21:03.221883] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:21:03.313954] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-15T19:21:04.114016] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-15T19:21:04.262099] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T19:21:04.656146] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T19:21:04.914023] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-15T19:21:05.714087] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-15T19:21:05.949018] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T19:21:06.243992] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T19:21:06.513994] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-15T19:21:07.030721] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:21:07.314008] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-15T19:21:08.114115] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-15T19:21:08.378694] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T19:21:08.614692] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:21:08.914051] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-15T19:21:09.076979] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:21:09.713995] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-15T19:21:10.514087] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-15T19:21:10.978336] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T19:21:11.274638] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:21:11.280448] [INFO ] [REMOTE ] HE: Full fetch complete (72248 records). [2025-10-15T19:21:11.280553] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-15T19:21:11.319168] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-15T19:21:11.690575] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-15T19:21:11.690706] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-15T19:21:11.691834] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-15T19:21:11.691910] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-15T19:21:11.693490] [DEBUG] [LOCAL ] HE: Trimmed 72248 records to 48936 (keeping 200 days of data) [2025-10-15T19:21:11.984866] [DEBUG] [LOCAL ] HE: Primary data saved (48936 records). [2025-10-15T19:21:11.984993] [INFO ] [MAIN ] HE: Full history saved. [2025-10-15T19:21:11.985114] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 40.3s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-10-15T19:21:12.118581] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-15T19:21:12.161534] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:12.170562] [DEBUG] [LOCAL ] HEQ: Loaded 6781 existing records from primary storage. [2025-10-15T19:21:12.170792] [INFO ] [MAIN ] HEQ: Loaded 6781 existing records. [2025-10-15T19:21:12.348461] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:12.348705] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-15T19:21:12.348846] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-15T19:21:12.354704] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-15T19:21:12.364237] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-15T19:21:12.396470] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:21:12.472062] [INFO ] [REMOTE ] HDB: Full fetch complete (75578 records). [2025-10-15T19:21:12.477868] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-15T19:21:12.979456] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:12.999536] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-15T19:21:13.132637] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-15T19:21:13.132796] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-15T19:21:13.133823] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-15T19:21:13.133903] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-15T19:21:13.135348] [DEBUG] [LOCAL ] HDB: Trimmed 75578 records to 51932 (keeping 200 days of data) [2025-10-15T19:21:13.381140] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T19:21:13.483320] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T19:21:13.512800] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T19:21:13.532817] [DEBUG] [LOCAL ] HDB: Primary data saved (51932 records). [2025-10-15T19:21:13.532950] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-15T19:21:13.533034] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HDB took 41.9s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-15T19:21:13.697681] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:13.714021] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-15T19:21:13.746482] [DEBUG] [LOCAL ] HESM: Loaded 48462 existing records from primary storage. [2025-10-15T19:21:13.746819] [INFO ] [MAIN ] HESM: Loaded 48462 existing records. [2025-10-15T19:21:13.919250] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:13.919704] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-15T19:21:13.919761] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-15T19:21:13.920060] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-15T19:21:13.920098] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-15T19:21:14.273613] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:14.363500] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T19:21:14.514015] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-15T19:21:15.314053] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-15T19:21:15.922804] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:21:15.987639] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T19:21:16.113977] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-15T19:21:16.913984] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-15T19:21:16.972826] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:21:16.979559] [INFO ] [REMOTE ] HD: Full fetch complete (77563 records). [2025-10-15T19:21:16.979787] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-15T19:21:17.362633] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-15T19:21:17.362777] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-15T19:21:17.363813] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-15T19:21:17.363875] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-15T19:21:17.365262] [DEBUG] [LOCAL ] HD: Trimmed 77563 records to 53492 (keeping 200 days of data) [2025-10-15T19:21:17.696614] [DEBUG] [LOCAL ] HD: Primary data saved (53492 records). [2025-10-15T19:21:17.696768] [INFO ] [MAIN ] HD: Full history saved. [2025-10-15T19:21:17.696851] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HD took 46.0s. Estimated remaining: 3h 11m 60s. Rate: 7.1 symbols/min [2025-10-15T19:21:17.719128] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-15T19:21:17.866445] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:17.866596] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-15T19:21:17.866632] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-15T19:21:17.866757] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-15T19:21:17.866798] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-15T19:21:17.866838] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-15T19:21:17.866868] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-15T19:21:18.052903] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:21:18.103156] [INFO ] [REMOTE ] HEI: Full fetch complete (47729 records). [2025-10-15T19:21:18.128533] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-15T19:21:18.390401] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:18.520216] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-15T19:21:18.643470] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-15T19:21:18.643542] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-15T19:21:18.644326] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-15T19:21:18.644387] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-15T19:21:18.645287] [DEBUG] [LOCAL ] HEI: Trimmed 47729 records to 31248 (keeping 200 days of data) [2025-10-15T19:21:18.838244] [DEBUG] [LOCAL ] HEI: Primary data saved (31248 records). [2025-10-15T19:21:18.838398] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-15T19:21:18.838484] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEI took 31.0s. Estimated remaining: 3h 11m 41s. Rate: 7.1 symbols/min [2025-10-15T19:21:19.006535] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:19.006690] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-15T19:21:19.006741] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-15T19:21:19.006844] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-15T19:21:19.006886] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-15T19:21:19.006926] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-15T19:21:19.006962] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-15T19:21:19.283154] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T19:21:19.320302] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-15T19:21:19.430060] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:19.432748] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:21:20.113983] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-15T19:21:20.208272] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T19:21:20.914048] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-15T19:21:21.341864] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T19:21:21.388931] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T19:21:21.714020] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-15T19:21:22.514016] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-15T19:21:22.857339] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T19:21:22.913695] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T19:21:23.314006] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-15T19:21:23.663928] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-15T19:21:24.114009] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-15T19:21:24.914079] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-15T19:21:25.616993] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T19:21:25.658867] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:21:25.713974] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-15T19:21:26.514060] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-15T19:21:26.937935] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T19:21:27.232353] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:21:27.313961] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-15T19:21:28.113972] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-15T19:21:28.506286] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-15T19:21:28.913988] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-15T19:21:28.969174] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T19:21:29.315810] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-15T19:21:29.714012] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-15T19:21:30.020277] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T19:21:30.513992] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-15T19:21:30.826796] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T19:21:31.314010] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-15T19:21:31.712706] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T19:21:32.113997] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-15T19:21:32.799879] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:21:32.914014] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-15T19:21:33.714017] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-15T19:21:33.951525] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-15T19:21:34.514010] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-15T19:21:34.574046] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:21:35.091493] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T19:21:35.314021] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-15T19:21:35.863734] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T19:21:36.114053] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-15T19:21:36.444076] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-15T19:21:36.914012] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-15T19:21:37.238880] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:21:37.714007] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-15T19:21:38.509337] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:21:38.511037] [INFO ] [REMOTE ] HEQ: Full fetch complete (9605 records). [2025-10-15T19:21:38.511112] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-15T19:21:38.522484] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-15T19:21:38.908382] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-15T19:21:38.908462] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-15T19:21:38.908701] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-15T19:21:38.908761] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-15T19:21:38.909176] [DEBUG] [LOCAL ] HEQ: Trimmed 9605 records to 6769 (keeping 200 days of data) [2025-10-15T19:21:38.948815] [DEBUG] [LOCAL ] HEQ: Primary data saved (6769 records). [2025-10-15T19:21:38.948926] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-15T19:21:38.949017] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 27.0s. Estimated remaining: 3h 11m 49s. Rate: 7.1 symbols/min [2025-10-15T19:21:39.113794] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:39.131179] [DEBUG] [LOCAL ] HFRO: Loaded 17027 existing records from primary storage. [2025-10-15T19:21:39.131401] [INFO ] [MAIN ] HFRO: Loaded 17027 existing records. [2025-10-15T19:21:39.305524] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:39.305769] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-15T19:21:39.305818] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-15T19:21:39.306013] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-15T19:21:39.306071] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-15T19:21:39.319222] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-15T19:21:39.648055] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T19:21:39.669601] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:40.000515] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T19:21:40.114003] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-15T19:21:40.914010] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-15T19:21:41.249387] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:21:41.310611] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T19:21:41.714013] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-15T19:21:42.514012] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-15T19:21:42.777071] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-15T19:21:42.792846] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:21:43.313996] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-15T19:21:44.113979] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-15T19:21:44.416767] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:21:44.531842] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T19:21:44.914052] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-15T19:21:45.713980] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-15T19:21:45.961715] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T19:21:46.514081] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-15T19:21:47.313993] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-15T19:21:47.426798] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:21:47.485696] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T19:21:47.574749] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-15T19:21:48.113997] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-15T19:21:48.914051] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-15T19:21:49.303730] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T19:21:49.304435] [INFO ] [REMOTE ] HFND: Full fetch complete (1763 records). [2025-10-15T19:21:49.304503] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-15T19:21:49.485728] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T19:21:49.485920] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:21:49.485990] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:21:49.486063] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-15T19:21:49.486129] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-15T19:21:49.486166] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-15T19:21:49.486207] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-15T19:21:49.486265] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HFND took 30.6s. Estimated remaining: 3h 11m 43s. Rate: 7.1 symbols/min [2025-10-15T19:21:49.657490] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:49.672383] [DEBUG] [LOCAL ] HGER: Loaded 14809 existing records from primary storage. [2025-10-15T19:21:49.672629] [INFO ] [MAIN ] HGER: Loaded 14809 existing records. [2025-10-15T19:21:49.719348] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-15T19:21:49.863866] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:49.864095] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-15T19:21:49.864143] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-15T19:21:49.864351] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-15T19:21:49.864409] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-15T19:21:50.060222] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T19:21:50.131522] [INFO ] [REMOTE ] HESM: Full fetch complete (69637 records). [2025-10-15T19:21:50.146628] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-15T19:21:50.385350] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:50.521141] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-15T19:21:50.606157] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T19:21:50.732929] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-15T19:21:50.733050] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-15T19:21:50.734283] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-15T19:21:50.734412] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-15T19:21:50.736589] [DEBUG] [LOCAL ] HESM: Trimmed 69637 records to 48517 (keeping 200 days of data) [2025-10-15T19:21:50.834805] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T19:21:51.057387] [DEBUG] [LOCAL ] HESM: Primary data saved (48517 records). [2025-10-15T19:21:51.057546] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-15T19:21:51.057660] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HESM took 37.5s. Estimated remaining: 3h 11m 26s. Rate: 7.1 symbols/min [2025-10-15T19:21:51.244082] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:51.255706] [DEBUG] [LOCAL ] HGLB: Loaded 9621 existing records from primary storage. [2025-10-15T19:21:51.255937] [INFO ] [MAIN ] HGLB: Loaded 9621 existing records. [2025-10-15T19:21:51.321571] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-15T19:21:51.459082] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:51.459298] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-15T19:21:51.459348] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-15T19:21:51.459514] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-15T19:21:51.459572] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-15T19:21:51.638964] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-15T19:21:51.875144] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:52.114011] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-15T19:21:52.784951] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T19:21:52.913996] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-15T19:21:53.669396] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T19:21:53.713986] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-15T19:21:54.117270] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T19:21:54.514035] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-15T19:21:54.729416] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-15T19:21:55.313977] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-15T19:21:56.061278] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T19:21:56.114008] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-15T19:21:56.688141] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T19:21:56.914038] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-15T19:21:57.388288] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T19:21:57.714043] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-15T19:21:58.498713] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T19:21:58.513949] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-15T19:21:59.139511] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T19:21:59.314003] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-15T19:22:00.016873] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T19:22:00.114107] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-15T19:22:00.913992] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-15T19:22:01.082581] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T19:22:01.612761] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T19:22:01.613462] [INFO ] [REMOTE ] HF: Full fetch complete (435 records). [2025-10-15T19:22:01.613530] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-15T19:22:01.718821] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-15T19:22:01.805261] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-15T19:22:01.805506] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:22:01.805591] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:22:01.805709] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-15T19:22:01.805806] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-15T19:22:01.805858] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-15T19:22:01.805917] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-15T19:22:01.805999] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HF took 44.1s. Estimated remaining: 3h 11m 20s. Rate: 7.1 symbols/min [2025-10-15T19:22:01.982431] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:01.999286] [DEBUG] [LOCAL ] HGTY: Loaded 13282 existing records from primary storage. [2025-10-15T19:22:01.999526] [INFO ] [MAIN ] HGTY: Loaded 13282 existing records. [2025-10-15T19:22:02.183210] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:02.183427] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-15T19:22:02.183475] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-15T19:22:02.183708] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-15T19:22:02.183765] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-15T19:22:02.519137] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-15T19:22:02.575949] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:02.766372] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:22:03.314027] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-15T19:22:03.450619] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T19:22:04.114006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-15T19:22:04.315444] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:22:04.818981] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T19:22:04.914081] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-15T19:22:05.713972] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-15T19:22:05.869890] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:22:06.488376] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T19:22:06.513955] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-15T19:22:07.314056] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-15T19:22:07.490135] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:22:07.492922] [INFO ] [REMOTE ] HFRO: Full fetch complete (27949 records). [2025-10-15T19:22:07.493004] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-15T19:22:07.865249] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-15T19:22:07.865351] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-15T19:22:07.865947] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-15T19:22:07.866009] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-15T19:22:07.866670] [DEBUG] [LOCAL ] HFRO: Trimmed 27949 records to 16923 (keeping 200 days of data) [2025-10-15T19:22:07.961982] [DEBUG] [LOCAL ] HFRO: Primary data saved (16923 records). [2025-10-15T19:22:07.962116] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-15T19:22:07.962195] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HFRO took 29.0s. Estimated remaining: 3h 11m 9s. Rate: 7.1 symbols/min [2025-10-15T19:22:08.137139] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T19:22:08.136475] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-15T19:22:08.139496] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:08.184895] [DEBUG] [LOCAL ] HGV: Loaded 46382 existing records from primary storage. [2025-10-15T19:22:08.185180] [INFO ] [MAIN ] HGV: Loaded 46382 existing records. [2025-10-15T19:22:08.364362] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:08.364803] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-15T19:22:08.364863] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-15T19:22:08.365193] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-15T19:22:08.365249] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-15T19:22:08.706770] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:08.914012] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-15T19:22:09.044597] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T19:22:09.714061] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-15T19:22:09.849919] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T19:22:10.196895] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T19:22:10.513965] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-15T19:22:11.253181] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T19:22:11.313996] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-15T19:22:11.863391] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T19:22:12.114000] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-15T19:22:12.914054] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-15T19:22:13.438322] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T19:22:13.714113] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-15T19:22:13.991418] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:22:13.994823] [INFO ] [REMOTE ] HGER: Full fetch complete (18185 records). [2025-10-15T19:22:13.994897] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-15T19:22:14.381977] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-15T19:22:14.382059] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-15T19:22:14.382480] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-15T19:22:14.382524] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-15T19:22:14.383088] [DEBUG] [LOCAL ] HGER: Trimmed 18185 records to 14918 (keeping 200 days of data) [2025-10-15T19:22:14.473251] [DEBUG] [LOCAL ] HGER: Primary data saved (14918 records). [2025-10-15T19:22:14.473395] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-15T19:22:14.473476] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGER took 25.0s. Estimated remaining: 3h 10m 58s. Rate: 7.1 symbols/min [2025-10-15T19:22:14.517874] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-15T19:22:14.595171] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T19:22:14.670468] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:14.702560] [DEBUG] [LOCAL ] HHH: Loaded 33198 existing records from primary storage. [2025-10-15T19:22:14.702900] [INFO ] [MAIN ] HHH: Loaded 33198 existing records. [2025-10-15T19:22:14.878538] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:14.878776] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-15T19:22:14.878827] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-15T19:22:14.879061] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-15T19:22:14.879116] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-15T19:22:15.229107] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:15.313961] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-15T19:22:15.335920] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:22:16.114010] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-15T19:22:16.380779] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T19:22:16.913996] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-15T19:22:16.958704] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T19:22:17.714030] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-15T19:22:18.335268] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:22:18.441605] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T19:22:18.513975] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-15T19:22:19.249198] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T19:22:19.314007] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-15T19:22:20.084573] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T19:22:20.114022] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-15T19:22:20.680486] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T19:22:20.914061] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-15T19:22:21.714026] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-15T19:22:22.183889] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:22:22.513971] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-15T19:22:22.714617] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:22:23.314006] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-15T19:22:23.887637] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T19:22:23.953980] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T19:22:24.114012] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-15T19:22:24.914034] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-15T19:22:24.998895] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T19:22:25.000935] [INFO ] [REMOTE ] HGTY: Full fetch complete (17443 records). [2025-10-15T19:22:25.001017] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-15T19:22:25.390789] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-15T19:22:25.390866] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-15T19:22:25.391233] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-15T19:22:25.391272] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-15T19:22:25.391817] [DEBUG] [LOCAL ] HGTY: Trimmed 17443 records to 13285 (keeping 200 days of data) [2025-10-15T19:22:25.472509] [DEBUG] [LOCAL ] HGTY: Primary data saved (13285 records). [2025-10-15T19:22:25.472717] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-15T19:22:25.472836] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGTY took 23.7s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-15T19:22:25.640365] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:25.674962] [DEBUG] [LOCAL ] HI: Loaded 35603 existing records from primary storage. [2025-10-15T19:22:25.675234] [INFO ] [MAIN ] HI: Loaded 35603 existing records. [2025-10-15T19:22:25.719203] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-15T19:22:25.851804] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:25.852032] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-15T19:22:25.852079] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-15T19:22:25.852385] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-15T19:22:25.852440] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-15T19:22:26.239241] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:26.491748] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:22:26.513959] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-15T19:22:27.109522] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:22:27.314068] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-15T19:22:27.767600] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:22:27.886963] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T19:22:28.114035] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-15T19:22:28.817376] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T19:22:28.914102] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-15T19:22:29.714054] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-15T19:22:30.237931] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T19:22:30.422499] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T19:22:30.514044] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-15T19:22:31.314033] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-15T19:22:32.086428] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:22:32.113999] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-15T19:22:32.844840] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T19:22:32.913992] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-15T19:22:33.611823] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:22:33.713983] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-15T19:22:34.000427] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:22:34.514065] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-15T19:22:35.087181] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:22:35.314023] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-15T19:22:35.759504] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T19:22:35.772787] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T19:22:36.113963] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-15T19:22:36.913958] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-15T19:22:37.320122] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T19:22:37.713981] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-15T19:22:38.323002] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T19:22:38.514121] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-15T19:22:39.028850] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T19:22:39.278898] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T19:22:39.314091] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-15T19:22:39.968833] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T19:22:40.114018] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-15T19:22:40.914009] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-15T19:22:41.522421] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:22:41.556182] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T19:22:41.558210] [INFO ] [REMOTE ] HGLB: Full fetch complete (14750 records). [2025-10-15T19:22:41.558285] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-15T19:22:41.721606] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-15T19:22:41.988627] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-15T19:22:41.988735] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-15T19:22:41.989072] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-15T19:22:41.989112] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-15T19:22:41.989632] [DEBUG] [LOCAL ] HGLB: Trimmed 14750 records to 9584 (keeping 200 days of data) [2025-10-15T19:22:42.051201] [DEBUG] [LOCAL ] HGLB: Primary data saved (9584 records). [2025-10-15T19:22:42.051340] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-15T19:22:42.051418] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGLB took 51.0s. Estimated remaining: 3h 10m 55s. Rate: 7.1 symbols/min [2025-10-15T19:22:42.218754] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:42.269099] [DEBUG] [LOCAL ] HIG: Loaded 51171 existing records from primary storage. [2025-10-15T19:22:42.269410] [INFO ] [MAIN ] HIG: Loaded 51171 existing records. [2025-10-15T19:22:42.441733] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:42.441941] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-15T19:22:42.441988] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-15T19:22:42.442229] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-15T19:22:42.442268] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-15T19:22:42.519152] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-15T19:22:42.793229] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:43.314024] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-15T19:22:43.494078] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T19:22:43.915518] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:22:43.919963] [INFO ] [REMOTE ] HHH: Full fetch complete (45949 records). [2025-10-15T19:22:43.920236] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-15T19:22:44.122623] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-15T19:22:44.314353] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-15T19:22:44.314449] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-15T19:22:44.315419] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-15T19:22:44.315487] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-15T19:22:44.316715] [DEBUG] [LOCAL ] HHH: Trimmed 45949 records to 33258 (keeping 200 days of data) [2025-10-15T19:22:44.520224] [DEBUG] [LOCAL ] HHH: Primary data saved (33258 records). [2025-10-15T19:22:44.520371] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-15T19:22:44.520451] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HHH took 30.0s. Estimated remaining: 3h 10m 39s. Rate: 7.1 symbols/min [2025-10-15T19:22:44.701287] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:44.746329] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T19:22:44.767570] [DEBUG] [LOCAL ] HII: Loaded 33836 existing records from primary storage. [2025-10-15T19:22:44.767927] [INFO ] [MAIN ] HII: Loaded 33836 existing records. [2025-10-15T19:22:44.922298] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-15T19:22:44.963943] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:44.964106] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-15T19:22:44.964345] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-15T19:22:44.964545] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-15T19:22:44.964600] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-15T19:22:45.325030] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:45.612271] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:22:45.713982] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-15T19:22:46.117453] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:22:46.514012] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-15T19:22:47.033016] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T19:22:47.313997] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-15T19:22:48.038348] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:22:48.113992] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-15T19:22:48.790476] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:22:48.914028] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-15T19:22:49.544695] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T19:22:49.713991] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-15T19:22:50.224829] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:22:50.513982] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-15T19:22:51.313987] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-15T19:22:51.462780] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:22:52.113988] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-15T19:22:52.914053] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-15T19:23:06.926698] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (14.81 seconds). [2025-10-15T19:23:06.938256] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-15T19:23:06.988159] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (15.67 seconds). [2025-10-15T19:23:06.995634] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-15T19:23:08.514980] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:23:08.523842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-15T19:23:09.231206] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (16.32 seconds). [2025-10-15T19:23:09.238212] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-15T19:23:10.217141] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:23:10.226595] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-15T19:23:10.432769] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (19.92 seconds). [2025-10-15T19:23:10.438338] [INFO ] [REMOTE ] HGV: Full fetch complete (66024 records). [2025-10-15T19:23:10.438474] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-15T19:23:10.827865] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-15T19:23:10.827946] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-15T19:23:10.828872] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-15T19:23:10.828936] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-15T19:23:10.830196] [DEBUG] [LOCAL ] HGV: Trimmed 66024 records to 46390 (keeping 200 days of data) [2025-10-15T19:23:11.102029] [DEBUG] [LOCAL ] HGV: Primary data saved (46390 records). [2025-10-15T19:23:11.102194] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-15T19:23:11.103192] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HGV took 1m 3s. Estimated remaining: 3h 10m 54s. Rate: 7.1 symbols/min [2025-10-15T19:23:11.269243] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:11.323130] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-15T19:23:11.323438] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-15T19:23:11.500221] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:11.500448] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-15T19:23:11.500496] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-15T19:23:11.500992] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-15T19:23:11.501049] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-15T19:23:11.887756] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:11.888629] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-15T19:23:11.975550] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:23:11.985324] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-15T19:23:12.559502] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (5.62 seconds). [2025-10-15T19:23:12.571880] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-15T19:23:13.347515] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (4.11 seconds). [2025-10-15T19:23:13.355388] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-15T19:23:13.509136] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:23:13.516763] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-15T19:23:14.308738] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:23:14.319732] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-15T19:23:14.802340] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T19:23:14.816014] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-15T19:23:14.817569] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-10-15T19:23:14.830518] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-15T19:23:15.149375] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:23:15.157086] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-15T19:23:16.128956] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T19:23:16.143822] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-15T19:23:16.167585] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:23:16.176990] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-15T19:23:16.508252] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T19:23:16.519737] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-15T19:23:16.760506] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T19:23:16.767857] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-15T19:23:17.677812] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:23:17.682394] [INFO ] [REMOTE ] HI: Full fetch complete (50472 records). [2025-10-15T19:23:17.682480] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-15T19:23:18.077321] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-15T19:23:18.087787] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-15T19:23:18.093894] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-15T19:23:18.107560] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-15T19:23:18.127352] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T19:23:18.138938] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:23:18.144507] [DEBUG] [LOCAL ] HI: Trimmed 50472 records to 35761 (keeping 200 days of data) [2025-10-15T19:23:18.150698] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-15T19:23:18.152976] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-15T19:23:18.379591] [DEBUG] [LOCAL ] HI: Primary data saved (35761 records). [2025-10-15T19:23:18.379773] [INFO ] [MAIN ] HI: Full history saved. [2025-10-15T19:23:18.379927] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 52.9s. Estimated remaining: 3h 10m 44s. Rate: 7.1 symbols/min [2025-10-15T19:23:18.527370] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T19:23:18.579868] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-15T19:23:18.598310] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:18.622226] [DEBUG] [LOCAL ] HIO: Loaded 24147 existing records from primary storage. [2025-10-15T19:23:18.622484] [INFO ] [MAIN ] HIO: Loaded 24147 existing records. [2025-10-15T19:23:18.799824] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:18.800029] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-15T19:23:18.800114] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-15T19:23:18.800501] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-15T19:23:18.800557] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-15T19:23:19.145696] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:19.146020] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-15T19:23:19.733190] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:23:19.740471] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-15T19:23:19.989705] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T19:23:20.000894] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-15T19:23:20.297389] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T19:23:20.303739] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-15T19:23:20.889210] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T19:23:20.893498] [INFO ] [REMOTE ] HII: Full fetch complete (52525 records). [2025-10-15T19:23:20.902316] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-15T19:23:20.941505] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:23:21.021403] [INFO ] [REMOTE ] HIG: Full fetch complete (73448 records). [2025-10-15T19:23:21.032001] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-15T19:23:21.507414] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-15T19:23:21.668074] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-15T19:23:21.676431] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-15T19:23:21.680180] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-15T19:23:21.697727] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-15T19:23:21.697876] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-15T19:23:21.713583] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:23:21.751679] [DEBUG] [LOCAL ] HII: Trimmed 52525 records to 33852 (keeping 200 days of data) [2025-10-15T19:23:21.751478] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-15T19:23:21.813904] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-15T19:23:21.814018] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-15T19:23:21.814993] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-15T19:23:21.815100] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-15T19:23:21.907069] [DEBUG] [LOCAL ] HIG: Trimmed 73448 records to 51192 (keeping 200 days of data) [2025-10-15T19:23:22.219457] [DEBUG] [LOCAL ] HII: Primary data saved (33852 records). [2025-10-15T19:23:22.228306] [INFO ] [MAIN ] HII: Full history saved. [2025-10-15T19:23:22.255432] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HII took 37.7s. Estimated remaining: 3h 10m 30s. Rate: 7.1 symbols/min [2025-10-15T19:23:22.458944] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:22.549857] [DEBUG] [LOCAL ] HIPO: Loaded 21934 existing records from primary storage. [2025-10-15T19:23:22.550990] [INFO ] [MAIN ] HIPO: Loaded 21934 existing records. [2025-10-15T19:23:22.732183] [DEBUG] [LOCAL ] HIG: Primary data saved (51192 records). [2025-10-15T19:23:22.748322] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-15T19:23:22.752788] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:22.753736] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-15T19:23:22.753502] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HIG took 40.7s. Estimated remaining: 3h 10m 11s. Rate: 7.1 symbols/min [2025-10-15T19:23:22.753914] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-15T19:23:22.759448] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-15T19:23:22.777276] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-15T19:23:23.134291] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:23.178449] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T19:23:23.227043] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-15T19:23:23.341498] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:23.341842] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-15T19:23:23.370529] [DEBUG] [LOCAL ] HIW: Loaded 44584 existing records from primary storage. [2025-10-15T19:23:23.370871] [INFO ] [MAIN ] HIW: Loaded 44584 existing records. [2025-10-15T19:23:23.556436] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:23.556694] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-15T19:23:23.556755] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-15T19:23:23.557159] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-15T19:23:23.557214] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-15T19:23:23.918010] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:23.918401] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-15T19:23:24.192861] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-15T19:23:24.205681] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-15T19:23:24.219943] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:23:24.224666] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-15T19:23:24.595136] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T19:23:24.602145] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-15T19:23:24.840343] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:23:24.844783] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-15T19:23:25.424896] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T19:23:25.434284] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-15T19:23:25.453811] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T19:23:25.460473] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-15T19:23:25.824538] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:23:25.828803] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-15T19:23:26.265875] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:23:26.271457] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-15T19:23:26.320625] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T19:23:26.332169] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-15T19:23:26.539087] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T19:23:26.544432] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-15T19:23:26.982385] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:23:26.991427] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-15T19:23:27.252320] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T19:23:27.258155] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-15T19:23:27.487474] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:23:27.492878] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-15T19:23:28.289251] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T19:23:28.294558] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-15T19:23:28.446596] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:23:28.488502] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:23:28.684260] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-15T19:23:28.913992] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-15T19:23:29.245800] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T19:23:29.713966] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-15T19:23:30.102999] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T19:23:30.514065] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-15T19:23:31.314089] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-15T19:23:31.409936] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:23:32.114037] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-15T19:23:32.446635] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:23:32.913999] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-15T19:23:33.065810] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-15T19:23:33.719441] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-15T19:23:33.733993] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T19:23:34.244774] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:23:34.249774] [INFO ] [REMOTE ] HIO: Full fetch complete (37955 records). [2025-10-15T19:23:34.249888] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-15T19:23:34.526211] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-15T19:23:34.648691] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-15T19:23:34.648780] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-15T19:23:34.649526] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-15T19:23:34.649585] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-15T19:23:34.650607] [DEBUG] [LOCAL ] HIO: Trimmed 37955 records to 24351 (keeping 200 days of data) [2025-10-15T19:23:34.790725] [DEBUG] [LOCAL ] HIO: Primary data saved (24351 records). [2025-10-15T19:23:34.790866] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-15T19:23:34.790946] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 16.4s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-15T19:23:34.953291] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:34.973293] [DEBUG] [LOCAL ] HIX: Loaded 20500 existing records from primary storage. [2025-10-15T19:23:34.973527] [INFO ] [MAIN ] HIX: Loaded 20500 existing records. [2025-10-15T19:23:35.145361] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:35.145563] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-15T19:23:35.145629] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-15T19:23:35.145919] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-15T19:23:35.145964] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-15T19:23:35.324299] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-15T19:23:35.495752] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:35.641199] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:23:36.106725] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-15T19:23:36.117355] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-15T19:23:36.885900] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:23:36.913961] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-15T19:23:37.227197] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:23:37.714003] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-15T19:23:38.395319] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:23:38.514033] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-15T19:23:38.715169] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:23:39.314022] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-15T19:23:39.363048] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:23:40.114054] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-15T19:23:40.685357] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:23:40.913986] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-15T19:23:41.713994] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-15T19:23:41.915088] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T19:23:42.514068] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-15T19:23:42.759142] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-15T19:23:43.282356] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:23:43.313955] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-15T19:23:43.527081] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:23:43.529495] [INFO ] [REMOTE ] HIPO: Full fetch complete (31266 records). [2025-10-15T19:23:43.529590] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-15T19:23:43.889156] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-15T19:23:43.889231] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-15T19:23:43.889852] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-15T19:23:43.889913] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-15T19:23:43.890603] [DEBUG] [LOCAL ] HIPO: Trimmed 31266 records to 21869 (keeping 200 days of data) [2025-10-15T19:23:44.019110] [DEBUG] [LOCAL ] HIPO: Primary data saved (21869 records). [2025-10-15T19:23:44.019248] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-15T19:23:44.019328] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIPO took 21.8s. Estimated remaining: 3h 9m 60s. Rate: 7.1 symbols/min [2025-10-15T19:23:44.116905] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-15T19:23:44.186551] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:44.203926] [DEBUG] [LOCAL ] HKD: Loaded 18591 existing records from primary storage. [2025-10-15T19:23:44.204196] [INFO ] [MAIN ] HKD: Loaded 18591 existing records. [2025-10-15T19:23:44.380762] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:44.380976] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-15T19:23:44.381021] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-15T19:23:44.381186] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-15T19:23:44.381223] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-15T19:23:44.743495] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:44.794416] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T19:23:44.913983] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-15T19:23:45.713996] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-15T19:23:45.942921] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:23:46.514007] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-15T19:23:46.561764] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-15T19:23:46.569174] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-15T19:23:46.569317] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-15T19:23:46.989916] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-15T19:23:46.990000] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-15T19:23:46.991093] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-15T19:23:46.991166] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-15T19:23:46.992709] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-15T19:23:47.311547] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-15T19:23:47.311808] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-15T19:23:47.323216] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-15T19:23:47.326114] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 36.2s. Estimated remaining: 3h 9m 44s. Rate: 7.1 symbols/min [2025-10-15T19:23:47.350163] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:23:47.431498] [INFO ] [REMOTE ] HIW: Full fetch complete (64874 records). [2025-10-15T19:23:47.431817] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-15T19:23:47.541574] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T19:23:47.599953] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:47.940832] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-15T19:23:47.955554] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-15T19:23:47.958120] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-15T19:23:47.958204] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-15T19:23:47.959279] [DEBUG] [LOCAL ] HL: Loaded 53673 existing records from primary storage. [2025-10-15T19:23:47.960015] [INFO ] [MAIN ] HL: Loaded 53673 existing records. [2025-10-15T19:23:48.032760] [DEBUG] [LOCAL ] HIW: Trimmed 64874 records to 44595 (keeping 200 days of data) [2025-10-15T19:23:48.144686] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-15T19:23:48.242405] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:48.243512] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-15T19:23:48.243596] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-15T19:23:48.245662] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-15T19:23:48.246776] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-15T19:23:48.780190] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:48.795460] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:23:48.829556] [DEBUG] [LOCAL ] HIW: Primary data saved (44595 records). [2025-10-15T19:23:48.829749] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-15T19:23:48.829850] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIW took 26.1s. Estimated remaining: 3h 9m 27s. Rate: 7.1 symbols/min [2025-10-15T19:23:48.919159] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-15T19:23:49.002464] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:49.049130] [DEBUG] [LOCAL ] HLF: Loaded 48505 existing records from primary storage. [2025-10-15T19:23:49.049476] [INFO ] [MAIN ] HLF: Loaded 48505 existing records. [2025-10-15T19:23:49.234667] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:49.243072] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-15T19:23:49.243156] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-15T19:23:49.243685] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T19:23:49.248269] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-15T19:23:49.248632] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-15T19:23:49.594040] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:49.714000] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-15T19:23:50.203342] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:23:50.514035] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-15T19:23:51.192517] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:23:51.314025] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-15T19:23:51.994709] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:23:52.113965] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-15T19:23:52.241857] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T19:23:52.914004] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-15T19:23:53.714043] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-15T19:23:53.919971] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T19:23:54.031368] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T19:23:54.513998] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-15T19:23:55.043584] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:23:55.191486] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T19:23:55.314019] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-15T19:23:56.114002] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-15T19:23:56.913971] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-15T19:23:57.267243] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-15T19:23:57.315570] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:23:57.456721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T19:23:57.714042] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-15T19:23:58.514049] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-15T19:23:58.731344] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T19:23:59.314046] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-15T19:24:00.070478] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T19:24:00.113954] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-15T19:24:00.325934] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:24:00.913998] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-15T19:24:01.714026] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-15T19:24:01.744673] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:24:02.493508] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:24:02.519208] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-15T19:24:02.522130] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T19:24:03.314034] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-15T19:24:04.113986] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-15T19:24:04.291713] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T19:24:04.907382] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:24:04.918074] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-15T19:24:05.107618] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:24:05.714039] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-15T19:24:06.462716] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:24:06.514005] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-15T19:24:06.784301] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:24:06.786957] [INFO ] [REMOTE ] HIX: Full fetch complete (30135 records). [2025-10-15T19:24:06.787036] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-15T19:24:07.150817] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-15T19:24:07.150899] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-15T19:24:07.151488] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-15T19:24:07.151528] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-15T19:24:07.152325] [DEBUG] [LOCAL ] HIX: Trimmed 30135 records to 20507 (keeping 200 days of data) [2025-10-15T19:24:07.269283] [DEBUG] [LOCAL ] HIX: Primary data saved (20507 records). [2025-10-15T19:24:07.269406] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-15T19:24:07.269483] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 32.5s. Estimated remaining: 3h 9m 32s. Rate: 7.1 symbols/min [2025-10-15T19:24:07.321249] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-15T19:24:07.445588] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:07.476160] [DEBUG] [LOCAL ] HLI: Loaded 30898 existing records from primary storage. [2025-10-15T19:24:07.476409] [INFO ] [MAIN ] HLI: Loaded 30898 existing records. [2025-10-15T19:24:07.654615] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:07.654961] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-15T19:24:07.655017] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-15T19:24:07.655218] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-15T19:24:07.655285] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-15T19:24:07.846153] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:24:08.061217] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:08.113961] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-15T19:24:08.914032] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-15T19:24:09.178103] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T19:24:09.215186] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T19:24:09.714060] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-15T19:24:10.093364] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:24:10.514013] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-15T19:24:11.314022] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-15T19:24:11.538659] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:24:12.028670] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T19:24:12.063926] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T19:24:12.114016] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-15T19:24:12.914010] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-15T19:24:13.358411] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T19:24:13.714061] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-15T19:24:14.361573] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:24:14.514001] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-15T19:24:15.314055] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-15T19:24:15.375590] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:24:16.114005] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-15T19:24:16.541050] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T19:24:16.544148] [INFO ] [REMOTE ] HKD: Full fetch complete (28348 records). [2025-10-15T19:24:16.544237] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-15T19:24:16.906281] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-15T19:24:16.931084] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-15T19:24:16.953794] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-15T19:24:16.953873] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-15T19:24:16.954563] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-15T19:24:16.954662] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-15T19:24:16.956152] [DEBUG] [LOCAL ] HKD: Trimmed 28348 records to 18657 (keeping 200 days of data) [2025-10-15T19:24:17.061799] [DEBUG] [LOCAL ] HKD: Primary data saved (18657 records). [2025-10-15T19:24:17.061920] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-15T19:24:17.061997] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 33.0s. Estimated remaining: 3h 9m 25s. Rate: 7.1 symbols/min [2025-10-15T19:24:17.255342] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:17.284359] [DEBUG] [LOCAL ] HLIO: Loaded 28076 existing records from primary storage. [2025-10-15T19:24:17.284704] [INFO ] [MAIN ] HLIO: Loaded 28076 existing records. [2025-10-15T19:24:17.497397] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:17.500082] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:24:17.500246] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-15T19:24:17.510081] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-15T19:24:17.510878] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-15T19:24:17.510947] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-15T19:24:17.719168] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-15T19:24:17.867970] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:18.192891] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:24:18.514032] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-15T19:24:19.313995] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-15T19:24:19.416519] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T19:24:20.114019] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-15T19:24:20.461286] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T19:24:20.582681] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-15T19:24:20.914055] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-15T19:24:21.506497] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:24:21.512127] [INFO ] [REMOTE ] HLF: Full fetch complete (70995 records). [2025-10-15T19:24:21.512228] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-15T19:24:21.721690] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-15T19:24:21.900004] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-15T19:24:21.900097] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-15T19:24:21.901160] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-15T19:24:21.901229] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-15T19:24:21.902541] [DEBUG] [LOCAL ] HLF: Trimmed 70995 records to 48547 (keeping 200 days of data) [2025-10-15T19:24:22.175170] [DEBUG] [LOCAL ] HLF: Primary data saved (48547 records). [2025-10-15T19:24:22.175295] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-15T19:24:22.175376] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLF took 33.3s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-15T19:24:22.346311] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:22.377776] [DEBUG] [LOCAL ] HLLY: Loaded 33534 existing records from primary storage. [2025-10-15T19:24:22.378054] [INFO ] [MAIN ] HLLY: Loaded 33534 existing records. [2025-10-15T19:24:22.519150] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-15T19:24:22.556114] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:22.557331] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-15T19:24:22.557383] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-15T19:24:22.557668] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-15T19:24:22.557756] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-15T19:24:22.860429] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:24:22.947568] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:23.313999] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-15T19:24:23.393639] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-15T19:24:23.938500] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T19:24:24.114020] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-15T19:24:24.210979] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T19:24:24.914091] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-15T19:24:25.139454] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:24:25.714000] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-15T19:24:26.513996] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-15T19:24:26.811067] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T19:24:26.920332] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T19:24:26.926782] [INFO ] [REMOTE ] HL: Full fetch complete (77822 records). [2025-10-15T19:24:26.926897] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-15T19:24:27.315791] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-15T19:24:27.315491] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-15T19:24:27.316734] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-15T19:24:27.317852] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-15T19:24:27.318056] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-15T19:24:27.319713] [DEBUG] [LOCAL ] HL: Trimmed 77822 records to 53675 (keeping 200 days of data) [2025-10-15T19:24:27.534090] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:24:27.651903] [DEBUG] [LOCAL ] HL: Primary data saved (53675 records). [2025-10-15T19:24:27.652030] [INFO ] [MAIN ] HL: Full history saved. [2025-10-15T19:24:27.652107] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HL took 40.3s. Estimated remaining: 3h 8m 60s. Rate: 7.1 symbols/min [2025-10-15T19:24:27.824057] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:27.874004] [DEBUG] [LOCAL ] HLN: Loaded 53117 existing records from primary storage. [2025-10-15T19:24:27.874296] [INFO ] [MAIN ] HLN: Loaded 53117 existing records. [2025-10-15T19:24:28.067270] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:28.067502] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-15T19:24:28.067559] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-15T19:24:28.068082] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-15T19:24:28.068140] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-15T19:24:28.119170] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-15T19:24:28.443773] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:28.654624] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T19:24:28.913989] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-15T19:24:29.056069] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T19:24:29.714007] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-15T19:24:30.468818] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:24:30.513948] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-15T19:24:30.781041] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:24:31.314015] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-15T19:24:31.992246] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:24:32.113960] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-15T19:24:32.590420] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:24:32.914048] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-15T19:24:33.721229] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-15T19:24:33.739746] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T19:24:34.124693] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T19:24:34.514047] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-15T19:24:35.140901] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:24:35.313994] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-15T19:24:35.776333] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:24:36.114096] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-15T19:24:36.606946] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T19:24:36.914001] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-15T19:24:37.354996] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:24:37.713973] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-15T19:24:37.864640] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T19:24:38.514044] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-15T19:24:39.214861] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:24:39.314116] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-15T19:24:40.030117] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T19:24:40.113974] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-15T19:24:40.506298] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:24:40.914031] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-15T19:24:41.714049] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-15T19:24:41.930749] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:24:42.514014] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-15T19:24:42.883708] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-15T19:24:43.032913] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:24:43.314006] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-15T19:24:44.113978] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-15T19:24:44.398769] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T19:24:44.675562] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-15T19:24:44.913987] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-15T19:24:45.244489] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:24:45.713986] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-15T19:24:46.486391] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T19:24:46.513980] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-15T19:24:46.804511] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T19:24:46.807910] [INFO ] [REMOTE ] HLIO: Full fetch complete (36808 records). [2025-10-15T19:24:46.808003] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-15T19:24:47.198425] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-15T19:24:47.198503] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-15T19:24:47.199329] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-15T19:24:47.199392] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-15T19:24:47.200217] [DEBUG] [LOCAL ] HLIO: Trimmed 36808 records to 28238 (keeping 200 days of data) [2025-10-15T19:24:47.317676] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-15T19:24:47.373204] [DEBUG] [LOCAL ] HLIO: Primary data saved (28238 records). [2025-10-15T19:24:47.373316] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-15T19:24:47.373394] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLIO took 30.3s. Estimated remaining: 3h 9m 6s. Rate: 7.1 symbols/min [2025-10-15T19:24:47.540304] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:47.593188] [DEBUG] [LOCAL ] HLT: Loaded 50550 existing records from primary storage. [2025-10-15T19:24:47.593533] [INFO ] [MAIN ] HLT: Loaded 50550 existing records. [2025-10-15T19:24:47.782759] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:47.782940] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-15T19:24:47.782986] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-15T19:24:47.783484] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-15T19:24:47.783524] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-15T19:24:48.118929] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-15T19:24:48.140193] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:48.254774] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:24:48.836560] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T19:24:48.913962] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-15T19:24:49.383716] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:24:49.713996] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-15T19:24:49.793429] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T19:24:50.514057] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-15T19:24:51.313984] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-15T19:24:51.418402] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T19:24:51.490045] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T19:24:52.114066] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-15T19:24:52.799951] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T19:24:52.914002] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-15T19:24:53.449475] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T19:24:53.454003] [INFO ] [REMOTE ] HLI: Full fetch complete (45212 records). [2025-10-15T19:24:53.454122] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-15T19:24:53.719696] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-15T19:24:53.884365] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-15T19:24:53.884470] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-15T19:24:53.885885] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-15T19:24:53.885951] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-15T19:24:53.887296] [DEBUG] [LOCAL ] HLI: Trimmed 45212 records to 30847 (keeping 200 days of data) [2025-10-15T19:24:54.104738] [DEBUG] [LOCAL ] HLI: Primary data saved (30847 records). [2025-10-15T19:24:54.105059] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-15T19:24:54.105181] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLI took 46.8s. Estimated remaining: 3h 8m 55s. Rate: 7.1 symbols/min [2025-10-15T19:24:54.286729] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:54.335193] [DEBUG] [LOCAL ] HLX: Loaded 47440 existing records from primary storage. [2025-10-15T19:24:54.335610] [INFO ] [MAIN ] HLX: Loaded 47440 existing records. [2025-10-15T19:24:54.519634] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-15T19:24:54.525806] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:54.527543] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-15T19:24:54.527689] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-15T19:24:54.528070] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-15T19:24:54.528135] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-15T19:24:54.864776] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T19:24:54.929355] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:55.314041] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-15T19:24:55.433110] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:24:55.659015] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:24:55.664628] [INFO ] [REMOTE ] HLLY: Full fetch complete (46136 records). [2025-10-15T19:24:55.664851] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-15T19:24:56.058176] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-15T19:24:56.058294] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-15T19:24:56.059100] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-15T19:24:56.059166] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-15T19:24:56.060261] [DEBUG] [LOCAL ] HLLY: Trimmed 46136 records to 33508 (keeping 200 days of data) [2025-10-15T19:24:56.140256] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-15T19:24:56.249519] [DEBUG] [LOCAL ] HLLY: Primary data saved (33508 records). [2025-10-15T19:24:56.249677] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-15T19:24:56.249776] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 34.1s. Estimated remaining: 3h 8m 39s. Rate: 7.1 symbols/min [2025-10-15T19:24:56.422906] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:56.463954] [DEBUG] [LOCAL ] HMC: Loaded 46526 existing records from primary storage. [2025-10-15T19:24:56.464280] [INFO ] [MAIN ] HMC: Loaded 46526 existing records. [2025-10-15T19:24:56.644823] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:56.645068] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-15T19:24:56.645116] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-15T19:24:56.645869] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-15T19:24:56.645928] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-15T19:24:56.921136] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-15T19:24:57.015301] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:57.043984] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:24:57.707511] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:24:57.713976] [INFO ] [REMOTE ] HLN: Full fetch complete (77004 records). [2025-10-15T19:24:57.714035] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-15T19:24:57.714318] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-15T19:24:58.117951] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-15T19:24:58.118295] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-15T19:24:58.119335] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-15T19:24:58.119398] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-15T19:24:58.120957] [DEBUG] [LOCAL ] HLN: Trimmed 77004 records to 53123 (keeping 200 days of data) [2025-10-15T19:24:58.442529] [DEBUG] [LOCAL ] HLN: Primary data saved (53123 records). [2025-10-15T19:24:58.442698] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-15T19:24:58.443860] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLN took 30.8s. Estimated remaining: 3h 8m 22s. Rate: 7.1 symbols/min [2025-10-15T19:24:58.518206] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-15T19:24:58.632624] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:58.671482] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T19:24:58.688330] [DEBUG] [LOCAL ] HMN: Loaded 23474 existing records from primary storage. [2025-10-15T19:24:58.688554] [INFO ] [MAIN ] HMN: Loaded 23474 existing records. [2025-10-15T19:24:58.865009] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:58.865226] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-15T19:24:58.865274] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-15T19:24:58.865912] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-15T19:24:58.865971] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-15T19:24:59.218613] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:59.313960] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-15T19:24:59.810212] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T19:25:00.113992] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-15T19:25:00.410267] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T19:25:00.455785] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T19:25:00.914059] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-15T19:25:01.715966] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-15T19:25:01.718828] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T19:25:01.811704] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T19:25:02.514014] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-15T19:25:03.268448] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:25:03.313955] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-15T19:25:04.114000] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-15T19:25:04.266720] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:25:04.913984] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-15T19:25:05.096303] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T19:25:05.497329] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:25:05.713986] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-15T19:25:05.931316] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:25:06.514062] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-15T19:25:07.314011] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-15T19:25:07.454277] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:25:07.547966] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T19:25:08.114038] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-15T19:25:08.771585] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:25:08.913989] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-15T19:25:09.713977] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-15T19:25:09.808821] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:25:10.124855] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T19:25:10.514056] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-15T19:25:11.313977] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-15T19:25:11.666171] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T19:25:11.770092] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:25:12.114016] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-15T19:25:12.790120] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:25:12.913968] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-15T19:25:13.183339] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:25:13.713990] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-15T19:25:14.514009] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-15T19:25:14.862636] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T19:25:15.241458] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T19:25:15.314002] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-15T19:25:16.113990] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-15T19:25:16.243603] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:25:16.913987] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-15T19:25:17.226393] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T19:25:17.306109] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T19:25:17.714052] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-15T19:25:18.375517] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T19:25:18.513980] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-15T19:25:18.717976] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:25:18.927929] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T19:25:18.934045] [INFO ] [REMOTE ] HLT: Full fetch complete (73614 records). [2025-10-15T19:25:18.934194] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-15T19:25:19.326052] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-15T19:25:19.329756] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-15T19:25:19.330678] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-15T19:25:19.331842] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-15T19:25:19.332028] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-15T19:25:19.333522] [DEBUG] [LOCAL ] HLT: Trimmed 73614 records to 50527 (keeping 200 days of data) [2025-10-15T19:25:19.646899] [DEBUG] [LOCAL ] HLT: Primary data saved (50527 records). [2025-10-15T19:25:19.647032] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-15T19:25:19.647478] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLT took 32.3s. Estimated remaining: 3h 8m 30s. Rate: 7.1 symbols/min [2025-10-15T19:25:19.837086] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:19.890530] [DEBUG] [LOCAL ] HMY: Loaded 53167 existing records from primary storage. [2025-10-15T19:25:19.890979] [INFO ] [MAIN ] HMY: Loaded 53167 existing records. [2025-10-15T19:25:20.102162] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:20.102376] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-15T19:25:20.102422] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-15T19:25:20.103359] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-15T19:25:20.103419] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-15T19:25:20.119239] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-15T19:25:20.466662] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:20.913965] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-15T19:25:21.109298] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T19:25:21.714032] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-15T19:25:21.761120] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:25:21.918575] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T19:25:22.514006] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-15T19:25:23.314002] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-15T19:25:23.315309] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T19:25:23.852453] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:25:24.114012] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-15T19:25:24.919083] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-15T19:25:24.932031] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:25:25.713973] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-15T19:25:25.846099] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:25:26.514040] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-15T19:25:26.848360] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T19:25:27.313973] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-15T19:25:27.437090] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:25:27.436838] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T19:25:27.449879] [INFO ] [REMOTE ] HMN: Full fetch complete (31581 records). [2025-10-15T19:25:27.450087] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-15T19:25:27.818170] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-15T19:25:27.818255] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-15T19:25:27.818922] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-15T19:25:27.818982] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-15T19:25:27.819808] [DEBUG] [LOCAL ] HMN: Trimmed 31581 records to 23512 (keeping 200 days of data) [2025-10-15T19:25:27.961702] [DEBUG] [LOCAL ] HMN: Primary data saved (23512 records). [2025-10-15T19:25:27.961836] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-15T19:25:27.961916] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HMN took 29.5s. Estimated remaining: 3h 8m 22s. Rate: 7.1 symbols/min [2025-10-15T19:25:28.125398] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-15T19:25:28.128086] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:28.129186] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-15T19:25:28.129233] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-15T19:25:28.129342] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-15T19:25:28.129382] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-15T19:25:28.129423] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-15T19:25:28.129455] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-15T19:25:28.498714] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:28.913969] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-15T19:25:29.225156] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T19:25:29.713983] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-15T19:25:29.924928] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T19:25:30.513968] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-15T19:25:30.576584] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T19:25:30.713905] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:25:30.714206] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-15T19:25:30.714293] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:25:30.714359] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-15T19:25:30.714423] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:25:30.714494] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-15T19:25:30.714558] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-15T19:25:30.714593] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-15T19:25:30.714631] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-15T19:25:30.714725] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HNGE took 2.8s. Estimated remaining: 3h 8m 6s. Rate: 7.1 symbols/min [2025-10-15T19:25:30.880876] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:30.909335] [DEBUG] [LOCAL ] HNI: Loaded 29528 existing records from primary storage. [2025-10-15T19:25:30.909596] [INFO ] [MAIN ] HNI: Loaded 29528 existing records. [2025-10-15T19:25:31.093385] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:31.093711] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-15T19:25:31.093774] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-15T19:25:31.094314] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-15T19:25:31.094374] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-15T19:25:31.320943] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-15T19:25:31.643306] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:31.821125] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T19:25:32.114016] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-15T19:25:32.712726] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T19:25:32.914059] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-15T19:25:33.393086] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T19:25:33.714014] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-15T19:25:34.514176] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-15T19:25:34.536932] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T19:25:34.542722] [INFO ] [REMOTE ] HLX: Full fetch complete (69011 records). [2025-10-15T19:25:34.542877] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-15T19:25:34.958070] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-15T19:25:34.958161] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-15T19:25:34.959155] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-15T19:25:34.959219] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-15T19:25:34.960518] [DEBUG] [LOCAL ] HLX: Trimmed 69011 records to 47471 (keeping 200 days of data) [2025-10-15T19:25:35.219581] [DEBUG] [LOCAL ] HLX: Primary data saved (47471 records). [2025-10-15T19:25:35.219737] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-15T19:25:35.219839] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HLX took 41.1s. Estimated remaining: 3h 7m 52s. Rate: 7.1 symbols/min [2025-10-15T19:25:35.317580] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-15T19:25:35.392973] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:35.441889] [DEBUG] [LOCAL ] HOG: Loaded 50858 existing records from primary storage. [2025-10-15T19:25:35.442227] [INFO ] [MAIN ] HOG: Loaded 50858 existing records. [2025-10-15T19:25:35.621674] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:35.622032] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-15T19:25:35.622299] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-15T19:25:35.628251] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-15T19:25:35.636011] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-15T19:25:35.668740] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:25:35.997959] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:36.034604] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T19:25:36.113957] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-15T19:25:36.914030] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-15T19:25:37.072080] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:25:37.079939] [INFO ] [REMOTE ] HMC: Full fetch complete (68980 records). [2025-10-15T19:25:37.080119] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-15T19:25:37.459367] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-15T19:25:37.459455] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-15T19:25:37.460401] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-15T19:25:37.460483] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-15T19:25:37.461854] [DEBUG] [LOCAL ] HMC: Trimmed 68980 records to 46489 (keeping 200 days of data) [2025-10-15T19:25:37.716716] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-15T19:25:37.738838] [DEBUG] [LOCAL ] HMC: Primary data saved (46489 records). [2025-10-15T19:25:37.738962] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-15T19:25:37.739054] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HMC took 41.5s. Estimated remaining: 3h 7m 36s. Rate: 7.1 symbols/min [2025-10-15T19:25:37.914458] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:37.957023] [DEBUG] [LOCAL ] HOMB: Loaded 43570 existing records from primary storage. [2025-10-15T19:25:37.957410] [INFO ] [MAIN ] HOMB: Loaded 43570 existing records. [2025-10-15T19:25:38.148630] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:25:38.152552] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:38.159365] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-15T19:25:38.159950] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-15T19:25:38.160755] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-15T19:25:38.160817] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-15T19:25:38.349137] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-15T19:25:38.522339] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-15T19:25:38.567149] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:39.324194] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-15T19:25:39.355181] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:25:40.114027] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-15T19:25:40.560618] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T19:25:40.599140] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T19:25:40.913998] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-15T19:25:41.713977] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-15T19:25:41.867046] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:25:41.900009] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T19:25:42.514001] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-15T19:25:43.314052] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-15T19:25:43.559134] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T19:25:43.777475] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:25:44.114028] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-15T19:25:44.175356] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:25:44.914005] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-15T19:25:45.714038] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-15T19:25:46.151580] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T19:25:46.350299] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T19:25:46.513962] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-15T19:25:46.882677] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T19:25:47.313998] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-15T19:25:48.113962] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-15T19:25:48.328212] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T19:25:48.354540] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:25:48.913988] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-15T19:25:49.713966] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-15T19:25:49.886478] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:25:50.513999] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-15T19:25:50.725954] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:25:51.208502] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:25:51.313951] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-15T19:25:51.497195] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:25:52.113995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-15T19:25:52.824454] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:25:52.913968] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-15T19:25:53.616261] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T19:25:53.714051] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-15T19:25:54.507073] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:25:54.516151] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-15T19:25:55.314025] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-15T19:25:55.482227] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T19:25:55.812746] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T19:25:55.816855] [INFO ] [REMOTE ] HNI: Full fetch complete (42025 records). [2025-10-15T19:25:55.816963] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-15T19:25:56.119144] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-15T19:25:56.194876] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-15T19:25:56.194967] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-15T19:25:56.195796] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-15T19:25:56.195871] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-15T19:25:56.197218] [DEBUG] [LOCAL ] HNI: Trimmed 42025 records to 29627 (keeping 200 days of data) [2025-10-15T19:25:56.380041] [DEBUG] [LOCAL ] HNI: Primary data saved (29627 records). [2025-10-15T19:25:56.380169] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-15T19:25:56.380248] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HNI took 25.7s. Estimated remaining: 3h 7m 41s. Rate: 7.1 symbols/min [2025-10-15T19:25:56.548484] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:56.589462] [DEBUG] [LOCAL ] HOUS: Loaded 45217 existing records from primary storage. [2025-10-15T19:25:56.589809] [INFO ] [MAIN ] HOUS: Loaded 45217 existing records. [2025-10-15T19:25:56.767788] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:56.768037] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-15T19:25:56.768085] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-15T19:25:56.768800] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-15T19:25:56.768858] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-15T19:25:56.914295] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-15T19:25:57.152255] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:57.182390] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:25:57.714027] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-15T19:25:58.128595] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T19:25:58.513982] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-15T19:25:58.689527] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:25:58.722327] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:25:59.314049] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-15T19:26:00.113969] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-15T19:26:00.507111] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T19:26:00.514538] [INFO ] [REMOTE ] HMY: Full fetch complete (77012 records). [2025-10-15T19:26:00.514698] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-15T19:26:00.929572] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-15T19:26:00.953194] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-15T19:26:00.954248] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-15T19:26:00.955411] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-15T19:26:00.955673] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-15T19:26:00.957186] [DEBUG] [LOCAL ] HMY: Trimmed 77012 records to 53166 (keeping 200 days of data) [2025-10-15T19:26:01.077768] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T19:26:01.335718] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T19:26:01.366658] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-15T19:26:01.366775] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-15T19:26:01.367079] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HMY took 41.7s. Estimated remaining: 3h 7m 28s. Rate: 7.1 symbols/min [2025-10-15T19:26:01.713992] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-15T19:26:02.514033] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-15T19:26:02.594848] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:26:03.264225] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T19:26:03.313965] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-15T19:26:03.553725] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:26:04.114054] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-15T19:26:04.914033] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-15T19:26:04.980974] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:26:04.986948] [INFO ] [REMOTE ] HOG: Full fetch complete (74305 records). [2025-10-15T19:26:04.987065] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-15T19:26:05.378047] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-15T19:26:05.378143] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-15T19:26:05.379194] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-15T19:26:05.379299] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-15T19:26:05.380824] [DEBUG] [LOCAL ] HOG: Trimmed 74305 records to 50849 (keeping 200 days of data) [2025-10-15T19:26:05.495014] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T19:26:05.719035] [DEBUG] [LOCAL ] HOG: Primary data saved (50849 records). [2025-10-15T19:26:05.716943] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-15T19:26:05.720098] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-15T19:26:05.720539] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOG took 30.5s. Estimated remaining: 3h 7m 14s. Rate: 7.1 symbols/min [2025-10-15T19:26:06.212683] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:26:06.514044] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-15T19:26:07.008458] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T19:26:07.314052] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-15T19:26:08.141559] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:26:08.151962] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-15T19:26:08.725113] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:26:08.914013] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-15T19:26:09.644965] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:26:09.713965] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-15T19:26:10.372954] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T19:26:10.513966] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-15T19:26:10.843344] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:26:11.314017] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-15T19:26:11.623108] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:26:12.114005] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-15T19:26:12.913237] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:26:12.918684] [INFO ] [REMOTE ] HOMB: Full fetch complete (64137 records). [2025-10-15T19:26:12.918798] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-15T19:26:13.298844] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-15T19:26:13.298946] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-15T19:26:13.299890] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-15T19:26:13.299971] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-15T19:26:13.301471] [DEBUG] [LOCAL ] HOMB: Trimmed 64137 records to 43633 (keeping 200 days of data) [2025-10-15T19:26:13.420983] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T19:26:13.442964] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-15T19:26:13.603929] [DEBUG] [LOCAL ] HOMB: Primary data saved (43633 records). [2025-10-15T19:26:13.604053] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-15T19:26:13.604130] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOMB took 35.9s. Estimated remaining: 3h 7m 5s. Rate: 7.1 symbols/min [2025-10-15T19:26:14.758563] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:26:14.769472] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-15T19:26:16.554774] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T19:26:16.561264] [INFO ] [REMOTE ] HOUS: Full fetch complete (64363 records). [2025-10-15T19:26:16.561428] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-15T19:26:16.960389] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-15T19:26:16.960466] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-15T19:26:16.961376] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-15T19:26:16.961480] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-15T19:26:16.962786] [DEBUG] [LOCAL ] HOUS: Trimmed 64363 records to 45340 (keeping 200 days of data) [2025-10-15T19:26:17.214377] [DEBUG] [LOCAL ] HOUS: Primary data saved (45340 records). [2025-10-15T19:26:17.214502] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-15T19:26:17.215401] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 20.8s. Estimated remaining: 3h 6m 50s. Rate: 7.1 symbols/min [2025-10-15T19:26:17.903301] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.834290] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.902186] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.948997] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.960726] [DEBUG] [LOCAL ] HPF: Loaded 7523 existing records from primary storage. [2025-10-15T19:26:17.961296] [INFO ] [MAIN ] HPF: Loaded 7523 existing records. [2025-10-15T19:26:18.024358] [DEBUG] [LOCAL ] HOV: Loaded 14015 existing records from primary storage. [2025-10-15T19:26:18.044481] [INFO ] [MAIN ] HOV: Loaded 14015 existing records. [2025-10-15T19:26:18.323157] [DEBUG] [LOCAL ] HP: Loaded 51534 existing records from primary storage. [2025-10-15T19:26:18.306331] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:18.342724] [INFO ] [MAIN ] HP: Loaded 51534 existing records. [2025-10-15T19:26:18.403087] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-15T19:26:18.397730] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:18.420465] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-15T19:26:18.420810] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-15T19:26:18.420870] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-15T19:26:18.436695] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-15T19:26:18.444346] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-15T19:26:18.436905] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-15T19:26:18.489153] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-15T19:26:18.525208] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-15T19:26:18.589101] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-15T19:26:18.891599] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:19.076853] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:18.980620] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-15T19:26:19.117167] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-15T19:26:19.117357] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-15T19:26:19.148437] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-15T19:26:19.173393] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-15T19:26:19.189252] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-15T19:26:19.331928] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-15T19:26:19.372142] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-15T19:26:19.550583] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:19.591131] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-15T19:26:20.087489] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:20.191479] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-15T19:26:20.191210] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:20.229929] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-15T19:26:20.331610] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:20.331983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-15T19:26:20.604864] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:26:20.607890] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-15T19:26:21.125407] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T19:26:21.128968] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-15T19:26:21.375052] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:26:21.378420] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-15T19:26:21.782195] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:26:21.801898] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:26:21.800495] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-15T19:26:21.805857] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-15T19:26:21.812162] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T19:26:21.814377] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-15T19:26:22.267532] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T19:26:22.419202] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T19:26:22.514028] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-15T19:26:22.637257] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T19:26:23.218753] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:26:23.314046] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-15T19:26:24.114044] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-15T19:26:24.606666] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T19:26:24.920469] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-15T19:26:24.926165] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:26:24.946150] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T19:26:25.713997] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-15T19:26:26.514049] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-15T19:26:26.723208] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T19:26:27.137912] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T19:26:27.313962] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-15T19:26:27.401202] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:26:28.004928] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T19:26:28.113989] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-15T19:26:28.913989] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-15T19:26:29.022150] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T19:26:29.714009] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-15T19:26:30.513964] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-15T19:26:30.585411] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T19:26:31.313975] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-15T19:26:31.388534] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T19:26:31.866482] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T19:26:32.055828] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:26:32.114038] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-15T19:26:32.914068] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-15T19:26:33.714046] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-15T19:26:33.962036] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T19:26:34.329402] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T19:26:34.513978] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-15T19:26:35.012444] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-15T19:26:35.314014] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-15T19:26:36.025488] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T19:26:36.113973] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-15T19:26:36.235711] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T19:26:36.833270] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T19:26:36.913962] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-15T19:26:37.713969] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-15T19:26:37.897046] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T19:26:38.514068] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-15T19:26:39.217085] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T19:26:39.218469] [INFO ] [REMOTE ] HPF: Full fetch complete (10675 records). [2025-10-15T19:26:39.218538] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-15T19:26:39.315258] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-15T19:26:39.576945] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-15T19:26:39.577244] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-15T19:26:39.577729] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-15T19:26:39.577817] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-15T19:26:39.578819] [DEBUG] [LOCAL ] HPF: Trimmed 10675 records to 7499 (keeping 200 days of data) [2025-10-15T19:26:39.642291] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T19:26:39.668193] [DEBUG] [LOCAL ] HPF: Primary data saved (7499 records). [2025-10-15T19:26:39.668334] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-15T19:26:39.668419] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 22.4s. Estimated remaining: 3h 6m 60s. Rate: 7.1 symbols/min [2025-10-15T19:26:39.833674] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:39.845191] [DEBUG] [LOCAL ] HPI: Loaded 10657 existing records from primary storage. [2025-10-15T19:26:39.845390] [INFO ] [MAIN ] HPI: Loaded 10657 existing records. [2025-10-15T19:26:40.019296] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:40.019551] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-15T19:26:40.019599] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-15T19:26:40.019948] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-15T19:26:40.020014] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-15T19:26:40.117485] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-15T19:26:40.368820] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:40.381261] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:26:40.914047] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-15T19:26:41.554639] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T19:26:41.713977] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-15T19:26:41.893627] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T19:26:42.271302] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T19:26:42.514010] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-15T19:26:43.314005] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-15T19:26:43.605066] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T19:26:44.113990] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-15T19:26:44.913968] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-15T19:26:44.971090] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T19:26:45.357456] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T19:26:45.713981] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-15T19:26:46.260822] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:26:46.290485] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T19:26:46.513995] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-15T19:26:47.313968] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-15T19:26:48.013317] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:26:48.019329] [INFO ] [REMOTE ] HP: Full fetch complete (74067 records). [2025-10-15T19:26:48.019430] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-15T19:26:48.117746] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-15T19:26:48.295078] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:26:48.329895] [INFO ] [REMOTE ] HOV: Full fetch complete (19093 records). [2025-10-15T19:26:48.330105] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-15T19:26:48.539139] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-15T19:26:48.544388] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-15T19:26:48.550944] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-15T19:26:48.561345] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-15T19:26:48.701558] [DEBUG] [LOCAL ] HP: Trimmed 74067 records to 51543 (keeping 200 days of data) [2025-10-15T19:26:48.943835] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-15T19:26:48.944751] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-15T19:26:48.954112] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T19:26:48.960097] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-15T19:26:48.960627] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-15T19:26:49.013412] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-15T19:26:49.054217] [DEBUG] [LOCAL ] HOV: Trimmed 19093 records to 14032 (keeping 200 days of data) [2025-10-15T19:26:49.223212] [DEBUG] [LOCAL ] HOV: Primary data saved (14032 records). [2025-10-15T19:26:49.224373] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-15T19:26:49.227077] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 32.0s. Estimated remaining: 3h 6m 53s. Rate: 7.1 symbols/min [2025-10-15T19:26:49.353764] [DEBUG] [LOCAL ] HP: Primary data saved (51543 records). [2025-10-15T19:26:49.364142] [INFO ] [MAIN ] HP: Full history saved. [2025-10-15T19:26:49.390350] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HP took 32.2s. Estimated remaining: 3h 6m 34s. Rate: 7.1 symbols/min [2025-10-15T19:26:49.424818] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:49.586781] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:49.621505] [DEBUG] [LOCAL ] HPP: Loaded 51172 existing records from primary storage. [2025-10-15T19:26:49.621934] [INFO ] [MAIN ] HPP: Loaded 51172 existing records. [2025-10-15T19:26:49.717930] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-15T19:26:49.819753] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:49.836019] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-15T19:26:49.837135] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-15T19:26:49.836187] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-15T19:26:49.837485] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-15T19:26:49.868468] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-15T19:26:49.879851] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-15T19:26:50.184189] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:50.208950] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-15T19:26:50.246094] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-15T19:26:50.293060] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-15T19:26:50.305390] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-15T19:26:50.564289] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:50.598554] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-15T19:26:50.715373] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T19:26:50.775254] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:50.822814] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T19:26:51.314007] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-15T19:26:51.954762] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:26:52.113988] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-15T19:26:52.536678] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T19:26:52.913994] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-15T19:26:53.689030] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T19:26:53.713952] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-15T19:26:54.000469] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T19:26:54.507729] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T19:26:54.513950] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-15T19:26:55.314023] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-15T19:26:55.346892] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T19:26:56.114004] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-15T19:26:56.913999] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-15T19:26:57.033730] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:26:57.713968] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-15T19:26:57.928926] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T19:26:57.953840] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:26:58.514115] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-15T19:26:59.314005] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-15T19:26:59.713768] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T19:26:59.898720] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:26:59.900575] [INFO ] [REMOTE ] HPI: Full fetch complete (13931 records). [2025-10-15T19:26:59.900679] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-15T19:27:00.123493] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-15T19:27:00.289617] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-15T19:27:00.289742] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-15T19:27:00.290070] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-15T19:27:00.290111] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-15T19:27:00.290587] [DEBUG] [LOCAL ] HPI: Trimmed 13931 records to 10655 (keeping 200 days of data) [2025-10-15T19:27:00.380107] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T19:27:00.402870] [DEBUG] [LOCAL ] HPI: Primary data saved (10655 records). [2025-10-15T19:27:00.403347] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-15T19:27:00.403442] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HPI took 20.7s. Estimated remaining: 3h 6m 29s. Rate: 7.1 symbols/min [2025-10-15T19:27:00.573088] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:00.584456] [DEBUG] [LOCAL ] HPS: Loaded 10340 existing records from primary storage. [2025-10-15T19:27:00.584736] [INFO ] [MAIN ] HPS: Loaded 10340 existing records. [2025-10-15T19:27:00.760083] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:00.760282] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-15T19:27:00.760329] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-15T19:27:00.760630] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-15T19:27:00.760723] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-15T19:27:00.914606] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-15T19:27:01.110103] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:01.714040] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-15T19:27:02.142918] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-15T19:27:02.149288] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-15T19:27:02.149423] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-15T19:27:02.549636] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-15T19:27:02.549234] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-15T19:27:02.549867] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-15T19:27:02.550956] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-15T19:27:02.551149] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-15T19:27:02.582505] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 53697 (keeping 200 days of data) [2025-10-15T19:27:02.584246] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T19:27:02.925552] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-15T19:27:02.925716] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-15T19:27:02.925807] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 45.7s. Estimated remaining: 3h 6m 13s. Rate: 7.1 symbols/min [2025-10-15T19:27:03.090724] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:03.115831] [DEBUG] [LOCAL ] HQH: Loaded 25740 existing records from primary storage. [2025-10-15T19:27:03.116103] [INFO ] [MAIN ] HQH: Loaded 25740 existing records. [2025-10-15T19:27:03.293131] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:03.293431] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-15T19:27:03.293511] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-15T19:27:03.294179] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-15T19:27:03.294236] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-15T19:27:03.326278] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-15T19:27:03.597037] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:27:03.704296] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:03.706736] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T19:27:04.114002] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-15T19:27:04.733103] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:27:04.914050] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-15T19:27:05.713987] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-15T19:27:05.760107] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:27:05.947828] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T19:27:06.514014] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-15T19:27:07.171119] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T19:27:07.246738] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T19:27:07.313981] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-15T19:27:08.114054] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-15T19:27:08.738553] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T19:27:08.914013] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-15T19:27:09.466877] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:27:09.714001] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-15T19:27:10.453781] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:27:10.493495] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T19:27:10.513965] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-15T19:27:11.117556] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T19:27:11.314110] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-15T19:27:12.030032] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:27:12.113957] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-15T19:27:12.915877] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-15T19:27:12.920828] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T19:27:13.713986] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-15T19:27:14.514027] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-15T19:27:14.582584] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T19:27:14.940042] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T19:27:15.314045] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-15T19:27:15.756042] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T19:27:15.954021] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:27:16.114040] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-15T19:27:16.914043] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-15T19:27:17.713969] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-15T19:27:18.181836] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T19:27:18.514027] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-15T19:27:18.586636] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T19:27:18.733545] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:27:19.267949] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T19:27:19.313969] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-15T19:27:20.094915] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T19:27:20.096590] [INFO ] [REMOTE ] HPS: Full fetch complete (15181 records). [2025-10-15T19:27:20.096682] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-15T19:27:20.119125] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-15T19:27:20.463015] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-15T19:27:20.463090] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-15T19:27:20.463420] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-15T19:27:20.463460] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-15T19:27:20.463966] [DEBUG] [LOCAL ] HPS: Trimmed 15181 records to 10310 (keeping 200 days of data) [2025-10-15T19:27:20.525338] [DEBUG] [LOCAL ] HPS: Primary data saved (10310 records). [2025-10-15T19:27:20.525469] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-15T19:27:20.525549] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPS took 20.1s. Estimated remaining: 3h 6m 16s. Rate: 7.1 symbols/min [2025-10-15T19:27:20.702630] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:20.720572] [DEBUG] [LOCAL ] HQL: Loaded 16824 existing records from primary storage. [2025-10-15T19:27:20.720850] [INFO ] [MAIN ] HQL: Loaded 16824 existing records. [2025-10-15T19:27:20.902303] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:20.902699] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-15T19:27:20.902759] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-15T19:27:20.903780] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-15T19:27:20.903866] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-15T19:27:20.923779] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-15T19:27:21.254231] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:21.714023] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-15T19:27:21.970888] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T19:27:22.108325] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T19:27:22.514069] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-15T19:27:23.314041] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-15T19:27:23.368690] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T19:27:23.620359] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T19:27:24.113997] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-15T19:27:24.368795] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:27:24.913975] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-15T19:27:25.069674] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T19:27:25.714083] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-15T19:27:25.897436] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T19:27:26.514016] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-15T19:27:27.314065] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-15T19:27:27.733236] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:27:27.927520] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:27:28.113980] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-15T19:27:28.501561] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:27:28.914056] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-15T19:27:29.714069] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-15T19:27:29.830677] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:27:29.836874] [INFO ] [REMOTE ] HPP: Full fetch complete (73421 records). [2025-10-15T19:27:29.837060] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-15T19:27:30.231595] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-15T19:27:30.231727] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-15T19:27:30.232740] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-15T19:27:30.232830] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-15T19:27:30.234428] [DEBUG] [LOCAL ] HPP: Trimmed 73421 records to 51192 (keeping 200 days of data) [2025-10-15T19:27:30.519575] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-15T19:27:30.541269] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T19:27:30.540695] [DEBUG] [LOCAL ] HPP: Primary data saved (51192 records). [2025-10-15T19:27:30.541809] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-15T19:27:30.547509] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPP took 41.3s. Estimated remaining: 3h 6m 9s. Rate: 7.1 symbols/min [2025-10-15T19:27:30.724930] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:30.784206] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:27:30.813626] [DEBUG] [LOCAL ] HR: Loaded 52103 existing records from primary storage. [2025-10-15T19:27:30.813973] [INFO ] [MAIN ] HR: Loaded 52103 existing records. [2025-10-15T19:27:30.985918] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:30.986138] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-15T19:27:30.986186] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-15T19:27:30.987139] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-15T19:27:30.987195] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-15T19:27:31.335027] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-15T19:27:31.342509] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:31.497021] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:27:32.114008] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-15T19:27:32.914004] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-15T19:27:33.111127] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T19:27:33.152475] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:27:33.714022] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-15T19:27:34.452988] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:27:34.513955] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-15T19:27:34.598790] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T19:27:34.605216] [INFO ] [REMOTE ] HPQ: Full fetch complete (77841 records). [2025-10-15T19:27:34.605422] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-15T19:27:34.987882] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-15T19:27:34.987961] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-15T19:27:34.988991] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-15T19:27:34.989053] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-15T19:27:34.990471] [DEBUG] [LOCAL ] HPQ: Trimmed 77841 records to 53669 (keeping 200 days of data) [2025-10-15T19:27:35.317580] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-15T19:27:35.324706] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-15T19:27:35.325893] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-15T19:27:35.326035] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPQ took 45.9s. Estimated remaining: 3h 5m 56s. Rate: 7.1 symbols/min [2025-10-15T19:27:35.525929] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:35.572363] [DEBUG] [LOCAL ] HRB: Loaded 48355 existing records from primary storage. [2025-10-15T19:27:35.572681] [INFO ] [MAIN ] HRB: Loaded 48355 existing records. [2025-10-15T19:27:35.756183] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:35.756392] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-15T19:27:35.756441] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-15T19:27:35.757264] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-15T19:27:35.757322] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-15T19:27:36.134903] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:36.122084] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-15T19:27:36.166422] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T19:27:36.663112] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:27:36.801862] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T19:27:36.913976] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-15T19:27:37.713990] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-15T19:27:38.428295] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:27:38.513959] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-15T19:27:38.659125] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T19:27:39.314026] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-15T19:27:40.114004] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-15T19:27:40.280239] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:27:40.366878] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T19:27:40.914098] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-15T19:27:41.714959] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-15T19:27:41.720695] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:27:42.513996] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-15T19:27:42.673367] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T19:27:42.780694] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:27:43.314014] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-15T19:27:43.774757] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:27:43.779138] [INFO ] [REMOTE ] HQH: Full fetch complete (37286 records). [2025-10-15T19:27:43.779284] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-15T19:27:44.119208] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-15T19:27:44.186154] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-15T19:27:44.186258] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-15T19:27:44.187456] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-15T19:27:44.187523] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-15T19:27:44.188618] [DEBUG] [LOCAL ] HQH: Trimmed 37286 records to 25800 (keeping 200 days of data) [2025-10-15T19:27:44.370700] [DEBUG] [LOCAL ] HQH: Primary data saved (25800 records). [2025-10-15T19:27:44.370917] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-15T19:27:44.371117] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQH took 41.4s. Estimated remaining: 3h 5m 49s. Rate: 7.1 symbols/min [2025-10-15T19:27:44.563162] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:44.605790] [DEBUG] [LOCAL ] HRI: Loaded 32458 existing records from primary storage. [2025-10-15T19:27:44.606189] [INFO ] [MAIN ] HRI: Loaded 32458 existing records. [2025-10-15T19:27:44.789935] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:44.790309] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-15T19:27:44.790420] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-15T19:27:44.791062] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-15T19:27:44.791123] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-15T19:27:44.922691] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-15T19:27:45.066277] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:27:45.189601] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:45.711703] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T19:27:45.720523] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-15T19:27:46.013093] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:27:46.514004] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-15T19:27:47.250520] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:27:47.313969] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-15T19:27:48.035966] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:27:48.113964] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-15T19:27:48.586148] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T19:27:48.914054] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-15T19:27:49.714031] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-15T19:27:49.900119] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:27:50.167071] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T19:27:50.514013] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-15T19:27:50.712774] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:27:51.314016] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-15T19:27:52.022865] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:27:52.114030] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-15T19:27:52.913993] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-15T19:27:52.971879] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T19:27:53.136858] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:27:53.714006] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-15T19:27:54.514015] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-15T19:27:54.631823] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:27:54.639119] [INFO ] [REMOTE ] HR: Full fetch complete (75040 records). [2025-10-15T19:27:54.639394] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-15T19:27:55.028946] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-15T19:27:55.029092] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-15T19:27:55.030299] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-15T19:27:55.030464] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-15T19:27:55.032088] [DEBUG] [LOCAL ] HR: Trimmed 75040 records to 52106 (keeping 200 days of data) [2025-10-15T19:27:55.276476] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:27:55.315170] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-15T19:27:55.395506] [DEBUG] [LOCAL ] HR: Primary data saved (52106 records). [2025-10-15T19:27:55.395695] [INFO ] [MAIN ] HR: Full history saved. [2025-10-15T19:27:55.396130] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HR took 24.8s. Estimated remaining: 3h 5m 44s. Rate: 7.1 symbols/min [2025-10-15T19:27:55.576320] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:27:55.578562] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:55.630475] [DEBUG] [LOCAL ] HRL: Loaded 53119 existing records from primary storage. [2025-10-15T19:27:55.630841] [INFO ] [MAIN ] HRL: Loaded 53119 existing records. [2025-10-15T19:27:55.806035] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:55.806334] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-15T19:27:55.806393] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-15T19:27:55.807383] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-15T19:27:55.807441] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-15T19:27:56.120720] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-15T19:27:56.161936] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:56.846991] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:27:56.913980] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-15T19:27:57.000762] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:27:57.714049] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-15T19:27:58.523064] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-15T19:27:58.531049] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:27:59.314046] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-15T19:27:59.449215] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T19:27:59.477903] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:28:00.114006] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-15T19:28:00.380930] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:28:00.384030] [INFO ] [REMOTE ] HQL: Full fetch complete (25236 records). [2025-10-15T19:28:00.384102] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-15T19:28:00.745044] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-15T19:28:00.745129] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-15T19:28:00.745680] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-15T19:28:00.745741] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-15T19:28:00.746326] [DEBUG] [LOCAL ] HQL: Trimmed 25236 records to 16872 (keeping 200 days of data) [2025-10-15T19:28:00.846671] [DEBUG] [LOCAL ] HQL: Primary data saved (16872 records). [2025-10-15T19:28:00.846805] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-15T19:28:00.846884] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HQL took 40.3s. Estimated remaining: 3h 5m 31s. Rate: 7.1 symbols/min [2025-10-15T19:28:00.920339] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-15T19:28:01.015034] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:01.046987] [DEBUG] [LOCAL ] HRTG: Loaded 34286 existing records from primary storage. [2025-10-15T19:28:01.047240] [INFO ] [MAIN ] HRTG: Loaded 34286 existing records. [2025-10-15T19:28:01.223852] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:01.224061] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-15T19:28:01.224132] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-15T19:28:01.224758] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-15T19:28:01.224816] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-15T19:28:01.577469] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:01.714013] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-15T19:28:01.902437] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:28:02.393845] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:28:02.514049] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-15T19:28:02.602744] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T19:28:03.314059] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-15T19:28:04.113961] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-15T19:28:04.144457] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:28:04.914053] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-15T19:28:05.248396] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T19:28:05.536808] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:28:05.714008] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-15T19:28:05.915057] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T19:28:06.513997] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-15T19:28:07.192498] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T19:28:07.313982] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-15T19:28:08.113988] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-15T19:28:08.384790] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T19:28:08.820975] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:28:08.914057] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-15T19:28:09.492368] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:28:09.498180] [INFO ] [REMOTE ] HRB: Full fetch complete (70074 records). [2025-10-15T19:28:09.498311] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-15T19:28:09.719134] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-15T19:28:09.905464] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-15T19:28:09.905549] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-15T19:28:09.906553] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-15T19:28:09.906625] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-15T19:28:09.909149] [DEBUG] [LOCAL ] HRB: Trimmed 70074 records to 48404 (keeping 200 days of data) [2025-10-15T19:28:10.223604] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:28:10.235761] [DEBUG] [LOCAL ] HRB: Primary data saved (48404 records). [2025-10-15T19:28:10.235865] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-15T19:28:10.235936] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRB took 34.9s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-15T19:28:10.401376] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:10.448930] [DEBUG] [LOCAL ] HSBC: Loaded 50997 existing records from primary storage. [2025-10-15T19:28:10.449229] [INFO ] [MAIN ] HSBC: Loaded 50997 existing records. [2025-10-15T19:28:10.517319] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-15T19:28:10.626757] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:10.626942] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-15T19:28:10.626988] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-15T19:28:10.627686] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-15T19:28:10.627761] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-15T19:28:10.811975] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:28:10.999077] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:11.313990] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-15T19:28:11.830053] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:28:12.114002] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-15T19:28:12.918991] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-15T19:28:12.924456] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:28:13.226131] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:28:13.714078] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-15T19:28:14.013901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:28:14.514012] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-15T19:28:15.314044] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-15T19:28:15.536717] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:28:16.113957] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-15T19:28:16.237716] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T19:28:16.590698] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:28:16.913992] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-15T19:28:17.459936] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T19:28:17.713988] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-15T19:28:18.121107] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T19:28:18.514056] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-15T19:28:18.902556] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:28:19.313984] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-15T19:28:20.041927] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:28:20.114039] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-15T19:28:20.717586] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T19:28:20.914017] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-15T19:28:21.713981] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-15T19:28:22.014550] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:28:22.370385] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:28:22.511207] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:28:22.517518] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-15T19:28:23.313999] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-15T19:28:24.114052] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-15T19:28:24.470308] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T19:28:24.915739] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T19:28:24.914310] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-15T19:28:25.170412] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T19:28:25.174732] [INFO ] [REMOTE ] HRI: Full fetch complete (46463 records). [2025-10-15T19:28:25.174843] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-15T19:28:25.562306] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-15T19:28:25.562455] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-15T19:28:25.563994] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-15T19:28:25.564065] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-15T19:28:25.565530] [DEBUG] [LOCAL ] HRI: Trimmed 46463 records to 32443 (keeping 200 days of data) [2025-10-15T19:28:25.738030] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-15T19:28:25.792349] [DEBUG] [LOCAL ] HRI: Primary data saved (32443 records). [2025-10-15T19:28:25.792494] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-15T19:28:25.792578] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 41.4s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-15T19:28:25.968320] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:25.983169] [DEBUG] [LOCAL ] HSHP: Loaded 14927 existing records from primary storage. [2025-10-15T19:28:25.983430] [INFO ] [MAIN ] HSHP: Loaded 14927 existing records. [2025-10-15T19:28:26.163364] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:26.163777] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-15T19:28:26.163848] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-15T19:28:26.164039] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-15T19:28:26.164248] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-15T19:28:26.269224] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:28:26.526758] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-15T19:28:26.567890] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:27.314022] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-15T19:28:27.744523] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T19:28:27.807425] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:28:28.114001] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-15T19:28:28.914056] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-15T19:28:29.166681] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:28:29.449210] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T19:28:29.713994] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-15T19:28:29.902487] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:28:30.514056] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-15T19:28:31.313986] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-15T19:28:31.345214] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:28:31.351673] [INFO ] [REMOTE ] HRL: Full fetch complete (76948 records). [2025-10-15T19:28:31.351795] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-15T19:28:31.750383] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-15T19:28:31.750492] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-15T19:28:31.751600] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-15T19:28:31.751700] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-15T19:28:31.753267] [DEBUG] [LOCAL ] HRL: Trimmed 76948 records to 53128 (keeping 200 days of data) [2025-10-15T19:28:32.079629] [DEBUG] [LOCAL ] HRL: Primary data saved (53128 records). [2025-10-15T19:28:32.079912] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-15T19:28:32.080336] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRL took 36.7s. Estimated remaining: 3h 5m 13s. Rate: 7.1 symbols/min [2025-10-15T19:28:32.122853] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-15T19:28:32.252330] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:32.310254] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T19:28:32.344987] [DEBUG] [LOCAL ] HSY: Loaded 50417 existing records from primary storage. [2025-10-15T19:28:32.345451] [INFO ] [MAIN ] HSY: Loaded 50417 existing records. [2025-10-15T19:28:32.522143] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:32.522471] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-15T19:28:32.522543] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-15T19:28:32.523177] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-15T19:28:32.523234] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-15T19:28:32.800967] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T19:28:32.821864] [INFO ] [REMOTE ] HRTG: Full fetch complete (43985 records). [2025-10-15T19:28:32.837426] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-15T19:28:32.914349] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-15T19:28:32.950870] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:33.197966] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:28:33.328878] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-15T19:28:33.329005] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-15T19:28:33.330308] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-15T19:28:33.330377] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-15T19:28:33.331948] [DEBUG] [LOCAL ] HRTG: Trimmed 43985 records to 34367 (keeping 200 days of data) [2025-10-15T19:28:33.548100] [DEBUG] [LOCAL ] HRTG: Primary data saved (34367 records). [2025-10-15T19:28:33.548321] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-15T19:28:33.548432] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRTG took 32.7s. Estimated remaining: 3h 4m 56s. Rate: 7.1 symbols/min [2025-10-15T19:28:33.721587] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-15T19:28:33.726568] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:33.726893] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-15T19:28:33.726945] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-15T19:28:33.727065] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-15T19:28:33.727106] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-15T19:28:33.727147] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-15T19:28:33.727180] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-15T19:28:34.096987] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:34.514070] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-15T19:28:34.621173] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T19:28:34.671151] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T19:28:35.314031] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-15T19:28:36.113998] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-15T19:28:36.501335] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T19:28:36.746332] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:28:36.914005] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-15T19:28:37.209848] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T19:28:37.714035] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-15T19:28:38.416165] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T19:28:38.514022] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-15T19:28:39.314002] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-15T19:28:39.539263] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T19:28:39.829414] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:28:40.038404] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T19:28:40.113990] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-15T19:28:40.599613] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T19:28:40.913995] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-15T19:28:41.713978] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-15T19:28:41.940468] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T19:28:42.167040] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:28:42.167355] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-15T19:28:42.167443] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:28:42.167503] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-15T19:28:42.167580] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:28:42.167690] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-15T19:28:42.167813] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-15T19:28:42.167865] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-15T19:28:42.167922] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-15T19:28:42.167985] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HTB took 8.6s. Estimated remaining: 3h 4m 48s. Rate: 7.1 symbols/min [2025-10-15T19:28:42.331446] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:42.346225] [DEBUG] [LOCAL ] HTD: Loaded 14145 existing records from primary storage. [2025-10-15T19:28:42.346431] [INFO ] [MAIN ] HTD: Loaded 14145 existing records. [2025-10-15T19:28:42.520629] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:42.520759] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-15T19:28:42.521773] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-15T19:28:42.521837] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-15T19:28:42.522068] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-15T19:28:42.522126] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-15T19:28:42.866715] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:43.314008] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-15T19:28:43.448292] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:28:44.113999] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-15T19:28:44.914042] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-15T19:28:45.038696] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:28:45.045239] [INFO ] [REMOTE ] HSBC: Full fetch complete (74085 records). [2025-10-15T19:28:45.045380] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-15T19:28:45.500519] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-15T19:28:45.500609] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-15T19:28:45.501635] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-15T19:28:45.501731] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-15T19:28:45.503244] [DEBUG] [LOCAL ] HSBC: Trimmed 74085 records to 51004 (keeping 200 days of data) [2025-10-15T19:28:45.715621] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-15T19:28:45.827383] [DEBUG] [LOCAL ] HSBC: Primary data saved (51004 records). [2025-10-15T19:28:45.827766] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-15T19:28:45.833137] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HSBC took 35.6s. Estimated remaining: 3h 4m 34s. Rate: 7.1 symbols/min [2025-10-15T19:28:45.877224] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T19:28:45.985944] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T19:28:46.056452] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:46.056623] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-15T19:28:46.056692] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-15T19:28:46.056805] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-15T19:28:46.056847] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-15T19:28:46.056887] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-15T19:28:46.056969] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-15T19:28:46.404527] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:46.514012] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-15T19:28:46.609712] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T19:28:47.313980] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-15T19:28:47.358577] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T19:28:48.113982] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-15T19:28:48.160673] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T19:28:48.913994] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-15T19:28:49.663282] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T19:28:49.713963] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-15T19:28:49.813891] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:28:50.514018] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-15T19:28:50.577832] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T19:28:51.313988] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-15T19:28:51.479278] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T19:28:51.481292] [INFO ] [REMOTE ] HSHP: Full fetch complete (23322 records). [2025-10-15T19:28:51.481365] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-15T19:28:51.848584] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-15T19:28:51.848711] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-15T19:28:51.849309] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-15T19:28:51.849350] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-15T19:28:51.849979] [DEBUG] [LOCAL ] HSHP: Trimmed 23322 records to 14871 (keeping 200 days of data) [2025-10-15T19:28:51.935009] [DEBUG] [LOCAL ] HSHP: Primary data saved (14871 records). [2025-10-15T19:28:51.935143] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-15T19:28:51.935225] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSHP took 26.1s. Estimated remaining: 3h 4m 22s. Rate: 7.1 symbols/min [2025-10-15T19:28:52.096406] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T19:28:52.116974] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-15T19:28:52.120259] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:52.166158] [DEBUG] [LOCAL ] HTGC: Loaded 47691 existing records from primary storage. [2025-10-15T19:28:52.166454] [INFO ] [MAIN ] HTGC: Loaded 47691 existing records. [2025-10-15T19:28:52.341661] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:52.341887] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-15T19:28:52.341934] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-15T19:28:52.342246] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-15T19:28:52.342284] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-15T19:28:52.454514] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-15T19:28:52.705502] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:52.914025] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-15T19:28:53.668302] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:28:53.714067] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-15T19:28:54.513985] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-15T19:28:54.588886] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T19:28:55.314019] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-15T19:28:56.114092] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-15T19:28:56.253124] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T19:28:56.425636] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:28:56.600832] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T19:28:56.914092] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-15T19:28:57.714033] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-15T19:28:58.385679] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:28:58.408949] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:28:58.513984] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-15T19:28:59.280777] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:28:59.313960] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-15T19:29:00.064117] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T19:29:00.113964] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-15T19:29:00.914007] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-15T19:29:01.033857] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:29:01.036720] [INFO ] [REMOTE ] HTD: Full fetch complete (19480 records). [2025-10-15T19:29:01.036806] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-15T19:29:01.414810] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-15T19:29:01.414926] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-15T19:29:01.415594] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-15T19:29:01.415659] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-15T19:29:01.416453] [DEBUG] [LOCAL ] HTD: Trimmed 19480 records to 14172 (keeping 200 days of data) [2025-10-15T19:29:01.510799] [DEBUG] [LOCAL ] HTD: Primary data saved (14172 records). [2025-10-15T19:29:01.510964] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-15T19:29:01.511063] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HTD took 19.3s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-15T19:29:01.680989] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:01.716373] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-15T19:29:01.718399] [DEBUG] [LOCAL ] HTH: Loaded 32540 existing records from primary storage. [2025-10-15T19:29:01.718669] [INFO ] [MAIN ] HTH: Loaded 32540 existing records. [2025-10-15T19:29:01.908447] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:01.908788] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-15T19:29:01.908846] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-15T19:29:01.909172] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-15T19:29:01.909257] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-15T19:29:02.294315] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:02.494444] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:29:02.513960] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-15T19:29:03.314083] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-15T19:29:03.578387] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T19:29:03.628778] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T19:29:04.101162] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:29:04.113946] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-15T19:29:04.914064] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-15T19:29:05.214288] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-15T19:29:05.714004] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-15T19:29:05.847346] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:29:06.072257] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-15T19:29:06.514091] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-15T19:29:06.836225] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T19:29:07.314073] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-15T19:29:08.113966] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-15T19:29:08.227572] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T19:29:08.914020] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-15T19:29:09.714004] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-15T19:29:10.025585] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T19:29:10.514033] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-15T19:29:10.743094] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T19:29:10.903433] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-15T19:29:11.314024] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-15T19:29:11.640758] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T19:29:12.114069] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-15T19:29:12.403319] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T19:29:12.914064] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-15T19:29:13.720823] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-15T19:29:13.740576] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (5.63 seconds). [2025-10-15T19:29:14.514024] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-15T19:29:14.737633] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:29:14.902230] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T19:29:15.314006] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-15T19:29:15.815157] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:29:16.114067] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-15T19:29:16.449469] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T19:29:16.450448] [INFO ] [REMOTE ] HTFC: Full fetch complete (842 records). [2025-10-15T19:29:16.450538] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-15T19:29:16.693832] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-15T19:29:16.694062] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:29:16.694135] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:29:16.694212] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-15T19:29:16.694279] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-15T19:29:16.694318] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-15T19:29:16.694360] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-15T19:29:16.694422] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTFC took 30.9s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-15T19:29:16.870396] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:16.905038] [DEBUG] [LOCAL ] HUBB: Loaded 36488 existing records from primary storage. [2025-10-15T19:29:16.905304] [INFO ] [MAIN ] HUBB: Loaded 36488 existing records. [2025-10-15T19:29:16.925683] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-15T19:29:17.088930] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:17.089187] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-15T19:29:17.089239] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-15T19:29:17.089573] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-15T19:29:17.089630] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-15T19:29:17.263183] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T19:29:17.484068] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:17.713965] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-15T19:29:18.513971] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-15T19:29:18.625600] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T19:29:18.700322] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:29:19.313993] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-15T19:29:19.884331] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T19:29:20.114025] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-15T19:29:20.913976] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-15T19:29:21.118971] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T19:29:21.170970] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T19:29:21.713996] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-15T19:29:22.428083] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:29:22.513973] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-15T19:29:23.259320] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:29:23.314032] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-15T19:29:24.114032] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-15T19:29:24.343533] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:29:24.349982] [INFO ] [REMOTE ] HSY: Full fetch complete (73645 records). [2025-10-15T19:29:24.350191] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-15T19:29:24.759739] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-15T19:29:24.759837] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-15T19:29:24.778034] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-15T19:29:24.778180] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-15T19:29:24.780010] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:29:24.787773] [DEBUG] [LOCAL ] HSY: Trimmed 73645 records to 50437 (keeping 200 days of data) [2025-10-15T19:29:24.965767] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-15T19:29:25.106129] [DEBUG] [LOCAL ] HSY: Primary data saved (50437 records). [2025-10-15T19:29:25.106272] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-15T19:29:25.106730] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HSY took 53.0s. Estimated remaining: 3h 4m 7s. Rate: 7.1 symbols/min [2025-10-15T19:29:25.286176] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:25.326032] [DEBUG] [LOCAL ] HUBS: Loaded 40047 existing records from primary storage. [2025-10-15T19:29:25.326312] [INFO ] [MAIN ] HUBS: Loaded 40047 existing records. [2025-10-15T19:29:25.507417] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:25.507983] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-15T19:29:25.508164] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-15T19:29:25.509033] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-15T19:29:25.509094] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-15T19:29:25.724579] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-15T19:29:25.847830] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:29:25.918718] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:26.251994] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:29:26.513999] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-15T19:29:27.108759] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:29:27.314006] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-15T19:29:27.519462] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:29:28.114049] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-15T19:29:28.914029] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-15T19:29:29.045577] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T19:29:29.051627] [INFO ] [REMOTE ] HTGC: Full fetch complete (68824 records). [2025-10-15T19:29:29.051763] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-15T19:29:29.490723] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:29:29.494596] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-15T19:29:29.494829] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-15T19:29:29.502811] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-15T19:29:29.503296] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-15T19:29:29.504567] [DEBUG] [LOCAL ] HTGC: Trimmed 68824 records to 47734 (keeping 200 days of data) [2025-10-15T19:29:29.714232] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-15T19:29:29.802502] [DEBUG] [LOCAL ] HTGC: Primary data saved (47734 records). [2025-10-15T19:29:29.802697] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-15T19:29:29.802804] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 37.9s. Estimated remaining: 3h 3m 54s. Rate: 7.1 symbols/min [2025-10-15T19:29:29.970618] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:30.015019] [DEBUG] [LOCAL ] HUM: Loaded 49228 existing records from primary storage. [2025-10-15T19:29:30.015335] [INFO ] [MAIN ] HUM: Loaded 49228 existing records. [2025-10-15T19:29:30.191495] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:30.191748] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-15T19:29:30.191803] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-15T19:29:30.192085] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-15T19:29:30.192124] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-15T19:29:30.524066] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-15T19:29:30.567424] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:30.598136] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T19:29:30.716786] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T19:29:31.314006] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-15T19:29:31.912425] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T19:29:32.113991] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-15T19:29:32.567104] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:29:32.914000] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-15T19:29:33.714044] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-15T19:29:33.780229] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:29:34.329394] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:29:34.513998] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-15T19:29:34.745661] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:29:35.314001] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-15T19:29:35.378260] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T19:29:36.114001] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-15T19:29:36.914014] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-15T19:29:37.062411] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:29:37.372911] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:29:37.376582] [INFO ] [REMOTE ] HTH: Full fetch complete (46769 records). [2025-10-15T19:29:37.376716] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-15T19:29:37.719881] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-15T19:29:37.773376] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-15T19:29:37.773459] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-15T19:29:37.774298] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-15T19:29:37.774378] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-15T19:29:37.775488] [DEBUG] [LOCAL ] HTH: Trimmed 46769 records to 32576 (keeping 200 days of data) [2025-10-15T19:29:37.970505] [DEBUG] [LOCAL ] HTH: Primary data saved (32576 records). [2025-10-15T19:29:37.970671] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-15T19:29:37.970775] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HTH took 36.5s. Estimated remaining: 3h 3m 45s. Rate: 7.1 symbols/min [2025-10-15T19:29:38.138054] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:38.187731] [DEBUG] [LOCAL ] HUN: Loaded 53215 existing records from primary storage. [2025-10-15T19:29:38.188062] [INFO ] [MAIN ] HUN: Loaded 53215 existing records. [2025-10-15T19:29:38.369284] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:38.369612] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-15T19:29:38.369778] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-15T19:29:38.370314] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-15T19:29:38.370410] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-15T19:29:38.517885] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-15T19:29:38.552903] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:29:38.803889] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:38.943457] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T19:29:39.314032] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-15T19:29:40.037085] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:29:40.113991] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-15T19:29:40.914024] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-15T19:29:41.018075] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:29:41.669394] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:29:41.714028] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-15T19:29:42.364257] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:29:42.513996] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-15T19:29:43.147008] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T19:29:43.314002] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-15T19:29:43.816317] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:29:44.113992] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-15T19:29:44.737945] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T19:29:44.913988] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-15T19:29:45.680814] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:29:45.713957] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-15T19:29:46.247227] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:29:46.251743] [INFO ] [REMOTE ] HUBB: Full fetch complete (54233 records). [2025-10-15T19:29:46.251892] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-15T19:29:46.519124] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-15T19:29:46.626030] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-15T19:29:46.626101] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-15T19:29:46.626936] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-15T19:29:46.626997] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-15T19:29:46.628056] [DEBUG] [LOCAL ] HUBB: Trimmed 54233 records to 36510 (keeping 200 days of data) [2025-10-15T19:29:46.862233] [DEBUG] [LOCAL ] HUBB: Primary data saved (36510 records). [2025-10-15T19:29:46.862381] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-15T19:29:46.862505] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBB took 30.2s. Estimated remaining: 3h 3m 37s. Rate: 7.1 symbols/min [2025-10-15T19:29:47.036708] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:47.079741] [DEBUG] [LOCAL ] HUYA: Loaded 43846 existing records from primary storage. [2025-10-15T19:29:47.080174] [INFO ] [MAIN ] HUYA: Loaded 43846 existing records. [2025-10-15T19:29:47.259626] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:47.259942] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-15T19:29:47.260042] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-15T19:29:47.260427] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-15T19:29:47.260516] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-15T19:29:47.354954] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-15T19:29:47.391125] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:29:47.643085] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:47.908679] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:29:48.113995] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-15T19:29:48.774145] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:29:48.913993] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-15T19:29:49.490985] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:29:49.713999] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-15T19:29:50.514052] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-15T19:29:50.638592] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:29:51.272781] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:29:51.313956] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-15T19:29:51.695457] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:29:52.114016] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-15T19:29:52.878256] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T19:29:52.913960] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-15T19:29:53.713985] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-15T19:29:53.781815] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T19:29:54.468498] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:29:54.514076] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-15T19:29:55.314085] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-15T19:29:55.444806] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:29:56.113982] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-15T19:29:56.271418] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:29:56.914030] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-15T19:29:57.103725] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:29:57.714025] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-15T19:29:57.791348] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:29:58.498799] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:29:58.513960] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-15T19:29:58.826151] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T19:29:59.314036] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-15T19:30:00.114011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-15T19:30:00.339446] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:30:00.827750] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:30:00.913972] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-15T19:30:01.714063] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-15T19:30:01.873596] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:30:02.400914] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T19:30:02.514058] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-15T19:30:03.314008] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-15T19:30:03.397633] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:30:03.403818] [INFO ] [REMOTE ] HUBS: Full fetch complete (56577 records). [2025-10-15T19:30:03.403976] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-15T19:30:03.794527] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-15T19:30:03.794612] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-15T19:30:03.795509] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-15T19:30:03.795567] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-15T19:30:03.796667] [DEBUG] [LOCAL ] HUBS: Trimmed 56577 records to 40051 (keeping 200 days of data) [2025-10-15T19:30:04.045501] [DEBUG] [LOCAL ] HUBS: Primary data saved (40051 records). [2025-10-15T19:30:04.045684] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-15T19:30:04.046088] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBS took 38.9s. Estimated remaining: 3h 3m 39s. Rate: 7.1 symbols/min [2025-10-15T19:30:04.114541] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-15T19:30:04.249399] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:30:04.251769] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:04.276442] [DEBUG] [LOCAL ] HVT: Loaded 15153 existing records from primary storage. [2025-10-15T19:30:04.276732] [INFO ] [MAIN ] HVT: Loaded 15153 existing records. [2025-10-15T19:30:04.449403] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:04.449623] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-15T19:30:04.449702] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-15T19:30:04.449879] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-15T19:30:04.449917] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-15T19:30:04.830050] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:04.913971] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-15T19:30:05.123853] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T19:30:05.713975] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-15T19:30:05.862030] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T19:30:05.932973] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:30:06.514031] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-15T19:30:07.313981] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-15T19:30:07.646615] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T19:30:07.988812] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:30:08.023616] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:30:08.114000] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-15T19:30:08.914095] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-15T19:30:09.714040] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-15T19:30:10.011481] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:30:10.323384] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:30:10.514006] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-15T19:30:10.888337] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-15T19:30:10.895472] [INFO ] [REMOTE ] HUN: Full fetch complete (76968 records). [2025-10-15T19:30:10.895678] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-15T19:30:11.324770] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-15T19:30:11.320850] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-15T19:30:11.326010] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-15T19:30:11.327113] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-15T19:30:11.327280] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-15T19:30:11.333022] [DEBUG] [LOCAL ] HUN: Trimmed 76968 records to 53214 (keeping 200 days of data) [2025-10-15T19:30:11.666757] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T19:30:11.693629] [DEBUG] [LOCAL ] HUN: Primary data saved (53214 records). [2025-10-15T19:30:11.693806] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-15T19:30:11.694676] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUN took 33.7s. Estimated remaining: 3h 3m 30s. Rate: 7.1 symbols/min [2025-10-15T19:30:11.883291] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:11.941574] [DEBUG] [LOCAL ] HWM: Loaded 52852 existing records from primary storage. [2025-10-15T19:30:11.941907] [INFO ] [MAIN ] HWM: Loaded 52852 existing records. [2025-10-15T19:30:12.121064] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-15T19:30:12.142535] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:12.143741] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-15T19:30:12.143808] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-15T19:30:12.144126] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-15T19:30:12.144168] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-15T19:30:12.484855] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:12.870720] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:30:12.913990] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-15T19:30:12.988143] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T19:30:13.714006] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-15T19:30:14.431783] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:30:14.514037] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-15T19:30:14.577338] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:30:15.314019] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-15T19:30:16.113969] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-15T19:30:16.321627] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:30:16.351763] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:30:16.914032] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-15T19:30:17.316685] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T19:30:17.322337] [INFO ] [REMOTE ] HUYA: Full fetch complete (64117 records). [2025-10-15T19:30:17.322442] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-15T19:30:17.711526] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-15T19:30:17.711705] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-15T19:30:17.712745] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-15T19:30:17.712808] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-15T19:30:17.714063] [DEBUG] [LOCAL ] HUYA: Trimmed 64117 records to 43809 (keeping 200 days of data) [2025-10-15T19:30:17.713975] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-15T19:30:17.926275] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:30:17.983849] [DEBUG] [LOCAL ] HUYA: Primary data saved (43809 records). [2025-10-15T19:30:17.983994] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-15T19:30:17.984087] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUYA took 31.1s. Estimated remaining: 3h 3m 19s. Rate: 7.1 symbols/min [2025-10-15T19:30:18.151090] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:18.192013] [DEBUG] [LOCAL ] HXL: Loaded 45870 existing records from primary storage. [2025-10-15T19:30:18.192310] [INFO ] [MAIN ] HXL: Loaded 45870 existing records. [2025-10-15T19:30:18.369626] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:18.369882] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-15T19:30:18.369936] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-15T19:30:18.370360] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-15T19:30:18.370416] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-15T19:30:18.519157] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-15T19:30:18.728881] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:19.313999] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-15T19:30:20.113996] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-15T19:30:20.264379] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-15T19:30:20.478265] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T19:30:20.655905] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T19:30:20.856689] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:30:20.913952] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-15T19:30:21.714015] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-15T19:30:22.513996] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-15T19:30:22.845979] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-15T19:30:22.851992] [INFO ] [REMOTE ] HUM: Full fetch complete (71071 records). [2025-10-15T19:30:22.852097] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-15T19:30:23.235310] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-15T19:30:23.235408] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-15T19:30:23.236380] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-15T19:30:23.236443] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-15T19:30:23.237861] [DEBUG] [LOCAL ] HUM: Trimmed 71071 records to 49309 (keeping 200 days of data) [2025-10-15T19:30:23.325478] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-15T19:30:23.550999] [DEBUG] [LOCAL ] HUM: Primary data saved (49309 records). [2025-10-15T19:30:23.551206] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-15T19:30:23.551297] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUM took 53.7s. Estimated remaining: 3h 3m 7s. Rate: 7.1 symbols/min [2025-10-15T19:30:23.726964] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:23.760348] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T19:30:23.775406] [DEBUG] [LOCAL ] HY: Loaded 10030 existing records from primary storage. [2025-10-15T19:30:23.775619] [INFO ] [MAIN ] HY: Loaded 10030 existing records. [2025-10-15T19:30:23.954600] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:23.954852] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-15T19:30:23.954912] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-15T19:30:23.955099] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-15T19:30:23.955153] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-15T19:30:24.117827] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T19:30:24.116792] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-15T19:30:24.178280] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:30:24.373458] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:24.914039] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-15T19:30:25.714034] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-15T19:30:26.007190] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T19:30:26.212977] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-15T19:30:26.386387] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:30:26.514053] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-15T19:30:27.313987] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-15T19:30:27.374686] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:30:27.377687] [INFO ] [REMOTE ] HVT: Full fetch complete (23196 records). [2025-10-15T19:30:27.377810] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-15T19:30:27.784354] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-15T19:30:27.784459] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-15T19:30:27.785055] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-15T19:30:27.785119] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-15T19:30:27.785831] [DEBUG] [LOCAL ] HVT: Trimmed 23196 records to 15120 (keeping 200 days of data) [2025-10-15T19:30:27.886527] [DEBUG] [LOCAL ] HVT: Primary data saved (15120 records). [2025-10-15T19:30:27.886693] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-15T19:30:27.886792] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HVT took 23.8s. Estimated remaining: 3h 2m 53s. Rate: 7.1 symbols/min [2025-10-15T19:30:28.079472] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:28.079636] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-15T19:30:28.079711] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-15T19:30:28.079823] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-15T19:30:28.079864] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-15T19:30:28.079909] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-15T19:30:28.079951] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-15T19:30:28.120828] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-15T19:30:28.430610] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:28.913975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-15T19:30:29.225465] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-15T19:30:29.330669] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T19:30:29.714053] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-15T19:30:29.836320] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:30:30.025669] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T19:30:30.514076] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-15T19:30:31.314005] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-15T19:30:31.461745] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:30:31.654928] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:30:32.113966] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-15T19:30:32.913998] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-15T19:30:33.165927] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-15T19:30:33.713984] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-15T19:30:33.987795] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:30:34.024534] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-15T19:30:34.513992] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-15T19:30:35.281405] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T19:30:35.313960] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-15T19:30:35.629537] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T19:30:36.114006] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-15T19:30:36.415731] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-15T19:30:36.913999] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-15T19:30:37.713991] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-15T19:30:38.122749] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-15T19:30:38.466613] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T19:30:38.513952] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-15T19:30:39.314020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-15T19:30:39.537876] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-15T19:30:40.109268] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:30:40.118178] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-15T19:30:40.342767] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-15T19:30:40.913990] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-15T19:30:41.713959] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-15T19:30:41.735598] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:30:42.513992] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-15T19:30:42.947947] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T19:30:42.948779] [INFO ] [REMOTE ] HYAC: Full fetch complete (916 records). [2025-10-15T19:30:42.948846] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-15T19:30:43.128049] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-15T19:30:43.128430] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:30:43.128506] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:30:43.128630] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-15T19:30:43.128735] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-15T19:30:43.128778] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-15T19:30:43.128818] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-15T19:30:43.128873] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HYAC took 15.2s. Estimated remaining: 3h 2m 53s. Rate: 7.1 symbols/min [2025-10-15T19:30:43.303019] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:43.303365] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-15T19:30:43.303460] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-15T19:30:43.303599] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-15T19:30:43.303691] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-15T19:30:43.303864] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-15T19:30:43.303982] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-15T19:30:43.319134] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-15T19:30:43.566015] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T19:30:43.718913] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:44.113991] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-15T19:30:44.469399] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-15T19:30:44.914000] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-15T19:30:45.455161] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T19:30:45.475546] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:30:45.713982] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-15T19:30:46.468211] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:30:46.513961] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-15T19:30:47.283036] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T19:30:47.313953] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-15T19:30:47.849478] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T19:30:48.113984] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-15T19:30:48.436374] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-15T19:30:48.914000] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-15T19:30:49.687531] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:30:49.713951] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-15T19:30:50.293443] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:30:50.513965] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-15T19:30:51.237085] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:30:51.238746] [INFO ] [REMOTE ] HY: Full fetch complete (15050 records). [2025-10-15T19:30:51.238817] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-15T19:30:51.319127] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-15T19:30:51.604912] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-15T19:30:51.604991] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-15T19:30:51.605308] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-15T19:30:51.605348] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-15T19:30:51.605850] [DEBUG] [LOCAL ] HY: Trimmed 15050 records to 10057 (keeping 200 days of data) [2025-10-15T19:30:51.666622] [DEBUG] [LOCAL ] HY: Primary data saved (10057 records). [2025-10-15T19:30:51.666778] [INFO ] [MAIN ] HY: Full history saved. [2025-10-15T19:30:51.666859] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HY took 28.1s. Estimated remaining: 3h 2m 45s. Rate: 7.1 symbols/min [2025-10-15T19:30:51.833259] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:51.843710] [DEBUG] [LOCAL ] HYI: Loaded 9904 existing records from primary storage. [2025-10-15T19:30:51.843927] [INFO ] [MAIN ] HYI: Loaded 9904 existing records. [2025-10-15T19:30:52.016438] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:52.016682] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-15T19:30:52.016761] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-15T19:30:52.016950] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-15T19:30:52.017005] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-15T19:30:52.115836] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-15T19:30:52.371543] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:52.867308] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:30:52.913953] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-15T19:30:53.717801] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-15T19:30:53.723958] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:30:54.178636] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T19:30:54.492735] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T19:30:54.513958] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-15T19:30:55.313990] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-15T19:30:56.113973] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-15T19:30:56.275863] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:30:56.835070] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T19:30:56.902328] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T19:30:56.907557] [INFO ] [REMOTE ] HXL: Full fetch complete (66381 records). [2025-10-15T19:30:56.907678] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-15T19:30:56.919139] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-15T19:30:57.301956] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-15T19:30:57.302031] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-15T19:30:57.302951] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-15T19:30:57.303021] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-15T19:30:57.304219] [DEBUG] [LOCAL ] HXL: Trimmed 66381 records to 45841 (keeping 200 days of data) [2025-10-15T19:30:57.572933] [DEBUG] [LOCAL ] HXL: Primary data saved (45841 records). [2025-10-15T19:30:57.573050] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-15T19:30:57.573129] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HXL took 39.6s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-15T19:30:57.728356] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-15T19:30:57.754332] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T19:30:57.753169] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:57.788939] [DEBUG] [LOCAL ] HYT: Loaded 33676 existing records from primary storage. [2025-10-15T19:30:57.789204] [INFO ] [MAIN ] HYT: Loaded 33676 existing records. [2025-10-15T19:30:57.964630] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:57.964874] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-15T19:30:57.964923] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-15T19:30:57.965233] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-15T19:30:57.965273] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-15T19:30:58.310751] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:58.514027] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-15T19:30:59.314010] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-15T19:30:59.724456] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:30:59.793526] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T19:31:00.068102] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:31:00.113950] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-15T19:31:00.769585] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T19:31:00.914044] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-15T19:31:01.716438] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-15T19:31:01.720145] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:31:02.514004] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-15T19:31:02.739699] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-15T19:31:03.313980] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-15T19:31:03.637011] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T19:31:04.051768] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:31:04.114038] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-15T19:31:04.914019] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-15T19:31:05.132769] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-15T19:31:05.714033] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-15T19:31:05.980084] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T19:31:06.359989] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T19:31:06.513989] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-15T19:31:06.862262] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T19:31:07.314034] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-15T19:31:08.070707] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T19:31:08.113967] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-15T19:31:08.914006] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-15T19:31:09.236143] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T19:31:09.257384] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:31:09.714013] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-15T19:31:10.514008] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-15T19:31:11.158172] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T19:31:11.314061] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-15T19:31:12.113974] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-15T19:31:12.153931] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:31:12.159925] [INFO ] [REMOTE ] HWM: Full fetch complete (76687 records). [2025-10-15T19:31:12.160031] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-15T19:31:12.369549] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T19:31:12.435009] [INFO ] [REMOTE ] HYI: Full fetch complete (13987 records). [2025-10-15T19:31:12.446628] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-15T19:31:12.475627] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T19:31:12.744933] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-15T19:31:12.745702] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-15T19:31:12.770981] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-15T19:31:12.810998] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-15T19:31:12.875805] [DEBUG] [LOCAL ] HWM: Trimmed 76687 records to 52813 (keeping 200 days of data) [2025-10-15T19:31:12.919912] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-15T19:31:13.051869] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-15T19:31:13.052829] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-15T19:31:13.061313] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-15T19:31:13.061393] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-15T19:31:13.067787] [DEBUG] [LOCAL ] HYI: Trimmed 13987 records to 9824 (keeping 200 days of data) [2025-10-15T19:31:13.240372] [DEBUG] [LOCAL ] HYI: Primary data saved (9824 records). [2025-10-15T19:31:13.257403] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-15T19:31:13.269358] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYI took 21.6s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-15T19:31:13.336498] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T19:31:13.521833] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:13.532311] [DEBUG] [LOCAL ] HYTR: Loaded 3124 existing records from primary storage. [2025-10-15T19:31:13.533695] [INFO ] [MAIN ] HYTR: Loaded 3124 existing records. [2025-10-15T19:31:13.710534] [DEBUG] [LOCAL ] HWM: Primary data saved (52813 records). [2025-10-15T19:31:13.726233] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-15T19:31:13.726375] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-15T19:31:13.733852] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:13.734164] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-15T19:31:13.734243] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-15T19:31:13.730613] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HWM took 1m 2s. Estimated remaining: 3h 2m 15s. Rate: 7.1 symbols/min [2025-10-15T19:31:13.740050] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-15T19:31:13.811210] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-15T19:31:14.039876] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:14.066873] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T19:31:14.297563] [DEBUG] [LOCAL ] HZO: Loaded 29123 existing records from primary storage. [2025-10-15T19:31:14.301333] [INFO ] [MAIN ] HZO: Loaded 29123 existing records. [2025-10-15T19:31:14.400787] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:14.505089] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:14.505296] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-15T19:31:14.505347] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-15T19:31:14.505583] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-15T19:31:14.505694] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-15T19:31:14.519098] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-15T19:31:14.869745] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:14.922804] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T19:31:15.313996] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-15T19:31:16.114057] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-15T19:31:16.405117] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:31:16.914020] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-15T19:31:17.000135] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T19:31:17.337571] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T19:31:17.714000] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-15T19:31:18.212407] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-15T19:31:18.514037] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-15T19:31:19.314003] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-15T19:31:19.917272] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T19:31:20.113987] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-15T19:31:20.440597] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:31:20.483890] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T19:31:20.914028] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-15T19:31:21.714000] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-15T19:31:22.274711] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T19:31:22.422506] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:31:22.513970] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-15T19:31:23.084614] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T19:31:23.313991] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-15T19:31:24.114011] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-15T19:31:24.432941] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T19:31:24.914023] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-15T19:31:25.501438] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T19:31:25.713985] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-15T19:31:25.987083] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T19:31:26.513980] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-15T19:31:26.916708] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T19:31:26.917378] [INFO ] [REMOTE ] HYBX: Full fetch complete (706 records). [2025-10-15T19:31:26.917447] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-15T19:31:27.146210] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-15T19:31:27.152342] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:31:27.163224] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:31:27.163871] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-15T19:31:27.164532] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:31:27.170777] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-15T19:31:27.171289] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-15T19:31:27.171678] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-15T19:31:27.171758] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYBX took 44.0s. Estimated remaining: 3h 2m 13s. Rate: 7.1 symbols/min [2025-10-15T19:31:27.319972] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-15T19:31:27.340898] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:27.352308] [DEBUG] [LOCAL ] IAE: Loaded 6255 existing records from primary storage. [2025-10-15T19:31:27.352504] [INFO ] [MAIN ] IAE: Loaded 6255 existing records. [2025-10-15T19:31:27.526052] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:27.526290] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-15T19:31:27.526343] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-15T19:31:27.526503] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-15T19:31:27.526559] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-15T19:31:27.886266] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:28.113964] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-15T19:31:28.767448] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:31:28.795979] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T19:31:28.914048] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-15T19:31:29.449738] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T19:31:29.713991] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-15T19:31:30.514007] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-15T19:31:31.038521] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T19:31:31.060766] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:31:31.313997] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-15T19:31:31.786456] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T19:31:32.113991] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-15T19:31:32.567764] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:31:32.913982] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-15T19:31:33.713991] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-15T19:31:34.319186] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T19:31:34.367889] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T19:31:34.513984] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-15T19:31:35.314049] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-15T19:31:35.677069] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T19:31:35.959857] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T19:31:35.960914] [INFO ] [REMOTE ] HYTR: Full fetch complete (4649 records). [2025-10-15T19:31:35.960982] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-15T19:31:36.119197] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-15T19:31:36.355324] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-15T19:31:36.355408] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-15T19:31:36.355570] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-15T19:31:36.355610] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-15T19:31:36.356030] [DEBUG] [LOCAL ] HYTR: Trimmed 4649 records to 3132 (keeping 200 days of data) [2025-10-15T19:31:36.374945] [DEBUG] [LOCAL ] HYTR: Primary data saved (3132 records). [2025-10-15T19:31:36.375020] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-15T19:31:36.375098] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 23.1s. Estimated remaining: 3h 2m 5s. Rate: 7.1 symbols/min [2025-10-15T19:31:36.544352] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:36.597953] [DEBUG] [LOCAL ] IAG: Loaded 53488 existing records from primary storage. [2025-10-15T19:31:36.598269] [INFO ] [MAIN ] IAG: Loaded 53488 existing records. [2025-10-15T19:31:36.778099] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:36.778302] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-15T19:31:36.778349] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-15T19:31:36.778548] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-15T19:31:36.778588] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-15T19:31:36.863771] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T19:31:36.919123] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-15T19:31:37.164990] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:37.714001] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-15T19:31:38.384821] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T19:31:38.431300] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T19:31:38.435805] [INFO ] [REMOTE ] HYT: Full fetch complete (47888 records). [2025-10-15T19:31:38.435932] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-15T19:31:38.519060] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-15T19:31:38.819522] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-15T19:31:38.819611] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-15T19:31:38.820603] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-15T19:31:38.820699] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-15T19:31:38.821895] [DEBUG] [LOCAL ] HYT: Trimmed 47888 records to 33599 (keeping 200 days of data) [2025-10-15T19:31:39.028014] [DEBUG] [LOCAL ] HYT: Primary data saved (33599 records). [2025-10-15T19:31:39.028163] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-15T19:31:39.028250] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYT took 41.5s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-15T19:31:39.314049] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-15T19:31:39.924759] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T19:31:39.977284] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:31:40.113988] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-15T19:31:40.913968] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-15T19:31:41.316363] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:31:41.713981] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-15T19:31:42.438830] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:31:42.513960] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-15T19:31:42.946280] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T19:31:42.957629] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T19:31:43.314005] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-15T19:31:44.113997] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-15T19:31:44.713317] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T19:31:44.740969] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T19:31:44.914000] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-15T19:31:45.603994] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:31:45.713979] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-15T19:31:46.402888] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T19:31:46.514000] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-15T19:31:47.314016] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-15T19:31:47.800549] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T19:31:48.053575] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T19:31:48.113970] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-15T19:31:48.914059] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-15T19:31:48.969221] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:31:48.970990] [INFO ] [REMOTE ] IAE: Full fetch complete (9022 records). [2025-10-15T19:31:48.971062] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-15T19:31:49.371449] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-15T19:31:49.371540] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-15T19:31:49.371796] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-15T19:31:49.371856] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-15T19:31:49.372515] [DEBUG] [LOCAL ] IAE: Trimmed 9022 records to 6256 (keeping 200 days of data) [2025-10-15T19:31:49.408243] [DEBUG] [LOCAL ] IAE: Primary data saved (6256 records). [2025-10-15T19:31:49.408354] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-15T19:31:49.408459] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. IAE took 22.2s. Estimated remaining: 3h 1m 44s. Rate: 7.1 symbols/min [2025-10-15T19:31:49.714058] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-15T19:31:50.638201] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T19:31:50.648974] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-15T19:31:50.889398] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:31:51.314061] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-15T19:31:52.210186] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:31:52.221637] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-15T19:31:52.238547] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:31:52.914048] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-15T19:31:54.176850] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T19:31:54.188091] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-15T19:31:54.369282] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:31:54.372941] [INFO ] [REMOTE ] HZO: Full fetch complete (41325 records). [2025-10-15T19:31:54.373046] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-15T19:31:54.762820] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-15T19:31:54.762897] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-15T19:31:54.763729] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-15T19:31:54.763791] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-15T19:31:54.764727] [DEBUG] [LOCAL ] HZO: Trimmed 41325 records to 29081 (keeping 200 days of data) [2025-10-15T19:31:54.939902] [DEBUG] [LOCAL ] HZO: Primary data saved (29081 records). [2025-10-15T19:31:54.940058] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-15T19:31:54.940156] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. HZO took 41.2s. Estimated remaining: 3h 1m 32s. Rate: 7.1 symbols/min [2025-10-15T19:31:55.883540] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:31:55.895082] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-15T19:31:57.873731] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T19:31:57.884388] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-15T19:31:59.448245] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:31:59.459929] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-15T19:32:01.447024] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T19:32:01.464344] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-15T19:32:03.351599] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:32:03.363114] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-15T19:32:05.139904] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T19:32:05.146240] [INFO ] [REMOTE ] IAG: Full fetch complete (77476 records). [2025-10-15T19:32:05.146389] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-15T19:32:05.528968] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-15T19:32:05.529053] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-15T19:32:05.530089] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-15T19:32:05.530153] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-15T19:32:05.531792] [DEBUG] [LOCAL ] IAG: Trimmed 77476 records to 53488 (keeping 200 days of data) [2025-10-15T19:32:05.836662] [DEBUG] [LOCAL ] IAG: Primary data saved (53488 records). [2025-10-15T19:32:05.836855] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-15T19:32:05.837013] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 29.5s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-15T19:32:06.407426] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.409766] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.537833] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.563883] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.600137] [DEBUG] [LOCAL ] IBTA: Loaded 36746 existing records from primary storage. [2025-10-15T19:32:06.600522] [INFO ] [MAIN ] IBTA: Loaded 36746 existing records. [2025-10-15T19:32:06.713492] [DEBUG] [LOCAL ] IBM: Loaded 53632 existing records from primary storage. [2025-10-15T19:32:06.726384] [INFO ] [MAIN ] IBM: Loaded 53632 existing records. [2025-10-15T19:32:06.848068] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:06.858492] [DEBUG] [LOCAL ] IBP: Loaded 28892 existing records from primary storage. [2025-10-15T19:32:06.896960] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-15T19:32:06.891728] [INFO ] [MAIN ] IBP: Loaded 28892 existing records. [2025-10-15T19:32:06.907449] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-15T19:32:06.956715] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-15T19:32:07.007393] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-15T19:32:07.024041] [DEBUG] [LOCAL ] IBN: Loaded 52809 existing records from primary storage. [2025-10-15T19:32:07.060585] [INFO ] [MAIN ] IBN: Loaded 52809 existing records. [2025-10-15T19:32:07.273695] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:07.312180] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-15T19:32:07.328772] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-15T19:32:07.345109] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-15T19:32:07.365873] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-15T19:32:07.538862] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:07.582821] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:07.579749] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-15T19:32:07.597594] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-15T19:32:07.603682] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-15T19:32:07.602899] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-15T19:32:07.645880] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-15T19:32:07.659683] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-15T19:32:07.707280] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-15T19:32:07.702069] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-15T19:32:08.175200] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.211385] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-15T19:32:08.562842] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.589322] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-15T19:32:08.794511] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.814610] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-15T19:32:08.851997] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.852351] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-15T19:32:09.371770] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:32:09.379796] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-15T19:32:09.867563] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:32:09.877451] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-15T19:32:10.145222] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:32:10.157167] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-15T19:32:10.258053] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T19:32:10.264305] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-15T19:32:10.428474] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:32:10.440505] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-15T19:32:11.024759] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:32:11.030576] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-15T19:32:11.458185] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T19:32:11.463624] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-15T19:32:11.635993] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:32:11.651450] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-15T19:32:12.265594] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T19:32:12.271410] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-15T19:32:12.438420] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-15T19:32:12.450845] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-15T19:32:12.962570] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T19:32:12.973246] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-15T19:32:13.018808] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:32:13.029703] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-15T19:32:13.252752] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:32:13.259363] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-15T19:32:14.260975] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:32:14.270986] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-15T19:32:14.541584] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-15T19:32:14.551730] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-15T19:32:14.613032] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T19:32:14.619734] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-15T19:32:14.934574] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T19:32:14.945430] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-15T19:32:15.452792] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T19:32:15.460155] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-15T19:32:15.843334] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T19:32:16.114149] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-15T19:32:16.462467] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:32:16.659705] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:32:16.849954] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-15T19:32:16.914094] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-15T19:32:17.309697] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:32:17.714025] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-15T19:32:18.513992] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-15T19:32:18.720888] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:32:19.085399] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:32:19.314020] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-15T19:32:20.114036] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-15T19:32:20.562552] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T19:32:20.916528] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-15T19:32:20.922187] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T19:32:21.301785] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:32:21.714003] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-15T19:32:22.167177] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:32:22.514007] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-15T19:32:23.313993] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-15T19:32:23.907833] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-15T19:32:24.113991] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-15T19:32:24.393839] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T19:32:24.906093] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:32:24.914668] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-15T19:32:25.713960] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-15T19:32:26.194610] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:32:26.233325] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T19:32:26.514002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-15T19:32:27.192282] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T19:32:27.313968] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-15T19:32:27.626962] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T19:32:27.630558] [INFO ] [REMOTE ] IBP: Full fetch complete (41135 records). [2025-10-15T19:32:27.630636] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-15T19:32:28.002919] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-15T19:32:28.003049] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-15T19:32:28.003868] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-15T19:32:28.003932] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-15T19:32:28.005055] [DEBUG] [LOCAL ] IBP: Trimmed 41135 records to 28891 (keeping 200 days of data) [2025-10-15T19:32:28.114039] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-15T19:32:28.189582] [DEBUG] [LOCAL ] IBP: Primary data saved (28891 records). [2025-10-15T19:32:28.189734] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-15T19:32:28.189819] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 22.3s. Estimated remaining: 3h 1m 35s. Rate: 7.1 symbols/min [2025-10-15T19:32:28.353007] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:28.408225] [DEBUG] [LOCAL ] ICE: Loaded 53017 existing records from primary storage. [2025-10-15T19:32:28.408517] [INFO ] [MAIN ] ICE: Loaded 53017 existing records. [2025-10-15T19:32:28.582808] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:28.583790] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-15T19:32:28.583924] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-15T19:32:28.584382] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-15T19:32:28.584457] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-15T19:32:28.916279] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-15T19:32:28.947499] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:28.977731] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:32:29.713989] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-15T19:32:30.370695] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T19:32:30.514830] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-15T19:32:30.517563] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-15T19:32:31.313967] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-15T19:32:31.381039] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:32:32.113964] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-15T19:32:32.281288] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T19:32:32.287780] [INFO ] [REMOTE ] IBN: Full fetch complete (76531 records). [2025-10-15T19:32:32.287904] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-15T19:32:32.710241] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-15T19:32:32.710339] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-15T19:32:32.711447] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-15T19:32:32.711511] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-15T19:32:32.712911] [DEBUG] [LOCAL ] IBN: Trimmed 76531 records to 52819 (keeping 200 days of data) [2025-10-15T19:32:32.930031] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-15T19:32:32.945379] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:32:32.951566] [INFO ] [REMOTE ] IBTA: Full fetch complete (51132 records). [2025-10-15T19:32:32.952912] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-15T19:32:33.376412] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-15T19:32:33.376852] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-15T19:32:33.378605] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-15T19:32:33.379252] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-15T19:32:33.385100] [DEBUG] [LOCAL ] IBTA: Trimmed 51132 records to 36655 (keeping 200 days of data) [2025-10-15T19:32:33.581918] [DEBUG] [LOCAL ] IBN: Primary data saved (52819 records). [2025-10-15T19:32:33.584497] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-15T19:32:33.585316] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBN took 27.7s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-15T19:32:33.840444] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:33.896838] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:32:33.909871] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-15T19:32:33.930024] [DEBUG] [LOCAL ] ICL: Loaded 38549 existing records from primary storage. [2025-10-15T19:32:33.933117] [INFO ] [MAIN ] ICL: Loaded 38549 existing records. [2025-10-15T19:32:33.932951] [DEBUG] [LOCAL ] IBTA: Primary data saved (36655 records). [2025-10-15T19:32:33.977100] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-15T19:32:33.998212] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBTA took 28.2s. Estimated remaining: 3h 1m 4s. Rate: 7.1 symbols/min [2025-10-15T19:32:34.272263] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:34.290209] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:34.290282] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-15T19:32:34.290683] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-15T19:32:34.290865] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-15T19:32:34.290905] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-15T19:32:34.602308] [DEBUG] [LOCAL ] IDA: Loaded 32789 existing records from primary storage. [2025-10-15T19:32:34.613321] [INFO ] [MAIN ] IDA: Loaded 32789 existing records. [2025-10-15T19:32:34.785880] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:34.786233] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-15T19:32:34.867477] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:34.867743] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-15T19:32:34.867828] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-15T19:32:34.868071] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-15T19:32:34.868127] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-15T19:32:35.221932] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:35.314080] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-15T19:32:35.717206] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T19:32:35.764508] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-15T19:32:35.919149] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:32:36.113969] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-15T19:32:36.469244] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:32:36.914056] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-15T19:32:37.713994] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-15T19:32:38.245818] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:32:38.513981] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-15T19:32:38.569489] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-15T19:32:39.314071] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-15T19:32:39.659675] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T19:32:39.901629] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T19:32:40.115094] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-15T19:32:40.117435] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:32:40.125104] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-15T19:32:40.125286] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-15T19:32:40.510957] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-15T19:32:40.511034] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-15T19:32:40.512053] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-15T19:32:40.512117] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-15T19:32:40.513540] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 53633 (keeping 200 days of data) [2025-10-15T19:32:40.849913] [DEBUG] [LOCAL ] IBM: Primary data saved (53633 records). [2025-10-15T19:32:40.850072] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-15T19:32:40.850166] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 35.0s. Estimated remaining: 3h 0m 54s. Rate: 7.1 symbols/min [2025-10-15T19:32:40.923915] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-15T19:32:41.021568] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:41.033965] [DEBUG] [LOCAL ] IDE: Loaded 9113 existing records from primary storage. [2025-10-15T19:32:41.034312] [INFO ] [MAIN ] IDE: Loaded 9113 existing records. [2025-10-15T19:32:41.230352] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:41.230681] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-15T19:32:41.230794] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-15T19:32:41.230977] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-15T19:32:41.231034] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-15T19:32:41.498218] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:32:41.625876] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:41.714018] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-15T19:32:42.331215] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:32:42.346198] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T19:32:42.513980] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-15T19:32:43.313991] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-15T19:32:43.330372] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T19:32:44.113982] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-15T19:32:44.333108] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T19:32:44.914053] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-15T19:32:45.683722] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:32:45.713950] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-15T19:32:46.291871] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T19:32:46.513989] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-15T19:32:47.322684] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-15T19:32:47.328132] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T19:32:47.930582] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:32:47.928995] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:32:48.113985] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-15T19:32:48.914060] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-15T19:32:49.674528] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:32:49.713949] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-15T19:32:50.514023] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-15T19:32:50.733542] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:32:51.246045] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:32:51.313954] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-15T19:32:51.927304] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:32:52.113980] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-15T19:32:52.458867] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:32:52.914013] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-15T19:32:53.714039] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-15T19:32:54.158629] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T19:32:54.303267] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:32:54.406219] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:32:54.514053] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-15T19:32:55.314075] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-15T19:32:55.729153] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T19:32:56.032419] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T19:32:56.114008] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-15T19:32:56.913988] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-15T19:32:57.609054] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:32:57.713953] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-15T19:32:58.149964] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:32:58.154579] [INFO ] [REMOTE ] ICL: Full fetch complete (56159 records). [2025-10-15T19:32:58.154685] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-15T19:32:58.517803] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-15T19:32:58.532091] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-15T19:32:58.532157] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-15T19:32:58.533015] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-15T19:32:58.533086] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-15T19:32:58.535177] [DEBUG] [LOCAL ] ICL: Trimmed 56159 records to 38552 (keeping 200 days of data) [2025-10-15T19:32:58.752123] [DEBUG] [LOCAL ] ICL: Primary data saved (38552 records). [2025-10-15T19:32:58.752347] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-15T19:32:58.752708] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 25.2s. Estimated remaining: 3h 0m 57s. Rate: 7.1 symbols/min [2025-10-15T19:32:58.921608] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:58.944076] [DEBUG] [LOCAL ] IDT: Loaded 18405 existing records from primary storage. [2025-10-15T19:32:58.944345] [INFO ] [MAIN ] IDT: Loaded 18405 existing records. [2025-10-15T19:32:59.103321] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:32:59.153370] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:59.153847] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-15T19:32:59.153898] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-15T19:32:59.154063] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-15T19:32:59.154119] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-15T19:32:59.325476] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-15T19:32:59.455412] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T19:32:59.525564] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:00.113978] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-15T19:33:00.573373] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:33:00.914007] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-15T19:33:01.496545] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T19:33:01.714084] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-15T19:33:02.514047] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-15T19:33:03.151589] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:33:03.155832] [INFO ] [REMOTE ] IDA: Full fetch complete (45276 records). [2025-10-15T19:33:03.155933] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-15T19:33:03.319771] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-15T19:33:03.463770] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:33:03.586943] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-15T19:33:03.587043] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-15T19:33:03.587926] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-15T19:33:03.588009] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-15T19:33:03.589420] [DEBUG] [LOCAL ] IDA: Trimmed 45276 records to 32824 (keeping 200 days of data) [2025-10-15T19:33:03.710281] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-15T19:33:03.848369] [DEBUG] [LOCAL ] IDA: Primary data saved (32824 records). [2025-10-15T19:33:03.848536] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-15T19:33:03.848631] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. IDA took 29.8s. Estimated remaining: 3h 0m 44s. Rate: 7.1 symbols/min [2025-10-15T19:33:03.976444] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T19:33:04.055528] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:04.094672] [DEBUG] [LOCAL ] IEX: Loaded 38366 existing records from primary storage. [2025-10-15T19:33:04.094980] [INFO ] [MAIN ] IEX: Loaded 38366 existing records. [2025-10-15T19:33:04.119183] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-15T19:33:04.286970] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:04.287303] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-15T19:33:04.287361] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-15T19:33:04.287861] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-15T19:33:04.287918] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-15T19:33:04.627219] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:04.914008] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-15T19:33:05.714005] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-15T19:33:05.943701] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:33:06.160159] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T19:33:06.312124] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:33:06.514049] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-15T19:33:07.314017] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-15T19:33:08.077238] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T19:33:08.113966] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-15T19:33:08.346367] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:33:08.913975] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-15T19:33:08.921363] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:33:09.684410] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T19:33:09.713975] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-15T19:33:10.345492] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T19:33:10.347422] [INFO ] [REMOTE ] IDE: Full fetch complete (12720 records). [2025-10-15T19:33:10.347502] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-15T19:33:10.524582] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-15T19:33:10.701769] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-15T19:33:10.701843] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-15T19:33:10.702134] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-15T19:33:10.702171] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-15T19:33:10.702600] [DEBUG] [LOCAL ] IDE: Trimmed 12720 records to 9108 (keeping 200 days of data) [2025-10-15T19:33:10.757108] [DEBUG] [LOCAL ] IDE: Primary data saved (9108 records). [2025-10-15T19:33:10.757237] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-15T19:33:10.757316] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDE took 29.9s. Estimated remaining: 3h 0m 34s. Rate: 7.1 symbols/min [2025-10-15T19:33:10.921591] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:10.970847] [DEBUG] [LOCAL ] IFF: Loaded 51103 existing records from primary storage. [2025-10-15T19:33:10.971170] [INFO ] [MAIN ] IFF: Loaded 51103 existing records. [2025-10-15T19:33:11.145943] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:11.146151] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-15T19:33:11.146197] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-15T19:33:11.146733] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-15T19:33:11.146790] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-15T19:33:11.319180] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-15T19:33:11.500976] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:11.742840] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T19:33:12.114033] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-15T19:33:12.914067] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-15T19:33:13.212144] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:33:13.483259] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:33:13.578757] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T19:33:13.714028] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-15T19:33:14.514003] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-15T19:33:15.093860] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:33:15.314002] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-15T19:33:16.113998] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-15T19:33:16.613482] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-15T19:33:16.622910] [INFO ] [REMOTE ] ICE: Full fetch complete (76958 records). [2025-10-15T19:33:16.623088] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-15T19:33:16.927340] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-15T19:33:17.035863] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-15T19:33:17.036089] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-15T19:33:17.037315] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-15T19:33:17.037545] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-15T19:33:17.053755] [DEBUG] [LOCAL ] ICE: Trimmed 76958 records to 53018 (keeping 200 days of data) [2025-10-15T19:33:17.061198] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:33:17.176793] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T19:33:17.416353] [DEBUG] [LOCAL ] ICE: Primary data saved (53018 records). [2025-10-15T19:33:17.416499] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-15T19:33:17.417571] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. ICE took 49.2s. Estimated remaining: 3h 0m 24s. Rate: 7.1 symbols/min [2025-10-15T19:33:17.586432] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:17.607931] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-10-15T19:33:17.608191] [INFO ] [MAIN ] IFN: Loaded 18475 existing records. [2025-10-15T19:33:17.719079] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-15T19:33:17.796518] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:17.796747] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-15T19:33:17.796799] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-15T19:33:17.797009] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-15T19:33:17.797048] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-15T19:33:18.149502] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:18.514044] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-15T19:33:18.661926] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T19:33:18.976788] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T19:33:19.313998] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-15T19:33:19.817504] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T19:33:20.114057] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-15T19:33:20.322105] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:33:20.914012] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-15T19:33:21.725397] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-15T19:33:21.734749] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T19:33:22.072569] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:33:22.514007] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-15T19:33:22.845349] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T19:33:23.313999] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-15T19:33:23.685201] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T19:33:24.114014] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-15T19:33:24.719921] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:33:24.913991] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-15T19:33:25.713998] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-15T19:33:25.788593] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:33:25.858547] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T19:33:26.514024] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-15T19:33:26.919678] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T19:33:27.313977] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-15T19:33:27.605783] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:33:28.092055] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:33:28.113967] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-15T19:33:28.913998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-15T19:33:29.262129] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T19:33:29.265464] [INFO ] [REMOTE ] IDT: Full fetch complete (23728 records). [2025-10-15T19:33:29.265554] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-15T19:33:29.621666] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-15T19:33:29.621759] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-15T19:33:29.622251] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-15T19:33:29.622290] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-15T19:33:29.623038] [DEBUG] [LOCAL ] IDT: Trimmed 23728 records to 18488 (keeping 200 days of data) [2025-10-15T19:33:29.714937] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-15T19:33:29.738365] [DEBUG] [LOCAL ] IDT: Primary data saved (18488 records). [2025-10-15T19:33:29.738517] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-15T19:33:29.738611] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDT took 31.0s. Estimated remaining: 3h 0m 20s. Rate: 7.1 symbols/min [2025-10-15T19:33:29.909661] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:29.931296] [DEBUG] [LOCAL ] IFS: Loaded 22683 existing records from primary storage. [2025-10-15T19:33:29.931553] [INFO ] [MAIN ] IFS: Loaded 22683 existing records. [2025-10-15T19:33:30.104226] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:30.104448] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-15T19:33:30.104502] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-15T19:33:30.104916] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-15T19:33:30.104976] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-15T19:33:30.479530] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:30.519846] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-15T19:33:30.532489] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T19:33:31.216337] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T19:33:31.263596] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T19:33:31.313957] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-15T19:33:32.113972] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-15T19:33:32.265307] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T19:33:32.914012] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-15T19:33:32.997912] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T19:33:33.714065] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-15T19:33:34.473123] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:33:34.519107] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-15T19:33:34.529063] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T19:33:35.314010] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-15T19:33:36.113969] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-15T19:33:36.175815] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T19:33:36.180194] [INFO ] [REMOTE ] IEX: Full fetch complete (53582 records). [2025-10-15T19:33:36.180293] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-15T19:33:36.563425] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-15T19:33:36.563498] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-15T19:33:36.564361] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-15T19:33:36.564421] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-15T19:33:36.565416] [DEBUG] [LOCAL ] IEX: Trimmed 53582 records to 38458 (keeping 200 days of data) [2025-10-15T19:33:36.808638] [DEBUG] [LOCAL ] IEX: Primary data saved (38458 records). [2025-10-15T19:33:36.808811] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-15T19:33:36.808898] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IEX took 33.0s. Estimated remaining: 3h 0m 10s. Rate: 7.1 symbols/min [2025-10-15T19:33:36.920172] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-15T19:33:36.983716] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:36.995217] [DEBUG] [LOCAL ] IGA: Loaded 10185 existing records from primary storage. [2025-10-15T19:33:36.995488] [INFO ] [MAIN ] IGA: Loaded 10185 existing records. [2025-10-15T19:33:37.070709] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T19:33:37.228374] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T19:33:37.234678] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:37.245718] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-15T19:33:37.246115] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-15T19:33:37.246325] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-15T19:33:37.246383] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-15T19:33:37.628068] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:37.638535] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T19:33:37.713968] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-15T19:33:38.343954] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T19:33:38.513989] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-15T19:33:39.286052] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:33:39.313959] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-15T19:33:40.021897] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T19:33:40.113998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-15T19:33:40.914013] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-15T19:33:41.714002] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-15T19:33:41.869870] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:33:41.951545] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:33:42.513964] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-15T19:33:42.792057] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T19:33:43.314055] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-15T19:33:44.113960] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-15T19:33:44.156114] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:33:44.361783] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T19:33:44.913969] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-15T19:33:45.194638] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T19:33:45.713982] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-15T19:33:46.113891] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:33:46.514085] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-15T19:33:47.003990] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T19:33:47.247427] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T19:33:47.250112] [INFO ] [REMOTE ] IFN: Full fetch complete (28625 records). [2025-10-15T19:33:47.250210] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-15T19:33:47.319173] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-15T19:33:47.620720] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-15T19:33:47.620833] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-15T19:33:47.621440] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-15T19:33:47.621484] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-15T19:33:47.622245] [DEBUG] [LOCAL ] IFN: Trimmed 28625 records to 18517 (keeping 200 days of data) [2025-10-15T19:33:47.736243] [DEBUG] [LOCAL ] IFN: Primary data saved (18517 records). [2025-10-15T19:33:47.736375] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-15T19:33:47.736453] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IFN took 30.3s. Estimated remaining: 3h 0m 4s. Rate: 7.1 symbols/min [2025-10-15T19:33:47.899449] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:47.918513] [DEBUG] [LOCAL ] IGD: Loaded 19411 existing records from primary storage. [2025-10-15T19:33:47.918772] [INFO ] [MAIN ] IGD: Loaded 19411 existing records. [2025-10-15T19:33:48.089792] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:48.090024] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-15T19:33:48.090072] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-15T19:33:48.090313] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-15T19:33:48.090392] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-15T19:33:48.120928] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-15T19:33:48.440781] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:48.914058] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-15T19:33:49.112555] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T19:33:49.446792] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-15T19:33:49.714038] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-15T19:33:50.166534] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T19:33:50.513967] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-15T19:33:50.849040] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T19:33:51.313990] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-15T19:33:52.027622] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T19:33:52.123223] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-15T19:33:52.143376] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:33:52.913997] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-15T19:33:53.420436] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:33:53.714064] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-15T19:33:54.205999] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T19:33:54.405246] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T19:33:54.514034] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-15T19:33:55.313984] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-15T19:33:55.404792] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T19:33:56.113992] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-15T19:33:56.914029] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-15T19:33:57.022453] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T19:33:57.028590] [INFO ] [REMOTE ] IFF: Full fetch complete (73512 records). [2025-10-15T19:33:57.028731] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-15T19:33:57.185998] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:33:57.447304] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T19:33:57.447513] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-15T19:33:57.451069] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-15T19:33:57.452103] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-15T19:33:57.452166] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-15T19:33:57.453410] [DEBUG] [LOCAL ] IFF: Trimmed 73512 records to 51147 (keeping 200 days of data) [2025-10-15T19:33:57.731001] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-15T19:33:57.772052] [DEBUG] [LOCAL ] IFF: Primary data saved (51147 records). [2025-10-15T19:33:57.772163] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-15T19:33:57.772237] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 47.0s. Estimated remaining: 2h 59m 57s. Rate: 7.1 symbols/min [2025-10-15T19:33:57.943619] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:57.950159] [DEBUG] [LOCAL ] IGI: Loaded 3934 existing records from primary storage. [2025-10-15T19:33:57.950382] [INFO ] [MAIN ] IGI: Loaded 3934 existing records. [2025-10-15T19:33:58.124283] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:58.124493] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-15T19:33:58.124543] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-15T19:33:58.124979] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-15T19:33:58.125039] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-15T19:33:58.478673] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:58.513974] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-15T19:33:58.908275] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T19:33:59.319091] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-15T19:33:59.327431] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:34:00.114029] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-15T19:34:00.125591] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T19:34:00.914024] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-15T19:34:01.199634] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:34:01.714022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-15T19:34:01.911485] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T19:34:02.514039] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-15T19:34:02.938389] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T19:34:03.314036] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-15T19:34:03.325932] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:34:03.328028] [INFO ] [REMOTE ] IGA: Full fetch complete (14139 records). [2025-10-15T19:34:03.328108] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-15T19:34:03.690921] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-15T19:34:03.690990] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-15T19:34:03.691303] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-15T19:34:03.691341] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-15T19:34:03.691853] [DEBUG] [LOCAL ] IGA: Trimmed 14139 records to 10170 (keeping 200 days of data) [2025-10-15T19:34:03.750730] [DEBUG] [LOCAL ] IGA: Primary data saved (10170 records). [2025-10-15T19:34:03.750850] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-15T19:34:03.750926] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IGA took 26.9s. Estimated remaining: 2h 59m 46s. Rate: 7.1 symbols/min [2025-10-15T19:34:03.826867] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T19:34:03.919736] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:03.949347] [DEBUG] [LOCAL ] IGR: Loaded 30377 existing records from primary storage. [2025-10-15T19:34:03.949595] [INFO ] [MAIN ] IGR: Loaded 30377 existing records. [2025-10-15T19:34:04.119135] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-15T19:34:04.124486] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:04.125549] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-15T19:34:04.125602] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-15T19:34:04.125920] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-15T19:34:04.125976] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-15T19:34:04.480984] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:04.683488] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T19:34:04.913990] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-15T19:34:05.381355] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T19:34:05.714029] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-15T19:34:06.513981] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-15T19:34:06.828138] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:34:07.314009] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-15T19:34:08.093191] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:34:08.113963] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-15T19:34:08.389017] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:34:08.914040] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-15T19:34:09.236053] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T19:34:09.713958] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-15T19:34:09.953769] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:34:10.514075] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-15T19:34:10.910716] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T19:34:11.070184] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:34:11.313994] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-15T19:34:11.721211] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-15T19:34:12.114034] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-15T19:34:12.691786] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T19:34:12.914028] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-15T19:34:13.523116] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T19:34:13.713998] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-15T19:34:14.514037] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-15T19:34:14.787335] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:34:15.314001] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-15T19:34:15.427032] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T19:34:16.113969] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-15T19:34:16.273182] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:34:16.913967] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-15T19:34:17.139423] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T19:34:17.490924] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T19:34:17.714054] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-15T19:34:18.205799] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T19:34:18.514014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-15T19:34:19.314009] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-15T19:34:19.571499] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T19:34:20.113972] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-15T19:34:20.253348] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T19:34:20.914035] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-15T19:34:21.402693] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:34:21.597900] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T19:34:21.599355] [INFO ] [REMOTE ] IGI: Full fetch complete (5490 records). [2025-10-15T19:34:21.599446] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-15T19:34:21.719135] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-15T19:34:21.964047] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-15T19:34:21.964126] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-15T19:34:21.964284] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-15T19:34:21.964324] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-15T19:34:21.964705] [DEBUG] [LOCAL ] IGI: Trimmed 5490 records to 3999 (keeping 200 days of data) [2025-10-15T19:34:21.990782] [DEBUG] [LOCAL ] IGI: Primary data saved (3999 records). [2025-10-15T19:34:21.990847] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-15T19:34:21.990956] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IGI took 24.2s. Estimated remaining: 2h 59m 49s. Rate: 7.1 symbols/min [2025-10-15T19:34:22.154175] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:22.160366] [DEBUG] [LOCAL ] IH: Loaded 2794 existing records from primary storage. [2025-10-15T19:34:22.160543] [INFO ] [MAIN ] IH: Loaded 2794 existing records. [2025-10-15T19:34:22.330954] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:22.331161] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-15T19:34:22.331209] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-15T19:34:22.331383] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-15T19:34:22.331438] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-15T19:34:22.522080] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-15T19:34:22.685890] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:22.883480] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T19:34:22.886730] [INFO ] [REMOTE ] IGD: Full fetch complete (30115 records). [2025-10-15T19:34:22.886851] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-15T19:34:23.263877] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-15T19:34:23.263949] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-15T19:34:23.264516] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-15T19:34:23.264554] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-15T19:34:23.265231] [DEBUG] [LOCAL ] IGD: Trimmed 30115 records to 19405 (keeping 200 days of data) [2025-10-15T19:34:23.320678] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-15T19:34:23.379967] [DEBUG] [LOCAL ] IGD: Primary data saved (19405 records). [2025-10-15T19:34:23.380073] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-15T19:34:23.380146] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGD took 35.6s. Estimated remaining: 2h 59m 32s. Rate: 7.1 symbols/min [2025-10-15T19:34:23.557185] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:23.573045] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T19:34:23.581832] [DEBUG] [LOCAL ] IHD: Loaded 7305 existing records from primary storage. [2025-10-15T19:34:23.582003] [INFO ] [MAIN ] IHD: Loaded 7305 existing records. [2025-10-15T19:34:23.766304] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:23.766907] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-15T19:34:23.766976] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-15T19:34:23.767149] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-15T19:34:23.767189] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-15T19:34:24.015396] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T19:34:24.131775] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:24.126391] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-15T19:34:24.914011] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-15T19:34:25.239070] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T19:34:25.438442] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T19:34:25.714002] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-15T19:34:26.307167] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T19:34:26.514002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-15T19:34:27.314045] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-15T19:34:27.476478] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T19:34:28.114052] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-15T19:34:28.796564] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:34:28.855129] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T19:34:28.913990] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-15T19:34:29.377439] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T19:34:29.713984] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-15T19:34:30.136219] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T19:34:30.514010] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-15T19:34:31.314055] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-15T19:34:31.558346] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T19:34:31.561133] [INFO ] [REMOTE ] IFS: Full fetch complete (32033 records). [2025-10-15T19:34:31.561217] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-15T19:34:31.947187] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-15T19:34:31.947285] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-15T19:34:31.948087] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-15T19:34:31.948153] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-15T19:34:31.949096] [DEBUG] [LOCAL ] IFS: Trimmed 32033 records to 22636 (keeping 200 days of data) [2025-10-15T19:34:32.085805] [DEBUG] [LOCAL ] IFS: Primary data saved (22636 records). [2025-10-15T19:34:32.085952] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-15T19:34:32.086061] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IFS took 1m 2s. Estimated remaining: 2h 59m 24s. Rate: 7.1 symbols/min [2025-10-15T19:34:32.117738] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-15T19:34:32.256200] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:32.280117] [DEBUG] [LOCAL ] IHG: Loaded 24262 existing records from primary storage. [2025-10-15T19:34:32.280348] [INFO ] [MAIN ] IHG: Loaded 24262 existing records. [2025-10-15T19:34:32.455399] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:32.455692] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-15T19:34:32.455750] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-15T19:34:32.455932] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-15T19:34:32.455986] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-15T19:34:32.638125] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T19:34:32.834053] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T19:34:32.882762] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:32.913989] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-15T19:34:33.713953] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-15T19:34:34.150360] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T19:34:34.193042] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T19:34:34.514060] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-15T19:34:35.314086] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-15T19:34:35.736255] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T19:34:35.739461] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:34:35.744630] [INFO ] [REMOTE ] IGR: Full fetch complete (45018 records). [2025-10-15T19:34:35.744752] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-15T19:34:36.116668] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-15T19:34:36.132130] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-15T19:34:36.132205] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-15T19:34:36.132987] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-15T19:34:36.133130] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-15T19:34:36.134227] [DEBUG] [LOCAL ] IGR: Trimmed 45018 records to 30438 (keeping 200 days of data) [2025-10-15T19:34:36.311185] [DEBUG] [LOCAL ] IGR: Primary data saved (30438 records). [2025-10-15T19:34:36.311331] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-15T19:34:36.311412] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IGR took 32.6s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-10-15T19:34:36.483782] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:36.518017] [DEBUG] [LOCAL ] IHS: Loaded 37773 existing records from primary storage. [2025-10-15T19:34:36.518320] [INFO ] [MAIN ] IHS: Loaded 37773 existing records. [2025-10-15T19:34:36.683720] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:34:36.704007] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:36.705627] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-15T19:34:36.705717] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-15T19:34:36.706144] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-15T19:34:36.706199] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-15T19:34:36.919121] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-15T19:34:37.084255] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:37.713999] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-15T19:34:37.826784] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T19:34:38.514057] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-15T19:34:39.117468] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:34:39.257500] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T19:34:39.313982] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-15T19:34:40.114002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-15T19:34:40.550411] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T19:34:40.809430] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T19:34:40.913951] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-15T19:34:41.714073] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-15T19:34:42.013949] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:34:42.514049] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-15T19:34:42.938724] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:34:43.314049] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-15T19:34:43.605586] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:34:44.114035] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-15T19:34:44.141629] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T19:34:44.565380] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T19:34:44.566274] [INFO ] [REMOTE ] IH: Full fetch complete (5019 records). [2025-10-15T19:34:44.566342] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-15T19:34:44.917244] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-15T19:34:44.922266] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-15T19:34:44.923228] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-15T19:34:44.923441] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-15T19:34:44.923483] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-15T19:34:44.923930] [DEBUG] [LOCAL ] IH: Trimmed 5019 records to 2799 (keeping 200 days of data) [2025-10-15T19:34:44.939870] [DEBUG] [LOCAL ] IH: Primary data saved (2799 records). [2025-10-15T19:34:44.940205] [INFO ] [MAIN ] IH: Full history saved. [2025-10-15T19:34:44.940399] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IH took 22.9s. Estimated remaining: 2h 59m 3s. Rate: 7.1 symbols/min [2025-10-15T19:34:45.138270] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:45.147559] [DEBUG] [LOCAL ] IIF: Loaded 5596 existing records from primary storage. [2025-10-15T19:34:45.147858] [INFO ] [MAIN ] IIF: Loaded 5596 existing records. [2025-10-15T19:34:45.326466] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:45.326719] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-15T19:34:45.326774] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-15T19:34:45.326930] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-15T19:34:45.326968] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-15T19:34:45.700377] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:45.713950] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-15T19:34:46.160781] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T19:34:46.514061] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-15T19:34:46.734318] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:34:47.314029] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-15T19:34:47.589002] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T19:34:48.113961] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-15T19:34:48.162144] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:34:48.756435] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T19:34:48.913975] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-15T19:34:49.714045] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-15T19:34:50.141524] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T19:34:50.201327] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T19:34:50.514052] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-15T19:34:51.111184] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T19:34:51.314018] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-15T19:34:52.114028] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-15T19:34:52.835859] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:34:52.914009] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-15T19:34:53.152790] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T19:34:53.714005] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-15T19:34:54.321884] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T19:34:54.384374] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:34:54.514030] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-15T19:34:55.220794] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T19:34:55.314006] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-15T19:34:55.890261] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T19:34:56.114022] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-15T19:34:56.887545] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T19:34:56.913954] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-15T19:34:57.557721] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:34:57.714001] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-15T19:34:58.514009] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-15T19:34:58.852037] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T19:34:59.314071] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-15T19:34:59.935272] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T19:35:00.114015] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-15T19:35:00.403930] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:35:00.846139] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T19:35:00.913953] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-15T19:35:01.568266] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T19:35:01.714005] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-15T19:35:02.514002] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-15T19:35:02.630369] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:35:03.314043] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-15T19:35:03.920277] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:35:04.113984] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-15T19:35:04.146459] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T19:35:04.148262] [INFO ] [REMOTE ] IHD: Full fetch complete (11868 records). [2025-10-15T19:35:04.148332] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-15T19:35:04.498412] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-15T19:35:04.498494] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-15T19:35:04.498788] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-15T19:35:04.498850] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-15T19:35:04.499275] [DEBUG] [LOCAL ] IHD: Trimmed 11868 records to 7329 (keeping 200 days of data) [2025-10-15T19:35:04.547376] [DEBUG] [LOCAL ] IHD: Primary data saved (7329 records). [2025-10-15T19:35:04.547516] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-15T19:35:04.547599] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IHD took 41.2s. Estimated remaining: 2h 59m 7s. Rate: 7.1 symbols/min [2025-10-15T19:35:04.717073] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:04.734052] [DEBUG] [LOCAL ] IIIN: Loaded 15969 existing records from primary storage. [2025-10-15T19:35:04.734424] [INFO ] [MAIN ] IIIN: Loaded 15969 existing records. [2025-10-15T19:35:04.913149] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:04.913344] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-15T19:35:04.913405] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-15T19:35:04.913585] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-15T19:35:04.913624] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-15T19:35:04.924637] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-15T19:35:05.270832] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:05.301058] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:35:05.714024] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-15T19:35:06.500087] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T19:35:06.513952] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-15T19:35:06.543573] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:35:07.115882] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T19:35:07.314058] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-15T19:35:07.893165] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:35:08.114001] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-15T19:35:08.604376] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T19:35:08.605294] [INFO ] [REMOTE ] IIF: Full fetch complete (9021 records). [2025-10-15T19:35:08.605362] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-15T19:35:08.924143] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-15T19:35:08.955935] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-15T19:35:08.956063] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-15T19:35:08.956301] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-15T19:35:08.956342] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-15T19:35:08.956954] [DEBUG] [LOCAL ] IIF: Trimmed 9021 records to 5591 (keeping 200 days of data) [2025-10-15T19:35:09.001937] [DEBUG] [LOCAL ] IIF: Primary data saved (5591 records). [2025-10-15T19:35:09.002098] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-15T19:35:09.002197] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IIF took 24.1s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-15T19:35:09.168611] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:09.184888] [DEBUG] [LOCAL ] IIM: Loaded 15708 existing records from primary storage. [2025-10-15T19:35:09.185112] [INFO ] [MAIN ] IIM: Loaded 15708 existing records. [2025-10-15T19:35:09.355833] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:09.356017] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-15T19:35:09.356063] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-15T19:35:09.356311] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-15T19:35:09.356367] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-15T19:35:09.699009] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:09.713951] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-15T19:35:10.219834] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:35:10.514050] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-15T19:35:10.777615] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T19:35:11.313982] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-15T19:35:11.569739] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:35:12.114012] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-15T19:35:12.392816] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:35:12.913955] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-15T19:35:12.994014] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T19:35:12.996993] [INFO ] [REMOTE ] IHG: Full fetch complete (34003 records). [2025-10-15T19:35:12.997072] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-15T19:35:13.370709] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-15T19:35:13.370793] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-15T19:35:13.371459] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-15T19:35:13.371505] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-15T19:35:13.372316] [DEBUG] [LOCAL ] IHG: Trimmed 34003 records to 24302 (keeping 200 days of data) [2025-10-15T19:35:13.520631] [DEBUG] [LOCAL ] IHG: Primary data saved (24302 records). [2025-10-15T19:35:13.520779] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-15T19:35:13.520858] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHG took 41.4s. Estimated remaining: 2h 58m 41s. Rate: 7.1 symbols/min [2025-10-15T19:35:13.686441] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:13.717131] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-15T19:35:13.718507] [DEBUG] [LOCAL ] IIPR: Loaded 29452 existing records from primary storage. [2025-10-15T19:35:13.718751] [INFO ] [MAIN ] IIPR: Loaded 29452 existing records. [2025-10-15T19:35:13.900020] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:13.900229] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-15T19:35:13.900283] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-15T19:35:13.900617] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-15T19:35:13.900699] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-15T19:35:14.284358] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T19:35:14.283864] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:14.513965] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-15T19:35:14.852922] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T19:35:15.314045] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-15T19:35:15.429699] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:35:15.433341] [INFO ] [REMOTE ] IHS: Full fetch complete (51487 records). [2025-10-15T19:35:15.433445] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-15T19:35:15.822038] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-15T19:35:15.822128] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-15T19:35:15.823053] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-15T19:35:15.823118] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-15T19:35:15.824326] [DEBUG] [LOCAL ] IHS: Trimmed 51487 records to 37622 (keeping 200 days of data) [2025-10-15T19:35:16.038231] [DEBUG] [LOCAL ] IHS: Primary data saved (37622 records). [2025-10-15T19:35:16.038376] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-15T19:35:16.038452] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IHS took 39.7s. Estimated remaining: 2h 58m 26s. Rate: 7.1 symbols/min [2025-10-15T19:35:16.116686] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-15T19:35:16.219559] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:16.265095] [DEBUG] [LOCAL ] IMAX: Loaded 43182 existing records from primary storage. [2025-10-15T19:35:16.265423] [INFO ] [MAIN ] IMAX: Loaded 43182 existing records. [2025-10-15T19:35:16.397842] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T19:35:16.476761] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:16.477179] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-15T19:35:16.477237] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-15T19:35:16.477736] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-15T19:35:16.477793] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-15T19:35:16.826417] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:16.914014] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-15T19:35:17.248939] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:35:17.714014] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-15T19:35:17.859423] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:35:18.514009] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-15T19:35:18.623006] [DEBUG] [REMOTE ] IMAX: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T19:35:18.623327] [WARN ] [REMOTE ] IMAX: No data returned for month 2024-12 [2025-10-15T19:35:18.623418] [FATAL] [REMOTE ] IMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:35:18.623488] [FATAL] [MAIN ] IMAX: Failed to fetch primary data. [2025-10-15T19:35:18.623554] [WARN ] [MAIN ] IMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:35:18.623626] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-15T19:35:18.623725] [DEBUG] [LOCAL ] IMAX: No primary data file found to delete. [2025-10-15T19:35:18.623769] [INFO ] [LOCAL ] IMAX: Starting deletion of derivative data. [2025-10-15T19:35:18.623926] [DEBUG] [LOCAL ] IMAX: Deleted derivative data file. [2025-10-15T19:35:18.624017] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IMAX took 2.6s. Estimated remaining: 2h 58m 11s. Rate: 7.1 symbols/min [2025-10-15T19:35:18.790306] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:18.835879] [DEBUG] [LOCAL ] INFA: Loaded 49048 existing records from primary storage. [2025-10-15T19:35:18.836192] [INFO ] [MAIN ] INFA: Loaded 49048 existing records. [2025-10-15T19:35:19.021789] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:19.022100] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-15T19:35:19.022183] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-15T19:35:19.022837] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-15T19:35:19.022896] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-15T19:35:19.317632] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-15T19:35:19.331973] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:35:19.418289] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:20.113981] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-15T19:35:20.155150] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T19:35:20.913972] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-15T19:35:20.955235] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T19:35:21.713991] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-15T19:35:22.513965] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-15T19:35:22.592036] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T19:35:22.784681] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:35:23.313989] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-15T19:35:23.722875] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T19:35:24.113972] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-15T19:35:24.391887] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T19:35:24.913982] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-15T19:35:25.040096] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T19:35:25.472711] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T19:35:25.714000] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-15T19:35:26.513999] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-15T19:35:27.243441] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:35:27.292675] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:35:27.313957] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-15T19:35:28.113995] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-15T19:35:28.914006] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-15T19:35:29.020392] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T19:35:29.167831] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T19:35:29.713997] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-15T19:35:29.744071] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T19:35:30.514015] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-15T19:35:31.313979] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-15T19:35:31.374289] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T19:35:31.836688] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T19:35:32.114045] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-15T19:35:32.297900] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T19:35:32.913996] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-15T19:35:33.618849] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:35:33.713968] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-15T19:35:33.908543] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:35:34.513991] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-15T19:35:35.275132] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:35:35.313973] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-15T19:35:35.450124] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:35:35.452458] [INFO ] [REMOTE ] IIM: Full fetch complete (25202 records). [2025-10-15T19:35:35.452532] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-15T19:35:35.861141] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-15T19:35:35.861224] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-15T19:35:35.861813] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-15T19:35:35.861876] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-15T19:35:35.862512] [DEBUG] [LOCAL ] IIM: Trimmed 25202 records to 15661 (keeping 200 days of data) [2025-10-15T19:35:35.968475] [DEBUG] [LOCAL ] IIM: Primary data saved (15661 records). [2025-10-15T19:35:35.968616] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-15T19:35:35.968731] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIM took 27.0s. Estimated remaining: 2h 58m 12s. Rate: 7.1 symbols/min [2025-10-15T19:35:36.118203] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-15T19:35:36.144442] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:36.199353] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-15T19:35:36.199709] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-15T19:35:36.373261] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:36.373454] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-15T19:35:36.373502] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-15T19:35:36.374000] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-15T19:35:36.374055] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-15T19:35:36.722723] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:36.750960] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:35:36.913959] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-15T19:35:37.626096] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:35:37.713997] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-15T19:35:38.513986] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-15T19:35:38.841190] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T19:35:38.961264] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T19:35:39.313988] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-15T19:35:39.773992] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T19:35:40.114043] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-15T19:35:40.913996] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-15T19:35:41.074612] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T19:35:41.459089] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:35:41.713984] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-15T19:35:41.734814] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T19:35:42.514021] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-15T19:35:42.962930] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T19:35:43.057580] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T19:35:43.314001] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-15T19:35:44.113991] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-15T19:35:44.913975] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-15T19:35:44.982430] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:35:45.559324] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T19:35:45.713996] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-15T19:35:45.761696] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T19:35:46.514002] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-15T19:35:47.071350] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T19:35:47.314008] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-15T19:35:48.114002] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-15T19:35:48.136593] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T19:35:48.138707] [INFO ] [REMOTE ] IIIN: Full fetch complete (24572 records). [2025-10-15T19:35:48.138786] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-15T19:35:48.550538] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-15T19:35:48.550670] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-15T19:35:48.551251] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-15T19:35:48.551668] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-15T19:35:48.554436] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T19:35:48.567282] [DEBUG] [LOCAL ] IIIN: Trimmed 24572 records to 15979 (keeping 200 days of data) [2025-10-15T19:35:48.669775] [DEBUG] [LOCAL ] IIIN: Primary data saved (15979 records). [2025-10-15T19:35:48.669916] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-15T19:35:48.669994] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIIN took 44.1s. Estimated remaining: 2h 58m 9s. Rate: 7.1 symbols/min [2025-10-15T19:35:48.836415] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:48.896926] [DEBUG] [LOCAL ] ING: Loaded 50723 existing records from primary storage. [2025-10-15T19:35:48.897251] [INFO ] [MAIN ] ING: Loaded 50723 existing records. [2025-10-15T19:35:48.919142] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-15T19:35:49.074961] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:49.075166] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-15T19:35:49.075213] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-15T19:35:49.075428] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-15T19:35:49.075483] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-15T19:35:49.423565] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:49.442056] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T19:35:49.713985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-15T19:35:50.513963] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-15T19:35:50.923261] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T19:35:51.039941] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:35:51.314000] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-15T19:35:52.072535] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:35:52.078084] [INFO ] [REMOTE ] INFA: Full fetch complete (70908 records). [2025-10-15T19:35:52.078219] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-15T19:35:52.124076] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-15T19:35:52.472187] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-15T19:35:52.472265] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-15T19:35:52.473226] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-15T19:35:52.473288] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-15T19:35:52.474679] [DEBUG] [LOCAL ] INFA: Trimmed 70908 records to 49000 (keeping 200 days of data) [2025-10-15T19:35:52.819007] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:35:52.820353] [DEBUG] [LOCAL ] INFA: Primary data saved (49000 records). [2025-10-15T19:35:52.830943] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-15T19:35:52.831175] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. INFA took 34.2s. Estimated remaining: 2h 57m 55s. Rate: 7.1 symbols/min [2025-10-15T19:35:52.922205] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-15T19:35:53.003422] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:53.033743] [DEBUG] [LOCAL ] INGM: Loaded 28445 existing records from primary storage. [2025-10-15T19:35:53.034009] [INFO ] [MAIN ] INGM: Loaded 28445 existing records. [2025-10-15T19:35:53.229438] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:53.229676] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-15T19:35:53.229736] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-15T19:35:53.230050] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-15T19:35:53.230090] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-15T19:35:53.590839] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:53.713965] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-15T19:35:54.276357] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T19:35:54.365047] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:35:54.369177] [INFO ] [REMOTE ] IIPR: Full fetch complete (44297 records). [2025-10-15T19:35:54.369322] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-15T19:35:54.519263] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-15T19:35:54.880317] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-15T19:35:54.880440] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-15T19:35:54.882173] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-15T19:35:54.882272] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-15T19:35:54.884436] [DEBUG] [LOCAL ] IIPR: Trimmed 44297 records to 29450 (keeping 200 days of data) [2025-10-15T19:35:55.138291] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:35:55.154569] [DEBUG] [LOCAL ] IIPR: Primary data saved (29450 records). [2025-10-15T19:35:55.154749] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-15T19:35:55.154838] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. IIPR took 41.6s. Estimated remaining: 2h 57m 40s. Rate: 7.1 symbols/min [2025-10-15T19:35:55.323953] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-15T19:35:55.328200] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:55.368686] [DEBUG] [LOCAL ] INGR: Loaded 33861 existing records from primary storage. [2025-10-15T19:35:55.368964] [INFO ] [MAIN ] INGR: Loaded 33861 existing records. [2025-10-15T19:35:55.554312] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:55.554590] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-15T19:35:55.554687] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-15T19:35:55.555023] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-15T19:35:55.555121] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-15T19:35:55.926882] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:56.113959] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-15T19:35:56.295708] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:35:56.914070] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-15T19:35:56.964991] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:35:57.542489] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T19:35:57.713996] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-15T19:35:58.495172] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:35:58.513993] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-15T19:35:59.314023] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-15T19:35:59.561756] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T19:36:00.114045] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-15T19:36:00.378061] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T19:36:00.587559] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:36:00.914045] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-15T19:36:01.714019] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-15T19:36:01.948108] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:36:02.513971] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-15T19:36:02.705174] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:36:03.185276] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:36:03.314000] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-15T19:36:04.113976] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-15T19:36:04.426407] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T19:36:04.455219] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T19:36:04.914016] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-15T19:36:05.664964] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T19:36:05.713947] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-15T19:36:06.513983] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-15T19:36:06.805509] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T19:36:06.811958] [INFO ] [REMOTE ] INFY: Full fetch complete (77734 records). [2025-10-15T19:36:06.812077] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-15T19:36:07.201498] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-15T19:36:07.201606] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-15T19:36:07.202767] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-15T19:36:07.202872] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-15T19:36:07.204323] [DEBUG] [LOCAL ] INFY: Trimmed 77734 records to 53597 (keeping 200 days of data) [2025-10-15T19:36:07.320748] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-15T19:36:07.469024] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:36:07.570319] [DEBUG] [LOCAL ] INFY: Primary data saved (53597 records). [2025-10-15T19:36:07.570444] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-15T19:36:07.570520] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFY took 31.6s. Estimated remaining: 2h 57m 36s. Rate: 7.1 symbols/min [2025-10-15T19:36:07.756056] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:07.777998] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T19:36:07.819348] [DEBUG] [LOCAL ] INN: Loaded 41782 existing records from primary storage. [2025-10-15T19:36:07.819615] [INFO ] [MAIN ] INN: Loaded 41782 existing records. [2025-10-15T19:36:07.990927] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:07.991112] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-15T19:36:07.991157] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-15T19:36:07.991503] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-15T19:36:07.991558] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-15T19:36:08.126466] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-15T19:36:08.341321] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:08.552352] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:36:08.914055] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-15T19:36:09.713984] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-15T19:36:09.953797] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:36:10.320133] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T19:36:10.514001] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-15T19:36:11.104615] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T19:36:11.313993] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-15T19:36:12.113961] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-15T19:36:12.158437] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T19:36:12.587061] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:36:12.914043] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-15T19:36:13.347480] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:36:13.713981] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-15T19:36:14.217249] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:36:14.514004] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-15T19:36:14.665127] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:36:15.314051] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-15T19:36:15.816595] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T19:36:16.114012] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-15T19:36:16.214936] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T19:36:16.914035] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-15T19:36:17.601415] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T19:36:17.713993] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-15T19:36:18.512041] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T19:36:18.518750] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-15T19:36:19.313969] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-15T19:36:19.414508] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T19:36:19.420806] [INFO ] [REMOTE ] ING: Full fetch complete (73797 records). [2025-10-15T19:36:19.420925] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-15T19:36:19.832473] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:36:19.836154] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-15T19:36:19.836229] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-15T19:36:19.842507] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-15T19:36:19.842838] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-15T19:36:19.844491] [DEBUG] [LOCAL ] ING: Trimmed 73797 records to 50732 (keeping 200 days of data) [2025-10-15T19:36:20.117454] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-15T19:36:20.150315] [DEBUG] [LOCAL ] ING: Primary data saved (50732 records). [2025-10-15T19:36:20.150400] [INFO ] [MAIN ] ING: Full history saved. [2025-10-15T19:36:20.151453] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. ING took 31.5s. Estimated remaining: 2h 57m 32s. Rate: 7.1 symbols/min [2025-10-15T19:36:20.316121] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:20.316250] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-15T19:36:20.316286] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-15T19:36:20.316391] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-15T19:36:20.316431] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-15T19:36:20.316471] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-15T19:36:20.316502] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-15T19:36:20.662903] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:20.689571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:36:20.913971] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-15T19:36:21.107944] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:36:21.108283] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-15T19:36:21.108367] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:36:21.108417] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-15T19:36:21.108478] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:36:21.108547] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-15T19:36:21.108607] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-15T19:36:21.108663] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-15T19:36:21.108730] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-15T19:36:21.108777] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INR took 1.0s. Estimated remaining: 2h 57m 15s. Rate: 7.1 symbols/min [2025-10-15T19:36:21.276455] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:21.316132] [DEBUG] [LOCAL ] INSP: Loaded 38215 existing records from primary storage. [2025-10-15T19:36:21.316389] [INFO ] [MAIN ] INSP: Loaded 38215 existing records. [2025-10-15T19:36:21.491369] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:21.491580] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-15T19:36:21.491677] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-15T19:36:21.492468] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-15T19:36:21.492525] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-15T19:36:21.687867] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:36:21.717024] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-15T19:36:21.910891] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:22.513998] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-15T19:36:23.147170] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:36:23.313999] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-15T19:36:23.736523] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T19:36:24.113996] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-15T19:36:24.690714] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:36:24.913968] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-15T19:36:25.400697] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T19:36:25.714042] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-15T19:36:26.458286] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:36:26.513957] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-15T19:36:26.990502] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T19:36:27.313990] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-15T19:36:28.112072] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:36:28.120902] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-15T19:36:28.373174] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T19:36:28.913968] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-15T19:36:29.029901] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T19:36:29.714065] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-15T19:36:30.366418] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T19:36:30.514013] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-15T19:36:30.907088] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T19:36:30.911750] [INFO ] [REMOTE ] INGM: Full fetch complete (42000 records). [2025-10-15T19:36:30.911895] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-15T19:36:31.319198] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-15T19:36:31.321137] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-15T19:36:31.321267] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-15T19:36:31.323185] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-15T19:36:31.323370] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-15T19:36:31.324805] [DEBUG] [LOCAL ] INGM: Trimmed 42000 records to 28330 (keeping 200 days of data) [2025-10-15T19:36:31.509058] [DEBUG] [LOCAL ] INGM: Primary data saved (28330 records). [2025-10-15T19:36:31.509287] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-15T19:36:31.509525] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. INGM took 38.7s. Estimated remaining: 2h 57m 9s. Rate: 7.1 symbols/min [2025-10-15T19:36:31.708261] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:31.755352] [DEBUG] [LOCAL ] INSW: Loaded 39628 existing records from primary storage. [2025-10-15T19:36:31.755828] [INFO ] [MAIN ] INSW: Loaded 39628 existing records. [2025-10-15T19:36:31.956195] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:31.956532] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-15T19:36:31.956675] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-15T19:36:31.957075] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-15T19:36:31.957137] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-15T19:36:32.131446] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-15T19:36:32.321731] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T19:36:32.341497] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:32.864953] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:36:32.913960] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-15T19:36:33.674697] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:36:33.713961] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-15T19:36:34.152471] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T19:36:34.514006] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-15T19:36:35.101151] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T19:36:35.313959] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-15T19:36:35.454686] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T19:36:36.113993] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-15T19:36:36.833938] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T19:36:36.838843] [INFO ] [REMOTE ] INGR: Full fetch complete (50622 records). [2025-10-15T19:36:36.838975] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-15T19:36:36.919090] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-15T19:36:37.242261] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-15T19:36:37.242359] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-15T19:36:37.243365] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-15T19:36:37.243432] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-15T19:36:37.244626] [DEBUG] [LOCAL ] INGR: Trimmed 50622 records to 33816 (keeping 200 days of data) [2025-10-15T19:36:37.453904] [DEBUG] [LOCAL ] INGR: Primary data saved (33816 records). [2025-10-15T19:36:37.454102] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-15T19:36:37.454521] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INGR took 42.3s. Estimated remaining: 2h 56m 58s. Rate: 7.1 symbols/min [2025-10-15T19:36:37.640437] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:37.661292] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T19:36:37.716373] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-15T19:36:37.718668] [DEBUG] [LOCAL ] INVH: Loaded 53185 existing records from primary storage. [2025-10-15T19:36:37.719016] [INFO ] [MAIN ] INVH: Loaded 53185 existing records. [2025-10-15T19:36:37.907334] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:37.907495] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-15T19:36:37.907544] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-15T19:36:37.908110] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-15T19:36:37.908169] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-15T19:36:38.283164] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:38.374943] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:36:38.379593] [INFO ] [REMOTE ] INN: Full fetch complete (57796 records). [2025-10-15T19:36:38.379712] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-15T19:36:38.519119] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-15T19:36:38.789429] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-15T19:36:38.789529] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-15T19:36:38.790464] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-15T19:36:38.790536] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-15T19:36:38.791910] [DEBUG] [LOCAL ] INN: Trimmed 57796 records to 41819 (keeping 200 days of data) [2025-10-15T19:36:39.032053] [DEBUG] [LOCAL ] INN: Primary data saved (41819 records). [2025-10-15T19:36:39.032169] [INFO ] [MAIN ] INN: Full history saved. [2025-10-15T19:36:39.032244] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INN took 31.5s. Estimated remaining: 2h 56m 42s. Rate: 7.1 symbols/min [2025-10-15T19:36:39.204117] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:39.231508] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:36:39.264963] [DEBUG] [LOCAL ] INVX: Loaded 29342 existing records from primary storage. [2025-10-15T19:36:39.265232] [INFO ] [MAIN ] INVX: Loaded 29342 existing records. [2025-10-15T19:36:39.326154] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-15T19:36:39.441931] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:39.442253] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-15T19:36:39.442363] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-15T19:36:39.442612] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-15T19:36:39.442709] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-15T19:36:39.711511] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T19:36:39.820764] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:40.114046] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-15T19:36:40.822931] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:36:40.913965] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-15T19:36:41.582715] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:36:41.714045] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-15T19:36:42.498767] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:36:42.513956] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-15T19:36:43.240251] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:36:43.313958] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-15T19:36:44.109827] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:36:44.117744] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-15T19:36:44.552149] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T19:36:44.913999] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-15T19:36:45.377846] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T19:36:45.713997] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-15T19:36:46.514111] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-15T19:36:46.800259] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:36:47.314112] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-15T19:36:47.387571] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:36:48.114013] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-15T19:36:48.303660] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:36:48.448678] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:36:48.914013] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-15T19:36:49.704480] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:36:49.714095] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-15T19:36:50.408948] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T19:36:50.513971] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-15T19:36:51.231391] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:36:51.313978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-15T19:36:51.879366] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T19:36:52.114029] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-15T19:36:52.893888] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:36:52.913951] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-15T19:36:52.961106] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T19:36:53.713994] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-15T19:36:54.460793] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:36:54.513985] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-15T19:36:55.314009] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-15T19:36:55.462411] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:36:55.786417] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T19:36:56.113990] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-15T19:36:56.914020] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-15T19:36:56.984477] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T19:36:57.051412] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:36:57.714065] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-15T19:36:58.325305] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:36:58.514028] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-15T19:36:59.118170] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:36:59.314025] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-15T19:37:00.113621] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:37:00.118451] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-15T19:37:00.119863] [INFO ] [REMOTE ] INSP: Full fetch complete (53637 records). [2025-10-15T19:37:00.119937] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-15T19:37:00.506462] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-15T19:37:00.506563] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-15T19:37:00.507561] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-15T19:37:00.507683] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-15T19:37:00.509084] [DEBUG] [LOCAL ] INSP: Trimmed 53637 records to 38333 (keeping 200 days of data) [2025-10-15T19:37:00.530732] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T19:37:00.763270] [DEBUG] [LOCAL ] INSP: Primary data saved (38333 records). [2025-10-15T19:37:00.763401] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-15T19:37:00.763480] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 39.7s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-15T19:37:00.916157] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-15T19:37:00.936545] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:00.990266] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-15T19:37:00.990610] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-15T19:37:01.203116] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:01.203545] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-15T19:37:01.203673] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-15T19:37:01.204761] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-15T19:37:01.204821] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-15T19:37:01.607814] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:01.601967] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:37:01.714044] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-15T19:37:02.513979] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-15T19:37:02.723540] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:37:02.752601] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:37:03.313991] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-15T19:37:04.114000] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-15T19:37:04.624536] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:37:04.835864] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-15T19:37:04.914023] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-15T19:37:05.713987] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-15T19:37:05.866385] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T19:37:06.169798] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:37:06.513996] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-15T19:37:06.840154] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:37:06.844932] [INFO ] [REMOTE ] INSW: Full fetch complete (59996 records). [2025-10-15T19:37:06.845045] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-15T19:37:07.216956] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-15T19:37:07.217043] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-15T19:37:07.217963] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-15T19:37:07.218027] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-15T19:37:07.219265] [DEBUG] [LOCAL ] INSW: Trimmed 59996 records to 39595 (keeping 200 days of data) [2025-10-15T19:37:07.313999] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-15T19:37:07.475054] [DEBUG] [LOCAL ] INSW: Primary data saved (39595 records). [2025-10-15T19:37:07.475206] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-15T19:37:07.475314] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSW took 36.0s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-15T19:37:07.642836] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:07.687616] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T19:37:07.717344] [DEBUG] [LOCAL ] IOT: Loaded 53480 existing records from primary storage. [2025-10-15T19:37:07.717728] [INFO ] [MAIN ] IOT: Loaded 53480 existing records. [2025-10-15T19:37:07.889921] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:07.890112] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-15T19:37:07.890158] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-15T19:37:07.890674] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-15T19:37:07.890732] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-15T19:37:08.121698] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-15T19:37:08.235875] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:08.913984] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-15T19:37:09.212126] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-15T19:37:09.218637] [INFO ] [REMOTE ] INVH: Full fetch complete (76940 records). [2025-10-15T19:37:09.218830] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-15T19:37:09.585482] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:37:09.631018] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-15T19:37:09.631111] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-15T19:37:09.632343] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-15T19:37:09.632551] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-15T19:37:09.632478] [INFO ] [REMOTE ] INVX: Full fetch complete (43359 records). [2025-10-15T19:37:09.632712] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-15T19:37:09.720627] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-15T19:37:09.738501] [DEBUG] [LOCAL ] INVH: Trimmed 76940 records to 53197 (keeping 200 days of data) [2025-10-15T19:37:10.118256] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-15T19:37:10.118959] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-15T19:37:10.119916] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-15T19:37:10.120255] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-15T19:37:10.123691] [DEBUG] [LOCAL ] INVX: Trimmed 43359 records to 29342 (keeping 200 days of data) [2025-10-15T19:37:10.314905] [DEBUG] [LOCAL ] INVX: Primary data saved (29342 records). [2025-10-15T19:37:10.315093] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-15T19:37:10.315187] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INVX took 31.3s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-15T19:37:10.586445] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:10.710518] [DEBUG] [LOCAL ] IP: Loaded 53311 existing records from primary storage. [2025-10-15T19:37:10.712575] [INFO ] [MAIN ] IP: Loaded 53311 existing records. [2025-10-15T19:37:10.903400] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:10.906974] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-15T19:37:10.907346] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-15T19:37:10.908752] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-15T19:37:10.909596] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-15T19:37:11.017152] [DEBUG] [LOCAL ] INVH: Primary data saved (53197 records). [2025-10-15T19:37:11.027938] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-15T19:37:11.061388] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVH took 33.6s. Estimated remaining: 2h 56m 6s. Rate: 7.1 symbols/min [2025-10-15T19:37:11.280312] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:11.280744] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-15T19:37:11.482596] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-15T19:37:11.493878] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-15T19:37:11.559264] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:37:12.113997] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-15T19:37:13.230350] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-15T19:37:13.241105] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-15T19:37:13.928995] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T19:37:13.940296] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-15T19:37:13.968757] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-15T19:37:14.514058] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-15T19:37:14.968819] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T19:37:15.314008] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-15T19:37:15.755318] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T19:37:16.113995] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-15T19:37:16.915181] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-15T19:37:16.926971] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-15T19:37:16.989392] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T19:37:17.723724] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-15T19:37:17.726897] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:37:18.514046] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-15T19:37:19.600556] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-15T19:37:19.612401] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-15T19:37:19.674534] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T19:37:20.114058] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-15T19:37:20.377596] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T19:37:20.914052] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-15T19:37:21.933086] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:37:21.944563] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-15T19:37:22.021511] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-15T19:37:22.514020] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-15T19:37:22.681733] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T19:37:23.313978] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-15T19:37:23.692355] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:37:24.113993] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-15T19:37:25.007115] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-15T19:37:25.018454] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-15T19:37:25.062170] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:37:25.713958] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-15T19:37:25.842809] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T19:37:26.514104] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-15T19:37:27.659805] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T19:37:27.671924] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-15T19:37:27.746913] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-15T19:37:28.113962] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-15T19:37:28.376152] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T19:37:28.914048] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-15T19:37:29.647565] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T19:37:29.713971] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-15T19:37:30.290288] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:37:30.513970] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-15T19:37:30.806685] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-15T19:37:31.314049] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-15T19:37:31.747065] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T19:37:32.071885] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:37:32.113952] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-15T19:37:32.913993] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-15T19:37:33.958881] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T19:37:33.965674] [INFO ] [REMOTE ] IP: Full fetch complete (77370 records). [2025-10-15T19:37:33.965896] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-15T19:37:34.149224] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-15T19:37:34.244803] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-15T19:37:34.411958] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-15T19:37:34.412163] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-15T19:37:34.413229] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-15T19:37:34.413354] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-15T19:37:34.415233] [DEBUG] [LOCAL ] IP: Trimmed 77370 records to 53307 (keeping 200 days of data) [2025-10-15T19:37:34.524280] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T19:37:34.535885] [INFO ] [REMOTE ] IOT: Full fetch complete (77550 records). [2025-10-15T19:37:34.537967] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-15T19:37:35.064673] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-15T19:37:35.065348] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-15T19:37:35.067073] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-15T19:37:35.067151] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-15T19:37:35.074054] [DEBUG] [LOCAL ] IOT: Trimmed 77550 records to 53480 (keeping 200 days of data) [2025-10-15T19:37:35.414005] [DEBUG] [LOCAL ] IP: Primary data saved (53307 records). [2025-10-15T19:37:35.415223] [INFO ] [MAIN ] IP: Full history saved. [2025-10-15T19:37:35.416851] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IP took 25.1s. Estimated remaining: 2h 56m 15s. Rate: 7.1 symbols/min [2025-10-15T19:37:35.499639] [DEBUG] [LOCAL ] IOT: Primary data saved (53480 records). [2025-10-15T19:37:35.499820] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-15T19:37:35.499902] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IOT took 28.0s. Estimated remaining: 2h 55m 57s. Rate: 7.1 symbols/min [2025-10-15T19:37:37.236145] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-15T19:37:37.243265] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-15T19:37:37.243460] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-15T19:37:37.639818] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-15T19:37:37.639894] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-15T19:37:37.640992] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-15T19:37:37.641059] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-15T19:37:37.642530] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-15T19:37:37.960209] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-15T19:37:37.960338] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-15T19:37:37.961175] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IONQ took 37.2s. Estimated remaining: 2h 55m 42s. Rate: 7.1 symbols/min [2025-10-15T19:37:38.575320] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.708526] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.707215] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.710172] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.741336] [DEBUG] [LOCAL ] IQI: Loaded 17823 existing records from primary storage. [2025-10-15T19:37:38.741977] [INFO ] [MAIN ] IQI: Loaded 17823 existing records. [2025-10-15T19:37:38.846452] [DEBUG] [LOCAL ] IPI: Loaded 21301 existing records from primary storage. [2025-10-15T19:37:38.893728] [INFO ] [MAIN ] IPI: Loaded 21301 existing records. [2025-10-15T19:37:39.107871] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-10-15T19:37:39.151931] [DEBUG] [LOCAL ] IQV: Loaded 50084 existing records from primary storage. [2025-10-15T19:37:39.171067] [INFO ] [MAIN ] IQV: Loaded 50084 existing records. [2025-10-15T19:37:39.204210] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:39.165253] [INFO ] [MAIN ] IPG: Loaded 53331 existing records. [2025-10-15T19:37:39.204733] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-15T19:37:39.238180] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-15T19:37:39.290041] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-15T19:37:39.312470] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-15T19:37:39.810547] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:39.970343] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:39.956622] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-15T19:37:39.991213] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-15T19:37:40.029324] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-15T19:37:40.050148] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-15T19:37:40.044047] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-15T19:37:40.067977] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-15T19:37:40.074499] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-15T19:37:40.077941] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:40.074452] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-15T19:37:40.086680] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-15T19:37:40.099252] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-15T19:37:40.264305] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-15T19:37:40.298736] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-15T19:37:40.905698] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.004772] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-15T19:37:41.256891] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.279212] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-15T19:37:41.329884] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.344244] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-15T19:37:41.435384] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.435677] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-15T19:37:42.111734] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:37:42.116737] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-15T19:37:42.140884] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T19:37:42.144847] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-15T19:37:42.916048] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:37:42.919869] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-15T19:37:43.131877] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T19:37:43.136638] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-15T19:37:43.312887] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T19:37:43.323898] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-15T19:37:43.426434] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T19:37:43.436492] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-15T19:37:43.766137] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T19:37:43.771082] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-15T19:37:43.957042] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:37:43.961173] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-15T19:37:44.401720] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T19:37:44.405596] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-15T19:37:44.617371] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T19:37:44.791312] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T19:37:44.913988] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-15T19:37:45.097406] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:37:45.168741] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:37:45.713980] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-15T19:37:45.970001] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T19:37:46.513956] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-15T19:37:46.745738] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:37:47.314057] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-15T19:37:47.837167] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T19:37:48.114020] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-15T19:37:48.643574] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T19:37:48.914035] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-15T19:37:49.713965] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-15T19:37:49.744044] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:37:49.837302] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T19:37:50.513975] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-15T19:37:50.881910] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T19:37:51.314083] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-15T19:37:52.076282] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T19:37:52.113961] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-15T19:37:52.271836] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:37:52.913969] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-15T19:37:53.139023] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T19:37:53.713972] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-15T19:37:53.901899] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:37:54.514047] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-15T19:37:55.127705] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T19:37:55.313983] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-15T19:37:56.114031] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-15T19:37:56.319699] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:37:56.913971] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-15T19:37:57.025087] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:37:57.126771] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T19:37:57.607015] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:37:57.713985] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-15T19:37:58.513995] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-15T19:37:59.320733] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-15T19:37:59.341827] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:37:59.534486] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T19:38:00.113994] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-15T19:38:00.455487] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:38:00.457858] [INFO ] [REMOTE ] IQI: Full fetch complete (26607 records). [2025-10-15T19:38:00.457932] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-15T19:38:00.841021] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-15T19:38:00.841099] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-15T19:38:00.841738] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-15T19:38:00.841801] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-15T19:38:00.842461] [DEBUG] [LOCAL ] IQI: Trimmed 26607 records to 17837 (keeping 200 days of data) [2025-10-15T19:38:00.921577] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-15T19:38:00.954546] [DEBUG] [LOCAL ] IQI: Primary data saved (17837 records). [2025-10-15T19:38:00.954719] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-15T19:38:00.954814] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 23.0s. Estimated remaining: 2h 55m 50s. Rate: 7.1 symbols/min [2025-10-15T19:38:01.133632] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:01.192335] [DEBUG] [LOCAL ] IR: Loaded 52781 existing records from primary storage. [2025-10-15T19:38:01.192733] [INFO ] [MAIN ] IR: Loaded 52781 existing records. [2025-10-15T19:38:01.392595] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:38:01.396864] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:01.402178] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-15T19:38:01.402245] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-15T19:38:01.403498] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-15T19:38:01.403563] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-15T19:38:01.722464] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-15T19:38:01.762374] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:02.513974] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-15T19:38:02.796754] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T19:38:03.080990] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T19:38:03.314024] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-15T19:38:03.525382] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:38:03.528610] [INFO ] [REMOTE ] IPI: Full fetch complete (29916 records). [2025-10-15T19:38:03.528715] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-15T19:38:03.905717] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-15T19:38:03.905804] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-15T19:38:03.906489] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-15T19:38:03.906532] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-15T19:38:03.907296] [DEBUG] [LOCAL ] IPI: Trimmed 29916 records to 21357 (keeping 200 days of data) [2025-10-15T19:38:04.030792] [DEBUG] [LOCAL ] IPI: Primary data saved (21357 records). [2025-10-15T19:38:04.030914] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-15T19:38:04.030990] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPI took 26.1s. Estimated remaining: 2h 55m 36s. Rate: 7.1 symbols/min [2025-10-15T19:38:04.122160] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-15T19:38:04.203302] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:04.247323] [DEBUG] [LOCAL ] IRM: Loaded 49163 existing records from primary storage. [2025-10-15T19:38:04.247673] [INFO ] [MAIN ] IRM: Loaded 49163 existing records. [2025-10-15T19:38:04.448144] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:04.448387] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-15T19:38:04.448437] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-15T19:38:04.449292] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-15T19:38:04.449351] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-15T19:38:04.815293] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:04.884348] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:38:04.913961] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-15T19:38:05.714022] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-15T19:38:05.803061] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T19:38:06.514004] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-15T19:38:06.578846] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:38:07.039695] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:38:07.313998] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-15T19:38:08.113984] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-15T19:38:08.160877] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T19:38:08.871461] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T19:38:08.877396] [INFO ] [REMOTE ] IQV: Full fetch complete (72347 records). [2025-10-15T19:38:08.877516] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-15T19:38:08.919368] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-15T19:38:09.278518] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-15T19:38:09.278737] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-15T19:38:09.279924] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-15T19:38:09.280032] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-15T19:38:09.281929] [DEBUG] [LOCAL ] IQV: Trimmed 72347 records to 50051 (keeping 200 days of data) [2025-10-15T19:38:09.399283] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T19:38:09.653232] [DEBUG] [LOCAL ] IQV: Primary data saved (50051 records). [2025-10-15T19:38:09.653372] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-15T19:38:09.653451] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IQV took 31.7s. Estimated remaining: 2h 55m 24s. Rate: 7.1 symbols/min [2025-10-15T19:38:09.723739] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-15T19:38:09.840369] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:09.861946] [DEBUG] [LOCAL ] IRS: Loaded 22985 existing records from primary storage. [2025-10-15T19:38:09.862197] [INFO ] [MAIN ] IRS: Loaded 22985 existing records. [2025-10-15T19:38:10.048969] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:10.049172] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-15T19:38:10.049218] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-15T19:38:10.049911] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-15T19:38:10.049968] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-15T19:38:10.409030] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:10.513965] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-15T19:38:10.548776] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T19:38:11.314007] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-15T19:38:11.460270] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:38:11.719293] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:38:12.114015] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-15T19:38:12.877188] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:38:12.914022] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-15T19:38:13.713972] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-15T19:38:13.836051] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T19:38:14.514080] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-15T19:38:14.744239] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:38:14.811998] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T19:38:15.314059] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-15T19:38:16.022521] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:38:16.114005] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-15T19:38:16.914024] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-15T19:38:16.989845] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:38:17.095141] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:38:17.714035] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-15T19:38:18.400376] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:38:18.513993] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-15T19:38:18.740672] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T19:38:19.313973] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-15T19:38:19.564444] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T19:38:20.114091] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-15T19:38:20.913985] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-15T19:38:21.022063] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:38:21.713987] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-15T19:38:21.903928] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:38:21.949157] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:38:22.514052] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-15T19:38:23.314026] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-15T19:38:23.602963] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T19:38:23.609992] [INFO ] [REMOTE ] IPG: Full fetch complete (77429 records). [2025-10-15T19:38:23.610127] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-15T19:38:24.055685] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-15T19:38:24.055919] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-15T19:38:24.057391] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-15T19:38:24.057767] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-15T19:38:24.072078] [DEBUG] [LOCAL ] IPG: Trimmed 77429 records to 53331 (keeping 200 days of data) [2025-10-15T19:38:24.074709] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T19:38:24.136482] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-15T19:38:24.234834] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T19:38:24.480171] [DEBUG] [LOCAL ] IPG: Primary data saved (53331 records). [2025-10-15T19:38:24.480342] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-15T19:38:24.480799] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IPG took 46.5s. Estimated remaining: 2h 55m 23s. Rate: 7.1 symbols/min [2025-10-15T19:38:24.650768] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:24.699461] [DEBUG] [LOCAL ] IRT: Loaded 50569 existing records from primary storage. [2025-10-15T19:38:24.699810] [INFO ] [MAIN ] IRT: Loaded 50569 existing records. [2025-10-15T19:38:24.871124] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:24.871343] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-15T19:38:24.871390] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-15T19:38:24.872375] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-15T19:38:24.872432] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-15T19:38:24.924793] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-15T19:38:25.256164] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:25.713981] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-15T19:38:25.971131] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T19:38:26.513972] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-15T19:38:26.609477] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:38:26.858547] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:38:27.313997] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-15T19:38:28.083363] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T19:38:28.113953] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-15T19:38:28.359270] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:38:28.914007] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-15T19:38:29.713987] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-15T19:38:30.011082] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:38:30.514067] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-15T19:38:30.604490] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T19:38:31.172708] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T19:38:31.314014] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-15T19:38:31.616889] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T19:38:32.114008] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-15T19:38:32.531786] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T19:38:32.914013] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-15T19:38:33.035302] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:38:33.713973] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-15T19:38:34.514015] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-15T19:38:34.633227] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:38:34.798877] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:38:34.803122] [INFO ] [REMOTE ] IRS: Full fetch complete (32728 records). [2025-10-15T19:38:34.803309] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-15T19:38:35.202866] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-15T19:38:35.202969] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-15T19:38:35.203701] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-15T19:38:35.203790] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-15T19:38:35.204875] [DEBUG] [LOCAL ] IRS: Trimmed 32728 records to 23063 (keeping 200 days of data) [2025-10-15T19:38:35.314120] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-15T19:38:35.343564] [DEBUG] [LOCAL ] IRS: Primary data saved (23063 records). [2025-10-15T19:38:35.344233] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-15T19:38:35.344358] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IRS took 25.7s. Estimated remaining: 2h 55m 17s. Rate: 7.1 symbols/min [2025-10-15T19:38:35.515304] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:35.533205] [DEBUG] [LOCAL ] ISD: Loaded 15926 existing records from primary storage. [2025-10-15T19:38:35.533498] [INFO ] [MAIN ] ISD: Loaded 15926 existing records. [2025-10-15T19:38:35.708871] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:35.709086] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-15T19:38:35.709134] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-15T19:38:35.709543] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-15T19:38:35.709601] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-15T19:38:36.072859] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:36.107492] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:38:36.118790] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-15T19:38:36.913955] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-15T19:38:37.030885] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:38:37.224976] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:38:37.714037] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-15T19:38:38.484553] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T19:38:38.512701] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T19:38:38.517418] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-15T19:38:39.314007] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-15T19:38:40.114018] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-15T19:38:40.176320] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:38:40.914034] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-15T19:38:41.176443] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T19:38:41.183183] [INFO ] [REMOTE ] IR: Full fetch complete (76451 records). [2025-10-15T19:38:41.183331] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-15T19:38:41.579570] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-15T19:38:41.579684] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-15T19:38:41.580762] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-15T19:38:41.580823] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-15T19:38:41.582265] [DEBUG] [LOCAL ] IR: Trimmed 76451 records to 52780 (keeping 200 days of data) [2025-10-15T19:38:41.760321] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-15T19:38:41.833069] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T19:38:41.950215] [DEBUG] [LOCAL ] IR: Primary data saved (52780 records). [2025-10-15T19:38:41.950352] [INFO ] [MAIN ] IR: Full history saved. [2025-10-15T19:38:41.950436] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IR took 41.0s. Estimated remaining: 2h 55m 6s. Rate: 7.1 symbols/min [2025-10-15T19:38:42.114210] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:42.153815] [DEBUG] [LOCAL ] IT: Loaded 42200 existing records from primary storage. [2025-10-15T19:38:42.154095] [INFO ] [MAIN ] IT: Loaded 42200 existing records. [2025-10-15T19:38:42.332341] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:42.332676] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-15T19:38:42.332786] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-15T19:38:42.348489] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-15T19:38:42.348659] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-15T19:38:42.375001] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:38:42.423174] [INFO ] [REMOTE ] IRM: Full fetch complete (72331 records). [2025-10-15T19:38:42.461415] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-15T19:38:42.525933] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-15T19:38:42.577904] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T19:38:43.004040] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:43.130757] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-15T19:38:43.130837] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-15T19:38:43.131781] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-15T19:38:43.131843] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-15T19:38:43.133158] [DEBUG] [LOCAL ] IRM: Trimmed 72331 records to 49144 (keeping 200 days of data) [2025-10-15T19:38:43.318074] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-15T19:38:43.436639] [DEBUG] [LOCAL ] IRM: Primary data saved (49144 records). [2025-10-15T19:38:43.436852] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-15T19:38:43.436964] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRM took 39.4s. Estimated remaining: 2h 54m 50s. Rate: 7.1 symbols/min [2025-10-15T19:38:43.602446] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:43.634625] [DEBUG] [LOCAL ] ITGR: Loaded 31233 existing records from primary storage. [2025-10-15T19:38:43.634912] [INFO ] [MAIN ] ITGR: Loaded 31233 existing records. [2025-10-15T19:38:43.807756] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:43.807941] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-15T19:38:43.807987] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-15T19:38:43.808615] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-15T19:38:43.808705] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-15T19:38:44.122859] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-15T19:38:44.165914] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:44.272598] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:38:44.666962] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:38:44.913951] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-15T19:38:45.153453] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T19:38:45.713991] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-15T19:38:46.358429] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T19:38:46.513997] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-15T19:38:46.997990] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T19:38:47.314076] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-15T19:38:47.938195] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:38:48.113995] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-15T19:38:48.516702] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T19:38:48.913992] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-15T19:38:49.547022] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:38:49.714001] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-15T19:38:49.792704] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T19:38:50.519089] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-15T19:38:50.527594] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T19:38:51.314048] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-15T19:38:52.114792] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-15T19:38:52.120116] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T19:38:52.500531] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T19:38:52.913974] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-15T19:38:53.236667] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T19:38:53.714017] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-15T19:38:54.519254] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-15T19:38:54.537624] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:38:54.645682] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T19:38:55.313992] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-15T19:38:55.852302] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T19:38:56.114059] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-15T19:38:56.913991] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-15T19:38:57.012697] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T19:38:57.508609] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T19:38:57.713997] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-15T19:38:58.001085] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T19:38:58.514001] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-15T19:38:58.959427] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T19:38:59.314010] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-15T19:38:59.508629] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:39:00.113963] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-15T19:39:00.282309] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T19:39:00.913995] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-15T19:39:01.035468] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:39:01.714054] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-15T19:39:02.449672] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:39:02.514005] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-15T19:39:03.068322] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:39:03.314020] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-15T19:39:04.017333] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:39:04.113963] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-15T19:39:04.426526] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T19:39:04.914027] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-15T19:39:05.713993] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-15T19:39:05.742525] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:39:05.875889] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:39:06.513958] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-15T19:39:06.985303] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T19:39:07.314019] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-15T19:39:07.482167] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:39:08.114029] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-15T19:39:08.913987] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-15T19:39:08.949192] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:39:08.951842] [INFO ] [REMOTE ] ISD: Full fetch complete (24068 records). [2025-10-15T19:39:08.951934] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-15T19:39:09.193421] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:39:09.268854] [INFO ] [REMOTE ] IRT: Full fetch complete (72972 records). [2025-10-15T19:39:09.269379] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-15T19:39:09.458309] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-15T19:39:09.458419] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-15T19:39:09.459002] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-15T19:39:09.464796] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-15T19:39:09.510447] [DEBUG] [LOCAL ] ISD: Trimmed 24068 records to 15874 (keeping 200 days of data) [2025-10-15T19:39:09.729030] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-15T19:39:09.847775] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-15T19:39:09.848484] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-15T19:39:09.849951] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-15T19:39:09.850308] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-15T19:39:09.855716] [DEBUG] [LOCAL ] IRT: Trimmed 72972 records to 50567 (keeping 200 days of data) [2025-10-15T19:39:09.962257] [DEBUG] [LOCAL ] ISD: Primary data saved (15874 records). [2025-10-15T19:39:09.968013] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-15T19:39:09.968694] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. ISD took 34.6s. Estimated remaining: 2h 55m 2s. Rate: 7.1 symbols/min [2025-10-15T19:39:10.148891] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:10.292035] [DEBUG] [LOCAL ] ITT: Loaded 32739 existing records from primary storage. [2025-10-15T19:39:10.296173] [INFO ] [MAIN ] ITT: Loaded 32739 existing records. [2025-10-15T19:39:10.508887] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:10.539942] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-15T19:39:10.543386] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-15T19:39:10.547226] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-15T19:39:10.547054] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T19:39:10.557947] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-15T19:39:10.618419] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-15T19:39:10.833017] [DEBUG] [LOCAL ] IRT: Primary data saved (50567 records). [2025-10-15T19:39:10.849781] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-15T19:39:10.858094] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. IRT took 46.4s. Estimated remaining: 2h 54m 45s. Rate: 7.1 symbols/min [2025-10-15T19:39:11.124180] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:39:11.179284] [INFO ] [REMOTE ] ITGR: Full fetch complete (42705 records). [2025-10-15T19:39:11.263181] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-15T19:39:11.274554] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:11.270391] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:11.320850] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-15T19:39:11.652449] [DEBUG] [LOCAL ] ITUB: Loaded 53330 existing records from primary storage. [2025-10-15T19:39:11.689189] [INFO ] [MAIN ] ITUB: Loaded 53330 existing records. [2025-10-15T19:39:11.770175] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-15T19:39:11.782817] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-15T19:39:11.789088] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-15T19:39:11.802158] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-15T19:39:11.861821] [DEBUG] [LOCAL ] ITGR: Trimmed 42705 records to 31316 (keeping 200 days of data) [2025-10-15T19:39:11.901571] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:11.902408] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-15T19:39:11.902464] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-15T19:39:11.903530] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-15T19:39:11.903592] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-15T19:39:12.479347] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T19:39:12.509405] [INFO ] [REMOTE ] IT: Full fetch complete (57276 records). [2025-10-15T19:39:12.538814] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-15T19:39:12.560458] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:12.562591] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-15T19:39:12.636789] [DEBUG] [LOCAL ] ITGR: Primary data saved (31316 records). [2025-10-15T19:39:12.664726] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-15T19:39:12.670102] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. ITGR took 29.2s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-15T19:39:12.972823] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:39:13.028126] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-15T19:39:13.103742] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:13.215063] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-15T19:39:13.215292] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-15T19:39:13.217155] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-15T19:39:13.217248] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-15T19:39:13.219344] [DEBUG] [LOCAL ] IT: Trimmed 57276 records to 42223 (keeping 200 days of data) [2025-10-15T19:39:13.462504] [DEBUG] [LOCAL ] ITW: Loaded 45801 existing records from primary storage. [2025-10-15T19:39:13.468815] [INFO ] [MAIN ] ITW: Loaded 45801 existing records. [2025-10-15T19:39:13.649741] [DEBUG] [LOCAL ] IT: Primary data saved (42223 records). [2025-10-15T19:39:13.666912] [INFO ] [MAIN ] IT: Full history saved. [2025-10-15T19:39:13.667068] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. IT took 31.7s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-15T19:39:13.781739] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:13.819545] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-15T19:39:13.822601] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-15T19:39:13.844906] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-15T19:39:13.862529] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-15T19:39:13.960543] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:14.304750] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:14.307810] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-15T19:39:14.307190] [DEBUG] [LOCAL ] IVR: Loaded 48130 existing records from primary storage. [2025-10-15T19:39:14.309427] [INFO ] [MAIN ] IVR: Loaded 48130 existing records. [2025-10-15T19:39:14.497759] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:14.514296] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-15T19:39:14.514668] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-15T19:39:14.516142] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:39:14.522163] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-15T19:39:14.523208] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-15T19:39:14.524230] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-15T19:39:14.662316] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T19:39:14.926823] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:15.314028] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-15T19:39:15.940335] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T19:39:15.988327] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:39:16.114016] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-15T19:39:16.913982] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-15T19:39:17.109929] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T19:39:17.666462] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:39:17.713976] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-15T19:39:18.424629] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:39:18.514007] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-15T19:39:19.314045] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-15T19:39:19.402379] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:39:20.114002] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-15T19:39:20.215823] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T19:39:20.782311] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T19:39:20.913975] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-15T19:39:21.020154] [DEBUG] [REMOTE ] IVR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-15T19:39:21.020394] [WARN ] [REMOTE ] IVR: No data returned for month 2025-01 [2025-10-15T19:39:21.020481] [FATAL] [REMOTE ] IVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:39:21.020558] [FATAL] [MAIN ] IVR: Failed to fetch primary data. [2025-10-15T19:39:21.020620] [WARN ] [MAIN ] IVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:39:21.020712] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-15T19:39:21.020771] [DEBUG] [LOCAL ] IVR: No primary data file found to delete. [2025-10-15T19:39:21.020807] [INFO ] [LOCAL ] IVR: Starting deletion of derivative data. [2025-10-15T19:39:21.020949] [DEBUG] [LOCAL ] IVR: Deleted derivative data file. [2025-10-15T19:39:21.021034] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. IVR took 7.3s. Estimated remaining: 2h 54m 3s. Rate: 7.1 symbols/min [2025-10-15T19:39:21.197216] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:21.229736] [DEBUG] [LOCAL ] IVT: Loaded 31274 existing records from primary storage. [2025-10-15T19:39:21.230023] [INFO ] [MAIN ] IVT: Loaded 31274 existing records. [2025-10-15T19:39:21.410206] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:21.410530] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-15T19:39:21.410581] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-15T19:39:21.411265] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-15T19:39:21.411337] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-15T19:39:21.718024] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-15T19:39:21.803209] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:21.806795] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T19:39:22.513993] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-15T19:39:23.313999] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-15T19:39:23.414313] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:39:23.889686] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:39:24.113972] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-15T19:39:24.255038] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:39:24.914001] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-15T19:39:25.714011] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-15T19:39:25.910930] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T19:39:26.189886] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T19:39:26.514003] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-15T19:39:27.230303] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T19:39:27.313997] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-15T19:39:27.560064] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:39:28.114049] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-15T19:39:28.601891] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T19:39:28.914032] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-15T19:39:29.713973] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-15T19:39:29.820487] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:39:29.882617] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T19:39:30.513990] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-15T19:39:31.313967] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-15T19:39:31.353995] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:39:31.770732] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T19:39:32.113994] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-15T19:39:32.914010] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-15T19:39:33.061869] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:39:33.389409] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:39:33.714051] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-15T19:39:34.043791] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T19:39:34.514067] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-15T19:39:35.314046] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-15T19:39:35.422452] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T19:39:35.967333] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T19:39:36.113969] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-15T19:39:36.685131] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:39:36.689443] [INFO ] [REMOTE ] ITT: Full fetch complete (47275 records). [2025-10-15T19:39:36.689587] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-15T19:39:36.919186] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-15T19:39:37.088818] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-15T19:39:37.088940] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-15T19:39:37.090081] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-15T19:39:37.090303] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-15T19:39:37.091859] [DEBUG] [LOCAL ] ITT: Trimmed 47275 records to 32710 (keeping 200 days of data) [2025-10-15T19:39:37.112771] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T19:39:37.331886] [DEBUG] [LOCAL ] ITT: Primary data saved (32710 records). [2025-10-15T19:39:37.332035] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-15T19:39:37.332118] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITT took 27.4s. Estimated remaining: 2h 54m 3s. Rate: 7.1 symbols/min [2025-10-15T19:39:37.499712] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:37.550130] [DEBUG] [LOCAL ] IVZ: Loaded 53118 existing records from primary storage. [2025-10-15T19:39:37.550514] [INFO ] [MAIN ] IVZ: Loaded 53118 existing records. [2025-10-15T19:39:37.721160] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-15T19:39:37.725712] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:37.726909] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-15T19:39:37.726968] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-15T19:39:37.728189] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-15T19:39:37.728251] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-15T19:39:38.075104] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:38.514044] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-15T19:39:38.553291] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:39:39.314010] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-15T19:39:39.876455] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T19:39:40.034929] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:39:40.114016] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-15T19:39:40.599784] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:39:40.914068] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-15T19:39:41.713964] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-15T19:39:41.824949] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:39:41.901255] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:39:42.514009] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-15T19:39:43.319130] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-15T19:39:43.330098] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:39:43.927805] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T19:39:44.114025] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-15T19:39:44.632291] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T19:39:44.914071] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-15T19:39:45.389776] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T19:39:45.714040] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-15T19:39:46.515492] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-15T19:39:46.519549] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:39:47.313999] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-15T19:39:47.493413] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T19:39:48.095774] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:39:48.113977] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-15T19:39:48.692251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:39:48.697781] [INFO ] [REMOTE ] ITW: Full fetch complete (66674 records). [2025-10-15T19:39:48.697890] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-15T19:39:48.919175] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-15T19:39:49.080847] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-15T19:39:49.080918] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-15T19:39:49.082017] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-15T19:39:49.082082] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-15T19:39:49.083299] [DEBUG] [LOCAL ] ITW: Trimmed 66674 records to 45789 (keeping 200 days of data) [2025-10-15T19:39:49.376318] [DEBUG] [LOCAL ] ITW: Primary data saved (45789 records). [2025-10-15T19:39:49.376469] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-15T19:39:49.376550] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. ITW took 36.7s. Estimated remaining: 2h 53m 59s. Rate: 7.1 symbols/min [2025-10-15T19:39:49.546450] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:49.568209] [DEBUG] [LOCAL ] IX: Loaded 22281 existing records from primary storage. [2025-10-15T19:39:49.568455] [INFO ] [MAIN ] IX: Loaded 22281 existing records. [2025-10-15T19:39:49.719186] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-15T19:39:49.747785] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:49.748119] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-15T19:39:49.748245] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-15T19:39:49.748556] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-15T19:39:49.748611] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-15T19:39:50.106593] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:50.136172] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T19:39:50.324881] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T19:39:50.514019] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-15T19:39:51.260331] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T19:39:51.266761] [INFO ] [REMOTE ] ITUB: Full fetch complete (77322 records). [2025-10-15T19:39:51.266872] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-15T19:39:51.314002] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-15T19:39:51.614300] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:39:51.692384] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-15T19:39:51.692480] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-15T19:39:51.693565] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-15T19:39:51.693634] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-15T19:39:51.695206] [DEBUG] [LOCAL ] ITUB: Trimmed 77322 records to 53332 (keeping 200 days of data) [2025-10-15T19:39:52.004780] [DEBUG] [LOCAL ] ITUB: Primary data saved (53332 records). [2025-10-15T19:39:52.004926] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-15T19:39:52.005019] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. ITUB took 41.1s. Estimated remaining: 2h 53m 44s. Rate: 7.1 symbols/min [2025-10-15T19:39:52.119159] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-15T19:39:52.173690] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:52.215817] [DEBUG] [LOCAL ] J: Loaded 40309 existing records from primary storage. [2025-10-15T19:39:52.216095] [INFO ] [MAIN ] J: Loaded 40309 existing records. [2025-10-15T19:39:52.348264] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:39:52.402080] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:52.402280] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-15T19:39:52.402326] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-15T19:39:52.402736] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-15T19:39:52.402792] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-15T19:39:52.743559] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:52.913996] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-15T19:39:53.714085] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-15T19:39:53.930177] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:39:54.352012] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T19:39:54.513988] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-15T19:39:54.792265] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:39:54.796941] [INFO ] [REMOTE ] IVT: Full fetch complete (45942 records). [2025-10-15T19:39:54.797029] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-15T19:39:55.168388] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-15T19:39:55.168465] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-15T19:39:55.169268] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-15T19:39:55.169331] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-15T19:39:55.170279] [DEBUG] [LOCAL ] IVT: Trimmed 45942 records to 31347 (keeping 200 days of data) [2025-10-15T19:39:55.322892] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-15T19:39:55.363755] [DEBUG] [LOCAL ] IVT: Primary data saved (31347 records). [2025-10-15T19:39:55.363854] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-15T19:39:55.363928] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. IVT took 34.3s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-15T19:39:55.528468] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:55.568297] [DEBUG] [LOCAL ] JBGS: Loaded 42182 existing records from primary storage. [2025-10-15T19:39:55.568572] [INFO ] [MAIN ] JBGS: Loaded 42182 existing records. [2025-10-15T19:39:55.743505] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:55.743748] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-15T19:39:55.743811] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-15T19:39:55.744220] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-15T19:39:55.744261] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-15T19:39:55.991756] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:39:56.123838] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-15T19:39:56.123779] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:56.157887] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:39:56.892344] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T19:39:56.913948] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-15T19:39:57.713959] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-15T19:39:57.821365] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T19:39:58.514009] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-15T19:39:59.314002] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-15T19:39:59.430876] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T19:39:59.681093] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T19:40:00.113996] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-15T19:40:00.866560] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:40:00.913952] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-15T19:40:01.630732] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:40:01.714056] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-15T19:40:02.206533] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:40:02.514016] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-15T19:40:03.314005] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-15T19:40:03.540995] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:40:03.718664] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T19:40:04.114004] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-15T19:40:04.913976] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-15T19:40:05.006058] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:40:05.027816] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T19:40:05.713996] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-15T19:40:06.514006] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-15T19:40:06.646056] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:40:06.674148] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T19:40:07.314023] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-15T19:40:07.918978] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T19:40:08.114049] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-15T19:40:08.914049] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-15T19:40:09.001612] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:40:09.240457] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T19:40:09.714003] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-15T19:40:10.304739] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:40:10.394987] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T19:40:10.514009] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-15T19:40:11.314034] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-15T19:40:11.912244] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T19:40:12.043804] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T19:40:12.046586] [INFO ] [REMOTE ] IX: Full fetch complete (28159 records). [2025-10-15T19:40:12.046684] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-15T19:40:12.119189] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-15T19:40:12.419219] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-15T19:40:12.419298] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-15T19:40:12.419941] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-15T19:40:12.420002] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-15T19:40:12.420832] [DEBUG] [LOCAL ] IX: Trimmed 28159 records to 22281 (keeping 200 days of data) [2025-10-15T19:40:12.546634] [DEBUG] [LOCAL ] IX: Primary data saved (22281 records). [2025-10-15T19:40:12.546784] [INFO ] [MAIN ] IX: Full history saved. [2025-10-15T19:40:12.546862] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IX took 23.2s. Estimated remaining: 2h 53m 31s. Rate: 7.1 symbols/min [2025-10-15T19:40:12.710100] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:12.749541] [DEBUG] [LOCAL ] JBI: Loaded 43014 existing records from primary storage. [2025-10-15T19:40:12.749861] [INFO ] [MAIN ] JBI: Loaded 43014 existing records. [2025-10-15T19:40:12.930996] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-15T19:40:12.936730] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:12.937972] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-15T19:40:12.938043] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-15T19:40:12.938362] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-15T19:40:12.938433] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-15T19:40:13.292279] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:13.716237] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-15T19:40:13.719177] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T19:40:14.513985] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-15T19:40:14.543550] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:40:15.031562] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T19:40:15.314035] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-15T19:40:16.020792] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:40:16.113952] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-15T19:40:16.700718] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:40:16.913983] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-15T19:40:17.652092] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:40:17.713952] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-15T19:40:18.513966] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-15T19:40:18.594117] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:40:18.600512] [INFO ] [REMOTE ] IVZ: Full fetch complete (77016 records). [2025-10-15T19:40:18.600636] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-15T19:40:19.015232] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-15T19:40:19.015335] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-15T19:40:19.016481] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-15T19:40:19.016572] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-15T19:40:19.018183] [DEBUG] [LOCAL ] IVZ: Trimmed 77016 records to 53117 (keeping 200 days of data) [2025-10-15T19:40:19.267830] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:40:19.332698] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-15T19:40:19.380557] [DEBUG] [LOCAL ] IVZ: Primary data saved (53117 records). [2025-10-15T19:40:19.380704] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-15T19:40:19.381537] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IVZ took 42.0s. Estimated remaining: 2h 53m 21s. Rate: 7.1 symbols/min [2025-10-15T19:40:19.549612] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:19.596132] [DEBUG] [LOCAL ] JBL: Loaded 48360 existing records from primary storage. [2025-10-15T19:40:19.596605] [INFO ] [MAIN ] JBL: Loaded 48360 existing records. [2025-10-15T19:40:19.773824] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:19.774115] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-15T19:40:19.774189] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-15T19:40:19.775141] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-15T19:40:19.775201] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-15T19:40:20.147852] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-15T19:40:20.173451] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:20.167592] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T19:40:20.481893] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:40:20.914003] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-15T19:40:21.691555] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T19:40:21.713964] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-15T19:40:22.391783] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T19:40:22.513979] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-15T19:40:23.219442] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:40:23.314027] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-15T19:40:23.957038] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:40:23.961700] [INFO ] [REMOTE ] JBGS: Full fetch complete (59337 records). [2025-10-15T19:40:23.961811] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-15T19:40:24.135023] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-15T19:40:24.358256] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-15T19:40:24.358409] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-15T19:40:24.359357] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-15T19:40:24.359468] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-15T19:40:24.361140] [DEBUG] [LOCAL ] JBGS: Trimmed 59337 records to 42194 (keeping 200 days of data) [2025-10-15T19:40:24.458333] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T19:40:24.655140] [DEBUG] [LOCAL ] JBGS: Primary data saved (42194 records). [2025-10-15T19:40:24.655265] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-15T19:40:24.655342] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. JBGS took 29.3s. Estimated remaining: 2h 53m 9s. Rate: 7.1 symbols/min [2025-10-15T19:40:24.820723] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:24.844920] [DEBUG] [LOCAL ] JBND: Loaded 26794 existing records from primary storage. [2025-10-15T19:40:24.845201] [INFO ] [MAIN ] JBND: Loaded 26794 existing records. [2025-10-15T19:40:24.919128] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-15T19:40:25.020410] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:25.020581] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-15T19:40:25.020627] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-15T19:40:25.021265] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-15T19:40:25.021322] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-15T19:40:25.370920] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:25.713962] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-15T19:40:25.786921] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:40:26.084421] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T19:40:26.514013] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-15T19:40:27.300776] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:40:27.313950] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-15T19:40:27.576012] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T19:40:28.114037] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-15T19:40:28.761255] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:40:28.913962] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-15T19:40:29.060322] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:40:29.714045] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-15T19:40:30.514048] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-15T19:40:30.590571] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T19:40:30.839860] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T19:40:31.313995] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-15T19:40:32.091055] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:40:32.096375] [INFO ] [REMOTE ] J: Full fetch complete (59529 records). [2025-10-15T19:40:32.096486] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-15T19:40:32.119162] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-15T19:40:32.409691] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:40:32.498313] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-15T19:40:32.498391] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-15T19:40:32.499356] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-15T19:40:32.499419] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-15T19:40:32.500546] [DEBUG] [LOCAL ] J: Trimmed 59529 records to 40381 (keeping 200 days of data) [2025-10-15T19:40:32.743092] [DEBUG] [LOCAL ] J: Primary data saved (40381 records). [2025-10-15T19:40:32.743212] [INFO ] [MAIN ] J: Full history saved. [2025-10-15T19:40:32.743761] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. J took 40.7s. Estimated remaining: 2h 52m 60s. Rate: 7.1 symbols/min [2025-10-15T19:40:32.915767] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:32.915893] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-15T19:40:32.917903] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-15T19:40:32.917981] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-15T19:40:32.918104] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-15T19:40:32.918147] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-15T19:40:32.918189] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-15T19:40:32.918221] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-15T19:40:33.405173] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:33.709991] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T19:40:33.723716] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-15T19:40:33.881504] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T19:40:33.990323] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:40:33.990878] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-15T19:40:33.990986] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:40:33.991039] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-15T19:40:33.991075] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:40:33.991122] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-15T19:40:33.991189] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-15T19:40:33.991359] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-15T19:40:33.991448] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-15T19:40:33.991523] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBS took 1.2s. Estimated remaining: 2h 52m 44s. Rate: 7.1 symbols/min [2025-10-15T19:40:34.192565] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:34.192771] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-15T19:40:34.192818] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-15T19:40:34.192936] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-15T19:40:34.192980] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-15T19:40:34.193023] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-15T19:40:34.193056] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-15T19:40:34.519175] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-15T19:40:34.556798] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:35.314049] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-15T19:40:36.114012] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-15T19:40:36.422390] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:40:36.423064] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-15T19:40:36.423404] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:40:36.423493] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-15T19:40:36.439865] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:40:36.453277] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-15T19:40:36.453409] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-15T19:40:36.453492] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-15T19:40:36.454305] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-15T19:40:36.455544] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T19:40:36.455913] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBTM took 2.5s. Estimated remaining: 2h 52m 29s. Rate: 7.1 symbols/min [2025-10-15T19:40:36.671229] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:36.682632] [DEBUG] [LOCAL ] JCE: Loaded 7424 existing records from primary storage. [2025-10-15T19:40:36.682965] [INFO ] [MAIN ] JCE: Loaded 7424 existing records. [2025-10-15T19:40:36.908142] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:36.908503] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-15T19:40:36.908753] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-15T19:40:36.918825] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-15T19:40:36.918690] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-15T19:40:36.924721] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-15T19:40:36.988523] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T19:40:37.335227] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:37.713999] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-15T19:40:38.513978] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-15T19:40:38.752365] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T19:40:39.168912] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:40:39.217811] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T19:40:39.313958] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-15T19:40:39.930134] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:40:40.114037] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-15T19:40:40.660891] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T19:40:40.914035] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-15T19:40:41.714023] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-15T19:40:42.462858] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:40:42.513966] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-15T19:40:43.323379] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-15T19:40:43.329359] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:40:43.859993] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T19:40:43.883151] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T19:40:44.114025] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-15T19:40:44.699336] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T19:40:44.913975] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-15T19:40:45.713994] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-15T19:40:45.805398] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T19:40:46.341160] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T19:40:46.514028] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-15T19:40:47.314052] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-15T19:40:47.901894] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:40:47.906807] [INFO ] [REMOTE ] JBI: Full fetch complete (63977 records). [2025-10-15T19:40:47.906922] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-15T19:40:48.119092] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-15T19:40:48.223274] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T19:40:48.321372] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-15T19:40:48.321453] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-15T19:40:48.322396] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-15T19:40:48.322458] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-15T19:40:48.323614] [DEBUG] [LOCAL ] JBI: Trimmed 63977 records to 42989 (keeping 200 days of data) [2025-10-15T19:40:48.561796] [DEBUG] [LOCAL ] JBI: Primary data saved (42989 records). [2025-10-15T19:40:48.561918] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-15T19:40:48.561993] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBI took 36.0s. Estimated remaining: 2h 52m 24s. Rate: 7.1 symbols/min [2025-10-15T19:40:48.728093] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:48.779458] [DEBUG] [LOCAL ] JCI: Loaded 53530 existing records from primary storage. [2025-10-15T19:40:48.779786] [INFO ] [MAIN ] JCI: Loaded 53530 existing records. [2025-10-15T19:40:48.919151] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-15T19:40:48.964857] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:48.965058] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-15T19:40:48.965111] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-15T19:40:48.966211] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-15T19:40:48.966269] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-15T19:40:49.326513] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:49.713969] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-15T19:40:49.848319] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T19:40:50.012080] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T19:40:50.514068] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-15T19:40:51.221285] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T19:40:51.313971] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-15T19:40:51.430511] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T19:40:52.024690] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T19:40:52.114007] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-15T19:40:52.914013] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-15T19:40:53.713992] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-15T19:40:53.810310] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T19:40:54.070342] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T19:40:54.514035] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-15T19:40:55.313965] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-15T19:40:55.417769] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T19:40:56.113962] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-15T19:40:56.230025] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T19:40:56.292172] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:40:56.815358] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T19:40:56.914021] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-15T19:40:57.713963] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-15T19:40:57.727527] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T19:40:58.514046] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-15T19:40:59.314050] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-15T19:40:59.826445] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:41:00.113994] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-15T19:41:00.914066] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-15T19:41:01.036751] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:41:01.038885] [INFO ] [REMOTE ] JCE: Full fetch complete (9802 records). [2025-10-15T19:41:01.038970] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-15T19:41:01.412259] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-15T19:41:01.412385] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-15T19:41:01.412670] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-15T19:41:01.412732] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-15T19:41:01.413315] [DEBUG] [LOCAL ] JCE: Trimmed 9802 records to 7439 (keeping 200 days of data) [2025-10-15T19:41:01.458098] [DEBUG] [LOCAL ] JCE: Primary data saved (7439 records). [2025-10-15T19:41:01.458222] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-15T19:41:01.458298] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JCE took 25.0s. Estimated remaining: 2h 52m 21s. Rate: 7.1 symbols/min [2025-10-15T19:41:01.623100] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:01.666363] [DEBUG] [LOCAL ] JEF: Loaded 50173 existing records from primary storage. [2025-10-15T19:41:01.666728] [INFO ] [MAIN ] JEF: Loaded 50173 existing records. [2025-10-15T19:41:01.837785] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:01.838017] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-15T19:41:01.838064] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-15T19:41:01.839040] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-15T19:41:01.839098] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-15T19:41:02.191999] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:02.197638] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-15T19:41:02.206317] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T19:41:02.211364] [INFO ] [REMOTE ] JBND: Full fetch complete (35457 records). [2025-10-15T19:41:02.211501] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-15T19:41:02.584343] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-15T19:41:02.584586] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-15T19:41:02.585474] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-15T19:41:02.585539] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-15T19:41:02.586409] [DEBUG] [LOCAL ] JBND: Trimmed 35457 records to 26907 (keeping 200 days of data) [2025-10-15T19:41:02.751852] [DEBUG] [LOCAL ] JBND: Primary data saved (26907 records). [2025-10-15T19:41:02.751984] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-15T19:41:02.752065] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JBND took 38.1s. Estimated remaining: 2h 52m 5s. Rate: 7.1 symbols/min [2025-10-15T19:41:02.919016] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:02.958630] [DEBUG] [LOCAL ] JELD: Loaded 46081 existing records from primary storage. [2025-10-15T19:41:02.958956] [INFO ] [MAIN ] JELD: Loaded 46081 existing records. [2025-10-15T19:41:03.176606] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:03.177262] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-15T19:41:03.179390] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (5.47 seconds). [2025-10-15T19:41:03.177884] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-15T19:41:03.190364] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-15T19:41:03.190301] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-15T19:41:03.190538] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-15T19:41:03.555639] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:03.556195] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-15T19:41:03.630454] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T19:41:04.113975] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-15T19:41:05.064772] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T19:41:05.075599] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-15T19:41:05.352228] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (6.04 seconds). [2025-10-15T19:41:05.714000] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-15T19:41:05.908927] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:41:06.166147] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-15T19:41:06.513954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-15T19:41:06.970368] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T19:41:06.976374] [INFO ] [REMOTE ] JBL: Full fetch complete (70540 records). [2025-10-15T19:41:06.976502] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-15T19:41:07.324536] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-15T19:41:07.386203] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-15T19:41:07.386398] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-15T19:41:07.387750] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-15T19:41:07.387820] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-15T19:41:07.389369] [DEBUG] [LOCAL ] JBL: Trimmed 70540 records to 48349 (keeping 200 days of data) [2025-10-15T19:41:07.666297] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:41:07.771611] [DEBUG] [LOCAL ] JBL: Primary data saved (48349 records). [2025-10-15T19:41:07.771798] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-15T19:41:07.772810] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBL took 48.4s. Estimated remaining: 2h 51m 53s. Rate: 7.1 symbols/min [2025-10-15T19:41:07.946869] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:07.979479] [DEBUG] [LOCAL ] JFR: Loaded 30884 existing records from primary storage. [2025-10-15T19:41:07.979810] [INFO ] [MAIN ] JFR: Loaded 30884 existing records. [2025-10-15T19:41:08.122074] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-15T19:41:08.163211] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:08.163710] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-15T19:41:08.163836] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-15T19:41:08.180280] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-15T19:41:08.193370] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-15T19:41:08.269410] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-15T19:41:08.552238] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:08.908190] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:41:08.917409] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-15T19:41:09.609390] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T19:41:09.713995] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-15T19:41:10.325003] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:41:10.513992] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-15T19:41:11.313970] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-15T19:41:11.643393] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T19:41:11.961337] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:41:12.113979] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-15T19:41:12.913973] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-15T19:41:13.122519] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T19:41:13.690257] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:41:13.713954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-15T19:41:14.441692] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T19:41:14.513961] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-15T19:41:15.314010] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-15T19:41:15.469779] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:41:16.114000] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-15T19:41:16.504232] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T19:41:16.545703] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T19:41:16.914030] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-15T19:41:17.492622] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T19:41:17.714008] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-15T19:41:18.514025] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-15T19:41:18.554068] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:41:19.118024] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:41:19.314028] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-15T19:41:20.113980] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-15T19:41:20.173548] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:41:20.355938] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:41:20.914047] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-15T19:41:21.574231] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T19:41:21.713975] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-15T19:41:22.514019] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-15T19:41:22.856216] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T19:41:23.313966] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-15T19:41:23.460826] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T19:41:23.800253] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T19:41:24.113964] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-15T19:41:24.458443] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:41:24.913973] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-15T19:41:25.686850] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:41:25.714034] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-15T19:41:26.339704] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:41:26.513994] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-15T19:41:27.313974] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-15T19:41:27.644087] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T19:41:28.011491] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:41:28.113979] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-15T19:41:28.819908] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:41:28.914016] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-15T19:41:29.714020] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-15T19:41:29.919512] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T19:41:30.184282] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T19:41:30.513997] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-15T19:41:31.313968] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-15T19:41:31.408623] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T19:41:31.862696] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:41:31.986347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T19:41:31.996066] [INFO ] [REMOTE ] JCI: Full fetch complete (77591 records). [2025-10-15T19:41:31.996208] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-15T19:41:32.119067] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-15T19:41:32.382966] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-15T19:41:32.383049] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-15T19:41:32.384115] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-15T19:41:32.384179] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-15T19:41:32.385611] [DEBUG] [LOCAL ] JCI: Trimmed 77591 records to 53527 (keeping 200 days of data) [2025-10-15T19:41:32.740233] [DEBUG] [LOCAL ] JCI: Primary data saved (53527 records). [2025-10-15T19:41:32.740415] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-15T19:41:32.740536] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 44.2s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-15T19:41:32.908037] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:32.914182] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-15T19:41:32.921304] [DEBUG] [LOCAL ] JGH: Loaded 12243 existing records from primary storage. [2025-10-15T19:41:32.921535] [INFO ] [MAIN ] JGH: Loaded 12243 existing records. [2025-10-15T19:41:33.133151] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:33.133361] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-15T19:41:33.133410] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-15T19:41:33.133740] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-15T19:41:33.133797] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-15T19:41:33.497283] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:33.574907] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:41:33.580006] [INFO ] [REMOTE ] JFR: Full fetch complete (48391 records). [2025-10-15T19:41:33.580102] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-15T19:41:33.719103] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-15T19:41:33.964122] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-15T19:41:33.964189] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-15T19:41:33.965036] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-15T19:41:33.965096] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-15T19:41:33.966191] [DEBUG] [LOCAL ] JFR: Trimmed 48391 records to 30985 (keeping 200 days of data) [2025-10-15T19:41:34.162176] [DEBUG] [LOCAL ] JFR: Primary data saved (30985 records). [2025-10-15T19:41:34.162331] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-15T19:41:34.162417] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JFR took 26.4s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-15T19:41:34.341017] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:34.381665] [DEBUG] [LOCAL ] JHG: Loaded 47608 existing records from primary storage. [2025-10-15T19:41:34.382033] [INFO ] [MAIN ] JHG: Loaded 47608 existing records. [2025-10-15T19:41:34.515040] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-15T19:41:34.581317] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:34.582689] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:41:34.582919] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-15T19:41:34.589369] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-15T19:41:34.595951] [INFO ] [REMOTE ] JELD: Full fetch complete (64418 records). [2025-10-15T19:41:34.596490] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:41:34.596674] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-15T19:41:34.597019] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-15T19:41:34.596961] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-15T19:41:35.338218] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-15T19:41:35.358453] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-15T19:41:35.362917] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:35.364085] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-15T19:41:35.365337] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-15T19:41:35.365510] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-15T19:41:35.366990] [DEBUG] [LOCAL ] JELD: Trimmed 64418 records to 46134 (keeping 200 days of data) [2025-10-15T19:41:35.623240] [DEBUG] [LOCAL ] JELD: Primary data saved (46134 records). [2025-10-15T19:41:35.623374] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-15T19:41:35.623467] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JELD took 32.9s. Estimated remaining: 2h 51m 30s. Rate: 7.1 symbols/min [2025-10-15T19:41:35.788797] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:35.789003] [DEBUG] [LOCAL ] JHI: No existing data file found in primary storage. [2025-10-15T19:41:35.789043] [WARN ] [MAIN ] JHI: No existing data found, performing full refresh instead. [2025-10-15T19:41:35.789114] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-15T19:41:35.789149] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-15T19:41:35.789187] [DEBUG] [LOCAL ] JHI: No primary data file found to delete. [2025-10-15T19:41:35.789217] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-15T19:41:36.114798] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-15T19:41:36.139615] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:36.199745] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T19:41:36.233612] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T19:41:36.914054] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-15T19:41:37.483100] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T19:41:37.670529] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:41:37.713982] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-15T19:41:38.250611] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T19:41:38.514003] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-15T19:41:39.313995] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-15T19:41:39.915970] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T19:41:40.113972] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-15T19:41:40.418506] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-15T19:41:40.424822] [INFO ] [REMOTE ] JEF: Full fetch complete (73279 records). [2025-10-15T19:41:40.424941] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-15T19:41:40.622253] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T19:41:40.821153] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-15T19:41:40.821228] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-15T19:41:40.822220] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-15T19:41:40.822283] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-15T19:41:40.823663] [DEBUG] [LOCAL ] JEF: Trimmed 73279 records to 50171 (keeping 200 days of data) [2025-10-15T19:41:40.914005] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-15T19:41:41.127293] [DEBUG] [LOCAL ] JEF: Primary data saved (50171 records). [2025-10-15T19:41:41.127554] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-15T19:41:41.127950] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JEF took 39.7s. Estimated remaining: 2h 51m 18s. Rate: 7.1 symbols/min [2025-10-15T19:41:41.291558] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:41.296509] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-15T19:41:41.296726] [INFO ] [MAIN ] JHS: Loaded 2944 existing records. [2025-10-15T19:41:41.469445] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:41.469716] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-15T19:41:41.469771] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-15T19:41:41.469978] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-15T19:41:41.470036] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-15T19:41:41.719180] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-15T19:41:41.818414] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:42.461258] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:41:42.514035] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-15T19:41:42.550461] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T19:41:43.008547] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-15T19:41:43.314063] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-15T19:41:44.095249] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T19:41:44.113958] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-15T19:41:44.761121] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T19:41:44.913984] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-15T19:41:45.614269] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T19:41:45.714062] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-15T19:41:46.164966] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T19:41:46.514057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-15T19:41:47.314040] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-15T19:41:47.331844] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:41:47.871819] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T19:41:48.114048] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-15T19:41:48.698356] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T19:41:48.914020] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-15T19:41:49.425847] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T19:41:49.713971] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-15T19:41:50.513972] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-15T19:41:50.602705] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T19:41:51.314031] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-15T19:41:52.081756] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T19:41:52.113980] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-15T19:41:52.184401] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T19:41:52.187672] [INFO ] [REMOTE ] JGH: Full fetch complete (16098 records). [2025-10-15T19:41:52.187770] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-15T19:41:52.544070] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-15T19:41:52.544178] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-15T19:41:52.544525] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-15T19:41:52.544565] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-15T19:41:52.545075] [DEBUG] [LOCAL ] JGH: Trimmed 16098 records to 12453 (keeping 200 days of data) [2025-10-15T19:41:52.618599] [DEBUG] [LOCAL ] JGH: Primary data saved (12453 records). [2025-10-15T19:41:52.618741] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-15T19:41:52.618870] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JGH took 19.9s. Estimated remaining: 2h 51m 13s. Rate: 7.1 symbols/min [2025-10-15T19:41:52.786567] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:52.834141] [DEBUG] [LOCAL ] JHX: Loaded 53155 existing records from primary storage. [2025-10-15T19:41:52.834481] [INFO ] [MAIN ] JHX: Loaded 53155 existing records. [2025-10-15T19:41:52.921400] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-15T19:41:53.008432] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:53.008629] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-15T19:41:53.008711] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-15T19:41:53.009622] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-15T19:41:53.009714] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-15T19:41:53.360247] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:53.524944] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T19:41:53.713968] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-15T19:41:53.786009] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:41:54.209827] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-15T19:41:54.514003] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-15T19:41:54.980010] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T19:41:55.313979] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-15T19:41:55.881411] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T19:41:56.113983] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-15T19:41:56.672689] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:41:56.914049] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-15T19:41:57.422751] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-15T19:41:57.714019] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-15T19:41:58.463908] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:41:58.513967] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-15T19:41:58.971913] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T19:41:59.314001] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-15T19:42:00.113984] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-15T19:42:00.342983] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:42:00.714417] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T19:42:00.913970] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-15T19:42:01.713997] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-15T19:42:02.301827] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T19:42:02.514030] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-15T19:42:02.597633] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:42:02.845145] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T19:42:03.314093] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-15T19:42:04.113996] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-15T19:42:04.663086] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T19:42:04.913971] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-15T19:42:05.065695] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:42:05.325425] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T19:42:05.326350] [INFO ] [REMOTE ] JHS: Full fetch complete (4498 records). [2025-10-15T19:42:05.326419] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-15T19:42:05.676516] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-15T19:42:05.676595] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-15T19:42:05.676748] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-15T19:42:05.676810] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-15T19:42:05.677160] [DEBUG] [LOCAL ] JHS: Trimmed 4498 records to 2933 (keeping 200 days of data) [2025-10-15T19:42:05.694825] [DEBUG] [LOCAL ] JHS: Primary data saved (2933 records). [2025-10-15T19:42:05.694891] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-15T19:42:05.694959] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JHS took 24.6s. Estimated remaining: 2h 51m 10s. Rate: 7.1 symbols/min [2025-10-15T19:42:05.719132] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-15T19:42:05.865091] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:05.881625] [DEBUG] [LOCAL ] JILL: Loaded 16017 existing records from primary storage. [2025-10-15T19:42:05.881890] [INFO ] [MAIN ] JILL: Loaded 16017 existing records. [2025-10-15T19:42:06.054237] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:06.054459] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-15T19:42:06.054507] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-15T19:42:06.054885] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-15T19:42:06.054943] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-15T19:42:06.398226] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:06.513997] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-15T19:42:07.313974] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-15T19:42:07.333268] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T19:42:07.362082] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:42:08.113970] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-15T19:42:08.491678] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:42:08.914000] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-15T19:42:09.395396] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T19:42:09.713982] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-15T19:42:09.880685] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:42:10.247778] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T19:42:10.514004] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-15T19:42:11.114785] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T19:42:11.314005] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-15T19:42:12.114085] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-15T19:42:12.874870] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T19:42:12.925034] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-15T19:42:12.927841] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T19:42:13.673186] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T19:42:13.674781] [INFO ] [REMOTE ] JHI: Full fetch complete (5697 records). [2025-10-15T19:42:13.674851] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-15T19:42:13.719103] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-15T19:42:14.022208] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-15T19:42:14.022282] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-15T19:42:14.022434] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-15T19:42:14.022472] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-15T19:42:14.022858] [DEBUG] [LOCAL ] JHI: Trimmed 5697 records to 4041 (keeping 200 days of data) [2025-10-15T19:42:14.046273] [DEBUG] [LOCAL ] JHI: Primary data saved (4041 records). [2025-10-15T19:42:14.046347] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-15T19:42:14.046409] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 38.4s. Estimated remaining: 2h 51m 1s. Rate: 7.1 symbols/min [2025-10-15T19:42:14.208593] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:14.247585] [DEBUG] [LOCAL ] JKS: Loaded 39715 existing records from primary storage. [2025-10-15T19:42:14.247908] [INFO ] [MAIN ] JKS: Loaded 39715 existing records. [2025-10-15T19:42:14.420091] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:14.420301] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-15T19:42:14.420359] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-15T19:42:14.420673] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-15T19:42:14.420728] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-15T19:42:14.517369] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-15T19:42:14.785619] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:14.797381] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T19:42:15.314030] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-15T19:42:15.809844] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T19:42:16.113983] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-15T19:42:16.914056] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-15T19:42:17.041957] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T19:42:17.714086] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-15T19:42:17.927573] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T19:42:17.931625] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:42:18.514002] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-15T19:42:18.956910] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T19:42:19.209758] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T19:42:19.313987] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-15T19:42:20.114017] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-15T19:42:20.616370] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:42:20.913994] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-15T19:42:21.213547] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T19:42:21.714039] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-15T19:42:22.513985] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-15T19:42:22.627145] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T19:42:22.815452] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:42:23.313991] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-15T19:42:23.884200] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:42:23.889947] [INFO ] [REMOTE ] JHG: Full fetch complete (68466 records). [2025-10-15T19:42:23.890068] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-15T19:42:24.119575] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-15T19:42:24.297063] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-15T19:42:24.297149] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-15T19:42:24.298175] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-15T19:42:24.298239] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-15T19:42:24.299638] [DEBUG] [LOCAL ] JHG: Trimmed 68466 records to 47560 (keeping 200 days of data) [2025-10-15T19:42:24.597390] [DEBUG] [LOCAL ] JHG: Primary data saved (47560 records). [2025-10-15T19:42:24.597536] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-15T19:42:24.598352] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 50.4s. Estimated remaining: 2h 50m 55s. Rate: 7.1 symbols/min [2025-10-15T19:42:24.773405] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:24.809103] [DEBUG] [LOCAL ] JLL: Loaded 31732 existing records from primary storage. [2025-10-15T19:42:24.809434] [INFO ] [MAIN ] JLL: Loaded 31732 existing records. [2025-10-15T19:42:24.924068] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-15T19:42:24.988893] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:24.989341] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-15T19:42:24.989460] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-15T19:42:24.989951] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-15T19:42:24.990019] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-15T19:42:25.129243] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:42:25.391445] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:25.713971] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-15T19:42:25.781899] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T19:42:25.846692] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:42:26.513991] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-15T19:42:27.313967] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-15T19:42:27.502291] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T19:42:27.501466] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T19:42:28.114009] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-15T19:42:28.456951] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:42:28.914037] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-15T19:42:29.648712] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T19:42:29.713964] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-15T19:42:30.513963] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-15T19:42:30.612724] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T19:42:31.313985] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-15T19:42:31.394734] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:42:31.818698] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:42:32.087511] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T19:42:32.113954] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-15T19:42:32.914044] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-15T19:42:33.050686] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:42:33.052860] [INFO ] [REMOTE ] JILL: Full fetch complete (22636 records). [2025-10-15T19:42:33.052947] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-15T19:42:33.427069] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-15T19:42:33.427144] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-15T19:42:33.427594] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-15T19:42:33.427633] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-15T19:42:33.428302] [DEBUG] [LOCAL ] JILL: Trimmed 22636 records to 15931 (keeping 200 days of data) [2025-10-15T19:42:33.525677] [DEBUG] [LOCAL ] JILL: Primary data saved (15931 records). [2025-10-15T19:42:33.525833] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-15T19:42:33.525913] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JILL took 27.8s. Estimated remaining: 2h 50m 47s. Rate: 7.1 symbols/min [2025-10-15T19:42:33.719772] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-15T19:42:33.719631] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:33.727580] [DEBUG] [LOCAL ] JLS: Loaded 4203 existing records from primary storage. [2025-10-15T19:42:33.727956] [INFO ] [MAIN ] JLS: Loaded 4203 existing records. [2025-10-15T19:42:33.932957] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:33.934334] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-15T19:42:33.934395] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-15T19:42:33.935101] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-15T19:42:33.935173] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-15T19:42:34.286879] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T19:42:34.337750] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:34.514008] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-15T19:42:35.129847] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:42:35.313977] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-15T19:42:35.937924] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:42:36.114043] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-15T19:42:36.667314] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T19:42:36.913975] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-15T19:42:36.999765] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T19:42:37.006033] [INFO ] [REMOTE ] JHX: Full fetch complete (61213 records). [2025-10-15T19:42:37.006148] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-15T19:42:37.392065] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-15T19:42:37.392271] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-15T19:42:37.393327] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-15T19:42:37.393392] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-15T19:42:37.394805] [DEBUG] [LOCAL ] JHX: Trimmed 61213 records to 53161 (keeping 200 days of data) [2025-10-15T19:42:37.499205] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T19:42:37.715691] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-15T19:42:37.724424] [DEBUG] [LOCAL ] JHX: Primary data saved (53161 records). [2025-10-15T19:42:37.724508] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-15T19:42:37.724585] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 45.1s. Estimated remaining: 2h 50m 34s. Rate: 7.1 symbols/min [2025-10-15T19:42:37.892480] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:37.943623] [DEBUG] [LOCAL ] JMIA: Loaded 51026 existing records from primary storage. [2025-10-15T19:42:37.943972] [INFO ] [MAIN ] JMIA: Loaded 51026 existing records. [2025-10-15T19:42:38.120134] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:38.120369] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-15T19:42:38.120418] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-15T19:42:38.120845] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-15T19:42:38.120901] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-15T19:42:38.397744] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T19:42:38.474262] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:38.513951] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-15T19:42:39.314025] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-15T19:42:39.879914] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T19:42:40.113999] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-15T19:42:40.534476] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-15T19:42:40.914011] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-15T19:42:41.422479] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:42:41.513570] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T19:42:41.714019] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-15T19:42:42.514010] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-15T19:42:43.314055] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-15T19:42:43.378799] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T19:42:43.785103] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T19:42:44.114018] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-15T19:42:44.798514] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:42:44.913963] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-15T19:42:45.579572] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:42:45.713981] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-15T19:42:46.464691] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:42:46.513962] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-15T19:42:47.319060] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-15T19:42:47.333990] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T19:42:47.837837] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T19:42:47.909248] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T19:42:48.114031] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-15T19:42:48.913999] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-15T19:42:49.587098] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:42:49.592407] [INFO ] [REMOTE ] JKS: Full fetch complete (58834 records). [2025-10-15T19:42:49.592519] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-15T19:42:49.719182] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-15T19:42:49.977558] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-15T19:42:49.977661] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-15T19:42:49.978627] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-15T19:42:49.978713] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-15T19:42:49.979890] [DEBUG] [LOCAL ] JKS: Trimmed 58834 records to 39674 (keeping 200 days of data) [2025-10-15T19:42:50.219301] [DEBUG] [LOCAL ] JKS: Primary data saved (39674 records). [2025-10-15T19:42:50.219502] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-15T19:42:50.219688] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JKS took 36.2s. Estimated remaining: 2h 50m 30s. Rate: 7.1 symbols/min [2025-10-15T19:42:50.514093] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-15T19:42:50.666422] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:42:50.968374] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T19:42:51.191576] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:42:51.313967] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-15T19:42:51.721727] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-15T19:42:52.113988] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-15T19:42:52.914055] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-15T19:42:53.350857] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T19:42:53.714009] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-15T19:42:54.514098] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-15T19:42:54.611440] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T19:42:55.085143] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T19:42:55.086308] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:42:55.314024] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-15T19:42:56.114070] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-15T19:42:56.661023] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:42:56.913989] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-15T19:42:57.506324] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T19:42:57.713990] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-15T19:42:58.016660] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T19:42:58.514022] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-15T19:42:58.927523] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T19:42:58.931084] [INFO ] [REMOTE ] JLL: Full fetch complete (44973 records). [2025-10-15T19:42:58.931188] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-15T19:42:59.094912] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:42:59.117093] [INFO ] [REMOTE ] JLS: Full fetch complete (5850 records). [2025-10-15T19:42:59.158815] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-15T19:42:59.325166] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-15T19:42:59.479170] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-15T19:42:59.494495] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-15T19:42:59.565802] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-15T19:42:59.577244] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-15T19:42:59.629728] [DEBUG] [LOCAL ] JLL: Trimmed 44973 records to 31768 (keeping 200 days of data) [2025-10-15T19:42:59.741700] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-15T19:42:59.741790] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-15T19:42:59.741907] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-15T19:42:59.741974] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-15T19:42:59.780809] [DEBUG] [LOCAL ] JLS: Trimmed 5850 records to 4209 (keeping 200 days of data) [2025-10-15T19:42:59.818841] [DEBUG] [LOCAL ] JLS: Primary data saved (4209 records). [2025-10-15T19:42:59.819242] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-15T19:42:59.819609] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLS took 26.3s. Estimated remaining: 2h 50m 23s. Rate: 7.1 symbols/min [2025-10-15T19:42:59.901011] [DEBUG] [LOCAL ] JLL: Primary data saved (31768 records). [2025-10-15T19:42:59.901157] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-15T19:42:59.901241] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JLL took 35.3s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-15T19:43:01.403693] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T19:43:01.413901] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-15T19:43:03.143825] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T19:43:03.156567] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-15T19:43:05.024799] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:43:05.035936] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-15T19:43:07.126844] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T19:43:07.138456] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-15T19:43:09.255219] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T19:43:09.261935] [INFO ] [REMOTE ] JMIA: Full fetch complete (73435 records). [2025-10-15T19:43:09.262097] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-15T19:43:09.655503] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-15T19:43:09.655594] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-15T19:43:09.656603] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-15T19:43:09.656724] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-15T19:43:09.658208] [DEBUG] [LOCAL ] JMIA: Trimmed 73435 records to 51055 (keeping 200 days of data) [2025-10-15T19:43:09.945190] [DEBUG] [LOCAL ] JMIA: Primary data saved (51055 records). [2025-10-15T19:43:09.945320] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-15T19:43:09.945416] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JMIA took 32.2s. Estimated remaining: 2h 49m 59s. Rate: 7.1 symbols/min [2025-10-15T19:43:10.496782] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.614433] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.652546] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.653084] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-15T19:43:10.653245] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-15T19:43:10.674123] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-15T19:43:10.675406] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-15T19:43:10.675261] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.675629] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-15T19:43:10.676022] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-15T19:43:10.851599] [DEBUG] [LOCAL ] JOE: Loaded 23904 existing records from primary storage. [2025-10-15T19:43:10.930853] [INFO ] [MAIN ] JOE: Loaded 23904 existing records. [2025-10-15T19:43:11.104514] [DEBUG] [LOCAL ] JOBY: Loaded 53808 existing records from primary storage. [2025-10-15T19:43:11.169059] [INFO ] [MAIN ] JOBY: Loaded 53808 existing records. [2025-10-15T19:43:11.300498] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:11.356134] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-15T19:43:11.347921] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-15T19:43:11.364623] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:11.420051] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-15T19:43:11.402954] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-15T19:43:11.427992] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-15T19:43:11.473090] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-15T19:43:11.488762] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-15T19:43:11.654113] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:11.700473] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-15T19:43:11.768384] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-15T19:43:11.805127] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-15T19:43:11.805268] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-15T19:43:11.805074] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:11.881274] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-15T19:43:11.931203] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-15T19:43:12.010724] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-15T19:43:12.033553] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-15T19:43:12.101748] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T19:43:12.203510] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-15T19:43:12.513631] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:12.576022] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-15T19:43:12.590277] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:12.630921] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-15T19:43:12.758212] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T19:43:12.764507] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-15T19:43:12.832183] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:12.832482] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-15T19:43:13.253198] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T19:43:13.254252] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-15T19:43:13.705186] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:43:13.710901] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-15T19:43:13.751879] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T19:43:13.752824] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-15T19:43:14.141971] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T19:43:14.143047] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-15T19:43:14.604091] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T19:43:14.605385] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-15T19:43:14.745842] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T19:43:14.751685] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-15T19:43:14.970263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T19:43:14.981829] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-15T19:43:15.076274] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:43:15.077535] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-15T19:43:15.124723] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-15T19:43:15.135693] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-15T19:43:15.482797] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-15T19:43:15.484323] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-15T19:43:15.613759] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T19:43:15.917236] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:43:16.114042] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-15T19:43:16.914076] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-15T19:43:17.238993] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-15T19:43:17.414872] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T19:43:17.539884] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T19:43:17.615723] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-15T19:43:17.713983] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-15T19:43:18.513994] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-15T19:43:19.313997] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-15T19:43:19.745319] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:43:19.913925] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-15T19:43:20.114017] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-15T19:43:20.914002] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-15T19:43:21.378765] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T19:43:21.444915] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T19:43:21.713988] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-15T19:43:22.514033] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-15T19:43:22.818472] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T19:43:22.968779] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T19:43:22.969510] [INFO ] [REMOTE ] JMM: Full fetch complete (2304 records). [2025-10-15T19:43:22.969575] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-15T19:43:23.147525] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-15T19:43:23.147733] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:43:23.147805] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:43:23.147880] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-15T19:43:23.147941] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-15T19:43:23.147977] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-15T19:43:23.148016] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-15T19:43:23.148074] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 13.2s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-15T19:43:23.315161] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-15T19:43:23.318066] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:23.332917] [DEBUG] [LOCAL ] JOF: Loaded 6886 existing records from primary storage. [2025-10-15T19:43:23.333151] [INFO ] [MAIN ] JOF: Loaded 6886 existing records. [2025-10-15T19:43:23.512455] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:23.512785] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-15T19:43:23.512847] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-15T19:43:23.537761] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-15T19:43:23.540795] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-15T19:43:23.616937] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-15T19:43:23.898935] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:24.113970] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-15T19:43:24.314551] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:43:24.709265] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T19:43:24.913993] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-15T19:43:25.544612] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T19:43:25.714005] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-15T19:43:26.514049] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-15T19:43:26.787426] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:43:27.314017] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-15T19:43:27.927024] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:43:28.114008] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-15T19:43:28.853232] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-15T19:43:28.913983] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-15T19:43:28.978343] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T19:43:29.714017] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-15T19:43:30.513999] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-15T19:43:31.007011] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-15T19:43:31.314040] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-15T19:43:31.509920] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-15T19:43:31.726137] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T19:43:32.022612] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-15T19:43:32.114005] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-15T19:43:32.914020] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-15T19:43:33.713997] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-15T19:43:34.514002] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-15T19:43:34.625586] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-15T19:43:34.762296] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T19:43:34.765632] [INFO ] [REMOTE ] JOE: Full fetch complete (35707 records). [2025-10-15T19:43:34.765778] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-15T19:43:35.064195] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T19:43:35.180393] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-15T19:43:35.180513] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-15T19:43:35.181350] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-15T19:43:35.181449] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-15T19:43:35.183756] [DEBUG] [LOCAL ] JOE: Trimmed 35707 records to 23893 (keeping 200 days of data) [2025-10-15T19:43:35.305934] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-15T19:43:35.321612] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-15T19:43:35.375009] [DEBUG] [LOCAL ] JOE: Primary data saved (23893 records). [2025-10-15T19:43:35.375129] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-15T19:43:35.375209] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JOE took 25.4s. Estimated remaining: 2h 49m 51s. Rate: 7.1 symbols/min [2025-10-15T19:43:35.540388] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:35.576603] [DEBUG] [LOCAL ] JPC: Loaded 37244 existing records from primary storage. [2025-10-15T19:43:35.576903] [INFO ] [MAIN ] JPC: Loaded 37244 existing records. [2025-10-15T19:43:35.778405] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:35.778616] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-15T19:43:35.778691] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-15T19:43:35.779031] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-15T19:43:35.779070] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-15T19:43:36.038315] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T19:43:36.119117] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-15T19:43:36.147239] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:36.914054] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-15T19:43:37.534490] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T19:43:37.714093] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-15T19:43:38.296093] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-15T19:43:38.514029] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-15T19:43:39.195709] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:43:39.314044] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-15T19:43:40.114017] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-15T19:43:40.639949] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T19:43:40.680690] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T19:43:40.835197] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:43:40.913967] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-15T19:43:41.714008] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-15T19:43:42.421749] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T19:43:42.513954] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-15T19:43:43.135619] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T19:43:43.136964] [INFO ] [REMOTE ] JOF: Full fetch complete (9527 records). [2025-10-15T19:43:43.137032] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-15T19:43:43.325854] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-15T19:43:43.469899] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-15T19:43:43.545476] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-15T19:43:43.545549] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-15T19:43:43.545870] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-15T19:43:43.545931] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-15T19:43:43.546342] [DEBUG] [LOCAL ] JOF: Trimmed 9527 records to 6891 (keeping 200 days of data) [2025-10-15T19:43:43.586814] [DEBUG] [LOCAL ] JOF: Primary data saved (6891 records). [2025-10-15T19:43:43.586941] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-15T19:43:43.587024] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JOF took 20.4s. Estimated remaining: 2h 49m 42s. Rate: 7.1 symbols/min [2025-10-15T19:43:43.752120] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:43.805221] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-15T19:43:43.805563] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-15T19:43:43.988635] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:43.988885] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-15T19:43:43.988937] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-15T19:43:43.989428] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-15T19:43:43.989493] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-15T19:43:44.127105] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-15T19:43:44.358700] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:44.724848] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T19:43:44.914058] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-15T19:43:45.714000] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-15T19:43:46.165202] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T19:43:46.514067] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-15T19:43:46.987986] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-15T19:43:47.139412] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:43:47.314018] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-15T19:43:48.114052] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-15T19:43:48.914031] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-15T19:43:49.095550] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-15T19:43:49.204701] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:43:49.714066] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-15T19:43:49.973620] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T19:43:50.423308] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:43:50.513961] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-15T19:43:51.314051] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-15T19:43:51.912129] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T19:43:52.113968] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-15T19:43:52.220130] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-15T19:43:52.913998] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-15T19:43:53.298236] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T19:43:53.304586] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-15T19:43:53.304747] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-15T19:43:53.690275] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-15T19:43:53.690394] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-15T19:43:53.691443] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-15T19:43:53.691506] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-15T19:43:53.692914] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-15T19:43:53.747896] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-15T19:43:54.030889] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-15T19:43:54.031127] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-15T19:43:54.031225] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JNJ took 44.1s. Estimated remaining: 2h 49m 36s. Rate: 7.1 symbols/min [2025-10-15T19:43:54.199809] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:54.230610] [DEBUG] [LOCAL ] JQC: Loaded 33824 existing records from primary storage. [2025-10-15T19:43:54.230933] [INFO ] [MAIN ] JQC: Loaded 33824 existing records. [2025-10-15T19:43:54.410910] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:54.411782] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-15T19:43:54.426481] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-15T19:43:54.450737] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-15T19:43:54.454776] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-15T19:43:54.464775] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-15T19:43:54.497273] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:43:54.529278] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-15T19:43:54.822766] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:55.314053] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-15T19:43:56.113967] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-15T19:43:56.301856] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-15T19:43:56.616857] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T19:43:56.914042] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-15T19:43:57.109620] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-15T19:43:57.189814] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T19:43:57.714013] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-15T19:43:58.514050] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-15T19:43:59.206834] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:43:59.313950] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-15T19:43:59.825255] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-15T19:43:59.831623] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-15T19:43:59.831775] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-15T19:44:00.120632] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-15T19:44:00.218479] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-15T19:44:00.218556] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-15T19:44:00.219622] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-15T19:44:00.219706] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-15T19:44:00.221185] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53808 (keeping 200 days of data) [2025-10-15T19:44:00.476364] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T19:44:00.574936] [DEBUG] [LOCAL ] JOBY: Primary data saved (53808 records). [2025-10-15T19:44:00.575091] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-15T19:44:00.575202] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOBY took 50.6s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-15T19:44:00.752069] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:00.789688] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-15T19:44:00.806672] [DEBUG] [LOCAL ] JRI: Loaded 15431 existing records from primary storage. [2025-10-15T19:44:00.806915] [INFO ] [MAIN ] JRI: Loaded 15431 existing records. [2025-10-15T19:44:00.919154] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-15T19:44:00.993814] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:00.994087] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-15T19:44:00.994134] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-15T19:44:00.994381] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-15T19:44:00.994437] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-15T19:44:01.398781] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:01.645862] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:44:01.714003] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-15T19:44:02.378670] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:44:02.383722] [INFO ] [REMOTE ] JPC: Full fetch complete (55333 records). [2025-10-15T19:44:02.383828] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-15T19:44:02.532184] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-15T19:44:02.572618] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T19:44:02.791689] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-15T19:44:02.791781] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-15T19:44:02.792760] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-15T19:44:02.792825] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-15T19:44:02.794005] [DEBUG] [LOCAL ] JPC: Trimmed 55333 records to 37227 (keeping 200 days of data) [2025-10-15T19:44:03.009110] [DEBUG] [LOCAL ] JPC: Primary data saved (37227 records). [2025-10-15T19:44:03.009255] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-15T19:44:03.009334] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JPC took 27.6s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-15T19:44:03.171927] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:03.183435] [DEBUG] [LOCAL ] JRS: Loaded 11664 existing records from primary storage. [2025-10-15T19:44:03.183684] [INFO ] [MAIN ] JRS: Loaded 11664 existing records. [2025-10-15T19:44:03.319210] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-15T19:44:03.359145] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:03.359312] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-15T19:44:03.359359] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-15T19:44:03.359534] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-15T19:44:03.359588] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-15T19:44:03.714495] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:03.863514] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T19:44:04.114001] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-15T19:44:04.914011] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-15T19:44:05.186873] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:44:05.715256] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-15T19:44:05.715176] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T19:44:06.283434] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T19:44:06.514001] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-15T19:44:06.926106] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T19:44:07.314017] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-15T19:44:08.113976] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-15T19:44:08.806843] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T19:44:08.842733] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T19:44:08.858862] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T19:44:08.914021] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-15T19:44:09.713986] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-15T19:44:10.514005] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-15T19:44:11.035912] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T19:44:11.179325] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-15T19:44:11.237060] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T19:44:11.313953] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-15T19:44:12.114016] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-15T19:44:12.736577] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:44:12.914028] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-15T19:44:13.687591] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-15T19:44:13.713956] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-15T19:44:14.144084] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T19:44:14.514008] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-15T19:44:15.314004] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-15T19:44:15.922538] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:44:15.983870] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:44:16.113974] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-15T19:44:16.151113] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-15T19:44:16.913992] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-15T19:44:17.295634] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:44:17.713992] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-15T19:44:18.514063] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-15T19:44:19.127365] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:44:19.313998] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-15T19:44:19.337048] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:44:19.395536] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-15T19:44:19.402465] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-15T19:44:19.402678] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-15T19:44:19.945451] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-15T19:44:19.945527] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-15T19:44:19.946579] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-15T19:44:19.946663] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-15T19:44:19.948076] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-15T19:44:20.126018] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-15T19:44:20.283702] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-15T19:44:20.283827] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-15T19:44:20.283904] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JPM took 36.7s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-15T19:44:20.460097] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:20.476520] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T19:44:20.483862] [INFO ] [REMOTE ] JQC: Full fetch complete (49626 records). [2025-10-15T19:44:20.484007] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-15T19:44:20.808585] [DEBUG] [LOCAL ] JXN: Loaded 44808 existing records from primary storage. [2025-10-15T19:44:20.825015] [INFO ] [MAIN ] JXN: Loaded 44808 existing records. [2025-10-15T19:44:20.915172] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-15T19:44:21.004152] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-15T19:44:21.025714] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-15T19:44:21.031831] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-15T19:44:21.045328] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-15T19:44:21.088121] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:21.096793] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-15T19:44:21.096987] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-15T19:44:21.098345] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T19:44:21.098426] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-15T19:44:21.098593] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-15T19:44:21.097815] [DEBUG] [LOCAL ] JQC: Trimmed 49626 records to 33645 (keeping 200 days of data) [2025-10-15T19:44:21.593741] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:21.675285] [DEBUG] [LOCAL ] JQC: Primary data saved (33645 records). [2025-10-15T19:44:21.675428] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-15T19:44:21.675888] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JQC took 27.6s. Estimated remaining: 2h 48m 56s. Rate: 7.1 symbols/min [2025-10-15T19:44:21.717635] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-15T19:44:21.850271] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:21.869775] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:44:21.906009] [DEBUG] [LOCAL ] K: Loaded 50400 existing records from primary storage. [2025-10-15T19:44:21.906314] [INFO ] [MAIN ] K: Loaded 50400 existing records. [2025-10-15T19:44:22.093491] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:22.093740] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-15T19:44:22.093794] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-15T19:44:22.094254] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-15T19:44:22.094310] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-15T19:44:22.463374] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:22.513962] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-15T19:44:23.018960] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T19:44:23.314010] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-15T19:44:24.018382] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T19:44:24.113964] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-15T19:44:24.150260] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:44:24.856264] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T19:44:24.913981] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-15T19:44:25.714004] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-15T19:44:25.859251] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T19:44:26.513995] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-15T19:44:27.049200] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T19:44:27.313968] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-15T19:44:27.523595] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:44:28.113978] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-15T19:44:28.156681] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T19:44:28.914055] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-15T19:44:28.924742] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T19:44:29.714041] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-15T19:44:29.829566] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:44:30.514063] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-15T19:44:31.004831] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:44:31.314008] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-15T19:44:32.008777] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:44:32.062020] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T19:44:32.114023] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-15T19:44:32.914025] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-15T19:44:33.127286] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:44:33.129915] [INFO ] [REMOTE ] JRI: Full fetch complete (23251 records). [2025-10-15T19:44:33.129997] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-15T19:44:33.488480] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-15T19:44:33.488558] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-15T19:44:33.489053] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-15T19:44:33.489115] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-15T19:44:33.489812] [DEBUG] [LOCAL ] JRI: Trimmed 23251 records to 15410 (keeping 200 days of data) [2025-10-15T19:44:33.584606] [DEBUG] [LOCAL ] JRI: Primary data saved (15410 records). [2025-10-15T19:44:33.584762] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-15T19:44:33.584845] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JRI took 33.0s. Estimated remaining: 2h 48m 51s. Rate: 7.1 symbols/min [2025-10-15T19:44:33.723871] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-15T19:44:33.756261] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:33.771532] [DEBUG] [LOCAL ] KAI: Loaded 13548 existing records from primary storage. [2025-10-15T19:44:33.771896] [INFO ] [MAIN ] KAI: Loaded 13548 existing records. [2025-10-15T19:44:33.948566] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:33.948834] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-15T19:44:33.948885] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-15T19:44:33.949109] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-15T19:44:33.949168] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-15T19:44:34.304255] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:34.351172] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T19:44:34.513968] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-15T19:44:34.543882] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:44:35.314020] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-15T19:44:36.112546] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:44:36.113341] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T19:44:36.121574] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-15T19:44:36.914038] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-15T19:44:37.714058] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-15T19:44:37.817617] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T19:44:37.867868] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:44:38.514009] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-15T19:44:39.313988] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-15T19:44:39.567163] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T19:44:39.924256] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:44:39.940563] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T19:44:39.942764] [INFO ] [REMOTE ] JRS: Full fetch complete (16339 records). [2025-10-15T19:44:39.942840] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-15T19:44:40.118682] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-15T19:44:40.310509] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-15T19:44:40.310628] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-15T19:44:40.311025] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-15T19:44:40.311072] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-15T19:44:40.311702] [DEBUG] [LOCAL ] JRS: Trimmed 16339 records to 11669 (keeping 200 days of data) [2025-10-15T19:44:40.383635] [DEBUG] [LOCAL ] JRS: Primary data saved (11669 records). [2025-10-15T19:44:40.383792] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-15T19:44:40.383873] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRS took 37.4s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-15T19:44:40.547161] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:40.584482] [DEBUG] [LOCAL ] KAR: Loaded 40095 existing records from primary storage. [2025-10-15T19:44:40.584807] [INFO ] [MAIN ] KAR: Loaded 40095 existing records. [2025-10-15T19:44:40.755899] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:40.756082] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-15T19:44:40.756130] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-15T19:44:40.756476] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-15T19:44:40.756515] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-15T19:44:40.922460] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-15T19:44:41.098762] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:41.660930] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:44:41.713961] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-15T19:44:42.484204] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:44:42.513947] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-15T19:44:42.800768] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T19:44:43.313957] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-15T19:44:43.491534] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:44:44.114054] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-15T19:44:44.913981] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-15T19:44:44.998483] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:44:45.060128] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:44:45.714052] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-15T19:44:46.472420] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:44:46.513962] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-15T19:44:47.313969] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-15T19:44:47.424867] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T19:44:47.961707] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:44:48.107436] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T19:44:48.113945] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-15T19:44:48.913955] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-15T19:44:49.074352] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T19:44:49.714044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-15T19:44:50.462927] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:44:50.514040] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-15T19:44:51.313964] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-15T19:44:51.427154] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:44:51.869885] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T19:44:51.887150] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T19:44:52.114006] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-15T19:44:52.914028] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-15T19:44:53.713968] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-15T19:44:53.746519] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:44:53.753164] [INFO ] [REMOTE ] K: Full fetch complete (72298 records). [2025-10-15T19:44:53.753390] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-15T19:44:53.952629] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:44:54.219221] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-15T19:44:54.219332] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-15T19:44:54.220449] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-15T19:44:54.220514] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-15T19:44:54.221893] [DEBUG] [LOCAL ] K: Trimmed 72298 records to 50422 (keeping 200 days of data) [2025-10-15T19:44:54.514172] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-15T19:44:54.532605] [DEBUG] [LOCAL ] K: Primary data saved (50422 records). [2025-10-15T19:44:54.532867] [INFO ] [MAIN ] K: Full history saved. [2025-10-15T19:44:54.533391] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. K took 32.9s. Estimated remaining: 2h 48m 38s. Rate: 7.1 symbols/min [2025-10-15T19:44:54.712598] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:54.736242] [DEBUG] [LOCAL ] KB: Loaded 23417 existing records from primary storage. [2025-10-15T19:44:54.736519] [INFO ] [MAIN ] KB: Loaded 23417 existing records. [2025-10-15T19:44:54.926094] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:54.926354] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-15T19:44:54.926409] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-15T19:44:54.926756] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-15T19:44:54.926814] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-15T19:44:55.318577] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:55.314559] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-15T19:44:55.353814] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T19:44:55.358738] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T19:44:56.114035] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-15T19:44:56.868025] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:44:56.913950] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-15T19:44:57.393264] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T19:44:57.714055] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-15T19:44:58.498303] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T19:44:58.513955] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-15T19:44:59.225153] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:44:59.313960] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-15T19:45:00.072185] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:45:00.113954] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-15T19:45:00.480585] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T19:45:00.914004] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-15T19:45:01.646732] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T19:45:01.653129] [INFO ] [REMOTE ] JXN: Full fetch complete (65500 records). [2025-10-15T19:45:01.653341] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-15T19:45:01.719784] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-15T19:45:02.050861] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-15T19:45:02.050954] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-15T19:45:02.051943] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-15T19:45:02.052008] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-15T19:45:02.053386] [DEBUG] [LOCAL ] JXN: Trimmed 65500 records to 44730 (keeping 200 days of data) [2025-10-15T19:45:02.333539] [DEBUG] [LOCAL ] JXN: Primary data saved (44730 records). [2025-10-15T19:45:02.333900] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-15T19:45:02.334057] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JXN took 42.1s. Estimated remaining: 2h 48m 29s. Rate: 7.1 symbols/min [2025-10-15T19:45:02.525255] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:02.525413] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-15T19:45:02.549933] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:45:02.581506] [DEBUG] [LOCAL ] KBDC: Loaded 22139 existing records from primary storage. [2025-10-15T19:45:02.581868] [INFO ] [MAIN ] KBDC: Loaded 22139 existing records. [2025-10-15T19:45:02.793254] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:02.793698] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-15T19:45:02.799713] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-15T19:45:02.802583] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T19:45:02.802686] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-15T19:45:02.802865] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-15T19:45:03.177771] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:03.314018] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-15T19:45:03.837750] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T19:45:04.114021] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-15T19:45:04.290681] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:45:04.869775] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T19:45:04.913955] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-15T19:45:05.714059] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-15T19:45:06.063037] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T19:45:06.514040] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-15T19:45:06.650841] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T19:45:07.314008] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-15T19:45:07.921639] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:45:07.941050] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T19:45:08.114006] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-15T19:45:08.914049] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-15T19:45:09.167846] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T19:45:09.713959] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-15T19:45:10.122925] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T19:45:10.514063] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-15T19:45:11.177576] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T19:45:11.314042] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-15T19:45:11.762764] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:45:12.114011] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-15T19:45:12.613461] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:45:12.914031] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-15T19:45:13.359369] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T19:45:13.714000] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-15T19:45:14.359833] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:45:14.364637] [INFO ] [REMOTE ] KAR: Full fetch complete (57044 records). [2025-10-15T19:45:14.364774] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-15T19:45:14.517597] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-15T19:45:14.757010] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-15T19:45:14.757109] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-15T19:45:14.758140] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-15T19:45:14.758216] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-15T19:45:14.759362] [DEBUG] [LOCAL ] KAR: Trimmed 57044 records to 40054 (keeping 200 days of data) [2025-10-15T19:45:15.000257] [DEBUG] [LOCAL ] KAR: Primary data saved (40054 records). [2025-10-15T19:45:15.000409] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-15T19:45:15.000602] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. KAR took 34.6s. Estimated remaining: 2h 48m 25s. Rate: 7.1 symbols/min [2025-10-15T19:45:15.080103] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T19:45:15.193487] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:15.241700] [DEBUG] [LOCAL ] KBH: Loaded 48836 existing records from primary storage. [2025-10-15T19:45:15.241990] [INFO ] [MAIN ] KBH: Loaded 48836 existing records. [2025-10-15T19:45:15.315556] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-15T19:45:15.420503] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:15.420709] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-15T19:45:15.420778] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-15T19:45:15.421202] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-15T19:45:15.421257] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-15T19:45:15.531847] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:45:15.554635] [INFO ] [REMOTE ] KAI: Full fetch complete (19121 records). [2025-10-15T19:45:15.572048] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-15T19:45:16.037010] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:16.123698] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-15T19:45:16.169531] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-15T19:45:16.169625] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-15T19:45:16.170145] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-15T19:45:16.170209] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-15T19:45:16.170840] [DEBUG] [LOCAL ] KAI: Trimmed 19121 records to 13579 (keeping 200 days of data) [2025-10-15T19:45:16.256695] [DEBUG] [LOCAL ] KAI: Primary data saved (13579 records). [2025-10-15T19:45:16.256851] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-15T19:45:16.256932] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. KAI took 42.7s. Estimated remaining: 2h 48m 9s. Rate: 7.1 symbols/min [2025-10-15T19:45:16.434690] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:16.451605] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:45:16.497292] [DEBUG] [LOCAL ] KBR: Loaded 48037 existing records from primary storage. [2025-10-15T19:45:16.497632] [INFO ] [MAIN ] KBR: Loaded 48037 existing records. [2025-10-15T19:45:16.671398] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:16.671631] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-15T19:45:16.671713] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-15T19:45:16.672080] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-15T19:45:16.672146] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-15T19:45:16.919154] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-15T19:45:17.021045] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:17.595243] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:45:17.714023] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-15T19:45:18.072857] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:45:18.514050] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-15T19:45:19.320935] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-15T19:45:19.328086] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:45:19.610735] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:45:20.114061] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-15T19:45:20.913989] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-15T19:45:20.968073] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:45:21.525983] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:45:21.714021] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-15T19:45:21.931900] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T19:45:21.934465] [INFO ] [REMOTE ] KB: Full fetch complete (33681 records). [2025-10-15T19:45:21.934544] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-15T19:45:22.307815] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-15T19:45:22.307928] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-15T19:45:22.308705] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-15T19:45:22.308783] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-15T19:45:22.309840] [DEBUG] [LOCAL ] KB: Trimmed 33681 records to 23340 (keeping 200 days of data) [2025-10-15T19:45:22.455420] [DEBUG] [LOCAL ] KB: Primary data saved (23340 records). [2025-10-15T19:45:22.455543] [INFO ] [MAIN ] KB: Full history saved. [2025-10-15T19:45:22.455620] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KB took 27.9s. Estimated remaining: 2h 47m 58s. Rate: 7.1 symbols/min [2025-10-15T19:45:22.519333] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-15T19:45:22.647332] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:22.695199] [DEBUG] [LOCAL ] KD: Loaded 52358 existing records from primary storage. [2025-10-15T19:45:22.695520] [INFO ] [MAIN ] KD: Loaded 52358 existing records. [2025-10-15T19:45:22.867685] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:22.867873] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-15T19:45:22.867919] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-15T19:45:22.868297] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-15T19:45:22.868352] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-15T19:45:23.215204] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:23.313961] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-15T19:45:23.466938] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:45:24.114053] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-15T19:45:24.183766] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T19:45:24.878660] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:45:24.913974] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-15T19:45:25.692335] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:45:25.713987] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-15T19:45:26.514008] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-15T19:45:26.761747] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T19:45:27.313994] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-15T19:45:27.485564] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:45:27.975902] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:45:28.113970] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-15T19:45:28.309036] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:45:28.914014] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-15T19:45:29.713976] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-15T19:45:29.819310] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:45:30.473767] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:45:30.513959] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-15T19:45:30.654390] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:45:31.314042] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-15T19:45:32.113982] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-15T19:45:32.155072] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:45:32.919074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-15T19:45:32.937568] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:45:33.145157] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T19:45:33.714036] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-15T19:45:34.514043] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-15T19:45:34.674383] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T19:45:34.773813] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T19:45:35.314025] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-15T19:45:35.713120] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:45:36.113993] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-15T19:45:36.646297] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:45:36.914028] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-15T19:45:37.713974] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-15T19:45:37.955675] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T19:45:38.236883] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:45:38.241001] [INFO ] [REMOTE ] KBDC: Full fetch complete (30201 records). [2025-10-15T19:45:38.241075] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-15T19:45:38.519238] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-15T19:45:38.620016] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-15T19:45:38.620107] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-15T19:45:38.620837] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-15T19:45:38.620934] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-15T19:45:38.621789] [DEBUG] [LOCAL ] KBDC: Trimmed 30201 records to 22209 (keeping 200 days of data) [2025-10-15T19:45:38.757849] [DEBUG] [LOCAL ] KBDC: Primary data saved (22209 records). [2025-10-15T19:45:38.757972] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-15T19:45:38.758048] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KBDC took 36.4s. Estimated remaining: 2h 47m 58s. Rate: 7.1 symbols/min [2025-10-15T19:45:38.923895] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:38.930032] [DEBUG] [LOCAL ] KEN: Loaded 4689 existing records from primary storage. [2025-10-15T19:45:38.930238] [INFO ] [MAIN ] KEN: Loaded 4689 existing records. [2025-10-15T19:45:39.104833] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:39.105037] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-15T19:45:39.105084] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-15T19:45:39.105222] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-15T19:45:39.105263] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-15T19:45:39.320816] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-15T19:45:39.472636] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:39.537214] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:45:40.123093] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-15T19:45:40.147696] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:45:40.913968] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-15T19:45:41.106420] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T19:45:41.714028] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-15T19:45:41.744758] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T19:45:42.386234] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T19:45:42.514041] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-15T19:45:42.726999] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T19:45:43.314057] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-15T19:45:44.113981] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-15T19:45:44.208980] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T19:45:44.736634] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:45:44.914039] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-15T19:45:44.950012] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T19:45:45.352205] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T19:45:45.714007] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-15T19:45:46.514046] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-15T19:45:47.072950] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T19:45:47.314024] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-15T19:45:47.473847] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T19:45:48.054709] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T19:45:48.114015] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-15T19:45:48.697477] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T19:45:48.914005] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-15T19:45:49.714091] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-15T19:45:50.514017] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-15T19:45:50.582223] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:45:50.588368] [INFO ] [REMOTE ] KBH: Full fetch complete (71086 records). [2025-10-15T19:45:50.588521] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-15T19:45:50.971282] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-15T19:45:50.971360] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-15T19:45:50.972365] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-15T19:45:50.972429] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-15T19:45:50.973838] [DEBUG] [LOCAL ] KBH: Trimmed 71086 records to 48840 (keeping 200 days of data) [2025-10-15T19:45:51.274560] [DEBUG] [LOCAL ] KBH: Primary data saved (48840 records). [2025-10-15T19:45:51.274746] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-15T19:45:51.274839] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KBH took 36.3s. Estimated remaining: 2h 47m 54s. Rate: 7.1 symbols/min [2025-10-15T19:45:51.318026] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-15T19:45:51.449073] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:51.478233] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:45:51.514186] [DEBUG] [LOCAL ] KEP: Loaded 31864 existing records from primary storage. [2025-10-15T19:45:51.514473] [INFO ] [MAIN ] KEP: Loaded 31864 existing records. [2025-10-15T19:45:51.691696] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:51.691893] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-15T19:45:51.691953] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-15T19:45:51.692259] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-15T19:45:51.692298] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-15T19:45:52.048184] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:52.075166] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:45:52.088836] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T19:45:52.113952] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-15T19:45:52.914074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-15T19:45:53.492059] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T19:45:53.714011] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-15T19:45:54.514030] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-15T19:45:54.695524] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T19:45:54.730362] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:45:55.314004] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-15T19:45:55.810604] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T19:45:55.816587] [INFO ] [REMOTE ] KBR: Full fetch complete (69970 records). [2025-10-15T19:45:55.816747] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-15T19:45:56.122096] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-15T19:45:56.267398] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-15T19:45:56.267506] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-15T19:45:56.268632] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-15T19:45:56.268724] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-15T19:45:56.270181] [DEBUG] [LOCAL ] KBR: Trimmed 69970 records to 48081 (keeping 200 days of data) [2025-10-15T19:45:56.486450] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T19:45:56.628062] [DEBUG] [LOCAL ] KBR: Primary data saved (48081 records). [2025-10-15T19:45:56.628299] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-15T19:45:56.629287] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBR took 40.4s. Estimated remaining: 2h 47m 42s. Rate: 7.1 symbols/min [2025-10-15T19:45:56.815422] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:56.854781] [DEBUG] [LOCAL ] KEX: Loaded 38548 existing records from primary storage. [2025-10-15T19:45:56.855082] [INFO ] [MAIN ] KEX: Loaded 38548 existing records. [2025-10-15T19:45:56.919162] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-15T19:45:57.039979] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:57.040207] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-15T19:45:57.040255] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-15T19:45:57.040689] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-15T19:45:57.040747] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-15T19:45:57.394989] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:57.585254] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T19:45:57.713979] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-15T19:45:58.143594] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T19:45:58.514025] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-15T19:45:58.855360] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T19:45:59.314006] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-15T19:46:00.054728] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:46:00.113967] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-15T19:46:00.530381] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T19:46:00.914001] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-15T19:46:01.654708] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-15T19:46:01.713999] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-15T19:46:01.785878] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T19:46:02.281973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:46:02.514035] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-15T19:46:03.314311] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-15T19:46:03.979855] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T19:46:03.980975] [INFO ] [REMOTE ] KEN: Full fetch complete (5971 records). [2025-10-15T19:46:03.981046] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-15T19:46:04.126759] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-15T19:46:04.384578] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-15T19:46:04.384682] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-15T19:46:04.384886] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-15T19:46:04.384926] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-15T19:46:04.385289] [DEBUG] [LOCAL ] KEN: Trimmed 5971 records to 4705 (keeping 200 days of data) [2025-10-15T19:46:04.413708] [DEBUG] [LOCAL ] KEN: Primary data saved (4705 records). [2025-10-15T19:46:04.413855] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-15T19:46:04.413943] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KEN took 25.7s. Estimated remaining: 2h 47m 33s. Rate: 7.1 symbols/min [2025-10-15T19:46:04.559694] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T19:46:04.633375] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:04.633765] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-15T19:46:04.633820] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-15T19:46:04.633970] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-15T19:46:04.634011] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-15T19:46:04.634051] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-15T19:46:04.634082] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-15T19:46:04.919163] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-15T19:46:04.983966] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:05.255334] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T19:46:05.714064] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-15T19:46:06.320758] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T19:46:06.513992] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-15T19:46:07.313990] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-15T19:46:07.588302] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T19:46:08.054359] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:46:08.113993] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-15T19:46:08.480509] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T19:46:08.913985] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-15T19:46:09.619996] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:46:09.713985] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-15T19:46:10.386922] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:46:10.513990] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-15T19:46:11.112067] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T19:46:11.314000] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-15T19:46:12.010725] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:46:12.113948] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-15T19:46:12.717078] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T19:46:12.913979] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-15T19:46:13.714057] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-15T19:46:13.880533] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:46:14.514065] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-15T19:46:14.549177] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:46:14.555430] [INFO ] [REMOTE ] KD: Full fetch complete (76015 records). [2025-10-15T19:46:14.555558] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-15T19:46:14.961580] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-15T19:46:14.961715] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-15T19:46:14.962827] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-15T19:46:14.962912] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-15T19:46:14.964574] [DEBUG] [LOCAL ] KD: Trimmed 76015 records to 52354 (keeping 200 days of data) [2025-10-15T19:46:15.070983] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:46:15.303346] [DEBUG] [LOCAL ] KD: Primary data saved (52354 records). [2025-10-15T19:46:15.303496] [INFO ] [MAIN ] KD: Full history saved. [2025-10-15T19:46:15.303896] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KD took 52.8s. Estimated remaining: 2h 47m 27s. Rate: 7.1 symbols/min [2025-10-15T19:46:15.319131] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-15T19:46:15.478544] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:15.524793] [DEBUG] [LOCAL ] KEYS: Loaded 43320 existing records from primary storage. [2025-10-15T19:46:15.525098] [INFO ] [MAIN ] KEYS: Loaded 43320 existing records. [2025-10-15T19:46:15.700568] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:15.700834] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-15T19:46:15.700887] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-15T19:46:15.701230] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-15T19:46:15.701287] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-15T19:46:16.066385] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:16.114018] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-15T19:46:16.437603] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T19:46:16.914042] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-15T19:46:16.938118] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:46:17.407527] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T19:46:17.714054] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-15T19:46:17.928458] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:46:17.932362] [INFO ] [REMOTE ] KEP: Full fetch complete (42091 records). [2025-10-15T19:46:17.932442] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-15T19:46:18.298037] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-15T19:46:18.298115] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-15T19:46:18.298903] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-15T19:46:18.298967] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-15T19:46:18.300012] [DEBUG] [LOCAL ] KEP: Trimmed 42091 records to 31996 (keeping 200 days of data) [2025-10-15T19:46:18.484719] [DEBUG] [LOCAL ] KEP: Primary data saved (31996 records). [2025-10-15T19:46:18.484871] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-15T19:46:18.484953] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KEP took 27.2s. Estimated remaining: 2h 47m 13s. Rate: 7.1 symbols/min [2025-10-15T19:46:18.519145] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-15T19:46:18.668335] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:18.672506] [DEBUG] [LOCAL ] KF: Loaded 2339 existing records from primary storage. [2025-10-15T19:46:18.672717] [INFO ] [MAIN ] KF: Loaded 2339 existing records. [2025-10-15T19:46:18.887435] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T19:46:18.892185] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:18.899053] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-15T19:46:18.899159] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-15T19:46:18.899554] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-15T19:46:18.899617] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-15T19:46:19.245435] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:19.313989] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-15T19:46:20.113972] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-15T19:46:20.363695] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:46:20.803317] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:46:20.914029] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-15T19:46:21.166532] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:46:21.714029] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-15T19:46:22.513998] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-15T19:46:22.816985] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T19:46:23.170917] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T19:46:23.322484] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-15T19:46:23.324907] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:46:24.113985] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-15T19:46:24.914033] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-15T19:46:25.020408] [DEBUG] [REMOTE ] KF: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-15T19:46:25.020744] [WARN ] [REMOTE ] KF: No data returned for month 2025-01 [2025-10-15T19:46:25.020835] [FATAL] [REMOTE ] KF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:46:25.020947] [FATAL] [MAIN ] KF: Failed to fetch primary data. [2025-10-15T19:46:25.021026] [WARN ] [MAIN ] KF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:46:25.021111] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-15T19:46:25.021188] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-10-15T19:46:25.021239] [INFO ] [LOCAL ] KF: Starting deletion of derivative data. [2025-10-15T19:46:25.021462] [DEBUG] [LOCAL ] KF: Deleted derivative data file. [2025-10-15T19:46:25.021562] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KF took 6.5s. Estimated remaining: 2h 47m 3s. Rate: 7.1 symbols/min [2025-10-15T19:46:25.193934] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:25.213034] [DEBUG] [LOCAL ] KFRC: Loaded 20396 existing records from primary storage. [2025-10-15T19:46:25.213292] [INFO ] [MAIN ] KFRC: Loaded 20396 existing records. [2025-10-15T19:46:25.401156] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:25.401490] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-15T19:46:25.401623] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-15T19:46:25.402010] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-15T19:46:25.431327] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-15T19:46:25.477363] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-15T19:46:25.714582] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-15T19:46:25.836677] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:25.873949] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:46:26.513999] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-15T19:46:26.925067] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T19:46:27.314040] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-15T19:46:27.394432] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:46:28.114073] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-15T19:46:28.914031] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-15T19:46:29.006085] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:46:29.719133] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-15T19:46:29.732193] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T19:46:30.297187] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T19:46:30.513970] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-15T19:46:30.728321] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:46:31.314002] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-15T19:46:32.097149] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T19:46:32.113991] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-15T19:46:32.148405] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T19:46:32.913982] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-15T19:46:33.668672] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:46:33.713962] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-15T19:46:34.459408] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T19:46:34.464515] [INFO ] [REMOTE ] KEX: Full fetch complete (55940 records). [2025-10-15T19:46:34.464610] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-15T19:46:34.526116] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-15T19:46:34.841793] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-15T19:46:34.841886] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-15T19:46:34.842809] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-15T19:46:34.842871] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-15T19:46:34.843955] [DEBUG] [LOCAL ] KEX: Trimmed 55940 records to 38604 (keeping 200 days of data) [2025-10-15T19:46:35.074532] [DEBUG] [LOCAL ] KEX: Primary data saved (38604 records). [2025-10-15T19:46:35.074698] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-15T19:46:35.074790] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEX took 38.4s. Estimated remaining: 2h 46m 56s. Rate: 7.1 symbols/min [2025-10-15T19:46:35.260916] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:35.271292] [DEBUG] [LOCAL ] KFS: Loaded 8695 existing records from primary storage. [2025-10-15T19:46:35.271701] [INFO ] [MAIN ] KFS: Loaded 8695 existing records. [2025-10-15T19:46:35.318412] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-15T19:46:35.456372] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:46:35.507774] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:35.508039] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-15T19:46:35.508094] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-15T19:46:35.508257] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-15T19:46:35.508315] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-15T19:46:35.881700] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:36.113965] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-15T19:46:36.315604] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T19:46:36.354460] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T19:46:36.447243] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T19:46:36.914027] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-15T19:46:37.574430] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T19:46:37.713997] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-15T19:46:38.346847] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T19:46:38.513992] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-15T19:46:39.313973] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-15T19:46:39.461248] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:46:40.113987] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-15T19:46:40.680506] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T19:46:40.707060] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:46:40.913986] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-15T19:46:41.714033] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-15T19:46:42.488061] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T19:46:42.513958] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-15T19:46:42.769539] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T19:46:43.314012] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-15T19:46:43.999099] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T19:46:44.010605] [INFO ] [REMOTE ] KEYS: Full fetch complete (62900 records). [2025-10-15T19:46:44.011369] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T19:46:44.011474] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-15T19:46:44.119061] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-15T19:46:44.436924] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-15T19:46:44.437014] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-15T19:46:44.438170] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-15T19:46:44.438243] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-15T19:46:44.439582] [DEBUG] [LOCAL ] KEYS: Trimmed 62900 records to 43274 (keeping 200 days of data) [2025-10-15T19:46:44.706873] [DEBUG] [LOCAL ] KEYS: Primary data saved (43274 records). [2025-10-15T19:46:44.706998] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-15T19:46:44.707240] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEYS took 29.4s. Estimated remaining: 2h 46m 49s. Rate: 7.1 symbols/min [2025-10-15T19:46:44.876449] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:44.905417] [DEBUG] [LOCAL ] KFY: Loaded 29975 existing records from primary storage. [2025-10-15T19:46:44.905700] [INFO ] [MAIN ] KFY: Loaded 29975 existing records. [2025-10-15T19:46:44.919173] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-15T19:46:45.023843] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T19:46:45.099423] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:45.099683] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-15T19:46:45.100445] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-15T19:46:45.100724] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-15T19:46:45.100780] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-15T19:46:45.457530] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:45.671239] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:46:45.713960] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-15T19:46:46.461612] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T19:46:46.514012] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-15T19:46:47.241537] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T19:46:47.314014] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-15T19:46:48.114021] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-15T19:46:48.378451] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:46:48.911776] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:46:48.914137] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-15T19:46:49.714054] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-15T19:46:50.084394] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T19:46:50.501056] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T19:46:50.513950] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-15T19:46:51.312913] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:46:51.314283] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-15T19:46:51.315799] [INFO ] [REMOTE ] KFS: Full fetch complete (10979 records). [2025-10-15T19:46:51.315875] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-15T19:46:51.688723] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-15T19:46:51.688796] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-15T19:46:51.689089] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-15T19:46:51.689128] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-15T19:46:51.689570] [DEBUG] [LOCAL ] KFS: Trimmed 10979 records to 8664 (keeping 200 days of data) [2025-10-15T19:46:51.738914] [DEBUG] [LOCAL ] KFS: Primary data saved (8664 records). [2025-10-15T19:46:51.739037] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-15T19:46:51.739112] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KFS took 16.7s. Estimated remaining: 2h 46m 39s. Rate: 7.1 symbols/min [2025-10-15T19:46:51.908730] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:51.963058] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-15T19:46:51.963415] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-15T19:46:52.120614] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-15T19:46:52.142726] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:52.142964] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-15T19:46:52.143076] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-15T19:46:52.143744] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-15T19:46:52.143823] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-15T19:46:52.498971] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:52.913969] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-15T19:46:53.165895] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T19:46:53.175023] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-15T19:46:53.175237] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-15T19:46:53.380418] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T19:46:53.381392] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:46:53.381508] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:46:53.381737] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-15T19:46:53.381831] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-15T19:46:53.381900] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-15T19:46:53.381981] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-15T19:46:53.382112] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KEY took 49.0s. Estimated remaining: 2h 46m 24s. Rate: 7.1 symbols/min [2025-10-15T19:46:53.563429] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:53.588307] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:46:53.636676] [DEBUG] [LOCAL ] KGS: Loaded 46153 existing records from primary storage. [2025-10-15T19:46:53.637000] [INFO ] [MAIN ] KGS: Loaded 46153 existing records. [2025-10-15T19:46:53.719221] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-15T19:46:53.823672] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:53.823877] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-15T19:46:53.823927] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-15T19:46:53.824314] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-15T19:46:53.824371] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-15T19:46:54.212000] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:54.514004] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-15T19:46:54.680739] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T19:46:54.932822] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T19:46:55.314021] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-15T19:46:56.064625] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:46:56.113962] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-15T19:46:56.704431] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:46:56.914037] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-15T19:46:57.334234] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T19:46:57.713968] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-15T19:46:58.444121] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:46:58.513984] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-15T19:46:58.850122] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T19:46:59.314050] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-15T19:46:59.901452] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:47:00.114006] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-15T19:47:00.914059] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-15T19:47:01.361491] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:47:01.546457] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T19:47:01.714014] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-15T19:47:02.247354] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T19:47:02.514072] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-15T19:47:02.995457] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T19:47:02.999123] [INFO ] [REMOTE ] KFRC: Full fetch complete (26496 records). [2025-10-15T19:47:02.999203] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-15T19:47:03.319117] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-15T19:47:03.377763] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-15T19:47:03.377843] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-15T19:47:03.378422] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-15T19:47:03.378461] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-15T19:47:03.379274] [DEBUG] [LOCAL ] KFRC: Trimmed 26496 records to 20493 (keeping 200 days of data) [2025-10-15T19:47:03.503404] [DEBUG] [LOCAL ] KFRC: Primary data saved (20493 records). [2025-10-15T19:47:03.503527] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-15T19:47:03.503605] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KFRC took 38.5s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-15T19:47:03.670745] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:03.726312] [DEBUG] [LOCAL ] KIM: Loaded 52997 existing records from primary storage. [2025-10-15T19:47:03.726615] [INFO ] [MAIN ] KIM: Loaded 52997 existing records. [2025-10-15T19:47:03.905680] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:03.905918] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-15T19:47:03.905965] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-15T19:47:03.906487] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-15T19:47:03.906545] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-15T19:47:04.134760] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-15T19:47:04.279695] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:04.421439] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T19:47:04.914025] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-15T19:47:05.033579] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:47:05.512480] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T19:47:05.714024] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-15T19:47:06.514001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-15T19:47:06.685100] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:47:07.054213] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T19:47:07.314011] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-15T19:47:08.114011] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-15T19:47:08.203185] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T19:47:08.736824] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:47:08.914011] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-15T19:47:09.489212] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T19:47:09.713985] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-15T19:47:10.383778] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:47:10.513995] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-15T19:47:11.314067] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-15T19:47:11.846905] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T19:47:11.897616] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:47:12.114001] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-15T19:47:12.469575] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T19:47:12.913983] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-15T19:47:13.713979] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-15T19:47:14.192675] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-15T19:47:14.495593] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:47:14.513950] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-15T19:47:14.980444] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T19:47:15.314048] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-15T19:47:16.113998] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-15T19:47:16.492336] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T19:47:16.752143] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:47:16.914016] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-15T19:47:17.321623] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T19:47:17.325958] [INFO ] [REMOTE ] KFY: Full fetch complete (43402 records). [2025-10-15T19:47:17.326084] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-15T19:47:17.719346] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-15T19:47:17.767571] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-15T19:47:17.767744] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-15T19:47:17.768856] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-15T19:47:17.768925] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-15T19:47:17.770389] [DEBUG] [LOCAL ] KFY: Trimmed 43402 records to 29991 (keeping 200 days of data) [2025-10-15T19:47:17.969852] [DEBUG] [LOCAL ] KFY: Primary data saved (29991 records). [2025-10-15T19:47:17.969983] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-15T19:47:17.970065] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFY took 33.3s. Estimated remaining: 2h 46m 14s. Rate: 7.1 symbols/min [2025-10-15T19:47:18.150796] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:18.172763] [DEBUG] [LOCAL ] KIO: Loaded 21606 existing records from primary storage. [2025-10-15T19:47:18.173077] [INFO ] [MAIN ] KIO: Loaded 21606 existing records. [2025-10-15T19:47:18.351547] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:18.351938] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-15T19:47:18.352080] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-15T19:47:18.352392] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-15T19:47:18.352453] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-15T19:47:18.527995] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-15T19:47:18.744219] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:18.747092] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:47:19.314046] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-15T19:47:19.816117] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:47:20.114065] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-15T19:47:20.167541] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:47:20.537562] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:47:20.914053] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-15T19:47:21.714030] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-15T19:47:21.928230] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T19:47:22.257214] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T19:47:22.514001] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-15T19:47:23.240246] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T19:47:23.314005] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-15T19:47:24.114002] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-15T19:47:24.461763] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T19:47:24.913965] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-15T19:47:25.012146] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:47:25.713985] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-15T19:47:25.857907] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T19:47:26.514019] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-15T19:47:27.313990] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-15T19:47:27.410383] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-15T19:47:27.416883] [INFO ] [REMOTE ] KGC: Full fetch complete (77870 records). [2025-10-15T19:47:27.417012] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-15T19:47:27.749133] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T19:47:27.872799] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-15T19:47:27.872895] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-15T19:47:27.874079] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-15T19:47:27.874148] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-15T19:47:27.875871] [DEBUG] [LOCAL ] KGC: Trimmed 77870 records to 53700 (keeping 200 days of data) [2025-10-15T19:47:28.114747] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-15T19:47:28.157555] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:47:28.191766] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T19:47:28.286067] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-15T19:47:28.286201] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-15T19:47:28.287218] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KGC took 36.5s. Estimated remaining: 2h 46m 8s. Rate: 7.1 symbols/min [2025-10-15T19:47:28.460052] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:28.460215] [DEBUG] [LOCAL ] KKR: No existing data file found in primary storage. [2025-10-15T19:47:28.460251] [WARN ] [MAIN ] KKR: No existing data found, performing full refresh instead. [2025-10-15T19:47:28.460356] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-15T19:47:28.460397] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-15T19:47:28.460437] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-10-15T19:47:28.460468] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-15T19:47:28.830681] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:28.914003] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-15T19:47:29.714026] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-15T19:47:29.828164] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T19:47:30.514065] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-15T19:47:30.812806] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T19:47:31.313983] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-15T19:47:31.334026] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T19:47:31.339960] [INFO ] [REMOTE ] KGS: Full fetch complete (66538 records). [2025-10-15T19:47:31.340085] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-15T19:47:31.730258] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-15T19:47:31.730347] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-15T19:47:31.731494] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-15T19:47:31.731575] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-15T19:47:31.733018] [DEBUG] [LOCAL ] KGS: Trimmed 66538 records to 46135 (keeping 200 days of data) [2025-10-15T19:47:32.018976] [DEBUG] [LOCAL ] KGS: Primary data saved (46135 records). [2025-10-15T19:47:32.019148] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-15T19:47:32.019239] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KGS took 38.6s. Estimated remaining: 2h 45m 55s. Rate: 7.1 symbols/min [2025-10-15T19:47:32.116359] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-15T19:47:32.193020] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:32.226933] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:47:32.230361] [DEBUG] [LOCAL ] KKRS: Loaded 5647 existing records from primary storage. [2025-10-15T19:47:32.242381] [INFO ] [MAIN ] KKRS: Loaded 5647 existing records. [2025-10-15T19:47:32.357144] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T19:47:32.440802] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:32.441045] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-15T19:47:32.441129] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-15T19:47:32.441323] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-15T19:47:32.441380] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-15T19:47:32.799864] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:32.914008] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-15T19:47:33.713977] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-15T19:47:33.864781] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:47:34.039968] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T19:47:34.514008] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-15T19:47:35.313996] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-15T19:47:35.467758] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:47:35.474063] [INFO ] [REMOTE ] KIM: Full fetch complete (76965 records). [2025-10-15T19:47:35.474185] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-15T19:47:35.884154] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-15T19:47:35.884310] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-15T19:47:35.885378] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-15T19:47:35.885443] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-15T19:47:35.886979] [DEBUG] [LOCAL ] KIM: Trimmed 76965 records to 53004 (keeping 200 days of data) [2025-10-15T19:47:35.989798] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T19:47:36.114317] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-15T19:47:36.152805] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T19:47:36.267355] [DEBUG] [LOCAL ] KIM: Primary data saved (53004 records). [2025-10-15T19:47:36.267484] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-15T19:47:36.267573] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KIM took 32.8s. Estimated remaining: 2h 45m 42s. Rate: 7.1 symbols/min [2025-10-15T19:47:36.437288] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:36.437465] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-15T19:47:36.437503] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-15T19:47:36.437612] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-15T19:47:36.437681] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-15T19:47:36.437787] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-15T19:47:36.437835] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-15T19:47:36.719399] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T19:47:36.805834] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:36.913961] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-15T19:47:37.100044] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:47:37.100349] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-15T19:47:37.100439] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:47:37.100507] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-15T19:47:37.100572] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:47:37.100701] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-15T19:47:37.100785] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-15T19:47:37.100825] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-15T19:47:37.100910] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-15T19:47:37.100966] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KKRT took 0.8s. Estimated remaining: 2h 45m 26s. Rate: 7.1 symbols/min [2025-10-15T19:47:37.283383] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:37.283583] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-15T19:47:37.283640] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-15T19:47:37.283771] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-15T19:47:37.283812] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-15T19:47:37.283854] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-15T19:47:37.283888] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-15T19:47:37.637196] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:37.713969] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-15T19:47:37.896743] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:47:37.897056] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-15T19:47:37.897139] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:47:37.897187] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-15T19:47:37.897246] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:47:37.897316] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-15T19:47:37.897377] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-15T19:47:37.897411] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-15T19:47:37.897449] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-15T19:47:37.897494] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 45m 10s. Rate: 7.1 symbols/min [2025-10-15T19:47:38.067588] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:38.103871] [DEBUG] [LOCAL ] KLC: Loaded 36536 existing records from primary storage. [2025-10-15T19:47:38.104135] [INFO ] [MAIN ] KLC: Loaded 36536 existing records. [2025-10-15T19:47:38.277251] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:38.277465] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-15T19:47:38.277511] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-15T19:47:38.277834] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-15T19:47:38.277891] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-15T19:47:38.520471] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-15T19:47:38.639163] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:39.131481] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:47:39.313982] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-15T19:47:40.113996] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-15T19:47:40.665984] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:47:40.914056] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-15T19:47:41.427967] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T19:47:41.645384] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T19:47:41.714005] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-15T19:47:42.419298] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T19:47:42.513991] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-15T19:47:43.095049] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T19:47:43.313997] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-15T19:47:44.114011] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-15T19:47:44.678752] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:47:44.770626] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:47:44.913999] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-15T19:47:45.482397] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T19:47:45.713998] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-15T19:47:46.513965] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-15T19:47:46.987478] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:47:47.313968] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-15T19:47:47.545580] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:47:48.113970] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-15T19:47:48.428774] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T19:47:48.820451] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T19:47:48.914002] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-15T19:47:49.396783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T19:47:49.714008] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-15T19:47:50.513987] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-15T19:47:50.719168] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:47:51.075774] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T19:47:51.076973] [INFO ] [REMOTE ] KKRS: Full fetch complete (7681 records). [2025-10-15T19:47:51.077047] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-15T19:47:51.322868] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-15T19:47:51.464267] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-15T19:47:51.464377] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-15T19:47:51.464704] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-15T19:47:51.464772] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-15T19:47:51.465403] [DEBUG] [LOCAL ] KKRS: Trimmed 7681 records to 5638 (keeping 200 days of data) [2025-10-15T19:47:51.504056] [DEBUG] [LOCAL ] KKRS: Primary data saved (5638 records). [2025-10-15T19:47:51.504268] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-15T19:47:51.504377] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KKRS took 19.5s. Estimated remaining: 2h 45m 7s. Rate: 7.1 symbols/min [2025-10-15T19:47:51.733132] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:51.794409] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-15T19:47:51.794899] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-15T19:47:51.977876] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:51.978117] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-15T19:47:51.978167] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-15T19:47:51.978581] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-15T19:47:51.978694] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-15T19:47:52.119235] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-15T19:47:52.383839] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:52.786101] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:47:52.913994] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-15T19:47:53.714006] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-15T19:47:53.903292] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T19:47:54.393513] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T19:47:54.514015] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-15T19:47:55.217475] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:47:55.313976] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-15T19:47:56.113979] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-15T19:47:56.441855] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T19:47:56.904908] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T19:47:56.913951] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-15T19:47:57.107804] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:47:57.714008] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-15T19:47:58.011569] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:47:58.514003] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-15T19:47:59.314037] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-15T19:47:59.420191] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T19:47:59.713465] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:48:00.113996] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-15T19:48:00.914021] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-15T19:48:01.336173] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T19:48:01.339490] [INFO ] [REMOTE ] KIO: Full fetch complete (31837 records). [2025-10-15T19:48:01.339569] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-15T19:48:01.678515] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-15T19:48:01.715264] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-15T19:48:01.781897] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-15T19:48:01.781988] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-15T19:48:01.782726] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-15T19:48:01.782792] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-15T19:48:01.783743] [DEBUG] [LOCAL ] KIO: Trimmed 31837 records to 21606 (keeping 200 days of data) [2025-10-15T19:48:01.920364] [DEBUG] [LOCAL ] KIO: Primary data saved (21606 records). [2025-10-15T19:48:01.920498] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-15T19:48:01.920576] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KIO took 44.0s. Estimated remaining: 2h 45m 0s. Rate: 7.1 symbols/min [2025-10-15T19:48:02.084377] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:02.089522] [DEBUG] [LOCAL ] KMPB: Loaded 3693 existing records from primary storage. [2025-10-15T19:48:02.089710] [INFO ] [MAIN ] KMPB: Loaded 3693 existing records. [2025-10-15T19:48:02.265591] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:02.265823] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-15T19:48:02.265876] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-15T19:48:02.266012] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-15T19:48:02.266049] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-15T19:48:02.519077] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-15T19:48:02.628936] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:02.877490] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T19:48:03.044219] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:48:03.314071] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-15T19:48:04.114007] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-15T19:48:04.267288] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:48:04.658997] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T19:48:04.914030] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-15T19:48:05.262589] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T19:48:05.279702] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:48:05.714061] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-15T19:48:06.513996] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-15T19:48:07.035509] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:48:07.313988] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-15T19:48:08.113964] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-15T19:48:08.441877] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T19:48:08.779929] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T19:48:08.914001] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-15T19:48:09.713998] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-15T19:48:09.929095] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:48:10.374601] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T19:48:10.514005] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-15T19:48:10.987268] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T19:48:11.313960] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-15T19:48:11.393557] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:48:12.113995] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-15T19:48:12.733561] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T19:48:12.738225] [INFO ] [REMOTE ] KLC: Full fetch complete (50544 records). [2025-10-15T19:48:12.738329] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-15T19:48:12.922545] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-15T19:48:13.122302] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-15T19:48:13.122400] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-15T19:48:13.123286] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-15T19:48:13.123347] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-15T19:48:13.124511] [DEBUG] [LOCAL ] KLC: Trimmed 50544 records to 36505 (keeping 200 days of data) [2025-10-15T19:48:13.329906] [DEBUG] [LOCAL ] KLC: Primary data saved (36505 records). [2025-10-15T19:48:13.330038] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-15T19:48:13.330116] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KLC took 35.4s. Estimated remaining: 2h 44m 55s. Rate: 7.1 symbols/min [2025-10-15T19:48:13.515321] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:13.552582] [DEBUG] [LOCAL ] KMPR: Loaded 39849 existing records from primary storage. [2025-10-15T19:48:13.552916] [INFO ] [MAIN ] KMPR: Loaded 39849 existing records. [2025-10-15T19:48:13.666233] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T19:48:13.718832] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-15T19:48:13.760916] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:13.761165] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-15T19:48:13.761213] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-15T19:48:13.761612] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-15T19:48:13.761696] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-15T19:48:14.124916] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:14.156342] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T19:48:14.280224] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:48:14.513994] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-15T19:48:14.964228] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T19:48:15.314007] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-15T19:48:16.114006] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-15T19:48:16.914027] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-15T19:48:17.465476] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-15T19:48:17.482323] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T19:48:17.714054] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-15T19:48:17.785807] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:48:17.792234] [INFO ] [REMOTE ] KKR: Full fetch complete (77624 records). [2025-10-15T19:48:17.792380] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-15T19:48:18.170851] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-15T19:48:18.170934] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-15T19:48:18.172003] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-15T19:48:18.172068] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-15T19:48:18.173523] [DEBUG] [LOCAL ] KKR: Trimmed 77624 records to 53503 (keeping 200 days of data) [2025-10-15T19:48:18.498706] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:48:18.519195] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-15T19:48:18.524257] [DEBUG] [LOCAL ] KKR: Primary data saved (53503 records). [2025-10-15T19:48:18.524410] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-15T19:48:18.524490] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 50.2s. Estimated remaining: 2h 44m 43s. Rate: 7.1 symbols/min [2025-10-15T19:48:19.314029] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-15T19:48:19.668540] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T19:48:19.723126] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-15T19:48:20.114073] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-15T19:48:20.913967] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-15T19:48:21.300683] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T19:48:21.714000] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-15T19:48:22.268617] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T19:48:22.514039] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-15T19:48:23.314035] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-15T19:48:24.505759] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T19:48:24.512275] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-15T19:48:24.872154] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (3.96 seconds). [2025-10-15T19:48:24.888488] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-15T19:48:24.889916] [INFO ] [REMOTE ] KMPB: Full fetch complete (5030 records). [2025-10-15T19:48:24.890067] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-15T19:48:24.925453] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-15T19:48:25.278422] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-15T19:48:25.278498] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-15T19:48:25.278677] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-15T19:48:25.278738] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-15T19:48:25.279091] [DEBUG] [LOCAL ] KMPB: Trimmed 5030 records to 3652 (keeping 200 days of data) [2025-10-15T19:48:25.301068] [DEBUG] [LOCAL ] KMPB: Primary data saved (3652 records). [2025-10-15T19:48:25.301199] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-15T19:48:25.301285] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KMPB took 23.4s. Estimated remaining: 2h 44m 33s. Rate: 7.1 symbols/min [2025-10-15T19:48:25.857430] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:48:25.864418] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-15T19:48:27.006749] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T19:48:27.030606] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-15T19:48:27.039548] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T19:48:27.313974] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-15T19:48:27.642381] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:48:27.649836] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-15T19:48:27.649967] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-15T19:48:28.048845] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-15T19:48:28.048978] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-15T19:48:28.050040] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-15T19:48:28.050107] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-15T19:48:28.051681] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-15T19:48:28.407856] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-15T19:48:28.408036] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-15T19:48:28.408382] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KMI took 36.9s. Estimated remaining: 2h 44m 20s. Rate: 7.1 symbols/min [2025-10-15T19:48:28.409583] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T19:48:28.416909] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-15T19:48:29.828571] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:48:29.836206] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-15T19:48:34.150924] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (4.31 seconds). [2025-10-15T19:48:34.159711] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-15T19:48:35.884165] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:48:35.893997] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-15T19:48:37.420047] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T19:48:37.430187] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-15T19:48:38.585544] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T19:48:38.590890] [INFO ] [REMOTE ] KMPR: Full fetch complete (52828 records). [2025-10-15T19:48:38.590995] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-15T19:48:38.964516] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-15T19:48:38.964602] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-15T19:48:38.965480] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-15T19:48:38.965535] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-15T19:48:38.966606] [DEBUG] [LOCAL ] KMPR: Trimmed 52828 records to 39987 (keeping 200 days of data) [2025-10-15T19:48:39.199234] [DEBUG] [LOCAL ] KMPR: Primary data saved (39987 records). [2025-10-15T19:48:39.199374] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-15T19:48:39.199464] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KMPR took 25.9s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-15T19:48:39.760113] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.791749] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.881597] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.916806] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.959211] [DEBUG] [LOCAL ] KN: Loaded 38607 existing records from primary storage. [2025-10-15T19:48:39.959750] [INFO ] [MAIN ] KN: Loaded 38607 existing records. [2025-10-15T19:48:40.079235] [DEBUG] [LOCAL ] KNF: Loaded 36549 existing records from primary storage. [2025-10-15T19:48:40.111058] [INFO ] [MAIN ] KNF: Loaded 36549 existing records. [2025-10-15T19:48:40.151679] [DEBUG] [LOCAL ] KMT: Loaded 42914 existing records from primary storage. [2025-10-15T19:48:40.196751] [INFO ] [MAIN ] KMT: Loaded 42914 existing records. [2025-10-15T19:48:40.325520] [DEBUG] [LOCAL ] KMX: Loaded 53268 existing records from primary storage. [2025-10-15T19:48:40.305571] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.341355] [INFO ] [MAIN ] KMX: Loaded 53268 existing records. [2025-10-15T19:48:40.401420] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.471684] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-15T19:48:40.522522] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-15T19:48:40.522776] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-15T19:48:40.855970] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.880070] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.859823] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.880532] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.880937] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-15T19:48:40.880991] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.881464] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.886974] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-15T19:48:40.907743] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-15T19:48:40.897371] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-15T19:48:40.921236] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-15T19:48:40.931610] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-15T19:48:40.939829] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-15T19:48:40.940021] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-15T19:48:40.946013] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-15T19:48:41.852019] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:41.940570] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-15T19:48:42.121200] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:42.143501] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-15T19:48:42.262640] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:42.265026] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-15T19:48:42.284356] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:42.284668] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-15T19:48:43.293825] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:48:43.301303] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-15T19:48:43.590830] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:48:43.597841] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-15T19:48:43.705424] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:48:43.716115] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-15T19:48:43.807175] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:48:43.815439] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-15T19:48:44.506456] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T19:48:44.513046] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-15T19:48:44.630051] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:48:44.637904] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-15T19:48:45.128637] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:48:45.138986] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-15T19:48:45.523934] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:48:45.530680] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-15T19:48:45.692296] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T19:48:45.700908] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-15T19:48:45.725580] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T19:48:45.734144] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-15T19:48:46.522335] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T19:48:46.529855] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-15T19:48:47.164785] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:48:47.173527] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-15T19:48:47.246967] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:48:47.255477] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-15T19:48:47.323345] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-15T19:48:47.332791] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-15T19:48:47.472319] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:48:47.479888] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-15T19:48:48.475239] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T19:48:48.484068] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-15T19:48:48.726742] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:48:48.736462] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-15T19:48:48.800907] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T19:48:48.897983] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:48:48.913952] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-15T19:48:49.714027] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-15T19:48:49.755793] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:48:49.927404] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:48:50.514023] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-15T19:48:50.787835] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:48:50.821827] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T19:48:51.313997] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-15T19:48:52.114015] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-15T19:48:52.433084] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T19:48:52.913971] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-15T19:48:53.548885] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-15T19:48:53.713970] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-15T19:48:54.117484] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T19:48:54.332272] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T19:48:54.513996] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-15T19:48:55.147417] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T19:48:55.313995] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-15T19:48:55.871580] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T19:48:56.114055] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-15T19:48:56.402932] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T19:48:56.914055] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-15T19:48:57.714060] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-15T19:48:57.867224] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:48:58.417631] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:48:58.513989] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-15T19:48:58.995731] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:48:59.313998] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-15T19:49:00.114015] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-15T19:49:00.305431] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T19:49:00.680557] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:49:00.685316] [INFO ] [REMOTE ] KN: Full fetch complete (56587 records). [2025-10-15T19:49:00.685428] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-15T19:49:00.919097] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-15T19:49:01.064385] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-15T19:49:01.064460] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-15T19:49:01.065336] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-15T19:49:01.065399] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-15T19:49:01.066542] [DEBUG] [LOCAL ] KN: Trimmed 56587 records to 38621 (keeping 200 days of data) [2025-10-15T19:49:01.290187] [DEBUG] [LOCAL ] KN: Primary data saved (38621 records). [2025-10-15T19:49:01.290331] [INFO ] [MAIN ] KN: Full history saved. [2025-10-15T19:49:01.290413] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KN took 22.1s. Estimated remaining: 2h 44m 18s. Rate: 7.1 symbols/min [2025-10-15T19:49:01.474680] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:01.486961] [DEBUG] [LOCAL ] KNOP: Loaded 10475 existing records from primary storage. [2025-10-15T19:49:01.487162] [INFO ] [MAIN ] KNOP: Loaded 10475 existing records. [2025-10-15T19:49:01.701444] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:49:01.707114] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:01.719310] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-15T19:49:01.719552] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-15T19:49:01.719222] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-15T19:49:01.720869] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-15T19:49:01.720947] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-15T19:49:02.090249] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:02.513986] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-15T19:49:02.807329] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:49:03.314061] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-15T19:49:03.442249] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:49:03.577346] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:49:03.866409] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T19:49:04.114004] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-15T19:49:04.705606] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T19:49:04.914059] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-15T19:49:05.714051] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-15T19:49:06.513994] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-15T19:49:06.952877] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T19:49:07.175898] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:49:07.183448] [INFO ] [REMOTE ] KNF: Full fetch complete (51286 records). [2025-10-15T19:49:07.183704] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-15T19:49:07.319183] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-15T19:49:07.581587] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-15T19:49:07.581702] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-15T19:49:07.582557] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-15T19:49:07.582603] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-15T19:49:07.583811] [DEBUG] [LOCAL ] KNF: Trimmed 51286 records to 36599 (keeping 200 days of data) [2025-10-15T19:49:07.801140] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T19:49:07.841854] [DEBUG] [LOCAL ] KNF: Primary data saved (36599 records). [2025-10-15T19:49:07.841988] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-15T19:49:07.842066] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KNF took 28.6s. Estimated remaining: 2h 44m 8s. Rate: 7.1 symbols/min [2025-10-15T19:49:08.048391] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:08.067477] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T19:49:08.074303] [INFO ] [REMOTE ] KMX: Full fetch complete (76309 records). [2025-10-15T19:49:08.074483] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-15T19:49:08.118672] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-15T19:49:08.244006] [DEBUG] [LOCAL ] KNSL: Loaded 18386 existing records from primary storage. [2025-10-15T19:49:08.268180] [INFO ] [MAIN ] KNSL: Loaded 18386 existing records. [2025-10-15T19:49:08.629991] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:08.664168] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-15T19:49:08.667740] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-15T19:49:08.667872] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-15T19:49:08.667946] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-15T19:49:08.669114] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-15T19:49:08.669070] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-15T19:49:08.669229] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-15T19:49:08.669284] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-15T19:49:08.769991] [DEBUG] [LOCAL ] KMX: Trimmed 76309 records to 53277 (keeping 200 days of data) [2025-10-15T19:49:08.916854] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-15T19:49:09.022843] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:49:09.136237] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:09.349358] [DEBUG] [LOCAL ] KMX: Primary data saved (53277 records). [2025-10-15T19:49:09.349495] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-15T19:49:09.349574] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMX took 30.1s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-15T19:49:09.519227] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:09.558987] [DEBUG] [LOCAL ] KNTK: Loaded 46985 existing records from primary storage. [2025-10-15T19:49:09.559278] [INFO ] [MAIN ] KNTK: Loaded 46985 existing records. [2025-10-15T19:49:09.731204] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-15T19:49:09.736834] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:09.738035] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-15T19:49:09.738091] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-15T19:49:09.738504] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-15T19:49:09.738546] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-15T19:49:10.094585] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:10.514028] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-15T19:49:10.592094] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:49:10.597197] [INFO ] [REMOTE ] KMT: Full fetch complete (61950 records). [2025-10-15T19:49:10.597346] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-15T19:49:10.715450] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:49:11.000978] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-15T19:49:11.001081] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-15T19:49:11.002268] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-15T19:49:11.002332] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-15T19:49:11.003699] [DEBUG] [LOCAL ] KMT: Trimmed 61950 records to 42946 (keeping 200 days of data) [2025-10-15T19:49:11.262121] [DEBUG] [LOCAL ] KMT: Primary data saved (42946 records). [2025-10-15T19:49:11.262264] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-15T19:49:11.262365] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMT took 32.1s. Estimated remaining: 2h 43m 38s. Rate: 7.1 symbols/min [2025-10-15T19:49:11.323669] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-15T19:49:11.436789] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:11.486869] [DEBUG] [LOCAL ] KNX: Loaded 52607 existing records from primary storage. [2025-10-15T19:49:11.487199] [INFO ] [MAIN ] KNX: Loaded 52607 existing records. [2025-10-15T19:49:11.634703] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:49:11.691976] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:11.692228] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-15T19:49:11.692287] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-15T19:49:11.693261] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-15T19:49:11.693318] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-15T19:49:12.036703] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:12.114018] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-15T19:49:12.777686] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:49:12.913969] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-15T19:49:13.249113] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T19:49:13.713989] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-15T19:49:14.284571] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:49:14.300975] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T19:49:14.513991] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-15T19:49:15.313994] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-15T19:49:16.113971] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-15T19:49:16.213959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T19:49:16.246397] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T19:49:16.913975] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-15T19:49:17.322461] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T19:49:17.345056] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:49:17.713973] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-15T19:49:18.513970] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-15T19:49:18.592983] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T19:49:19.313997] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-15T19:49:19.958893] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T19:49:20.082002] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:49:20.114008] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-15T19:49:20.768790] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T19:49:20.914002] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-15T19:49:21.714010] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-15T19:49:21.891398] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:49:21.893560] [INFO ] [REMOTE ] KNOP: Full fetch complete (14716 records). [2025-10-15T19:49:21.893674] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-15T19:49:22.254941] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-15T19:49:22.255015] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-15T19:49:22.255376] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-15T19:49:22.255418] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-15T19:49:22.255919] [DEBUG] [LOCAL ] KNOP: Trimmed 14716 records to 10486 (keeping 200 days of data) [2025-10-15T19:49:22.314876] [DEBUG] [LOCAL ] KNOP: Primary data saved (10486 records). [2025-10-15T19:49:22.314989] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-15T19:49:22.315089] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KNOP took 21.0s. Estimated remaining: 2h 43m 32s. Rate: 7.1 symbols/min [2025-10-15T19:49:22.481632] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:22.481825] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-15T19:49:22.481867] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-15T19:49:22.481975] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-15T19:49:22.482017] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-15T19:49:22.482079] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-15T19:49:22.482114] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-15T19:49:22.519169] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-15T19:49:22.843753] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:23.314052] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-15T19:49:23.587233] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T19:49:23.644600] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:49:24.113990] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-15T19:49:24.914011] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-15T19:49:25.047012] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T19:49:25.713966] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-15T19:49:26.016895] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-15T19:49:26.503883] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T19:49:26.519695] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-15T19:49:26.540964] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:49:27.313995] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-15T19:49:27.527586] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T19:49:28.114057] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-15T19:49:28.874678] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:49:28.913944] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-15T19:49:29.713997] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-15T19:49:29.759897] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T19:49:30.476988] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:49:30.513955] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-15T19:49:31.314010] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-15T19:49:31.993229] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:49:32.113959] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-15T19:49:32.507570] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-15T19:49:32.914008] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-15T19:49:32.980339] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:49:33.426140] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:49:33.714028] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-15T19:49:34.514004] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-15T19:49:34.939427] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T19:49:35.313971] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-15T19:49:35.472469] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:49:35.619005] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:49:36.114007] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-15T19:49:36.913985] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-15T19:49:37.087719] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T19:49:37.713977] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-15T19:49:37.856310] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-15T19:49:38.513995] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-15T19:49:38.710566] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T19:49:38.749350] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:49:39.314058] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-15T19:49:40.068042] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:49:40.113951] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-15T19:49:40.639141] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:49:40.913989] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-15T19:49:41.300835] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:49:41.713991] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-15T19:49:42.513999] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-15T19:49:42.681868] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T19:49:42.954456] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:49:42.960351] [INFO ] [REMOTE ] KNTK: Full fetch complete (65409 records). [2025-10-15T19:49:42.960494] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-15T19:49:43.317807] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-15T19:49:43.338320] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-15T19:49:43.339398] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-15T19:49:43.340478] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-15T19:49:43.340682] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-15T19:49:43.342015] [DEBUG] [LOCAL ] KNTK: Trimmed 65409 records to 47085 (keeping 200 days of data) [2025-10-15T19:49:43.619130] [DEBUG] [LOCAL ] KNTK: Primary data saved (47085 records). [2025-10-15T19:49:43.619257] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-15T19:49:43.619715] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNTK took 34.3s. Estimated remaining: 2h 43m 36s. Rate: 7.1 symbols/min [2025-10-15T19:49:43.746995] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T19:49:43.787801] [INFO ] [REMOTE ] KNSL: Full fetch complete (26959 records). [2025-10-15T19:49:43.811587] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:43.811730] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-15T19:49:44.106147] [DEBUG] [LOCAL ] KODK: Loaded 43707 existing records from primary storage. [2025-10-15T19:49:44.130213] [INFO ] [MAIN ] KODK: Loaded 43707 existing records. [2025-10-15T19:49:44.119339] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-15T19:49:44.426037] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-15T19:49:44.438955] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:44.439259] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-15T19:49:44.439101] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-15T19:49:44.439350] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-15T19:49:44.440018] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-15T19:49:44.440063] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-15T19:49:44.440163] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-15T19:49:44.483798] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-15T19:49:44.546958] [DEBUG] [LOCAL ] KNSL: Trimmed 26959 records to 18426 (keeping 200 days of data) [2025-10-15T19:49:44.906627] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:44.913955] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-15T19:49:44.921976] [DEBUG] [LOCAL ] KNSL: Primary data saved (18426 records). [2025-10-15T19:49:44.922090] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-15T19:49:44.922167] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KNSL took 37.1s. Estimated remaining: 2h 43m 21s. Rate: 7.1 symbols/min [2025-10-15T19:49:45.089366] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:45.113822] [DEBUG] [LOCAL ] KOF: Loaded 26602 existing records from primary storage. [2025-10-15T19:49:45.114072] [INFO ] [MAIN ] KOF: Loaded 26602 existing records. [2025-10-15T19:49:45.285042] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:45.285213] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-15T19:49:45.285267] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-15T19:49:45.285849] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-15T19:49:45.285908] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-15T19:49:45.647490] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:45.713954] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-15T19:49:45.937007] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T19:49:46.283287] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-15T19:49:46.514110] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-15T19:49:46.640810] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T19:49:46.690197] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:49:47.314048] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-15T19:49:47.921185] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:49:48.065273] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T19:49:48.114034] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-15T19:49:48.914085] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-15T19:49:49.282447] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T19:49:49.714011] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-15T19:49:50.521411] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-15T19:49:50.526815] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:49:51.304599] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T19:49:51.313951] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-15T19:49:52.113973] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-15T19:49:52.376920] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-15T19:49:52.584160] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:49:52.652853] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T19:49:52.659368] [INFO ] [REMOTE ] KNX: Full fetch complete (76172 records). [2025-10-15T19:49:52.659532] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-15T19:49:52.919187] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-15T19:49:53.060007] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-15T19:49:53.060106] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-15T19:49:53.061221] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-15T19:49:53.061289] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-15T19:49:53.062842] [DEBUG] [LOCAL ] KNX: Trimmed 76172 records to 52615 (keeping 200 days of data) [2025-10-15T19:49:53.384706] [DEBUG] [LOCAL ] KNX: Primary data saved (52615 records). [2025-10-15T19:49:53.384841] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-15T19:49:53.385874] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNX took 42.1s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-15T19:49:53.586570] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:53.608762] [DEBUG] [LOCAL ] KOP: Loaded 17462 existing records from primary storage. [2025-10-15T19:49:53.609058] [INFO ] [MAIN ] KOP: Loaded 17462 existing records. [2025-10-15T19:49:53.719231] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-15T19:49:53.847950] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:53.848180] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-15T19:49:53.848230] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-15T19:49:53.848826] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-15T19:49:53.848884] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-15T19:49:54.199207] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:54.514002] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-15T19:49:55.282149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-15T19:49:55.315463] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:49:55.314070] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-15T19:49:55.340999] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T19:49:56.113956] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-15T19:49:56.580188] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T19:49:56.914006] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-15T19:49:57.625678] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T19:49:57.713952] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-15T19:49:57.915603] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T19:49:58.513989] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-15T19:49:59.314024] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-15T19:49:59.347175] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T19:49:59.759768] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T19:50:00.114048] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-15T19:50:00.310536] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T19:50:00.914043] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-15T19:50:01.714052] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-15T19:50:02.347352] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T19:50:02.513968] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-15T19:50:03.058149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-15T19:50:03.088610] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:50:03.313974] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-15T19:50:03.495073] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:50:04.114008] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-15T19:50:04.913984] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-15T19:50:05.587521] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:50:05.694898] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-15T19:50:05.713951] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-15T19:50:06.070183] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T19:50:06.513995] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-15T19:50:07.263325] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:50:07.313954] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-15T19:50:08.113996] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-15T19:50:08.913994] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-15T19:50:08.948149] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:50:08.989081] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-15T19:50:09.030711] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:50:09.713990] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-15T19:50:09.809523] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T19:50:10.514050] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-15T19:50:11.314051] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-15T19:50:11.345868] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T19:50:11.402428] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T19:50:12.114014] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-15T19:50:12.816806] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:50:12.820529] [INFO ] [REMOTE ] KOF: Full fetch complete (37952 records). [2025-10-15T19:50:12.820632] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-15T19:50:12.919164] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-15T19:50:13.197348] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-15T19:50:13.197447] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-15T19:50:13.198369] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-15T19:50:13.198437] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-15T19:50:13.199502] [DEBUG] [LOCAL ] KOF: Trimmed 37952 records to 26616 (keeping 200 days of data) [2025-10-15T19:50:13.370872] [DEBUG] [LOCAL ] KOF: Primary data saved (26616 records). [2025-10-15T19:50:13.371045] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-15T19:50:13.371137] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KOF took 28.4s. Estimated remaining: 2h 43m 15s. Rate: 7.1 symbols/min [2025-10-15T19:50:13.542555] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:13.546375] [DEBUG] [LOCAL ] KORE: Loaded 2171 existing records from primary storage. [2025-10-15T19:50:13.546545] [INFO ] [MAIN ] KORE: Loaded 2171 existing records. [2025-10-15T19:50:13.723433] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-15T19:50:13.729681] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:13.731069] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-15T19:50:13.731245] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-15T19:50:13.731517] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-15T19:50:13.731740] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-15T19:50:13.842477] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T19:50:13.881279] [INFO ] [REMOTE ] KODK: Full fetch complete (63471 records). [2025-10-15T19:50:13.909554] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-15T19:50:14.156414] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:50:14.321921] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:14.520521] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-15T19:50:14.538960] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-15T19:50:14.539747] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-15T19:50:14.540888] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-15T19:50:14.541097] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-15T19:50:14.542565] [DEBUG] [LOCAL ] KODK: Trimmed 63471 records to 43766 (keeping 200 days of data) [2025-10-15T19:50:14.786101] [DEBUG] [LOCAL ] KODK: Primary data saved (43766 records). [2025-10-15T19:50:14.786235] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-15T19:50:14.786314] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KODK took 31.2s. Estimated remaining: 2h 42m 60s. Rate: 7.1 symbols/min [2025-10-15T19:50:14.984956] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:15.033973] [DEBUG] [LOCAL ] KOS: Loaded 53091 existing records from primary storage. [2025-10-15T19:50:15.034290] [INFO ] [MAIN ] KOS: Loaded 53091 existing records. [2025-10-15T19:50:15.208745] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:15.208951] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-15T19:50:15.208999] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-15T19:50:15.209813] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-15T19:50:15.209871] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-15T19:50:15.316069] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-15T19:50:15.584050] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:15.585600] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:50:16.114013] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-15T19:50:16.177539] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T19:50:16.424465] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-15T19:50:16.430922] [INFO ] [REMOTE ] KO: Full fetch complete (76828 records). [2025-10-15T19:50:16.431075] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-15T19:50:16.431823] [FATAL] [VALIDATOR ] KO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T19:50:16.431916] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:50:16.431959] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:50:16.432016] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-15T19:50:16.432072] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-15T19:50:16.432106] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-15T19:50:16.432152] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-15T19:50:16.432235] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KO took 54.1s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-15T19:50:16.628808] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:16.680340] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-15T19:50:16.680680] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-15T19:50:16.858702] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:16.858950] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-15T19:50:16.859008] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-15T19:50:16.859981] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-15T19:50:16.860039] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-15T19:50:16.921930] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-15T19:50:17.219427] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:17.679506] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T19:50:17.717850] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-15T19:50:17.725867] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:50:18.514001] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-15T19:50:19.314016] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-15T19:50:19.570794] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T19:50:19.648516] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T19:50:20.113999] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-15T19:50:20.207707] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T19:50:20.390176] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-15T19:50:20.913996] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-15T19:50:21.713985] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-15T19:50:21.958732] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T19:50:22.065460] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T19:50:22.514008] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-15T19:50:23.313984] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-15T19:50:23.469087] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T19:50:23.839328] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T19:50:24.113998] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-15T19:50:24.613342] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T19:50:24.913995] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-15T19:50:25.714037] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-15T19:50:25.959099] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T19:50:25.961625] [INFO ] [REMOTE ] KOP: Full fetch complete (25435 records). [2025-10-15T19:50:25.961750] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-15T19:50:26.273100] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:50:26.362829] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-15T19:50:26.362928] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-15T19:50:26.363518] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-15T19:50:26.363596] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-15T19:50:26.364404] [DEBUG] [LOCAL ] KOP: Trimmed 25435 records to 17433 (keeping 200 days of data) [2025-10-15T19:50:26.475454] [DEBUG] [LOCAL ] KOP: Primary data saved (17433 records). [2025-10-15T19:50:26.475605] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-15T19:50:26.475730] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOP took 33.1s. Estimated remaining: 2h 42m 38s. Rate: 7.1 symbols/min [2025-10-15T19:50:26.519199] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-15T19:50:26.650055] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:26.695843] [DEBUG] [LOCAL ] KRC: Loaded 48299 existing records from primary storage. [2025-10-15T19:50:26.696179] [INFO ] [MAIN ] KRC: Loaded 48299 existing records. [2025-10-15T19:50:26.869755] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:26.869990] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-15T19:50:26.870038] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-15T19:50:26.870944] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-15T19:50:26.871002] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-15T19:50:27.234895] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:27.313992] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-15T19:50:27.419241] [DEBUG] [REMOTE ] KRC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T19:50:27.419703] [WARN ] [REMOTE ] KRC: No data returned for month 2024-12 [2025-10-15T19:50:27.419806] [FATAL] [REMOTE ] KRC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:50:27.419857] [FATAL] [MAIN ] KRC: Failed to fetch primary data. [2025-10-15T19:50:27.419920] [WARN ] [MAIN ] KRC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:50:27.419996] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-15T19:50:27.420066] [DEBUG] [LOCAL ] KRC: No primary data file found to delete. [2025-10-15T19:50:27.420104] [INFO ] [LOCAL ] KRC: Starting deletion of derivative data. [2025-10-15T19:50:27.420541] [DEBUG] [LOCAL ] KRC: Deleted derivative data file. [2025-10-15T19:50:27.421747] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KRC took 0.9s. Estimated remaining: 2h 42m 23s. Rate: 7.1 symbols/min [2025-10-15T19:50:27.587462] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:27.626487] [DEBUG] [LOCAL ] KREF: Loaded 38003 existing records from primary storage. [2025-10-15T19:50:27.626848] [INFO ] [MAIN ] KREF: Loaded 38003 existing records. [2025-10-15T19:50:27.807849] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:27.808084] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-15T19:50:27.808134] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-15T19:50:27.808895] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-15T19:50:27.808955] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-15T19:50:28.115433] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-15T19:50:28.217082] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:28.257157] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:50:28.569055] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:50:28.913994] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-15T19:50:29.714027] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-15T19:50:30.514017] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-15T19:50:30.657558] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T19:50:31.313962] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-15T19:50:31.511333] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T19:50:31.605309] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T19:50:31.919791] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:50:32.113979] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-15T19:50:32.795837] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T19:50:32.797077] [INFO ] [REMOTE ] KORE: Full fetch complete (5305 records). [2025-10-15T19:50:32.797149] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-15T19:50:32.919126] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-15T19:50:33.160076] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-15T19:50:33.160150] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-15T19:50:33.160293] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-15T19:50:33.160330] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-15T19:50:33.160697] [DEBUG] [LOCAL ] KORE: Trimmed 5305 records to 2164 (keeping 200 days of data) [2025-10-15T19:50:33.172744] [DEBUG] [LOCAL ] KORE: Primary data saved (2164 records). [2025-10-15T19:50:33.172807] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-15T19:50:33.172872] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KORE took 19.8s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-15T19:50:33.336055] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:33.379812] [DEBUG] [LOCAL ] KRG: Loaded 49267 existing records from primary storage. [2025-10-15T19:50:33.380186] [INFO ] [MAIN ] KRG: Loaded 49267 existing records. [2025-10-15T19:50:33.551055] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:33.551274] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-15T19:50:33.551334] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-15T19:50:33.552270] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-15T19:50:33.552327] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-15T19:50:33.719731] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-15T19:50:33.898205] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:34.293112] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:50:34.514005] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-15T19:50:35.313987] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-15T19:50:35.468732] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:50:36.114010] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-15T19:50:36.181996] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:50:36.211585] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:50:36.914015] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-15T19:50:37.716321] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-15T19:50:37.719606] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:50:38.514076] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-15T19:50:38.775990] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T19:50:38.815880] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T19:50:39.314013] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-15T19:50:39.678058] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:50:40.114009] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-15T19:50:40.816429] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:50:40.913994] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-15T19:50:41.636422] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:50:41.713952] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-15T19:50:42.513991] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-15T19:50:42.724431] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T19:50:43.183199] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T19:50:43.314025] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-15T19:50:44.114041] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-15T19:50:44.175523] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:50:44.919134] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-15T19:50:44.939035] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T19:50:45.714030] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-15T19:50:45.949094] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T19:50:46.514056] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-15T19:50:46.565705] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T19:50:47.260118] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:50:47.313952] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-15T19:50:48.114003] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-15T19:50:48.824189] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-15T19:50:48.913974] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-15T19:50:49.034306] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:50:49.490405] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:50:49.713987] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-15T19:50:50.514008] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-15T19:50:50.639835] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:50:51.215692] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:50:51.313979] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-15T19:50:51.793448] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:50:52.114049] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-15T19:50:52.850168] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T19:50:52.856406] [INFO ] [REMOTE ] KOS: Full fetch complete (77036 records). [2025-10-15T19:50:52.856520] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-15T19:50:52.922178] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-15T19:50:53.263209] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-15T19:50:53.263296] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-15T19:50:53.264515] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-15T19:50:53.264580] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-15T19:50:53.266025] [DEBUG] [LOCAL ] KOS: Trimmed 77036 records to 53097 (keeping 200 days of data) [2025-10-15T19:50:53.562263] [DEBUG] [LOCAL ] KOS: Primary data saved (53097 records). [2025-10-15T19:50:53.562434] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-15T19:50:53.563186] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KOS took 38.8s. Estimated remaining: 2h 42m 14s. Rate: 7.1 symbols/min [2025-10-15T19:50:53.714736] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-15T19:50:53.740501] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:53.741623] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-15T19:50:53.741713] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-15T19:50:53.741969] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-15T19:50:53.742270] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-15T19:50:53.742360] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-15T19:50:53.758191] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-15T19:50:53.849987] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:50:54.159871] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:54.514010] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-15T19:50:54.696116] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:50:55.314052] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-15T19:50:55.474183] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:50:55.503374] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T19:50:56.114080] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-15T19:50:56.914099] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-15T19:50:57.330924] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-15T19:50:57.607115] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T19:50:57.714110] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-15T19:50:58.353548] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:50:58.522225] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-15T19:50:58.527270] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:50:58.534168] [INFO ] [REMOTE ] KR: Full fetch complete (77841 records). [2025-10-15T19:50:58.534361] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-15T19:50:58.799825] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:50:58.832960] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-15T19:50:58.833492] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:50:58.844211] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-15T19:50:58.854588] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:50:58.883288] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-15T19:50:58.940373] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-15T19:50:58.940774] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-15T19:50:58.940903] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-15T19:50:58.940971] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-15T19:50:58.942400] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-15T19:50:58.941130] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-15T19:50:58.942550] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-15T19:50:58.942892] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KRMN took 5.4s. Estimated remaining: 2h 42m 3s. Rate: 7.1 symbols/min [2025-10-15T19:50:59.052003] [DEBUG] [LOCAL ] KR: Trimmed 77841 records to 53680 (keeping 200 days of data) [2025-10-15T19:50:59.186876] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:59.265342] [DEBUG] [LOCAL ] KRO: Loaded 26420 existing records from primary storage. [2025-10-15T19:50:59.269057] [INFO ] [MAIN ] KRO: Loaded 26420 existing records. [2025-10-15T19:50:59.357602] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-15T19:50:59.563986] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:59.565002] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-15T19:50:59.565412] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-15T19:50:59.569043] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-15T19:50:59.569964] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-15T19:51:00.005617] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:00.114378] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-15T19:51:00.118457] [DEBUG] [LOCAL ] KR: Primary data saved (53680 records). [2025-10-15T19:51:00.118636] [INFO ] [MAIN ] KR: Full history saved. [2025-10-15T19:51:00.118792] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KR took 43.7s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-15T19:51:00.292961] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:00.326503] [DEBUG] [LOCAL ] KRP: Loaded 36430 existing records from primary storage. [2025-10-15T19:51:00.326801] [INFO ] [MAIN ] KRP: Loaded 36430 existing records. [2025-10-15T19:51:00.503622] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:00.503899] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-15T19:51:00.503979] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-15T19:51:00.504870] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-15T19:51:00.504932] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-15T19:51:00.858215] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:00.913976] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-15T19:51:01.031132] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T19:51:01.714047] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-15T19:51:01.754482] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:51:01.759789] [INFO ] [REMOTE ] KREF: Full fetch complete (52810 records). [2025-10-15T19:51:01.759953] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-15T19:51:02.187931] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T19:51:02.186870] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-15T19:51:02.188103] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-15T19:51:02.189147] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-15T19:51:02.194817] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-15T19:51:02.196279] [DEBUG] [LOCAL ] KREF: Trimmed 52810 records to 37941 (keeping 200 days of data) [2025-10-15T19:51:02.436791] [DEBUG] [LOCAL ] KREF: Primary data saved (37941 records). [2025-10-15T19:51:02.436962] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-15T19:51:02.437050] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KREF took 35.0s. Estimated remaining: 2h 41m 34s. Rate: 7.1 symbols/min [2025-10-15T19:51:02.519180] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-15T19:51:02.611491] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:02.662276] [DEBUG] [LOCAL ] KSS: Loaded 53595 existing records from primary storage. [2025-10-15T19:51:02.662584] [INFO ] [MAIN ] KSS: Loaded 53595 existing records. [2025-10-15T19:51:02.838922] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:02.839132] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-15T19:51:02.839179] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-15T19:51:02.840228] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-15T19:51:02.840286] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-15T19:51:03.211811] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:51:03.249006] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:03.313987] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-15T19:51:03.581120] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T19:51:04.114007] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-15T19:51:04.791937] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T19:51:04.913980] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-15T19:51:05.314872] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T19:51:05.714005] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-15T19:51:06.362444] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:51:06.514003] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-15T19:51:06.785742] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:51:07.313995] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-15T19:51:08.114017] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-15T19:51:08.173260] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T19:51:08.393214] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T19:51:08.914041] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-15T19:51:09.224748] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T19:51:09.713984] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-15T19:51:09.913082] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:51:10.514003] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-15T19:51:10.979351] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T19:51:11.313977] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-15T19:51:12.114052] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-15T19:51:12.149874] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T19:51:12.913963] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-15T19:51:13.014770] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T19:51:13.199137] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:51:13.714020] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-15T19:51:14.115981] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:51:14.513966] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-15T19:51:14.896991] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:51:15.313988] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-15T19:51:16.113974] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-15T19:51:16.585014] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-15T19:51:16.596278] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:51:16.914012] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-15T19:51:17.316449] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:51:17.714048] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-15T19:51:18.514032] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-15T19:51:18.740408] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:51:18.746381] [INFO ] [REMOTE ] KRG: Full fetch complete (71296 records). [2025-10-15T19:51:18.746491] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-15T19:51:19.155832] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-15T19:51:19.155953] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-15T19:51:19.157201] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-15T19:51:19.157364] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-15T19:51:19.179247] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:51:19.179456] [DEBUG] [LOCAL ] KRG: Trimmed 71296 records to 49285 (keeping 200 days of data) [2025-10-15T19:51:19.361020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-15T19:51:19.488563] [DEBUG] [LOCAL ] KRG: Primary data saved (49285 records). [2025-10-15T19:51:19.488731] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-15T19:51:19.488823] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KRG took 46.3s. Estimated remaining: 2h 41m 33s. Rate: 7.1 symbols/min [2025-10-15T19:51:19.664026] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:19.706595] [DEBUG] [LOCAL ] KT: Loaded 45503 existing records from primary storage. [2025-10-15T19:51:19.706960] [INFO ] [MAIN ] KT: Loaded 45503 existing records. [2025-10-15T19:51:19.898815] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:19.899135] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-15T19:51:19.899333] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-15T19:51:19.900613] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-15T19:51:19.900735] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-15T19:51:20.125546] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-15T19:51:20.315132] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:20.581057] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T19:51:20.679226] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:51:20.913968] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-15T19:51:21.377636] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:51:21.714014] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-15T19:51:22.513971] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-15T19:51:22.822044] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T19:51:22.825340] [INFO ] [REMOTE ] KRO: Full fetch complete (35207 records). [2025-10-15T19:51:22.825423] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-15T19:51:23.252684] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-15T19:51:23.252515] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-15T19:51:23.252891] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-15T19:51:23.264595] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-15T19:51:23.264709] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-15T19:51:23.266090] [DEBUG] [LOCAL ] KRO: Trimmed 35207 records to 26413 (keeping 200 days of data) [2025-10-15T19:51:23.322052] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-15T19:51:23.422999] [DEBUG] [LOCAL ] KRO: Primary data saved (26413 records). [2025-10-15T19:51:23.423142] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-15T19:51:23.423226] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRO took 24.5s. Estimated remaining: 2h 41m 21s. Rate: 7.1 symbols/min [2025-10-15T19:51:23.597042] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:23.626388] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T19:51:23.670576] [DEBUG] [LOCAL ] KTB: Loaded 40489 existing records from primary storage. [2025-10-15T19:51:23.670892] [INFO ] [MAIN ] KTB: Loaded 40489 existing records. [2025-10-15T19:51:23.866842] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:23.867053] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-15T19:51:23.867101] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-15T19:51:23.867869] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-15T19:51:23.867927] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-15T19:51:24.119168] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-15T19:51:24.238172] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:24.913984] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-15T19:51:25.411783] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-15T19:51:25.719482] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-15T19:51:25.738661] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:51:25.829491] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T19:51:26.513981] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-15T19:51:26.755553] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:51:27.314009] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-15T19:51:28.114016] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-15T19:51:28.264807] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:51:28.752528] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T19:51:28.913990] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-15T19:51:29.103935] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T19:51:29.108497] [INFO ] [REMOTE ] KRP: Full fetch complete (54993 records). [2025-10-15T19:51:29.108622] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-15T19:51:29.541984] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-15T19:51:29.542067] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-15T19:51:29.543241] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-15T19:51:29.543310] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-15T19:51:29.544666] [DEBUG] [LOCAL ] KRP: Trimmed 54993 records to 36348 (keeping 200 days of data) [2025-10-15T19:51:29.725184] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-15T19:51:29.789098] [DEBUG] [LOCAL ] KRP: Primary data saved (36348 records). [2025-10-15T19:51:29.789252] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-15T19:51:29.790139] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRP took 29.7s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-15T19:51:29.979340] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:29.992762] [DEBUG] [LOCAL ] KTF: Loaded 11831 existing records from primary storage. [2025-10-15T19:51:29.992996] [INFO ] [MAIN ] KTF: Loaded 11831 existing records. [2025-10-15T19:51:30.167617] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:30.167898] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-15T19:51:30.167949] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-15T19:51:30.168241] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-15T19:51:30.168422] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-15T19:51:30.534515] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:30.528857] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-15T19:51:30.557060] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T19:51:31.314015] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-15T19:51:31.926417] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-15T19:51:31.953486] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T19:51:32.099338] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T19:51:32.113960] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-15T19:51:32.914082] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-15T19:51:33.468149] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T19:51:33.714006] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-15T19:51:34.499829] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:51:34.513946] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-15T19:51:35.263179] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:51:35.313972] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-15T19:51:35.890967] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T19:51:36.114066] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-15T19:51:36.913986] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-15T19:51:36.956174] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:51:37.591482] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:51:37.714011] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-15T19:51:38.514024] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-15T19:51:38.886984] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T19:51:39.115457] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T19:51:39.219583] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:51:39.314018] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-15T19:51:40.114053] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-15T19:51:40.510115] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:51:40.914033] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-15T19:51:41.589761] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:51:41.713976] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-15T19:51:42.463601] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:51:42.513949] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-15T19:51:43.314019] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-15T19:51:43.692690] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T19:51:43.733218] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T19:51:44.114038] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-15T19:51:44.914043] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-15T19:51:44.949509] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T19:51:45.714328] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-15T19:51:45.714235] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T19:51:46.516938] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-15T19:51:46.528290] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T19:51:46.529283] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:51:46.537023] [INFO ] [REMOTE ] KSS: Full fetch complete (77754 records). [2025-10-15T19:51:46.539366] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-15T19:51:46.933382] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-15T19:51:46.933497] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-15T19:51:46.934555] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-15T19:51:46.934616] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-15T19:51:46.936297] [DEBUG] [LOCAL ] KSS: Trimmed 77754 records to 53593 (keeping 200 days of data) [2025-10-15T19:51:47.258079] [DEBUG] [LOCAL ] KSS: Primary data saved (53593 records). [2025-10-15T19:51:47.258206] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-15T19:51:47.259027] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KSS took 44.8s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-15T19:51:47.320886] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-15T19:51:47.432817] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:47.432974] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-15T19:51:47.433016] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-15T19:51:47.433137] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-15T19:51:47.433209] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-15T19:51:47.433281] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-15T19:51:47.433326] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-15T19:51:47.789962] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:48.114069] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-15T19:51:48.148705] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:51:48.154250] [INFO ] [REMOTE ] KT: Full fetch complete (66719 records). [2025-10-15T19:51:48.154413] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-15T19:51:48.483885] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T19:51:48.572579] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-15T19:51:48.572684] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-15T19:51:48.573790] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-15T19:51:48.573855] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-15T19:51:48.576359] [DEBUG] [LOCAL ] KT: Trimmed 66719 records to 45480 (keeping 200 days of data) [2025-10-15T19:51:48.883545] [DEBUG] [LOCAL ] KT: Primary data saved (45480 records). [2025-10-15T19:51:48.883734] [INFO ] [MAIN ] KT: Full history saved. [2025-10-15T19:51:48.883878] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KT took 29.4s. Estimated remaining: 2h 40m 56s. Rate: 7.1 symbols/min [2025-10-15T19:51:48.921329] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-15T19:51:49.112008] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:49.186256] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-15T19:51:49.186781] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-15T19:51:49.422599] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:49.423089] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-15T19:51:49.423149] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-15T19:51:49.424195] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-15T19:51:49.424256] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-15T19:51:49.719185] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-15T19:51:49.855954] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:49.857151] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:51:49.887723] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:51:50.476507] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T19:51:50.514036] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-15T19:51:51.314005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-15T19:51:51.454536] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T19:51:52.114064] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-15T19:51:52.675408] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T19:51:52.919078] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-15T19:51:52.936382] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:51:53.713958] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-15T19:51:53.859498] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:51:54.514060] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-15T19:51:55.248410] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:51:55.267871] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:51:55.313964] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-15T19:51:56.114012] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-15T19:51:56.649900] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T19:51:56.731671] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:51:56.914007] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-15T19:51:57.714013] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-15T19:51:58.310061] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T19:51:58.514020] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-15T19:51:59.314005] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-15T19:51:59.472411] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T19:51:59.475857] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:52:00.114000] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-15T19:52:00.401002] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T19:52:00.405980] [INFO ] [REMOTE ] KTB: Full fetch complete (58182 records). [2025-10-15T19:52:00.406158] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-15T19:52:00.840627] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-15T19:52:00.840746] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-15T19:52:00.841626] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-15T19:52:00.841703] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-15T19:52:00.842908] [DEBUG] [LOCAL ] KTB: Trimmed 58182 records to 40516 (keeping 200 days of data) [2025-10-15T19:52:00.929474] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-15T19:52:01.087912] [DEBUG] [LOCAL ] KTB: Primary data saved (40516 records). [2025-10-15T19:52:01.088039] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-15T19:52:01.088409] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KTB took 37.7s. Estimated remaining: 2h 40m 51s. Rate: 7.1 symbols/min [2025-10-15T19:52:01.254969] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:01.302697] [DEBUG] [LOCAL ] KVYO: Loaded 50745 existing records from primary storage. [2025-10-15T19:52:01.303015] [INFO ] [MAIN ] KVYO: Loaded 50745 existing records. [2025-10-15T19:52:01.479661] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:01.479883] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-15T19:52:01.479948] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-15T19:52:01.480889] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-15T19:52:01.480949] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-15T19:52:01.715697] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-15T19:52:01.861858] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:52:01.897314] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:02.122964] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T19:52:02.255284] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T19:52:02.513988] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-15T19:52:03.314088] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-15T19:52:03.314570] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:52:04.114019] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-15T19:52:04.876782] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T19:52:04.913997] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-15T19:52:05.155369] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:52:05.630682] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:52:05.632104] [INFO ] [REMOTE ] KTF: Full fetch complete (17429 records). [2025-10-15T19:52:05.632174] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-15T19:52:05.719151] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-15T19:52:06.003914] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-15T19:52:06.003991] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-15T19:52:06.004358] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-15T19:52:06.004397] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-15T19:52:06.005005] [DEBUG] [LOCAL ] KTF: Trimmed 17429 records to 11799 (keeping 200 days of data) [2025-10-15T19:52:06.079288] [DEBUG] [LOCAL ] KTF: Primary data saved (11799 records). [2025-10-15T19:52:06.079433] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-15T19:52:06.079514] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTF took 36.3s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-15T19:52:06.180797] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T19:52:06.249555] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:06.288640] [DEBUG] [LOCAL ] KW: Loaded 40532 existing records from primary storage. [2025-10-15T19:52:06.288972] [INFO ] [MAIN ] KW: Loaded 40532 existing records. [2025-10-15T19:52:06.467972] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:06.468251] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-15T19:52:06.468323] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-15T19:52:06.469103] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-15T19:52:06.469159] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-15T19:52:06.520502] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-15T19:52:06.822993] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:06.891526] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-15T19:52:07.313995] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-15T19:52:07.783703] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:52:08.114032] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-15T19:52:08.913966] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-15T19:52:08.936260] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T19:52:09.713989] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-15T19:52:10.513969] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-15T19:52:10.586312] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:52:11.055986] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T19:52:11.310309] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:52:11.312219] [INFO ] [REMOTE ] KUKE: Full fetch complete (8930 records). [2025-10-15T19:52:11.312286] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-15T19:52:11.318676] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-15T19:52:11.516808] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T19:52:11.517059] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:52:11.517128] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:52:11.517197] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-15T19:52:11.517260] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-15T19:52:11.517296] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-15T19:52:11.517341] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-15T19:52:11.517396] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KUKE took 24.3s. Estimated remaining: 2h 40m 28s. Rate: 7.1 symbols/min [2025-10-15T19:52:11.684569] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:11.700858] [DEBUG] [LOCAL ] KWR: Loaded 16121 existing records from primary storage. [2025-10-15T19:52:11.701116] [INFO ] [MAIN ] KWR: Loaded 16121 existing records. [2025-10-15T19:52:11.877233] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:11.877410] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-15T19:52:11.877457] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-15T19:52:11.877858] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-15T19:52:11.877914] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-15T19:52:12.119129] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-15T19:52:12.230087] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:12.914027] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-15T19:52:13.136923] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:52:13.575771] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T19:52:13.657830] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:52:13.713955] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-15T19:52:14.514004] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-15T19:52:14.751860] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T19:52:15.314056] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-15T19:52:16.113975] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-15T19:52:16.124636] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:52:16.269851] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:52:16.913995] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-15T19:52:17.458912] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:52:17.714055] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-15T19:52:17.885153] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T19:52:18.514023] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-15T19:52:19.056672] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:52:19.314074] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-15T19:52:19.902807] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:52:20.114070] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-15T19:52:20.381824] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T19:52:20.914032] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-15T19:52:21.724367] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-15T19:52:21.730469] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:52:22.522360] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-15T19:52:22.542215] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:52:23.240418] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:52:23.313986] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-15T19:52:24.113982] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-15T19:52:24.644829] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T19:52:24.764389] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:52:24.913983] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-15T19:52:25.469285] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:52:25.714054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-15T19:52:26.330996] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:52:26.520920] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-15T19:52:26.527419] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:52:27.313994] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-15T19:52:28.114031] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-15T19:52:28.195410] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:52:28.914013] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-15T19:52:29.548364] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:52:29.620965] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-15T19:52:29.714045] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-15T19:52:30.047407] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T19:52:30.514031] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-15T19:52:30.834418] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T19:52:31.314006] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-15T19:52:31.485499] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T19:52:32.114049] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-15T19:52:32.793509] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:52:32.913968] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-15T19:52:33.714017] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-15T19:52:33.773597] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:52:34.381199] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T19:52:34.514004] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-15T19:52:34.540535] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T19:52:34.547729] [INFO ] [REMOTE ] KVUE: Full fetch complete (77842 records). [2025-10-15T19:52:34.547964] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-15T19:52:34.961125] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-15T19:52:34.961275] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-15T19:52:34.962454] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-15T19:52:34.962520] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-15T19:52:34.964174] [DEBUG] [LOCAL ] KVUE: Trimmed 77842 records to 53667 (keeping 200 days of data) [2025-10-15T19:52:35.310340] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-15T19:52:35.310488] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-15T19:52:35.310572] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KVUE took 46.4s. Estimated remaining: 2h 40m 34s. Rate: 7.1 symbols/min [2025-10-15T19:52:35.321940] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-15T19:52:35.524723] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:35.536509] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T19:52:35.568403] [DEBUG] [LOCAL ] KYN: Loaded 30240 existing records from primary storage. [2025-10-15T19:52:35.568697] [INFO ] [MAIN ] KYN: Loaded 30240 existing records. [2025-10-15T19:52:35.755263] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:35.755531] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-15T19:52:35.755581] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-15T19:52:35.756332] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-15T19:52:35.756393] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-15T19:52:36.124998] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-15T19:52:36.131339] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:36.845331] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:52:36.914021] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-15T19:52:37.714021] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-15T19:52:37.800721] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:52:37.822346] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T19:52:38.514052] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-15T19:52:39.022868] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:52:39.027789] [INFO ] [REMOTE ] KW: Full fetch complete (57248 records). [2025-10-15T19:52:39.027901] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-15T19:52:39.319166] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-15T19:52:39.401458] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-15T19:52:39.401531] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-15T19:52:39.402428] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-15T19:52:39.402490] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-15T19:52:39.403595] [DEBUG] [LOCAL ] KW: Trimmed 57248 records to 40511 (keeping 200 days of data) [2025-10-15T19:52:39.635208] [DEBUG] [LOCAL ] KW: Primary data saved (40511 records). [2025-10-15T19:52:39.635329] [INFO ] [MAIN ] KW: Full history saved. [2025-10-15T19:52:39.635403] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KW took 33.6s. Estimated remaining: 2h 40m 21s. Rate: 7.1 symbols/min [2025-10-15T19:52:39.798256] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:39.798421] [DEBUG] [LOCAL ] L: No existing data file found in primary storage. [2025-10-15T19:52:39.798458] [WARN ] [MAIN ] L: No existing data found, performing full refresh instead. [2025-10-15T19:52:39.798567] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-15T19:52:39.798607] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-15T19:52:39.798671] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-15T19:52:39.798724] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-15T19:52:40.114042] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-15T19:52:40.157283] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:40.180957] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:52:40.181734] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:52:40.191308] [INFO ] [REMOTE ] KWR: Full fetch complete (23630 records). [2025-10-15T19:52:40.191417] [INFO ] [REMOTE ] KVYO: Full fetch complete (72032 records). [2025-10-15T19:52:40.191624] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-15T19:52:40.191715] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-15T19:52:40.917975] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-15T19:52:41.120240] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-15T19:52:41.120552] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-15T19:52:41.120698] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-15T19:52:41.122194] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-15T19:52:41.122401] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-15T19:52:41.122301] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-15T19:52:41.123710] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-15T19:52:41.123813] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-15T19:52:41.125972] [DEBUG] [LOCAL ] KWR: Trimmed 23630 records to 16108 (keeping 200 days of data) [2025-10-15T19:52:41.126914] [DEBUG] [LOCAL ] KVYO: Trimmed 72032 records to 50785 (keeping 200 days of data) [2025-10-15T19:52:41.553401] [DEBUG] [LOCAL ] KWR: Primary data saved (16108 records). [2025-10-15T19:52:41.589561] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-15T19:52:41.613480] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KWR took 30.1s. Estimated remaining: 2h 40m 7s. Rate: 7.1 symbols/min [2025-10-15T19:52:41.644272] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T19:52:41.716985] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-15T19:52:41.908884] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:42.003801] [DEBUG] [LOCAL ] KVYO: Primary data saved (50785 records). [2025-10-15T19:52:42.003977] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-15T19:52:42.004532] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KVYO took 40.9s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-15T19:52:42.216190] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:42.217190] [DEBUG] [LOCAL ] LAC: Loaded 52499 existing records from primary storage. [2025-10-15T19:52:42.218146] [INFO ] [MAIN ] LAC: Loaded 52499 existing records. [2025-10-15T19:52:42.414434] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:42.415113] [DEBUG] [LOCAL ] LAD: Loaded 23409 existing records from primary storage. [2025-10-15T19:52:42.415474] [INFO ] [MAIN ] LAD: Loaded 23409 existing records. [2025-10-15T19:52:42.426747] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-15T19:52:42.426882] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-15T19:52:42.452784] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-15T19:52:42.491359] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-15T19:52:42.700138] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:42.774476] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-15T19:52:42.825494] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-15T19:52:42.850360] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T19:52:42.887927] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-15T19:52:42.905516] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-15T19:52:42.923757] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-15T19:52:43.124990] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:43.317339] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-15T19:52:43.330554] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:52:43.428692] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:44.113982] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-15T19:52:44.522479] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:52:44.913964] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-15T19:52:45.023815] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:52:45.265475] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T19:52:45.714063] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-15T19:52:46.339132] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T19:52:46.514007] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-15T19:52:47.314068] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-15T19:52:47.612247] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T19:52:47.672094] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:52:48.113991] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-15T19:52:48.417513] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T19:52:48.913987] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-15T19:52:49.371472] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:52:49.713988] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-15T19:52:50.514010] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-15T19:52:50.809839] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T19:52:50.947209] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:52:51.314036] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-15T19:52:51.947065] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:52:52.113974] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-15T19:52:52.713557] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:52:52.913990] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-15T19:52:53.714036] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-15T19:52:53.934158] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:52:54.272570] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T19:52:54.513998] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-15T19:52:55.320727] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-15T19:52:55.339216] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T19:52:55.413918] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T19:52:56.114039] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-15T19:52:56.913995] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-15T19:52:57.377234] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T19:52:57.449707] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T19:52:57.714054] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-15T19:52:58.250295] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:52:58.513991] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-15T19:52:59.313981] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-15T19:52:59.720747] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T19:52:59.819592] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T19:53:00.114009] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-15T19:53:00.581217] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:53:00.914001] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-15T19:53:01.713980] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-15T19:53:01.785410] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:53:02.032382] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T19:53:02.514008] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-15T19:53:03.040299] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:53:03.314050] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-15T19:53:03.508881] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:53:04.114082] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-15T19:53:04.815248] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:53:04.914019] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-15T19:53:05.008133] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T19:53:05.714004] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-15T19:53:05.874779] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T19:53:05.880370] [INFO ] [REMOTE ] KYN: Full fetch complete (44546 records). [2025-10-15T19:53:05.880512] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-15T19:53:06.288294] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-15T19:53:06.288419] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-15T19:53:06.289241] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-15T19:53:06.289301] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-15T19:53:06.290323] [DEBUG] [LOCAL ] KYN: Trimmed 44546 records to 30275 (keeping 200 days of data) [2025-10-15T19:53:06.476132] [DEBUG] [LOCAL ] KYN: Primary data saved (30275 records). [2025-10-15T19:53:06.476269] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-15T19:53:06.476364] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KYN took 31.2s. Estimated remaining: 2h 39m 58s. Rate: 7.1 symbols/min [2025-10-15T19:53:06.522521] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-15T19:53:06.648498] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:06.683957] [DEBUG] [LOCAL ] LADR: Loaded 39388 existing records from primary storage. [2025-10-15T19:53:06.684236] [INFO ] [MAIN ] LADR: Loaded 39388 existing records. [2025-10-15T19:53:06.857336] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:06.857550] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-15T19:53:06.857597] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-15T19:53:06.858429] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-15T19:53:06.858487] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-15T19:53:07.207134] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:07.314007] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-15T19:53:07.574953] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T19:53:07.932389] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:53:08.113996] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-15T19:53:08.335719] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:53:08.913985] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-15T19:53:09.376717] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:53:09.635349] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T19:53:09.714018] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-15T19:53:10.514010] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-15T19:53:11.185555] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:53:11.314021] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-15T19:53:12.098015] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:53:12.113962] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-15T19:53:12.381573] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T19:53:12.914015] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-15T19:53:13.561524] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:53:13.566478] [INFO ] [REMOTE ] L: Full fetch complete (59390 records). [2025-10-15T19:53:13.566562] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-15T19:53:13.719024] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-15T19:53:13.954073] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-15T19:53:13.954157] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-15T19:53:13.955244] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-15T19:53:13.955345] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-15T19:53:13.956832] [DEBUG] [LOCAL ] L: Trimmed 59390 records to 41169 (keeping 200 days of data) [2025-10-15T19:53:14.206975] [DEBUG] [LOCAL ] L: Primary data saved (41169 records). [2025-10-15T19:53:14.207153] [INFO ] [MAIN ] L: Full history saved. [2025-10-15T19:53:14.207366] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. L took 34.6s. Estimated remaining: 2h 39m 49s. Rate: 7.1 symbols/min [2025-10-15T19:53:14.367938] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T19:53:14.408282] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:14.414207] [DEBUG] [LOCAL ] LANV: Loaded 2789 existing records from primary storage. [2025-10-15T19:53:14.414378] [INFO ] [MAIN ] LANV: Loaded 2789 existing records. [2025-10-15T19:53:14.519305] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-15T19:53:14.610419] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:14.610828] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-15T19:53:14.610884] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-15T19:53:14.611184] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-15T19:53:14.611257] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-15T19:53:14.973370] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:15.313993] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-15T19:53:15.658392] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T19:53:15.941694] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T19:53:15.984339] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T19:53:16.114002] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-15T19:53:16.914044] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-15T19:53:17.470050] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T19:53:17.714037] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-15T19:53:18.158620] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T19:53:18.514038] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-15T19:53:18.840668] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:53:18.843918] [INFO ] [REMOTE ] LAD: Full fetch complete (35388 records). [2025-10-15T19:53:18.844013] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-15T19:53:19.218805] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-15T19:53:19.218889] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-15T19:53:19.219693] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-15T19:53:19.219757] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-15T19:53:19.220533] [DEBUG] [LOCAL ] LAD: Trimmed 35388 records to 23378 (keeping 200 days of data) [2025-10-15T19:53:19.315687] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-15T19:53:19.367322] [DEBUG] [LOCAL ] LAD: Primary data saved (23378 records). [2025-10-15T19:53:19.367440] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-15T19:53:19.367524] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. LAD took 37.4s. Estimated remaining: 2h 39m 37s. Rate: 7.1 symbols/min [2025-10-15T19:53:19.542456] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:19.542673] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-15T19:53:19.542760] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-15T19:53:19.542878] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-15T19:53:19.542957] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-15T19:53:19.543029] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-15T19:53:19.543092] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-15T19:53:19.900674] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:20.114054] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-15T19:53:20.389640] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T19:53:20.562675] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T19:53:20.914043] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-15T19:53:21.380325] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T19:53:21.409981] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T19:53:21.714007] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-15T19:53:22.035040] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-15T19:53:22.514010] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-15T19:53:23.314017] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-15T19:53:23.519801] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:53:23.520112] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-15T19:53:23.520201] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:53:23.520279] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-15T19:53:23.520345] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:53:23.520416] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-15T19:53:23.520481] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-15T19:53:23.520518] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-15T19:53:23.520557] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-15T19:53:23.520603] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. LAR took 4.2s. Estimated remaining: 2h 39m 25s. Rate: 7.1 symbols/min [2025-10-15T19:53:23.690576] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:23.704795] [DEBUG] [LOCAL ] LAW: Loaded 14591 existing records from primary storage. [2025-10-15T19:53:23.705074] [INFO ] [MAIN ] LAW: Loaded 14591 existing records. [2025-10-15T19:53:23.892412] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:23.892804] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-15T19:53:23.892877] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-15T19:53:23.893319] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-15T19:53:23.893379] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-15T19:53:24.088160] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:53:24.126463] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-15T19:53:24.322440] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:24.623382] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T19:53:24.914039] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-15T19:53:25.234540] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:53:25.714003] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-15T19:53:26.272778] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:53:26.514003] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-15T19:53:27.274342] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T19:53:27.314024] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-15T19:53:27.842330] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-15T19:53:28.113994] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-15T19:53:28.913991] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-15T19:53:29.714006] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-15T19:53:30.275975] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:53:30.455858] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-15T19:53:30.462363] [INFO ] [REMOTE ] LAC: Full fetch complete (76123 records). [2025-10-15T19:53:30.462501] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-15T19:53:30.523354] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-15T19:53:30.648126] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T19:53:30.864441] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-15T19:53:30.864519] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-15T19:53:30.865550] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-15T19:53:30.865614] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-15T19:53:30.867030] [DEBUG] [LOCAL ] LAC: Trimmed 76123 records to 52510 (keeping 200 days of data) [2025-10-15T19:53:31.155409] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T19:53:31.177451] [DEBUG] [LOCAL ] LAC: Primary data saved (52510 records). [2025-10-15T19:53:31.177586] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-15T19:53:31.178546] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. LAC took 49.5s. Estimated remaining: 2h 39m 16s. Rate: 7.1 symbols/min [2025-10-15T19:53:31.323388] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-15T19:53:31.348448] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:31.391460] [DEBUG] [LOCAL ] LAZ: Loaded 44781 existing records from primary storage. [2025-10-15T19:53:31.391784] [INFO ] [MAIN ] LAZ: Loaded 44781 existing records. [2025-10-15T19:53:31.568067] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:31.568304] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-15T19:53:31.568355] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-15T19:53:31.569402] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-15T19:53:31.569461] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-15T19:53:31.899039] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:53:31.924300] [INFO ] [REMOTE ] LANV: Full fetch complete (4306 records). [2025-10-15T19:53:31.928572] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:31.928673] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-15T19:53:32.124165] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-15T19:53:32.282349] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-15T19:53:32.282422] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-15T19:53:32.282566] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-15T19:53:32.282604] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-15T19:53:32.282976] [DEBUG] [LOCAL ] LANV: Trimmed 4306 records to 2784 (keeping 200 days of data) [2025-10-15T19:53:32.298393] [DEBUG] [LOCAL ] LANV: Primary data saved (2784 records). [2025-10-15T19:53:32.298459] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-15T19:53:32.298530] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LANV took 18.1s. Estimated remaining: 2h 39m 0s. Rate: 7.1 symbols/min [2025-10-15T19:53:32.462079] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:32.498521] [DEBUG] [LOCAL ] LB: Loaded 37450 existing records from primary storage. [2025-10-15T19:53:32.498835] [INFO ] [MAIN ] LB: Loaded 37450 existing records. [2025-10-15T19:53:32.671114] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:32.671358] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-15T19:53:32.671406] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-15T19:53:32.671798] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-15T19:53:32.671854] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-15T19:53:32.919260] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-15T19:53:33.024828] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:33.148712] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:53:33.714038] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-15T19:53:34.433086] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:53:34.463113] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:53:34.514040] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-15T19:53:35.298687] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T19:53:35.313945] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-15T19:53:36.114022] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-15T19:53:36.184688] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T19:53:36.913984] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-15T19:53:37.707202] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T19:53:37.716766] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-15T19:53:37.821933] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T19:53:38.513991] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-15T19:53:39.141927] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T19:53:39.314024] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-15T19:53:39.898986] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:53:40.114073] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-15T19:53:40.812633] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:53:40.913995] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-15T19:53:40.944522] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T19:53:41.714015] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-15T19:53:42.513984] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-15T19:53:43.131414] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T19:53:43.268378] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T19:53:43.313959] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-15T19:53:44.114022] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-15T19:53:44.734561] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T19:53:44.739674] [INFO ] [REMOTE ] LADR: Full fetch complete (55671 records). [2025-10-15T19:53:44.739801] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-15T19:53:44.915550] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-15T19:53:45.140877] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-15T19:53:45.140960] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-15T19:53:45.141854] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-15T19:53:45.141915] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-15T19:53:45.145906] [DEBUG] [LOCAL ] LADR: Trimmed 55671 records to 39396 (keeping 200 days of data) [2025-10-15T19:53:45.384691] [DEBUG] [LOCAL ] LADR: Primary data saved (39396 records). [2025-10-15T19:53:45.384836] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-15T19:53:45.384953] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LADR took 38.9s. Estimated remaining: 2h 38m 56s. Rate: 7.1 symbols/min [2025-10-15T19:53:45.674557] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:53:45.713946] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-15T19:53:45.888779] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:53:46.055429] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (5.14 seconds). [2025-10-15T19:53:46.514018] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-15T19:53:47.213968] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:53:47.313953] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-15T19:53:48.105823] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:53:48.115519] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-15T19:53:48.827684] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:53:48.913965] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-15T19:53:49.091890] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:53:49.094369] [INFO ] [REMOTE ] LAW: Full fetch complete (20860 records). [2025-10-15T19:53:49.094440] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-15T19:53:49.452779] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-15T19:53:49.452852] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-15T19:53:49.453265] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-15T19:53:49.453304] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-15T19:53:49.453875] [DEBUG] [LOCAL ] LAW: Trimmed 20860 records to 14653 (keeping 200 days of data) [2025-10-15T19:53:49.530971] [DEBUG] [LOCAL ] LAW: Primary data saved (14653 records). [2025-10-15T19:53:49.531094] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-15T19:53:49.531172] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAW took 26.0s. Estimated remaining: 2h 38m 44s. Rate: 7.1 symbols/min [2025-10-15T19:53:49.714053] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-15T19:53:50.383950] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T19:53:50.513986] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-15T19:53:51.327209] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:53:51.335971] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-15T19:53:51.991008] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:53:52.113963] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-15T19:53:52.901592] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:53:52.913947] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-15T19:53:53.703971] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T19:53:53.714114] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-15T19:53:54.396209] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:53:54.513987] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-15T19:53:55.195457] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T19:53:55.314006] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-15T19:53:55.834843] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:53:56.114045] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-15T19:53:56.896960] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:53:56.913954] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-15T19:53:57.747157] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:53:57.756612] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-15T19:53:58.408373] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T19:53:58.413291] [INFO ] [REMOTE ] LAZ: Full fetch complete (65697 records). [2025-10-15T19:53:58.413389] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-15T19:53:58.796306] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-15T19:53:58.796405] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-15T19:53:58.797499] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-15T19:53:58.797580] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-15T19:53:58.798926] [DEBUG] [LOCAL ] LAZ: Trimmed 65697 records to 44741 (keeping 200 days of data) [2025-10-15T19:53:59.037963] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:53:59.048783] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-15T19:53:59.096845] [DEBUG] [LOCAL ] LAZ: Primary data saved (44741 records). [2025-10-15T19:53:59.096963] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-15T19:53:59.097864] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LAZ took 27.9s. Estimated remaining: 2h 38m 37s. Rate: 7.1 symbols/min [2025-10-15T19:54:00.656402] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:54:00.664067] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-15T19:54:02.299544] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:54:02.305054] [INFO ] [REMOTE ] LB: Full fetch complete (56014 records). [2025-10-15T19:54:02.305214] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-15T19:54:02.714986] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-15T19:54:02.715063] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-15T19:54:02.715960] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-15T19:54:02.716036] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-15T19:54:02.717093] [DEBUG] [LOCAL ] LB: Trimmed 56014 records to 37383 (keeping 200 days of data) [2025-10-15T19:54:02.938903] [DEBUG] [LOCAL ] LB: Primary data saved (37383 records). [2025-10-15T19:54:02.939039] [INFO ] [MAIN ] LB: Full history saved. [2025-10-15T19:54:02.939118] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LB took 30.6s. Estimated remaining: 2h 38m 24s. Rate: 7.1 symbols/min [2025-10-15T19:54:03.649685] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.630358] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.653218] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.648817] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.707882] [DEBUG] [LOCAL ] LCII: Loaded 27499 existing records from primary storage. [2025-10-15T19:54:03.708259] [INFO ] [MAIN ] LCII: Loaded 27499 existing records. [2025-10-15T19:54:03.853481] [DEBUG] [LOCAL ] LDI: Loaded 44773 existing records from primary storage. [2025-10-15T19:54:03.852846] [DEBUG] [LOCAL ] LC: Loaded 48108 existing records from primary storage. [2025-10-15T19:54:03.908761] [INFO ] [MAIN ] LDI: Loaded 44773 existing records. [2025-10-15T19:54:03.957015] [INFO ] [MAIN ] LC: Loaded 48108 existing records. [2025-10-15T19:54:03.985369] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.036265] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-15T19:54:03.991929] [DEBUG] [LOCAL ] LBRT: Loaded 52954 existing records from primary storage. [2025-10-15T19:54:04.046306] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-15T19:54:04.078060] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-15T19:54:04.114926] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-15T19:54:04.077990] [INFO ] [MAIN ] LBRT: Loaded 52954 existing records. [2025-10-15T19:54:04.433290] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.499370] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-15T19:54:04.510443] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-15T19:54:04.530666] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-15T19:54:04.596233] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-15T19:54:04.723912] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.720937] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.774464] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-15T19:54:04.814050] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-15T19:54:04.784978] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-15T19:54:04.830505] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-15T19:54:04.898369] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-15T19:54:04.904863] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-15T19:54:04.904919] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-15T19:54:04.914040] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-15T19:54:05.326168] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:05.363252] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-15T19:54:05.876382] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:05.880230] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-15T19:54:06.047189] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:06.051299] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-15T19:54:06.071229] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:06.071773] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-15T19:54:06.703348] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T19:54:06.707894] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-15T19:54:07.524423] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:54:07.533302] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-15T19:54:07.612316] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:54:07.625739] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-15T19:54:07.762813] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:54:07.773146] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-15T19:54:07.819767] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:54:07.824745] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-15T19:54:08.579178] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T19:54:08.585859] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-15T19:54:08.706405] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T19:54:08.711484] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-15T19:54:09.037441] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:54:09.048186] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-15T19:54:09.552407] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:54:09.714026] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-15T19:54:09.839734] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T19:54:10.001597] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T19:54:10.307602] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:54:10.513996] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-15T19:54:11.314069] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-15T19:54:11.455122] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:54:11.751013] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:54:12.114042] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-15T19:54:12.663433] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:54:12.913999] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-15T19:54:13.558473] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T19:54:13.714001] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-15T19:54:14.503884] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:54:14.513956] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-15T19:54:15.251448] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:54:15.313959] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-15T19:54:15.962178] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:54:16.114008] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-15T19:54:16.860429] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:54:16.913947] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-15T19:54:17.517862] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T19:54:17.713999] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-15T19:54:18.514006] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-15T19:54:18.650854] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:54:19.280879] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:54:19.313966] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-15T19:54:19.906249] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:54:20.113965] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-15T19:54:20.379634] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T19:54:20.913980] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-15T19:54:21.722577] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-15T19:54:21.728396] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T19:54:21.980025] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:54:22.514047] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-15T19:54:23.313968] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-15T19:54:23.528787] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T19:54:24.113984] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-15T19:54:24.248573] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:54:24.913991] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-15T19:54:25.142554] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:54:25.713963] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-15T19:54:25.930273] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T19:54:26.191154] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T19:54:26.514025] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-15T19:54:27.313962] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-15T19:54:27.659091] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:54:27.948044] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T19:54:28.114007] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-15T19:54:28.912304] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:54:28.922193] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-15T19:54:29.714040] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-15T19:54:30.066252] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:54:30.302686] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-15T19:54:30.309017] [INFO ] [REMOTE ] LDI: Full fetch complete (61752 records). [2025-10-15T19:54:30.309173] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-15T19:54:30.523571] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-15T19:54:30.696535] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-15T19:54:30.696664] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-15T19:54:30.697595] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-15T19:54:30.697699] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-15T19:54:30.698976] [DEBUG] [LOCAL ] LDI: Trimmed 61752 records to 44806 (keeping 200 days of data) [2025-10-15T19:54:30.952061] [DEBUG] [LOCAL ] LDI: Primary data saved (44806 records). [2025-10-15T19:54:30.952195] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-15T19:54:30.952292] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LDI took 28.0s. Estimated remaining: 2h 38m 33s. Rate: 7.1 symbols/min [2025-10-15T19:54:31.119452] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:31.164756] [DEBUG] [LOCAL ] LDOS: Loaded 45119 existing records from primary storage. [2025-10-15T19:54:31.165046] [INFO ] [MAIN ] LDOS: Loaded 45119 existing records. [2025-10-15T19:54:31.319464] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-15T19:54:31.350439] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:31.351759] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-15T19:54:31.351852] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-15T19:54:31.352955] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-15T19:54:31.353018] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-15T19:54:31.747559] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T19:54:31.763738] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T19:54:31.761516] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:31.777736] [INFO ] [REMOTE ] LCII: Full fetch complete (39140 records). [2025-10-15T19:54:31.778828] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-15T19:54:32.119214] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-15T19:54:32.165815] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-15T19:54:32.165901] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-15T19:54:32.166699] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-15T19:54:32.166761] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-15T19:54:32.167972] [DEBUG] [LOCAL ] LCII: Trimmed 39140 records to 27437 (keeping 200 days of data) [2025-10-15T19:54:32.337933] [DEBUG] [LOCAL ] LCII: Primary data saved (27437 records). [2025-10-15T19:54:32.338073] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-15T19:54:32.338156] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LCII took 29.4s. Estimated remaining: 2h 38m 19s. Rate: 7.1 symbols/min [2025-10-15T19:54:32.512517] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:32.526438] [DEBUG] [LOCAL ] LDP: Loaded 12849 existing records from primary storage. [2025-10-15T19:54:32.526719] [INFO ] [MAIN ] LDP: Loaded 12849 existing records. [2025-10-15T19:54:32.709023] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:32.709231] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-15T19:54:32.709278] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-15T19:54:32.709597] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-15T19:54:32.709692] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-15T19:54:32.921747] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-15T19:54:33.057392] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:33.083372] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T19:54:33.713964] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-15T19:54:33.899210] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T19:54:34.340609] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:54:34.514019] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-15T19:54:34.824969] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:54:35.314052] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-15T19:54:35.901367] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T19:54:36.114027] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-15T19:54:36.141054] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T19:54:36.914041] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-15T19:54:37.528738] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:54:37.713998] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-15T19:54:37.836259] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:54:37.843850] [INFO ] [REMOTE ] LC: Full fetch complete (70662 records). [2025-10-15T19:54:37.844018] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-15T19:54:38.236203] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-15T19:54:38.236310] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-15T19:54:38.237382] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-15T19:54:38.237475] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-15T19:54:38.239026] [DEBUG] [LOCAL ] LC: Trimmed 70662 records to 48164 (keeping 200 days of data) [2025-10-15T19:54:38.516716] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-15T19:54:38.516607] [DEBUG] [LOCAL ] LC: Primary data saved (48164 records). [2025-10-15T19:54:38.517914] [INFO ] [MAIN ] LC: Full history saved. [2025-10-15T19:54:38.518013] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LC took 35.6s. Estimated remaining: 2h 38m 8s. Rate: 7.1 symbols/min [2025-10-15T19:54:38.705631] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:38.742720] [DEBUG] [LOCAL ] LEA: Loaded 41400 existing records from primary storage. [2025-10-15T19:54:38.743036] [INFO ] [MAIN ] LEA: Loaded 41400 existing records. [2025-10-15T19:54:38.924230] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:38.924455] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-15T19:54:38.924509] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-15T19:54:38.925230] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-15T19:54:38.925289] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-15T19:54:39.306299] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:39.313979] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-15T19:54:39.447231] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:54:40.082563] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T19:54:40.113952] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-15T19:54:40.797815] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:54:40.913978] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-15T19:54:41.714212] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-15T19:54:42.274830] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T19:54:42.495692] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:54:42.514023] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-15T19:54:42.533165] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:54:43.314064] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-15T19:54:44.026622] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:54:44.114007] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-15T19:54:44.914032] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-15T19:54:44.988124] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:54:44.994382] [INFO ] [REMOTE ] LBRT: Full fetch complete (76877 records). [2025-10-15T19:54:44.994486] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-15T19:54:45.379523] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-15T19:54:45.379597] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-15T19:54:45.380613] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-15T19:54:45.380698] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-15T19:54:45.382082] [DEBUG] [LOCAL ] LBRT: Trimmed 76877 records to 52959 (keeping 200 days of data) [2025-10-15T19:54:45.707788] [DEBUG] [LOCAL ] LBRT: Primary data saved (52959 records). [2025-10-15T19:54:45.707963] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-15T19:54:45.708070] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 42.8s. Estimated remaining: 2h 37m 59s. Rate: 7.1 symbols/min [2025-10-15T19:54:45.719800] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-15T19:54:45.910202] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:45.912760] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T19:54:45.961154] [DEBUG] [LOCAL ] LEG: Loaded 50183 existing records from primary storage. [2025-10-15T19:54:45.961452] [INFO ] [MAIN ] LEG: Loaded 50183 existing records. [2025-10-15T19:54:46.136455] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:46.136709] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-15T19:54:46.136782] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-15T19:54:46.137721] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-15T19:54:46.137914] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-15T19:54:46.466390] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:54:46.529869] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-15T19:54:46.535507] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:46.569301] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T19:54:47.314064] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-15T19:54:48.026133] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:54:48.071383] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T19:54:48.113955] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-15T19:54:48.856396] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:54:48.913963] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-15T19:54:49.713976] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-15T19:54:49.850345] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T19:54:50.514076] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-15T19:54:51.314049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-15T19:54:51.418129] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:54:52.083417] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:54:52.113948] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-15T19:54:52.728724] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:54:52.914026] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-15T19:54:53.645375] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:54:53.713981] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-15T19:54:54.514009] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-15T19:54:54.547084] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:54:55.276771] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:54:55.314028] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-15T19:54:55.386464] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T19:54:56.114021] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-15T19:54:56.775190] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T19:54:56.913964] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-15T19:54:57.714056] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-15T19:54:57.754601] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T19:54:58.190350] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:54:58.514028] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-15T19:54:59.321090] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-15T19:54:59.326449] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:54:59.968042] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:54:59.973054] [INFO ] [REMOTE ] LEA: Full fetch complete (60658 records). [2025-10-15T19:54:59.973159] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-15T19:55:00.120533] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-15T19:55:00.354897] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-15T19:55:00.354980] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-15T19:55:00.355897] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-15T19:55:00.355962] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-15T19:55:00.357170] [DEBUG] [LOCAL ] LEA: Trimmed 60658 records to 41359 (keeping 200 days of data) [2025-10-15T19:55:00.612357] [DEBUG] [LOCAL ] LEA: Primary data saved (41359 records). [2025-10-15T19:55:00.612484] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-15T19:55:00.612849] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LEA took 22.1s. Estimated remaining: 2h 37m 56s. Rate: 7.1 symbols/min [2025-10-15T19:55:00.783599] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:00.836044] [DEBUG] [LOCAL ] LEN: Loaded 53192 existing records from primary storage. [2025-10-15T19:55:00.836375] [INFO ] [MAIN ] LEN: Loaded 53192 existing records. [2025-10-15T19:55:00.915126] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-15T19:55:01.018825] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:01.019188] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-15T19:55:01.019267] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-15T19:55:01.020478] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-15T19:55:01.020536] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-15T19:55:01.204555] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T19:55:01.407343] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:01.714022] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-15T19:55:01.881057] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:55:02.131132] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T19:55:02.514000] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-15T19:55:03.294108] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T19:55:03.296354] [INFO ] [REMOTE ] LDP: Full fetch complete (18986 records). [2025-10-15T19:55:03.296564] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-15T19:55:03.319120] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-15T19:55:03.627408] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T19:55:03.711126] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-15T19:55:03.711202] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-15T19:55:03.711585] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-15T19:55:03.711624] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-15T19:55:03.712187] [DEBUG] [LOCAL ] LDP: Trimmed 18986 records to 12815 (keeping 200 days of data) [2025-10-15T19:55:03.789916] [DEBUG] [LOCAL ] LDP: Primary data saved (12815 records). [2025-10-15T19:55:03.790053] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-15T19:55:03.790137] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDP took 31.5s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-15T19:55:03.959834] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:03.975804] [DEBUG] [LOCAL ] LEO: Loaded 16716 existing records from primary storage. [2025-10-15T19:55:03.976015] [INFO ] [MAIN ] LEO: Loaded 16716 existing records. [2025-10-15T19:55:04.122356] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-15T19:55:04.165805] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:04.166221] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-15T19:55:04.166278] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-15T19:55:04.166741] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-15T19:55:04.166813] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-15T19:55:04.530985] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:04.914001] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-15T19:55:05.135123] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:55:05.713997] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-15T19:55:05.745116] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:55:05.789961] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:55:06.514006] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-15T19:55:07.093792] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:55:07.102454] [INFO ] [REMOTE ] LDOS: Full fetch complete (67113 records). [2025-10-15T19:55:07.102598] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-15T19:55:07.317201] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-15T19:55:07.541189] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-15T19:55:07.541261] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-15T19:55:07.542226] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-15T19:55:07.542287] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-15T19:55:07.543460] [DEBUG] [LOCAL ] LDOS: Trimmed 67113 records to 44998 (keeping 200 days of data) [2025-10-15T19:55:07.845523] [DEBUG] [LOCAL ] LDOS: Primary data saved (44998 records). [2025-10-15T19:55:07.845734] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-15T19:55:07.846877] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LDOS took 36.9s. Estimated remaining: 2h 37m 30s. Rate: 7.1 symbols/min [2025-10-15T19:55:08.026576] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:08.059241] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:55:08.114161] [DEBUG] [LOCAL ] LEVI: Loaded 51765 existing records from primary storage. [2025-10-15T19:55:08.114266] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-15T19:55:08.115600] [INFO ] [MAIN ] LEVI: Loaded 51765 existing records. [2025-10-15T19:55:08.296698] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:08.296937] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-15T19:55:08.297006] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-15T19:55:08.297975] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-15T19:55:08.298037] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-15T19:55:08.474559] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T19:55:08.721510] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:08.914053] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-15T19:55:09.714069] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-15T19:55:10.142741] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T19:55:10.514011] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-15T19:55:10.781099] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T19:55:10.804898] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:55:11.314028] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-15T19:55:12.114030] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-15T19:55:12.192546] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:55:12.244016] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T19:55:12.914013] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-15T19:55:13.713979] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-15T19:55:13.787911] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T19:55:14.010367] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T19:55:14.514033] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-15T19:55:15.289351] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:55:15.313964] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-15T19:55:15.717158] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T19:55:16.114042] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-15T19:55:16.913973] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-15T19:55:17.304236] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T19:55:17.714083] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-15T19:55:17.811183] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T19:55:17.967036] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T19:55:18.514053] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-15T19:55:19.313987] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-15T19:55:19.383431] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T19:55:20.113973] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-15T19:55:20.283214] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T19:55:20.324694] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T19:55:20.913996] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-15T19:55:21.713976] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-15T19:55:21.910812] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T19:55:21.915612] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:55:22.514037] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-15T19:55:23.085423] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T19:55:23.314021] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-15T19:55:23.964515] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:55:24.113989] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-15T19:55:24.847833] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:55:24.913989] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-15T19:55:25.694427] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:55:25.713950] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-15T19:55:26.513978] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-15T19:55:26.593273] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:55:27.235063] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:55:27.314024] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-15T19:55:28.114027] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-15T19:55:28.261314] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T19:55:28.913999] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-15T19:55:28.958526] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T19:55:29.121244] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:55:29.714063] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-15T19:55:30.513982] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-15T19:55:30.693901] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T19:55:31.302881] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:55:31.313952] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-15T19:55:32.114004] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-15T19:55:32.225528] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:55:32.913995] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-15T19:55:32.951988] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:55:33.005084] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T19:55:33.714007] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-15T19:55:34.513990] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-15T19:55:34.866364] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T19:55:34.877471] [INFO ] [REMOTE ] LEVI: Full fetch complete (74865 records). [2025-10-15T19:55:34.877954] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-15T19:55:35.315528] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-15T19:55:35.435631] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:55:35.435943] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-15T19:55:35.436359] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-15T19:55:35.456148] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:55:35.455464] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-15T19:55:35.460288] [INFO ] [REMOTE ] LEO: Full fetch complete (26591 records). [2025-10-15T19:55:35.460546] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-15T19:55:35.460707] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-15T19:55:35.460113] [INFO ] [REMOTE ] LEG: Full fetch complete (73037 records). [2025-10-15T19:55:35.461150] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-15T19:55:35.638483] [DEBUG] [LOCAL ] LEVI: Trimmed 74865 records to 51780 (keeping 200 days of data) [2025-10-15T19:55:36.550615] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-15T19:55:36.559210] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-15T19:55:36.562008] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-15T19:55:36.562567] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-15T19:55:36.563557] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-15T19:55:36.563691] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-15T19:55:36.564559] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-15T19:55:36.565501] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-15T19:55:36.581097] [DEBUG] [LOCAL ] LEG: Trimmed 73037 records to 50170 (keeping 200 days of data) [2025-10-15T19:55:36.581548] [DEBUG] [LOCAL ] LEO: Trimmed 26591 records to 16652 (keeping 200 days of data) [2025-10-15T19:55:36.846810] [DEBUG] [LOCAL ] LEVI: Primary data saved (51780 records). [2025-10-15T19:55:36.847887] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-15T19:55:36.848941] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LEVI took 29.0s. Estimated remaining: 2h 37m 41s. Rate: 7.1 symbols/min [2025-10-15T19:55:36.959153] [DEBUG] [LOCAL ] LEO: Primary data saved (16652 records). [2025-10-15T19:55:36.982589] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-15T19:55:36.988270] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEO took 33.2s. Estimated remaining: 2h 37m 25s. Rate: 7.1 symbols/min [2025-10-15T19:55:37.224068] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:37.371231] [DEBUG] [LOCAL ] LFT: Loaded 18370 existing records from primary storage. [2025-10-15T19:55:37.370572] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:37.380509] [INFO ] [MAIN ] LFT: Loaded 18370 existing records. [2025-10-15T19:55:37.506166] [DEBUG] [LOCAL ] LGI: Loaded 10092 existing records from primary storage. [2025-10-15T19:55:37.524840] [INFO ] [MAIN ] LGI: Loaded 10092 existing records. [2025-10-15T19:55:37.637474] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:37.764420] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-15T19:55:37.781373] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-15T19:55:37.832197] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-15T19:55:37.857700] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-15T19:55:37.865119] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:37.874057] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-15T19:55:37.925612] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-15T19:55:37.988804] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-15T19:55:37.989056] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-15T19:55:37.983480] [DEBUG] [LOCAL ] LEG: Primary data saved (50170 records). [2025-10-15T19:55:38.016177] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-15T19:55:38.162718] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEG took 52.5s. Estimated remaining: 2h 37m 10s. Rate: 7.1 symbols/min [2025-10-15T19:55:38.568384] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-10-15T19:55:38.752949] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-15T19:55:38.824716] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:38.864232] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:38.898861] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-15T19:55:38.928335] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:38.930014] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-15T19:55:38.965634] [DEBUG] [LOCAL ] LH: Loaded 37606 existing records from primary storage. [2025-10-15T19:55:38.965950] [INFO ] [MAIN ] LH: Loaded 37606 existing records. [2025-10-15T19:55:39.142891] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:39.143150] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-15T19:55:39.143214] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-15T19:55:39.143991] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-15T19:55:39.144050] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-15T19:55:39.506331] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:39.506682] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-15T19:55:39.706340] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T19:55:39.709137] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-15T19:55:40.014885] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:55:40.114016] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-15T19:55:40.154242] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-15T19:55:40.663206] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:55:40.913978] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-15T19:55:41.044696] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T19:55:41.186821] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-15T19:55:41.196532] [INFO ] [REMOTE ] LEN: Full fetch complete (77197 records). [2025-10-15T19:55:41.196733] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-15T19:55:41.521460] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:55:41.604876] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-15T19:55:41.604951] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-15T19:55:41.605974] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-15T19:55:41.606041] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-15T19:55:41.607393] [DEBUG] [LOCAL ] LEN: Trimmed 77197 records to 53195 (keeping 200 days of data) [2025-10-15T19:55:41.715146] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-15T19:55:41.946232] [DEBUG] [LOCAL ] LEN: Primary data saved (53195 records). [2025-10-15T19:55:41.946375] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-15T19:55:41.947017] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEN took 41.3s. Estimated remaining: 2h 36m 57s. Rate: 7.1 symbols/min [2025-10-15T19:55:42.118546] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:42.166942] [DEBUG] [LOCAL ] LHX: Loaded 48594 existing records from primary storage. [2025-10-15T19:55:42.167259] [INFO ] [MAIN ] LHX: Loaded 48594 existing records. [2025-10-15T19:55:42.343131] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:42.343383] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-15T19:55:42.343432] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-15T19:55:42.343997] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-15T19:55:42.344052] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-15T19:55:42.519199] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-15T19:55:42.780471] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:42.979962] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:55:43.313973] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-15T19:55:43.465529] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T19:55:44.087276] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T19:55:44.113968] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-15T19:55:44.913977] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-15T19:55:45.134609] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T19:55:45.714037] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-15T19:55:46.409550] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:55:46.513955] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-15T19:55:46.976094] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T19:55:47.314011] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-15T19:55:48.036115] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T19:55:48.095984] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T19:55:48.113946] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-15T19:55:48.850374] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:55:48.913999] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-15T19:55:49.690667] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:55:49.713950] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-15T19:55:50.513966] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-15T19:55:50.607489] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T19:55:51.313997] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-15T19:55:51.982564] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:55:52.113993] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-15T19:55:52.913990] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-15T19:55:53.033177] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T19:55:53.714164] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-15T19:55:53.763379] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T19:55:53.772753] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T19:55:54.514019] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-15T19:55:55.104248] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T19:55:55.314022] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-15T19:55:55.482998] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T19:55:56.021476] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T19:55:56.023724] [INFO ] [REMOTE ] LGI: Full fetch complete (14525 records). [2025-10-15T19:55:56.023807] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-15T19:55:56.119154] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-15T19:55:56.409972] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-15T19:55:56.410072] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-15T19:55:56.410500] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-15T19:55:56.410543] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-15T19:55:56.411153] [DEBUG] [LOCAL ] LGI: Trimmed 14525 records to 10092 (keeping 200 days of data) [2025-10-15T19:55:56.475766] [DEBUG] [LOCAL ] LGI: Primary data saved (10092 records). [2025-10-15T19:55:56.475957] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-15T19:55:56.476059] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LGI took 19.5s. Estimated remaining: 2h 36m 54s. Rate: 7.1 symbols/min [2025-10-15T19:55:56.658766] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:56.686340] [DEBUG] [LOCAL ] LII: Loaded 27855 existing records from primary storage. [2025-10-15T19:55:56.686599] [INFO ] [MAIN ] LII: Loaded 27855 existing records. [2025-10-15T19:55:56.859322] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:56.859692] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-15T19:55:56.859751] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-15T19:55:56.860076] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-15T19:55:56.860134] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-15T19:55:56.921336] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-15T19:55:57.190277] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T19:55:57.258720] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:57.714047] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-15T19:55:58.514027] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-15T19:55:58.743362] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:55:59.199992] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:55:59.314063] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-15T19:55:59.674688] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:55:59.910928] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T19:56:00.114021] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-15T19:56:00.914020] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-15T19:56:01.252415] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:56:01.714038] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-15T19:56:02.523835] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-15T19:56:02.528003] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T19:56:02.863077] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:56:03.314025] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-15T19:56:04.113971] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-15T19:56:04.218324] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:56:04.326378] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:56:04.913993] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-15T19:56:05.225567] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:56:05.714004] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-15T19:56:06.514044] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-15T19:56:06.763284] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T19:56:07.078812] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T19:56:07.314033] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-15T19:56:07.584711] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:56:08.114018] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-15T19:56:08.716920] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:56:08.914002] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-15T19:56:09.183780] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:56:09.714000] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-15T19:56:10.339817] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:56:10.513972] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-15T19:56:11.010237] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T19:56:11.314095] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-15T19:56:12.113982] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-15T19:56:12.202159] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:56:12.685454] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:56:12.689897] [INFO ] [REMOTE ] LH: Full fetch complete (54961 records). [2025-10-15T19:56:12.690013] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-15T19:56:12.919250] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-15T19:56:13.073477] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-15T19:56:13.073571] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-15T19:56:13.074462] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-15T19:56:13.074564] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-15T19:56:13.075807] [DEBUG] [LOCAL ] LH: Trimmed 54961 records to 37607 (keeping 200 days of data) [2025-10-15T19:56:13.293976] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T19:56:13.329065] [DEBUG] [LOCAL ] LH: Primary data saved (37607 records). [2025-10-15T19:56:13.329180] [INFO ] [MAIN ] LH: Full history saved. [2025-10-15T19:56:13.329250] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LH took 35.1s. Estimated remaining: 2h 36m 53s. Rate: 7.1 symbols/min [2025-10-15T19:56:13.509211] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:13.552773] [DEBUG] [LOCAL ] LION: Loaded 46175 existing records from primary storage. [2025-10-15T19:56:13.553061] [INFO ] [MAIN ] LION: Loaded 46175 existing records. [2025-10-15T19:56:13.719835] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-15T19:56:13.733436] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:13.734444] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-15T19:56:13.734520] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-15T19:56:13.735004] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-15T19:56:13.735076] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-15T19:56:14.048818] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:56:14.112158] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:14.514013] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-15T19:56:15.314007] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-15T19:56:15.455347] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:56:15.457563] [INFO ] [REMOTE ] LFT: Full fetch complete (24071 records). [2025-10-15T19:56:15.457637] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-15T19:56:15.840743] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-15T19:56:15.840853] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-15T19:56:15.841434] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-15T19:56:15.841512] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-15T19:56:15.842490] [DEBUG] [LOCAL ] LFT: Trimmed 24071 records to 18357 (keeping 200 days of data) [2025-10-15T19:56:15.953025] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T19:56:15.993590] [DEBUG] [LOCAL ] LFT: Primary data saved (18357 records). [2025-10-15T19:56:15.993779] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-15T19:56:15.993893] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LFT took 39.1s. Estimated remaining: 2h 36m 40s. Rate: 7.1 symbols/min [2025-10-15T19:56:16.119124] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-15T19:56:16.171917] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:16.178344] [DEBUG] [LOCAL ] LITB: Loaded 4160 existing records from primary storage. [2025-10-15T19:56:16.178567] [INFO ] [MAIN ] LITB: Loaded 4160 existing records. [2025-10-15T19:56:16.369122] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:16.369367] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-15T19:56:16.369419] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-15T19:56:16.369567] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-15T19:56:16.369621] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-15T19:56:16.537136] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:56:16.782231] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:16.914020] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-15T19:56:17.528897] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:56:17.714010] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-15T19:56:18.513972] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-15T19:56:18.640911] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:56:18.946487] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T19:56:18.974823] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-15T19:56:19.313990] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-15T19:56:19.835902] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T19:56:20.114038] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-15T19:56:20.914061] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-15T19:56:21.401179] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T19:56:21.713993] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-15T19:56:22.072028] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T19:56:22.308532] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T19:56:22.513989] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-15T19:56:23.313998] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-15T19:56:23.932565] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T19:56:24.096348] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:56:24.102236] [INFO ] [REMOTE ] LHX: Full fetch complete (70762 records). [2025-10-15T19:56:24.102381] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-15T19:56:24.123271] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-15T19:56:24.492338] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-15T19:56:24.492413] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-15T19:56:24.493404] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-15T19:56:24.493466] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-15T19:56:24.494853] [DEBUG] [LOCAL ] LHX: Trimmed 70762 records to 48604 (keeping 200 days of data) [2025-10-15T19:56:24.798770] [DEBUG] [LOCAL ] LHX: Primary data saved (48604 records). [2025-10-15T19:56:24.798915] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-15T19:56:24.799238] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LHX took 42.9s. Estimated remaining: 2h 36m 32s. Rate: 7.1 symbols/min [2025-10-15T19:56:24.919102] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-15T19:56:24.977546] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:25.017868] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T19:56:25.040702] [DEBUG] [LOCAL ] LLY: Loaded 53265 existing records from primary storage. [2025-10-15T19:56:25.041080] [INFO ] [MAIN ] LLY: Loaded 53265 existing records. [2025-10-15T19:56:25.218402] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:25.218611] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-15T19:56:25.218685] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-15T19:56:25.219582] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-15T19:56:25.219669] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-15T19:56:25.572737] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:25.713993] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-15T19:56:26.314505] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:56:26.318193] [INFO ] [REMOTE ] LII: Full fetch complete (41343 records). [2025-10-15T19:56:26.318331] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-15T19:56:26.523996] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-15T19:56:26.784083] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-15T19:56:26.784212] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-15T19:56:26.785936] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-15T19:56:26.786029] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-15T19:56:26.787498] [DEBUG] [LOCAL ] LII: Trimmed 41343 records to 27767 (keeping 200 days of data) [2025-10-15T19:56:27.035412] [DEBUG] [LOCAL ] LII: Primary data saved (27767 records). [2025-10-15T19:56:27.035599] [INFO ] [MAIN ] LII: Full history saved. [2025-10-15T19:56:27.035746] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LII took 30.6s. Estimated remaining: 2h 36m 18s. Rate: 7.1 symbols/min [2025-10-15T19:56:27.168084] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:56:27.296516] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:27.328015] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-15T19:56:27.354318] [DEBUG] [LOCAL ] LMND: Loaded 52049 existing records from primary storage. [2025-10-15T19:56:27.354754] [INFO ] [MAIN ] LMND: Loaded 52049 existing records. [2025-10-15T19:56:27.573566] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:27.573841] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-15T19:56:27.573894] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-15T19:56:27.574998] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-15T19:56:27.575065] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-15T19:56:27.971134] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:28.119120] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-15T19:56:28.139674] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-15T19:56:28.410063] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:56:28.914021] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-15T19:56:29.713991] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-15T19:56:29.820500] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T19:56:29.933871] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:56:30.514023] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-15T19:56:30.951053] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:56:31.314013] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-15T19:56:31.698291] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T19:56:32.108106] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-15T19:56:32.118349] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-15T19:56:32.914013] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-15T19:56:33.039455] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T19:56:33.347266] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:56:33.714002] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-15T19:56:34.514023] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-15T19:56:34.960999] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:56:35.314007] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-15T19:56:35.892382] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:56:36.114040] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-15T19:56:36.629388] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T19:56:36.697911] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:56:36.698907] [INFO ] [REMOTE ] LITB: Full fetch complete (5677 records). [2025-10-15T19:56:36.698975] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-15T19:56:36.919179] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-15T19:56:37.058897] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-15T19:56:37.059004] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-15T19:56:37.059172] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-15T19:56:37.059211] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-15T19:56:37.059570] [DEBUG] [LOCAL ] LITB: Trimmed 5677 records to 4146 (keeping 200 days of data) [2025-10-15T19:56:37.082661] [DEBUG] [LOCAL ] LITB: Primary data saved (4146 records). [2025-10-15T19:56:37.082768] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-15T19:56:37.082844] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LITB took 21.1s. Estimated remaining: 2h 36m 11s. Rate: 7.1 symbols/min [2025-10-15T19:56:37.246309] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:37.246490] [DEBUG] [LOCAL ] LMT: No existing data file found in primary storage. [2025-10-15T19:56:37.246526] [WARN ] [MAIN ] LMT: No existing data found, performing full refresh instead. [2025-10-15T19:56:37.246633] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-15T19:56:37.246710] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-15T19:56:37.246768] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-10-15T19:56:37.246801] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-15T19:56:37.594384] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:37.713981] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-15T19:56:38.514027] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-15T19:56:39.314103] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-15T19:56:39.354224] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-15T19:56:39.679202] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T19:56:40.113960] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-15T19:56:40.310414] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T19:56:40.763844] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:56:40.913998] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-15T19:56:41.714033] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-15T19:56:42.215275] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T19:56:42.346951] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T19:56:42.513988] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-15T19:56:43.314065] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-15T19:56:43.555390] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T19:56:44.113990] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-15T19:56:44.769131] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:56:44.913963] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-15T19:56:45.091004] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-15T19:56:45.713994] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-15T19:56:46.161150] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-15T19:56:46.514021] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-15T19:56:46.772746] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T19:56:47.314062] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-15T19:56:48.114028] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-15T19:56:48.313749] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-15T19:56:48.606728] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T19:56:48.913975] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-15T19:56:49.063381] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T19:56:49.714010] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-15T19:56:49.969552] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T19:56:50.513988] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-15T19:56:51.303474] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-15T19:56:51.314052] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-15T19:56:51.607246] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:56:52.114448] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-15T19:56:52.114356] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T19:56:52.914031] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-15T19:56:53.716160] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-15T19:56:53.716078] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T19:56:53.741094] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T19:56:54.513959] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-15T19:56:54.595538] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:56:55.314030] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-15T19:56:55.676427] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T19:56:56.114042] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-15T19:56:56.143244] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:56:56.149403] [INFO ] [REMOTE ] LION: Full fetch complete (57108 records). [2025-10-15T19:56:56.149524] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-15T19:56:56.528354] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-15T19:56:56.528442] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-15T19:56:56.529361] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-15T19:56:56.529423] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-15T19:56:56.530614] [DEBUG] [LOCAL ] LION: Trimmed 57108 records to 46349 (keeping 200 days of data) [2025-10-15T19:56:56.786803] [DEBUG] [LOCAL ] LION: Primary data saved (46349 records). [2025-10-15T19:56:56.786976] [INFO ] [MAIN ] LION: Full history saved. [2025-10-15T19:56:56.787086] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LION took 43.5s. Estimated remaining: 2h 36m 12s. Rate: 7.1 symbols/min [2025-10-15T19:56:56.919130] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-15T19:56:56.965199] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:57.015509] [DEBUG] [LOCAL ] LNC: Loaded 51593 existing records from primary storage. [2025-10-15T19:56:57.015967] [INFO ] [MAIN ] LNC: Loaded 51593 existing records. [2025-10-15T19:56:57.231729] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T19:56:57.235911] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:57.247068] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-15T19:56:57.247441] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-15T19:56:57.248785] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-15T19:56:57.248849] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-15T19:56:57.597358] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:57.713978] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-15T19:56:58.514031] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-15T19:56:58.701477] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-15T19:56:59.113622] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-15T19:56:59.313968] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-15T19:56:59.360456] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:57:00.113992] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-15T19:57:00.473964] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-15T19:57:00.913993] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-15T19:57:01.596615] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:57:01.713962] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-15T19:57:01.985200] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-15T19:57:02.514044] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-15T19:57:03.028071] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T19:57:03.319080] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-15T19:57:03.325334] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:57:04.113987] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-15T19:57:04.676700] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-15T19:57:04.913988] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-15T19:57:05.545039] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T19:57:05.714045] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-15T19:57:05.839735] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:57:05.868810] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T19:57:05.875298] [INFO ] [REMOTE ] LLY: Full fetch complete (77258 records). [2025-10-15T19:57:05.875452] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-15T19:57:06.257974] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-15T19:57:06.258057] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-15T19:57:06.259104] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-15T19:57:06.259168] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-15T19:57:06.260574] [DEBUG] [LOCAL ] LLY: Trimmed 77258 records to 53261 (keeping 200 days of data) [2025-10-15T19:57:06.539766] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-15T19:57:06.588411] [DEBUG] [LOCAL ] LLY: Primary data saved (53261 records). [2025-10-15T19:57:06.588511] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-15T19:57:06.588993] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LLY took 41.8s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-15T19:57:06.754270] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:06.761955] [DEBUG] [LOCAL ] LND: Loaded 4953 existing records from primary storage. [2025-10-15T19:57:06.762164] [INFO ] [MAIN ] LND: Loaded 4953 existing records. [2025-10-15T19:57:06.939084] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:06.939306] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-15T19:57:06.939389] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-15T19:57:06.939686] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-15T19:57:06.939754] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-15T19:57:07.286565] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:07.313951] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-15T19:57:07.892618] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T19:57:07.898893] [INFO ] [REMOTE ] LMND: Full fetch complete (75460 records). [2025-10-15T19:57:07.899000] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-15T19:57:08.121166] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-15T19:57:08.197668] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:57:08.308164] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-15T19:57:08.308267] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-15T19:57:08.309384] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-15T19:57:08.309484] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-15T19:57:08.311078] [DEBUG] [LOCAL ] LMND: Trimmed 75460 records to 52062 (keeping 200 days of data) [2025-10-15T19:57:08.426787] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:57:08.652312] [DEBUG] [LOCAL ] LMND: Primary data saved (52062 records). [2025-10-15T19:57:08.652468] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-15T19:57:08.653393] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LMND took 41.6s. Estimated remaining: 2h 35m 51s. Rate: 7.1 symbols/min [2025-10-15T19:57:08.817575] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:08.868706] [DEBUG] [LOCAL ] LNG: Loaded 51269 existing records from primary storage. [2025-10-15T19:57:08.869015] [INFO ] [MAIN ] LNG: Loaded 51269 existing records. [2025-10-15T19:57:08.922017] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-15T19:57:09.049191] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:09.049425] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-15T19:57:09.049471] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-15T19:57:09.050370] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-15T19:57:09.050426] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-15T19:57:09.394558] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:09.714017] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-15T19:57:10.064089] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T19:57:10.333598] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:57:10.513985] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-15T19:57:10.694256] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T19:57:11.314039] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-15T19:57:12.114019] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-15T19:57:12.618753] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T19:57:12.618491] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:57:12.647234] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-15T19:57:12.653125] [INFO ] [REMOTE ] LMT: Full fetch complete (72446 records). [2025-10-15T19:57:12.653258] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-15T19:57:12.919161] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-15T19:57:13.041543] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-15T19:57:13.041618] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-15T19:57:13.042635] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-15T19:57:13.042719] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-15T19:57:13.044059] [DEBUG] [LOCAL ] LMT: Trimmed 72446 records to 49623 (keeping 200 days of data) [2025-10-15T19:57:13.351224] [DEBUG] [LOCAL ] LMT: Primary data saved (49623 records). [2025-10-15T19:57:13.351353] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-15T19:57:13.351427] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LMT took 36.3s. Estimated remaining: 2h 35m 39s. Rate: 7.1 symbols/min [2025-10-15T19:57:13.521983] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:13.533873] [DEBUG] [LOCAL ] LNN: Loaded 11373 existing records from primary storage. [2025-10-15T19:57:13.534100] [INFO ] [MAIN ] LNN: Loaded 11373 existing records. [2025-10-15T19:57:13.717853] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:13.714669] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-15T19:57:13.718846] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-15T19:57:13.718929] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-15T19:57:13.719246] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-15T19:57:13.719301] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-15T19:57:14.077986] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:14.421062] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T19:57:14.514018] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-15T19:57:14.736281] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:57:15.313988] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-15T19:57:16.114021] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-15T19:57:16.272527] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:57:16.605064] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-15T19:57:16.913973] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-15T19:57:17.083117] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:57:17.714010] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-15T19:57:18.514052] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-15T19:57:19.035866] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:57:19.120049] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-15T19:57:19.165493] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T19:57:19.314039] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-15T19:57:20.114076] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-15T19:57:20.914002] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-15T19:57:20.980033] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T19:57:21.175447] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T19:57:21.184344] [INFO ] [REMOTE ] LNC: Full fetch complete (74510 records). [2025-10-15T19:57:21.184513] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-15T19:57:21.578152] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-15T19:57:21.578233] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-15T19:57:21.579274] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-15T19:57:21.579339] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-15T19:57:21.580785] [DEBUG] [LOCAL ] LNC: Trimmed 74510 records to 51556 (keeping 200 days of data) [2025-10-15T19:57:21.761763] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-15T19:57:21.906933] [DEBUG] [LOCAL ] LNC: Primary data saved (51556 records). [2025-10-15T19:57:21.907100] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-15T19:57:21.907188] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LNC took 25.1s. Estimated remaining: 2h 35m 31s. Rate: 7.1 symbols/min [2025-10-15T19:57:22.073374] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:22.110164] [DEBUG] [LOCAL ] LOAR: Loaded 42212 existing records from primary storage. [2025-10-15T19:57:22.110435] [INFO ] [MAIN ] LOAR: Loaded 42212 existing records. [2025-10-15T19:57:22.290143] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:22.290410] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-15T19:57:22.290459] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-15T19:57:22.291139] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-15T19:57:22.291196] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-15T19:57:22.398805] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:57:22.519076] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-15T19:57:22.668510] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:22.706244] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T19:57:23.313975] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-15T19:57:23.387733] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T19:57:24.114009] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-15T19:57:24.617476] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T19:57:24.753341] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T19:57:24.913994] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-15T19:57:25.713973] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-15T19:57:25.954787] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T19:57:26.302865] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T19:57:26.514005] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-15T19:57:27.015901] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T19:57:27.314048] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-15T19:57:28.114094] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-15T19:57:28.584716] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:57:28.608562] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:57:28.914014] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-15T19:57:29.714060] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-15T19:57:30.307029] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:57:30.514025] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-15T19:57:31.313978] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-15T19:57:31.456232] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:57:31.546012] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T19:57:32.114018] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-15T19:57:32.871873] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:57:32.914037] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-15T19:57:33.714032] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-15T19:57:33.927252] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T19:57:34.513998] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-15T19:57:34.615742] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:57:34.663602] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T19:57:35.314000] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-15T19:57:36.113961] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-15T19:57:36.187675] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T19:57:36.383343] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T19:57:36.459565] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T19:57:36.914063] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-15T19:57:37.714039] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-15T19:57:38.269544] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:57:38.296536] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:57:38.297852] [INFO ] [REMOTE ] LND: Full fetch complete (7980 records). [2025-10-15T19:57:38.297948] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-15T19:57:38.519091] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-15T19:57:38.654293] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-15T19:57:38.654364] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-15T19:57:38.654550] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-15T19:57:38.654587] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-15T19:57:38.654988] [DEBUG] [LOCAL ] LND: Trimmed 7980 records to 4972 (keeping 200 days of data) [2025-10-15T19:57:38.681554] [DEBUG] [LOCAL ] LND: Primary data saved (4972 records). [2025-10-15T19:57:38.681625] [INFO ] [MAIN ] LND: Full history saved. [2025-10-15T19:57:38.681729] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LND took 32.1s. Estimated remaining: 2h 35m 30s. Rate: 7.1 symbols/min [2025-10-15T19:57:38.845105] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:38.871703] [DEBUG] [LOCAL ] LOB: Loaded 26746 existing records from primary storage. [2025-10-15T19:57:38.871949] [INFO ] [MAIN ] LOB: Loaded 26746 existing records. [2025-10-15T19:57:39.051168] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:39.051361] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-15T19:57:39.051409] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-15T19:57:39.051963] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-15T19:57:39.052021] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-15T19:57:39.319149] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-15T19:57:39.458194] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:40.114003] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-15T19:57:40.531939] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T19:57:40.886451] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T19:57:40.913975] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-15T19:57:41.098050] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:57:41.714011] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-15T19:57:42.263857] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:57:42.514010] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-15T19:57:43.313981] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-15T19:57:43.730561] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:57:43.768332] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:57:44.052919] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T19:57:44.113966] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-15T19:57:44.914036] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-15T19:57:45.030349] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:57:45.619111] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T19:57:45.714059] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-15T19:57:46.513998] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-15T19:57:47.067287] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T19:57:47.072313] [INFO ] [REMOTE ] LOAR: Full fetch complete (56057 records). [2025-10-15T19:57:47.072427] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-15T19:57:47.322451] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-15T19:57:47.509883] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-15T19:57:47.510059] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-15T19:57:47.510981] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-15T19:57:47.511090] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-15T19:57:47.530605] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T19:57:47.538507] [DEBUG] [LOCAL ] LOAR: Trimmed 56057 records to 42140 (keeping 200 days of data) [2025-10-15T19:57:47.787668] [DEBUG] [LOCAL ] LOAR: Primary data saved (42140 records). [2025-10-15T19:57:47.787820] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-15T19:57:47.787907] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LOAR took 25.9s. Estimated remaining: 2h 35m 22s. Rate: 7.1 symbols/min [2025-10-15T19:57:47.960365] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:47.965329] [DEBUG] [LOCAL ] LOCL: Loaded 3701 existing records from primary storage. [2025-10-15T19:57:47.965482] [INFO ] [MAIN ] LOCL: Loaded 3701 existing records. [2025-10-15T19:57:48.120750] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-15T19:57:48.150219] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:48.150431] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-15T19:57:48.150478] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-15T19:57:48.150711] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-15T19:57:48.150768] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-15T19:57:48.501707] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:48.919113] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-15T19:57:48.941538] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:57:49.562038] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T19:57:49.673604] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:57:49.713965] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-15T19:57:50.514017] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-15T19:57:50.796717] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:57:50.881519] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:57:51.314037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-15T19:57:51.655062] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:57:52.114023] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-15T19:57:52.911049] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:57:52.914046] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-15T19:57:53.713980] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-15T19:57:54.020217] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T19:57:54.496959] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:57:54.513957] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-15T19:57:55.313998] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-15T19:57:55.377855] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:57:55.379586] [INFO ] [REMOTE ] LNN: Full fetch complete (15697 records). [2025-10-15T19:57:55.379692] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-15T19:57:55.745407] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T19:57:55.745716] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-15T19:57:55.747051] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-15T19:57:55.747626] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-15T19:57:55.747718] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-15T19:57:55.748290] [DEBUG] [LOCAL ] LNN: Trimmed 15697 records to 11430 (keeping 200 days of data) [2025-10-15T19:57:55.821303] [DEBUG] [LOCAL ] LNN: Primary data saved (11430 records). [2025-10-15T19:57:55.821459] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-15T19:57:55.821544] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LNN took 42.5s. Estimated remaining: 2h 35m 13s. Rate: 7.1 symbols/min [2025-10-15T19:57:55.987950] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:56.017282] [DEBUG] [LOCAL ] LOMA: Loaded 32605 existing records from primary storage. [2025-10-15T19:57:56.017540] [INFO ] [MAIN ] LOMA: Loaded 32605 existing records. [2025-10-15T19:57:56.115225] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-15T19:57:56.201967] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:56.202144] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-15T19:57:56.202196] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-15T19:57:56.202794] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-15T19:57:56.202850] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-15T19:57:56.547751] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:56.914000] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-15T19:57:57.713975] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-15T19:57:57.826807] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:57:57.854836] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T19:57:58.477961] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:57:58.513985] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-15T19:57:59.313993] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-15T19:57:59.586768] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:58:00.113998] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-15T19:58:00.488543] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T19:58:00.914002] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-15T19:58:01.407566] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T19:58:01.714001] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-15T19:58:02.332699] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T19:58:02.364795] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:58:02.514005] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-15T19:58:02.954676] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:58:03.313977] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-15T19:58:04.114000] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-15T19:58:04.154632] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:58:04.160683] [INFO ] [REMOTE ] LNG: Full fetch complete (74748 records). [2025-10-15T19:58:04.160869] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-15T19:58:04.553384] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-15T19:58:04.553475] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-15T19:58:04.554578] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-15T19:58:04.554677] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-15T19:58:04.556152] [DEBUG] [LOCAL ] LNG: Trimmed 74748 records to 51216 (keeping 200 days of data) [2025-10-15T19:58:04.688353] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T19:58:04.889219] [DEBUG] [LOCAL ] LNG: Primary data saved (51216 records). [2025-10-15T19:58:04.889371] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-15T19:58:04.890369] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LNG took 56.2s. Estimated remaining: 2h 35m 5s. Rate: 7.1 symbols/min [2025-10-15T19:58:04.922426] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-15T19:58:05.083476] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:05.142807] [DEBUG] [LOCAL ] LOW: Loaded 52994 existing records from primary storage. [2025-10-15T19:58:05.143154] [INFO ] [MAIN ] LOW: Loaded 52994 existing records. [2025-10-15T19:58:05.320662] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:05.320863] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-15T19:58:05.320912] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-15T19:58:05.321827] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-15T19:58:05.321886] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-15T19:58:05.683413] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:05.713969] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-15T19:58:06.218587] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T19:58:06.514014] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-15T19:58:06.965662] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:58:07.313992] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-15T19:58:07.390394] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T19:58:08.114067] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-15T19:58:08.575696] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:58:08.578961] [INFO ] [REMOTE ] LOB: Full fetch complete (38203 records). [2025-10-15T19:58:08.579060] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-15T19:58:08.919089] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-15T19:58:08.968695] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-15T19:58:08.968823] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-15T19:58:08.969695] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-15T19:58:08.969826] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-15T19:58:08.970861] [DEBUG] [LOCAL ] LOB: Trimmed 38203 records to 26728 (keeping 200 days of data) [2025-10-15T19:58:09.139480] [DEBUG] [LOCAL ] LOB: Primary data saved (26728 records). [2025-10-15T19:58:09.139687] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-15T19:58:09.139818] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LOB took 30.5s. Estimated remaining: 2h 34m 53s. Rate: 7.1 symbols/min [2025-10-15T19:58:09.276110] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T19:58:09.339627] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:09.376492] [DEBUG] [LOCAL ] LPG: Loaded 39624 existing records from primary storage. [2025-10-15T19:58:09.376827] [INFO ] [MAIN ] LPG: Loaded 39624 existing records. [2025-10-15T19:58:09.552817] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:09.556109] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-15T19:58:09.559414] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-15T19:58:09.559724] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T19:58:09.561251] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-15T19:58:09.562062] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-15T19:58:09.719133] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-15T19:58:09.948567] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:10.514037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-15T19:58:10.967954] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:58:11.042689] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T19:58:11.043739] [INFO ] [REMOTE ] LOCL: Full fetch complete (4553 records). [2025-10-15T19:58:11.043809] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-15T19:58:11.319064] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-15T19:58:11.407349] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-15T19:58:11.407421] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-15T19:58:11.407561] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-15T19:58:11.407597] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-15T19:58:11.407986] [DEBUG] [LOCAL ] LOCL: Trimmed 4553 records to 3781 (keeping 200 days of data) [2025-10-15T19:58:11.428527] [DEBUG] [LOCAL ] LOCL: Primary data saved (3781 records). [2025-10-15T19:58:11.428598] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-15T19:58:11.428693] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LOCL took 23.6s. Estimated remaining: 2h 34m 39s. Rate: 7.1 symbols/min [2025-10-15T19:58:11.594825] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:11.624722] [DEBUG] [LOCAL ] LPL: Loaded 28131 existing records from primary storage. [2025-10-15T19:58:11.625015] [INFO ] [MAIN ] LPL: Loaded 28131 existing records. [2025-10-15T19:58:11.824029] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:11.824443] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-15T19:58:11.824498] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-15T19:58:11.824903] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-15T19:58:11.824960] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-15T19:58:12.119165] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-15T19:58:12.169632] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:12.358351] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:58:12.914017] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-15T19:58:13.713979] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-15T19:58:13.827303] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:58:14.034877] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:58:14.514062] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-15T19:58:15.313982] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-15T19:58:15.420695] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:58:15.582094] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:58:16.114027] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-15T19:58:16.919105] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-15T19:58:16.934394] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T19:58:16.997073] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:58:17.714007] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-15T19:58:17.925554] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:58:18.514020] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-15T19:58:18.848342] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T19:58:19.314068] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-15T19:58:20.114006] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-15T19:58:20.358298] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T19:58:20.826753] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:58:20.903437] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T19:58:20.913952] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-15T19:58:21.656437] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T19:58:21.713991] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-15T19:58:22.513957] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-15T19:58:22.823960] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T19:58:23.313976] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-15T19:58:23.589178] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T19:58:24.114013] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-15T19:58:24.920807] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-15T19:58:24.923200] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:58:25.173559] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T19:58:25.713990] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-15T19:58:26.155376] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T19:58:26.513964] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-15T19:58:26.851898] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:58:27.314078] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-15T19:58:28.049538] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:58:28.113965] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-15T19:58:28.913971] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-15T19:58:29.277567] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T19:58:29.613282] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:58:29.621122] [INFO ] [REMOTE ] LOMA: Full fetch complete (47991 records). [2025-10-15T19:58:29.621372] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-15T19:58:29.719307] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-15T19:58:30.159398] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-15T19:58:30.159542] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-15T19:58:30.160500] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-15T19:58:30.160955] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-15T19:58:30.189510] [DEBUG] [LOCAL ] LOMA: Trimmed 47991 records to 32694 (keeping 200 days of data) [2025-10-15T19:58:30.190843] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:58:30.385830] [DEBUG] [LOCAL ] LOMA: Primary data saved (32694 records). [2025-10-15T19:58:30.385978] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-15T19:58:30.386074] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LOMA took 34.6s. Estimated remaining: 2h 34m 40s. Rate: 7.1 symbols/min [2025-10-15T19:58:30.522778] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-15T19:58:30.554767] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:30.590463] [DEBUG] [LOCAL ] LPX: Loaded 40227 existing records from primary storage. [2025-10-15T19:58:30.590765] [INFO ] [MAIN ] LPX: Loaded 40227 existing records. [2025-10-15T19:58:30.766840] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:30.767065] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-15T19:58:30.767113] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-15T19:58:30.768135] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-15T19:58:30.768195] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-15T19:58:31.122748] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:31.292012] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:58:31.314017] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-15T19:58:31.580079] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:58:32.114022] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-15T19:58:32.737246] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:58:32.914029] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-15T19:58:33.612043] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:58:33.713993] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-15T19:58:34.213108] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:58:34.514043] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-15T19:58:34.836121] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T19:58:35.314115] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-15T19:58:36.047786] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T19:58:36.055446] [INFO ] [REMOTE ] LPL: Full fetch complete (36846 records). [2025-10-15T19:58:36.055710] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-15T19:58:36.125748] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-15T19:58:36.469577] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-15T19:58:36.469867] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-15T19:58:36.470761] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-15T19:58:36.470854] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-15T19:58:36.471835] [DEBUG] [LOCAL ] LPL: Trimmed 36846 records to 28287 (keeping 200 days of data) [2025-10-15T19:58:36.656769] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:58:36.679085] [DEBUG] [LOCAL ] LPL: Primary data saved (28287 records). [2025-10-15T19:58:36.679208] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-15T19:58:36.679351] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LPL took 25.3s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-15T19:58:36.855790] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:36.898975] [DEBUG] [LOCAL ] LRN: Loaded 39539 existing records from primary storage. [2025-10-15T19:58:36.899303] [INFO ] [MAIN ] LRN: Loaded 39539 existing records. [2025-10-15T19:58:36.921580] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-15T19:58:37.083126] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:37.083323] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-15T19:58:37.083379] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-15T19:58:37.084082] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-15T19:58:37.084138] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-15T19:58:37.431680] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:37.714010] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-15T19:58:37.928520] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T19:58:38.289045] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T19:58:38.513968] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-15T19:58:39.290526] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T19:58:39.314033] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-15T19:58:40.114042] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-15T19:58:40.281201] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T19:58:40.698211] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T19:58:40.914032] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-15T19:58:41.599291] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T19:58:41.714002] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-15T19:58:42.497429] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:58:42.513962] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-15T19:58:43.313985] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-15T19:58:43.476077] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:58:43.643908] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T19:58:44.114010] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-15T19:58:44.281344] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:58:44.914066] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-15T19:58:45.713984] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-15T19:58:45.761756] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T19:58:46.385087] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:58:46.389621] [INFO ] [REMOTE ] LPG: Full fetch complete (59202 records). [2025-10-15T19:58:46.389781] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-15T19:58:46.519215] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-15T19:58:46.778211] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-15T19:58:46.778286] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-15T19:58:46.779201] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-15T19:58:46.779262] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-15T19:58:46.780349] [DEBUG] [LOCAL ] LPG: Trimmed 59202 records to 39643 (keeping 200 days of data) [2025-10-15T19:58:47.015417] [DEBUG] [LOCAL ] LPG: Primary data saved (39643 records). [2025-10-15T19:58:47.015554] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-15T19:58:47.015984] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LPG took 37.9s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-15T19:58:47.185840] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:47.226411] [DEBUG] [LOCAL ] LSPD: Loaded 42628 existing records from primary storage. [2025-10-15T19:58:47.226718] [INFO ] [MAIN ] LSPD: Loaded 42628 existing records. [2025-10-15T19:58:47.320546] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-15T19:58:47.412092] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:47.412358] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-15T19:58:47.412407] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-15T19:58:47.412987] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-15T19:58:47.413044] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-15T19:58:47.780089] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:47.814992] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:58:47.865794] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T19:58:48.114001] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-15T19:58:48.913976] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-15T19:58:48.971235] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T19:58:49.289033] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:58:49.714029] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-15T19:58:50.514000] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-15T19:58:50.634379] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:58:51.305889] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T19:58:51.314559] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-15T19:58:52.042237] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:58:52.113955] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-15T19:58:52.914029] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-15T19:58:53.224864] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T19:58:53.577981] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:58:53.713992] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-15T19:58:54.001535] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:58:54.120172] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T19:58:54.126535] [INFO ] [REMOTE ] LOW: Full fetch complete (76707 records). [2025-10-15T19:58:54.126716] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-15T19:58:54.514052] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-15T19:58:54.535966] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-15T19:58:54.536119] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-15T19:58:54.538217] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-15T19:58:54.538406] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-15T19:58:54.540106] [DEBUG] [LOCAL ] LOW: Trimmed 76707 records to 52993 (keeping 200 days of data) [2025-10-15T19:58:54.888213] [DEBUG] [LOCAL ] LOW: Primary data saved (52993 records). [2025-10-15T19:58:54.888365] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-15T19:58:54.889349] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LOW took 50.0s. Estimated remaining: 2h 34m 14s. Rate: 7.1 symbols/min [2025-10-15T19:58:55.056334] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:55.087574] [DEBUG] [LOCAL ] LTC: Loaded 30571 existing records from primary storage. [2025-10-15T19:58:55.087908] [INFO ] [MAIN ] LTC: Loaded 30571 existing records. [2025-10-15T19:58:55.266554] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:55.266821] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-15T19:58:55.266879] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-15T19:58:55.267512] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-15T19:58:55.267571] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-15T19:58:55.320829] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-15T19:58:55.623036] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:56.037050] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:58:56.113980] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-15T19:58:56.731273] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:58:56.914014] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-15T19:58:57.538356] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:58:57.714054] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-15T19:58:58.519115] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-15T19:58:58.534113] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T19:58:58.979427] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T19:58:59.313992] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-15T19:58:59.731037] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T19:59:00.113999] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-15T19:59:00.913990] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-15T19:59:01.269692] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T19:59:01.377096] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:59:01.714018] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-15T19:59:02.450979] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T19:59:02.514056] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-15T19:59:03.125923] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:59:03.314025] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-15T19:59:04.113108] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T19:59:04.116781] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-15T19:59:04.536823] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T19:59:04.914040] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-15T19:59:05.538166] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T19:59:05.543910] [INFO ] [REMOTE ] LPX: Full fetch complete (59026 records). [2025-10-15T19:59:05.544050] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-15T19:59:05.714037] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-15T19:59:05.954271] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-15T19:59:05.954351] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-15T19:59:05.955282] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-15T19:59:05.955344] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-15T19:59:05.956720] [DEBUG] [LOCAL ] LPX: Trimmed 59026 records to 40329 (keeping 200 days of data) [2025-10-15T19:59:06.198119] [DEBUG] [LOCAL ] LPX: Primary data saved (40329 records). [2025-10-15T19:59:06.198241] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-15T19:59:06.198316] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LPX took 35.8s. Estimated remaining: 2h 34m 8s. Rate: 7.1 symbols/min [2025-10-15T19:59:06.365410] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:06.417132] [DEBUG] [LOCAL ] LTH: Loaded 51750 existing records from primary storage. [2025-10-15T19:59:06.417483] [INFO ] [MAIN ] LTH: Loaded 51750 existing records. [2025-10-15T19:59:06.516573] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-15T19:59:06.611437] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:06.612343] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T19:59:06.612682] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-15T19:59:06.616872] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-15T19:59:06.617912] [INFO ] [REMOTE ] LRN: Full fetch complete (58464 records). [2025-10-15T19:59:06.618069] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-15T19:59:06.618236] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-15T19:59:06.618323] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-15T19:59:07.405116] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:07.447638] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-15T19:59:07.468675] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-15T19:59:07.470843] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:59:07.470931] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-15T19:59:07.480955] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-15T19:59:07.481513] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-15T19:59:07.482957] [DEBUG] [LOCAL ] LRN: Trimmed 58464 records to 39565 (keeping 200 days of data) [2025-10-15T19:59:07.721160] [DEBUG] [LOCAL ] LRN: Primary data saved (39565 records). [2025-10-15T19:59:07.721296] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-15T19:59:07.721375] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LRN took 31.0s. Estimated remaining: 2h 33m 54s. Rate: 7.1 symbols/min [2025-10-15T19:59:07.905466] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:07.918849] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T19:59:07.959552] [DEBUG] [LOCAL ] LTM: Loaded 38583 existing records from primary storage. [2025-10-15T19:59:07.959887] [INFO ] [MAIN ] LTM: Loaded 38583 existing records. [2025-10-15T19:59:08.119218] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-15T19:59:08.161373] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:08.162020] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-15T19:59:08.162106] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-15T19:59:08.162818] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-15T19:59:08.162876] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-15T19:59:08.519396] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:08.695529] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T19:59:08.914093] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-15T19:59:09.476128] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:59:09.713992] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-15T19:59:10.100858] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T19:59:10.514064] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-15T19:59:11.189876] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:59:11.313988] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-15T19:59:11.728093] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T19:59:12.114006] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-15T19:59:12.380976] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:59:12.914004] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-15T19:59:13.424741] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T19:59:13.713967] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-15T19:59:14.115097] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:59:14.514032] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-15T19:59:14.906889] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:59:15.314052] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-15T19:59:16.114007] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-15T19:59:16.207622] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:59:16.629358] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:59:16.634578] [INFO ] [REMOTE ] LSPD: Full fetch complete (61958 records). [2025-10-15T19:59:16.634769] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-15T19:59:16.919167] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-15T19:59:17.013719] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-15T19:59:17.013811] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-15T19:59:17.014808] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-15T19:59:17.014873] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-15T19:59:17.016183] [DEBUG] [LOCAL ] LSPD: Trimmed 61958 records to 42581 (keeping 200 days of data) [2025-10-15T19:59:17.264341] [DEBUG] [LOCAL ] LSPD: Primary data saved (42581 records). [2025-10-15T19:59:17.264496] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-15T19:59:17.264806] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LSPD took 30.2s. Estimated remaining: 2h 33m 46s. Rate: 7.1 symbols/min [2025-10-15T19:59:17.420887] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:59:17.462113] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:17.506105] [DEBUG] [LOCAL ] LU: Loaded 49028 existing records from primary storage. [2025-10-15T19:59:17.506449] [INFO ] [MAIN ] LU: Loaded 49028 existing records. [2025-10-15T19:59:17.682905] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:17.683154] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-15T19:59:17.683215] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-15T19:59:17.684067] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-15T19:59:17.684126] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-15T19:59:17.719809] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-15T19:59:18.036474] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:18.420618] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:59:18.514043] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-15T19:59:19.314061] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-15T19:59:19.395928] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:59:20.114005] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-15T19:59:20.196346] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:59:20.486824] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T19:59:20.913982] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-15T19:59:21.167226] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:59:21.714090] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-15T19:59:22.513987] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-15T19:59:22.637517] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T19:59:23.261598] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:59:23.313964] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-15T19:59:23.631875] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T19:59:24.114015] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-15T19:59:24.914054] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-15T19:59:25.007045] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T19:59:25.504537] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:59:25.714022] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-15T19:59:26.011727] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:59:26.514043] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-15T19:59:27.049749] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T19:59:27.313980] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-15T19:59:27.672135] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T19:59:28.114044] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-15T19:59:28.818905] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:59:28.913966] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-15T19:59:29.339160] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:59:29.713997] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-15T19:59:30.514009] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-15T19:59:30.587738] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T19:59:30.794253] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:59:31.314008] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-15T19:59:32.033095] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T19:59:32.037446] [INFO ] [REMOTE ] LTC: Full fetch complete (43701 records). [2025-10-15T19:59:32.037582] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-15T19:59:32.119144] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-15T19:59:32.415666] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-15T19:59:32.415807] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-15T19:59:32.416839] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-15T19:59:32.416921] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-15T19:59:32.438633] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T19:59:32.437599] [DEBUG] [LOCAL ] LTC: Trimmed 43701 records to 30625 (keeping 200 days of data) [2025-10-15T19:59:32.641936] [DEBUG] [LOCAL ] LTC: Primary data saved (30625 records). [2025-10-15T19:59:32.642072] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-15T19:59:32.642154] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LTC took 37.8s. Estimated remaining: 2h 33m 44s. Rate: 7.1 symbols/min [2025-10-15T19:59:32.815915] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:32.838764] [DEBUG] [LOCAL ] LUCK: Loaded 24199 existing records from primary storage. [2025-10-15T19:59:32.839054] [INFO ] [MAIN ] LUCK: Loaded 24199 existing records. [2025-10-15T19:59:32.919110] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-15T19:59:33.024188] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:33.024448] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-15T19:59:33.024503] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-15T19:59:33.025070] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-15T19:59:33.025129] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-15T19:59:33.369066] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:33.713978] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-15T19:59:33.748344] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:59:34.514009] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-15T19:59:34.608443] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T19:59:34.661317] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T19:59:35.314044] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-15T19:59:35.693953] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:59:36.114014] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-15T19:59:36.732258] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:59:36.914068] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-15T19:59:37.487371] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T19:59:37.714073] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-15T19:59:38.513982] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-15T19:59:38.593609] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:59:38.600123] [INFO ] [REMOTE ] LTH: Full fetch complete (74647 records). [2025-10-15T19:59:38.600287] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-15T19:59:39.051528] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-15T19:59:39.051696] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-15T19:59:39.052811] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-15T19:59:39.052890] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-15T19:59:39.063152] [DEBUG] [LOCAL ] LTH: Trimmed 74647 records to 51743 (keeping 200 days of data) [2025-10-15T19:59:39.081242] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:59:39.319439] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-15T19:59:39.390839] [DEBUG] [LOCAL ] LTH: Primary data saved (51743 records). [2025-10-15T19:59:39.390960] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-15T19:59:39.391039] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LTH took 33.2s. Estimated remaining: 2h 33m 34s. Rate: 7.1 symbols/min [2025-10-15T19:59:39.794603] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:59:40.114013] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-15T19:59:40.734390] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:59:40.914043] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-15T19:59:41.566257] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:59:41.713998] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-15T19:59:42.514026] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-15T19:59:42.661421] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:59:42.667722] [INFO ] [REMOTE ] LTM: Full fetch complete (50207 records). [2025-10-15T19:59:42.667863] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-15T19:59:43.112827] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-15T19:59:43.112968] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-15T19:59:43.114137] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-15T19:59:43.114375] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-15T19:59:43.130632] [DEBUG] [LOCAL ] LTM: Trimmed 50207 records to 38692 (keeping 200 days of data) [2025-10-15T19:59:43.145611] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T19:59:43.325518] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-15T19:59:43.398025] [DEBUG] [LOCAL ] LTM: Primary data saved (38692 records). [2025-10-15T19:59:43.398183] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-15T19:59:43.398277] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LTM took 35.7s. Estimated remaining: 2h 33m 22s. Rate: 7.1 symbols/min [2025-10-15T19:59:43.745336] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T19:59:44.113996] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-15T19:59:45.045726] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T19:59:45.056580] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-15T19:59:45.334104] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T19:59:45.714056] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-15T19:59:46.577047] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T19:59:46.587178] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-15T19:59:46.791824] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:59:47.314063] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-15T19:59:48.321510] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:59:48.332469] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-15T19:59:48.449509] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:59:48.914003] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-15T19:59:49.931933] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:59:49.938962] [INFO ] [REMOTE ] LU: Full fetch complete (70769 records). [2025-10-15T19:59:49.939122] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-15T19:59:50.166609] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:59:50.264902] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-15T19:59:50.412211] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-15T19:59:50.412301] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-15T19:59:50.413548] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-15T19:59:50.413638] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-15T19:59:50.415199] [DEBUG] [LOCAL ] LU: Trimmed 70769 records to 49048 (keeping 200 days of data) [2025-10-15T19:59:50.715137] [DEBUG] [LOCAL ] LU: Primary data saved (49048 records). [2025-10-15T19:59:50.715267] [INFO ] [MAIN ] LU: Full history saved. [2025-10-15T19:59:50.715710] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LU took 33.5s. Estimated remaining: 2h 33m 12s. Rate: 7.1 symbols/min [2025-10-15T19:59:51.354100] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T19:59:51.361041] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-15T19:59:52.404851] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:59:52.410344] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-15T19:59:53.421120] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:59:53.423710] [INFO ] [REMOTE ] LUCK: Full fetch complete (39887 records). [2025-10-15T19:59:53.423790] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-15T19:59:53.794104] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-15T19:59:53.794226] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-15T19:59:53.795770] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-15T19:59:53.795836] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-15T19:59:53.796921] [DEBUG] [LOCAL ] LUCK: Trimmed 39887 records to 24196 (keeping 200 days of data) [2025-10-15T19:59:53.947854] [DEBUG] [LOCAL ] LUCK: Primary data saved (24196 records). [2025-10-15T19:59:53.948008] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-15T19:59:53.948135] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LUCK took 21.3s. Estimated remaining: 2h 32m 59s. Rate: 7.1 symbols/min [2025-10-15T19:59:54.579449] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:54.605833] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:54.612083] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:54.659341] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:54.660041] [DEBUG] [LOCAL ] LVS: No existing data file found in primary storage. [2025-10-15T19:59:54.660303] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-15T19:59:54.660446] [WARN ] [MAIN ] LVS: No existing data found, performing full refresh instead. [2025-10-15T19:59:54.660383] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-15T19:59:54.660865] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-15T19:59:54.660733] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-15T19:59:54.660978] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-15T19:59:54.661846] [DEBUG] [LOCAL ] LVS: No primary data file found to delete. [2025-10-15T19:59:54.661578] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-15T19:59:54.662032] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-15T19:59:54.683604] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-15T19:59:54.698050] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-15T19:59:55.180558] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-15T19:59:55.205925] [INFO ] [MAIN ] LUMN: Loaded 53646 existing records. [2025-10-15T19:59:55.426449] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-15T19:59:55.523577] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-15T19:59:55.526635] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:55.594421] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-15T19:59:55.851542] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:55.883587] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-15T19:59:55.883715] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-15T19:59:55.883342] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:55.884047] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-15T19:59:55.884833] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-15T19:59:55.890518] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-15T19:59:56.061789] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:56.063992] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-15T19:59:56.064275] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-15T19:59:56.080674] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-15T19:59:56.085869] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-15T19:59:56.164260] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:59:56.241701] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-15T19:59:56.257794] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:59:56.296151] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-15T19:59:56.314203] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:59:56.319801] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-15T19:59:56.335355] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-15T19:59:56.347448] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-15T19:59:56.398954] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-15T19:59:56.404567] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LUXE took 2.5s. Estimated remaining: 2h 32m 46s. Rate: 7.1 symbols/min [2025-10-15T19:59:56.643189] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:56.654996] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-15T19:59:56.876305] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:56.880478] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-15T19:59:56.880107] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:59:56.900335] [DEBUG] [LOCAL ] LVWR: Loaded 18450 existing records from primary storage. [2025-10-15T19:59:56.900583] [INFO ] [MAIN ] LVWR: Loaded 18450 existing records. [2025-10-15T19:59:57.087006] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:59:57.087223] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-15T19:59:57.087270] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-15T19:59:57.087700] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-15T19:59:57.087777] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-15T19:59:57.484868] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:59:57.485341] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-15T19:59:57.958095] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-15T19:59:57.968989] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-15T19:59:58.223281] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:59:58.224941] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-15T19:59:58.804289] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T19:59:58.815502] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-15T19:59:58.860506] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T19:59:58.863090] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-15T19:59:58.893636] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T19:59:59.314006] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-15T19:59:59.351893] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:59:59.472434] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T20:00:00.114015] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-15T20:00:00.459125] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T20:00:00.914023] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-15T20:00:01.098727] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T20:00:01.552788] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T20:00:01.714006] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-15T20:00:01.943008] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T20:00:02.514001] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-15T20:00:02.903997] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T20:00:03.314131] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-15T20:00:03.593929] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T20:00:04.114000] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-15T20:00:04.914009] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-15T20:00:05.184101] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T20:00:05.714012] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-15T20:00:06.219463] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T20:00:06.514034] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-15T20:00:07.195732] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-15T20:00:07.313981] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-15T20:00:07.528032] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T20:00:07.528844] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T20:00:08.114034] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-15T20:00:08.914040] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-15T20:00:09.518882] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-15T20:00:09.558366] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T20:00:09.714044] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-15T20:00:10.513980] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-15T20:00:10.607229] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:00:10.952188] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T20:00:11.314046] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-15T20:00:11.873073] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T20:00:12.114020] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-15T20:00:12.649972] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T20:00:12.914041] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-15T20:00:13.446333] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T20:00:13.714176] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-15T20:00:14.514121] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-15T20:00:14.672576] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T20:00:15.314027] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-15T20:00:15.894972] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-15T20:00:16.123767] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-15T20:00:16.144235] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T20:00:16.913994] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-15T20:00:17.177710] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T20:00:17.714108] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-15T20:00:17.822223] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T20:00:18.431872] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:00:18.434324] [INFO ] [REMOTE ] LVWR: Full fetch complete (20569 records). [2025-10-15T20:00:18.434418] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-15T20:00:18.515626] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-15T20:00:18.663280] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T20:00:18.879366] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-15T20:00:18.879449] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-15T20:00:18.879988] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-15T20:00:18.880052] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-15T20:00:18.880838] [DEBUG] [LOCAL ] LVWR: Trimmed 20569 records to 18485 (keeping 200 days of data) [2025-10-15T20:00:18.986539] [DEBUG] [LOCAL ] LVWR: Primary data saved (18485 records). [2025-10-15T20:00:18.986700] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-15T20:00:18.986793] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LVWR took 22.5s. Estimated remaining: 2h 32m 50s. Rate: 7.1 symbols/min [2025-10-15T20:00:19.152135] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:00:19.198151] [DEBUG] [LOCAL ] LW: Loaded 51232 existing records from primary storage. [2025-10-15T20:00:19.198469] [INFO ] [MAIN ] LW: Loaded 51232 existing records. [2025-10-15T20:00:19.319169] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-15T20:00:19.375202] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:00:19.375406] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-15T20:00:19.375454] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-15T20:00:19.376436] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-15T20:00:19.376493] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-15T20:00:19.730960] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:00:20.114009] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-15T20:00:20.312987] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T20:00:20.913989] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-15T20:00:21.192424] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T20:00:21.713976] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-15T20:00:22.129602] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T20:00:22.513978] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-15T20:00:22.945811] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T20:00:23.250612] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T20:00:23.313977] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-15T20:00:24.114024] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-15T20:00:24.548257] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T20:00:24.914023] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-15T20:00:25.101347] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T20:00:25.714016] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-15T20:00:26.399357] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T20:00:26.445034] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T20:00:26.514072] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-15T20:00:27.314018] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-15T20:00:27.681299] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-15T20:00:27.688368] [INFO ] [REMOTE ] LVS: Full fetch complete (77702 records). [2025-10-15T20:00:27.688583] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-15T20:00:28.107280] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-15T20:00:28.107422] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-15T20:00:28.109493] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-15T20:00:28.109601] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-15T20:00:28.111900] [DEBUG] [LOCAL ] LVS: Trimmed 77702 records to 53570 (keeping 200 days of data) [2025-10-15T20:00:28.114099] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-15T20:00:28.484836] [DEBUG] [LOCAL ] LVS: Primary data saved (53570 records). [2025-10-15T20:00:28.485048] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-15T20:00:28.485144] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LVS took 34.5s. Estimated remaining: 2h 32m 42s. Rate: 7.1 symbols/min [2025-10-15T20:00:28.669124] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:00:28.687585] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-15T20:00:28.694527] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-15T20:00:28.694737] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-15T20:00:28.807703] [DEBUG] [LOCAL ] LXFR: Loaded 16744 existing records from primary storage. [2025-10-15T20:00:28.818938] [INFO ] [MAIN ] LXFR: Loaded 16744 existing records. [2025-10-15T20:00:29.220266] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:00:29.238443] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-15T20:00:29.253306] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-15T20:00:29.293203] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-15T20:00:29.293520] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-15T20:00:29.396795] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-15T20:00:29.396962] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-15T20:00:29.416797] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-15T20:00:29.438628] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-15T20:00:29.514713] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 53646 (keeping 200 days of data) [2025-10-15T20:00:29.856102] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:00:29.825008] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-15T20:00:29.856481] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-15T20:00:29.875908] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-15T20:00:29.921096] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T20:00:30.117988] [DEBUG] [LOCAL ] LUMN: Primary data saved (53646 records). [2025-10-15T20:00:30.118123] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-15T20:00:30.118202] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LUMN took 36.2s. Estimated remaining: 2h 32m 28s. Rate: 7.1 symbols/min [2025-10-15T20:00:30.284742] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:00:30.335670] [DEBUG] [LOCAL ] LXP: Loaded 50740 existing records from primary storage. [2025-10-15T20:00:30.336023] [INFO ] [MAIN ] LXP: Loaded 50740 existing records. [2025-10-15T20:00:30.517055] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-15T20:00:30.550170] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:00:30.556997] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-15T20:00:30.567673] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-15T20:00:30.568787] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-15T20:00:30.569965] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-15T20:00:30.569872] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:00:30.637092] [INFO ] [REMOTE ] LUV: Full fetch complete (77862 records). [2025-10-15T20:00:30.665369] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T20:00:30.664561] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-15T20:00:31.316819] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-15T20:00:31.334744] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:00:31.416340] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-15T20:00:31.416413] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-15T20:00:31.417491] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-15T20:00:31.417557] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-15T20:00:31.419076] [DEBUG] [LOCAL ] LUV: Trimmed 77862 records to 53689 (keeping 200 days of data) [2025-10-15T20:00:31.762028] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-15T20:00:31.762187] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-15T20:00:31.762294] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUV took 37.8s. Estimated remaining: 2h 32m 14s. Rate: 7.1 symbols/min [2025-10-15T20:00:31.931219] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:00:31.961486] [DEBUG] [LOCAL ] LXU: Loaded 31836 existing records from primary storage. [2025-10-15T20:00:31.961979] [INFO ] [MAIN ] LXU: Loaded 31836 existing records. [2025-10-15T20:00:32.125580] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-15T20:00:32.150168] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:00:32.151014] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-15T20:00:32.151096] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-15T20:00:32.151786] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-15T20:00:32.151847] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-15T20:00:32.340524] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T20:00:32.493185] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T20:00:32.576617] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:00:32.914010] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-15T20:00:33.714060] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-15T20:00:33.780970] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T20:00:33.911035] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T20:00:34.514011] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-15T20:00:35.314014] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-15T20:00:35.379356] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T20:00:35.690479] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T20:00:36.025334] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T20:00:36.114013] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-15T20:00:36.914010] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-15T20:00:37.329358] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T20:00:37.713993] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-15T20:00:38.215272] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T20:00:38.514031] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-15T20:00:38.578115] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T20:00:39.313981] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-15T20:00:39.615263] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T20:00:40.114019] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-15T20:00:40.914019] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-15T20:00:41.143070] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T20:00:41.166238] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T20:00:41.714021] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-15T20:00:42.014604] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T20:00:42.514030] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-15T20:00:42.767130] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T20:00:43.314002] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-15T20:00:44.098739] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T20:00:44.113961] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-15T20:00:44.914031] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-15T20:00:45.085606] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T20:00:45.714062] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-15T20:00:45.910895] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T20:00:46.401247] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T20:00:46.514002] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-15T20:00:46.969768] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T20:00:47.314021] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-15T20:00:48.119092] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-15T20:00:48.144603] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T20:00:48.271682] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T20:00:48.914036] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-15T20:00:49.714018] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-15T20:00:49.776359] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T20:00:50.507821] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T20:00:50.513942] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-15T20:00:50.584773] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T20:00:51.313975] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-15T20:00:51.514500] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T20:00:52.114007] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-15T20:00:52.916572] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-15T20:00:52.922902] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T20:00:53.144068] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T20:00:53.713962] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-15T20:00:54.178160] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T20:00:54.513994] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-15T20:00:55.313980] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-15T20:00:55.429004] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T20:00:55.473629] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T20:00:56.114001] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-15T20:00:56.732270] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T20:00:56.914017] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-15T20:00:57.152523] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T20:00:57.154724] [INFO ] [REMOTE ] LXFR: Full fetch complete (24752 records). [2025-10-15T20:00:57.154798] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-15T20:00:57.520130] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-15T20:00:57.520211] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-15T20:00:57.520805] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-15T20:00:57.520871] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-15T20:00:57.521600] [DEBUG] [LOCAL ] LXFR: Trimmed 24752 records to 16648 (keeping 200 days of data) [2025-10-15T20:00:57.620409] [DEBUG] [LOCAL ] LXFR: Primary data saved (16648 records). [2025-10-15T20:00:57.620551] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-15T20:00:57.620669] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LXFR took 29.1s. Estimated remaining: 2h 32m 20s. Rate: 7.1 symbols/min [2025-10-15T20:00:57.719106] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-15T20:00:57.794070] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:00:57.842985] [DEBUG] [LOCAL ] LYB: Loaded 53613 existing records from primary storage. [2025-10-15T20:00:57.843296] [INFO ] [MAIN ] LYB: Loaded 53613 existing records. [2025-10-15T20:00:58.032397] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:00:58.032756] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-15T20:00:58.032836] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-15T20:00:58.040134] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-15T20:00:58.054222] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-15T20:00:58.088622] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T20:00:58.419915] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:00:58.514004] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-15T20:00:59.314005] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-15T20:00:59.369344] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T20:01:00.113977] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-15T20:01:00.203861] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T20:01:00.913966] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-15T20:01:01.334005] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-15T20:01:01.714058] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-15T20:01:01.992336] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T20:01:01.998746] [INFO ] [REMOTE ] LW: Full fetch complete (74779 records). [2025-10-15T20:01:01.998906] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-15T20:01:02.402242] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-15T20:01:02.402357] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-15T20:01:02.403621] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-15T20:01:02.404272] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-15T20:01:02.406062] [DEBUG] [LOCAL ] LW: Trimmed 74779 records to 51215 (keeping 200 days of data) [2025-10-15T20:01:02.518545] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-15T20:01:02.552310] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T20:01:02.790258] [DEBUG] [LOCAL ] LW: Primary data saved (51215 records). [2025-10-15T20:01:02.790409] [INFO ] [MAIN ] LW: Full history saved. [2025-10-15T20:01:02.790932] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LW took 43.8s. Estimated remaining: 2h 32m 9s. Rate: 7.1 symbols/min [2025-10-15T20:01:02.987035] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:02.989209] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T20:01:03.054988] [DEBUG] [LOCAL ] LYG: Loaded 52726 existing records from primary storage. [2025-10-15T20:01:03.055329] [INFO ] [MAIN ] LYG: Loaded 52726 existing records. [2025-10-15T20:01:03.239789] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:03.240026] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-15T20:01:03.240076] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-15T20:01:03.240879] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-15T20:01:03.240940] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-15T20:01:03.323897] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-15T20:01:03.608408] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:04.114014] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-15T20:01:04.244270] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T20:01:04.914177] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-15T20:01:05.019175] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T20:01:05.028353] [INFO ] [REMOTE ] LXP: Full fetch complete (72869 records). [2025-10-15T20:01:05.028574] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-15T20:01:05.442161] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-15T20:01:05.442307] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-15T20:01:05.443390] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-15T20:01:05.443512] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-15T20:01:05.459287] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T20:01:05.465413] [INFO ] [REMOTE ] LXU: Full fetch complete (45311 records). [2025-10-15T20:01:05.465315] [DEBUG] [LOCAL ] LXP: Trimmed 72869 records to 50765 (keeping 200 days of data) [2025-10-15T20:01:05.465616] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-15T20:01:05.727706] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-15T20:01:06.121800] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-15T20:01:06.122589] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-15T20:01:06.125073] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-15T20:01:06.125209] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-15T20:01:06.126758] [DEBUG] [LOCAL ] LXU: Trimmed 45311 records to 31770 (keeping 200 days of data) [2025-10-15T20:01:06.749008] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T20:01:06.769571] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-15T20:01:06.779933] [DEBUG] [LOCAL ] LXU: Primary data saved (31770 records). [2025-10-15T20:01:06.782609] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-15T20:01:06.783494] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LXU took 35.0s. Estimated remaining: 2h 31m 57s. Rate: 7.1 symbols/min [2025-10-15T20:01:06.984021] [DEBUG] [LOCAL ] LXP: Primary data saved (50765 records). [2025-10-15T20:01:06.982430] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:06.984474] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-15T20:01:06.984596] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LXP took 36.9s. Estimated remaining: 2h 31m 41s. Rate: 7.1 symbols/min [2025-10-15T20:01:07.166680] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:07.211852] [DEBUG] [LOCAL ] LYV: Loaded 51134 existing records from primary storage. [2025-10-15T20:01:07.212225] [INFO ] [MAIN ] LYV: Loaded 51134 existing records. [2025-10-15T20:01:07.347515] [DEBUG] [LOCAL ] LZB: Loaded 35166 existing records from primary storage. [2025-10-15T20:01:07.367305] [INFO ] [MAIN ] LZB: Loaded 35166 existing records. [2025-10-15T20:01:07.413906] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:07.451096] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-15T20:01:07.487162] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-15T20:01:07.510471] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-15T20:01:07.528122] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-15T20:01:07.711013] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:07.728634] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-15T20:01:07.733923] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-15T20:01:07.746936] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-15T20:01:07.750884] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-15T20:01:08.380464] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:08.387001] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-15T20:01:08.406432] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-15T20:01:08.502898] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-15T20:01:08.502428] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:08.564058] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T20:01:08.914006] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-15T20:01:09.713993] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-15T20:01:09.946344] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T20:01:10.035722] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T20:01:10.307998] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-15T20:01:10.514065] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-15T20:01:10.981616] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T20:01:11.314029] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-15T20:01:12.114101] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-15T20:01:12.422413] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T20:01:12.904191] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T20:01:12.914592] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-15T20:01:13.456845] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T20:01:13.714020] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-15T20:01:14.514000] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-15T20:01:14.885434] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T20:01:15.056954] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T20:01:15.314098] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-15T20:01:16.114020] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-15T20:01:16.628134] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T20:01:16.914021] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-15T20:01:17.076905] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T20:01:17.714042] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-15T20:01:17.923676] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T20:01:18.514015] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-15T20:01:18.669536] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T20:01:19.314053] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-15T20:01:19.410075] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T20:01:20.028931] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T20:01:20.113998] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-15T20:01:20.913972] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-15T20:01:21.104761] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T20:01:21.713989] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-15T20:01:21.849117] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T20:01:22.381008] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T20:01:22.513996] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-15T20:01:22.713822] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T20:01:23.314059] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-15T20:01:24.113992] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-15T20:01:24.458367] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T20:01:24.679143] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T20:01:24.914069] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-15T20:01:25.509107] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T20:01:25.713975] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-15T20:01:26.313690] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T20:01:26.514039] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-15T20:01:27.314010] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-15T20:01:27.442662] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T20:01:27.753226] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T20:01:28.114004] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-15T20:01:28.861788] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T20:01:28.913993] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-15T20:01:29.581876] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T20:01:29.714032] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-15T20:01:30.422832] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T20:01:30.505077] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:01:30.512013] [INFO ] [REMOTE ] LYB: Full fetch complete (77624 records). [2025-10-15T20:01:30.512196] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-15T20:01:30.519214] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-15T20:01:30.928964] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-15T20:01:30.929065] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-15T20:01:30.930260] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-15T20:01:30.930332] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-15T20:01:30.931981] [DEBUG] [LOCAL ] LYB: Trimmed 77624 records to 53618 (keeping 200 days of data) [2025-10-15T20:01:31.269956] [DEBUG] [LOCAL ] LYB: Primary data saved (53618 records). [2025-10-15T20:01:31.270154] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-15T20:01:31.271230] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LYB took 33.7s. Estimated remaining: 2h 31m 46s. Rate: 7.1 symbols/min [2025-10-15T20:01:31.324717] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-15T20:01:31.439323] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:31.455583] [DEBUG] [LOCAL ] LZM: Loaded 14548 existing records from primary storage. [2025-10-15T20:01:31.455842] [INFO ] [MAIN ] LZM: Loaded 14548 existing records. [2025-10-15T20:01:31.628230] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:31.628456] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-15T20:01:31.628504] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-15T20:01:31.628728] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-15T20:01:31.628784] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-15T20:01:32.000501] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:32.114002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-15T20:01:32.318734] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-15T20:01:32.878855] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T20:01:32.898704] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T20:01:32.913964] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-15T20:01:33.706992] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T20:01:33.713963] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-15T20:01:34.434095] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T20:01:34.514016] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-15T20:01:35.313996] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-15T20:01:36.114022] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-15T20:01:36.530130] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T20:01:36.627581] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-15T20:01:36.914010] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-15T20:01:37.713995] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-15T20:01:37.978894] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T20:01:38.264150] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T20:01:38.279581] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T20:01:38.283895] [INFO ] [REMOTE ] LZB: Full fetch complete (50805 records). [2025-10-15T20:01:38.284018] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-15T20:01:38.519699] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-15T20:01:38.677187] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-15T20:01:38.677273] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-15T20:01:38.678220] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-15T20:01:38.678286] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-15T20:01:38.679476] [DEBUG] [LOCAL ] LZB: Trimmed 50805 records to 35168 (keeping 200 days of data) [2025-10-15T20:01:38.897268] [DEBUG] [LOCAL ] LZB: Primary data saved (35168 records). [2025-10-15T20:01:38.897418] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-15T20:01:38.897505] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LZB took 31.9s. Estimated remaining: 2h 31m 37s. Rate: 7.1 symbols/min [2025-10-15T20:01:39.072194] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:39.125213] [DEBUG] [LOCAL ] M: Loaded 53546 existing records from primary storage. [2025-10-15T20:01:39.125555] [INFO ] [MAIN ] M: Loaded 53546 existing records. [2025-10-15T20:01:39.310238] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:39.310472] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-15T20:01:39.310560] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-15T20:01:39.311354] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-15T20:01:39.311418] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-15T20:01:39.323546] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-15T20:01:39.687157] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:40.117188] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-15T20:01:40.123436] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T20:01:40.363781] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T20:01:40.914099] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-15T20:01:41.714046] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-15T20:01:41.821387] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T20:01:41.827733] [INFO ] [REMOTE ] LYG: Full fetch complete (76201 records). [2025-10-15T20:01:41.827920] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-15T20:01:42.240788] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-15T20:01:42.240950] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-15T20:01:42.242740] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-15T20:01:42.242835] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-15T20:01:42.245054] [DEBUG] [LOCAL ] LYG: Trimmed 76201 records to 52693 (keeping 200 days of data) [2025-10-15T20:01:42.519089] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-15T20:01:42.571731] [DEBUG] [LOCAL ] LYG: Primary data saved (52693 records). [2025-10-15T20:01:42.573220] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T20:01:42.573321] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-15T20:01:42.577453] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LYG took 39.8s. Estimated remaining: 2h 31m 25s. Rate: 7.1 symbols/min [2025-10-15T20:01:42.783774] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:42.837020] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-15T20:01:42.892719] [DEBUG] [LOCAL ] MA: Loaded 52487 existing records from primary storage. [2025-10-15T20:01:42.893038] [INFO ] [MAIN ] MA: Loaded 52487 existing records. [2025-10-15T20:01:43.070739] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:43.070984] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-15T20:01:43.071029] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-15T20:01:43.071991] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-15T20:01:43.072049] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-15T20:01:43.322008] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-15T20:01:43.425509] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:44.114007] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-15T20:01:44.188812] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T20:01:44.253776] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:01:44.914002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-15T20:01:45.713995] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-15T20:01:45.783475] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T20:01:46.003008] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T20:01:46.514001] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-15T20:01:47.276433] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T20:01:47.313954] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-15T20:01:47.522801] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T20:01:48.114044] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-15T20:01:48.302996] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T20:01:48.913995] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-15T20:01:49.703316] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:01:49.710133] [INFO ] [REMOTE ] LYV: Full fetch complete (74103 records). [2025-10-15T20:01:49.710290] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-15T20:01:49.721947] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-15T20:01:50.118159] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-15T20:01:50.118326] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-15T20:01:50.119524] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-15T20:01:50.119627] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-15T20:01:50.121537] [DEBUG] [LOCAL ] LYV: Trimmed 74103 records to 51136 (keeping 200 days of data) [2025-10-15T20:01:50.247989] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-15T20:01:50.486797] [DEBUG] [LOCAL ] LYV: Primary data saved (51136 records). [2025-10-15T20:01:50.486941] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-15T20:01:50.487020] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LYV took 43.7s. Estimated remaining: 2h 31m 16s. Rate: 7.1 symbols/min [2025-10-15T20:01:50.518532] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-15T20:01:50.659822] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:50.702268] [DEBUG] [LOCAL ] MAA: Loaded 42817 existing records from primary storage. [2025-10-15T20:01:50.702546] [INFO ] [MAIN ] MAA: Loaded 42817 existing records. [2025-10-15T20:01:50.888436] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:50.888933] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-15T20:01:50.889060] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-15T20:01:50.897258] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-15T20:01:50.898292] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-15T20:01:50.898730] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T20:01:50.946249] [INFO ] [REMOTE ] LZM: Full fetch complete (19373 records). [2025-10-15T20:01:50.983732] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-15T20:01:51.320452] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-15T20:01:51.609968] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:51.692680] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-15T20:01:51.692767] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-15T20:01:51.693173] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-15T20:01:51.693211] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-15T20:01:51.693809] [DEBUG] [LOCAL ] LZM: Trimmed 19373 records to 14485 (keeping 200 days of data) [2025-10-15T20:01:51.773266] [DEBUG] [LOCAL ] LZM: Primary data saved (14485 records). [2025-10-15T20:01:51.773411] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-15T20:01:51.773490] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LZM took 20.5s. Estimated remaining: 2h 31m 1s. Rate: 7.1 symbols/min [2025-10-15T20:01:51.942175] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:01:51.988835] [DEBUG] [LOCAL ] MAC: Loaded 49712 existing records from primary storage. [2025-10-15T20:01:51.989162] [INFO ] [MAIN ] MAC: Loaded 49712 existing records. [2025-10-15T20:01:52.118269] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-15T20:01:52.171597] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:01:52.172291] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-15T20:01:52.172466] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-15T20:01:52.173482] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-15T20:01:52.173544] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-15T20:01:52.548501] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:01:52.574622] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T20:01:52.913999] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-15T20:01:53.031295] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T20:01:53.697091] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T20:01:53.713984] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-15T20:01:54.514024] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-15T20:01:54.585155] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T20:01:55.314013] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-15T20:01:55.427064] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T20:01:55.919172] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T20:01:56.114026] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-15T20:01:56.889501] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T20:01:56.913954] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-15T20:01:57.714058] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-15T20:01:58.226424] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T20:01:58.377332] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T20:01:58.513997] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-15T20:01:59.314025] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-15T20:01:59.403063] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T20:02:00.114073] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-15T20:02:00.210285] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T20:02:00.914001] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-15T20:02:01.445151] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T20:02:01.714092] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-15T20:02:01.750932] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T20:02:02.514011] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-15T20:02:02.687499] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T20:02:03.314065] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-15T20:02:03.685730] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T20:02:04.114056] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-15T20:02:04.636409] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T20:02:04.914038] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-15T20:02:05.008320] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T20:02:05.599791] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T20:02:05.714013] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-15T20:02:06.489039] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T20:02:06.513974] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-15T20:02:07.314025] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-15T20:02:07.632339] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T20:02:08.119089] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-15T20:02:08.134877] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T20:02:08.913980] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-15T20:02:08.995885] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T20:02:09.713979] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-15T20:02:10.190404] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T20:02:10.514110] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-15T20:02:10.595272] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T20:02:11.314037] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-15T20:02:11.676001] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-15T20:02:12.113993] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-15T20:02:12.211712] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T20:02:12.914102] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-15T20:02:13.057538] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T20:02:13.714034] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-15T20:02:14.101535] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T20:02:14.514044] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-15T20:02:14.903296] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T20:02:15.026524] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T20:02:15.314101] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-15T20:02:16.113976] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-15T20:02:16.583822] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T20:02:16.914092] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-15T20:02:17.285454] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-15T20:02:17.292112] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-15T20:02:17.292259] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-15T20:02:17.709021] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-15T20:02:17.709119] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-15T20:02:17.710325] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-15T20:02:17.710406] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-15T20:02:17.712030] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53545 (keeping 200 days of data) [2025-10-15T20:02:17.767042] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-15T20:02:17.834682] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T20:02:17.844039] [INFO ] [REMOTE ] MAC: Full fetch complete (71569 records). [2025-10-15T20:02:17.849017] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-15T20:02:18.411077] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-15T20:02:18.412701] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-15T20:02:18.419123] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-15T20:02:18.425568] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-15T20:02:18.490222] [DEBUG] [LOCAL ] MAC: Trimmed 71569 records to 49774 (keeping 200 days of data) [2025-10-15T20:02:18.598076] [DEBUG] [LOCAL ] M: Primary data saved (53545 records). [2025-10-15T20:02:18.599525] [INFO ] [MAIN ] M: Full history saved. [2025-10-15T20:02:18.599966] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. M took 39.7s. Estimated remaining: 2h 31m 8s. Rate: 7.1 symbols/min [2025-10-15T20:02:18.740112] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T20:02:18.775117] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-15T20:02:18.830662] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:18.975296] [DEBUG] [LOCAL ] MAGN: Loaded 35969 existing records from primary storage. [2025-10-15T20:02:18.993085] [INFO ] [MAIN ] MAGN: Loaded 35969 existing records. [2025-10-15T20:02:19.256187] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:02:19.265084] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-15T20:02:19.265238] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-15T20:02:19.267239] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-15T20:02:19.269618] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-15T20:02:19.318621] [DEBUG] [LOCAL ] MAC: Primary data saved (49774 records). [2025-10-15T20:02:19.339943] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-15T20:02:19.346158] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. MAC took 27.6s. Estimated remaining: 2h 30m 53s. Rate: 7.1 symbols/min [2025-10-15T20:02:19.802204] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:19.874417] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:19.875083] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-15T20:02:19.911190] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T20:02:19.956261] [DEBUG] [LOCAL ] MAIN: Loaded 41746 existing records from primary storage. [2025-10-15T20:02:19.956713] [INFO ] [MAIN ] MAIN: Loaded 41746 existing records. [2025-10-15T20:02:20.115569] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-15T20:02:20.148334] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:02:20.149026] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-15T20:02:20.149127] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-15T20:02:20.150091] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-15T20:02:20.150417] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-15T20:02:20.323289] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T20:02:20.602852] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:20.914002] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-15T20:02:20.978976] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T20:02:21.713984] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-15T20:02:22.036567] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T20:02:22.445543] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T20:02:22.514046] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-15T20:02:23.314055] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-15T20:02:23.412084] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T20:02:23.622426] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T20:02:24.114168] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-15T20:02:24.857323] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T20:02:24.864765] [INFO ] [REMOTE ] MAA: Full fetch complete (61556 records). [2025-10-15T20:02:24.864920] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-15T20:02:24.919492] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-15T20:02:25.278348] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-15T20:02:25.278505] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-15T20:02:25.279594] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-15T20:02:25.279706] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-15T20:02:25.281097] [DEBUG] [LOCAL ] MAA: Trimmed 61556 records to 42905 (keeping 200 days of data) [2025-10-15T20:02:25.553768] [DEBUG] [LOCAL ] MAA: Primary data saved (42905 records). [2025-10-15T20:02:25.553897] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-15T20:02:25.553978] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. MAA took 35.1s. Estimated remaining: 2h 30m 43s. Rate: 7.1 symbols/min [2025-10-15T20:02:25.725452] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T20:02:25.751095] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:25.748069] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-15T20:02:25.798791] [DEBUG] [LOCAL ] MAN: Loaded 43935 existing records from primary storage. [2025-10-15T20:02:25.799077] [INFO ] [MAIN ] MAN: Loaded 43935 existing records. [2025-10-15T20:02:25.982825] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:02:25.983248] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-15T20:02:25.983297] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-15T20:02:25.984066] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-15T20:02:25.984125] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-15T20:02:26.337050] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:26.514029] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-15T20:02:26.634481] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T20:02:26.641069] [INFO ] [REMOTE ] MA: Full fetch complete (76389 records). [2025-10-15T20:02:26.641214] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-15T20:02:27.048471] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-15T20:02:27.048553] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-15T20:02:27.049661] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-15T20:02:27.049726] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-15T20:02:27.051204] [DEBUG] [LOCAL ] MA: Trimmed 76389 records to 52480 (keeping 200 days of data) [2025-10-15T20:02:27.317289] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-15T20:02:27.409244] [DEBUG] [LOCAL ] MA: Primary data saved (52480 records). [2025-10-15T20:02:27.409371] [INFO ] [MAIN ] MA: Full history saved. [2025-10-15T20:02:27.409867] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. MA took 44.8s. Estimated remaining: 2h 30m 29s. Rate: 7.1 symbols/min [2025-10-15T20:02:27.594946] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:27.621953] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T20:02:27.653361] [DEBUG] [LOCAL ] MANU: Loaded 27021 existing records from primary storage. [2025-10-15T20:02:27.653625] [INFO ] [MAIN ] MANU: Loaded 27021 existing records. [2025-10-15T20:02:27.842479] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:02:27.842754] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-15T20:02:27.842822] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-15T20:02:27.843410] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-15T20:02:27.843476] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-15T20:02:28.126586] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-15T20:02:28.166101] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T20:02:28.259407] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:28.810118] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T20:02:28.914046] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-15T20:02:29.466847] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T20:02:29.713991] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-15T20:02:30.154886] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T20:02:30.514020] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-15T20:02:31.313981] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-15T20:02:31.376447] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T20:02:31.714240] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T20:02:32.114015] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-15T20:02:32.786385] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T20:02:32.913991] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-15T20:02:33.631779] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T20:02:33.714013] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-15T20:02:34.472337] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T20:02:34.514010] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-15T20:02:35.313969] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-15T20:02:35.420324] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T20:02:36.113968] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-15T20:02:36.220254] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T20:02:36.287867] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T20:02:36.914011] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-15T20:02:37.246130] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T20:02:37.714049] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-15T20:02:38.341499] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T20:02:38.514008] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-15T20:02:39.273431] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T20:02:39.313965] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-15T20:02:40.113991] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-15T20:02:40.218291] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T20:02:40.724810] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T20:02:40.913987] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-15T20:02:41.009739] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T20:02:41.713997] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-15T20:02:42.450218] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T20:02:42.513990] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-15T20:02:43.313975] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-15T20:02:43.548392] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T20:02:44.026967] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T20:02:44.113988] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-15T20:02:44.499757] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T20:02:44.914062] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-15T20:02:45.713996] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-15T20:02:45.914730] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T20:02:46.207153] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T20:02:46.514011] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-15T20:02:47.086809] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T20:02:47.311380] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T20:02:47.316842] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-15T20:02:48.113964] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-15T20:02:48.598485] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T20:02:48.914035] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-15T20:02:49.637023] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T20:02:49.643392] [INFO ] [REMOTE ] MAN: Full fetch complete (62474 records). [2025-10-15T20:02:49.643553] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-15T20:02:49.719289] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-15T20:02:50.036305] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-15T20:02:50.036405] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-15T20:02:50.037390] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-15T20:02:50.037454] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-15T20:02:50.038886] [DEBUG] [LOCAL ] MAN: Trimmed 62474 records to 44037 (keeping 200 days of data) [2025-10-15T20:02:50.297891] [DEBUG] [LOCAL ] MAN: Primary data saved (44037 records). [2025-10-15T20:02:50.298019] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-15T20:02:50.298098] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. MAN took 24.7s. Estimated remaining: 2h 30m 33s. Rate: 7.1 symbols/min [2025-10-15T20:02:50.487233] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T20:02:50.489776] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:50.495951] [INFO ] [REMOTE ] MAGN: Full fetch complete (51747 records). [2025-10-15T20:02:50.496198] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-15T20:02:50.519112] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-15T20:02:50.881317] [DEBUG] [LOCAL ] MAS: Loaded 52266 existing records from primary storage. [2025-10-15T20:02:50.897985] [INFO ] [MAIN ] MAS: Loaded 52266 existing records. [2025-10-15T20:02:51.160788] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-15T20:02:51.168769] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-15T20:02:51.188728] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:02:51.190461] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-15T20:02:51.190184] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-15T20:02:51.190625] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-15T20:02:51.190906] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-15T20:02:51.191728] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-15T20:02:51.191864] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-15T20:02:51.296837] [DEBUG] [LOCAL ] MAGN: Trimmed 51747 records to 36089 (keeping 200 days of data) [2025-10-15T20:02:51.794738] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:51.797885] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-15T20:02:51.806628] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T20:02:51.851379] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T20:02:51.851478] [DEBUG] [LOCAL ] MAGN: Primary data saved (36089 records). [2025-10-15T20:02:51.858540] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-15T20:02:51.858630] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAGN took 33.3s. Estimated remaining: 2h 30m 19s. Rate: 7.1 symbols/min [2025-10-15T20:02:52.028826] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:52.062925] [DEBUG] [LOCAL ] MATV: Loaded 35662 existing records from primary storage. [2025-10-15T20:02:52.063194] [INFO ] [MAIN ] MATV: Loaded 35662 existing records. [2025-10-15T20:02:52.126449] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-15T20:02:52.247107] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:02:52.247316] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-15T20:02:52.247364] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-15T20:02:52.247699] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-15T20:02:52.247755] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-15T20:02:52.609861] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:52.913960] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-15T20:02:53.118429] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T20:02:53.457474] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T20:02:53.714019] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-15T20:02:54.173219] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T20:02:54.514054] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-15T20:02:55.313964] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-15T20:02:55.442269] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T20:02:55.447850] [INFO ] [REMOTE ] MAIN: Full fetch complete (60416 records). [2025-10-15T20:02:55.447978] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-15T20:02:55.816342] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T20:02:55.877202] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-15T20:02:55.877286] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-15T20:02:55.878404] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-15T20:02:55.878477] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-15T20:02:55.882065] [DEBUG] [LOCAL ] MAIN: Trimmed 60416 records to 41822 (keeping 200 days of data) [2025-10-15T20:02:56.116451] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-15T20:02:56.149455] [DEBUG] [LOCAL ] MAIN: Primary data saved (41822 records). [2025-10-15T20:02:56.149565] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-15T20:02:56.149707] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. MAIN took 36.8s. Estimated remaining: 2h 30m 7s. Rate: 7.1 symbols/min [2025-10-15T20:02:56.314333] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:02:56.314495] [DEBUG] [LOCAL ] MATX: No existing data file found in primary storage. [2025-10-15T20:02:56.314531] [WARN ] [MAIN ] MATX: No existing data found, performing full refresh instead. [2025-10-15T20:02:56.314659] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-15T20:02:56.314717] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-15T20:02:56.314762] [DEBUG] [LOCAL ] MATX: No primary data file found to delete. [2025-10-15T20:02:56.314794] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-15T20:02:56.669733] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:02:56.900828] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T20:02:56.913942] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-15T20:02:57.483615] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T20:02:57.713983] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-15T20:02:58.513975] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-15T20:02:58.541303] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T20:02:59.019344] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T20:02:59.314016] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-15T20:02:59.911417] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T20:03:00.114011] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-15T20:03:00.222527] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T20:03:00.913960] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-15T20:03:01.265011] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T20:03:01.714001] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-15T20:03:01.770486] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T20:03:02.514000] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-15T20:03:03.319082] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-15T20:03:03.339514] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T20:03:03.407630] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T20:03:04.113999] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-15T20:03:04.727049] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T20:03:04.914001] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-15T20:03:05.233457] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T20:03:05.714009] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-15T20:03:06.493494] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T20:03:06.497121] [INFO ] [REMOTE ] MANU: Full fetch complete (38859 records). [2025-10-15T20:03:06.497203] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-15T20:03:06.519163] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-15T20:03:06.884092] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-15T20:03:06.884195] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-15T20:03:06.885021] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-15T20:03:06.885084] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-15T20:03:06.886137] [DEBUG] [LOCAL ] MANU: Trimmed 38859 records to 27055 (keeping 200 days of data) [2025-10-15T20:03:07.047168] [DEBUG] [LOCAL ] MANU: Primary data saved (27055 records). [2025-10-15T20:03:07.047304] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-15T20:03:07.047388] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MANU took 39.6s. Estimated remaining: 2h 30m 0s. Rate: 7.1 symbols/min [2025-10-15T20:03:07.229231] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:03:07.275313] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:03:07.308899] [DEBUG] [LOCAL ] MAX: Loaded 30978 existing records from primary storage. [2025-10-15T20:03:07.309197] [INFO ] [MAIN ] MAX: Loaded 30978 existing records. [2025-10-15T20:03:07.321204] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-15T20:03:07.527278] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:03:07.527704] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-15T20:03:07.527852] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-15T20:03:07.528477] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-15T20:03:07.528545] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-15T20:03:07.853954] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T20:03:08.080175] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:03:08.114085] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-15T20:03:08.913982] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-15T20:03:09.114744] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T20:03:09.714033] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-15T20:03:09.997411] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T20:03:10.035213] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T20:03:10.513989] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-15T20:03:10.944207] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T20:03:11.314004] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-15T20:03:11.336513] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T20:03:12.114026] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-15T20:03:12.915771] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-15T20:03:12.921827] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T20:03:13.664623] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T20:03:13.714011] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-15T20:03:14.149302] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T20:03:14.514057] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-15T20:03:15.161158] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T20:03:15.314002] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-15T20:03:16.114030] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-15T20:03:16.192903] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T20:03:16.716245] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T20:03:16.914042] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-15T20:03:17.099107] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T20:03:17.714044] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-15T20:03:18.413936] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T20:03:18.513982] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-15T20:03:19.248695] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T20:03:19.314062] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-15T20:03:19.997600] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T20:03:20.114052] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-15T20:03:20.402029] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T20:03:20.914055] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-15T20:03:21.438792] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T20:03:21.714001] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-15T20:03:21.983577] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T20:03:22.514046] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-15T20:03:23.112673] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T20:03:23.313969] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-15T20:03:23.467240] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:03:24.114017] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-15T20:03:24.845297] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T20:03:24.913967] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-15T20:03:24.961831] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T20:03:25.713982] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-15T20:03:26.084976] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T20:03:26.513976] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-15T20:03:26.945053] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T20:03:27.313982] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-15T20:03:27.793688] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T20:03:28.114007] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-15T20:03:28.642548] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T20:03:28.646578] [INFO ] [REMOTE ] MATX: Full fetch complete (43571 records). [2025-10-15T20:03:28.646714] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-15T20:03:28.919114] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-15T20:03:29.029315] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-15T20:03:29.029430] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-15T20:03:29.030246] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-15T20:03:29.030308] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-15T20:03:29.031196] [DEBUG] [LOCAL ] MATX: Trimmed 43571 records to 31970 (keeping 200 days of data) [2025-10-15T20:03:29.231457] [DEBUG] [LOCAL ] MATX: Primary data saved (31970 records). [2025-10-15T20:03:29.231590] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-15T20:03:29.231683] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MATX took 33.1s. Estimated remaining: 2h 30m 3s. Rate: 7.1 symbols/min [2025-10-15T20:03:29.399740] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:03:29.439452] [DEBUG] [LOCAL ] MBC: Loaded 43833 existing records from primary storage. [2025-10-15T20:03:29.439778] [INFO ] [MAIN ] MBC: Loaded 43833 existing records. [2025-10-15T20:03:29.618837] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:03:29.619190] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-15T20:03:29.619268] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-15T20:03:29.620107] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-15T20:03:29.620170] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-15T20:03:29.718999] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-15T20:03:29.727345] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T20:03:30.010108] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:03:30.350238] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T20:03:30.513990] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-15T20:03:31.313989] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-15T20:03:31.344448] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T20:03:31.350759] [INFO ] [REMOTE ] MAS: Full fetch complete (75189 records). [2025-10-15T20:03:31.350896] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-15T20:03:31.764901] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-15T20:03:31.765000] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-15T20:03:31.766080] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-15T20:03:31.766222] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-15T20:03:31.778525] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T20:03:31.783515] [INFO ] [REMOTE ] MAX: Full fetch complete (45563 records). [2025-10-15T20:03:31.783420] [DEBUG] [LOCAL ] MAS: Trimmed 75189 records to 52288 (keeping 200 days of data) [2025-10-15T20:03:31.783712] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-15T20:03:32.153317] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-15T20:03:32.421465] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-15T20:03:32.421561] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-15T20:03:32.422818] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-15T20:03:32.423736] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-15T20:03:32.427314] [DEBUG] [LOCAL ] MAX: Trimmed 45563 records to 31010 (keeping 200 days of data) [2025-10-15T20:03:32.627589] [DEBUG] [LOCAL ] MAS: Primary data saved (52288 records). [2025-10-15T20:03:32.627802] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-15T20:03:32.627929] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MAS took 42.3s. Estimated remaining: 2h 29m 51s. Rate: 7.1 symbols/min [2025-10-15T20:03:32.837378] [DEBUG] [LOCAL ] MAX: Primary data saved (31010 records). [2025-10-15T20:03:32.869341] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-15T20:03:32.869238] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:03:32.869464] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MAX took 25.8s. Estimated remaining: 2h 29m 35s. Rate: 7.1 symbols/min [2025-10-15T20:03:32.981804] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T20:03:33.021515] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-15T20:03:33.044982] [DEBUG] [LOCAL ] MBI: Loaded 24329 existing records from primary storage. [2025-10-15T20:03:33.051092] [INFO ] [MAIN ] MBI: Loaded 24329 existing records. [2025-10-15T20:03:33.163627] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:03:33.288726] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:03:33.288934] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-15T20:03:33.288987] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-15T20:03:33.289580] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-15T20:03:33.289638] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-15T20:03:33.429543] [DEBUG] [LOCAL ] MC: Loaded 43984 existing records from primary storage. [2025-10-15T20:03:33.445367] [INFO ] [MAIN ] MC: Loaded 43984 existing records. [2025-10-15T20:03:33.807868] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:03:33.825775] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-15T20:03:33.845361] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T20:03:33.839249] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-15T20:03:33.889059] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:03:33.889419] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-15T20:03:33.883278] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-15T20:03:33.890441] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-15T20:03:34.236614] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:03:34.514021] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-15T20:03:34.598918] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T20:03:35.233336] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T20:03:35.238682] [INFO ] [REMOTE ] MATV: Full fetch complete (52301 records). [2025-10-15T20:03:35.238896] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-15T20:03:35.319202] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-15T20:03:35.620116] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-15T20:03:35.620236] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-15T20:03:35.621284] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-15T20:03:35.621353] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-15T20:03:35.622682] [DEBUG] [LOCAL ] MATV: Trimmed 52301 records to 35661 (keeping 200 days of data) [2025-10-15T20:03:35.853205] [DEBUG] [LOCAL ] MATV: Primary data saved (35661 records). [2025-10-15T20:03:35.854149] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-15T20:03:35.855125] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MATV took 44.0s. Estimated remaining: 2h 29m 23s. Rate: 7.1 symbols/min [2025-10-15T20:03:35.854977] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T20:03:36.024471] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:03:36.036029] [DEBUG] [LOCAL ] MCB: Loaded 11326 existing records from primary storage. [2025-10-15T20:03:36.036248] [INFO ] [MAIN ] MCB: Loaded 11326 existing records. [2025-10-15T20:03:36.121980] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-15T20:03:36.225242] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:03:36.225454] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-15T20:03:36.225504] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-15T20:03:36.226603] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-15T20:03:36.226700] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-15T20:03:36.636741] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:03:36.913999] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-15T20:03:37.014486] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T20:03:37.256959] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T20:03:37.533215] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T20:03:37.714012] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-15T20:03:38.514001] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-15T20:03:39.188913] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T20:03:39.313989] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-15T20:03:39.640238] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T20:03:40.114001] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-15T20:03:40.776192] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T20:03:40.818954] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T20:03:40.913962] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-15T20:03:41.714015] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-15T20:03:42.467027] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T20:03:42.513966] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-15T20:03:43.118035] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T20:03:43.314009] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-15T20:03:43.998362] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T20:03:44.054611] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T20:03:44.113985] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-15T20:03:44.717525] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T20:03:44.914087] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-15T20:03:45.714043] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-15T20:03:45.884687] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T20:03:46.514001] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-15T20:03:47.134306] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T20:03:47.319535] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-15T20:03:47.323663] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T20:03:48.114014] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-15T20:03:48.561601] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T20:03:48.913991] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-15T20:03:49.537758] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T20:03:49.713964] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-15T20:03:49.883608] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T20:03:50.513992] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-15T20:03:50.822936] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T20:03:51.314003] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-15T20:03:51.929143] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T20:03:51.947522] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T20:03:52.113993] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-15T20:03:52.857941] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T20:03:52.913960] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-15T20:03:53.632434] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T20:03:53.714028] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-15T20:03:54.514053] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-15T20:03:55.194523] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T20:03:55.236415] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T20:03:55.313975] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-15T20:03:56.087514] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T20:03:56.089919] [INFO ] [REMOTE ] MCB: Full fetch complete (16530 records). [2025-10-15T20:03:56.090017] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-15T20:03:56.119151] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-15T20:03:56.484864] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-15T20:03:56.484971] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-15T20:03:56.485611] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-15T20:03:56.485678] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-15T20:03:56.486378] [DEBUG] [LOCAL ] MCB: Trimmed 16530 records to 11339 (keeping 200 days of data) [2025-10-15T20:03:56.564102] [DEBUG] [LOCAL ] MCB: Primary data saved (11339 records). [2025-10-15T20:03:56.564298] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-15T20:03:56.564404] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MCB took 20.7s. Estimated remaining: 2h 29m 24s. Rate: 7.1 symbols/min [2025-10-15T20:03:56.753426] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:03:56.753685] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-15T20:03:56.753740] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-15T20:03:56.753865] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-15T20:03:56.753907] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-15T20:03:56.753948] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-15T20:03:56.753979] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-15T20:03:56.917705] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-15T20:03:57.133023] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:03:57.327462] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T20:03:57.714033] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-15T20:03:58.514016] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-15T20:03:58.617732] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T20:03:58.724557] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T20:03:59.314076] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-15T20:04:00.099186] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T20:04:00.114042] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-15T20:04:00.569833] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T20:04:00.914252] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-15T20:04:01.713977] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-15T20:04:02.028568] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T20:04:02.222173] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-15T20:04:02.514007] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-15T20:04:03.253998] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T20:04:03.314006] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-15T20:04:03.896447] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T20:04:04.114025] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-15T20:04:04.914052] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-15T20:04:05.302433] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T20:04:05.714042] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-15T20:04:05.836496] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T20:04:05.842919] [INFO ] [REMOTE ] MBC: Full fetch complete (63242 records). [2025-10-15T20:04:05.843072] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-15T20:04:06.147478] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T20:04:06.278809] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-15T20:04:06.278902] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-15T20:04:06.279855] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-15T20:04:06.279971] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-15T20:04:06.281334] [DEBUG] [LOCAL ] MBC: Trimmed 63242 records to 43915 (keeping 200 days of data) [2025-10-15T20:04:06.522284] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-15T20:04:06.537199] [DEBUG] [LOCAL ] MBC: Primary data saved (43915 records). [2025-10-15T20:04:06.537298] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-15T20:04:06.538069] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MBC took 37.3s. Estimated remaining: 2h 29m 17s. Rate: 7.1 symbols/min [2025-10-15T20:04:06.706808] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:06.715370] [DEBUG] [LOCAL ] MCI: Loaded 6454 existing records from primary storage. [2025-10-15T20:04:06.715597] [INFO ] [MAIN ] MCI: Loaded 6454 existing records. [2025-10-15T20:04:06.893484] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:06.893746] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-15T20:04:06.893822] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-15T20:04:06.894115] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-15T20:04:06.894173] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-15T20:04:07.255737] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:07.285325] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T20:04:07.314006] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-15T20:04:07.707359] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T20:04:07.710788] [INFO ] [REMOTE ] MBI: Full fetch complete (36399 records). [2025-10-15T20:04:07.710912] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-15T20:04:08.072395] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-15T20:04:08.072468] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-15T20:04:08.072902] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-15T20:04:08.072961] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-15T20:04:08.073720] [DEBUG] [LOCAL ] MBI: Trimmed 36399 records to 24330 (keeping 200 days of data) [2025-10-15T20:04:08.115674] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-15T20:04:08.204507] [DEBUG] [LOCAL ] MBI: Primary data saved (24330 records). [2025-10-15T20:04:08.204639] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-15T20:04:08.204760] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MBI took 35.6s. Estimated remaining: 2h 29m 3s. Rate: 7.1 symbols/min [2025-10-15T20:04:08.371274] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:08.408529] [DEBUG] [LOCAL ] MCK: Loaded 38649 existing records from primary storage. [2025-10-15T20:04:08.408981] [INFO ] [MAIN ] MCK: Loaded 38649 existing records. [2025-10-15T20:04:08.582490] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:08.582741] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-15T20:04:08.582811] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-15T20:04:08.583381] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-15T20:04:08.583439] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-15T20:04:08.928222] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-15T20:04:08.932876] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:08.960600] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T20:04:09.616575] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T20:04:09.713989] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-15T20:04:09.949635] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T20:04:10.514058] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-15T20:04:10.779507] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T20:04:11.236184] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T20:04:11.314029] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-15T20:04:12.114056] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-15T20:04:12.914076] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-15T20:04:13.516181] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T20:04:13.567439] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-15T20:04:13.713960] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-15T20:04:14.514004] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-15T20:04:14.567058] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T20:04:14.572296] [INFO ] [REMOTE ] MC: Full fetch complete (62933 records). [2025-10-15T20:04:14.572410] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-15T20:04:14.980808] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-15T20:04:14.980889] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-15T20:04:14.981943] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-15T20:04:14.982009] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-15T20:04:14.983324] [DEBUG] [LOCAL ] MC: Trimmed 62933 records to 43982 (keeping 200 days of data) [2025-10-15T20:04:15.242323] [DEBUG] [LOCAL ] MC: Primary data saved (43982 records). [2025-10-15T20:04:15.242437] [INFO ] [MAIN ] MC: Full history saved. [2025-10-15T20:04:15.242510] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MC took 42.4s. Estimated remaining: 2h 28m 53s. Rate: 7.1 symbols/min [2025-10-15T20:04:15.332464] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-15T20:04:15.418571] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:15.427687] [DEBUG] [LOCAL ] MCN: Loaded 8186 existing records from primary storage. [2025-10-15T20:04:15.427914] [INFO ] [MAIN ] MCN: Loaded 8186 existing records. [2025-10-15T20:04:15.638969] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:15.639235] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-15T20:04:15.639369] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-15T20:04:15.640087] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-15T20:04:15.641432] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T20:04:15.641552] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-15T20:04:16.015806] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:16.114006] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-15T20:04:16.173693] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T20:04:16.174690] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T20:04:16.663784] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T20:04:16.914002] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-15T20:04:17.714020] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-15T20:04:18.513996] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-15T20:04:18.549677] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T20:04:19.203247] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T20:04:19.313967] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-15T20:04:19.547436] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T20:04:20.020862] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T20:04:20.113970] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-15T20:04:20.710217] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T20:04:20.914027] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-15T20:04:21.653899] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:04:21.714007] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-15T20:04:22.514008] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-15T20:04:23.132281] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T20:04:23.313994] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-15T20:04:23.356566] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T20:04:24.113976] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-15T20:04:24.719949] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T20:04:24.913994] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-15T20:04:25.535339] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-15T20:04:25.714017] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-15T20:04:26.494624] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T20:04:26.495576] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T20:04:26.513941] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-15T20:04:27.314047] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-15T20:04:28.070127] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T20:04:28.085475] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:04:28.113974] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-15T20:04:28.882755] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T20:04:28.914017] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-15T20:04:29.653298] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T20:04:29.714012] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-15T20:04:30.514056] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-15T20:04:31.174252] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-15T20:04:31.314046] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-15T20:04:32.010455] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T20:04:32.062869] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-15T20:04:32.113950] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-15T20:04:32.914051] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-15T20:04:33.655720] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T20:04:33.714012] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-15T20:04:34.196860] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T20:04:34.340776] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:04:34.342149] [INFO ] [REMOTE ] MCN: Full fetch complete (11705 records). [2025-10-15T20:04:34.342220] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-15T20:04:34.525766] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-15T20:04:34.700271] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-15T20:04:34.700337] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-15T20:04:34.700583] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-15T20:04:34.700621] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-15T20:04:34.701064] [DEBUG] [LOCAL ] MCN: Trimmed 11705 records to 8174 (keeping 200 days of data) [2025-10-15T20:04:34.746247] [DEBUG] [LOCAL ] MCN: Primary data saved (8174 records). [2025-10-15T20:04:34.746352] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-15T20:04:34.746438] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MCN took 19.5s. Estimated remaining: 2h 28m 54s. Rate: 7.1 symbols/min [2025-10-15T20:04:34.910589] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:34.945908] [DEBUG] [LOCAL ] MCO: Loaded 39438 existing records from primary storage. [2025-10-15T20:04:34.946200] [INFO ] [MAIN ] MCO: Loaded 39438 existing records. [2025-10-15T20:04:35.118315] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:35.118475] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-15T20:04:35.118522] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-15T20:04:35.119220] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-15T20:04:35.119279] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-15T20:04:35.319066] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-15T20:04:35.479471] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:36.019794] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T20:04:36.113962] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-15T20:04:36.914016] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-15T20:04:37.395773] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T20:04:37.533562] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T20:04:37.713966] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-15T20:04:38.336400] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T20:04:38.412781] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T20:04:38.513964] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-15T20:04:39.314009] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-15T20:04:39.993057] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T20:04:40.108438] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:04:40.114388] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-15T20:04:40.116382] [INFO ] [REMOTE ] MCD: Full fetch complete (77153 records). [2025-10-15T20:04:40.116510] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-15T20:04:40.311624] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T20:04:40.312476] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:04:40.312551] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:04:40.312601] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-15T20:04:40.312691] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-15T20:04:40.312747] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-15T20:04:40.312791] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-15T20:04:40.312860] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MCD took 43.7s. Estimated remaining: 2h 28m 43s. Rate: 7.1 symbols/min [2025-10-15T20:04:40.478820] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:40.488590] [DEBUG] [LOCAL ] MCR: Loaded 8859 existing records from primary storage. [2025-10-15T20:04:40.488844] [INFO ] [MAIN ] MCR: Loaded 8859 existing records. [2025-10-15T20:04:40.677179] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:40.677385] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-15T20:04:40.677431] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-15T20:04:40.677602] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-15T20:04:40.677692] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-15T20:04:40.790865] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T20:04:40.919060] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-15T20:04:41.034580] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:41.714008] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-15T20:04:42.513994] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-15T20:04:42.587265] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T20:04:43.238890] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T20:04:43.311319] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T20:04:43.314746] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-15T20:04:44.114001] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-15T20:04:44.782210] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T20:04:44.857687] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T20:04:44.913992] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-15T20:04:45.639999] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T20:04:45.714013] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-15T20:04:46.453678] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:04:46.514050] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-15T20:04:47.313972] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-15T20:04:48.116745] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-15T20:04:48.122686] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T20:04:48.642509] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T20:04:48.646975] [INFO ] [REMOTE ] MCK: Full fetch complete (56746 records). [2025-10-15T20:04:48.647076] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-15T20:04:48.746909] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T20:04:48.919125] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-15T20:04:49.063636] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-15T20:04:49.063746] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-15T20:04:49.064620] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-15T20:04:49.064696] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-15T20:04:49.065869] [DEBUG] [LOCAL ] MCK: Trimmed 56746 records to 38560 (keeping 200 days of data) [2025-10-15T20:04:49.302762] [DEBUG] [LOCAL ] MCK: Primary data saved (38560 records). [2025-10-15T20:04:49.302895] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-15T20:04:49.302973] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MCK took 41.1s. Estimated remaining: 2h 28m 35s. Rate: 7.1 symbols/min [2025-10-15T20:04:49.469636] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:49.491745] [DEBUG] [LOCAL ] MCS: Loaded 21059 existing records from primary storage. [2025-10-15T20:04:49.492016] [INFO ] [MAIN ] MCS: Loaded 21059 existing records. [2025-10-15T20:04:49.670440] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:49.670663] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-15T20:04:49.670723] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-15T20:04:49.671025] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-15T20:04:49.671085] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-15T20:04:49.726457] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-15T20:04:49.767129] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T20:04:50.028946] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:50.404587] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-15T20:04:50.513993] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-15T20:04:51.314005] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-15T20:04:52.029937] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T20:04:52.114063] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-15T20:04:52.336077] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T20:04:52.704683] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T20:04:52.914057] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-15T20:04:53.713999] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-15T20:04:54.353434] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T20:04:54.379919] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T20:04:54.514030] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-15T20:04:55.313981] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-15T20:04:55.461850] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T20:04:55.463183] [INFO ] [REMOTE ] MCI: Full fetch complete (9981 records). [2025-10-15T20:04:55.463254] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-15T20:04:55.806437] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-15T20:04:55.806511] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-15T20:04:55.806761] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-15T20:04:55.806821] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-15T20:04:55.807226] [DEBUG] [LOCAL ] MCI: Trimmed 9981 records to 6403 (keeping 200 days of data) [2025-10-15T20:04:55.844900] [DEBUG] [LOCAL ] MCI: Primary data saved (6403 records). [2025-10-15T20:04:55.844995] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-15T20:04:55.845081] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCI took 49.3s. Estimated remaining: 2h 28m 25s. Rate: 7.1 symbols/min [2025-10-15T20:04:56.008124] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:04:56.030317] [DEBUG] [LOCAL ] MCY: Loaded 23899 existing records from primary storage. [2025-10-15T20:04:56.030541] [INFO ] [MAIN ] MCY: Loaded 23899 existing records. [2025-10-15T20:04:56.124266] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-15T20:04:56.207965] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:04:56.209229] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-15T20:04:56.209287] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-15T20:04:56.210165] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-15T20:04:56.210228] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-15T20:04:56.574755] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:04:56.607735] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T20:04:56.831720] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T20:04:56.913989] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-15T20:04:57.714017] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-15T20:04:58.494941] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T20:04:58.513942] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-15T20:04:58.754101] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:04:59.314004] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-15T20:04:59.992950] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T20:05:00.106079] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:05:00.107616] [INFO ] [REMOTE ] MCR: Full fetch complete (13962 records). [2025-10-15T20:05:00.107709] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-15T20:05:00.119180] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-15T20:05:00.462492] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-15T20:05:00.462570] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-15T20:05:00.462938] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-15T20:05:00.463000] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-15T20:05:00.463454] [DEBUG] [LOCAL ] MCR: Trimmed 13962 records to 8895 (keeping 200 days of data) [2025-10-15T20:05:00.516599] [DEBUG] [LOCAL ] MCR: Primary data saved (8895 records). [2025-10-15T20:05:00.516753] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-15T20:05:00.516853] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCR took 20.2s. Estimated remaining: 2h 28m 14s. Rate: 7.1 symbols/min [2025-10-15T20:05:00.680704] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:00.716153] [DEBUG] [LOCAL ] MD: Loaded 38569 existing records from primary storage. [2025-10-15T20:05:00.716423] [INFO ] [MAIN ] MD: Loaded 38569 existing records. [2025-10-15T20:05:00.889457] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:00.889702] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-15T20:05:00.889770] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-15T20:05:00.890198] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-15T20:05:00.890270] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-15T20:05:00.920076] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-15T20:05:01.239111] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:01.462415] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T20:05:01.714085] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-15T20:05:02.514003] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-15T20:05:02.679818] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T20:05:02.738230] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T20:05:03.314037] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-15T20:05:03.825478] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T20:05:04.113990] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-15T20:05:04.913990] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-15T20:05:05.061452] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T20:05:05.066819] [INFO ] [REMOTE ] MCO: Full fetch complete (57734 records). [2025-10-15T20:05:05.066920] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-15T20:05:05.476908] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T20:05:05.504578] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-15T20:05:05.504724] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-15T20:05:05.505731] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-15T20:05:05.506398] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-15T20:05:05.507591] [DEBUG] [LOCAL ] MCO: Trimmed 57734 records to 39462 (keeping 200 days of data) [2025-10-15T20:05:05.718019] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-15T20:05:05.755530] [DEBUG] [LOCAL ] MCO: Primary data saved (39462 records). [2025-10-15T20:05:05.755707] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-15T20:05:05.756266] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCO took 31.0s. Estimated remaining: 2h 28m 3s. Rate: 7.1 symbols/min [2025-10-15T20:05:05.930547] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:05.942381] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T20:05:05.951186] [DEBUG] [LOCAL ] MDST: Loaded 5942 existing records from primary storage. [2025-10-15T20:05:05.951337] [INFO ] [MAIN ] MDST: Loaded 5942 existing records. [2025-10-15T20:05:06.121845] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:06.122025] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-15T20:05:06.122070] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-15T20:05:06.122208] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-15T20:05:06.122282] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-15T20:05:06.472025] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:06.513953] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-15T20:05:07.222866] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T20:05:07.315554] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-15T20:05:07.320247] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T20:05:08.076142] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T20:05:08.113978] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-15T20:05:08.914058] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-15T20:05:09.417708] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T20:05:09.560347] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T20:05:09.714010] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-15T20:05:10.514075] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-15T20:05:11.076240] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T20:05:11.314055] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-15T20:05:11.693306] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T20:05:11.906687] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T20:05:12.114111] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-15T20:05:12.607820] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-15T20:05:12.914050] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-15T20:05:13.394464] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T20:05:13.714049] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-15T20:05:14.514004] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-15T20:05:14.787898] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T20:05:15.110985] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T20:05:15.314018] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-15T20:05:15.894799] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T20:05:16.114027] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-15T20:05:16.914067] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-15T20:05:17.436194] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T20:05:17.714006] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-15T20:05:17.775293] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T20:05:18.514052] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-15T20:05:19.150626] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T20:05:19.313958] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-15T20:05:19.615417] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T20:05:20.114036] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-15T20:05:20.713043] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T20:05:20.778743] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T20:05:20.913998] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-15T20:05:21.637509] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T20:05:21.713960] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-15T20:05:22.374300] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:05:22.376197] [INFO ] [REMOTE ] MDST: Full fetch complete (8748 records). [2025-10-15T20:05:22.376346] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-15T20:05:22.519281] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-15T20:05:22.775120] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-15T20:05:22.775233] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-15T20:05:22.775570] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-15T20:05:22.775637] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-15T20:05:22.776207] [DEBUG] [LOCAL ] MDST: Trimmed 8748 records to 5952 (keeping 200 days of data) [2025-10-15T20:05:22.817086] [DEBUG] [LOCAL ] MDST: Primary data saved (5952 records). [2025-10-15T20:05:22.817285] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-15T20:05:22.817441] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MDST took 17.1s. Estimated remaining: 2h 28m 1s. Rate: 7.1 symbols/min [2025-10-15T20:05:23.313994] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-15T20:05:24.113990] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-15T20:05:24.175969] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T20:05:24.614202] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T20:05:24.913970] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-15T20:05:25.030863] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T20:05:25.714007] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-15T20:05:26.329120] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T20:05:26.513968] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-15T20:05:26.838026] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T20:05:27.314014] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-15T20:05:27.798322] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T20:05:28.113975] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-15T20:05:28.462628] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T20:05:28.914010] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-15T20:05:29.335819] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T20:05:29.714042] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-15T20:05:30.082261] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T20:05:30.494701] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T20:05:30.514047] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-15T20:05:31.313988] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-15T20:05:31.750938] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T20:05:32.113968] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-15T20:05:32.340366] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T20:05:32.913996] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-15T20:05:33.200791] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T20:05:33.713989] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-15T20:05:33.746993] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T20:05:33.750692] [INFO ] [REMOTE ] MCS: Full fetch complete (30623 records). [2025-10-15T20:05:33.750772] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-15T20:05:34.138221] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-15T20:05:34.138294] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-15T20:05:34.138939] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-15T20:05:34.139002] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-15T20:05:34.139825] [DEBUG] [LOCAL ] MCS: Trimmed 30623 records to 21099 (keeping 200 days of data) [2025-10-15T20:05:34.268361] [DEBUG] [LOCAL ] MCS: Primary data saved (21099 records). [2025-10-15T20:05:34.268485] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-15T20:05:34.268560] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MCS took 45.0s. Estimated remaining: 2h 27m 55s. Rate: 7.1 symbols/min [2025-10-15T20:05:34.514020] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-15T20:05:34.817233] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T20:05:34.820605] [INFO ] [REMOTE ] MCY: Full fetch complete (41134 records). [2025-10-15T20:05:34.820706] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-15T20:05:35.226915] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-15T20:05:35.227023] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-15T20:05:35.227818] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-15T20:05:35.227912] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-15T20:05:35.228766] [DEBUG] [LOCAL ] MCY: Trimmed 41134 records to 23955 (keeping 200 days of data) [2025-10-15T20:05:35.373505] [DEBUG] [LOCAL ] MCY: Primary data saved (23955 records). [2025-10-15T20:05:35.373624] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-15T20:05:35.373735] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCY took 39.5s. Estimated remaining: 2h 27m 41s. Rate: 7.1 symbols/min [2025-10-15T20:05:35.925357] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T20:05:35.933196] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-15T20:05:37.091697] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T20:05:37.096486] [INFO ] [REMOTE ] MD: Full fetch complete (55164 records). [2025-10-15T20:05:37.096591] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-15T20:05:37.490958] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-15T20:05:37.491055] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-15T20:05:37.491959] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-15T20:05:37.492020] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-15T20:05:37.493167] [DEBUG] [LOCAL ] MD: Trimmed 55164 records to 38550 (keeping 200 days of data) [2025-10-15T20:05:37.717520] [DEBUG] [LOCAL ] MD: Primary data saved (38550 records). [2025-10-15T20:05:37.717687] [INFO ] [MAIN ] MD: Full history saved. [2025-10-15T20:05:37.717803] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MD took 37.2s. Estimated remaining: 2h 27m 28s. Rate: 7.1 symbols/min [2025-10-15T20:05:38.263143] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:38.354200] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:38.379612] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:38.425107] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:38.435252] [DEBUG] [LOCAL ] MDV: Loaded 8484 existing records from primary storage. [2025-10-15T20:05:38.435752] [INFO ] [MAIN ] MDV: Loaded 8484 existing records. [2025-10-15T20:05:38.533078] [DEBUG] [LOCAL ] MEC: Loaded 16347 existing records from primary storage. [2025-10-15T20:05:38.560010] [INFO ] [MAIN ] MEC: Loaded 16347 existing records. [2025-10-15T20:05:38.768294] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:38.799960] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-15T20:05:38.816447] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-15T20:05:38.895842] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-15T20:05:38.852011] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-15T20:05:38.896964] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-15T20:05:38.895749] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:38.897354] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-15T20:05:38.915325] [DEBUG] [LOCAL ] MDU: Loaded 48090 existing records from primary storage. [2025-10-15T20:05:38.939410] [INFO ] [MAIN ] MDU: Loaded 48090 existing records. [2025-10-15T20:05:38.929956] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-15T20:05:38.978045] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-15T20:05:39.141750] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-15T20:05:39.170819] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-15T20:05:39.480346] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:39.514776] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:39.496066] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-15T20:05:39.533486] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-15T20:05:39.533630] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-15T20:05:39.549043] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-15T20:05:39.574263] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-15T20:05:39.580955] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-15T20:05:39.609441] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-15T20:05:39.685736] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-15T20:05:40.282684] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:40.392265] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-15T20:05:40.583236] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:40.625910] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-15T20:05:40.809210] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:40.822196] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-15T20:05:40.847166] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:40.847670] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-15T20:05:41.122724] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T20:05:41.124689] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-15T20:05:41.672691] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T20:05:41.676395] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-15T20:05:41.794970] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T20:05:41.796821] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-15T20:05:42.347559] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T20:05:42.350020] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-15T20:05:42.485083] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T20:05:42.519120] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-15T20:05:42.524374] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T20:05:42.639719] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:05:42.968378] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T20:05:43.314062] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-15T20:05:44.103472] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T20:05:44.116965] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-15T20:05:44.884997] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:05:44.914017] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-15T20:05:45.142503] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T20:05:45.713990] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-15T20:05:46.214925] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T20:05:46.374466] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T20:05:46.513978] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-15T20:05:47.314012] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-15T20:05:47.924071] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T20:05:48.113979] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-15T20:05:48.150407] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T20:05:48.914001] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-15T20:05:49.713960] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-15T20:05:49.906047] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T20:05:50.490478] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T20:05:50.513948] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-15T20:05:50.531465] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T20:05:51.314025] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-15T20:05:52.114027] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-15T20:05:52.189000] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T20:05:52.255874] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T20:05:52.558881] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T20:05:52.913995] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-15T20:05:53.668349] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T20:05:53.714031] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-15T20:05:54.342862] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T20:05:54.514020] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-15T20:05:55.313996] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-15T20:05:55.508999] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T20:05:56.114024] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-15T20:05:56.862007] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T20:05:56.863412] [INFO ] [REMOTE ] MDV: Full fetch complete (11755 records). [2025-10-15T20:05:56.863480] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-15T20:05:56.924139] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-15T20:05:57.158280] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T20:05:57.269538] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-15T20:05:57.269628] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-15T20:05:57.269961] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-15T20:05:57.270012] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-15T20:05:57.270513] [DEBUG] [LOCAL ] MDV: Trimmed 11755 records to 8465 (keeping 200 days of data) [2025-10-15T20:05:57.321727] [DEBUG] [LOCAL ] MDV: Primary data saved (8465 records). [2025-10-15T20:05:57.321852] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-15T20:05:57.321930] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDV took 19.6s. Estimated remaining: 2h 27m 28s. Rate: 7.1 symbols/min [2025-10-15T20:05:57.491674] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:05:57.511201] [DEBUG] [LOCAL ] MED: Loaded 21244 existing records from primary storage. [2025-10-15T20:05:57.511475] [INFO ] [MAIN ] MED: Loaded 21244 existing records. [2025-10-15T20:05:57.695826] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:05:57.696078] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-15T20:05:57.696137] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-15T20:05:57.696595] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-15T20:05:57.696720] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-15T20:05:57.719131] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-15T20:05:58.004839] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T20:05:58.075920] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:05:58.514013] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-15T20:05:59.313961] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-15T20:05:59.367595] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T20:05:59.515899] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T20:06:00.114063] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-15T20:06:00.914010] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-15T20:06:00.979778] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T20:06:01.714080] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-15T20:06:02.271715] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T20:06:02.451876] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-15T20:06:02.514005] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-15T20:06:02.619681] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T20:06:03.314045] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-15T20:06:04.113981] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-15T20:06:04.474824] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T20:06:04.638439] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-15T20:06:04.890233] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T20:06:04.913975] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-15T20:06:05.714014] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-15T20:06:06.503175] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T20:06:06.513978] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-15T20:06:07.154063] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T20:06:07.283881] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T20:06:07.313958] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-15T20:06:08.113965] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-15T20:06:08.304618] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T20:06:08.307211] [INFO ] [REMOTE ] MEC: Full fetch complete (22785 records). [2025-10-15T20:06:08.307281] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-15T20:06:08.663417] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-15T20:06:08.663512] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-15T20:06:08.664017] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-15T20:06:08.664079] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-15T20:06:08.664709] [DEBUG] [LOCAL ] MEC: Trimmed 22785 records to 16364 (keeping 200 days of data) [2025-10-15T20:06:08.759143] [DEBUG] [LOCAL ] MEC: Primary data saved (16364 records). [2025-10-15T20:06:08.759281] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-15T20:06:08.759358] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MEC took 31.0s. Estimated remaining: 2h 27m 22s. Rate: 7.1 symbols/min [2025-10-15T20:06:08.922696] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-15T20:06:08.925321] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:08.955665] [DEBUG] [LOCAL ] MEG: Loaded 31553 existing records from primary storage. [2025-10-15T20:06:08.955971] [INFO ] [MAIN ] MEG: Loaded 31553 existing records. [2025-10-15T20:06:09.130955] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:09.131323] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-15T20:06:09.131395] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-15T20:06:09.132196] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-15T20:06:09.132254] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-15T20:06:09.368231] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T20:06:09.523721] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:09.714039] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-15T20:06:10.513975] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-15T20:06:10.616595] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T20:06:10.836939] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T20:06:11.314043] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-15T20:06:12.114014] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-15T20:06:12.248438] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T20:06:12.628745] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T20:06:12.914005] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-15T20:06:13.714034] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-15T20:06:13.757107] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T20:06:13.763322] [INFO ] [REMOTE ] MDU: Full fetch complete (70624 records). [2025-10-15T20:06:13.763444] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-15T20:06:14.162377] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-15T20:06:14.162514] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-15T20:06:14.163535] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-15T20:06:14.163599] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-15T20:06:14.165001] [DEBUG] [LOCAL ] MDU: Trimmed 70624 records to 48061 (keeping 200 days of data) [2025-10-15T20:06:14.485464] [DEBUG] [LOCAL ] MDU: Primary data saved (48061 records). [2025-10-15T20:06:14.485673] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-15T20:06:14.485808] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MDU took 36.7s. Estimated remaining: 2h 27m 11s. Rate: 7.1 symbols/min [2025-10-15T20:06:14.521925] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-15T20:06:14.665780] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:14.686638] [DEBUG] [LOCAL ] MEGI: Loaded 19859 existing records from primary storage. [2025-10-15T20:06:14.686916] [INFO ] [MAIN ] MEGI: Loaded 19859 existing records. [2025-10-15T20:06:14.870904] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:14.871351] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-15T20:06:14.871430] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-15T20:06:14.871970] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-15T20:06:14.872054] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-15T20:06:15.076471] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-15T20:06:15.318137] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-15T20:06:15.325054] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:15.330247] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T20:06:15.732603] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T20:06:16.114027] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-15T20:06:16.913970] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-15T20:06:17.084989] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T20:06:17.268112] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T20:06:17.714021] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-15T20:06:17.967217] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T20:06:18.513967] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-15T20:06:18.611361] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T20:06:18.620837] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-15T20:06:18.621003] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-15T20:06:19.018680] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-15T20:06:19.018783] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-15T20:06:19.019876] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-15T20:06:19.019944] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-15T20:06:19.021482] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-15T20:06:19.318063] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-15T20:06:19.362679] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-15T20:06:19.362834] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-15T20:06:19.363117] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MDT took 41.6s. Estimated remaining: 2h 27m 0s. Rate: 7.1 symbols/min [2025-10-15T20:06:19.536117] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:19.550385] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T20:06:19.583348] [DEBUG] [LOCAL ] MEI: Loaded 31735 existing records from primary storage. [2025-10-15T20:06:19.583613] [INFO ] [MAIN ] MEI: Loaded 31735 existing records. [2025-10-15T20:06:19.755743] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:19.755944] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-15T20:06:19.755989] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-15T20:06:19.756579] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-15T20:06:19.756681] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-15T20:06:20.108855] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:20.113952] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-15T20:06:20.183070] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T20:06:20.913970] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-15T20:06:21.451269] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T20:06:21.550143] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T20:06:21.714024] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-15T20:06:22.514019] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-15T20:06:22.666259] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T20:06:23.314039] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-15T20:06:23.529708] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T20:06:24.113997] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-15T20:06:24.622712] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T20:06:24.913999] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-15T20:06:25.405804] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T20:06:25.723152] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-15T20:06:25.724850] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T20:06:26.514053] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-15T20:06:26.658137] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T20:06:27.314028] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-15T20:06:27.537921] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T20:06:28.114021] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-15T20:06:28.183216] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T20:06:28.186107] [INFO ] [REMOTE ] MED: Full fetch complete (32028 records). [2025-10-15T20:06:28.186201] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-15T20:06:28.566638] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-15T20:06:28.566768] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-15T20:06:28.567869] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-15T20:06:28.567933] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-15T20:06:28.568852] [DEBUG] [LOCAL ] MED: Trimmed 32028 records to 21236 (keeping 200 days of data) [2025-10-15T20:06:28.702411] [DEBUG] [LOCAL ] MED: Primary data saved (21236 records). [2025-10-15T20:06:28.702586] [INFO ] [MAIN ] MED: Full history saved. [2025-10-15T20:06:28.702706] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MED took 31.4s. Estimated remaining: 2h 26m 52s. Rate: 7.1 symbols/min [2025-10-15T20:06:28.882150] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:28.914013] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-15T20:06:28.937094] [DEBUG] [LOCAL ] MET: Loaded 53318 existing records from primary storage. [2025-10-15T20:06:28.937487] [INFO ] [MAIN ] MET: Loaded 53318 existing records. [2025-10-15T20:06:29.124752] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:29.125109] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-15T20:06:29.125237] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-15T20:06:29.126780] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-15T20:06:29.126850] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-15T20:06:29.514738] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:29.538522] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T20:06:29.714012] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-15T20:06:30.395078] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T20:06:30.418708] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T20:06:30.514013] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-15T20:06:31.314025] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-15T20:06:31.474182] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T20:06:32.114037] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-15T20:06:32.493176] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T20:06:32.914018] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-15T20:06:33.580929] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T20:06:33.714001] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-15T20:06:34.513992] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-15T20:06:34.608551] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T20:06:34.641698] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T20:06:35.314009] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-15T20:06:35.746626] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T20:06:36.114004] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-15T20:06:36.914013] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-15T20:06:37.111970] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T20:06:37.257446] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T20:06:37.714120] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-15T20:06:38.189210] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T20:06:38.513981] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-15T20:06:38.737670] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:06:39.314001] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-15T20:06:40.113971] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-15T20:06:40.341604] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T20:06:40.491806] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T20:06:40.914047] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-15T20:06:41.177569] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T20:06:41.713995] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-15T20:06:42.514073] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-15T20:06:42.683984] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T20:06:43.234033] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T20:06:43.314046] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-15T20:06:43.510254] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T20:06:44.113962] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-15T20:06:44.230517] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T20:06:44.914036] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-15T20:06:45.415063] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T20:06:45.714003] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-15T20:06:46.456775] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T20:06:46.513964] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-15T20:06:46.640165] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T20:06:47.314061] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-15T20:06:48.012600] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T20:06:48.043610] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:06:48.046310] [INFO ] [REMOTE ] MEGI: Full fetch complete (29491 records). [2025-10-15T20:06:48.046417] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-15T20:06:48.119118] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-15T20:06:48.419262] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-15T20:06:48.419368] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-15T20:06:48.420756] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-15T20:06:48.420822] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-15T20:06:48.421871] [DEBUG] [LOCAL ] MEGI: Trimmed 29491 records to 19796 (keeping 200 days of data) [2025-10-15T20:06:48.550420] [DEBUG] [LOCAL ] MEGI: Primary data saved (19796 records). [2025-10-15T20:06:48.550628] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-15T20:06:48.550768] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MEGI took 34.1s. Estimated remaining: 2h 26m 53s. Rate: 7.1 symbols/min [2025-10-15T20:06:48.725576] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:48.769154] [DEBUG] [LOCAL ] MFA: Loaded 45808 existing records from primary storage. [2025-10-15T20:06:48.769557] [INFO ] [MAIN ] MFA: Loaded 45808 existing records. [2025-10-15T20:06:48.921396] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-15T20:06:48.956975] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:48.957571] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-15T20:06:48.957678] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-15T20:06:48.958462] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-15T20:06:48.958522] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-15T20:06:49.334997] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:49.356586] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T20:06:49.714042] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-15T20:06:50.368247] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T20:06:50.514021] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-15T20:06:51.313980] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-15T20:06:51.418714] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T20:06:51.573338] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T20:06:51.577193] [INFO ] [REMOTE ] MEI: Full fetch complete (45445 records). [2025-10-15T20:06:51.577336] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-15T20:06:51.974127] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-15T20:06:51.974203] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-15T20:06:51.975008] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-15T20:06:51.975068] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-15T20:06:51.975995] [DEBUG] [LOCAL ] MEI: Trimmed 45445 records to 31678 (keeping 200 days of data) [2025-10-15T20:06:52.118014] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-15T20:06:52.159099] [DEBUG] [LOCAL ] MEI: Primary data saved (31678 records). [2025-10-15T20:06:52.159238] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-15T20:06:52.159319] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEI took 32.8s. Estimated remaining: 2h 26m 41s. Rate: 7.1 symbols/min [2025-10-15T20:06:52.328077] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:52.342013] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T20:06:52.349058] [DEBUG] [LOCAL ] MFAN: Loaded 4390 existing records from primary storage. [2025-10-15T20:06:52.349393] [INFO ] [MAIN ] MFAN: Loaded 4390 existing records. [2025-10-15T20:06:52.349498] [INFO ] [REMOTE ] MEG: Full fetch complete (47569 records). [2025-10-15T20:06:52.349719] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-15T20:06:52.690564] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:52.719978] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-15T20:06:52.752839] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-15T20:06:52.783995] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-15T20:06:52.789327] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-15T20:06:52.928229] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-15T20:06:53.041740] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-15T20:06:53.059802] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-15T20:06:53.066354] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-15T20:06:53.072668] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-15T20:06:53.159398] [DEBUG] [LOCAL ] MEG: Trimmed 47569 records to 31598 (keeping 200 days of data) [2025-10-15T20:06:53.415885] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:53.544377] [DEBUG] [LOCAL ] MEG: Primary data saved (31598 records). [2025-10-15T20:06:53.544563] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-15T20:06:53.544684] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MEG took 44.8s. Estimated remaining: 2h 26m 27s. Rate: 7.1 symbols/min [2025-10-15T20:06:53.716504] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-15T20:06:53.827517] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:06:53.837199] [DEBUG] [LOCAL ] MFAO: Loaded 3994 existing records from primary storage. [2025-10-15T20:06:53.837527] [INFO ] [MAIN ] MFAO: Loaded 3994 existing records. [2025-10-15T20:06:54.120512] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:06:54.120913] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-15T20:06:54.120974] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-15T20:06:54.121237] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-15T20:06:54.121332] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-15T20:06:54.348491] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T20:06:54.378273] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T20:06:54.526827] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-15T20:06:54.550751] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T20:06:54.627238] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:06:55.178265] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T20:06:55.314011] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-15T20:06:55.678445] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T20:06:56.114009] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-15T20:06:56.558458] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-15T20:06:56.914000] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-15T20:06:57.384784] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T20:06:57.714035] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-15T20:06:58.514049] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-15T20:06:58.981604] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T20:06:59.314032] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-15T20:06:59.382281] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T20:07:00.114042] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-15T20:07:00.622677] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T20:07:00.887883] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T20:07:00.913962] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-15T20:07:01.714007] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-15T20:07:02.359601] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T20:07:02.514000] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-15T20:07:03.104387] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T20:07:03.225423] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T20:07:03.314004] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-15T20:07:03.975059] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:07:03.981342] [INFO ] [REMOTE ] MET: Full fetch complete (77329 records). [2025-10-15T20:07:03.981465] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-15T20:07:04.120026] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-15T20:07:04.372740] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-15T20:07:04.372822] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-15T20:07:04.373861] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-15T20:07:04.373924] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-15T20:07:04.375346] [DEBUG] [LOCAL ] MET: Trimmed 77329 records to 53316 (keeping 200 days of data) [2025-10-15T20:07:04.682152] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T20:07:04.705051] [DEBUG] [LOCAL ] MET: Primary data saved (53316 records). [2025-10-15T20:07:04.705153] [INFO ] [MAIN ] MET: Full history saved. [2025-10-15T20:07:04.706132] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MET took 36.0s. Estimated remaining: 2h 26m 20s. Rate: 7.1 symbols/min [2025-10-15T20:07:04.869047] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:04.917112] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-15T20:07:04.919034] [DEBUG] [LOCAL ] MFC: Loaded 51097 existing records from primary storage. [2025-10-15T20:07:04.919355] [INFO ] [MAIN ] MFC: Loaded 51097 existing records. [2025-10-15T20:07:05.093766] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:07:05.093976] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-15T20:07:05.094023] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-15T20:07:05.094997] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-15T20:07:05.095054] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-15T20:07:05.452984] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:05.447803] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T20:07:05.714006] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-15T20:07:06.514042] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-15T20:07:07.171028] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T20:07:07.323418] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-15T20:07:07.343091] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T20:07:08.114051] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-15T20:07:08.706040] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T20:07:08.885391] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T20:07:08.913979] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-15T20:07:09.714024] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-15T20:07:10.508740] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T20:07:10.518538] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-15T20:07:11.064321] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T20:07:11.152276] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T20:07:11.314005] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-15T20:07:12.114044] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-15T20:07:12.784124] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T20:07:12.815487] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T20:07:12.913984] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-15T20:07:13.714067] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-15T20:07:14.133176] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T20:07:14.526453] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-15T20:07:14.534202] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T20:07:15.314081] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-15T20:07:15.763704] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T20:07:16.113976] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-15T20:07:16.223165] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T20:07:16.914055] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-15T20:07:17.714006] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-15T20:07:17.886793] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T20:07:18.100467] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T20:07:18.277048] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T20:07:18.514018] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-15T20:07:19.314002] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-15T20:07:20.113982] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-15T20:07:20.235407] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T20:07:20.445030] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T20:07:20.914032] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-15T20:07:21.064863] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T20:07:21.458727] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T20:07:21.714063] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-15T20:07:22.126175] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T20:07:22.127705] [INFO ] [REMOTE ] MFAN: Full fetch complete (5899 records). [2025-10-15T20:07:22.127803] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-15T20:07:22.522197] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-15T20:07:22.516670] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-15T20:07:22.523063] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-15T20:07:22.523247] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-15T20:07:22.523292] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-15T20:07:22.523707] [DEBUG] [LOCAL ] MFAN: Trimmed 5899 records to 4377 (keeping 200 days of data) [2025-10-15T20:07:22.553950] [DEBUG] [LOCAL ] MFAN: Primary data saved (4377 records). [2025-10-15T20:07:22.554105] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-15T20:07:22.554284] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MFAN took 30.4s. Estimated remaining: 2h 26m 19s. Rate: 7.1 symbols/min [2025-10-15T20:07:22.718091] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:22.759248] [DEBUG] [LOCAL ] MFG: Loaded 49518 existing records from primary storage. [2025-10-15T20:07:22.759557] [INFO ] [MAIN ] MFG: Loaded 49518 existing records. [2025-10-15T20:07:22.948045] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:07:22.948279] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-15T20:07:22.948331] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-15T20:07:22.949295] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-15T20:07:22.949360] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-15T20:07:23.293137] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:23.313951] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-15T20:07:24.114002] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-15T20:07:24.319213] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T20:07:24.565665] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T20:07:24.796204] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T20:07:24.914013] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-15T20:07:25.713997] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-15T20:07:26.379163] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T20:07:26.514003] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-15T20:07:27.014807] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T20:07:27.016002] [INFO ] [REMOTE ] MFAO: Full fetch complete (5446 records). [2025-10-15T20:07:27.016073] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-15T20:07:27.317376] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-15T20:07:27.391580] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-15T20:07:27.391809] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-15T20:07:27.392119] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-15T20:07:27.392195] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-15T20:07:27.392875] [DEBUG] [LOCAL ] MFAO: Trimmed 5446 records to 3980 (keeping 200 days of data) [2025-10-15T20:07:27.421933] [DEBUG] [LOCAL ] MFAO: Primary data saved (3980 records). [2025-10-15T20:07:27.422043] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-15T20:07:27.422127] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MFAO took 33.9s. Estimated remaining: 2h 26m 8s. Rate: 7.1 symbols/min [2025-10-15T20:07:27.595728] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T20:07:27.629782] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:27.643899] [DEBUG] [LOCAL ] MFM: Loaded 14624 existing records from primary storage. [2025-10-15T20:07:27.644118] [INFO ] [MAIN ] MFM: Loaded 14624 existing records. [2025-10-15T20:07:27.815552] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:07:27.815799] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-15T20:07:27.815848] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-15T20:07:27.816200] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-15T20:07:27.816258] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-15T20:07:28.121370] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-15T20:07:28.162413] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:28.921666] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-15T20:07:28.940092] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T20:07:29.714200] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-15T20:07:29.717258] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T20:07:29.824331] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T20:07:30.514009] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-15T20:07:31.131719] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T20:07:31.152967] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T20:07:31.313991] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-15T20:07:32.113982] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-15T20:07:32.914029] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-15T20:07:32.987287] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T20:07:33.603258] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T20:07:33.713957] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-15T20:07:33.835133] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T20:07:34.514008] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-15T20:07:35.320164] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-15T20:07:35.325472] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T20:07:35.971545] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T20:07:36.113990] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-15T20:07:36.913982] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-15T20:07:37.032522] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T20:07:37.714027] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-15T20:07:37.892847] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T20:07:37.942368] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T20:07:37.948683] [INFO ] [REMOTE ] MFC: Full fetch complete (74390 records). [2025-10-15T20:07:37.948835] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-15T20:07:38.337398] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-15T20:07:38.337479] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-15T20:07:38.338683] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-15T20:07:38.338748] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-15T20:07:38.340169] [DEBUG] [LOCAL ] MFC: Trimmed 74390 records to 51094 (keeping 200 days of data) [2025-10-15T20:07:38.529077] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-15T20:07:38.667162] [DEBUG] [LOCAL ] MFC: Primary data saved (51094 records). [2025-10-15T20:07:38.667308] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-15T20:07:38.668322] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MFC took 34.0s. Estimated remaining: 2h 26m 2s. Rate: 7.1 symbols/min [2025-10-15T20:07:38.836736] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:38.836895] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-15T20:07:38.836933] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-15T20:07:38.837066] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-15T20:07:38.837134] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-15T20:07:38.837189] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-15T20:07:38.837226] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-15T20:07:39.232735] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:39.235016] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T20:07:39.313969] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-15T20:07:39.564761] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T20:07:39.648837] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T20:07:40.113985] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-15T20:07:40.914037] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-15T20:07:41.217124] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-15T20:07:41.723616] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-15T20:07:41.729594] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T20:07:42.513969] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-15T20:07:43.280318] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T20:07:43.286616] [INFO ] [REMOTE ] MFA: Full fetch complete (65424 records). [2025-10-15T20:07:43.286811] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-15T20:07:43.321231] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-15T20:07:43.705625] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-15T20:07:43.705781] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-15T20:07:43.707882] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-15T20:07:43.707955] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-15T20:07:43.709911] [DEBUG] [LOCAL ] MFA: Trimmed 65424 records to 45762 (keeping 200 days of data) [2025-10-15T20:07:44.012737] [DEBUG] [LOCAL ] MFA: Primary data saved (45762 records). [2025-10-15T20:07:44.012944] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-15T20:07:44.013070] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MFA took 55.5s. Estimated remaining: 2h 25m 51s. Rate: 7.1 symbols/min [2025-10-15T20:07:44.120402] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-15T20:07:44.130505] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T20:07:44.205046] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:44.214594] [DEBUG] [LOCAL ] MFSG: Loaded 5709 existing records from primary storage. [2025-10-15T20:07:44.214864] [INFO ] [MAIN ] MFSG: Loaded 5709 existing records. [2025-10-15T20:07:44.421719] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-15T20:07:44.421482] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:07:44.426487] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-15T20:07:44.426749] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-15T20:07:44.428498] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T20:07:44.428546] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-15T20:07:44.438357] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-15T20:07:44.784536] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:44.913983] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-15T20:07:45.228743] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-15T20:07:45.713991] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-15T20:07:46.009964] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-15T20:07:46.514079] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-15T20:07:46.932450] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T20:07:47.314062] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-15T20:07:48.114060] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-15T20:07:48.765834] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T20:07:48.914057] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-15T20:07:49.061232] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T20:07:49.714058] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-15T20:07:49.846171] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T20:07:50.514078] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-15T20:07:51.268820] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T20:07:51.313990] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-15T20:07:51.406223] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T20:07:51.413023] [INFO ] [REMOTE ] MFG: Full fetch complete (69534 records). [2025-10-15T20:07:51.413223] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-15T20:07:51.819866] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-15T20:07:51.819997] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-15T20:07:51.821289] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-15T20:07:51.821360] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-15T20:07:51.822931] [DEBUG] [LOCAL ] MFG: Trimmed 69534 records to 49508 (keeping 200 days of data) [2025-10-15T20:07:51.952504] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T20:07:52.113987] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-15T20:07:52.119530] [DEBUG] [LOCAL ] MFG: Primary data saved (49508 records). [2025-10-15T20:07:52.120561] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-15T20:07:52.121056] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFG took 29.6s. Estimated remaining: 2h 25m 42s. Rate: 7.1 symbols/min [2025-10-15T20:07:52.293991] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:52.306583] [DEBUG] [LOCAL ] MFSI: Loaded 12037 existing records from primary storage. [2025-10-15T20:07:52.306834] [INFO ] [MAIN ] MFSI: Loaded 12037 existing records. [2025-10-15T20:07:52.480533] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:07:52.480780] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-15T20:07:52.480853] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-15T20:07:52.481158] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-15T20:07:52.481199] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-15T20:07:52.833491] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:52.914051] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-15T20:07:52.978455] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T20:07:52.980682] [INFO ] [REMOTE ] MFM: Full fetch complete (19401 records). [2025-10-15T20:07:52.980762] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-15T20:07:53.339590] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-15T20:07:53.339686] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-15T20:07:53.340102] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-15T20:07:53.340142] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-15T20:07:53.340690] [DEBUG] [LOCAL ] MFM: Trimmed 19401 records to 14602 (keeping 200 days of data) [2025-10-15T20:07:53.427059] [DEBUG] [LOCAL ] MFM: Primary data saved (14602 records). [2025-10-15T20:07:53.427195] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-15T20:07:53.427274] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MFM took 26.0s. Estimated remaining: 2h 25m 28s. Rate: 7.1 symbols/min [2025-10-15T20:07:53.501435] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T20:07:53.643383] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:07:53.648989] [DEBUG] [LOCAL ] MFSV: Loaded 2793 existing records from primary storage. [2025-10-15T20:07:53.649209] [INFO ] [MAIN ] MFSV: Loaded 2793 existing records. [2025-10-15T20:07:53.719132] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-15T20:07:53.838985] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:07:53.839276] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-15T20:07:53.840083] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-15T20:07:53.840289] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-15T20:07:53.840347] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-15T20:07:54.191331] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:07:54.330256] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T20:07:54.514012] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-15T20:07:55.067848] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T20:07:55.313992] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-15T20:07:55.922225] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T20:07:56.114045] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-15T20:07:56.519307] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-15T20:07:56.914035] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-15T20:07:57.240087] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T20:07:57.713995] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-15T20:07:58.029687] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-15T20:07:58.514043] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-15T20:07:58.944828] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T20:07:59.314020] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-15T20:07:59.749730] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-15T20:08:00.114075] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-15T20:08:00.543423] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T20:08:00.914068] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-15T20:08:01.647591] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T20:08:01.714012] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-15T20:08:02.264258] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T20:08:02.514013] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-15T20:08:02.931669] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T20:08:03.314008] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-15T20:08:03.557503] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-15T20:08:04.114041] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-15T20:08:04.431636] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T20:08:04.914011] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-15T20:08:05.705436] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T20:08:05.714050] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-15T20:08:06.310079] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T20:08:06.514011] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-15T20:08:06.923481] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T20:08:07.314000] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-15T20:08:08.055266] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T20:08:08.114001] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-15T20:08:08.711894] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T20:08:08.914055] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-15T20:08:09.327514] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T20:08:09.714005] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-15T20:08:10.057991] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T20:08:10.514058] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-15T20:08:10.946252] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T20:08:11.314001] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-15T20:08:12.010259] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T20:08:12.113999] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-15T20:08:12.827358] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T20:08:12.913998] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-15T20:08:13.344619] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T20:08:13.714055] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-15T20:08:14.146241] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T20:08:14.514035] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-15T20:08:15.068138] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T20:08:15.313992] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-15T20:08:15.918563] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T20:08:16.114020] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-15T20:08:16.914060] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-15T20:08:17.012252] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:08:17.583966] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T20:08:17.585185] [INFO ] [REMOTE ] MFSV: Full fetch complete (3513 records). [2025-10-15T20:08:17.585258] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-15T20:08:17.721366] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-15T20:08:17.942748] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-15T20:08:17.942858] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-15T20:08:17.942997] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-15T20:08:17.943049] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-15T20:08:17.943471] [DEBUG] [LOCAL ] MFSV: Trimmed 3513 records to 2827 (keeping 200 days of data) [2025-10-15T20:08:17.960793] [DEBUG] [LOCAL ] MFSV: Primary data saved (2827 records). [2025-10-15T20:08:17.960944] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-15T20:08:17.961067] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFSV took 24.5s. Estimated remaining: 2h 25m 32s. Rate: 7.1 symbols/min [2025-10-15T20:08:18.128965] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:08:18.143575] [DEBUG] [LOCAL ] MG: Loaded 15911 existing records from primary storage. [2025-10-15T20:08:18.143824] [INFO ] [MAIN ] MG: Loaded 15911 existing records. [2025-10-15T20:08:18.317487] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:08:18.317750] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-15T20:08:18.317828] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-15T20:08:18.318146] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-15T20:08:18.318203] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-15T20:08:18.519123] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-15T20:08:18.686909] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:08:18.734256] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T20:08:18.735817] [INFO ] [REMOTE ] MFSG: Full fetch complete (6570 records). [2025-10-15T20:08:18.735897] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-15T20:08:19.012466] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T20:08:19.114859] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-15T20:08:19.114927] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-15T20:08:19.115122] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-15T20:08:19.115162] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-15T20:08:19.115549] [DEBUG] [LOCAL ] MFSG: Trimmed 6570 records to 5774 (keeping 200 days of data) [2025-10-15T20:08:19.149535] [DEBUG] [LOCAL ] MFSG: Primary data saved (5774 records). [2025-10-15T20:08:19.149628] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-15T20:08:19.149738] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFSG took 35.1s. Estimated remaining: 2h 25m 18s. Rate: 7.1 symbols/min [2025-10-15T20:08:19.323773] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-15T20:08:19.327902] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:08:19.378094] [DEBUG] [LOCAL ] MGA: Loaded 50617 existing records from primary storage. [2025-10-15T20:08:19.378479] [INFO ] [MAIN ] MGA: Loaded 50617 existing records. [2025-10-15T20:08:19.559486] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:08:19.559745] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-15T20:08:19.559799] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-15T20:08:19.560798] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-15T20:08:19.560856] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-15T20:08:19.919904] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:08:20.116819] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-15T20:08:20.119132] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T20:08:20.679056] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T20:08:20.913992] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-15T20:08:21.542511] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:08:21.543589] [INFO ] [REMOTE ] MFSB: Full fetch complete (1863 records). [2025-10-15T20:08:21.543694] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-15T20:08:21.721817] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-15T20:08:21.721717] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-15T20:08:21.722194] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:08:21.722895] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:08:21.722986] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-15T20:08:21.723049] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-15T20:08:21.723087] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-15T20:08:21.723131] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-15T20:08:21.723187] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFSB took 43.1s. Estimated remaining: 2h 25m 5s. Rate: 7.1 symbols/min [2025-10-15T20:08:21.895136] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:08:21.902142] [DEBUG] [LOCAL ] MGF: Loaded 4261 existing records from primary storage. [2025-10-15T20:08:21.902351] [INFO ] [MAIN ] MGF: Loaded 4261 existing records. [2025-10-15T20:08:22.075499] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:08:22.075739] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-15T20:08:22.075791] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-15T20:08:22.075984] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-15T20:08:22.076043] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-15T20:08:22.435034] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:08:22.513959] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-15T20:08:23.152595] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T20:08:23.313970] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-15T20:08:24.082379] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-15T20:08:24.104229] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T20:08:24.113950] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-15T20:08:24.785969] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T20:08:24.913977] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-15T20:08:25.713988] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-15T20:08:26.519176] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-15T20:08:26.534716] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T20:08:26.642489] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T20:08:26.867193] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-15T20:08:27.314030] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-15T20:08:28.113989] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-15T20:08:28.656912] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T20:08:28.831015] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T20:08:28.914020] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-15T20:08:29.714001] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-15T20:08:29.892495] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T20:08:30.270731] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T20:08:30.514024] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-15T20:08:31.314012] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-15T20:08:31.523530] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T20:08:32.113992] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-15T20:08:32.307411] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T20:08:32.881545] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T20:08:32.914017] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-15T20:08:33.713994] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-15T20:08:34.406840] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T20:08:34.513966] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-15T20:08:34.583680] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T20:08:34.585908] [INFO ] [REMOTE ] MFSI: Full fetch complete (14501 records). [2025-10-15T20:08:34.585979] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-15T20:08:34.939696] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-15T20:08:34.939821] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-15T20:08:34.940147] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-15T20:08:34.940187] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-15T20:08:34.940702] [DEBUG] [LOCAL ] MFSI: Trimmed 14501 records to 12132 (keeping 200 days of data) [2025-10-15T20:08:35.018352] [DEBUG] [LOCAL ] MFSI: Primary data saved (12132 records). [2025-10-15T20:08:35.018541] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-15T20:08:35.018704] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFSI took 42.9s. Estimated remaining: 2h 25m 0s. Rate: 7.1 symbols/min [2025-10-15T20:08:35.189000] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:08:35.237833] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-15T20:08:35.238159] [INFO ] [MAIN ] MGM: Loaded 53607 existing records. [2025-10-15T20:08:35.319192] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-15T20:08:35.417939] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:08:35.418176] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-15T20:08:35.418223] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-15T20:08:35.419219] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-15T20:08:35.419280] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-15T20:08:35.773891] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:08:35.961204] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T20:08:36.114037] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-15T20:08:36.145777] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T20:08:36.913975] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-15T20:08:37.713971] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-15T20:08:37.922107] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T20:08:38.358234] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T20:08:38.526887] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-15T20:08:38.533138] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T20:08:39.314066] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-15T20:08:39.408634] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T20:08:40.114030] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-15T20:08:40.913990] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-15T20:08:41.177543] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T20:08:41.391274] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T20:08:41.675088] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T20:08:41.713967] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-15T20:08:42.513986] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-15T20:08:42.571485] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T20:08:42.973741] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T20:08:43.314008] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-15T20:08:43.916420] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T20:08:44.113984] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-15T20:08:44.629215] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T20:08:44.914030] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-15T20:08:45.492756] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T20:08:45.714050] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-15T20:08:46.185954] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T20:08:46.514007] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-15T20:08:47.314024] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-15T20:08:47.897095] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:08:47.898534] [INFO ] [REMOTE ] MGF: Full fetch complete (5863 records). [2025-10-15T20:08:47.898630] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-15T20:08:48.122298] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-15T20:08:48.283798] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-15T20:08:48.283897] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-15T20:08:48.284083] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-15T20:08:48.284160] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-15T20:08:48.294516] [DEBUG] [LOCAL ] MGF: Trimmed 5863 records to 4154 (keeping 200 days of data) [2025-10-15T20:08:48.324625] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T20:08:48.348271] [DEBUG] [LOCAL ] MGF: Primary data saved (4154 records). [2025-10-15T20:08:48.348380] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-15T20:08:48.348455] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MGF took 26.6s. Estimated remaining: 2h 24m 56s. Rate: 7.1 symbols/min [2025-10-15T20:08:48.513431] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:08:48.520459] [DEBUG] [LOCAL ] MGR: Loaded 5625 existing records from primary storage. [2025-10-15T20:08:48.520709] [INFO ] [MAIN ] MGR: Loaded 5625 existing records. [2025-10-15T20:08:48.706801] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:08:48.707036] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-15T20:08:48.707083] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-15T20:08:48.707324] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-15T20:08:48.707380] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-15T20:08:48.919200] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-15T20:08:49.053038] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T20:08:49.074085] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:08:49.074360] [INFO ] [REMOTE ] MG: Full fetch complete (23601 records). [2025-10-15T20:08:49.074697] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-15T20:08:49.430304] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-15T20:08:49.430378] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-15T20:08:49.430866] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-15T20:08:49.430926] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-15T20:08:49.431484] [DEBUG] [LOCAL ] MG: Trimmed 23601 records to 15861 (keeping 200 days of data) [2025-10-15T20:08:49.518090] [DEBUG] [LOCAL ] MG: Primary data saved (15861 records). [2025-10-15T20:08:49.518223] [INFO ] [MAIN ] MG: Full history saved. [2025-10-15T20:08:49.518301] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MG took 31.6s. Estimated remaining: 2h 24m 42s. Rate: 7.1 symbols/min [2025-10-15T20:08:49.683079] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:08:49.688604] [DEBUG] [LOCAL ] MGRB: Loaded 4036 existing records from primary storage. [2025-10-15T20:08:49.688849] [INFO ] [MAIN ] MGRB: Loaded 4036 existing records. [2025-10-15T20:08:49.719220] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-15T20:08:49.870800] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:08:49.871011] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-15T20:08:49.871059] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-15T20:08:49.871281] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-15T20:08:49.871338] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-15T20:08:50.254603] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:08:50.513268] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T20:08:50.517007] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-15T20:08:51.060208] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T20:08:51.297280] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T20:08:51.313990] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-15T20:08:51.818781] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-15T20:08:52.113992] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-15T20:08:52.670062] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T20:08:52.914062] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-15T20:08:53.424872] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T20:08:53.714018] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-15T20:08:54.342529] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T20:08:54.513991] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-15T20:08:55.221219] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T20:08:55.314043] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-15T20:08:56.114065] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-15T20:08:56.913993] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-15T20:08:56.954869] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T20:08:57.488519] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T20:08:57.713995] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-15T20:08:57.897490] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T20:08:58.514041] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-15T20:08:59.079628] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T20:08:59.313976] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-15T20:08:59.398085] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T20:08:59.404457] [INFO ] [REMOTE ] MGA: Full fetch complete (73782 records). [2025-10-15T20:08:59.404606] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-15T20:08:59.796738] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-15T20:08:59.796887] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-15T20:08:59.797985] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-15T20:08:59.798051] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-15T20:08:59.799631] [DEBUG] [LOCAL ] MGA: Trimmed 73782 records to 50591 (keeping 200 days of data) [2025-10-15T20:08:59.893261] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T20:09:00.117167] [DEBUG] [LOCAL ] MGA: Primary data saved (50591 records). [2025-10-15T20:09:00.117362] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-15T20:09:00.117534] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-15T20:09:00.118473] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MGA took 41.0s. Estimated remaining: 2h 24m 35s. Rate: 7.1 symbols/min [2025-10-15T20:09:00.291479] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:00.295464] [DEBUG] [LOCAL ] MGRD: Loaded 2221 existing records from primary storage. [2025-10-15T20:09:00.295632] [INFO ] [MAIN ] MGRD: Loaded 2221 existing records. [2025-10-15T20:09:00.473633] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:09:00.473882] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-15T20:09:00.473932] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-15T20:09:00.474115] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-15T20:09:00.474174] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-15T20:09:00.842230] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:00.914039] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-15T20:09:01.601629] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T20:09:01.713983] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-15T20:09:02.049834] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T20:09:02.100885] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T20:09:02.514116] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-15T20:09:03.123256] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T20:09:03.314052] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-15T20:09:03.757155] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T20:09:04.113977] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-15T20:09:04.913987] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-15T20:09:05.646882] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T20:09:05.714017] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-15T20:09:06.036636] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T20:09:06.315943] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T20:09:06.514088] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-15T20:09:07.058433] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T20:09:07.314018] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-15T20:09:08.114016] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-15T20:09:08.568182] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T20:09:08.919752] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-15T20:09:08.926145] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T20:09:09.680944] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:09:09.682268] [INFO ] [REMOTE ] MGR: Full fetch complete (8011 records). [2025-10-15T20:09:09.682348] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-15T20:09:09.719187] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-15T20:09:10.061742] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-15T20:09:10.061853] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-15T20:09:10.062216] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-15T20:09:10.062295] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-15T20:09:10.063071] [DEBUG] [LOCAL ] MGR: Trimmed 8011 records to 5619 (keeping 200 days of data) [2025-10-15T20:09:10.102411] [DEBUG] [LOCAL ] MGR: Primary data saved (5619 records). [2025-10-15T20:09:10.102523] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-15T20:09:10.102602] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MGR took 21.8s. Estimated remaining: 2h 24m 28s. Rate: 7.1 symbols/min [2025-10-15T20:09:10.273894] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:10.282149] [DEBUG] [LOCAL ] MGRE: Loaded 6639 existing records from primary storage. [2025-10-15T20:09:10.282383] [INFO ] [MAIN ] MGRE: Loaded 6639 existing records. [2025-10-15T20:09:10.460519] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:09:10.461008] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-15T20:09:10.461117] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-15T20:09:10.468019] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-15T20:09:10.468102] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-15T20:09:10.468376] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T20:09:10.522828] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-15T20:09:10.820449] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:11.314014] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-15T20:09:11.927060] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T20:09:12.114002] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-15T20:09:12.384632] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T20:09:12.657742] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T20:09:12.914015] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-15T20:09:13.610080] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T20:09:13.713969] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-15T20:09:14.513994] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-15T20:09:15.173961] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T20:09:15.314020] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-15T20:09:15.682176] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T20:09:15.883251] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T20:09:16.114028] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-15T20:09:16.671116] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T20:09:16.914157] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-15T20:09:17.681848] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:09:17.714008] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-15T20:09:18.378311] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T20:09:18.514075] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-15T20:09:19.313991] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-15T20:09:19.830414] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T20:09:20.114026] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-15T20:09:20.261699] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T20:09:20.677541] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T20:09:20.914145] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-15T20:09:21.354029] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T20:09:21.713985] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-15T20:09:22.451965] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:09:22.458363] [INFO ] [REMOTE ] MGM: Full fetch complete (77755 records). [2025-10-15T20:09:22.458508] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-15T20:09:22.519561] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-15T20:09:22.848386] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-15T20:09:22.848474] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-15T20:09:22.849560] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-15T20:09:22.849628] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-15T20:09:22.851176] [DEBUG] [LOCAL ] MGM: Trimmed 77755 records to 53607 (keeping 200 days of data) [2025-10-15T20:09:23.131909] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T20:09:23.175516] [DEBUG] [LOCAL ] MGM: Primary data saved (53607 records). [2025-10-15T20:09:23.175677] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-15T20:09:23.175999] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MGM took 48.2s. Estimated remaining: 2h 24m 23s. Rate: 7.1 symbols/min [2025-10-15T20:09:23.319550] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-15T20:09:23.345428] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:23.393347] [DEBUG] [LOCAL ] MGY: Loaded 52419 existing records from primary storage. [2025-10-15T20:09:23.393709] [INFO ] [MAIN ] MGY: Loaded 52419 existing records. [2025-10-15T20:09:23.575729] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:09:23.576148] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-15T20:09:23.576200] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-15T20:09:23.577330] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-15T20:09:23.577401] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-15T20:09:23.874071] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T20:09:23.943807] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:24.113994] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-15T20:09:24.913989] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-15T20:09:25.441410] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T20:09:25.702403] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T20:09:25.713962] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-15T20:09:26.253315] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T20:09:26.254205] [INFO ] [REMOTE ] MGRB: Full fetch complete (5736 records). [2025-10-15T20:09:26.254273] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-15T20:09:26.519083] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-15T20:09:26.615975] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-15T20:09:26.616050] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-15T20:09:26.616227] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-15T20:09:26.616266] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-15T20:09:26.616631] [DEBUG] [LOCAL ] MGRB: Trimmed 5736 records to 4034 (keeping 200 days of data) [2025-10-15T20:09:26.642802] [DEBUG] [LOCAL ] MGRB: Primary data saved (4034 records). [2025-10-15T20:09:26.642905] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-15T20:09:26.642978] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGRB took 37.1s. Estimated remaining: 2h 24m 10s. Rate: 7.1 symbols/min [2025-10-15T20:09:26.808945] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:26.809126] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-15T20:09:26.809163] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-15T20:09:26.809269] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-15T20:09:26.809310] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-15T20:09:26.809353] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-15T20:09:26.809385] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-15T20:09:27.169307] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:27.276689] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T20:09:27.313949] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-15T20:09:27.990021] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T20:09:28.113979] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-15T20:09:28.318794] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:09:28.319065] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-15T20:09:28.319151] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:09:28.319201] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-15T20:09:28.319259] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:09:28.319330] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-15T20:09:28.319407] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-15T20:09:28.319443] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-15T20:09:28.319480] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-15T20:09:28.319525] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MH took 1.7s. Estimated remaining: 2h 23m 57s. Rate: 7.1 symbols/min [2025-10-15T20:09:28.486156] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:28.498870] [DEBUG] [LOCAL ] MHD: Loaded 12325 existing records from primary storage. [2025-10-15T20:09:28.499108] [INFO ] [MAIN ] MHD: Loaded 12325 existing records. [2025-10-15T20:09:28.672691] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:09:28.672917] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-15T20:09:28.672964] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-15T20:09:28.673310] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-15T20:09:28.673365] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-15T20:09:28.919209] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-15T20:09:29.024530] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:29.666682] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T20:09:29.714001] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-15T20:09:30.078895] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T20:09:30.514027] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-15T20:09:31.314013] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-15T20:09:31.468543] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T20:09:31.954001] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T20:09:31.955163] [INFO ] [REMOTE ] MGRE: Full fetch complete (9333 records). [2025-10-15T20:09:31.955232] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-15T20:09:32.119068] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-15T20:09:32.345991] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-15T20:09:32.346296] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-15T20:09:32.346531] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-15T20:09:32.346572] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-15T20:09:32.347016] [DEBUG] [LOCAL ] MGRE: Trimmed 9333 records to 6560 (keeping 200 days of data) [2025-10-15T20:09:32.387191] [DEBUG] [LOCAL ] MGRE: Primary data saved (6560 records). [2025-10-15T20:09:32.387310] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-15T20:09:32.387388] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGRE took 22.3s. Estimated remaining: 2h 23m 45s. Rate: 7.1 symbols/min [2025-10-15T20:09:32.561616] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:32.570965] [DEBUG] [LOCAL ] MHF: Loaded 8845 existing records from primary storage. [2025-10-15T20:09:32.571168] [INFO ] [MAIN ] MHF: Loaded 8845 existing records. [2025-10-15T20:09:32.752868] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:09:32.753065] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-15T20:09:32.753112] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-15T20:09:32.753569] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-15T20:09:32.753675] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-15T20:09:32.928559] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-15T20:09:33.116168] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:33.651705] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T20:09:33.713954] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-15T20:09:33.923967] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T20:09:34.514001] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-15T20:09:35.319133] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-15T20:09:35.339729] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T20:09:35.361931] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T20:09:36.093824] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T20:09:36.114017] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-15T20:09:36.491733] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-15T20:09:36.914066] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-15T20:09:37.664044] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T20:09:37.714000] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-15T20:09:38.447681] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T20:09:38.514022] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-15T20:09:39.066958] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T20:09:39.314015] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-15T20:09:39.759794] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T20:09:40.113979] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-15T20:09:40.914011] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-15T20:09:41.677143] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T20:09:41.711434] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T20:09:41.714318] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-15T20:09:42.172554] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T20:09:42.514007] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-15T20:09:42.940634] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T20:09:43.314007] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-15T20:09:44.114016] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-15T20:09:44.913979] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-15T20:09:45.081053] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T20:09:45.079224] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T20:09:45.496861] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:09:45.497841] [INFO ] [REMOTE ] MGRD: Full fetch complete (3516 records). [2025-10-15T20:09:45.497918] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-15T20:09:45.719237] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-15T20:09:45.887321] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-15T20:09:45.887400] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-15T20:09:45.887520] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-15T20:09:45.887580] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-15T20:09:45.887980] [DEBUG] [LOCAL ] MGRD: Trimmed 3516 records to 2232 (keeping 200 days of data) [2025-10-15T20:09:45.903199] [DEBUG] [LOCAL ] MGRD: Primary data saved (2232 records). [2025-10-15T20:09:45.903260] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-15T20:09:45.903327] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGRD took 45.8s. Estimated remaining: 2h 23m 40s. Rate: 7.1 symbols/min [2025-10-15T20:09:46.074442] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:46.114027] [DEBUG] [LOCAL ] MHK: Loaded 42126 existing records from primary storage. [2025-10-15T20:09:46.114324] [INFO ] [MAIN ] MHK: Loaded 42126 existing records. [2025-10-15T20:09:46.310602] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:09:46.310814] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-15T20:09:46.310872] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-15T20:09:46.311618] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-15T20:09:46.311715] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-15T20:09:46.519125] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-15T20:09:46.702861] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:09:46.732335] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T20:09:47.314067] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-15T20:09:47.359327] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T20:09:48.102425] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T20:09:48.113970] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-15T20:09:48.914010] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-15T20:09:49.395175] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T20:09:49.586874] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T20:09:49.714015] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-15T20:09:50.514050] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-15T20:09:51.124726] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T20:09:51.314006] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-15T20:09:52.032630] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T20:09:52.120564] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-15T20:09:52.122760] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T20:09:52.913996] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-15T20:09:53.722233] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-15T20:09:53.728404] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T20:09:54.012167] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T20:09:54.348013] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T20:09:54.514017] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-15T20:09:55.314037] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-15T20:09:55.349717] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T20:09:56.113994] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-15T20:09:56.917095] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-15T20:09:56.920353] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T20:09:57.005713] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T20:09:57.369044] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T20:09:57.714030] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-15T20:09:58.465246] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T20:09:58.467107] [INFO ] [REMOTE ] MHD: Full fetch complete (18323 records). [2025-10-15T20:09:58.467177] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-15T20:09:58.519166] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-15T20:09:58.856144] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-15T20:09:58.856242] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-15T20:09:58.856686] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-15T20:09:58.856746] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-15T20:09:58.857286] [DEBUG] [LOCAL ] MHD: Trimmed 18323 records to 12201 (keeping 200 days of data) [2025-10-15T20:09:58.935056] [DEBUG] [LOCAL ] MHD: Primary data saved (12201 records). [2025-10-15T20:09:58.935196] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-15T20:09:58.935294] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MHD took 30.6s. Estimated remaining: 2h 23m 35s. Rate: 7.1 symbols/min [2025-10-15T20:09:59.102857] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:09:59.103038] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-15T20:09:59.103076] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-15T20:09:59.103182] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-15T20:09:59.103223] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-15T20:09:59.103264] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-15T20:09:59.103295] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-15T20:09:59.209431] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T20:09:59.319167] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-15T20:09:59.464412] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:00.113992] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-15T20:10:00.914020] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-15T20:10:01.242262] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T20:10:01.594712] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T20:10:01.677093] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-15T20:10:01.713963] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-15T20:10:02.514030] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-15T20:10:02.938694] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T20:10:03.313989] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-15T20:10:03.674916] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T20:10:03.676488] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T20:10:03.685058] [INFO ] [REMOTE ] MGY: Full fetch complete (75927 records). [2025-10-15T20:10:03.685255] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-15T20:10:04.065021] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-15T20:10:04.065132] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-15T20:10:04.066206] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-15T20:10:04.066275] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-15T20:10:04.067769] [DEBUG] [LOCAL ] MGY: Trimmed 75927 records to 52423 (keeping 200 days of data) [2025-10-15T20:10:04.123871] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-15T20:10:04.395070] [DEBUG] [LOCAL ] MGY: Primary data saved (52423 records). [2025-10-15T20:10:04.395239] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-15T20:10:04.395746] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MGY took 41.2s. Estimated remaining: 2h 23m 25s. Rate: 7.1 symbols/min [2025-10-15T20:10:04.566297] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:04.575584] [DEBUG] [LOCAL ] MHN: Loaded 7527 existing records from primary storage. [2025-10-15T20:10:04.575829] [INFO ] [MAIN ] MHN: Loaded 7527 existing records. [2025-10-15T20:10:04.747973] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:10:04.748174] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-15T20:10:04.748221] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-15T20:10:04.748461] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-15T20:10:04.748518] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-15T20:10:04.919125] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-15T20:10:05.111188] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:05.722223] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-15T20:10:05.726988] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T20:10:05.821569] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T20:10:06.489951] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T20:10:06.513959] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-15T20:10:06.860793] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-15T20:10:07.313994] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-15T20:10:07.642689] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T20:10:08.113993] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-15T20:10:08.914013] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-15T20:10:09.053418] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T20:10:09.055215] [INFO ] [REMOTE ] MHF: Full fetch complete (12793 records). [2025-10-15T20:10:09.055294] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-15T20:10:09.441514] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-15T20:10:09.441601] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-15T20:10:09.441929] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-15T20:10:09.441985] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-15T20:10:09.442432] [DEBUG] [LOCAL ] MHF: Trimmed 12793 records to 8872 (keeping 200 days of data) [2025-10-15T20:10:09.492776] [DEBUG] [LOCAL ] MHF: Primary data saved (8872 records). [2025-10-15T20:10:09.492915] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-15T20:10:09.492994] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MHF took 37.1s. Estimated remaining: 2h 23m 14s. Rate: 7.1 symbols/min [2025-10-15T20:10:09.661325] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:09.683316] [DEBUG] [LOCAL ] MHO: Loaded 23765 existing records from primary storage. [2025-10-15T20:10:09.683599] [INFO ] [MAIN ] MHO: Loaded 23765 existing records. [2025-10-15T20:10:09.719088] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-15T20:10:09.865803] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:10:09.866001] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-15T20:10:09.866048] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-15T20:10:09.866478] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-15T20:10:09.866536] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-15T20:10:10.230879] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:10.470395] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:10:10.512768] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T20:10:10.516054] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-15T20:10:11.313995] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-15T20:10:11.874543] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T20:10:11.876111] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T20:10:12.113998] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-15T20:10:12.914020] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-15T20:10:13.245166] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-15T20:10:13.591780] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T20:10:13.714012] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-15T20:10:13.951318] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-15T20:10:14.514004] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-15T20:10:14.832326] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-15T20:10:15.314050] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-15T20:10:16.114024] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-15T20:10:16.705123] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T20:10:16.793585] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:10:16.914023] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-15T20:10:17.636244] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T20:10:17.714018] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-15T20:10:18.514021] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-15T20:10:18.531990] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T20:10:18.849934] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T20:10:19.314033] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-15T20:10:19.662915] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T20:10:19.663789] [INFO ] [REMOTE ] MHLA: Full fetch complete (1502 records). [2025-10-15T20:10:19.663861] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-15T20:10:19.855343] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-15T20:10:19.855552] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:10:19.855599] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:10:19.855707] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-15T20:10:19.855801] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-15T20:10:19.855845] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-15T20:10:19.855886] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-15T20:10:19.855942] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MHLA took 20.9s. Estimated remaining: 2h 23m 7s. Rate: 7.1 symbols/min [2025-10-15T20:10:20.029314] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:20.029530] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-15T20:10:20.029586] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-15T20:10:20.029722] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-15T20:10:20.029792] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-15T20:10:20.029883] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-15T20:10:20.029926] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-15T20:10:20.119181] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-15T20:10:20.380214] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:20.913998] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-15T20:10:21.520157] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T20:10:21.714028] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-15T20:10:22.458443] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T20:10:22.502157] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T20:10:22.513961] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-15T20:10:22.709595] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:10:22.709922] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-15T20:10:22.709994] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:10:22.710036] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-15T20:10:22.710095] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:10:22.710164] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-15T20:10:22.710224] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-15T20:10:22.710259] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-15T20:10:22.710297] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-15T20:10:22.710343] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MIAX took 2.9s. Estimated remaining: 2h 22m 54s. Rate: 7.1 symbols/min [2025-10-15T20:10:22.876435] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:22.889865] [DEBUG] [LOCAL ] MIN: Loaded 13860 existing records from primary storage. [2025-10-15T20:10:22.890085] [INFO ] [MAIN ] MIN: Loaded 13860 existing records. [2025-10-15T20:10:23.064116] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:10:23.064296] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-15T20:10:23.064343] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-15T20:10:23.064726] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-15T20:10:23.064785] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-15T20:10:23.319234] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-15T20:10:23.416191] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:24.113985] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-15T20:10:24.913997] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-15T20:10:25.112113] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T20:10:25.556873] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T20:10:25.701457] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T20:10:25.713943] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-15T20:10:26.513996] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-15T20:10:27.259831] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T20:10:27.314006] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-15T20:10:27.676291] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T20:10:28.114003] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-15T20:10:28.746120] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T20:10:28.751320] [INFO ] [REMOTE ] MHK: Full fetch complete (61135 records). [2025-10-15T20:10:28.751490] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-15T20:10:28.914518] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-15T20:10:29.160229] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-15T20:10:29.160383] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-15T20:10:29.161361] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-15T20:10:29.161425] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-15T20:10:29.162968] [DEBUG] [LOCAL ] MHK: Trimmed 61135 records to 42138 (keeping 200 days of data) [2025-10-15T20:10:29.407341] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T20:10:29.438547] [DEBUG] [LOCAL ] MHK: Primary data saved (42138 records). [2025-10-15T20:10:29.438683] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-15T20:10:29.438771] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MHK took 43.5s. Estimated remaining: 2h 22m 44s. Rate: 7.1 symbols/min [2025-10-15T20:10:29.605713] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:29.653466] [DEBUG] [LOCAL ] MIR: Loaded 51242 existing records from primary storage. [2025-10-15T20:10:29.653784] [INFO ] [MAIN ] MIR: Loaded 51242 existing records. [2025-10-15T20:10:29.719097] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-15T20:10:29.845179] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:10:29.846121] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T20:10:29.846402] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-15T20:10:29.848618] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-15T20:10:29.849611] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-15T20:10:29.849699] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-15T20:10:30.191196] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:30.514032] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-15T20:10:30.558088] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T20:10:31.314100] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-15T20:10:32.076266] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T20:10:32.114036] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-15T20:10:32.255432] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T20:10:32.693955] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T20:10:32.914005] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-15T20:10:33.714027] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-15T20:10:34.046025] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T20:10:34.360338] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T20:10:34.514067] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-15T20:10:35.307220] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:10:35.308523] [INFO ] [REMOTE ] MHN: Full fetch complete (11565 records). [2025-10-15T20:10:35.308594] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-15T20:10:35.319911] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-15T20:10:35.672933] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-15T20:10:35.673029] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-15T20:10:35.673302] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-15T20:10:35.673342] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-15T20:10:35.673819] [DEBUG] [LOCAL ] MHN: Trimmed 11565 records to 7476 (keeping 200 days of data) [2025-10-15T20:10:35.716738] [DEBUG] [LOCAL ] MHN: Primary data saved (7476 records). [2025-10-15T20:10:35.716847] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-15T20:10:35.716921] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHN took 31.3s. Estimated remaining: 2h 22m 34s. Rate: 7.1 symbols/min [2025-10-15T20:10:35.884260] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:35.884482] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-15T20:10:35.884532] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-15T20:10:35.884637] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-15T20:10:35.884736] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-15T20:10:35.884782] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-15T20:10:35.884815] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-15T20:10:36.118879] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-15T20:10:36.213604] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T20:10:36.248866] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:36.914099] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-15T20:10:37.245638] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T20:10:37.713990] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-15T20:10:38.063418] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T20:10:38.450621] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:10:38.514019] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-15T20:10:39.314065] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-15T20:10:39.618319] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T20:10:40.083697] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:10:40.114031] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-15T20:10:40.914031] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-15T20:10:41.344986] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T20:10:41.714085] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-15T20:10:42.519137] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-15T20:10:42.537245] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T20:10:42.668178] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T20:10:43.096046] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T20:10:43.314065] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-15T20:10:44.114032] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-15T20:10:44.425964] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T20:10:44.424895] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T20:10:44.914019] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-15T20:10:45.345737] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T20:10:45.714064] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-15T20:10:46.513986] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-15T20:10:46.851583] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T20:10:46.854519] [INFO ] [REMOTE ] MHO: Full fetch complete (36661 records). [2025-10-15T20:10:46.854594] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-15T20:10:47.221219] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-15T20:10:47.221292] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-15T20:10:47.221941] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-15T20:10:47.222001] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-15T20:10:47.222796] [DEBUG] [LOCAL ] MHO: Trimmed 36661 records to 23792 (keeping 200 days of data) [2025-10-15T20:10:47.318702] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-15T20:10:47.366108] [DEBUG] [LOCAL ] MHO: Primary data saved (23792 records). [2025-10-15T20:10:47.366244] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-15T20:10:47.366325] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MHO took 37.9s. Estimated remaining: 2h 22m 28s. Rate: 7.1 symbols/min [2025-10-15T20:10:47.530537] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:10:47.534195] [DEBUG] [LOCAL ] MITP: Loaded 2327 existing records from primary storage. [2025-10-15T20:10:47.534333] [INFO ] [MAIN ] MITP: Loaded 2327 existing records. [2025-10-15T20:10:47.707486] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:10:47.707868] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-15T20:10:47.707923] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-15T20:10:47.708099] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-15T20:10:47.708157] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-15T20:10:48.111754] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:10:48.120441] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-15T20:10:48.122141] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T20:10:48.160604] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T20:10:48.651795] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T20:10:48.914035] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-15T20:10:49.540307] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T20:10:49.714052] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-15T20:10:50.245913] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-15T20:10:50.514052] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-15T20:10:51.314040] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-15T20:10:51.618817] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T20:10:51.733701] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T20:10:52.113999] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-15T20:10:52.504677] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-15T20:10:52.913990] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-15T20:10:53.714018] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-15T20:10:54.047710] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T20:10:54.210398] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T20:10:54.514012] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-15T20:10:55.314043] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-15T20:10:55.702379] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T20:10:56.113989] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-15T20:10:56.156025] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T20:10:56.380241] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-15T20:10:56.914007] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-15T20:10:57.331348] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T20:10:57.714035] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-15T20:10:58.514012] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-15T20:10:58.850116] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T20:10:59.314032] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-15T20:10:59.402949] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T20:11:00.114047] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-15T20:11:00.297395] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T20:11:00.728664] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T20:11:00.729449] [INFO ] [REMOTE ] MITN: Full fetch complete (2360 records). [2025-10-15T20:11:00.729516] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-15T20:11:00.915214] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-15T20:11:00.915126] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T20:11:00.916323] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:11:00.916396] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:11:00.916447] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-15T20:11:00.916502] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-15T20:11:00.916556] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-15T20:11:00.916600] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-15T20:11:00.916686] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MITN took 25.2s. Estimated remaining: 2h 22m 24s. Rate: 7.1 symbols/min [2025-10-15T20:11:01.714043] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-15T20:11:01.731517] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T20:11:02.514078] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-15T20:11:03.314000] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-15T20:11:03.571817] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T20:11:03.574924] [INFO ] [REMOTE ] MIN: Full fetch complete (17998 records). [2025-10-15T20:11:03.575054] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-15T20:11:03.691130] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-15T20:11:03.953979] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T20:11:04.043703] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-15T20:11:04.043824] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-15T20:11:04.044482] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-15T20:11:04.044525] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-15T20:11:04.045613] [DEBUG] [LOCAL ] MIN: Trimmed 17998 records to 13871 (keeping 200 days of data) [2025-10-15T20:11:04.116028] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-15T20:11:04.142751] [DEBUG] [LOCAL ] MIN: Primary data saved (13871 records). [2025-10-15T20:11:04.143384] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-15T20:11:04.143498] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MIN took 41.4s. Estimated remaining: 2h 22m 11s. Rate: 7.1 symbols/min [2025-10-15T20:11:04.661244] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T20:11:04.914006] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-15T20:11:05.471400] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T20:11:05.714012] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-15T20:11:06.514032] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-15T20:11:06.917383] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T20:11:07.314034] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-15T20:11:07.388343] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T20:11:07.654359] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T20:11:08.114022] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-15T20:11:08.914087] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-15T20:11:09.315185] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T20:11:09.714043] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-15T20:11:09.924028] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T20:11:10.131309] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-15T20:11:10.514028] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-15T20:11:11.016930] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T20:11:11.017915] [INFO ] [REMOTE ] MITP: Full fetch complete (3270 records). [2025-10-15T20:11:11.018000] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-15T20:11:11.319132] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-15T20:11:11.381905] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-15T20:11:11.382010] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-15T20:11:11.382244] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-15T20:11:11.382292] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-15T20:11:11.382761] [DEBUG] [LOCAL ] MITP: Trimmed 3270 records to 2320 (keeping 200 days of data) [2025-10-15T20:11:11.397847] [DEBUG] [LOCAL ] MITP: Primary data saved (2320 records). [2025-10-15T20:11:11.397951] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-15T20:11:11.398048] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MITP took 24.0s. Estimated remaining: 2h 22m 2s. Rate: 7.1 symbols/min [2025-10-15T20:11:13.287280] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-15T20:11:13.294885] [INFO ] [REMOTE ] MIR: Full fetch complete (73825 records). [2025-10-15T20:11:13.295128] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-15T20:11:13.723501] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-15T20:11:13.723580] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-15T20:11:13.724619] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-15T20:11:13.724707] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-15T20:11:13.726076] [DEBUG] [LOCAL ] MIR: Trimmed 73825 records to 51281 (keeping 200 days of data) [2025-10-15T20:11:14.019672] [DEBUG] [LOCAL ] MIR: Primary data saved (51281 records). [2025-10-15T20:11:14.019820] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-15T20:11:14.019916] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MIR took 44.6s. Estimated remaining: 2h 21m 49s. Rate: 7.1 symbols/min [2025-10-15T20:11:14.657946] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:14.690986] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:14.732492] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:14.779581] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:14.786983] [DEBUG] [LOCAL ] MIY: Loaded 6234 existing records from primary storage. [2025-10-15T20:11:14.787450] [INFO ] [MAIN ] MIY: Loaded 6234 existing records. [2025-10-15T20:11:14.940198] [DEBUG] [LOCAL ] MITT: Loaded 22725 existing records from primary storage. [2025-10-15T20:11:15.005944] [INFO ] [MAIN ] MITT: Loaded 22725 existing records. [2025-10-15T20:11:15.035086] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:15.035963] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-15T20:11:15.041243] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-15T20:11:15.057589] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-15T20:11:15.135602] [DEBUG] [LOCAL ] MKL: Loaded 34026 existing records from primary storage. [2025-10-15T20:11:15.141732] [DEBUG] [LOCAL ] MKC: Loaded 52523 existing records from primary storage. [2025-10-15T20:11:15.089951] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-15T20:11:15.141987] [INFO ] [MAIN ] MKL: Loaded 34026 existing records. [2025-10-15T20:11:15.192711] [INFO ] [MAIN ] MKC: Loaded 52523 existing records. [2025-10-15T20:11:15.538978] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:15.627015] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-15T20:11:15.642490] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-15T20:11:15.727162] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-15T20:11:15.755182] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-15T20:11:15.941706] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:15.965297] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:16.032820] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-15T20:11:16.014303] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-15T20:11:16.033066] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-15T20:11:16.033014] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-15T20:11:16.111619] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-15T20:11:16.101289] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-15T20:11:16.114513] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-15T20:11:16.114635] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-15T20:11:16.146489] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:16.146807] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-15T20:11:16.913606] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:16.976415] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-15T20:11:17.137070] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:17.178813] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-15T20:11:17.178402] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:17.179854] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-15T20:11:17.187739] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:11:17.190365] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-15T20:11:17.956577] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T20:11:17.958446] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-15T20:11:18.200195] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T20:11:18.209579] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-15T20:11:18.400696] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T20:11:18.407491] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-15T20:11:18.548556] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T20:11:18.550245] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-15T20:11:19.096907] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-15T20:11:19.133398] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T20:11:19.291342] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T20:11:19.313996] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-15T20:11:19.546087] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T20:11:20.113994] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-15T20:11:20.913980] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-15T20:11:20.971184] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T20:11:20.995463] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T20:11:21.527445] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T20:11:21.713991] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-15T20:11:22.514006] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-15T20:11:23.141054] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T20:11:23.314005] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-15T20:11:23.570440] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T20:11:23.849463] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T20:11:24.113989] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-15T20:11:24.914013] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-15T20:11:25.714051] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-15T20:11:25.875595] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T20:11:25.924556] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T20:11:26.514069] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-15T20:11:26.788741] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T20:11:27.314038] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-15T20:11:28.032814] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T20:11:28.113989] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-15T20:11:28.331676] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T20:11:28.914034] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-15T20:11:29.422793] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T20:11:29.694834] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T20:11:29.713993] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-15T20:11:30.319146] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T20:11:30.514003] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-15T20:11:31.314048] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-15T20:11:31.442879] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T20:11:32.113998] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-15T20:11:32.541378] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T20:11:32.914036] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-15T20:11:32.949090] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T20:11:33.714101] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-15T20:11:34.514016] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-15T20:11:34.649880] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T20:11:35.102509] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T20:11:35.114278] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T20:11:35.314006] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-15T20:11:35.822853] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T20:11:36.114006] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-15T20:11:36.914028] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-15T20:11:37.579105] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T20:11:37.702326] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:11:37.703884] [INFO ] [REMOTE ] MIY: Full fetch complete (8978 records). [2025-10-15T20:11:37.703953] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-15T20:11:37.719125] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-15T20:11:38.068108] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-15T20:11:38.068179] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-15T20:11:38.068476] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-15T20:11:38.068516] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-15T20:11:38.069145] [DEBUG] [LOCAL ] MIY: Trimmed 8978 records to 6260 (keeping 200 days of data) [2025-10-15T20:11:38.113379] [DEBUG] [LOCAL ] MIY: Primary data saved (6260 records). [2025-10-15T20:11:38.113541] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-15T20:11:38.113684] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MIY took 24.1s. Estimated remaining: 2h 21m 53s. Rate: 7.1 symbols/min [2025-10-15T20:11:38.284372] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:38.322334] [DEBUG] [LOCAL ] MLI: Loaded 43535 existing records from primary storage. [2025-10-15T20:11:38.322675] [INFO ] [MAIN ] MLI: Loaded 43535 existing records. [2025-10-15T20:11:38.520737] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-15T20:11:38.533134] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:38.533399] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-15T20:11:38.533456] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-15T20:11:38.534412] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-15T20:11:38.534471] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-15T20:11:39.009495] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:39.314030] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-15T20:11:39.400831] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T20:11:40.045231] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T20:11:40.113976] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-15T20:11:40.331804] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:11:40.914021] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-15T20:11:41.714008] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-15T20:11:41.967911] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T20:11:42.285296] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T20:11:42.514053] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-15T20:11:42.922455] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T20:11:43.314005] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-15T20:11:43.647541] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T20:11:44.113978] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-15T20:11:44.913994] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-15T20:11:44.979348] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T20:11:45.466459] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T20:11:45.713967] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-15T20:11:46.035005] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T20:11:46.514046] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-15T20:11:46.944603] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T20:11:47.313963] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-15T20:11:47.565723] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T20:11:47.568800] [INFO ] [REMOTE ] MITT: Full fetch complete (34043 records). [2025-10-15T20:11:47.568928] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-15T20:11:47.934902] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-15T20:11:47.934985] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-15T20:11:47.935724] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-15T20:11:47.935786] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-15T20:11:47.936664] [DEBUG] [LOCAL ] MITT: Trimmed 34043 records to 22621 (keeping 200 days of data) [2025-10-15T20:11:48.064614] [DEBUG] [LOCAL ] MITT: Primary data saved (22621 records). [2025-10-15T20:11:48.064760] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-15T20:11:48.064842] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MITT took 34.0s. Estimated remaining: 2h 21m 45s. Rate: 7.1 symbols/min [2025-10-15T20:11:48.119124] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-15T20:11:48.232718] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:48.259268] [DEBUG] [LOCAL ] MLM: Loaded 29280 existing records from primary storage. [2025-10-15T20:11:48.259514] [INFO ] [MAIN ] MLM: Loaded 29280 existing records. [2025-10-15T20:11:48.434444] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:48.434845] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-15T20:11:48.435006] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-15T20:11:48.435615] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-15T20:11:48.435717] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-15T20:11:48.760294] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T20:11:48.818813] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:48.819081] [INFO ] [REMOTE ] MKL: Full fetch complete (49900 records). [2025-10-15T20:11:48.819742] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-15T20:11:48.919491] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-15T20:11:49.225806] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-15T20:11:49.225927] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-15T20:11:49.227305] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-15T20:11:49.227374] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-15T20:11:49.228963] [DEBUG] [LOCAL ] MKL: Trimmed 49900 records to 34067 (keeping 200 days of data) [2025-10-15T20:11:49.465870] [DEBUG] [LOCAL ] MKL: Primary data saved (34067 records). [2025-10-15T20:11:49.466089] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-15T20:11:49.466199] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MKL took 35.4s. Estimated remaining: 2h 21m 32s. Rate: 7.1 symbols/min [2025-10-15T20:11:49.641388] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:49.666906] [DEBUG] [LOCAL ] MLNK: Loaded 26497 existing records from primary storage. [2025-10-15T20:11:49.667196] [INFO ] [MAIN ] MLNK: Loaded 26497 existing records. [2025-10-15T20:11:49.721372] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-15T20:11:49.848429] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:49.848822] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-15T20:11:49.848878] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-15T20:11:49.849518] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-15T20:11:49.849577] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-15T20:11:50.235468] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T20:11:50.238472] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:50.246234] [INFO ] [REMOTE ] MKC: Full fetch complete (75910 records). [2025-10-15T20:11:50.266688] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-15T20:11:50.303787] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T20:11:50.522766] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-15T20:11:50.712216] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-15T20:11:50.712305] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-15T20:11:50.713534] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-15T20:11:50.713602] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-15T20:11:50.715277] [DEBUG] [LOCAL ] MKC: Trimmed 75910 records to 52520 (keeping 200 days of data) [2025-10-15T20:11:51.046538] [DEBUG] [LOCAL ] MKC: Primary data saved (52520 records). [2025-10-15T20:11:51.046705] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-15T20:11:51.046797] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MKC took 37.0s. Estimated remaining: 2h 21m 18s. Rate: 7.1 symbols/min [2025-10-15T20:11:51.203724] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T20:11:51.241019] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:11:51.245328] [DEBUG] [LOCAL ] MLP: Loaded 3066 existing records from primary storage. [2025-10-15T20:11:51.245481] [INFO ] [MAIN ] MLP: Loaded 3066 existing records. [2025-10-15T20:11:51.319063] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-15T20:11:51.422771] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:11:51.423011] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-15T20:11:51.423064] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-15T20:11:51.423250] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-15T20:11:51.423305] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-15T20:11:51.767340] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:11:52.114030] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-15T20:11:52.238375] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T20:11:52.452357] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:11:52.476847] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-15T20:11:52.914023] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-15T20:11:53.579976] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T20:11:53.714036] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-15T20:11:54.196495] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T20:11:54.514032] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-15T20:11:55.314015] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-15T20:11:55.777691] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T20:11:55.825145] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T20:11:56.113991] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-15T20:11:56.914018] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-15T20:11:57.524563] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T20:11:57.714027] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-15T20:11:58.429086] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T20:11:58.514046] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-15T20:11:59.235558] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T20:11:59.313966] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-15T20:12:00.093498] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T20:12:00.113953] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-15T20:12:00.416177] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T20:12:00.914028] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-15T20:12:01.478577] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T20:12:01.603909] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T20:12:01.714059] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-15T20:12:02.514016] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-15T20:12:03.252746] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T20:12:03.313990] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-15T20:12:03.437976] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T20:12:04.114004] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-15T20:12:04.913989] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-15T20:12:04.984577] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T20:12:05.083925] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T20:12:05.268674] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T20:12:05.714006] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-15T20:12:06.514018] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-15T20:12:07.067831] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T20:12:07.202035] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T20:12:07.314001] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-15T20:12:08.113972] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-15T20:12:08.220377] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T20:12:08.653742] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T20:12:08.914012] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-15T20:12:09.297723] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-15T20:12:09.713977] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-15T20:12:10.513966] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-15T20:12:10.750462] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T20:12:11.313989] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-15T20:12:11.921757] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T20:12:12.114010] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-15T20:12:12.844746] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T20:12:12.913971] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-15T20:12:12.963117] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T20:12:13.714009] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-15T20:12:14.261143] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T20:12:14.267235] [INFO ] [REMOTE ] MLI: Full fetch complete (63141 records). [2025-10-15T20:12:14.267391] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-15T20:12:14.519927] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-15T20:12:14.716374] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-15T20:12:14.716519] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-15T20:12:14.717601] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-15T20:12:14.717691] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-15T20:12:14.719037] [DEBUG] [LOCAL ] MLI: Trimmed 63141 records to 43495 (keeping 200 days of data) [2025-10-15T20:12:14.925683] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T20:12:15.010906] [DEBUG] [LOCAL ] MLI: Primary data saved (43495 records). [2025-10-15T20:12:15.011070] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-15T20:12:15.011230] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MLI took 36.9s. Estimated remaining: 2h 21m 21s. Rate: 7.1 symbols/min [2025-10-15T20:12:15.167852] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T20:12:15.185353] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:15.197793] [DEBUG] [LOCAL ] MLR: Loaded 12475 existing records from primary storage. [2025-10-15T20:12:15.198022] [INFO ] [MAIN ] MLR: Loaded 12475 existing records. [2025-10-15T20:12:15.319099] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-15T20:12:15.373811] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:12:15.374041] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-15T20:12:15.374090] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-15T20:12:15.374406] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-15T20:12:15.374465] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-15T20:12:15.752247] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:12:16.048082] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:12:16.049122] [INFO ] [REMOTE ] MLP: Full fetch complete (4454 records). [2025-10-15T20:12:16.049198] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-15T20:12:16.119146] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-15T20:12:16.408077] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-15T20:12:16.408151] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-15T20:12:16.408289] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-15T20:12:16.408326] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-15T20:12:16.408692] [DEBUG] [LOCAL ] MLP: Trimmed 4454 records to 3075 (keeping 200 days of data) [2025-10-15T20:12:16.426065] [DEBUG] [LOCAL ] MLP: Primary data saved (3075 records). [2025-10-15T20:12:16.426128] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-15T20:12:16.426210] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MLP took 25.4s. Estimated remaining: 2h 21m 7s. Rate: 7.1 symbols/min [2025-10-15T20:12:16.594221] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:16.641217] [DEBUG] [LOCAL ] MMC: Loaded 51919 existing records from primary storage. [2025-10-15T20:12:16.641528] [INFO ] [MAIN ] MMC: Loaded 51919 existing records. [2025-10-15T20:12:16.823256] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:12:16.823493] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-15T20:12:16.823541] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-15T20:12:16.824559] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-15T20:12:16.824618] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-15T20:12:16.917813] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-15T20:12:17.205801] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:12:17.235538] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T20:12:17.714010] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-15T20:12:18.257618] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T20:12:18.514002] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-15T20:12:19.314019] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-15T20:12:19.345602] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T20:12:19.446753] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T20:12:20.113995] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-15T20:12:20.739420] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T20:12:20.913991] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-15T20:12:21.436349] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T20:12:21.714014] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-15T20:12:22.251263] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T20:12:22.513984] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-15T20:12:22.874151] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T20:12:23.314024] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-15T20:12:23.347190] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T20:12:24.114025] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-15T20:12:24.888017] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T20:12:24.908470] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T20:12:24.913963] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-15T20:12:25.714005] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-15T20:12:25.812839] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T20:12:26.513987] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-15T20:12:27.313973] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-15T20:12:27.502986] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T20:12:27.620191] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T20:12:28.114055] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-15T20:12:28.879070] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T20:12:28.884591] [INFO ] [REMOTE ] MLNK: Full fetch complete (36971 records). [2025-10-15T20:12:28.884732] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-15T20:12:28.919133] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-15T20:12:29.290231] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-15T20:12:29.290308] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-15T20:12:29.291050] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-15T20:12:29.291111] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-15T20:12:29.292337] [DEBUG] [LOCAL ] MLNK: Trimmed 36971 records to 26767 (keeping 200 days of data) [2025-10-15T20:12:29.455697] [DEBUG] [LOCAL ] MLNK: Primary data saved (26767 records). [2025-10-15T20:12:29.455824] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-15T20:12:29.455903] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MLNK took 40.0s. Estimated remaining: 2h 21m 2s. Rate: 7.1 symbols/min [2025-10-15T20:12:29.636087] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:29.647335] [DEBUG] [LOCAL ] MMD: Loaded 10886 existing records from primary storage. [2025-10-15T20:12:29.647535] [INFO ] [MAIN ] MMD: Loaded 10886 existing records. [2025-10-15T20:12:29.720914] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-15T20:12:29.838363] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:12:29.838788] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-15T20:12:29.838853] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-15T20:12:29.839212] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-15T20:12:29.839268] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-15T20:12:30.117539] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T20:12:30.161793] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T20:12:30.162031] [INFO ] [REMOTE ] MLM: Full fetch complete (45332 records). [2025-10-15T20:12:30.182957] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-15T20:12:30.352085] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:12:30.516052] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-15T20:12:30.631322] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T20:12:30.645887] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-15T20:12:30.646211] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-15T20:12:30.647047] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-15T20:12:30.647108] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-15T20:12:30.648022] [DEBUG] [LOCAL ] MLM: Trimmed 45332 records to 29252 (keeping 200 days of data) [2025-10-15T20:12:30.856480] [DEBUG] [LOCAL ] MLM: Primary data saved (29252 records). [2025-10-15T20:12:30.856696] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-15T20:12:30.856818] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MLM took 42.8s. Estimated remaining: 2h 20m 49s. Rate: 7.1 symbols/min [2025-10-15T20:12:31.033788] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:31.047741] [DEBUG] [LOCAL ] MMI: Loaded 15459 existing records from primary storage. [2025-10-15T20:12:31.048041] [INFO ] [MAIN ] MMI: Loaded 15459 existing records. [2025-10-15T20:12:31.220749] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:12:31.220941] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-15T20:12:31.220990] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-15T20:12:31.221360] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-15T20:12:31.221417] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-15T20:12:31.319455] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-15T20:12:31.575524] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:12:32.113990] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-15T20:12:32.275988] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T20:12:32.358575] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:12:32.832058] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T20:12:32.913984] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-15T20:12:33.720023] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T20:12:33.719169] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-15T20:12:34.514038] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-15T20:12:34.618363] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T20:12:35.260567] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T20:12:35.313986] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-15T20:12:36.073737] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T20:12:36.113952] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-15T20:12:36.914093] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-15T20:12:37.101217] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T20:12:37.393356] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T20:12:37.714035] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-15T20:12:38.514023] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-15T20:12:39.314039] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-15T20:12:39.491436] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T20:12:39.490673] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T20:12:39.955491] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T20:12:40.114091] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-15T20:12:40.914067] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-15T20:12:41.043041] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T20:12:41.714010] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-15T20:12:42.514045] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-15T20:12:42.669609] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T20:12:42.694679] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T20:12:43.077877] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T20:12:43.314001] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-15T20:12:43.988075] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T20:12:44.114050] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-15T20:12:44.914058] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-15T20:12:44.924730] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T20:12:45.714019] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-15T20:12:45.905322] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T20:12:46.401554] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T20:12:46.514012] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-15T20:12:47.242618] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T20:12:47.313964] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-15T20:12:48.114014] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-15T20:12:48.914032] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-15T20:12:48.971411] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T20:12:49.079322] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T20:12:49.713978] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-15T20:12:49.863550] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:12:50.513978] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-15T20:12:50.715817] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T20:12:51.259732] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T20:12:51.313994] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-15T20:12:52.114050] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-15T20:12:52.226336] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T20:12:52.914034] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-15T20:12:53.713985] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-15T20:12:53.767110] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T20:12:53.891399] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T20:12:54.196784] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T20:12:54.514000] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-15T20:12:55.313978] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-15T20:12:55.590835] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T20:12:55.593068] [INFO ] [REMOTE ] MLR: Full fetch complete (18981 records). [2025-10-15T20:12:55.593138] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-15T20:12:55.951354] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-15T20:12:55.951464] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-15T20:12:55.951916] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-15T20:12:55.952481] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-15T20:12:55.953206] [DEBUG] [LOCAL ] MLR: Trimmed 18981 records to 12461 (keeping 200 days of data) [2025-10-15T20:12:56.031896] [DEBUG] [LOCAL ] MLR: Primary data saved (12461 records). [2025-10-15T20:12:56.032039] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-15T20:12:56.032122] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MLR took 41.0s. Estimated remaining: 2h 20m 53s. Rate: 7.1 symbols/min [2025-10-15T20:12:56.120083] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-15T20:12:56.203422] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T20:12:56.225564] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:56.225904] [INFO ] [REMOTE ] MMI: Full fetch complete (21647 records). [2025-10-15T20:12:56.226058] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-15T20:12:56.226131] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-15T20:12:56.226252] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-15T20:12:56.226493] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-15T20:12:56.226627] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-15T20:12:56.244537] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-15T20:12:56.258258] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-15T20:12:56.914406] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-15T20:12:56.997975] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:12:57.045207] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-15T20:12:57.045501] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-15T20:12:57.046937] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-15T20:12:57.047009] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-15T20:12:57.048035] [DEBUG] [LOCAL ] MMI: Trimmed 21647 records to 15512 (keeping 200 days of data) [2025-10-15T20:12:57.121678] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T20:12:57.141736] [INFO ] [REMOTE ] MMD: Full fetch complete (17319 records). [2025-10-15T20:12:57.152189] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-15T20:12:57.152048] [DEBUG] [LOCAL ] MMI: Primary data saved (15512 records). [2025-10-15T20:12:57.152625] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-15T20:12:57.196027] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MMI took 26.3s. Estimated remaining: 2h 20m 39s. Rate: 7.1 symbols/min [2025-10-15T20:12:57.542131] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:57.565219] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-15T20:12:57.588273] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-15T20:12:57.607712] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-15T20:12:57.630280] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-15T20:12:57.633164] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-15T20:12:57.633547] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-15T20:12:57.735780] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-15T20:12:57.838756] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-15T20:12:57.847170] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-15T20:12:57.856086] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-15T20:12:57.856175] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-15T20:12:57.956445] [DEBUG] [LOCAL ] MMD: Trimmed 17319 records to 10914 (keeping 200 days of data) [2025-10-15T20:12:58.064275] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:12:58.111030] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-15T20:12:58.117497] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:12:58.163604] [DEBUG] [LOCAL ] MMD: Primary data saved (10914 records). [2025-10-15T20:12:58.170388] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T20:12:58.175921] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-15T20:12:58.169669] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-15T20:12:58.176244] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MMD took 28.7s. Estimated remaining: 2h 20m 25s. Rate: 7.1 symbols/min [2025-10-15T20:12:58.176113] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:12:58.217280] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-15T20:12:58.269979] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-15T20:12:58.275544] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-15T20:12:58.312335] [INFO ] [REMOTE ] MMC: Full fetch complete (75083 records). [2025-10-15T20:12:58.336396] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-15T20:12:58.353188] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:12:58.336242] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-15T20:12:58.368946] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MMID took 2.3s. Estimated remaining: 2h 20m 10s. Rate: 7.1 symbols/min [2025-10-15T20:12:58.561812] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-15T20:12:58.620814] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:58.770016] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:12:59.088587] [DEBUG] [LOCAL ] MMM: Loaded 53116 existing records from primary storage. [2025-10-15T20:12:59.093540] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-15T20:12:59.097962] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T20:12:59.097717] [INFO ] [MAIN ] MMM: Loaded 53116 existing records. [2025-10-15T20:12:59.108792] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-15T20:12:59.124460] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-15T20:12:59.130259] [DEBUG] [LOCAL ] MMS: Loaded 33783 existing records from primary storage. [2025-10-15T20:12:59.149693] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-15T20:12:59.163578] [INFO ] [MAIN ] MMS: Loaded 33783 existing records. [2025-10-15T20:12:59.308244] [DEBUG] [LOCAL ] MMC: Trimmed 75083 records to 51929 (keeping 200 days of data) [2025-10-15T20:12:59.321681] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-15T20:12:59.589191] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:12:59.603913] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-15T20:12:59.619518] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-15T20:12:59.668857] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-15T20:12:59.657609] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:12:59.670030] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-15T20:12:59.690548] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-15T20:12:59.797356] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-15T20:12:59.850745] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-15T20:12:59.857359] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T20:12:59.857490] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-15T20:13:00.133417] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-15T20:13:00.662949] [DEBUG] [LOCAL ] MMC: Primary data saved (51929 records). [2025-10-15T20:13:00.699993] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:00.700080] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-15T20:13:00.720663] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:00.722615] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMC took 44.3s. Estimated remaining: 2h 19m 58s. Rate: 7.1 symbols/min [2025-10-15T20:13:00.791462] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T20:13:00.920297] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-15T20:13:00.924622] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:13:00.937812] [DEBUG] [LOCAL ] MMT: Loaded 10364 existing records from primary storage. [2025-10-15T20:13:00.938099] [INFO ] [MAIN ] MMT: Loaded 10364 existing records. [2025-10-15T20:13:01.142178] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:13:01.142430] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-15T20:13:01.142493] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-15T20:13:01.142939] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-15T20:13:01.143011] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-15T20:13:01.436577] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T20:13:01.562122] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:01.714019] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-15T20:13:02.138390] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T20:13:02.514005] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-15T20:13:03.314022] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-15T20:13:04.023701] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T20:13:04.114042] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-15T20:13:04.194321] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T20:13:04.914030] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-15T20:13:05.332384] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T20:13:05.393929] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T20:13:05.714051] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-15T20:13:06.519894] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-15T20:13:06.522237] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T20:13:06.857972] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T20:13:07.314041] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-15T20:13:08.021221] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T20:13:08.114001] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-15T20:13:08.914004] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-15T20:13:09.061842] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T20:13:09.714059] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-15T20:13:10.085522] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-15T20:13:10.346055] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T20:13:10.514029] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-15T20:13:11.314003] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-15T20:13:11.457994] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T20:13:11.747000] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T20:13:12.114024] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-15T20:13:12.421828] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-15T20:13:12.914029] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-15T20:13:13.714047] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-15T20:13:14.382865] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T20:13:14.514026] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-15T20:13:14.876686] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T20:13:15.314018] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-15T20:13:15.551172] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T20:13:15.771324] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T20:13:15.772285] [INFO ] [REMOTE ] MMKT: Full fetch complete (2112 records). [2025-10-15T20:13:15.772359] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-15T20:13:15.964848] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T20:13:15.965126] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:13:15.965176] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:13:15.965262] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-15T20:13:15.965357] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-15T20:13:15.965429] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-15T20:13:15.965511] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-15T20:13:15.965599] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMKT took 18.7s. Estimated remaining: 2h 19m 54s. Rate: 7.1 symbols/min [2025-10-15T20:13:16.120564] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-15T20:13:16.153274] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:13:16.169279] [DEBUG] [LOCAL ] MMU: Loaded 16581 existing records from primary storage. [2025-10-15T20:13:16.169526] [INFO ] [MAIN ] MMU: Loaded 16581 existing records. [2025-10-15T20:13:16.345636] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:13:16.345861] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-15T20:13:16.345911] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-15T20:13:16.346337] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-15T20:13:16.346394] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-15T20:13:16.699988] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:16.914004] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-15T20:13:16.978296] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T20:13:17.713977] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-15T20:13:17.928491] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T20:13:18.514014] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-15T20:13:19.213823] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T20:13:19.313990] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-15T20:13:19.482291] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T20:13:20.114040] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-15T20:13:20.750072] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T20:13:20.913982] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-15T20:13:21.035153] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T20:13:21.714005] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-15T20:13:22.099824] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T20:13:22.148368] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T20:13:22.514119] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-15T20:13:23.239968] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T20:13:23.314047] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-15T20:13:24.114009] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-15T20:13:24.914009] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-15T20:13:25.122130] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T20:13:25.265283] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-15T20:13:25.645059] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T20:13:25.714018] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-15T20:13:26.500666] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:13:26.502574] [INFO ] [REMOTE ] MMT: Full fetch complete (16074 records). [2025-10-15T20:13:26.502715] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-15T20:13:26.519217] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-15T20:13:26.924047] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-15T20:13:26.924178] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-15T20:13:26.924947] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-15T20:13:26.925023] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-15T20:13:26.926229] [DEBUG] [LOCAL ] MMT: Trimmed 16074 records to 10346 (keeping 200 days of data) [2025-10-15T20:13:26.986621] [DEBUG] [LOCAL ] MMT: Primary data saved (10346 records). [2025-10-15T20:13:26.986790] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-15T20:13:26.986877] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMT took 26.3s. Estimated remaining: 2h 19m 48s. Rate: 7.1 symbols/min [2025-10-15T20:13:27.153917] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:13:27.176660] [DEBUG] [LOCAL ] MNR: Loaded 24830 existing records from primary storage. [2025-10-15T20:13:27.176917] [INFO ] [MAIN ] MNR: Loaded 24830 existing records. [2025-10-15T20:13:27.324289] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-15T20:13:27.355358] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:13:27.355796] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-15T20:13:27.355866] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-15T20:13:27.356376] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-15T20:13:27.356434] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-15T20:13:27.676567] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T20:13:27.760219] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:28.113988] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-15T20:13:28.820762] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T20:13:28.891100] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T20:13:28.913987] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-15T20:13:29.714045] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-15T20:13:30.513978] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-15T20:13:30.739456] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T20:13:30.933541] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T20:13:31.314032] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-15T20:13:31.888619] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T20:13:32.114058] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-15T20:13:32.914061] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-15T20:13:33.183228] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T20:13:33.368345] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T20:13:33.713976] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-15T20:13:33.729562] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T20:13:34.514079] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-15T20:13:35.182405] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T20:13:35.254003] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:13:35.314002] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-15T20:13:36.113976] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-15T20:13:36.364567] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T20:13:36.913995] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-15T20:13:37.713969] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-15T20:13:38.124807] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T20:13:38.337489] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T20:13:38.341903] [INFO ] [REMOTE ] MMS: Full fetch complete (51506 records). [2025-10-15T20:13:38.342018] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-15T20:13:38.458476] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T20:13:38.523732] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-15T20:13:38.765494] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-15T20:13:38.765579] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-15T20:13:38.766476] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-15T20:13:38.766538] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-15T20:13:38.767682] [DEBUG] [LOCAL ] MMS: Trimmed 51506 records to 33758 (keeping 200 days of data) [2025-10-15T20:13:38.979246] [DEBUG] [LOCAL ] MMS: Primary data saved (33758 records). [2025-10-15T20:13:38.979384] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-15T20:13:38.979467] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMS took 40.6s. Estimated remaining: 2h 19m 42s. Rate: 7.1 symbols/min [2025-10-15T20:13:39.154007] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:13:39.192998] [DEBUG] [LOCAL ] MNSO: Loaded 44150 existing records from primary storage. [2025-10-15T20:13:39.193332] [INFO ] [MAIN ] MNSO: Loaded 44150 existing records. [2025-10-15T20:13:39.319159] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-15T20:13:39.371802] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:13:39.372004] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-15T20:13:39.372052] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-15T20:13:39.372802] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-15T20:13:39.372858] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-15T20:13:39.734221] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:39.840931] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T20:13:40.060092] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T20:13:40.114010] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-15T20:13:40.914055] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-15T20:13:41.017041] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:13:41.714045] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-15T20:13:42.492133] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T20:13:42.513953] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-15T20:13:42.642777] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T20:13:43.314044] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-15T20:13:44.063231] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T20:13:44.113994] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-15T20:13:44.631381] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T20:13:44.913983] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-15T20:13:45.607722] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T20:13:45.659216] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T20:13:45.714010] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-15T20:13:46.513997] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-15T20:13:46.730845] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T20:13:46.733326] [INFO ] [REMOTE ] MMU: Full fetch complete (25115 records). [2025-10-15T20:13:46.733419] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-15T20:13:47.115367] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-15T20:13:47.115446] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-15T20:13:47.116037] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-15T20:13:47.116101] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-15T20:13:47.116841] [DEBUG] [LOCAL ] MMU: Trimmed 25115 records to 16587 (keeping 200 days of data) [2025-10-15T20:13:47.215583] [DEBUG] [LOCAL ] MMU: Primary data saved (16587 records). [2025-10-15T20:13:47.215755] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-15T20:13:47.215842] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMU took 31.3s. Estimated remaining: 2h 19m 33s. Rate: 7.1 symbols/min [2025-10-15T20:13:47.319187] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-15T20:13:47.393276] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:13:47.393505] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-15T20:13:47.393545] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-15T20:13:47.393695] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-15T20:13:47.393751] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-15T20:13:47.393795] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-15T20:13:47.393829] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-15T20:13:47.755876] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:48.113957] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-15T20:13:48.308816] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T20:13:48.319942] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:13:48.320574] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-15T20:13:48.320702] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:13:48.320773] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-15T20:13:48.320838] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:13:48.320906] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-15T20:13:48.320967] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-15T20:13:48.321003] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-15T20:13:48.321041] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-15T20:13:48.321085] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MNTN took 1.1s. Estimated remaining: 2h 19m 19s. Rate: 7.1 symbols/min [2025-10-15T20:13:48.484560] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:13:48.484743] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-15T20:13:48.484788] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-15T20:13:48.484894] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-15T20:13:48.484935] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-15T20:13:48.484975] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-15T20:13:48.485006] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-15T20:13:48.833774] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:13:48.870005] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T20:13:48.913969] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-15T20:13:49.714055] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-15T20:13:50.514009] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-15T20:13:51.151374] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-15T20:13:51.314069] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-15T20:13:51.412591] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T20:13:52.114016] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-15T20:13:52.329835] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:13:52.570685] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-15T20:13:52.914075] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-15T20:13:53.714025] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-15T20:13:54.470810] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-15T20:13:54.514005] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-15T20:13:54.742912] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T20:13:55.314025] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-15T20:13:55.688429] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T20:13:56.114039] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-15T20:13:56.569004] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T20:13:56.867336] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T20:13:56.913989] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-15T20:13:57.612010] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T20:13:57.714038] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-15T20:13:58.514059] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-15T20:13:58.678157] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T20:13:59.205538] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-15T20:13:59.314028] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-15T20:13:59.990098] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T20:14:00.056932] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T20:14:00.113978] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-15T20:14:00.914021] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-15T20:14:01.714048] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-15T20:14:01.853289] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T20:14:02.514028] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-15T20:14:02.848056] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T20:14:02.851786] [INFO ] [REMOTE ] MNR: Full fetch complete (36815 records). [2025-10-15T20:14:02.852005] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-15T20:14:03.198276] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-15T20:14:03.290933] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-15T20:14:03.291007] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-15T20:14:03.291746] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-15T20:14:03.291807] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-15T20:14:03.292612] [DEBUG] [LOCAL ] MNR: Trimmed 36815 records to 24924 (keeping 200 days of data) [2025-10-15T20:14:03.345822] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-15T20:14:03.443457] [DEBUG] [LOCAL ] MNR: Primary data saved (24924 records). [2025-10-15T20:14:03.443587] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-15T20:14:03.443689] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MNR took 36.5s. Estimated remaining: 2h 19m 16s. Rate: 7.1 symbols/min [2025-10-15T20:14:03.616009] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:03.659259] [DEBUG] [LOCAL ] MOD: Loaded 44823 existing records from primary storage. [2025-10-15T20:14:03.659551] [INFO ] [MAIN ] MOD: Loaded 44823 existing records. [2025-10-15T20:14:03.849271] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:03.849561] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-15T20:14:03.849617] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-15T20:14:03.850372] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-15T20:14:03.850431] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-15T20:14:04.119126] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-15T20:14:04.216955] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:04.242609] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:14:04.913980] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-15T20:14:04.989825] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T20:14:04.996381] [INFO ] [REMOTE ] MMM: Full fetch complete (77202 records). [2025-10-15T20:14:04.996499] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-15T20:14:05.380423] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-15T20:14:05.380498] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-15T20:14:05.381562] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-15T20:14:05.381625] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-15T20:14:05.383329] [DEBUG] [LOCAL ] MMM: Trimmed 77202 records to 53114 (keeping 200 days of data) [2025-10-15T20:14:05.714343] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-15T20:14:05.729186] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-15T20:14:05.763597] [DEBUG] [LOCAL ] MMM: Primary data saved (53114 records). [2025-10-15T20:14:05.763742] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-15T20:14:05.763823] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MMM took 1m 8s. Estimated remaining: 2h 19m 3s. Rate: 7.1 symbols/min [2025-10-15T20:14:05.931735] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:05.976892] [DEBUG] [LOCAL ] MODG: Loaded 51587 existing records from primary storage. [2025-10-15T20:14:05.977204] [INFO ] [MAIN ] MODG: Loaded 51587 existing records. [2025-10-15T20:14:06.155152] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:06.155349] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-15T20:14:06.155397] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-15T20:14:06.156229] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-15T20:14:06.156289] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-15T20:14:06.518473] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-15T20:14:06.521626] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:06.615275] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T20:14:06.621085] [INFO ] [REMOTE ] MNSO: Full fetch complete (64693 records). [2025-10-15T20:14:06.621204] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-15T20:14:07.000061] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-15T20:14:07.000139] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-15T20:14:07.001176] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-15T20:14:07.001241] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-15T20:14:07.002498] [DEBUG] [LOCAL ] MNSO: Trimmed 64693 records to 44171 (keeping 200 days of data) [2025-10-15T20:14:07.275051] [DEBUG] [LOCAL ] MNSO: Primary data saved (44171 records). [2025-10-15T20:14:07.275212] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-15T20:14:07.275359] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNSO took 28.3s. Estimated remaining: 2h 18m 49s. Rate: 7.1 symbols/min [2025-10-15T20:14:07.319045] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-15T20:14:07.448531] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:07.471971] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T20:14:07.513495] [DEBUG] [LOCAL ] MOH: Loaded 42497 existing records from primary storage. [2025-10-15T20:14:07.513797] [INFO ] [MAIN ] MOH: Loaded 42497 existing records. [2025-10-15T20:14:07.685333] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:07.685520] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-15T20:14:07.685566] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-15T20:14:07.686364] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-15T20:14:07.686423] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-15T20:14:08.030129] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:08.113958] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-15T20:14:08.661377] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-15T20:14:08.775979] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T20:14:08.913990] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-15T20:14:09.203908] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T20:14:09.713996] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-15T20:14:10.513976] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-15T20:14:10.664532] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T20:14:11.163436] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T20:14:11.313996] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-15T20:14:12.114027] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-15T20:14:12.681356] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T20:14:12.813474] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-15T20:14:12.913955] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-15T20:14:13.713988] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-15T20:14:13.820356] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T20:14:14.513994] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-15T20:14:14.673421] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T20:14:15.313992] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-15T20:14:15.459954] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T20:14:16.048885] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T20:14:16.114007] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-15T20:14:16.913957] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-15T20:14:17.408630] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T20:14:17.589522] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T20:14:17.714007] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-15T20:14:18.325470] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T20:14:18.514033] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-15T20:14:19.314049] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-15T20:14:19.365926] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T20:14:19.949347] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T20:14:19.988312] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T20:14:19.995512] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-15T20:14:19.995716] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-15T20:14:20.119118] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-15T20:14:20.210871] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T20:14:20.211767] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:14:20.211844] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:14:20.211922] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-15T20:14:20.211997] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-15T20:14:20.212036] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-15T20:14:20.212078] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-15T20:14:20.212152] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MO took 31.9s. Estimated remaining: 2h 18m 44s. Rate: 7.1 symbols/min [2025-10-15T20:14:20.389733] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:20.447988] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-10-15T20:14:20.448437] [INFO ] [MAIN ] MOS: Loaded 53506 existing records. [2025-10-15T20:14:20.636474] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:20.636795] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-15T20:14:20.636856] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-15T20:14:20.638296] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-15T20:14:20.638360] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-15T20:14:20.920091] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-15T20:14:21.008992] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:21.714004] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-15T20:14:21.982261] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T20:14:22.514098] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-15T20:14:22.689998] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T20:14:23.314039] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-15T20:14:23.540805] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T20:14:24.114050] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-15T20:14:24.176804] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T20:14:24.756422] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T20:14:24.914208] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-15T20:14:25.654326] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T20:14:25.714056] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-15T20:14:26.513997] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-15T20:14:26.718058] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-15T20:14:27.314045] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-15T20:14:27.533249] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T20:14:27.688359] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T20:14:28.114071] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-15T20:14:28.725764] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T20:14:28.914049] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-15T20:14:29.714002] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-15T20:14:29.849981] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T20:14:30.502238] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T20:14:30.513973] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-15T20:14:31.057509] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T20:14:31.314083] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-15T20:14:32.114099] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-15T20:14:32.160916] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T20:14:32.760578] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T20:14:32.914063] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-15T20:14:33.714064] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-15T20:14:34.514742] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-15T20:14:34.516307] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-15T20:14:34.565090] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T20:14:35.314052] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-15T20:14:35.973021] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-15T20:14:36.114039] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-15T20:14:36.345177] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T20:14:36.914007] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-15T20:14:36.999581] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T20:14:37.008181] [INFO ] [REMOTE ] MODG: Full fetch complete (74900 records). [2025-10-15T20:14:37.008441] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-15T20:14:37.444329] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-15T20:14:37.444442] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-15T20:14:37.445977] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-15T20:14:37.446056] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-15T20:14:37.448083] [DEBUG] [LOCAL ] MODG: Trimmed 74900 records to 51597 (keeping 200 days of data) [2025-10-15T20:14:37.723564] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-15T20:14:37.751756] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T20:14:37.845418] [DEBUG] [LOCAL ] MODG: Primary data saved (51597 records). [2025-10-15T20:14:37.845633] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-15T20:14:37.845842] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MODG took 32.1s. Estimated remaining: 2h 18m 42s. Rate: 7.1 symbols/min [2025-10-15T20:14:38.040163] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:38.064099] [DEBUG] [LOCAL ] MOV: Loaded 21725 existing records from primary storage. [2025-10-15T20:14:38.064377] [INFO ] [MAIN ] MOV: Loaded 21725 existing records. [2025-10-15T20:14:38.285272] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:38.285612] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-15T20:14:38.285726] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-15T20:14:38.286390] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-15T20:14:38.286461] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-15T20:14:38.523386] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-15T20:14:38.708426] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:38.725576] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T20:14:39.313994] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-15T20:14:39.573515] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T20:14:40.056457] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T20:14:40.114054] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-15T20:14:40.791344] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T20:14:40.797687] [INFO ] [REMOTE ] MOD: Full fetch complete (66361 records). [2025-10-15T20:14:40.797897] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-15T20:14:40.919147] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-15T20:14:41.245203] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:14:41.245611] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-15T20:14:41.250810] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-15T20:14:41.252855] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-15T20:14:41.252926] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-15T20:14:41.254998] [DEBUG] [LOCAL ] MOD: Trimmed 66361 records to 44781 (keeping 200 days of data) [2025-10-15T20:14:41.549821] [DEBUG] [LOCAL ] MOD: Primary data saved (44781 records). [2025-10-15T20:14:41.550044] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-15T20:14:41.551038] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MOD took 38.1s. Estimated remaining: 2h 18m 31s. Rate: 7.1 symbols/min [2025-10-15T20:14:41.727739] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-15T20:14:41.734323] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:41.804282] [DEBUG] [LOCAL ] MP: Loaded 53720 existing records from primary storage. [2025-10-15T20:14:41.804774] [INFO ] [MAIN ] MP: Loaded 53720 existing records. [2025-10-15T20:14:42.017216] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:42.017586] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-15T20:14:42.017665] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-15T20:14:42.018632] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-15T20:14:42.018764] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-15T20:14:42.413280] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:42.513980] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-15T20:14:42.543973] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T20:14:42.550639] [INFO ] [REMOTE ] MOH: Full fetch complete (59143 records). [2025-10-15T20:14:42.550849] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-15T20:14:42.691117] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:14:43.026418] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-15T20:14:43.026535] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-15T20:14:43.027886] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-15T20:14:43.027953] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-15T20:14:43.029547] [DEBUG] [LOCAL ] MOH: Trimmed 59143 records to 42649 (keeping 200 days of data) [2025-10-15T20:14:43.283404] [DEBUG] [LOCAL ] MOH: Primary data saved (42649 records). [2025-10-15T20:14:43.283529] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-15T20:14:43.283605] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MOH took 36.0s. Estimated remaining: 2h 18m 17s. Rate: 7.1 symbols/min [2025-10-15T20:14:43.315366] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-15T20:14:43.453015] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:43.459880] [DEBUG] [LOCAL ] MPA: Loaded 5354 existing records from primary storage. [2025-10-15T20:14:43.460082] [INFO ] [MAIN ] MPA: Loaded 5354 existing records. [2025-10-15T20:14:43.640011] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:14:43.640280] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-15T20:14:43.640336] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-15T20:14:43.640569] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-15T20:14:43.640626] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-15T20:14:43.993979] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:44.113983] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-15T20:14:44.354155] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T20:14:44.720234] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T20:14:44.914056] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-15T20:14:45.410930] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T20:14:45.714102] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-15T20:14:46.514008] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-15T20:14:46.712931] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T20:14:46.958491] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T20:14:47.314081] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-15T20:14:47.554542] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T20:14:48.074212] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T20:14:48.114034] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-15T20:14:48.914029] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-15T20:14:49.500067] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T20:14:49.714098] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-15T20:14:49.857191] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T20:14:50.514011] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-15T20:14:50.801852] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T20:14:51.314013] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-15T20:14:51.778538] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T20:14:52.114019] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-15T20:14:52.312032] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T20:14:52.904093] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T20:14:52.913951] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-15T20:14:53.569010] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T20:14:53.713989] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-15T20:14:54.513980] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-15T20:14:55.314072] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-15T20:14:55.677133] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-15T20:14:55.695075] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-15T20:14:56.114004] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-15T20:14:56.283969] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T20:14:56.292062] [INFO ] [REMOTE ] MOS: Full fetch complete (77625 records). [2025-10-15T20:14:56.292291] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-15T20:14:56.693361] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-15T20:14:56.693515] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-15T20:14:56.694748] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-15T20:14:56.694822] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-15T20:14:56.696298] [DEBUG] [LOCAL ] MOS: Trimmed 77625 records to 53508 (keeping 200 days of data) [2025-10-15T20:14:56.917717] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-15T20:14:57.045085] [DEBUG] [LOCAL ] MOS: Primary data saved (53508 records). [2025-10-15T20:14:57.045238] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-15T20:14:57.045844] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MOS took 36.8s. Estimated remaining: 2h 18m 13s. Rate: 7.1 symbols/min [2025-10-15T20:14:57.228442] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:14:57.228873] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-15T20:14:57.228984] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-15T20:14:57.229339] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-15T20:14:57.229527] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-15T20:14:57.229772] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-15T20:14:57.229842] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-15T20:14:57.351875] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T20:14:57.674663] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:14:57.713997] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-15T20:14:58.514020] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-15T20:14:58.806960] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T20:14:58.950984] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T20:14:58.987681] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T20:14:59.314038] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-15T20:15:00.114035] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-15T20:15:00.319420] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T20:15:00.815096] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T20:15:00.914029] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-15T20:15:01.714019] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-15T20:15:01.941560] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T20:15:02.198634] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T20:15:02.514072] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-15T20:15:03.314100] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-15T20:15:03.990515] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:15:03.991909] [INFO ] [REMOTE ] MPA: Full fetch complete (7104 records). [2025-10-15T20:15:03.991986] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-15T20:15:04.117157] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-15T20:15:04.348161] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T20:15:04.419710] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-15T20:15:04.419815] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-15T20:15:04.420065] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-15T20:15:04.420109] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-15T20:15:04.420574] [DEBUG] [LOCAL ] MPA: Trimmed 7104 records to 5368 (keeping 200 days of data) [2025-10-15T20:15:04.460673] [DEBUG] [LOCAL ] MPA: Primary data saved (5368 records). [2025-10-15T20:15:04.460889] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-15T20:15:04.461000] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MPA took 21.2s. Estimated remaining: 2h 18m 4s. Rate: 7.1 symbols/min [2025-10-15T20:15:04.650217] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:15:04.713173] [DEBUG] [LOCAL ] MPLX: Loaded 50755 existing records from primary storage. [2025-10-15T20:15:04.713846] [INFO ] [MAIN ] MPLX: Loaded 50755 existing records. [2025-10-15T20:15:04.910608] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:15:04.910945] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-15T20:15:04.911011] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-15T20:15:04.912126] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-15T20:15:04.912188] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-15T20:15:04.924535] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-15T20:15:05.290022] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:15:05.714424] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-15T20:15:05.719713] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T20:15:06.190519] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T20:15:06.514010] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-15T20:15:07.314017] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-15T20:15:07.621837] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T20:15:08.114026] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-15T20:15:08.234372] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T20:15:08.731157] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-15T20:15:08.913991] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-15T20:15:09.719730] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-15T20:15:09.723320] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T20:15:09.741594] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T20:15:09.744162] [INFO ] [REMOTE ] MOV: Full fetch complete (30549 records). [2025-10-15T20:15:09.744247] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-15T20:15:10.103837] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-15T20:15:10.103915] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-15T20:15:10.104590] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-15T20:15:10.104676] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-15T20:15:10.105389] [DEBUG] [LOCAL ] MOV: Trimmed 30549 records to 21692 (keeping 200 days of data) [2025-10-15T20:15:10.233536] [DEBUG] [LOCAL ] MOV: Primary data saved (21692 records). [2025-10-15T20:15:10.233684] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-15T20:15:10.233775] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MOV took 32.4s. Estimated remaining: 2h 17m 53s. Rate: 7.1 symbols/min [2025-10-15T20:15:10.397032] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:15:10.403371] [DEBUG] [LOCAL ] MPV: Loaded 4759 existing records from primary storage. [2025-10-15T20:15:10.403558] [INFO ] [MAIN ] MPV: Loaded 4759 existing records. [2025-10-15T20:15:10.519205] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-15T20:15:10.581318] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:15:10.581831] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-15T20:15:10.581885] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-15T20:15:10.582134] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-15T20:15:10.582190] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-15T20:15:10.932855] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:15:11.175480] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T20:15:11.313994] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-15T20:15:12.114018] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-15T20:15:12.272268] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T20:15:12.759781] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T20:15:12.914039] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-15T20:15:13.714070] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-15T20:15:14.338390] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T20:15:14.432330] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-15T20:15:14.513960] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-15T20:15:15.314080] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-15T20:15:15.544133] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T20:15:16.114063] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-15T20:15:16.914082] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-15T20:15:17.227638] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-15T20:15:17.318106] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-15T20:15:17.380838] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T20:15:17.519556] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T20:15:17.714062] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-15T20:15:18.327446] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T20:15:18.514060] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-15T20:15:19.313982] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-15T20:15:20.072228] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:15:20.113957] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-15T20:15:20.913980] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-15T20:15:21.119168] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T20:15:21.713987] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-15T20:15:21.828484] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T20:15:22.514016] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-15T20:15:23.220776] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T20:15:23.314121] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-15T20:15:23.617422] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-15T20:15:24.014057] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T20:15:24.115607] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-15T20:15:24.122411] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T20:15:24.914036] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-15T20:15:25.675259] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T20:15:25.714040] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-15T20:15:26.514117] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-15T20:15:26.815293] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-15T20:15:26.935746] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T20:15:27.314008] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-15T20:15:27.413075] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T20:15:27.782225] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T20:15:28.114031] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-15T20:15:28.914025] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-15T20:15:29.714028] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-15T20:15:30.382482] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T20:15:30.514008] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-15T20:15:30.705518] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T20:15:30.851191] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T20:15:31.319273] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-15T20:15:31.331888] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (3.22 seconds). [2025-10-15T20:15:31.341933] [INFO ] [REMOTE ] MP: Full fetch complete (77553 records). [2025-10-15T20:15:31.342132] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-15T20:15:31.737239] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-15T20:15:31.737337] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-15T20:15:31.738594] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-15T20:15:31.738685] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-15T20:15:31.740385] [DEBUG] [LOCAL ] MP: Trimmed 77553 records to 53722 (keeping 200 days of data) [2025-10-15T20:15:32.076227] [DEBUG] [LOCAL ] MP: Primary data saved (53722 records). [2025-10-15T20:15:32.076423] [INFO ] [MAIN ] MP: Full history saved. [2025-10-15T20:15:32.077406] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MP took 50.5s. Estimated remaining: 2h 17m 54s. Rate: 7.1 symbols/min [2025-10-15T20:15:32.122541] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-15T20:15:32.260020] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:15:32.310906] [DEBUG] [LOCAL ] MPW: Loaded 53496 existing records from primary storage. [2025-10-15T20:15:32.311244] [INFO ] [MAIN ] MPW: Loaded 53496 existing records. [2025-10-15T20:15:32.505103] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:15:32.505399] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-15T20:15:32.505448] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-15T20:15:32.506390] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-15T20:15:32.506448] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-15T20:15:32.807180] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T20:15:32.894977] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:15:32.913973] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-15T20:15:33.103514] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T20:15:33.714045] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-15T20:15:34.336571] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T20:15:34.513985] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-15T20:15:34.701690] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T20:15:35.314028] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-15T20:15:36.114018] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-15T20:15:36.199290] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T20:15:36.595786] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T20:15:36.602440] [INFO ] [REMOTE ] MPLX: Full fetch complete (74262 records). [2025-10-15T20:15:36.602579] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-15T20:15:36.704238] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T20:15:36.707745] [INFO ] [REMOTE ] MPV: Full fetch complete (7837 records). [2025-10-15T20:15:36.718322] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-15T20:15:36.931244] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-15T20:15:37.386127] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-15T20:15:37.392139] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-15T20:15:37.397161] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-15T20:15:37.403749] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-15T20:15:37.430021] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-15T20:15:37.430461] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-15T20:15:37.430780] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-15T20:15:37.430869] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-15T20:15:37.431003] [DEBUG] [LOCAL ] MPLX: Trimmed 74262 records to 50757 (keeping 200 days of data) [2025-10-15T20:15:37.432349] [DEBUG] [LOCAL ] MPV: Trimmed 7837 records to 4661 (keeping 200 days of data) [2025-10-15T20:15:37.559182] [DEBUG] [LOCAL ] MPV: Primary data saved (4661 records). [2025-10-15T20:15:37.562882] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-15T20:15:37.563111] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MPV took 27.3s. Estimated remaining: 2h 17m 44s. Rate: 7.1 symbols/min [2025-10-15T20:15:37.720762] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-15T20:15:37.758963] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:15:37.778346] [DEBUG] [LOCAL ] MPX: Loaded 4071 existing records from primary storage. [2025-10-15T20:15:37.780286] [INFO ] [MAIN ] MPX: Loaded 4071 existing records. [2025-10-15T20:15:38.062094] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:15:38.063228] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-15T20:15:38.064560] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-15T20:15:38.067415] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-15T20:15:38.068591] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-15T20:15:38.511611] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:15:38.525858] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-15T20:15:38.547370] [DEBUG] [LOCAL ] MPLX: Primary data saved (50757 records). [2025-10-15T20:15:38.547467] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-15T20:15:38.547547] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MPLX took 34.1s. Estimated remaining: 2h 17m 30s. Rate: 7.1 symbols/min [2025-10-15T20:15:38.717259] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:15:38.726746] [DEBUG] [LOCAL ] MQT: Loaded 8306 existing records from primary storage. [2025-10-15T20:15:38.726977] [INFO ] [MAIN ] MQT: Loaded 8306 existing records. [2025-10-15T20:15:38.931806] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:15:38.934666] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-15T20:15:38.934903] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-15T20:15:38.936402] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-15T20:15:38.936358] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T20:15:38.936565] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-15T20:15:39.229247] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T20:15:39.311266] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:15:39.313953] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-15T20:15:39.415584] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T20:15:40.114000] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-15T20:15:40.914010] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-15T20:15:40.948767] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T20:15:41.045607] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T20:15:41.714034] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-15T20:15:42.294897] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T20:15:42.514022] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-15T20:15:42.696208] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T20:15:42.703861] [INFO ] [REMOTE ] MPC: Full fetch complete (75870 records). [2025-10-15T20:15:42.704014] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-15T20:15:43.035350] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T20:15:43.115688] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-15T20:15:43.115779] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-15T20:15:43.116883] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-15T20:15:43.116946] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-15T20:15:43.118418] [DEBUG] [LOCAL ] MPC: Trimmed 75870 records to 52051 (keeping 200 days of data) [2025-10-15T20:15:43.341263] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-15T20:15:43.468049] [DEBUG] [LOCAL ] MPC: Primary data saved (52051 records). [2025-10-15T20:15:43.468201] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-15T20:15:43.468276] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MPC took 46.4s. Estimated remaining: 2h 17m 19s. Rate: 7.1 symbols/min [2025-10-15T20:15:43.633636] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:15:43.633838] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-15T20:15:43.633876] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-15T20:15:43.633991] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-15T20:15:43.634032] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-15T20:15:43.634073] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-15T20:15:43.634105] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-15T20:15:43.807279] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T20:15:43.996364] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:15:44.114043] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-15T20:15:44.914022] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-15T20:15:45.577743] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T20:15:45.714011] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-15T20:15:46.093914] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T20:15:46.514082] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-15T20:15:46.864245] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T20:15:47.246491] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T20:15:47.314009] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-15T20:15:48.027409] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T20:15:48.114061] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-15T20:15:48.628442] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T20:15:48.914049] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-15T20:15:49.714027] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-15T20:15:50.514032] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-15T20:15:50.881049] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T20:15:50.906688] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T20:15:51.253893] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:15:51.314047] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-15T20:15:52.114043] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-15T20:15:52.725757] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T20:15:52.913973] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-15T20:15:53.268164] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T20:15:53.713976] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-15T20:15:53.727307] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T20:15:54.514040] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-15T20:15:55.314008] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-15T20:15:55.356627] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T20:15:55.536212] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T20:15:56.114017] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-15T20:15:56.372938] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T20:15:56.721544] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T20:15:56.914006] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-15T20:15:57.692923] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T20:15:57.714007] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-15T20:15:58.317190] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T20:15:58.514009] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-15T20:15:59.313997] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-15T20:15:59.944415] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T20:16:00.114010] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-15T20:16:00.571630] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-15T20:16:00.913963] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-15T20:16:01.058206] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T20:16:01.559005] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T20:16:01.714155] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-15T20:16:02.514019] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-15T20:16:02.564467] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T20:16:03.314002] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-15T20:16:03.523699] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T20:16:04.113997] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-15T20:16:04.830139] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T20:16:04.914038] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-15T20:16:05.345486] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T20:16:05.714013] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-15T20:16:05.763886] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T20:16:06.514072] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-15T20:16:06.786676] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:16:07.314035] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-15T20:16:07.957072] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T20:16:07.958201] [INFO ] [REMOTE ] MPX: Full fetch complete (6604 records). [2025-10-15T20:16:07.958272] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-15T20:16:08.114320] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-15T20:16:08.330791] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-15T20:16:08.331017] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-15T20:16:08.331237] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-15T20:16:08.331280] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-15T20:16:08.331725] [DEBUG] [LOCAL ] MPX: Trimmed 6604 records to 4065 (keeping 200 days of data) [2025-10-15T20:16:08.355570] [DEBUG] [LOCAL ] MPX: Primary data saved (4065 records). [2025-10-15T20:16:08.355696] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-15T20:16:08.355787] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPX took 30.8s. Estimated remaining: 2h 17m 22s. Rate: 7.1 symbols/min [2025-10-15T20:16:08.528546] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:08.528738] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-15T20:16:08.528808] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-15T20:16:08.529093] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-15T20:16:08.529210] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-15T20:16:08.529317] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-15T20:16:08.529393] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-15T20:16:08.667683] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-15T20:16:08.916743] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-15T20:16:08.940776] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:09.075469] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T20:16:09.714020] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-15T20:16:10.029846] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T20:16:10.514004] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-15T20:16:11.314000] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-15T20:16:11.336103] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T20:16:11.642743] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-15T20:16:11.651811] [INFO ] [REMOTE ] MPW: Full fetch complete (77598 records). [2025-10-15T20:16:11.652054] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-15T20:16:12.077308] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-15T20:16:12.077447] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-15T20:16:12.078560] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-15T20:16:12.078629] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-15T20:16:12.080208] [DEBUG] [LOCAL ] MPW: Trimmed 77598 records to 53496 (keeping 200 days of data) [2025-10-15T20:16:12.133498] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-15T20:16:12.421481] [DEBUG] [LOCAL ] MPW: Primary data saved (53496 records). [2025-10-15T20:16:12.421729] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-15T20:16:12.422679] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MPW took 40.3s. Estimated remaining: 2h 17m 11s. Rate: 7.1 symbols/min [2025-10-15T20:16:12.600011] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:12.600327] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-15T20:16:12.600382] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-15T20:16:12.600511] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-15T20:16:12.600563] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-15T20:16:12.600621] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-15T20:16:12.600711] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-15T20:16:12.911972] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T20:16:12.916615] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T20:16:12.916821] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-15T20:16:12.932330] [INFO ] [REMOTE ] MQY: Full fetch complete (26406 records). [2025-10-15T20:16:12.950147] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-15T20:16:12.979011] [FATAL] [VALIDATOR ] MQY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:16:12.996850] [FATAL] [MAIN ] MQY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:16:12.997017] [WARN ] [MAIN ] MQY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:16:12.997107] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-15T20:16:12.997191] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-15T20:16:12.997244] [INFO ] [LOCAL ] MQY: Starting deletion of derivative data. [2025-10-15T20:16:12.997306] [DEBUG] [LOCAL ] MQY: No derivative data file found to delete. [2025-10-15T20:16:12.997416] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MQY took 29.5s. Estimated remaining: 2h 16m 57s. Rate: 7.1 symbols/min [2025-10-15T20:16:13.011735] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:13.178231] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:13.178404] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-15T20:16:13.178442] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-15T20:16:13.178558] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-15T20:16:13.178606] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-15T20:16:13.178672] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-15T20:16:13.178725] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-15T20:16:13.564356] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:13.713990] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-15T20:16:13.735414] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T20:16:13.736845] [INFO ] [REMOTE ] MQT: Full fetch complete (13131 records). [2025-10-15T20:16:13.736916] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-15T20:16:13.988971] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:16:14.015466] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-15T20:16:14.015795] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:16:14.015872] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-15T20:16:14.021750] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:16:14.042530] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-15T20:16:14.074974] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-15T20:16:14.098150] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-15T20:16:14.098413] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-15T20:16:14.098566] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-15T20:16:14.098686] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-15T20:16:14.099193] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-15T20:16:14.098807] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MRP took 1.1s. Estimated remaining: 2h 16m 43s. Rate: 7.1 symbols/min [2025-10-15T20:16:14.099319] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-15T20:16:14.150475] [DEBUG] [LOCAL ] MQT: Trimmed 13131 records to 8325 (keeping 200 days of data) [2025-10-15T20:16:14.354283] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:14.359886] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-15T20:16:14.359962] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-15T20:16:14.359743] [DEBUG] [LOCAL ] MQT: Primary data saved (8325 records). [2025-10-15T20:16:14.360242] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-15T20:16:14.360336] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-15T20:16:14.360441] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-15T20:16:14.360565] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MQT took 35.8s. Estimated remaining: 2h 16m 29s. Rate: 7.1 symbols/min [2025-10-15T20:16:14.360882] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-15T20:16:14.360950] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-15T20:16:14.519291] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-15T20:16:14.781623] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:15.314046] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-15T20:16:16.114042] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-15T20:16:16.792240] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T20:16:16.926878] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-15T20:16:16.934325] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T20:16:17.714074] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-15T20:16:17.913433] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T20:16:18.397285] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T20:16:18.514046] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-15T20:16:19.314119] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-15T20:16:19.961355] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-15T20:16:20.114065] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-15T20:16:20.654578] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-15T20:16:20.865008] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T20:16:20.913953] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-15T20:16:21.714226] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-15T20:16:22.424496] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-15T20:16:22.510918] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T20:16:22.520981] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-15T20:16:23.314037] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-15T20:16:23.782107] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-15T20:16:24.114052] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-15T20:16:24.402605] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T20:16:24.839537] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T20:16:24.914138] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-15T20:16:25.714032] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-15T20:16:26.278451] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T20:16:26.514064] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-15T20:16:27.287099] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T20:16:27.317438] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-15T20:16:27.353559] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-15T20:16:28.113984] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-15T20:16:28.904590] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-15T20:16:28.919078] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-15T20:16:28.974675] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T20:16:29.714118] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-15T20:16:30.599860] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-15T20:16:30.614718] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-15T20:16:30.880289] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T20:16:31.183064] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T20:16:31.314029] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-15T20:16:32.114066] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-15T20:16:32.531014] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T20:16:32.668601] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T20:16:32.914000] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-15T20:16:33.321911] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T20:16:33.327337] [INFO ] [REMOTE ] MRC: Full fetch complete (54746 records). [2025-10-15T20:16:33.327532] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-15T20:16:33.328931] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:16:33.329149] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:16:33.329224] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:16:33.329306] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-15T20:16:33.329385] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-15T20:16:33.329425] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-15T20:16:33.329466] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-15T20:16:33.329630] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MRC took 25.0s. Estimated remaining: 2h 16m 28s. Rate: 7.1 symbols/min [2025-10-15T20:16:33.714020] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-15T20:16:33.792924] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T20:16:34.514041] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-15T20:16:36.269628] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-15T20:16:36.282498] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-15T20:16:36.366280] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T20:16:36.378473] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-15T20:16:38.395862] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T20:16:38.407426] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-15T20:16:38.600466] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-15T20:16:38.613345] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-15T20:16:40.511794] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-15T20:16:40.523596] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-15T20:16:41.064813] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-15T20:16:41.076888] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-15T20:16:41.209533] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:16:41.215469] [INFO ] [REMOTE ] MS: Full fetch complete (77466 records). [2025-10-15T20:16:41.215626] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-15T20:16:41.216489] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:16:41.216579] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:16:41.216623] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:16:41.216713] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-15T20:16:41.216781] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-15T20:16:41.216815] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-15T20:16:41.216853] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-15T20:16:41.216910] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MS took 27.1s. Estimated remaining: 2h 16m 19s. Rate: 7.1 symbols/min [2025-10-15T20:16:41.802152] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:16:41.809268] [INFO ] [REMOTE ] MRK: Full fetch complete (77578 records). [2025-10-15T20:16:41.809422] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-15T20:16:41.810473] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:16:41.810562] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:16:41.810604] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:16:41.810663] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-15T20:16:41.810744] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-15T20:16:41.810780] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-15T20:16:41.810820] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-15T20:16:41.810899] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MRK took 29.4s. Estimated remaining: 2h 16m 5s. Rate: 7.1 symbols/min [2025-10-15T20:16:42.370451] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:42.563976] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:42.565249] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:42.567596] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-15T20:16:42.562107] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:16:42.568174] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-15T20:16:42.568287] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-15T20:16:42.568340] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-15T20:16:42.568460] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-15T20:16:42.568533] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-15T20:16:42.568070] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-15T20:16:42.568700] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-15T20:16:42.603025] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-15T20:16:42.602919] [DEBUG] [LOCAL ] MSB: Loaded 7777 existing records from primary storage. [2025-10-15T20:16:42.603186] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-15T20:16:42.567948] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-15T20:16:42.613988] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-15T20:16:42.619564] [INFO ] [MAIN ] MSB: Loaded 7777 existing records. [2025-10-15T20:16:42.613868] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-15T20:16:42.643140] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-15T20:16:42.748210] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-15T20:16:42.762109] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-15T20:16:42.781134] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-15T20:16:42.820785] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-15T20:16:43.398374] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:16:43.483151] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-15T20:16:43.521064] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-15T20:16:43.560592] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-15T20:16:43.613058] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:43.658895] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-15T20:16:43.678631] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-15T20:16:43.959780] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:43.976830] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-15T20:16:44.049137] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:44.049437] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-15T20:16:44.291509] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:16:44.291843] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-15T20:16:44.579689] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-15T20:16:44.580537] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-15T20:16:45.016400] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T20:16:45.018789] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-15T20:16:45.117577] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T20:16:45.118929] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-15T20:16:45.193416] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T20:16:45.257556] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T20:16:45.551673] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T20:16:45.714059] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-15T20:16:46.107831] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T20:16:46.513975] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-15T20:16:47.300661] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T20:16:47.318608] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-15T20:16:47.321287] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T20:16:47.817306] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T20:16:48.114039] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-15T20:16:48.914085] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-15T20:16:49.206532] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T20:16:49.357167] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T20:16:49.714011] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-15T20:16:50.514001] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-15T20:16:50.934842] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T20:16:51.314049] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-15T20:16:52.087288] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T20:16:52.113973] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-15T20:16:52.531081] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T20:16:52.914053] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-15T20:16:53.339880] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T20:16:53.713993] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-15T20:16:53.837397] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T20:16:54.513988] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-15T20:16:55.313990] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-15T20:16:55.338321] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T20:16:55.753047] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T20:16:56.113997] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-15T20:16:56.138446] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T20:16:56.913995] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-15T20:16:57.363298] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T20:16:57.513926] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T20:16:57.713999] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-15T20:16:58.514044] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-15T20:16:59.032694] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T20:16:59.314088] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-15T20:16:59.529041] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T20:16:59.680231] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-15T20:17:00.114028] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-15T20:17:00.914026] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-15T20:17:00.963183] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T20:17:01.714062] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-15T20:17:02.255019] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T20:17:02.513994] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-15T20:17:02.674864] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T20:17:03.066824] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T20:17:03.314004] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-15T20:17:03.881990] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T20:17:04.114006] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-15T20:17:04.913965] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-15T20:17:04.966704] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T20:17:05.388554] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T20:17:05.389375] [INFO ] [REMOTE ] MSC: Full fetch complete (2532 records). [2025-10-15T20:17:05.389449] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-15T20:17:05.572109] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-15T20:17:05.572299] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:17:05.572368] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:17:05.572437] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-15T20:17:05.572501] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-15T20:17:05.572537] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-15T20:17:05.572576] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-15T20:17:05.572670] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSC took 23.7s. Estimated remaining: 2h 16m 8s. Rate: 7.1 symbols/min [2025-10-15T20:17:05.722361] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-15T20:17:05.751427] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:05.767970] [DEBUG] [LOCAL ] MSD: Loaded 16509 existing records from primary storage. [2025-10-15T20:17:05.768224] [INFO ] [MAIN ] MSD: Loaded 16509 existing records. [2025-10-15T20:17:05.972251] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:17:05.972500] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-15T20:17:05.972557] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-15T20:17:05.972941] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-15T20:17:05.972999] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-15T20:17:06.351550] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:06.514015] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-15T20:17:06.565884] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T20:17:07.314059] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-15T20:17:07.585226] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:17:08.114003] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-15T20:17:08.241579] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T20:17:08.913965] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-15T20:17:09.240596] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T20:17:09.714058] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-15T20:17:10.458667] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T20:17:10.513965] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-15T20:17:10.618908] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T20:17:11.314005] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-15T20:17:11.396164] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T20:17:12.114102] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-15T20:17:12.295818] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T20:17:12.914048] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-15T20:17:13.620103] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T20:17:13.713999] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-15T20:17:13.775275] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T20:17:14.366392] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T20:17:14.370240] [INFO ] [REMOTE ] MSCI: Full fetch complete (50153 records). [2025-10-15T20:17:14.370350] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-15T20:17:14.371915] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:17:14.372172] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:17:14.372248] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:17:14.372310] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-15T20:17:14.372375] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-15T20:17:14.372421] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-15T20:17:14.372461] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-15T20:17:14.372540] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MSCI took 32.6s. Estimated remaining: 2h 15m 59s. Rate: 7.1 symbols/min [2025-10-15T20:17:14.522387] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-15T20:17:14.561832] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:14.562102] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-15T20:17:14.562161] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-15T20:17:14.562277] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-15T20:17:14.562331] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-15T20:17:14.562399] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-15T20:17:14.562435] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-15T20:17:14.928030] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:15.265854] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:17:15.268084] [INFO ] [REMOTE ] MSA: Full fetch complete (25585 records). [2025-10-15T20:17:15.268173] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-15T20:17:15.268574] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:17:15.268679] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:17:15.268733] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:17:15.268772] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-15T20:17:15.268827] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-15T20:17:15.268864] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-15T20:17:15.268902] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-15T20:17:15.268952] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MSA took 33.5s. Estimated remaining: 2h 15m 46s. Rate: 7.1 symbols/min [2025-10-15T20:17:15.320484] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-15T20:17:15.441682] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:15.441841] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-15T20:17:15.441877] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-15T20:17:15.441985] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-15T20:17:15.442030] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-15T20:17:15.442104] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-15T20:17:15.442153] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-15T20:17:15.789976] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:16.114010] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-15T20:17:16.883081] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T20:17:16.913968] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-15T20:17:17.059265] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T20:17:17.713991] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-15T20:17:17.955627] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T20:17:18.513989] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-15T20:17:18.886384] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T20:17:18.984065] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T20:17:18.985447] [INFO ] [REMOTE ] MSB: Full fetch complete (12965 records). [2025-10-15T20:17:18.985516] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-15T20:17:19.319422] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-15T20:17:19.363667] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-15T20:17:19.363793] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-15T20:17:19.364117] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-15T20:17:19.364157] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-15T20:17:19.364691] [DEBUG] [LOCAL ] MSB: Trimmed 12965 records to 7796 (keeping 200 days of data) [2025-10-15T20:17:19.419137] [DEBUG] [LOCAL ] MSB: Primary data saved (7796 records). [2025-10-15T20:17:19.419338] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-15T20:17:19.419440] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MSB took 37.6s. Estimated remaining: 2h 15m 34s. Rate: 7.1 symbols/min [2025-10-15T20:17:19.667971] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:19.668217] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-15T20:17:19.668278] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-15T20:17:19.668437] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-15T20:17:19.668500] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-15T20:17:19.668567] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-15T20:17:19.668621] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-15T20:17:20.120933] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-15T20:17:20.224221] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:20.762095] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T20:17:20.913954] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-15T20:17:20.937565] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T20:17:21.714006] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-15T20:17:22.221860] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T20:17:22.514051] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-15T20:17:23.239583] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T20:17:23.313985] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-15T20:17:23.389627] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T20:17:24.114004] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-15T20:17:24.256303] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T20:17:24.914001] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-15T20:17:25.379720] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T20:17:25.713993] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-15T20:17:26.211389] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T20:17:26.513993] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-15T20:17:27.173410] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T20:17:27.313996] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-15T20:17:27.332152] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T20:17:28.114053] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-15T20:17:28.817143] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T20:17:28.914240] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-15T20:17:28.976460] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T20:17:29.714083] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-15T20:17:30.019833] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T20:17:30.368316] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T20:17:30.514081] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-15T20:17:31.314063] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-15T20:17:31.607256] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T20:17:32.114047] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-15T20:17:32.420510] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T20:17:32.913994] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-15T20:17:33.491468] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T20:17:33.713987] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-15T20:17:34.232464] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T20:17:34.502354] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T20:17:34.513952] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-15T20:17:35.314019] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-15T20:17:35.566034] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T20:17:36.114034] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-15T20:17:36.338116] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:17:36.913991] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-15T20:17:37.182537] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T20:17:37.714009] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-15T20:17:38.154609] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T20:17:38.513996] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-15T20:17:38.758770] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T20:17:39.314005] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-15T20:17:39.351265] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T20:17:40.114066] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-15T20:17:40.325109] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T20:17:40.914025] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-15T20:17:41.384539] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T20:17:41.714038] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-15T20:17:41.975047] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T20:17:42.514045] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-15T20:17:42.811620] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T20:17:43.314046] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-15T20:17:44.000923] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:17:44.005712] [INFO ] [REMOTE ] MSGE: Full fetch complete (40146 records). [2025-10-15T20:17:44.005855] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-15T20:17:44.006790] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:17:44.006881] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:17:44.006924] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:17:44.006993] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-15T20:17:44.007064] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-15T20:17:44.007101] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-15T20:17:44.007141] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-15T20:17:44.007204] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSGE took 28.7s. Estimated remaining: 2h 15m 37s. Rate: 7.1 symbols/min [2025-10-15T20:17:44.115486] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-15T20:17:44.200977] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:44.201405] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-15T20:17:44.201571] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-15T20:17:44.201843] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-15T20:17:44.201950] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-15T20:17:44.202037] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-15T20:17:44.202317] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-15T20:17:44.351853] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T20:17:44.663241] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:44.914028] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-15T20:17:45.140985] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T20:17:45.714050] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-15T20:17:46.514009] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-15T20:17:46.557114] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T20:17:46.619991] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T20:17:47.314041] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-15T20:17:48.114086] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-15T20:17:48.345776] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T20:17:48.489154] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T20:17:48.824573] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:17:48.830420] [INFO ] [REMOTE ] MSDL: Full fetch complete (55640 records). [2025-10-15T20:17:48.830560] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-15T20:17:48.831376] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:17:48.831467] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:17:48.831511] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:17:48.831561] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-15T20:17:48.831624] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-15T20:17:48.831697] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-15T20:17:48.831800] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-15T20:17:48.831913] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSDL took 34.5s. Estimated remaining: 2h 15m 26s. Rate: 7.1 symbols/min [2025-10-15T20:17:48.919390] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-15T20:17:49.016269] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:49.016518] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-15T20:17:49.016557] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-15T20:17:49.016709] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-15T20:17:49.016764] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-15T20:17:49.016808] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-15T20:17:49.016841] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-15T20:17:49.399162] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:49.579997] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:17:49.583944] [INFO ] [REMOTE ] MSGS: Full fetch complete (23505 records). [2025-10-15T20:17:49.584112] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-15T20:17:49.584747] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:17:49.584848] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:17:49.584921] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:17:49.585013] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-15T20:17:49.585110] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-15T20:17:49.585174] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-15T20:17:49.585249] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-15T20:17:49.585347] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSGS took 30.2s. Estimated remaining: 2h 15m 12s. Rate: 7.1 symbols/min [2025-10-15T20:17:49.719178] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-15T20:17:49.791795] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:49.791988] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-15T20:17:49.792080] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-15T20:17:49.792168] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-15T20:17:49.792206] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-15T20:17:49.792249] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-15T20:17:49.792282] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-15T20:17:50.068098] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:17:50.079226] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-15T20:17:50.084447] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:17:50.089702] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-15T20:17:50.107319] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:17:50.126710] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-15T20:17:50.127960] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-15T20:17:50.142151] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-15T20:17:50.147308] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-15T20:17:50.147205] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:50.147455] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSIF took 1.3s. Estimated remaining: 2h 14m 59s. Rate: 7.1 symbols/min [2025-10-15T20:17:50.318140] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:50.318325] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-15T20:17:50.318362] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-15T20:17:50.318472] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-15T20:17:50.318513] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-15T20:17:50.318554] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-15T20:17:50.318587] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-15T20:17:50.519184] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-15T20:17:50.683939] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:51.314005] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-15T20:17:52.113983] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-15T20:17:52.171277] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T20:17:52.396385] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T20:17:52.913994] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-15T20:17:53.589031] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T20:17:53.671578] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:17:53.674797] [INFO ] [REMOTE ] MSD: Full fetch complete (23175 records). [2025-10-15T20:17:53.674872] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-15T20:17:53.719134] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-15T20:17:54.067228] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-15T20:17:54.067362] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-15T20:17:54.067955] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-15T20:17:54.068018] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-15T20:17:54.068675] [DEBUG] [LOCAL ] MSD: Trimmed 23175 records to 16546 (keeping 200 days of data) [2025-10-15T20:17:54.165498] [DEBUG] [LOCAL ] MSD: Primary data saved (16546 records). [2025-10-15T20:17:54.165636] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-15T20:17:54.165783] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSD took 48.6s. Estimated remaining: 2h 14m 47s. Rate: 7.1 symbols/min [2025-10-15T20:17:54.345284] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:17:54.345499] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-15T20:17:54.345542] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-15T20:17:54.345699] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-15T20:17:54.345752] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-15T20:17:54.345795] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-15T20:17:54.345828] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-15T20:17:54.515929] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-15T20:17:54.718579] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:17:55.313979] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-15T20:17:55.565241] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T20:17:56.113983] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-15T20:17:56.191029] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T20:17:56.704345] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T20:17:56.914005] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-15T20:17:57.713987] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-15T20:17:57.808263] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T20:17:58.514029] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-15T20:17:58.784683] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T20:17:59.314047] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-15T20:17:59.341747] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T20:17:59.593724] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T20:18:00.114051] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-15T20:18:00.913990] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-15T20:18:01.090482] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T20:18:01.622508] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T20:18:01.714064] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-15T20:18:02.514009] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-15T20:18:02.684053] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T20:18:03.314008] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-15T20:18:03.377445] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T20:18:04.114028] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-15T20:18:04.287069] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T20:18:04.914001] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-15T20:18:04.961861] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T20:18:05.525897] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T20:18:05.714026] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-15T20:18:06.513975] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-15T20:18:06.641540] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T20:18:07.243175] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T20:18:07.314028] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-15T20:18:08.114010] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-15T20:18:08.475733] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T20:18:08.913992] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-15T20:18:08.950775] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T20:18:09.714068] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-15T20:18:10.021014] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T20:18:10.371555] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T20:18:10.514066] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-15T20:18:11.314108] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-15T20:18:11.470722] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T20:18:12.114097] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-15T20:18:12.471181] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T20:18:12.914006] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-15T20:18:13.026084] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T20:18:13.262222] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T20:18:13.714099] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-15T20:18:14.314956] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T20:18:14.514034] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-15T20:18:15.182261] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T20:18:15.186367] [INFO ] [REMOTE ] MSI: Full fetch complete (57775 records). [2025-10-15T20:18:15.186495] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-15T20:18:15.187092] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:18:15.187174] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:18:15.187249] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:18:15.187319] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-15T20:18:15.187381] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-15T20:18:15.187416] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-15T20:18:15.187453] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-15T20:18:15.187508] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSI took 31.2s. Estimated remaining: 2h 14m 47s. Rate: 7.1 symbols/min [2025-10-15T20:18:15.316426] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-15T20:18:15.363150] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:18:15.380423] [DEBUG] [LOCAL ] MTD: Loaded 15443 existing records from primary storage. [2025-10-15T20:18:15.380695] [INFO ] [MAIN ] MTD: Loaded 15443 existing records. [2025-10-15T20:18:15.565491] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:18:15.565863] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-15T20:18:15.566053] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-15T20:18:15.575213] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-15T20:18:15.590686] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-15T20:18:15.658617] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-15T20:18:15.990917] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:18:16.113987] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-15T20:18:16.914000] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-15T20:18:16.951947] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T20:18:16.983530] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T20:18:17.714019] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-15T20:18:18.513987] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-15T20:18:18.769371] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T20:18:19.313989] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-15T20:18:19.551736] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T20:18:19.603138] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T20:18:20.114033] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-15T20:18:20.645248] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T20:18:20.913984] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-15T20:18:21.242305] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T20:18:21.714053] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-15T20:18:22.514076] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-15T20:18:22.572435] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T20:18:23.043594] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T20:18:23.271140] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T20:18:23.314035] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-15T20:18:24.114006] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-15T20:18:24.914046] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-15T20:18:25.078282] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T20:18:25.714027] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-15T20:18:25.917538] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T20:18:26.229274] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T20:18:26.514000] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-15T20:18:27.313976] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-15T20:18:27.467153] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:18:27.794632] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T20:18:27.882806] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T20:18:27.887993] [INFO ] [REMOTE ] MTB: Full fetch complete (67738 records). [2025-10-15T20:18:27.888142] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-15T20:18:27.888978] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:18:27.889068] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:18:27.889139] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:18:27.889239] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-15T20:18:27.889328] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-15T20:18:27.889406] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-15T20:18:27.889457] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-15T20:18:27.889530] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MTB took 33.7s. Estimated remaining: 2h 14m 42s. Rate: 7.1 symbols/min [2025-10-15T20:18:28.075752] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:18:28.075967] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-15T20:18:28.076018] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-15T20:18:28.076137] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-15T20:18:28.076180] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-15T20:18:28.076223] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-15T20:18:28.076257] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-15T20:18:28.119081] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-15T20:18:28.424294] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:18:28.914019] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-15T20:18:29.195830] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T20:18:29.714075] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-15T20:18:30.513975] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-15T20:18:30.627039] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T20:18:31.313991] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-15T20:18:31.446968] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:18:31.743906] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T20:18:32.114038] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-15T20:18:32.822820] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T20:18:32.875505] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:18:32.880002] [INFO ] [REMOTE ] MSM: Full fetch complete (51790 records). [2025-10-15T20:18:32.880120] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-15T20:18:32.880873] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:18:32.880959] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:18:32.881002] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:18:32.881069] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-15T20:18:32.881133] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-15T20:18:32.881167] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-15T20:18:32.881206] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-15T20:18:32.881265] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MSM took 43.3s. Estimated remaining: 2h 14m 31s. Rate: 7.1 symbols/min [2025-10-15T20:18:32.919238] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-15T20:18:33.062052] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:18:33.062242] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-15T20:18:33.062280] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-15T20:18:33.062403] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-15T20:18:33.062444] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-15T20:18:33.062484] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-15T20:18:33.062516] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-15T20:18:33.455721] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:18:33.714077] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-15T20:18:34.450054] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:18:34.455925] [INFO ] [REMOTE ] MT: Full fetch complete (73375 records). [2025-10-15T20:18:34.456043] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-15T20:18:34.456937] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:18:34.457022] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:18:34.457064] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:18:34.457131] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-15T20:18:34.457194] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-15T20:18:34.457229] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-15T20:18:34.457267] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-15T20:18:34.457324] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MT took 44.3s. Estimated remaining: 2h 14m 18s. Rate: 7.1 symbols/min [2025-10-15T20:18:34.519132] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-15T20:18:34.633202] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:18:34.633508] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-15T20:18:34.633586] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-15T20:18:34.633751] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-15T20:18:34.633907] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-15T20:18:34.634180] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-15T20:18:34.634313] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-15T20:18:34.804794] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T20:18:35.026809] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:18:35.313986] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-15T20:18:35.421262] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:18:36.114023] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-15T20:18:36.758854] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T20:18:36.913982] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-15T20:18:37.191722] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T20:18:37.714103] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-15T20:18:38.513976] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-15T20:18:38.564724] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T20:18:39.314048] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-15T20:18:39.466286] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:18:39.510888] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T20:18:40.114054] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-15T20:18:40.921542] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-15T20:18:40.926537] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T20:18:41.713988] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-15T20:18:41.774493] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T20:18:42.513974] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-15T20:18:42.862277] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T20:18:43.323840] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-15T20:18:43.333190] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T20:18:44.118777] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-15T20:18:44.127447] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T20:18:44.914041] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-15T20:18:45.131547] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T20:18:45.133917] [INFO ] [REMOTE ] MTD: Full fetch complete (21397 records). [2025-10-15T20:18:45.134016] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-15T20:18:45.562440] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-15T20:18:45.563288] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-15T20:18:45.574303] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-15T20:18:45.574945] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-15T20:18:45.575344] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-15T20:18:45.576675] [DEBUG] [LOCAL ] MTD: Trimmed 21397 records to 15452 (keeping 200 days of data) [2025-10-15T20:18:45.677885] [DEBUG] [LOCAL ] MTD: Primary data saved (15452 records). [2025-10-15T20:18:45.678037] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-15T20:18:45.678119] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MTD took 30.5s. Estimated remaining: 2h 14m 11s. Rate: 7.1 symbols/min [2025-10-15T20:18:45.722893] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-15T20:18:45.848151] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:18:45.848330] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-15T20:18:45.848367] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-15T20:18:45.848487] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-15T20:18:45.848527] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-15T20:18:45.848567] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-15T20:18:45.848598] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-15T20:18:46.188864] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:18:46.514004] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-15T20:18:46.693453] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T20:18:47.314032] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-15T20:18:47.663931] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T20:18:48.114031] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-15T20:18:48.183008] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T20:18:48.913996] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-15T20:18:48.953110] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T20:18:49.713983] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-15T20:18:49.864216] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T20:18:50.513969] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-15T20:18:50.757004] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T20:18:51.203545] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T20:18:51.313984] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-15T20:18:52.114927] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-15T20:18:52.120167] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T20:18:52.913970] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-15T20:18:53.121870] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T20:18:53.713968] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-15T20:18:53.831844] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T20:18:54.037437] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T20:18:54.514048] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-15T20:18:55.127901] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T20:18:55.314046] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-15T20:18:56.091183] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T20:18:56.113959] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-15T20:18:56.914083] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-15T20:18:56.995706] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T20:18:57.714030] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-15T20:18:57.879243] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T20:18:58.405299] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T20:18:58.513998] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-15T20:18:59.251822] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T20:18:59.314038] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-15T20:19:00.114078] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-15T20:19:00.259073] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T20:19:00.914075] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-15T20:19:01.289620] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T20:19:01.714057] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-15T20:19:01.808949] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T20:19:02.462973] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T20:19:02.514016] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-15T20:19:03.232534] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:19:03.237449] [INFO ] [REMOTE ] MTH: Full fetch complete (63531 records). [2025-10-15T20:19:03.237549] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-15T20:19:03.238501] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:03.238596] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:03.238661] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:03.238727] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-15T20:19:03.238787] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-15T20:19:03.238823] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-15T20:19:03.238866] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-15T20:19:03.238922] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MTH took 28.8s. Estimated remaining: 2h 14m 9s. Rate: 7.1 symbols/min [2025-10-15T20:19:03.315847] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-15T20:19:03.414857] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:03.415176] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-15T20:19:03.415351] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-15T20:19:03.415508] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-15T20:19:03.415699] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-15T20:19:03.415820] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-15T20:19:03.415872] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-15T20:19:03.788135] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T20:19:03.806904] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:04.114062] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-15T20:19:04.174614] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T20:19:04.183152] [INFO ] [REMOTE ] MTDR: Full fetch complete (73671 records). [2025-10-15T20:19:04.183399] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-15T20:19:04.184703] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:04.184842] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:04.184918] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:04.185018] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-15T20:19:04.185108] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-15T20:19:04.185148] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-15T20:19:04.185189] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-15T20:19:04.185277] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MTDR took 36.3s. Estimated remaining: 2h 13m 56s. Rate: 7.1 symbols/min [2025-10-15T20:19:04.402730] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:04.402945] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-15T20:19:04.402986] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-15T20:19:04.403131] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-15T20:19:04.403207] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-15T20:19:04.403273] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-15T20:19:04.403337] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-15T20:19:04.715411] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T20:19:04.919175] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-15T20:19:04.956375] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:05.714013] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-15T20:19:06.514033] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-15T20:19:06.607476] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T20:19:06.633349] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T20:19:07.102771] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T20:19:07.314068] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-15T20:19:08.113994] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-15T20:19:08.320408] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T20:19:08.914023] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-15T20:19:09.422141] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T20:19:09.713968] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-15T20:19:09.915634] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T20:19:10.514078] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-15T20:19:10.723538] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T20:19:11.314002] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-15T20:19:12.113984] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-15T20:19:12.368819] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T20:19:12.437153] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T20:19:12.914046] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-15T20:19:13.685400] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T20:19:13.691317] [INFO ] [REMOTE ] MTG: Full fetch complete (73817 records). [2025-10-15T20:19:13.691442] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-15T20:19:13.692278] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:13.692372] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:13.692414] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:13.692476] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-15T20:19:13.692563] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-15T20:19:13.692611] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-15T20:19:13.692706] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-15T20:19:13.692800] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTG took 40.8s. Estimated remaining: 2h 13m 48s. Rate: 7.1 symbols/min [2025-10-15T20:19:13.719057] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-15T20:19:13.899427] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:13.900271] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-15T20:19:13.901822] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-15T20:19:13.901720] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T20:19:13.910795] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-15T20:19:13.911370] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-15T20:19:13.911444] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-15T20:19:13.911481] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-15T20:19:14.203726] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-15T20:19:14.283189] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:14.514014] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-15T20:19:15.314002] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-15T20:19:15.681001] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T20:19:16.114028] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-15T20:19:16.914051] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-15T20:19:17.055706] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T20:19:17.336319] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T20:19:17.593282] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T20:19:17.714024] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-15T20:19:18.513968] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-15T20:19:18.883064] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T20:19:19.313994] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-15T20:19:19.710534] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T20:19:20.114070] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-15T20:19:20.655682] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T20:19:20.914031] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-15T20:19:21.044482] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:19:21.714019] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-15T20:19:21.982068] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T20:19:22.455899] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:19:22.461324] [INFO ] [REMOTE ] MTN: Full fetch complete (56449 records). [2025-10-15T20:19:22.461479] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-15T20:19:22.462108] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:22.462195] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:22.462239] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:22.462281] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-15T20:19:22.462338] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-15T20:19:22.462374] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-15T20:19:22.462415] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-15T20:19:22.462474] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTN took 36.8s. Estimated remaining: 2h 13m 40s. Rate: 7.1 symbols/min [2025-10-15T20:19:22.519196] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-15T20:19:22.637755] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:22.637963] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-15T20:19:22.638004] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-15T20:19:22.638116] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-15T20:19:22.638156] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-15T20:19:22.638195] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-15T20:19:22.638227] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-15T20:19:22.997282] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:23.314043] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-15T20:19:23.934762] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T20:19:24.114012] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-15T20:19:24.729017] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T20:19:24.910076] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T20:19:24.913944] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-15T20:19:25.447398] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T20:19:25.714007] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-15T20:19:26.514036] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-15T20:19:26.937978] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T20:19:27.314094] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-15T20:19:27.751745] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T20:19:27.942586] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T20:19:28.114036] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-15T20:19:28.571024] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T20:19:28.913992] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-15T20:19:29.714007] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-15T20:19:30.040003] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T20:19:30.513990] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-15T20:19:30.945873] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T20:19:30.946594] [INFO ] [REMOTE ] MTR: Full fetch complete (2426 records). [2025-10-15T20:19:30.946708] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-15T20:19:31.156801] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T20:19:31.161871] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T20:19:31.164286] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:31.168578] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:31.168713] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-15T20:19:31.169079] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-15T20:19:31.169136] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-15T20:19:31.169182] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-15T20:19:31.169285] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTR took 27.9s. Estimated remaining: 2h 13m 31s. Rate: 7.1 symbols/min [2025-10-15T20:19:31.317373] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-15T20:19:31.352621] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:31.352830] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-15T20:19:31.352880] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-15T20:19:31.353004] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-15T20:19:31.353046] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-15T20:19:31.353087] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-15T20:19:31.353121] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-15T20:19:31.743261] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:32.114005] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-15T20:19:32.478473] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T20:19:32.914040] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-15T20:19:33.053738] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T20:19:33.714016] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-15T20:19:34.025066] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T20:19:34.514000] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-15T20:19:34.821865] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T20:19:35.313991] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-15T20:19:35.805710] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T20:19:36.113981] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-15T20:19:36.381797] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T20:19:36.914043] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-15T20:19:37.092945] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T20:19:37.714000] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-15T20:19:38.321427] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T20:19:38.513987] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-15T20:19:38.769055] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T20:19:39.313992] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-15T20:19:39.607895] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T20:19:40.114017] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-15T20:19:40.238469] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T20:19:40.914062] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-15T20:19:41.298777] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T20:19:41.534497] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T20:19:41.536881] [INFO ] [REMOTE ] MTRN: Full fetch complete (23812 records). [2025-10-15T20:19:41.536953] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-15T20:19:41.537436] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:41.537519] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:41.537561] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:41.537598] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-15T20:19:41.537678] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-15T20:19:41.537733] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-15T20:19:41.537804] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-15T20:19:41.537884] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTRN took 37.4s. Estimated remaining: 2h 13m 24s. Rate: 7.1 symbols/min [2025-10-15T20:19:41.706682] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:41.706881] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-15T20:19:41.706921] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-15T20:19:41.707039] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-15T20:19:41.707082] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-15T20:19:41.707126] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-15T20:19:41.707160] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-15T20:19:41.720001] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-15T20:19:42.075235] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:42.513998] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-15T20:19:43.126707] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T20:19:43.313988] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-15T20:19:43.612990] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T20:19:44.114030] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-15T20:19:44.509592] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T20:19:44.913993] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-15T20:19:45.296344] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T20:19:45.714004] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-15T20:19:46.088345] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T20:19:46.514002] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-15T20:19:46.609148] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:19:47.065312] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:19:47.068785] [INFO ] [REMOTE ] MTUS: Full fetch complete (41278 records). [2025-10-15T20:19:47.068892] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-15T20:19:47.069430] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:47.069514] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:47.069556] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:47.069594] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-15T20:19:47.069672] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-15T20:19:47.069727] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-15T20:19:47.069773] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-15T20:19:47.069829] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTUS took 33.4s. Estimated remaining: 2h 13m 14s. Rate: 7.1 symbols/min [2025-10-15T20:19:47.240289] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:47.240483] [DEBUG] [LOCAL ] MUA: No existing data file found in primary storage. [2025-10-15T20:19:47.240521] [WARN ] [MAIN ] MUA: No existing data found, performing full refresh instead. [2025-10-15T20:19:47.240637] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-15T20:19:47.240714] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-15T20:19:47.240761] [DEBUG] [LOCAL ] MUA: No primary data file found to delete. [2025-10-15T20:19:47.240795] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-15T20:19:47.319055] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-15T20:19:47.609466] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:48.114000] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-15T20:19:48.718602] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T20:19:48.913979] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-15T20:19:49.301104] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T20:19:49.713970] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-15T20:19:49.784806] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T20:19:50.513974] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-15T20:19:51.137334] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T20:19:51.141045] [INFO ] [REMOTE ] MTW: Full fetch complete (38018 records). [2025-10-15T20:19:51.141159] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-15T20:19:51.141973] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:19:51.142088] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:19:51.142475] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:19:51.142679] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-15T20:19:51.142858] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-15T20:19:51.143054] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-15T20:19:51.143244] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-15T20:19:51.143383] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTW took 28.7s. Estimated remaining: 2h 13m 3s. Rate: 7.1 symbols/min [2025-10-15T20:19:51.320103] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-15T20:19:51.324198] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:19:51.324709] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-15T20:19:51.326330] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-15T20:19:51.326502] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-15T20:19:51.326565] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-15T20:19:51.326627] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-15T20:19:51.326711] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-15T20:19:51.570246] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T20:19:51.730312] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:19:52.113992] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-15T20:19:52.262092] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T20:19:52.913994] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-15T20:19:53.714003] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-15T20:19:53.799552] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T20:19:53.844801] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T20:19:54.514020] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-15T20:19:54.855629] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T20:19:55.282819] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T20:19:55.313968] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-15T20:19:56.113983] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-15T20:19:56.391285] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T20:19:56.914031] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-15T20:19:57.074156] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T20:19:57.714080] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-15T20:19:58.019743] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T20:19:58.514011] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-15T20:19:58.971824] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T20:19:59.313990] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-15T20:19:59.816602] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T20:20:00.114014] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-15T20:20:00.641523] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T20:20:00.913970] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-15T20:20:01.218852] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T20:20:01.714089] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-15T20:20:02.007538] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T20:20:02.514067] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-15T20:20:03.314003] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-15T20:20:03.427298] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T20:20:03.491247] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T20:20:04.113989] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-15T20:20:04.189923] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T20:20:04.914051] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-15T20:20:05.114208] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T20:20:05.714005] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-15T20:20:05.935152] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T20:20:06.514047] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-15T20:20:07.313969] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-15T20:20:07.520631] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T20:20:07.593435] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T20:20:08.114061] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-15T20:20:08.445748] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T20:20:08.914049] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-15T20:20:09.476595] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:20:09.479015] [INFO ] [REMOTE ] MTX: Full fetch complete (31206 records). [2025-10-15T20:20:09.479108] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-15T20:20:09.479624] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:20:09.479741] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:20:09.479787] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:20:09.479857] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-15T20:20:09.479919] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-15T20:20:09.479958] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-15T20:20:09.479997] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-15T20:20:09.480052] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTX took 38.3s. Estimated remaining: 2h 13m 1s. Rate: 7.1 symbols/min [2025-10-15T20:20:09.657815] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:09.670489] [DEBUG] [LOCAL ] MUE: Loaded 11872 existing records from primary storage. [2025-10-15T20:20:09.670773] [INFO ] [MAIN ] MUE: Loaded 11872 existing records. [2025-10-15T20:20:09.723423] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-15T20:20:09.887912] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:20:09.889484] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T20:20:09.889812] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-15T20:20:09.899198] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-15T20:20:09.900194] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-15T20:20:09.900257] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-15T20:20:10.257686] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:10.513978] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-15T20:20:10.668495] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T20:20:11.314033] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-15T20:20:11.440758] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T20:20:12.114099] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-15T20:20:12.914010] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-15T20:20:13.076887] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T20:20:13.112384] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T20:20:13.714032] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-15T20:20:14.142072] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T20:20:14.514071] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-15T20:20:14.878081] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T20:20:15.314062] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-15T20:20:16.113970] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-15T20:20:16.145393] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T20:20:16.401600] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T20:20:16.840868] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T20:20:16.914049] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-15T20:20:17.713971] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-15T20:20:18.506511] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:20:18.509153] [INFO ] [REMOTE ] MUA: Full fetch complete (18519 records). [2025-10-15T20:20:18.509258] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-15T20:20:18.522829] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-15T20:20:18.746410] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T20:20:18.965940] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-15T20:20:18.966027] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-15T20:20:18.966454] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-15T20:20:18.966493] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-15T20:20:18.967056] [DEBUG] [LOCAL ] MUA: Trimmed 18519 records to 11546 (keeping 200 days of data) [2025-10-15T20:20:19.039922] [DEBUG] [LOCAL ] MUA: Primary data saved (11546 records). [2025-10-15T20:20:19.040073] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-15T20:20:19.040148] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MUA took 32.0s. Estimated remaining: 2h 12m 53s. Rate: 7.1 symbols/min [2025-10-15T20:20:19.209153] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:19.209344] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-15T20:20:19.209399] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-15T20:20:19.209511] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-15T20:20:19.209564] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-15T20:20:19.209631] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-15T20:20:19.209710] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-15T20:20:19.318381] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-15T20:20:19.562843] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:19.567927] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T20:20:20.114021] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-15T20:20:20.914006] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-15T20:20:20.945613] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T20:20:21.191745] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T20:20:21.714115] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-15T20:20:22.513972] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-15T20:20:22.661758] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:20:22.693332] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T20:20:23.313998] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-15T20:20:24.097091] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T20:20:24.113964] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-15T20:20:24.913977] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-15T20:20:25.040095] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T20:20:25.185109] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T20:20:25.714013] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-15T20:20:25.806894] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T20:20:26.513998] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-15T20:20:27.229845] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:20:27.235245] [INFO ] [REMOTE ] MTZ: Full fetch complete (63444 records). [2025-10-15T20:20:27.235366] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-15T20:20:27.236063] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:20:27.236168] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:20:27.236244] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:20:27.236348] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-15T20:20:27.236427] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-15T20:20:27.236465] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-15T20:20:27.236506] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-15T20:20:27.236564] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MTZ took 45.7s. Estimated remaining: 2h 12m 45s. Rate: 7.1 symbols/min [2025-10-15T20:20:27.319341] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-15T20:20:27.409777] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:27.409977] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-15T20:20:27.410074] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-15T20:20:27.410303] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-15T20:20:27.410421] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-15T20:20:27.410527] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-15T20:20:27.410580] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-15T20:20:27.694134] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-15T20:20:27.800770] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:28.114033] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-15T20:20:28.427614] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T20:20:28.914004] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-15T20:20:29.312633] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T20:20:29.714007] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-15T20:20:29.866817] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T20:20:30.134824] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T20:20:30.137449] [INFO ] [REMOTE ] MUC: Full fetch complete (29471 records). [2025-10-15T20:20:30.137530] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-15T20:20:30.138110] [FATAL] [VALIDATOR ] MUC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:20:30.138188] [FATAL] [MAIN ] MUC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:20:30.138255] [WARN ] [MAIN ] MUC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:20:30.138326] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-15T20:20:30.138389] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-15T20:20:30.138449] [INFO ] [LOCAL ] MUC: Starting deletion of derivative data. [2025-10-15T20:20:30.138522] [DEBUG] [LOCAL ] MUC: No derivative data file found to delete. [2025-10-15T20:20:30.138582] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MUC took 39.0s. Estimated remaining: 2h 12m 32s. Rate: 7.1 symbols/min [2025-10-15T20:20:30.316960] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:30.317142] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-15T20:20:30.317179] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-15T20:20:30.317287] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-15T20:20:30.317329] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-15T20:20:30.317371] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-15T20:20:30.317402] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-15T20:20:30.519115] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-15T20:20:30.672935] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:31.314015] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-15T20:20:32.113963] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-15T20:20:32.419389] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T20:20:32.526602] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T20:20:32.913996] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-15T20:20:33.666360] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T20:20:33.713962] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-15T20:20:33.751174] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T20:20:34.514041] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-15T20:20:35.313991] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-15T20:20:35.354600] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T20:20:35.447074] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T20:20:36.113977] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-15T20:20:36.875174] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T20:20:36.913984] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-15T20:20:37.227987] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T20:20:37.593633] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T20:20:37.713998] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-15T20:20:38.514033] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-15T20:20:38.646387] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T20:20:39.314001] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-15T20:20:40.114003] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-15T20:20:40.505617] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T20:20:40.773065] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T20:20:40.913973] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-15T20:20:41.247113] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T20:20:41.714008] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-15T20:20:42.330453] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T20:20:42.332504] [INFO ] [REMOTE ] MUE: Full fetch complete (15940 records). [2025-10-15T20:20:42.332599] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-15T20:20:42.518056] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-15T20:20:42.716139] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-15T20:20:42.716258] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-15T20:20:42.716723] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-15T20:20:42.716971] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-15T20:20:42.744328] [DEBUG] [LOCAL ] MUE: Trimmed 15940 records to 11930 (keeping 200 days of data) [2025-10-15T20:20:42.746967] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T20:20:42.828967] [DEBUG] [LOCAL ] MUE: Primary data saved (11930 records). [2025-10-15T20:20:42.829102] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-15T20:20:42.829187] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MUE took 33.3s. Estimated remaining: 2h 12m 27s. Rate: 7.1 symbols/min [2025-10-15T20:20:42.993523] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:42.993734] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-15T20:20:42.993780] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-15T20:20:42.993903] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-15T20:20:42.993960] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-15T20:20:42.994032] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-15T20:20:42.994077] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-15T20:20:43.321326] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-15T20:20:43.346237] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:43.696007] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T20:20:44.113999] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-15T20:20:44.913971] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-15T20:20:45.254182] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T20:20:45.275888] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T20:20:45.714006] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-15T20:20:45.931954] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:20:46.514020] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-15T20:20:46.844557] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T20:20:47.282481] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T20:20:47.314000] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-15T20:20:48.113980] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-15T20:20:48.913976] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-15T20:20:49.255223] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T20:20:49.334214] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T20:20:49.714045] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-15T20:20:50.043343] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T20:20:50.514002] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-15T20:20:51.313969] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-15T20:20:51.574547] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T20:20:51.867593] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T20:20:52.051240] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:20:52.053549] [INFO ] [REMOTE ] MUJ: Full fetch complete (19836 records). [2025-10-15T20:20:52.053684] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-15T20:20:52.054192] [FATAL] [VALIDATOR ] MUJ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:20:52.054279] [FATAL] [MAIN ] MUJ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:20:52.054322] [WARN ] [MAIN ] MUJ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:20:52.054360] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-15T20:20:52.054414] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-15T20:20:52.054448] [INFO ] [LOCAL ] MUJ: Starting deletion of derivative data. [2025-10-15T20:20:52.054485] [DEBUG] [LOCAL ] MUJ: No derivative data file found to delete. [2025-10-15T20:20:52.054540] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MUJ took 24.8s. Estimated remaining: 2h 12m 19s. Rate: 7.1 symbols/min [2025-10-15T20:20:52.119246] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-15T20:20:52.229134] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:52.229319] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-15T20:20:52.229355] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-15T20:20:52.229466] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-15T20:20:52.229508] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-15T20:20:52.229553] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-15T20:20:52.229585] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-15T20:20:52.580289] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:52.914029] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-15T20:20:53.541143] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T20:20:53.714023] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-15T20:20:54.259112] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T20:20:54.514071] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-15T20:20:54.807597] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-15T20:20:55.166858] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T20:20:55.314050] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-15T20:20:56.114045] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-15T20:20:56.914080] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-15T20:20:57.235341] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:20:57.239491] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-15T20:20:57.243736] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T20:20:57.243888] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:20:57.255173] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-15T20:20:57.255939] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:20:57.256247] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-15T20:20:57.256342] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-15T20:20:57.256383] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-15T20:20:57.256424] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-15T20:20:57.256486] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUSE took 5.2s. Estimated remaining: 2h 12m 8s. Rate: 7.1 symbols/min [2025-10-15T20:20:57.440496] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:20:57.440785] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-15T20:20:57.440853] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-15T20:20:57.441010] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-15T20:20:57.441071] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-15T20:20:57.441118] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-15T20:20:57.441151] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-15T20:20:57.718888] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-15T20:20:57.799573] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:20:58.019469] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T20:20:58.514031] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-15T20:20:58.866149] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T20:20:59.314078] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-15T20:20:59.975583] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T20:21:00.113959] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-15T20:21:00.334739] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:21:00.914023] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-15T20:21:01.714029] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-15T20:21:01.777352] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T20:21:02.513982] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-15T20:21:02.732449] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T20:21:02.801617] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T20:21:03.313991] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-15T20:21:04.100549] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T20:21:04.113952] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-15T20:21:04.621157] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T20:21:04.914000] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-15T20:21:05.714007] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-15T20:21:05.747338] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T20:21:06.514005] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-15T20:21:06.803743] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T20:21:07.056061] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T20:21:07.064058] [INFO ] [REMOTE ] MUSA: Full fetch complete (35083 records). [2025-10-15T20:21:07.064223] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-15T20:21:07.064994] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:21:07.065104] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:21:07.065183] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:21:07.065602] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-15T20:21:07.065739] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-15T20:21:07.065805] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-15T20:21:07.065853] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-15T20:21:07.065919] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUSA took 24.2s. Estimated remaining: 2h 12m 1s. Rate: 7.1 symbols/min [2025-10-15T20:21:07.305893] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:07.313994] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-15T20:21:07.322112] [DEBUG] [LOCAL ] MVF: Loaded 12789 existing records from primary storage. [2025-10-15T20:21:07.322444] [INFO ] [MAIN ] MVF: Loaded 12789 existing records. [2025-10-15T20:21:07.544438] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:21:07.544739] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-15T20:21:07.544795] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-15T20:21:07.545146] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-15T20:21:07.545206] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-15T20:21:07.975980] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:08.001188] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-15T20:21:08.114049] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-15T20:21:08.167836] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T20:21:08.174502] [INFO ] [REMOTE ] MUFG: Full fetch complete (75418 records). [2025-10-15T20:21:08.174739] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-15T20:21:08.175893] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:21:08.176086] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:21:08.176172] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:21:08.176254] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-15T20:21:08.176321] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-15T20:21:08.176358] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-15T20:21:08.176398] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-15T20:21:08.176462] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUFG took 49.1s. Estimated remaining: 2h 11m 48s. Rate: 7.1 symbols/min [2025-10-15T20:21:08.356361] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:08.365852] [DEBUG] [LOCAL ] MVO: Loaded 8805 existing records from primary storage. [2025-10-15T20:21:08.366066] [INFO ] [MAIN ] MVO: Loaded 8805 existing records. [2025-10-15T20:21:08.543809] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:21:08.544079] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-15T20:21:08.544141] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-15T20:21:08.544446] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-15T20:21:08.544516] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-15T20:21:08.901145] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:08.913961] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-15T20:21:09.242502] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:21:09.637182] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T20:21:09.714015] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-15T20:21:10.514074] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-15T20:21:10.539285] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T20:21:11.314064] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-15T20:21:12.113985] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-15T20:21:12.146959] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T20:21:12.197284] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T20:21:12.913961] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-15T20:21:13.002844] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T20:21:13.714055] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-15T20:21:14.439432] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T20:21:14.514016] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-15T20:21:15.313968] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-15T20:21:15.663354] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T20:21:15.951189] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T20:21:16.114047] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-15T20:21:16.152670] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T20:21:16.914059] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-15T20:21:17.713966] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-15T20:21:17.841332] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T20:21:17.889559] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T20:21:18.513967] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-15T20:21:18.547905] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T20:21:19.314000] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-15T20:21:20.124130] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-15T20:21:20.130596] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T20:21:20.144158] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T20:21:20.914077] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-15T20:21:21.097166] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T20:21:21.713995] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-15T20:21:22.519115] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-15T20:21:22.540102] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T20:21:22.648449] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T20:21:23.314022] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-15T20:21:23.469177] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:21:23.861580] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:21:23.869823] [INFO ] [REMOTE ] MUR: Full fetch complete (76409 records). [2025-10-15T20:21:23.870030] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-15T20:21:23.870949] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:21:23.871033] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:21:23.871099] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:21:23.871147] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-15T20:21:23.871205] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-15T20:21:23.871240] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-15T20:21:23.871277] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-15T20:21:23.871338] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MUR took 53.7s. Estimated remaining: 2h 11m 44s. Rate: 7.1 symbols/min [2025-10-15T20:21:24.042843] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:24.054467] [DEBUG] [LOCAL ] MVT: Loaded 10023 existing records from primary storage. [2025-10-15T20:21:24.054934] [INFO ] [MAIN ] MVT: Loaded 10023 existing records. [2025-10-15T20:21:24.119233] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-15T20:21:24.236995] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:21:24.237210] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-15T20:21:24.237258] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-15T20:21:24.237529] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-15T20:21:24.237586] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-15T20:21:24.598368] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:24.914039] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-15T20:21:25.122479] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T20:21:25.641701] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:21:25.647449] [INFO ] [REMOTE ] MUX: Full fetch complete (60377 records). [2025-10-15T20:21:25.647602] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-15T20:21:25.648385] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:21:25.648474] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:21:25.648516] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:21:25.648579] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-15T20:21:25.648670] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-15T20:21:25.648728] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-15T20:21:25.648772] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-15T20:21:25.648827] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUX took 28.4s. Estimated remaining: 2h 11m 31s. Rate: 7.1 symbols/min [2025-10-15T20:21:25.719115] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-15T20:21:25.823087] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:25.823302] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-15T20:21:25.823352] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-15T20:21:25.823464] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-15T20:21:25.823505] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-15T20:21:25.823546] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-15T20:21:25.823579] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-15T20:21:26.172204] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:26.514015] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-15T20:21:26.802355] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T20:21:27.292951] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T20:21:27.313996] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-15T20:21:28.114046] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-15T20:21:28.195456] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T20:21:28.914021] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-15T20:21:28.974141] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T20:21:29.714015] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-15T20:21:30.402227] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T20:21:30.514032] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-15T20:21:30.690967] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T20:21:31.313999] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-15T20:21:32.041279] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T20:21:32.069517] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T20:21:32.113983] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-15T20:21:32.686698] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T20:21:32.914000] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-15T20:21:33.714002] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-15T20:21:34.513989] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-15T20:21:34.615869] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T20:21:34.615534] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T20:21:35.179388] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T20:21:35.314009] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-15T20:21:36.114021] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-15T20:21:36.144113] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T20:21:36.914022] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-15T20:21:36.936530] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T20:21:37.714029] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-15T20:21:37.944911] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T20:21:38.513994] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-15T20:21:39.314018] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-15T20:21:39.508558] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T20:21:39.510689] [INFO ] [REMOTE ] MVF: Full fetch complete (18479 records). [2025-10-15T20:21:39.510759] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-15T20:21:39.890946] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-15T20:21:39.930304] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-15T20:21:39.930379] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-15T20:21:39.930827] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-15T20:21:39.930888] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-15T20:21:39.931418] [DEBUG] [LOCAL ] MVF: Trimmed 18479 records to 12768 (keeping 200 days of data) [2025-10-15T20:21:40.007618] [DEBUG] [LOCAL ] MVF: Primary data saved (12768 records). [2025-10-15T20:21:40.007854] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-15T20:21:40.007949] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MVF took 32.9s. Estimated remaining: 2h 11m 27s. Rate: 7.1 symbols/min [2025-10-15T20:21:40.115101] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-15T20:21:40.141944] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T20:21:40.195668] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:40.216717] [DEBUG] [LOCAL ] MX: Loaded 22352 existing records from primary storage. [2025-10-15T20:21:40.217006] [INFO ] [MAIN ] MX: Loaded 22352 existing records. [2025-10-15T20:21:40.397235] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:21:40.397473] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-15T20:21:40.397523] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-15T20:21:40.397958] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-15T20:21:40.398015] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-15T20:21:40.779793] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:40.913955] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-15T20:21:41.035477] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T20:21:41.713998] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-15T20:21:42.046595] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:21:42.514049] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-15T20:21:43.173554] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T20:21:43.313465] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T20:21:43.315408] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-15T20:21:44.113991] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-15T20:21:44.842030] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:21:44.843622] [INFO ] [REMOTE ] MVO: Full fetch complete (14618 records). [2025-10-15T20:21:44.843722] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-15T20:21:44.919088] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-15T20:21:45.270378] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T20:21:45.280373] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-15T20:21:45.280458] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-15T20:21:45.290555] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-15T20:21:45.290872] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-15T20:21:45.291804] [DEBUG] [LOCAL ] MVO: Trimmed 14618 records to 8824 (keeping 200 days of data) [2025-10-15T20:21:45.342528] [DEBUG] [LOCAL ] MVO: Primary data saved (8824 records). [2025-10-15T20:21:45.342673] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-15T20:21:45.342774] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MVO took 37.2s. Estimated remaining: 2h 11m 16s. Rate: 7.1 symbols/min [2025-10-15T20:21:45.517530] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:45.517757] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-15T20:21:45.517844] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-15T20:21:45.518014] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-15T20:21:45.518075] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-15T20:21:45.518150] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-15T20:21:45.518205] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-15T20:21:45.719061] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-15T20:21:45.883178] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:45.890020] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T20:21:46.514002] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-15T20:21:47.314017] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-15T20:21:47.357125] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T20:21:47.473886] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:21:47.920731] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T20:21:48.114003] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-15T20:21:48.913990] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-15T20:21:49.065271] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T20:21:49.714030] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-15T20:21:50.258960] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T20:21:50.449472] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T20:21:50.514021] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-15T20:21:51.023844] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T20:21:51.314065] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-15T20:21:52.114074] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-15T20:21:52.591508] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T20:21:52.905859] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:21:52.907947] [INFO ] [REMOTE ] MVT: Full fetch complete (14057 records). [2025-10-15T20:21:52.908038] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-15T20:21:52.922390] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-15T20:21:53.273974] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-15T20:21:53.274047] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-15T20:21:53.274342] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-15T20:21:53.274380] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-15T20:21:53.274868] [DEBUG] [LOCAL ] MVT: Trimmed 14057 records to 10021 (keeping 200 days of data) [2025-10-15T20:21:53.336865] [DEBUG] [LOCAL ] MVT: Primary data saved (10021 records). [2025-10-15T20:21:53.336980] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-15T20:21:53.337060] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MVT took 29.5s. Estimated remaining: 2h 11m 7s. Rate: 7.1 symbols/min [2025-10-15T20:21:53.506738] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:21:53.506957] [DEBUG] [LOCAL ] MXF: No existing data file found in primary storage. [2025-10-15T20:21:53.507006] [WARN ] [MAIN ] MXF: No existing data found, performing full refresh instead. [2025-10-15T20:21:53.507111] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-15T20:21:53.507154] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-15T20:21:53.507210] [DEBUG] [LOCAL ] MXF: No primary data file found to delete. [2025-10-15T20:21:53.507243] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-15T20:21:53.720440] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-15T20:21:53.858084] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:21:54.352944] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T20:21:54.513975] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-15T20:21:54.693709] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T20:21:55.313979] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-15T20:21:55.698900] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T20:21:56.113999] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-15T20:21:56.580286] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T20:21:56.914007] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-15T20:21:57.223937] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T20:21:57.437338] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T20:21:57.714018] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-15T20:21:58.514002] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-15T20:21:58.595508] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T20:21:58.963852] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T20:21:58.972713] [INFO ] [REMOTE ] MWA: Full fetch complete (67557 records). [2025-10-15T20:21:58.972927] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-15T20:21:58.974197] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:21:58.974554] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:21:58.974614] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:21:58.974725] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-15T20:21:58.974814] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-15T20:21:58.974868] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-15T20:21:58.974926] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-15T20:21:58.975010] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MWA took 33.3s. Estimated remaining: 2h 10m 57s. Rate: 7.1 symbols/min [2025-10-15T20:21:59.315252] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-15T20:21:59.853123] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T20:22:00.114055] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-15T20:22:00.623698] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T20:22:00.913996] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-15T20:22:01.347607] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T20:22:01.714064] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-15T20:22:02.182843] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T20:22:02.514058] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-15T20:22:03.314015] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-15T20:22:03.395082] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T20:22:03.866533] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T20:22:04.114008] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-15T20:22:04.914043] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-15T20:22:04.945061] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T20:22:05.713970] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-15T20:22:05.944338] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T20:22:06.514036] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-15T20:22:06.564707] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T20:22:07.314075] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-15T20:22:07.585570] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:22:07.839196] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T20:22:08.114042] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-15T20:22:08.914029] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-15T20:22:09.369530] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T20:22:09.370728] [INFO ] [REMOTE ] MXE: Full fetch complete (2597 records). [2025-10-15T20:22:09.370884] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-15T20:22:09.532930] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T20:22:09.607480] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T20:22:09.607722] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:22:09.607827] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:22:09.607918] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-15T20:22:09.608089] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-15T20:22:09.608146] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-15T20:22:09.608206] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-15T20:22:09.608300] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MXE took 24.3s. Estimated remaining: 2h 10m 50s. Rate: 7.1 symbols/min [2025-10-15T20:22:09.714015] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-15T20:22:10.513997] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-15T20:22:10.671245] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T20:22:11.314067] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-15T20:22:11.378001] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T20:22:12.114030] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-15T20:22:12.377438] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T20:22:12.380058] [INFO ] [REMOTE ] MX: Full fetch complete (31545 records). [2025-10-15T20:22:12.380147] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-15T20:22:12.757128] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-15T20:22:12.757212] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-15T20:22:12.758062] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-15T20:22:12.758127] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-15T20:22:12.758958] [DEBUG] [LOCAL ] MX: Trimmed 31545 records to 22327 (keeping 200 days of data) [2025-10-15T20:22:12.890097] [DEBUG] [LOCAL ] MX: Primary data saved (22327 records). [2025-10-15T20:22:12.890218] [INFO ] [MAIN ] MX: Full history saved. [2025-10-15T20:22:12.890304] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MX took 32.9s. Estimated remaining: 2h 10m 38s. Rate: 7.1 symbols/min [2025-10-15T20:22:12.938302] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T20:22:12.940863] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-15T20:22:13.615917] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T20:22:13.714016] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-15T20:22:14.534044] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T20:22:14.536329] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-15T20:22:15.110983] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T20:22:15.314002] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-15T20:22:15.867610] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T20:22:16.113977] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-15T20:22:16.679845] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T20:22:16.680999] [INFO ] [REMOTE ] MXF: Full fetch complete (9958 records). [2025-10-15T20:22:16.681069] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-15T20:22:17.029507] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-15T20:22:17.029589] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-15T20:22:17.029889] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-15T20:22:17.029953] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-15T20:22:17.030374] [DEBUG] [LOCAL ] MXF: Trimmed 9958 records to 5589 (keeping 200 days of data) [2025-10-15T20:22:17.064339] [DEBUG] [LOCAL ] MXF: Primary data saved (5589 records). [2025-10-15T20:22:17.064472] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-15T20:22:17.064545] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MXF took 23.7s. Estimated remaining: 2h 10m 27s. Rate: 7.1 symbols/min [2025-10-15T20:22:17.629000] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:22:17.766514] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-15T20:22:17.767454] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:22:17.729277] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:22:17.768356] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:22:17.768602] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-15T20:22:17.768512] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-15T20:22:17.769056] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-15T20:22:17.769586] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-15T20:22:17.768926] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-15T20:22:17.769460] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-15T20:22:17.769938] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-15T20:22:17.769882] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-15T20:22:17.770154] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-15T20:22:17.770422] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-15T20:22:17.770367] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-15T20:22:17.770583] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-15T20:22:17.770708] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-15T20:22:17.770885] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-15T20:22:17.770949] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-15T20:22:17.770839] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-15T20:22:17.787548] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-15T20:22:17.934104] [DEBUG] [LOCAL ] MYN: Loaded 9799 existing records from primary storage. [2025-10-15T20:22:17.966950] [INFO ] [MAIN ] MYN: Loaded 9799 existing records. [2025-10-15T20:22:18.918062] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:22:18.962600] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-15T20:22:18.984034] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:22:19.003385] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-15T20:22:18.981165] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:22:19.003752] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-15T20:22:19.017599] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-15T20:22:19.023532] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-15T20:22:19.017721] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-15T20:22:19.108777] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:22:19.118041] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-15T20:22:19.402017] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:22:19.402294] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-15T20:22:20.168610] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T20:22:20.173099] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-15T20:22:20.426375] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T20:22:20.453150] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T20:22:20.467388] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T20:22:20.819171] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T20:22:20.914198] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-15T20:22:21.714012] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-15T20:22:21.885877] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T20:22:22.514042] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-15T20:22:22.866423] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T20:22:23.314052] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-15T20:22:23.725879] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T20:22:24.114012] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-15T20:22:24.349501] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T20:22:24.914029] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-15T20:22:25.247449] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T20:22:25.716499] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-15T20:22:25.721689] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T20:22:26.514031] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-15T20:22:26.879858] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T20:22:27.313989] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-15T20:22:27.608628] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T20:22:28.114023] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-15T20:22:28.764479] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T20:22:28.913981] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-15T20:22:28.978180] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T20:22:29.714022] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-15T20:22:29.821320] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T20:22:30.514030] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-15T20:22:31.089416] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T20:22:31.314051] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-15T20:22:31.455523] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T20:22:32.114005] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-15T20:22:32.567677] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T20:22:32.647709] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T20:22:32.913987] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-15T20:22:33.713980] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-15T20:22:33.797120] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T20:22:34.513999] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-15T20:22:34.937616] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T20:22:35.136540] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T20:22:35.313995] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-15T20:22:36.114003] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-15T20:22:36.153727] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T20:22:36.409342] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-15T20:22:36.411231] [INFO ] [REMOTE ] MYD: Full fetch complete (20164 records). [2025-10-15T20:22:36.411312] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-15T20:22:36.411838] [FATAL] [VALIDATOR ] MYD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:22:36.411919] [FATAL] [MAIN ] MYD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:22:36.411964] [WARN ] [MAIN ] MYD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:22:36.412016] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-15T20:22:36.412070] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-15T20:22:36.412105] [INFO ] [LOCAL ] MYD: Starting deletion of derivative data. [2025-10-15T20:22:36.412143] [DEBUG] [LOCAL ] MYD: No derivative data file found to delete. [2025-10-15T20:22:36.412321] [INFO ] [MAIN ] Update Progress: 1441/2369 symbols completed. MYD took 19.3s. Estimated remaining: 2h 10m 26s. Rate: 7.1 symbols/min [2025-10-15T20:22:36.586670] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:22:36.586863] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-15T20:22:36.586904] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-15T20:22:36.587026] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-15T20:22:36.587071] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-15T20:22:36.587114] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-15T20:22:36.587148] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-15T20:22:36.926033] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-15T20:22:36.983176] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:22:37.714009] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-15T20:22:37.986116] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T20:22:38.513991] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-15T20:22:38.887712] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T20:22:39.108847] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T20:22:39.314069] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-15T20:22:40.113980] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-15T20:22:40.803628] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T20:22:40.914029] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-15T20:22:41.058720] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T20:22:41.714118] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-15T20:22:42.141874] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T20:22:42.514106] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-15T20:22:42.871626] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T20:22:43.313988] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-15T20:22:43.663864] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T20:22:44.028424] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T20:22:44.113962] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-15T20:22:44.914040] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-15T20:22:45.132863] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T20:22:45.714036] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-15T20:22:46.110140] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T20:22:46.514003] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-15T20:22:46.807437] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T20:22:47.100387] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T20:22:47.314058] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-15T20:22:48.114046] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-15T20:22:48.879012] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:22:48.913978] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-15T20:22:49.224010] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T20:22:49.714125] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-15T20:22:50.514006] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-15T20:22:50.676278] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T20:22:50.974201] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T20:22:51.040951] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T20:22:51.043233] [INFO ] [REMOTE ] MYI: Full fetch complete (28367 records). [2025-10-15T20:22:51.043319] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-15T20:22:51.043835] [FATAL] [VALIDATOR ] MYI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:22:51.043914] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:22:51.043979] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:22:51.044049] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-15T20:22:51.044209] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-15T20:22:51.044284] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-10-15T20:22:51.044335] [DEBUG] [LOCAL ] MYI: No derivative data file found to delete. [2025-10-15T20:22:51.044389] [INFO ] [MAIN ] Update Progress: 1442/2369 symbols completed. MYI took 34.0s. Estimated remaining: 2h 10m 21s. Rate: 7.1 symbols/min [2025-10-15T20:22:51.217959] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:22:51.218170] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-15T20:22:51.218215] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-15T20:22:51.218332] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-15T20:22:51.218372] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-15T20:22:51.218413] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-15T20:22:51.218444] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-15T20:22:51.319181] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-15T20:22:51.676780] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:22:52.114093] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-15T20:22:52.914089] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-15T20:22:53.714045] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-15T20:23:04.542032] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (10.83 seconds). [2025-10-15T20:23:04.544496] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-15T20:23:05.753520] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T20:23:05.755543] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (12.84 seconds). [2025-10-15T20:23:05.771368] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-15T20:23:05.772882] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-15T20:23:06.643914] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (14.53 seconds). [2025-10-15T20:23:06.651542] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-15T20:23:06.818131] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T20:23:06.822335] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-15T20:23:07.022055] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (15.70 seconds). [2025-10-15T20:23:07.028316] [INFO ] [REMOTE ] MYE: Full fetch complete (35981 records). [2025-10-15T20:23:07.028484] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-15T20:23:07.029562] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:23:07.029683] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:23:07.029738] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:23:07.029812] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-15T20:23:07.030078] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-15T20:23:07.030145] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-15T20:23:07.030200] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-15T20:23:07.030265] [INFO ] [MAIN ] Update Progress: 1443/2369 symbols completed. MYE took 50.0s. Estimated remaining: 2h 10m 18s. Rate: 7.1 symbols/min [2025-10-15T20:23:07.224231] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:07.224422] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-15T20:23:07.224489] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-15T20:23:07.224713] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-15T20:23:07.224890] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-15T20:23:07.224958] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-15T20:23:07.232150] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-15T20:23:07.309837] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T20:23:07.357846] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-15T20:23:07.617217] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:07.617578] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-15T20:23:07.637535] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T20:23:07.645223] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-15T20:23:07.680159] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T20:23:07.683199] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-15T20:23:08.723147] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T20:23:08.731899] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-15T20:23:08.740812] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T20:23:08.743995] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-15T20:23:08.838059] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T20:23:08.846722] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-15T20:23:09.289919] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:23:09.291635] [INFO ] [REMOTE ] MYN: Full fetch complete (15001 records). [2025-10-15T20:23:09.291725] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-15T20:23:09.645801] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-15T20:23:09.645889] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-15T20:23:09.646243] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-15T20:23:09.646283] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-15T20:23:09.646937] [DEBUG] [LOCAL ] MYN: Trimmed 15001 records to 9786 (keeping 200 days of data) [2025-10-15T20:23:09.707444] [DEBUG] [LOCAL ] MYN: Primary data saved (9786 records). [2025-10-15T20:23:09.707590] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-15T20:23:09.707710] [INFO ] [MAIN ] Update Progress: 1444/2369 symbols completed. MYN took 52.6s. Estimated remaining: 2h 10m 6s. Rate: 7.1 symbols/min [2025-10-15T20:23:09.895907] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:09.896344] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-15T20:23:09.896444] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-15T20:23:09.896697] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-15T20:23:09.896830] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-15T20:23:09.896942] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-15T20:23:09.897021] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-15T20:23:10.123560] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T20:23:10.280990] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-15T20:23:10.310169] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-15T20:23:10.328599] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-15T20:23:10.431983] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:10.433532] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-15T20:23:10.437515] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T20:23:10.446614] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-15T20:23:10.995141] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:23:10.999618] [INFO ] [REMOTE ] NABL: Full fetch complete (56786 records). [2025-10-15T20:23:10.999731] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-15T20:23:11.000322] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:23:11.000403] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:23:11.000446] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:23:11.000505] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-15T20:23:11.000561] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-15T20:23:11.000595] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-15T20:23:11.000632] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-15T20:23:11.000728] [INFO ] [MAIN ] Update Progress: 1445/2369 symbols completed. NABL took 34.6s. Estimated remaining: 2h 9m 53s. Rate: 7.1 symbols/min [2025-10-15T20:23:11.170151] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:11.214266] [DEBUG] [LOCAL ] NAT: Loaded 49216 existing records from primary storage. [2025-10-15T20:23:11.214574] [INFO ] [MAIN ] NAT: Loaded 49216 existing records. [2025-10-15T20:23:11.374052] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T20:23:11.405000] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-15T20:23:11.409864] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:23:11.411609] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-15T20:23:11.429480] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-15T20:23:11.435021] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-15T20:23:11.434704] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T20:23:11.435837] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-15T20:23:11.455205] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-15T20:23:11.644071] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T20:23:11.726733] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-15T20:23:11.845182] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:11.845528] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-15T20:23:12.158329] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T20:23:12.161443] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-15T20:23:12.874377] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T20:23:12.883072] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-15T20:23:12.996843] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T20:23:13.013958] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T20:23:13.013574] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-15T20:23:13.018608] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-15T20:23:13.503214] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T20:23:13.714079] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-15T20:23:13.744350] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T20:23:14.210325] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T20:23:14.364823] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T20:23:14.514029] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-15T20:23:15.313996] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-15T20:23:15.381716] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T20:23:15.649228] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T20:23:16.114038] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-15T20:23:16.875724] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T20:23:16.914039] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-15T20:23:17.714012] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-15T20:23:17.873147] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T20:23:18.114080] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T20:23:18.458143] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T20:23:18.514033] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-15T20:23:19.314021] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-15T20:23:19.928465] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T20:23:20.114048] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-15T20:23:20.913993] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-15T20:23:21.336954] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T20:23:21.653950] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T20:23:21.668150] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T20:23:21.713996] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-15T20:23:22.514019] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-15T20:23:22.644789] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T20:23:23.314017] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-15T20:23:23.403133] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:23:24.113998] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-15T20:23:24.445981] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T20:23:24.914059] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-15T20:23:25.355597] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T20:23:25.614871] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:23:25.618685] [INFO ] [REMOTE ] NAD: Full fetch complete (48776 records). [2025-10-15T20:23:25.618778] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-15T20:23:25.619564] [FATAL] [VALIDATOR ] NAD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:23:25.619670] [FATAL] [MAIN ] NAD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:23:25.619729] [WARN ] [MAIN ] NAD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:23:25.619785] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-15T20:23:25.619865] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-15T20:23:25.619946] [INFO ] [LOCAL ] NAD: Starting deletion of derivative data. [2025-10-15T20:23:25.619998] [DEBUG] [LOCAL ] NAD: No derivative data file found to delete. [2025-10-15T20:23:25.620053] [INFO ] [MAIN ] Update Progress: 1446/2369 symbols completed. NAD took 18.6s. Estimated remaining: 2h 9m 48s. Rate: 7.1 symbols/min [2025-10-15T20:23:25.719143] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-15T20:23:25.796298] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:25.796516] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-15T20:23:25.796574] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-15T20:23:25.796724] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-15T20:23:25.796774] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-15T20:23:25.796838] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-15T20:23:25.796873] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-15T20:23:26.153897] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:26.514025] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-15T20:23:27.314034] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-15T20:23:27.457250] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T20:23:27.683202] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T20:23:28.114026] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-15T20:23:28.394273] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T20:23:28.750819] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T20:23:28.914009] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-15T20:23:29.714001] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-15T20:23:29.754312] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T20:23:30.514015] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-15T20:23:30.942019] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T20:23:31.314011] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-15T20:23:31.514996] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T20:23:32.114055] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-15T20:23:32.656131] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T20:23:32.659005] [INFO ] [REMOTE ] NAC: Full fetch complete (35399 records). [2025-10-15T20:23:32.659086] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-15T20:23:32.659544] [FATAL] [VALIDATOR ] NAC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:23:32.659624] [FATAL] [MAIN ] NAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:23:32.659709] [WARN ] [MAIN ] NAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:23:32.659779] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-15T20:23:32.659841] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-15T20:23:32.659876] [INFO ] [LOCAL ] NAC: Starting deletion of derivative data. [2025-10-15T20:23:32.659915] [DEBUG] [LOCAL ] NAC: No derivative data file found to delete. [2025-10-15T20:23:32.659967] [INFO ] [MAIN ] Update Progress: 1447/2369 symbols completed. NAC took 41.6s. Estimated remaining: 2h 9m 39s. Rate: 7.1 symbols/min [2025-10-15T20:23:32.828823] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:32.832937] [DEBUG] [LOCAL ] NAZ: Loaded 2657 existing records from primary storage. [2025-10-15T20:23:32.833076] [INFO ] [MAIN ] NAZ: Loaded 2657 existing records. [2025-10-15T20:23:32.920241] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-15T20:23:33.011047] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T20:23:33.068015] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:23:33.068323] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-15T20:23:33.068392] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-15T20:23:33.068687] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-15T20:23:33.068783] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-15T20:23:33.420038] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:33.504816] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:23:33.506236] [INFO ] [REMOTE ] NAN: Full fetch complete (13465 records). [2025-10-15T20:23:33.506307] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-15T20:23:33.506721] [FATAL] [VALIDATOR ] NAN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:23:33.506802] [FATAL] [MAIN ] NAN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:23:33.506844] [WARN ] [MAIN ] NAN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:23:33.506883] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-15T20:23:33.506937] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-15T20:23:33.506971] [INFO ] [LOCAL ] NAN: Starting deletion of derivative data. [2025-10-15T20:23:33.507007] [DEBUG] [LOCAL ] NAN: No derivative data file found to delete. [2025-10-15T20:23:33.507058] [INFO ] [MAIN ] Update Progress: 1448/2369 symbols completed. NAN took 23.8s. Estimated remaining: 2h 9m 26s. Rate: 7.1 symbols/min [2025-10-15T20:23:33.677794] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:33.689499] [DEBUG] [LOCAL ] NBB: Loaded 9084 existing records from primary storage. [2025-10-15T20:23:33.689805] [INFO ] [MAIN ] NBB: Loaded 9084 existing records. [2025-10-15T20:23:33.719181] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-15T20:23:33.875379] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:23:33.875709] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-15T20:23:33.875772] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-15T20:23:33.876124] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-15T20:23:33.876189] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-15T20:23:34.239892] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:34.514003] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-15T20:23:35.072514] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T20:23:35.131229] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T20:23:35.314041] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-15T20:23:36.114083] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-15T20:23:36.623431] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T20:23:36.914023] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-15T20:23:37.134161] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T20:23:37.714017] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-15T20:23:38.380854] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T20:23:38.514020] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-15T20:23:38.614539] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T20:23:38.926832] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T20:23:39.314027] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-15T20:23:40.114109] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-15T20:23:40.605291] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T20:23:40.914047] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-15T20:23:40.954407] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T20:23:41.611790] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T20:23:41.714070] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-15T20:23:42.514022] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-15T20:23:43.314032] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-15T20:23:43.414456] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T20:23:43.475394] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T20:23:43.934108] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T20:23:44.114028] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-15T20:23:44.914077] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-15T20:23:44.970750] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T20:23:45.411857] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-15T20:23:45.714065] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-15T20:23:46.514086] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-15T20:23:47.041254] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T20:23:47.314041] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-15T20:23:47.368530] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T20:23:48.114039] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-15T20:23:48.183928] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T20:23:48.469441] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T20:23:48.914021] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-15T20:23:49.571637] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-15T20:23:49.713970] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-15T20:23:50.514006] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-15T20:23:51.267706] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T20:23:51.313953] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-15T20:23:52.113989] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-15T20:23:52.224750] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T20:23:52.293125] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T20:23:52.914033] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-15T20:23:52.981402] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T20:23:53.714018] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-15T20:23:54.514053] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-15T20:23:54.536184] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T20:23:54.715770] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T20:23:55.271260] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:23:55.275169] [INFO ] [REMOTE ] NATL: Full fetch complete (45226 records). [2025-10-15T20:23:55.275274] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-15T20:23:55.275928] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:23:55.276161] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:23:55.276232] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:23:55.276323] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-15T20:23:55.276385] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-15T20:23:55.276421] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-15T20:23:55.276461] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-15T20:23:55.276516] [INFO ] [MAIN ] Update Progress: 1449/2369 symbols completed. NATL took 29.7s. Estimated remaining: 2h 9m 26s. Rate: 7.1 symbols/min [2025-10-15T20:23:55.319134] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-15T20:23:55.475853] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:55.476073] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-15T20:23:55.476127] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-15T20:23:55.476245] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-15T20:23:55.476288] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-15T20:23:55.476331] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-15T20:23:55.476368] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-15T20:23:55.828507] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:23:56.031825] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T20:23:56.113988] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-15T20:23:56.742534] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T20:23:56.914002] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-15T20:23:57.714027] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-15T20:23:58.518403] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-15T20:23:58.519195] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T20:23:58.852233] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T20:23:58.998505] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T20:23:58.999480] [INFO ] [REMOTE ] NAZ: Full fetch complete (4204 records). [2025-10-15T20:23:58.999552] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-15T20:23:59.323798] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-15T20:23:59.354826] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-15T20:23:59.355597] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-15T20:23:59.355781] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-15T20:23:59.355836] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-15T20:23:59.356228] [DEBUG] [LOCAL ] NAZ: Trimmed 4204 records to 2663 (keeping 200 days of data) [2025-10-15T20:23:59.373089] [DEBUG] [LOCAL ] NAZ: Primary data saved (2663 records). [2025-10-15T20:23:59.373198] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-15T20:23:59.373274] [INFO ] [MAIN ] Update Progress: 1450/2369 symbols completed. NAZ took 26.7s. Estimated remaining: 2h 9m 14s. Rate: 7.1 symbols/min [2025-10-15T20:23:59.541798] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:23:59.542003] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-15T20:23:59.542061] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-15T20:23:59.542181] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-15T20:23:59.542224] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-15T20:23:59.542266] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-15T20:23:59.542298] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-15T20:23:59.897844] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:00.113986] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-15T20:24:00.317105] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T20:24:00.914068] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-15T20:24:01.272419] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T20:24:01.714017] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-15T20:24:02.140874] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T20:24:02.514063] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-15T20:24:02.522517] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T20:24:03.314000] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-15T20:24:03.700053] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T20:24:03.944003] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:24:03.945556] [INFO ] [REMOTE ] NBB: Full fetch complete (13602 records). [2025-10-15T20:24:03.945630] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-15T20:24:04.124355] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-15T20:24:04.301365] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-15T20:24:04.301434] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-15T20:24:04.301751] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-15T20:24:04.301811] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-15T20:24:04.302251] [DEBUG] [LOCAL ] NBB: Trimmed 13602 records to 9062 (keeping 200 days of data) [2025-10-15T20:24:04.357274] [DEBUG] [LOCAL ] NBB: Primary data saved (9062 records). [2025-10-15T20:24:04.357413] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-15T20:24:04.357494] [INFO ] [MAIN ] Update Progress: 1451/2369 symbols completed. NBB took 30.9s. Estimated remaining: 2h 9m 4s. Rate: 7.1 symbols/min [2025-10-15T20:24:04.523383] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:04.523572] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-15T20:24:04.523610] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-15T20:24:04.523740] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-15T20:24:04.523785] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-15T20:24:04.523828] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-15T20:24:04.523861] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-15T20:24:04.876122] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:04.913964] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-15T20:24:05.374371] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T20:24:05.714038] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-15T20:24:05.845879] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T20:24:06.514027] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-15T20:24:07.314009] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-15T20:24:07.372438] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T20:24:07.378555] [INFO ] [REMOTE ] NAT: Full fetch complete (72230 records). [2025-10-15T20:24:07.378714] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-15T20:24:07.775111] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T20:24:07.801143] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-15T20:24:07.801560] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-15T20:24:07.803137] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-15T20:24:07.803223] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-15T20:24:07.804694] [DEBUG] [LOCAL ] NAT: Trimmed 72230 records to 49224 (keeping 200 days of data) [2025-10-15T20:24:08.096571] [DEBUG] [LOCAL ] NAT: Primary data saved (49224 records). [2025-10-15T20:24:08.096744] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-15T20:24:08.097133] [INFO ] [MAIN ] Update Progress: 1452/2369 symbols completed. NAT took 57.1s. Estimated remaining: 2h 8m 52s. Rate: 7.1 symbols/min [2025-10-15T20:24:08.119071] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-15T20:24:08.270167] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:08.274468] [DEBUG] [LOCAL ] NC: Loaded 1957 existing records from primary storage. [2025-10-15T20:24:08.274704] [INFO ] [MAIN ] NC: Loaded 1957 existing records. [2025-10-15T20:24:08.461615] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:24:08.467058] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-15T20:24:08.474540] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-15T20:24:08.475135] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T20:24:08.480735] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-15T20:24:08.480826] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-15T20:24:08.847715] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:08.914019] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-15T20:24:09.424391] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T20:24:09.533389] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T20:24:09.713992] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-15T20:24:10.514007] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-15T20:24:10.827612] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T20:24:11.056475] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T20:24:11.314003] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-15T20:24:12.114037] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-15T20:24:12.466224] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T20:24:12.646425] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T20:24:12.913988] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-15T20:24:13.714059] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-15T20:24:14.021348] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T20:24:14.514018] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-15T20:24:15.012695] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T20:24:15.314091] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-15T20:24:15.573092] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T20:24:15.889927] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T20:24:16.114040] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-15T20:24:16.871813] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T20:24:16.913998] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-15T20:24:17.714055] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-15T20:24:18.194917] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T20:24:18.482960] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T20:24:18.513973] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-15T20:24:19.314028] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-15T20:24:19.649990] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T20:24:20.113999] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-15T20:24:20.617757] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T20:24:20.619171] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T20:24:20.914033] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-15T20:24:21.714008] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-15T20:24:22.190124] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T20:24:22.240454] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T20:24:22.513999] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-15T20:24:22.862661] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-15T20:24:23.313995] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-15T20:24:24.113999] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-15T20:24:24.577329] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T20:24:24.577147] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T20:24:24.913995] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-15T20:24:25.336691] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-15T20:24:25.714024] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-15T20:24:26.159849] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T20:24:26.160739] [INFO ] [REMOTE ] NC: Full fetch complete (2765 records). [2025-10-15T20:24:26.160807] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-15T20:24:26.502127] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-15T20:24:26.502205] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-15T20:24:26.502305] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-15T20:24:26.502343] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-15T20:24:26.502692] [DEBUG] [LOCAL ] NC: Trimmed 2765 records to 1963 (keeping 200 days of data) [2025-10-15T20:24:26.514089] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-15T20:24:26.514946] [DEBUG] [LOCAL ] NC: Primary data saved (1963 records). [2025-10-15T20:24:26.515089] [INFO ] [MAIN ] NC: Full history saved. [2025-10-15T20:24:26.515953] [INFO ] [MAIN ] Update Progress: 1453/2369 symbols completed. NC took 18.4s. Estimated remaining: 2h 8m 50s. Rate: 7.1 symbols/min [2025-10-15T20:24:26.685216] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:26.695693] [DEBUG] [LOCAL ] NCA: Loaded 10006 existing records from primary storage. [2025-10-15T20:24:26.695909] [INFO ] [MAIN ] NCA: Loaded 10006 existing records. [2025-10-15T20:24:26.867053] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:24:26.867266] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-15T20:24:26.867312] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-15T20:24:26.867603] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-15T20:24:26.867686] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-15T20:24:27.208188] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:27.313953] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-15T20:24:27.751787] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T20:24:28.113970] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-15T20:24:28.206399] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T20:24:28.913978] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-15T20:24:29.371401] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T20:24:29.714008] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-15T20:24:29.766794] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T20:24:30.513999] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-15T20:24:31.314023] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-15T20:24:31.353934] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T20:24:31.369984] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T20:24:31.373410] [INFO ] [REMOTE ] NBHC: Full fetch complete (32686 records). [2025-10-15T20:24:31.373489] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-15T20:24:31.374059] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:24:31.374143] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:24:31.374207] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:24:31.374293] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-15T20:24:31.374372] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-15T20:24:31.374421] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-15T20:24:31.374477] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-15T20:24:31.374546] [INFO ] [MAIN ] Update Progress: 1454/2369 symbols completed. NBHC took 36.1s. Estimated remaining: 2h 8m 40s. Rate: 7.1 symbols/min [2025-10-15T20:24:31.544752] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:31.544913] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-15T20:24:31.544953] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-15T20:24:31.545065] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-15T20:24:31.545130] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-15T20:24:31.545212] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-15T20:24:31.545257] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-15T20:24:31.903433] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:32.113994] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-15T20:24:32.543317] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T20:24:32.914053] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-15T20:24:33.484061] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T20:24:33.714052] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-15T20:24:34.513984] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-15T20:24:34.567281] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T20:24:34.655874] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T20:24:35.314036] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-15T20:24:35.773276] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T20:24:36.114019] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-15T20:24:36.343765] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T20:24:36.913977] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-15T20:24:36.991667] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T20:24:37.714049] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-15T20:24:38.139320] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T20:24:38.514065] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-15T20:24:39.314018] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-15T20:24:39.369603] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T20:24:39.652258] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T20:24:39.861688] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T20:24:40.114000] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-15T20:24:40.775545] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:24:40.778206] [INFO ] [REMOTE ] NBXG: Full fetch complete (32502 records). [2025-10-15T20:24:40.778289] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-15T20:24:40.778835] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:24:40.778917] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:24:40.778960] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:24:40.778997] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-15T20:24:40.779051] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-15T20:24:40.779085] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-15T20:24:40.779124] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-15T20:24:40.779176] [INFO ] [MAIN ] Update Progress: 1455/2369 symbols completed. NBXG took 36.4s. Estimated remaining: 2h 8m 32s. Rate: 7.1 symbols/min [2025-10-15T20:24:40.919161] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-15T20:24:40.949929] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:40.950955] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-15T20:24:40.951001] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-15T20:24:40.951109] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-15T20:24:40.951196] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-15T20:24:40.951259] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-15T20:24:40.951294] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-15T20:24:41.309639] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:41.714063] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-15T20:24:42.204732] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T20:24:42.514076] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-15T20:24:43.314065] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-15T20:24:43.748305] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T20:24:43.800339] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-15T20:24:44.114003] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-15T20:24:44.293105] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T20:24:44.914044] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-15T20:24:45.488499] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T20:24:45.714025] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-15T20:24:46.200255] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T20:24:46.513966] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-15T20:24:46.644346] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T20:24:47.314029] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-15T20:24:48.114076] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-15T20:24:48.224618] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T20:24:48.309160] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T20:24:48.913977] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-15T20:24:49.200916] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T20:24:49.274530] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-15T20:24:49.278037] [INFO ] [REMOTE ] NBR: Full fetch complete (49092 records). [2025-10-15T20:24:49.278126] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-15T20:24:49.278766] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:24:49.278851] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:24:49.278916] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:24:49.278990] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-15T20:24:49.279057] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-15T20:24:49.279096] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-15T20:24:49.279138] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-15T20:24:49.279195] [INFO ] [MAIN ] Update Progress: 1456/2369 symbols completed. NBR took 49.9s. Estimated remaining: 2h 8m 23s. Rate: 7.1 symbols/min [2025-10-15T20:24:49.456803] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:49.471469] [DEBUG] [LOCAL ] NCV: Loaded 13971 existing records from primary storage. [2025-10-15T20:24:49.471712] [INFO ] [MAIN ] NCV: Loaded 13971 existing records. [2025-10-15T20:24:49.649112] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:24:49.649348] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-15T20:24:49.649430] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-15T20:24:49.649827] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-15T20:24:49.649884] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-15T20:24:49.719158] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-15T20:24:50.033497] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:50.514045] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-15T20:24:51.193895] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T20:24:51.313986] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-15T20:24:51.843383] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T20:24:52.114005] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-15T20:24:52.135276] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T20:24:52.914060] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-15T20:24:53.345909] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T20:24:53.714011] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-15T20:24:54.514071] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-15T20:24:54.962403] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T20:24:55.042915] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T20:24:55.222675] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T20:24:55.314023] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-15T20:24:56.025574] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:24:56.026911] [INFO ] [REMOTE ] NCA: Full fetch complete (14656 records). [2025-10-15T20:24:56.026991] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-15T20:24:56.119124] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-15T20:24:56.428020] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-15T20:24:56.428128] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-15T20:24:56.428540] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-15T20:24:56.428604] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-15T20:24:56.429255] [DEBUG] [LOCAL ] NCA: Trimmed 14656 records to 9994 (keeping 200 days of data) [2025-10-15T20:24:56.493471] [DEBUG] [LOCAL ] NCA: Primary data saved (9994 records). [2025-10-15T20:24:56.493668] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-15T20:24:56.493792] [INFO ] [MAIN ] Update Progress: 1457/2369 symbols completed. NCA took 30.0s. Estimated remaining: 2h 8m 14s. Rate: 7.1 symbols/min [2025-10-15T20:24:56.668452] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:24:56.681492] [DEBUG] [LOCAL ] NCZ: Loaded 12381 existing records from primary storage. [2025-10-15T20:24:56.681771] [INFO ] [MAIN ] NCZ: Loaded 12381 existing records. [2025-10-15T20:24:56.878286] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:24:56.878548] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-15T20:24:56.878597] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-15T20:24:56.879007] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-15T20:24:56.879065] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-15T20:24:56.921709] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-15T20:24:57.245736] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:24:57.260268] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T20:24:57.713976] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-15T20:24:57.808191] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:24:58.514020] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-15T20:24:59.313970] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-15T20:24:59.575675] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T20:24:59.807504] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-15T20:25:00.114045] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-15T20:25:00.367089] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T20:25:00.914003] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-15T20:25:01.318576] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T20:25:01.713997] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-15T20:25:02.003832] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T20:25:02.513990] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-15T20:25:03.313970] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-15T20:25:03.552329] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T20:25:04.016918] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-15T20:25:04.039016] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:25:04.042996] [INFO ] [REMOTE ] NCDL: Full fetch complete (32893 records). [2025-10-15T20:25:04.043115] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-15T20:25:04.043835] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:25:04.043926] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:25:04.043971] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:25:04.044016] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-15T20:25:04.044082] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-15T20:25:04.044121] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-15T20:25:04.044161] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-15T20:25:04.044230] [INFO ] [MAIN ] Update Progress: 1458/2369 symbols completed. NCDL took 32.7s. Estimated remaining: 2h 8m 5s. Rate: 7.1 symbols/min [2025-10-15T20:25:04.119212] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-15T20:25:04.228385] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:25:04.228675] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-15T20:25:04.228734] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-15T20:25:04.228860] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-15T20:25:04.228903] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-15T20:25:04.228946] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-15T20:25:04.228979] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-15T20:25:04.602783] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:25:04.914034] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-15T20:25:05.714047] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-15T20:25:06.416796] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T20:25:06.516959] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-15T20:25:06.520424] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-15T20:25:06.915090] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T20:25:07.313967] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-15T20:25:07.419124] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T20:25:08.113977] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-15T20:25:08.329287] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T20:25:08.914012] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-15T20:25:09.714078] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-15T20:25:09.888167] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T20:25:10.183237] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T20:25:10.514002] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-15T20:25:11.071145] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T20:25:11.113018] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T20:25:11.313998] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-15T20:25:12.113969] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-15T20:25:12.401198] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T20:25:12.914045] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-15T20:25:13.714002] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-15T20:25:13.911990] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T20:25:14.340761] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T20:25:14.513998] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-15T20:25:14.979468] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T20:25:15.313982] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-15T20:25:16.114061] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-15T20:25:16.114465] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T20:25:16.648711] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-15T20:25:16.914019] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-15T20:25:17.302954] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T20:25:17.714010] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-15T20:25:17.924586] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T20:25:18.513998] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-15T20:25:18.583269] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T20:25:19.313985] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-15T20:25:19.376021] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T20:25:20.023077] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:25:20.028929] [INFO ] [REMOTE ] NCLH: Full fetch complete (77543 records). [2025-10-15T20:25:20.029039] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-15T20:25:20.029841] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:25:20.029928] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:25:20.029971] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:25:20.030008] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-15T20:25:20.030087] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-15T20:25:20.030140] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-15T20:25:20.030183] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-15T20:25:20.030238] [INFO ] [MAIN ] Update Progress: 1459/2369 symbols completed. NCLH took 39.3s. Estimated remaining: 2h 8m 1s. Rate: 7.1 symbols/min [2025-10-15T20:25:20.119170] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-15T20:25:20.200433] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:25:20.200588] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-15T20:25:20.200625] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-15T20:25:20.200753] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-15T20:25:20.200794] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-15T20:25:20.200836] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-15T20:25:20.200876] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-15T20:25:20.551268] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:25:20.914011] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-15T20:25:21.072496] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:25:21.714005] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-15T20:25:21.909972] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T20:25:22.452432] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:25:22.455083] [INFO ] [REMOTE ] NCV: Full fetch complete (22404 records). [2025-10-15T20:25:22.455184] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-15T20:25:22.519110] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-15T20:25:22.822708] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-15T20:25:22.822813] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-15T20:25:22.823291] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-15T20:25:22.823333] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-15T20:25:22.823969] [DEBUG] [LOCAL ] NCV: Trimmed 22404 records to 13954 (keeping 200 days of data) [2025-10-15T20:25:22.909559] [DEBUG] [LOCAL ] NCV: Primary data saved (13954 records). [2025-10-15T20:25:22.909723] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-15T20:25:22.909813] [INFO ] [MAIN ] Update Progress: 1460/2369 symbols completed. NCV took 33.6s. Estimated remaining: 2h 7m 49s. Rate: 7.1 symbols/min [2025-10-15T20:25:23.085871] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:25:23.086063] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-15T20:25:23.086111] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-15T20:25:23.086266] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-15T20:25:23.086337] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-15T20:25:23.086390] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-15T20:25:23.086430] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-15T20:25:23.319404] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-15T20:25:23.446237] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:25:24.114029] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-15T20:25:24.303506] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T20:25:24.459003] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T20:25:24.914031] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-15T20:25:25.500946] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T20:25:25.603946] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T20:25:25.713986] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-15T20:25:26.514031] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-15T20:25:27.227619] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T20:25:27.314035] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-15T20:25:28.114015] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-15T20:25:28.273373] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T20:25:28.786692] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T20:25:28.913984] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-15T20:25:29.157477] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T20:25:29.714087] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-15T20:25:29.904178] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T20:25:30.514084] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-15T20:25:30.841402] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T20:25:31.314049] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-15T20:25:31.711319] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T20:25:32.113993] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-15T20:25:32.159399] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T20:25:32.914018] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-15T20:25:33.420252] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T20:25:33.713984] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-15T20:25:33.999989] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T20:25:34.481799] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T20:25:34.514015] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-15T20:25:35.313993] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-15T20:25:35.743940] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T20:25:36.020905] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:25:36.022994] [INFO ] [REMOTE ] NDMO: Full fetch complete (23720 records). [2025-10-15T20:25:36.023088] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-15T20:25:36.023542] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:25:36.023671] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:25:36.023727] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:25:36.023775] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-15T20:25:36.023828] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-15T20:25:36.023862] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-15T20:25:36.023902] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-15T20:25:36.023996] [INFO ] [MAIN ] Update Progress: 1461/2369 symbols completed. NDMO took 32.0s. Estimated remaining: 2h 7m 44s. Rate: 7.1 symbols/min [2025-10-15T20:25:36.119127] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-15T20:25:36.242613] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:25:36.242827] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-15T20:25:36.242871] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-15T20:25:36.242981] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-15T20:25:36.243022] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-15T20:25:36.243066] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-15T20:25:36.243102] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-15T20:25:36.641693] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:25:36.913993] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-15T20:25:37.072830] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T20:25:37.075420] [INFO ] [REMOTE ] NCZ: Full fetch complete (21116 records). [2025-10-15T20:25:37.075498] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-15T20:25:37.433423] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-15T20:25:37.433505] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-15T20:25:37.433984] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-15T20:25:37.434046] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-15T20:25:37.434614] [DEBUG] [LOCAL ] NCZ: Trimmed 21116 records to 12383 (keeping 200 days of data) [2025-10-15T20:25:37.511737] [DEBUG] [LOCAL ] NCZ: Primary data saved (12383 records). [2025-10-15T20:25:37.511881] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-15T20:25:37.511977] [INFO ] [MAIN ] Update Progress: 1462/2369 symbols completed. NCZ took 41.0s. Estimated remaining: 2h 7m 31s. Rate: 7.1 symbols/min [2025-10-15T20:25:37.674844] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:25:37.675009] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-15T20:25:37.675045] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-15T20:25:37.675154] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-15T20:25:37.675194] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-15T20:25:37.675236] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-15T20:25:37.675268] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-15T20:25:37.719264] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-15T20:25:38.026415] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:25:38.513993] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-15T20:25:39.072950] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-15T20:25:39.313983] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-15T20:25:39.553690] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T20:25:40.114052] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-15T20:25:40.652681] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T20:25:40.914052] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-15T20:25:41.597141] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-15T20:25:41.675759] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T20:25:41.713959] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-15T20:25:42.514008] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-15T20:25:43.040270] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-15T20:25:43.313976] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-15T20:25:43.564736] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T20:25:44.114003] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-15T20:25:44.523757] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T20:25:44.914017] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-15T20:25:45.073667] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T20:25:45.714185] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-15T20:25:45.927512] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:25:46.514023] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-15T20:25:46.713201] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T20:25:47.314160] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-15T20:25:48.122803] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-15T20:25:48.126448] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-15T20:25:48.390733] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T20:25:48.914045] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-15T20:25:49.169442] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T20:25:49.713976] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-15T20:25:49.780780] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T20:25:50.514009] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-15T20:25:50.938030] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T20:25:51.314011] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-15T20:25:51.675376] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T20:25:51.997005] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T20:25:52.113974] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-15T20:25:52.914045] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-15T20:25:53.714003] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-15T20:25:53.836954] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-15T20:25:54.162867] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T20:25:54.214849] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T20:25:54.514050] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-15T20:25:55.318706] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-15T20:25:55.324404] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T20:25:56.114015] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-15T20:25:56.839710] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T20:25:56.914077] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-15T20:25:57.651682] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-15T20:25:57.713971] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-15T20:25:57.862139] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T20:25:58.360026] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T20:25:58.513991] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-15T20:25:59.314017] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-15T20:25:59.899061] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T20:26:00.113981] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-15T20:26:00.197129] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T20:26:00.203401] [INFO ] [REMOTE ] NE: Full fetch complete (75377 records). [2025-10-15T20:26:00.203540] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-15T20:26:00.204482] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:00.204590] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:00.204692] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:00.204792] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-15T20:26:00.204872] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-15T20:26:00.204911] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-15T20:26:00.204951] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-15T20:26:00.205008] [INFO ] [MAIN ] Update Progress: 1463/2369 symbols completed. NE took 40.2s. Estimated remaining: 2h 7m 32s. Rate: 7.1 symbols/min [2025-10-15T20:26:00.378384] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:00.378603] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-15T20:26:00.378681] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-15T20:26:00.378793] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-15T20:26:00.378834] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-15T20:26:00.378874] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-15T20:26:00.378906] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-15T20:26:00.762429] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:00.796670] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-15T20:26:00.913997] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-15T20:26:01.613558] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:26:01.617304] [INFO ] [REMOTE ] NEA: Full fetch complete (51042 records). [2025-10-15T20:26:01.617427] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-15T20:26:01.618600] [FATAL] [VALIDATOR ] NEA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:01.618709] [FATAL] [MAIN ] NEA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:01.618790] [WARN ] [MAIN ] NEA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:01.618864] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-15T20:26:01.618926] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-15T20:26:01.618962] [INFO ] [LOCAL ] NEA: Starting deletion of derivative data. [2025-10-15T20:26:01.619001] [DEBUG] [LOCAL ] NEA: No derivative data file found to delete. [2025-10-15T20:26:01.619055] [INFO ] [MAIN ] Update Progress: 1464/2369 symbols completed. NEA took 38.7s. Estimated remaining: 2h 7m 19s. Rate: 7.1 symbols/min [2025-10-15T20:26:01.716879] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-15T20:26:01.788434] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:01.788576] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-15T20:26:01.788613] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-15T20:26:01.788742] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-15T20:26:01.788784] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-15T20:26:01.788825] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-15T20:26:01.788857] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-15T20:26:02.134299] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:02.343254] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T20:26:02.514010] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-15T20:26:03.202020] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T20:26:03.314041] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-15T20:26:04.114039] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-15T20:26:04.245764] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-15T20:26:04.277617] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T20:26:04.283928] [INFO ] [REMOTE ] NEE: Full fetch complete (77497 records). [2025-10-15T20:26:04.284099] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-15T20:26:04.285073] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:04.285165] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:04.285209] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:04.285249] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-15T20:26:04.285306] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-15T20:26:04.285343] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-15T20:26:04.285381] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-15T20:26:04.285442] [INFO ] [MAIN ] Update Progress: 1465/2369 symbols completed. NEE took 28.3s. Estimated remaining: 2h 7m 7s. Rate: 7.1 symbols/min [2025-10-15T20:26:04.453368] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:04.453564] [DEBUG] [LOCAL ] NEXA: No existing data file found in primary storage. [2025-10-15T20:26:04.453601] [WARN ] [MAIN ] NEXA: No existing data found, performing full refresh instead. [2025-10-15T20:26:04.453739] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-15T20:26:04.453781] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-15T20:26:04.453822] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-15T20:26:04.453877] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-15T20:26:04.810897] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:04.914004] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-15T20:26:05.713994] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-15T20:26:05.798790] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T20:26:06.058997] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T20:26:06.221891] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T20:26:06.514038] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-15T20:26:07.314048] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-15T20:26:08.114019] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-15T20:26:08.773859] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-15T20:26:08.913979] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-15T20:26:08.966993] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T20:26:09.224410] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T20:26:09.714071] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-15T20:26:10.446566] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T20:26:10.513963] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-15T20:26:11.314691] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-15T20:26:11.320835] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-15T20:26:11.344020] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T20:26:12.114005] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-15T20:26:12.851430] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:26:12.860414] [INFO ] [REMOTE ] NEM: Full fetch complete (77497 records). [2025-10-15T20:26:12.860602] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-15T20:26:12.861687] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:12.861799] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:12.861849] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:12.861928] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-15T20:26:12.862011] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-15T20:26:12.862058] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-15T20:26:12.862106] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-15T20:26:12.862186] [INFO ] [MAIN ] Update Progress: 1466/2369 symbols completed. NEM took 35.4s. Estimated remaining: 2h 6m 58s. Rate: 7.1 symbols/min [2025-10-15T20:26:12.921288] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-15T20:26:13.061737] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:13.061975] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-15T20:26:13.062117] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-15T20:26:13.062368] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-15T20:26:13.062437] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-15T20:26:13.062513] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-15T20:26:13.062727] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-15T20:26:13.457221] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-15T20:26:13.455866] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:13.713974] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-15T20:26:13.729966] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T20:26:14.513980] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-15T20:26:15.173545] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T20:26:15.314045] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-15T20:26:15.928949] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T20:26:16.113994] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-15T20:26:16.802171] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-15T20:26:16.914055] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-15T20:26:17.152020] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T20:26:17.713968] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-15T20:26:18.278166] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T20:26:18.513994] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-15T20:26:18.602790] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:26:19.313991] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-15T20:26:19.967521] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T20:26:20.114003] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-15T20:26:20.790598] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:26:20.914000] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-15T20:26:21.534856] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T20:26:21.714007] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-15T20:26:22.502162] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T20:26:22.513953] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-15T20:26:22.569525] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T20:26:23.314032] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-15T20:26:23.889289] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T20:26:24.114002] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-15T20:26:24.210991] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T20:26:24.913990] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-15T20:26:25.421180] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T20:26:25.422737] [INFO ] [REMOTE ] NEU: Full fetch complete (10743 records). [2025-10-15T20:26:25.422810] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-15T20:26:25.423294] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:25.423378] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:25.423422] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:25.423502] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-15T20:26:25.423581] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-15T20:26:25.423682] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-15T20:26:25.423749] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-15T20:26:25.423805] [INFO ] [MAIN ] Update Progress: 1467/2369 symbols completed. NEU took 23.8s. Estimated remaining: 2h 6m 53s. Rate: 7.1 symbols/min [2025-10-15T20:26:25.604981] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:25.605270] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-15T20:26:25.605343] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-15T20:26:25.605546] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-15T20:26:25.605639] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-15T20:26:25.605771] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-15T20:26:25.605861] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-15T20:26:25.718797] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-15T20:26:25.786660] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T20:26:25.992448] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:26.443820] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T20:26:26.514041] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-15T20:26:27.313989] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-15T20:26:28.114009] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-15T20:26:28.289205] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T20:26:28.871321] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T20:26:28.913961] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-15T20:26:28.938548] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T20:26:29.714044] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-15T20:26:30.335017] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T20:26:30.514020] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-15T20:26:30.969393] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T20:26:31.086167] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T20:26:31.314019] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-15T20:26:31.968427] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-15T20:26:32.114009] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-15T20:26:32.913984] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-15T20:26:33.550143] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T20:26:33.714025] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-15T20:26:34.300287] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-15T20:26:34.514078] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-15T20:26:34.778793] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T20:26:35.313991] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-15T20:26:36.072259] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T20:26:36.113969] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-15T20:26:36.520209] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T20:26:36.914039] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-15T20:26:37.714146] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-15T20:26:38.236707] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-15T20:26:38.338534] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T20:26:38.463226] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T20:26:38.514119] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-15T20:26:39.314043] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-15T20:26:39.834217] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T20:26:40.114012] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-15T20:26:40.698171] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T20:26:40.913976] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-15T20:26:41.321251] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T20:26:41.639610] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:26:41.644230] [INFO ] [REMOTE ] NFG: Full fetch complete (56893 records). [2025-10-15T20:26:41.644322] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-15T20:26:41.645030] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:41.645117] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:41.645185] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:41.645259] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-15T20:26:41.645322] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-15T20:26:41.645366] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-15T20:26:41.645404] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-15T20:26:41.645458] [INFO ] [MAIN ] Update Progress: 1468/2369 symbols completed. NFG took 28.8s. Estimated remaining: 2h 6m 49s. Rate: 7.1 symbols/min [2025-10-15T20:26:41.719205] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-15T20:26:41.822561] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:41.822779] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-15T20:26:41.822829] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-15T20:26:41.822948] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-15T20:26:41.822988] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-15T20:26:41.823028] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-15T20:26:41.823060] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-15T20:26:42.173089] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:42.513994] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-15T20:26:42.735231] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T20:26:43.314108] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-15T20:26:44.114171] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-15T20:26:44.147257] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T20:26:44.517408] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T20:26:44.913992] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-15T20:26:44.934212] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T20:26:45.713996] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-15T20:26:46.513973] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-15T20:26:46.689297] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T20:26:47.313985] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-15T20:26:47.367894] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T20:26:47.370265] [INFO ] [REMOTE ] NEXA: Full fetch complete (8164 records). [2025-10-15T20:26:47.370339] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-15T20:26:47.749020] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-15T20:26:47.749232] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-15T20:26:47.749711] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-15T20:26:47.749794] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-15T20:26:47.750414] [DEBUG] [LOCAL ] NEXA: Trimmed 8164 records to 5247 (keeping 200 days of data) [2025-10-15T20:26:47.782325] [DEBUG] [LOCAL ] NEXA: Primary data saved (5247 records). [2025-10-15T20:26:47.782481] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-15T20:26:47.782573] [INFO ] [MAIN ] Update Progress: 1469/2369 symbols completed. NEXA took 43.5s. Estimated remaining: 2h 6m 39s. Rate: 7.1 symbols/min [2025-10-15T20:26:48.019806] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:48.068766] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-15T20:26:48.112251] [DEBUG] [LOCAL ] NGL: Loaded 29950 existing records from primary storage. [2025-10-15T20:26:48.112615] [INFO ] [MAIN ] NGL: Loaded 29950 existing records. [2025-10-15T20:26:48.124584] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-15T20:26:48.295522] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:26:48.295876] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-15T20:26:48.295939] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-15T20:26:48.296265] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-15T20:26:48.296326] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-15T20:26:48.671961] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:48.696014] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T20:26:48.914030] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-15T20:26:49.391751] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T20:26:49.714029] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-15T20:26:50.050385] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T20:26:50.513998] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-15T20:26:50.542361] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T20:26:50.548261] [INFO ] [REMOTE ] NET: Full fetch complete (76535 records). [2025-10-15T20:26:50.548420] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-15T20:26:50.549274] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:26:50.549370] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:26:50.549414] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:26:50.549514] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-15T20:26:50.549596] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-15T20:26:50.549674] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-15T20:26:50.549756] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-15T20:26:50.549834] [INFO ] [MAIN ] Update Progress: 1470/2369 symbols completed. NET took 50.3s. Estimated remaining: 2h 6m 27s. Rate: 7.1 symbols/min [2025-10-15T20:26:50.716805] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:26:50.728919] [DEBUG] [LOCAL ] NGS: Loaded 11198 existing records from primary storage. [2025-10-15T20:26:50.729145] [INFO ] [MAIN ] NGS: Loaded 11198 existing records. [2025-10-15T20:26:50.920867] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:26:50.921088] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-15T20:26:50.921137] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-15T20:26:50.921320] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-15T20:26:50.921376] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-15T20:26:51.300192] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:26:51.313958] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-15T20:26:51.801748] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T20:26:52.114041] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-15T20:26:52.195877] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T20:26:52.914088] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-15T20:26:53.667405] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T20:26:53.713993] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-15T20:26:54.087712] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T20:26:54.514022] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-15T20:26:54.804195] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T20:26:55.222431] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T20:26:55.313990] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-15T20:26:56.114007] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-15T20:26:56.228305] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T20:26:56.914040] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-15T20:26:57.238216] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T20:26:57.714043] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-15T20:26:58.514073] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-15T20:26:58.732150] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T20:26:58.733597] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T20:26:59.314109] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-15T20:26:59.752308] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T20:27:00.114022] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-15T20:27:00.330768] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T20:27:00.913998] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-15T20:27:01.292733] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T20:27:01.295604] [INFO ] [REMOTE ] NFJ: Full fetch complete (30031 records). [2025-10-15T20:27:01.295723] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-15T20:27:01.296235] [FATAL] [VALIDATOR ] NFJ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:27:01.296340] [FATAL] [MAIN ] NFJ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:27:01.296383] [WARN ] [MAIN ] NFJ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:27:01.296422] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-15T20:27:01.296476] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-15T20:27:01.296510] [INFO ] [LOCAL ] NFJ: Starting deletion of derivative data. [2025-10-15T20:27:01.296548] [DEBUG] [LOCAL ] NFJ: No derivative data file found to delete. [2025-10-15T20:27:01.296601] [INFO ] [MAIN ] Update Progress: 1471/2369 symbols completed. NFJ took 35.9s. Estimated remaining: 2h 6m 20s. Rate: 7.1 symbols/min [2025-10-15T20:27:01.486977] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:27:01.487201] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-15T20:27:01.487258] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-15T20:27:01.487392] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-15T20:27:01.487449] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-15T20:27:01.487509] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-15T20:27:01.487558] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-15T20:27:01.722308] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-15T20:27:01.881901] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:27:01.926497] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:27:02.514040] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-15T20:27:03.155856] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T20:27:03.314024] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-15T20:27:03.668103] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T20:27:04.113993] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-15T20:27:04.853685] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T20:27:04.877457] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T20:27:04.914046] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-15T20:27:05.713997] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-15T20:27:06.513987] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-15T20:27:06.659693] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T20:27:06.766242] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T20:27:07.314020] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-15T20:27:07.719862] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T20:27:08.114015] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-15T20:27:08.220797] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T20:27:08.913979] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-15T20:27:08.989909] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T20:27:09.449379] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T20:27:09.713988] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-15T20:27:10.514011] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-15T20:27:11.114893] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T20:27:11.313965] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-15T20:27:11.610896] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T20:27:12.114082] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-15T20:27:12.913968] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-15T20:27:12.974801] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T20:27:13.554978] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T20:27:13.713962] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-15T20:27:14.098355] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T20:27:14.514006] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-15T20:27:15.186828] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T20:27:15.313961] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-15T20:27:15.584045] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T20:27:16.114023] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-15T20:27:16.853997] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T20:27:16.914029] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-15T20:27:17.125210] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T20:27:17.714090] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T20:27:17.714170] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-15T20:27:17.718735] [INFO ] [REMOTE ] NGL: Full fetch complete (41571 records). [2025-10-15T20:27:17.718830] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-15T20:27:18.133326] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-15T20:27:18.133445] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-15T20:27:18.135125] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-15T20:27:18.135196] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-15T20:27:18.136372] [DEBUG] [LOCAL ] NGL: Trimmed 41571 records to 30004 (keeping 200 days of data) [2025-10-15T20:27:18.316025] [DEBUG] [LOCAL ] NGL: Primary data saved (30004 records). [2025-10-15T20:27:18.316223] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-15T20:27:18.316363] [INFO ] [MAIN ] Update Progress: 1472/2369 symbols completed. NGL took 30.5s. Estimated remaining: 2h 6m 17s. Rate: 7.1 symbols/min [2025-10-15T20:27:18.490103] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:27:18.490370] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-15T20:27:18.490412] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-15T20:27:18.490542] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-15T20:27:18.490585] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-15T20:27:18.490627] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-15T20:27:18.490696] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-15T20:27:18.519710] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-15T20:27:18.818246] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T20:27:18.884039] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:27:19.314005] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-15T20:27:20.114022] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-15T20:27:20.222440] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T20:27:20.495905] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T20:27:20.846815] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T20:27:20.913965] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-15T20:27:21.714068] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-15T20:27:21.964514] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T20:27:22.514030] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-15T20:27:22.930136] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T20:27:23.313969] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-15T20:27:23.345565] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T20:27:24.044773] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:27:24.046438] [INFO ] [REMOTE ] NGS: Full fetch complete (17171 records). [2025-10-15T20:27:24.046535] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-15T20:27:24.119251] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-15T20:27:24.454703] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-15T20:27:24.454806] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-15T20:27:24.455256] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-15T20:27:24.455317] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-15T20:27:24.455927] [DEBUG] [LOCAL ] NGS: Trimmed 17171 records to 11176 (keeping 200 days of data) [2025-10-15T20:27:24.541533] [DEBUG] [LOCAL ] NGS: Primary data saved (11176 records). [2025-10-15T20:27:24.541726] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-15T20:27:24.541823] [INFO ] [MAIN ] Update Progress: 1473/2369 symbols completed. NGS took 34.0s. Estimated remaining: 2h 6m 7s. Rate: 7.1 symbols/min [2025-10-15T20:27:24.711033] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:27:24.711189] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-15T20:27:24.711225] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-15T20:27:24.711331] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-15T20:27:24.711371] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-15T20:27:24.711412] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-15T20:27:24.711444] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-15T20:27:24.922409] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-15T20:27:25.058430] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:27:25.342842] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T20:27:25.714074] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-15T20:27:26.182788] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T20:27:26.514049] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-15T20:27:26.553561] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T20:27:27.135159] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T20:27:27.138130] [INFO ] [REMOTE ] NGVC: Full fetch complete (30825 records). [2025-10-15T20:27:27.138247] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-15T20:27:27.138811] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:27:27.138898] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:27:27.138942] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:27:27.139009] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-15T20:27:27.139074] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-15T20:27:27.139112] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-15T20:27:27.139155] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-15T20:27:27.139212] [INFO ] [MAIN ] Update Progress: 1474/2369 symbols completed. NGVC took 25.8s. Estimated remaining: 2h 5m 55s. Rate: 7.1 symbols/min [2025-10-15T20:27:27.322471] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:27:27.319280] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-15T20:27:27.323432] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-15T20:27:27.323494] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-15T20:27:27.323631] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-15T20:27:27.323724] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-15T20:27:27.323800] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-15T20:27:27.323860] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-15T20:27:27.672823] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:27:28.114017] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-15T20:27:28.542181] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T20:27:28.902671] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:27:28.907833] [INFO ] [REMOTE ] NGG: Full fetch complete (66183 records). [2025-10-15T20:27:28.907945] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-15T20:27:28.908705] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:27:28.908793] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:27:28.908836] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:27:28.908903] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-15T20:27:28.908966] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-15T20:27:28.909000] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-15T20:27:28.909039] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-15T20:27:28.909096] [INFO ] [MAIN ] Update Progress: 1475/2369 symbols completed. NGG took 47.3s. Estimated remaining: 2h 5m 43s. Rate: 7.1 symbols/min [2025-10-15T20:27:28.919223] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-15T20:27:29.081682] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:27:29.081867] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-15T20:27:29.081906] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-15T20:27:29.082019] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-15T20:27:29.082081] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-15T20:27:29.082126] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-15T20:27:29.082159] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-15T20:27:29.439869] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:27:29.713987] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-15T20:27:30.195061] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T20:27:30.514067] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-15T20:27:30.922529] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T20:27:31.314010] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-15T20:27:31.570472] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T20:27:32.114019] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-15T20:27:32.586450] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T20:27:32.800705] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T20:27:32.914022] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-15T20:27:33.704627] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T20:27:33.713955] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-15T20:27:34.514047] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-15T20:27:34.649340] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T20:27:35.314046] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-15T20:27:35.486955] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T20:27:36.114117] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-15T20:27:36.616263] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T20:27:36.914034] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-15T20:27:37.713963] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-15T20:27:37.794773] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T20:27:37.971259] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T20:27:38.514030] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-15T20:27:38.645419] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T20:27:39.313978] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-15T20:27:39.437945] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T20:27:40.113968] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-15T20:27:40.509309] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T20:27:40.794971] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-15T20:27:40.914114] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-15T20:27:41.714013] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-15T20:27:41.841591] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T20:27:42.514005] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-15T20:27:42.884837] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T20:27:43.313990] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-15T20:27:44.113996] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-15T20:27:44.381527] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T20:27:44.469392] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T20:27:44.914005] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-15T20:27:44.939606] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T20:27:45.713997] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-15T20:27:45.820491] [DEBUG] [REMOTE ] NHI: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-15T20:27:45.820780] [WARN ] [REMOTE ] NHI: No data returned for month 2025-07 [2025-10-15T20:27:45.820867] [FATAL] [REMOTE ] NHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:27:45.820947] [FATAL] [MAIN ] NHI: Failed to fetch primary data. [2025-10-15T20:27:45.821012] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:27:45.821079] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-15T20:27:45.821140] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-15T20:27:45.821175] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-15T20:27:45.821213] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-15T20:27:45.821261] [INFO ] [MAIN ] Update Progress: 1476/2369 symbols completed. NHI took 21.3s. Estimated remaining: 2h 5m 39s. Rate: 7.1 symbols/min [2025-10-15T20:27:45.987244] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:27:45.999947] [DEBUG] [LOCAL ] NIE: Loaded 11926 existing records from primary storage. [2025-10-15T20:27:46.000165] [INFO ] [MAIN ] NIE: Loaded 11926 existing records. [2025-10-15T20:27:46.173477] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:27:46.173692] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-15T20:27:46.173748] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-15T20:27:46.173951] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-15T20:27:46.173987] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-15T20:27:46.521755] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-15T20:27:46.542058] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:27:46.625079] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T20:27:47.313959] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-15T20:27:47.370183] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T20:27:48.113963] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-15T20:27:48.146705] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T20:27:48.913970] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-15T20:27:48.945790] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T20:27:49.711986] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T20:27:49.714491] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-15T20:27:50.513973] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-15T20:27:50.857159] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T20:27:51.314038] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-15T20:27:52.113985] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-15T20:27:52.166722] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T20:27:52.505242] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T20:27:52.829608] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T20:27:52.914030] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-15T20:27:53.352785] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T20:27:53.355613] [INFO ] [REMOTE ] NGVT: Full fetch complete (34342 records). [2025-10-15T20:27:53.355724] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-15T20:27:53.356309] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:27:53.356420] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:27:53.356466] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:27:53.356505] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-15T20:27:53.356562] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-15T20:27:53.356600] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-15T20:27:53.356683] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-15T20:27:53.356786] [INFO ] [MAIN ] Update Progress: 1477/2369 symbols completed. NGVT took 35.0s. Estimated remaining: 2h 5m 30s. Rate: 7.1 symbols/min [2025-10-15T20:27:53.714079] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-15T20:27:54.514022] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-15T20:27:54.636742] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T20:27:55.029958] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T20:27:55.031407] [INFO ] [REMOTE ] NIC: Full fetch complete (12353 records). [2025-10-15T20:27:55.031478] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-15T20:27:55.031886] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:27:55.031967] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:27:55.032009] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:27:55.032045] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-15T20:27:55.032100] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-15T20:27:55.032133] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-15T20:27:55.032176] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-15T20:27:55.032226] [INFO ] [MAIN ] Update Progress: 1478/2369 symbols completed. NIC took 26.1s. Estimated remaining: 2h 5m 18s. Rate: 7.1 symbols/min [2025-10-15T20:27:55.314069] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-15T20:27:56.114059] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-15T20:27:56.405307] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T20:27:56.914047] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-15T20:27:57.776128] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T20:27:57.776421] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T20:27:57.793601] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-15T20:27:58.378176] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T20:27:58.514021] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-15T20:27:59.314005] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-15T20:27:59.580718] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:28:00.114100] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-15T20:28:01.101252] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T20:28:01.104363] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-15T20:28:01.277027] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T20:28:01.714025] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-15T20:28:02.088898] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T20:28:02.514075] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-15T20:28:03.273540] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:28:03.276617] [INFO ] [REMOTE ] NIE: Full fetch complete (16802 records). [2025-10-15T20:28:03.276765] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-15T20:28:03.665619] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-15T20:28:03.665933] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-15T20:28:03.666385] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-15T20:28:03.666456] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-15T20:28:03.695374] [DEBUG] [LOCAL ] NIE: Trimmed 16802 records to 11908 (keeping 200 days of data) [2025-10-15T20:28:03.698336] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T20:28:03.744948] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-15T20:28:03.784256] [DEBUG] [LOCAL ] NIE: Primary data saved (11908 records). [2025-10-15T20:28:03.784409] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-15T20:28:03.784496] [INFO ] [MAIN ] Update Progress: 1479/2369 symbols completed. NIE took 18.0s. Estimated remaining: 2h 5m 9s. Rate: 7.1 symbols/min [2025-10-15T20:28:05.712462] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-15T20:28:05.724036] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-15T20:28:07.756891] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T20:28:07.771534] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-15T20:28:09.683937] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T20:28:09.697409] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-15T20:28:10.487171] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:28:10.493726] [INFO ] [REMOTE ] NI: Full fetch complete (77100 records). [2025-10-15T20:28:10.493940] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-15T20:28:10.495307] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:28:10.495417] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:28:10.495489] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:28:10.495568] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-15T20:28:10.495684] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-15T20:28:10.495746] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-15T20:28:10.495795] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-15T20:28:10.495865] [INFO ] [MAIN ] Update Progress: 1480/2369 symbols completed. NI took 43.4s. Estimated remaining: 2h 5m 0s. Rate: 7.1 symbols/min [2025-10-15T20:28:11.155968] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:11.286923] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:11.277184] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:11.317225] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-15T20:28:11.316923] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:11.317408] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-15T20:28:11.317836] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-15T20:28:11.318066] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-15T20:28:11.318138] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-15T20:28:11.318178] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-15T20:28:11.416905] [DEBUG] [LOCAL ] NIM: Loaded 3542 existing records from primary storage. [2025-10-15T20:28:11.427066] [INFO ] [MAIN ] NIM: Loaded 3542 existing records. [2025-10-15T20:28:11.793548] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:28:11.799616] [DEBUG] [LOCAL ] NINE: Loaded 28294 existing records from primary storage. [2025-10-15T20:28:11.869038] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-15T20:28:11.847626] [INFO ] [MAIN ] NINE: Loaded 28294 existing records. [2025-10-15T20:28:11.869284] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-15T20:28:11.913684] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-15T20:28:11.887101] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-15T20:28:12.009857] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-15T20:28:12.073350] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-15T20:28:12.173232] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:12.302107] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-15T20:28:12.324446] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:28:12.363869] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-15T20:28:12.379484] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-15T20:28:12.431989] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-15T20:28:12.432203] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-15T20:28:12.573265] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:28:12.605032] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-15T20:28:12.616837] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-15T20:28:12.658197] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-15T20:28:12.673468] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-15T20:28:12.718821] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:28:12.772096] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-15T20:28:12.858997] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:28:12.874518] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-15T20:28:12.889998] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:28:12.913026] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-15T20:28:12.966419] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-15T20:28:12.976392] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-15T20:28:13.009165] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-15T20:28:13.018970] [INFO ] [MAIN ] Update Progress: 1481/2369 symbols completed. NIQ took 2.5s. Estimated remaining: 2h 4m 48s. Rate: 7.1 symbols/min [2025-10-15T20:28:13.349677] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:13.400945] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-15T20:28:13.621137] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:13.631873] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-15T20:28:13.744871] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:13.756452] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-15T20:28:13.756534] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-15T20:28:13.768469] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-15T20:28:13.768545] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-15T20:28:13.768629] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-15T20:28:13.785691] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-15T20:28:13.824183] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:13.861694] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-15T20:28:14.155438] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:14.155796] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-15T20:28:14.327706] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T20:28:14.329845] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-15T20:28:15.055123] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T20:28:15.056962] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-15T20:28:15.296998] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T20:28:15.304216] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-15T20:28:15.599227] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T20:28:15.607337] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-15T20:28:15.685860] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T20:28:15.687812] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-15T20:28:16.229324] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T20:28:16.231448] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-15T20:28:16.274685] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-15T20:28:16.286087] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-15T20:28:16.941841] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T20:28:16.943976] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-15T20:28:17.078043] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T20:28:17.087443] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-15T20:28:17.269388] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T20:28:17.343546] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-15T20:28:17.714047] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-15T20:28:18.143847] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T20:28:18.161024] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T20:28:18.514040] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-15T20:28:18.613236] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-15T20:28:19.313984] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-15T20:28:19.623826] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T20:28:20.114030] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-15T20:28:20.737199] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T20:28:20.914092] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-15T20:28:21.714068] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-15T20:28:22.249082] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-15T20:28:22.420314] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T20:28:22.443690] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T20:28:22.514009] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-15T20:28:23.111977] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T20:28:23.314014] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-15T20:28:24.114012] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-15T20:28:24.914038] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-15T20:28:25.676457] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:28:25.713956] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-15T20:28:25.916401] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-15T20:28:25.943371] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T20:28:26.514046] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-15T20:28:27.278619] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T20:28:27.313963] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-15T20:28:27.999773] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T20:28:28.113993] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-15T20:28:28.537821] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T20:28:28.914033] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-15T20:28:29.672146] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T20:28:29.713973] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-15T20:28:30.219152] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T20:28:30.514037] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-15T20:28:30.960864] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T20:28:31.083026] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T20:28:31.313991] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-15T20:28:32.114106] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-15T20:28:32.914002] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-15T20:28:33.338386] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T20:28:33.374833] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T20:28:33.376192] [INFO ] [REMOTE ] NIM: Full fetch complete (6377 records). [2025-10-15T20:28:33.376340] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-15T20:28:33.719762] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-15T20:28:33.754664] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-15T20:28:33.754960] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-15T20:28:33.755268] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-15T20:28:33.755434] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-15T20:28:33.756355] [DEBUG] [LOCAL ] NIM: Trimmed 6377 records to 3526 (keeping 200 days of data) [2025-10-15T20:28:33.785176] [DEBUG] [LOCAL ] NIM: Primary data saved (3526 records). [2025-10-15T20:28:33.785291] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-15T20:28:33.785414] [INFO ] [MAIN ] Update Progress: 1482/2369 symbols completed. NIM took 23.3s. Estimated remaining: 2h 4m 47s. Rate: 7.1 symbols/min [2025-10-15T20:28:33.956890] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:33.957198] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-15T20:28:33.957273] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-15T20:28:33.957416] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-15T20:28:33.957581] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-15T20:28:33.957696] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-15T20:28:33.957892] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-15T20:28:34.106543] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-15T20:28:34.373908] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:34.514012] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-15T20:28:35.283547] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T20:28:35.313967] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-15T20:28:35.492890] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T20:28:36.114047] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-15T20:28:36.641276] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T20:28:36.914012] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-15T20:28:37.070155] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:28:37.399920] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T20:28:37.406232] [INFO ] [REMOTE ] NJR: Full fetch complete (54639 records). [2025-10-15T20:28:37.406388] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-15T20:28:37.407225] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:28:37.407336] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:28:37.407391] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:28:37.407443] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-15T20:28:37.407522] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-15T20:28:37.407614] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-15T20:28:37.407722] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-15T20:28:37.407840] [INFO ] [MAIN ] Update Progress: 1483/2369 symbols completed. NJR took 24.4s. Estimated remaining: 2h 4m 36s. Rate: 7.1 symbols/min [2025-10-15T20:28:37.588588] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:37.604193] [DEBUG] [LOCAL ] NKX: Loaded 13596 existing records from primary storage. [2025-10-15T20:28:37.604435] [INFO ] [MAIN ] NKX: Loaded 13596 existing records. [2025-10-15T20:28:37.719179] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-15T20:28:37.782812] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:28:37.783025] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-15T20:28:37.783074] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-15T20:28:37.783267] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-15T20:28:37.783307] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-15T20:28:38.130831] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:38.514064] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-15T20:28:38.971769] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T20:28:39.204223] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T20:28:39.314001] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-15T20:28:40.113990] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-15T20:28:40.512256] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T20:28:40.517391] [INFO ] [REMOTE ] NINE: Full fetch complete (43448 records). [2025-10-15T20:28:40.517563] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-15T20:28:40.899480] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-15T20:28:40.899557] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-15T20:28:40.900316] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-15T20:28:40.900377] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-15T20:28:40.901224] [DEBUG] [LOCAL ] NINE: Trimmed 43448 records to 28362 (keeping 200 days of data) [2025-10-15T20:28:40.946753] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-15T20:28:41.064008] [DEBUG] [LOCAL ] NINE: Primary data saved (28362 records). [2025-10-15T20:28:41.064152] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-15T20:28:41.064235] [INFO ] [MAIN ] Update Progress: 1484/2369 symbols completed. NINE took 30.6s. Estimated remaining: 2h 4m 24s. Rate: 7.1 symbols/min [2025-10-15T20:28:41.233742] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:28:41.233914] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-15T20:28:41.233951] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-15T20:28:41.234058] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-15T20:28:41.234100] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-15T20:28:41.234142] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-15T20:28:41.234174] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-15T20:28:41.575018] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:28:41.713957] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-15T20:28:42.005358] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T20:28:42.348570] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-15T20:28:42.400633] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T20:28:42.514011] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-15T20:28:43.314049] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-15T20:28:43.336267] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T20:28:44.114022] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-15T20:28:44.914077] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-15T20:28:45.065735] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T20:28:45.355020] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T20:28:45.714005] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-15T20:28:45.863770] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T20:28:46.514030] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-15T20:28:47.188499] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T20:28:47.314040] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-15T20:28:48.113972] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-15T20:28:48.377142] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T20:28:48.409548] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-15T20:28:48.913970] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-15T20:28:49.000228] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T20:28:49.714073] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-15T20:28:50.514022] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-15T20:28:50.826879] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T20:28:51.313973] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-15T20:28:51.353215] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T20:28:51.593332] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-15T20:28:52.114013] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-15T20:28:52.240450] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T20:28:52.914029] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-15T20:28:53.515193] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T20:28:53.714026] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-15T20:28:54.219538] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T20:28:54.514034] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-15T20:28:54.573364] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-15T20:28:55.314012] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-15T20:28:55.562447] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T20:28:56.114044] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-15T20:28:56.379320] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T20:28:56.760001] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T20:28:56.914014] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-15T20:28:57.714025] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-15T20:28:58.514089] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-15T20:28:58.546936] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T20:28:59.183038] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-15T20:28:59.314015] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-15T20:28:59.583015] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:29:00.114002] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-15T20:29:00.171263] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T20:29:00.177512] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-15T20:29:00.177618] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-15T20:29:00.557060] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-15T20:29:00.557133] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-15T20:29:00.558240] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-15T20:29:00.558302] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-15T20:29:00.559757] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 53802 (keeping 200 days of data) [2025-10-15T20:29:00.867891] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-15T20:29:00.868004] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-15T20:29:00.868094] [INFO ] [MAIN ] Update Progress: 1485/2369 symbols completed. NIO took 50.4s. Estimated remaining: 2h 4m 23s. Rate: 7.1 symbols/min [2025-10-15T20:29:00.922931] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-15T20:29:00.979438] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T20:29:01.049956] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:01.050108] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-15T20:29:01.050163] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-15T20:29:01.050269] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-15T20:29:01.050321] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-15T20:29:01.050387] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-15T20:29:01.050421] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-15T20:29:01.392033] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:01.716154] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-15T20:29:01.717045] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T20:29:02.474111] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:29:02.480103] [INFO ] [REMOTE ] NKE: Full fetch complete (76827 records). [2025-10-15T20:29:02.480249] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-15T20:29:02.481104] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:29:02.481207] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:29:02.481249] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:29:02.481292] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-15T20:29:02.481384] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-15T20:29:02.481438] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-15T20:29:02.481494] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-15T20:29:02.481571] [INFO ] [MAIN ] Update Progress: 1486/2369 symbols completed. NKE took 28.7s. Estimated remaining: 2h 4m 10s. Rate: 7.1 symbols/min [2025-10-15T20:29:02.519922] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-15T20:29:02.653778] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:02.653944] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-15T20:29:02.653982] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-15T20:29:02.654099] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-15T20:29:02.654167] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-15T20:29:02.654229] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-15T20:29:02.654273] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-15T20:29:02.998287] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:03.313965] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-15T20:29:03.551784] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T20:29:04.114064] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-15T20:29:04.914031] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-15T20:29:05.123500] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T20:29:05.159831] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T20:29:05.564598] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-15T20:29:05.714035] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-15T20:29:06.321276] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T20:29:06.513987] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-15T20:29:07.314007] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-15T20:29:07.426151] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T20:29:08.114381] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-15T20:29:08.115969] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T20:29:08.118256] [INFO ] [REMOTE ] NKX: Full fetch complete (19166 records). [2025-10-15T20:29:08.118334] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-15T20:29:08.481370] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-15T20:29:08.481447] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-15T20:29:08.481883] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-15T20:29:08.481944] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-15T20:29:08.482513] [DEBUG] [LOCAL ] NKX: Trimmed 19166 records to 13656 (keeping 200 days of data) [2025-10-15T20:29:08.566783] [DEBUG] [LOCAL ] NKX: Primary data saved (13656 records). [2025-10-15T20:29:08.566921] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-15T20:29:08.567001] [INFO ] [MAIN ] Update Progress: 1487/2369 symbols completed. NKX took 31.2s. Estimated remaining: 2h 4m 0s. Rate: 7.1 symbols/min [2025-10-15T20:29:08.738960] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:08.754242] [DEBUG] [LOCAL ] NMAI: Loaded 12852 existing records from primary storage. [2025-10-15T20:29:08.754490] [INFO ] [MAIN ] NMAI: Loaded 12852 existing records. [2025-10-15T20:29:08.927161] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-15T20:29:08.967407] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T20:29:08.970629] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:29:08.973025] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-15T20:29:08.973075] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-15T20:29:08.973267] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-15T20:29:08.973304] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-15T20:29:09.329176] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:09.711074] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T20:29:09.714164] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-15T20:29:10.514027] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-15T20:29:10.580919] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T20:29:11.137428] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T20:29:11.313992] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-15T20:29:11.956487] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T20:29:12.114020] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-15T20:29:12.913967] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-15T20:29:13.082938] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T20:29:13.713980] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-15T20:29:13.938923] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T20:29:14.514064] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-15T20:29:15.314030] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-15T20:29:15.387065] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T20:29:15.641568] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T20:29:15.896052] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:29:15.897224] [INFO ] [REMOTE ] NL: Full fetch complete (6910 records). [2025-10-15T20:29:15.897296] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-15T20:29:16.088045] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T20:29:16.088245] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:29:16.088312] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:29:16.088380] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-15T20:29:16.088441] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-15T20:29:16.088475] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-15T20:29:16.088513] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-15T20:29:16.088566] [INFO ] [MAIN ] Update Progress: 1488/2369 symbols completed. NL took 35.0s. Estimated remaining: 2h 3m 51s. Rate: 7.1 symbols/min [2025-10-15T20:29:16.119076] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-15T20:29:16.258252] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:16.258397] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-15T20:29:16.258435] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-15T20:29:16.258566] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-15T20:29:16.258627] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-15T20:29:16.258712] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-15T20:29:16.258754] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-15T20:29:16.604169] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:16.913968] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-15T20:29:17.105198] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T20:29:17.713970] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-15T20:29:17.944501] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T20:29:18.002686] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:29:18.002948] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-15T20:29:18.003055] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:29:18.003129] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-15T20:29:18.003194] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:29:18.003266] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-15T20:29:18.003329] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-15T20:29:18.003364] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-15T20:29:18.003406] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-15T20:29:18.003451] [INFO ] [MAIN ] Update Progress: 1489/2369 symbols completed. NMAX took 1.9s. Estimated remaining: 2h 3m 39s. Rate: 7.1 symbols/min [2025-10-15T20:29:18.176587] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:18.176827] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-15T20:29:18.176871] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-15T20:29:18.176981] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-15T20:29:18.177022] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-15T20:29:18.177064] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-15T20:29:18.177096] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-15T20:29:18.526837] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:18.514465] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-15T20:29:19.314036] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-15T20:29:20.113977] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-15T20:29:20.217706] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T20:29:20.274344] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T20:29:20.913982] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-15T20:29:21.005179] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:29:21.713991] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-15T20:29:22.514038] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-15T20:29:22.676803] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T20:29:23.097498] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-15T20:29:23.201341] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T20:29:23.314033] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-15T20:29:24.019585] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T20:29:24.113989] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-15T20:29:24.913970] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-15T20:29:24.936434] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T20:29:25.693613] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T20:29:25.713959] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-15T20:29:26.364455] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T20:29:26.513975] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-15T20:29:27.314024] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-15T20:29:27.740994] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T20:29:28.113963] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-15T20:29:28.140580] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T20:29:28.777139] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T20:29:28.914045] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-15T20:29:29.436156] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T20:29:29.438534] [INFO ] [REMOTE ] NLOP: Full fetch complete (17693 records). [2025-10-15T20:29:29.438672] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-15T20:29:29.439256] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:29:29.439367] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:29:29.439442] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:29:29.439523] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-15T20:29:29.439605] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-15T20:29:29.439692] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-15T20:29:29.439774] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-15T20:29:29.439851] [INFO ] [MAIN ] Update Progress: 1490/2369 symbols completed. NLOP took 28.6s. Estimated remaining: 2h 3m 32s. Rate: 7.1 symbols/min [2025-10-15T20:29:29.624848] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:29.636042] [DEBUG] [LOCAL ] NMG: Loaded 10296 existing records from primary storage. [2025-10-15T20:29:29.636259] [INFO ] [MAIN ] NMG: Loaded 10296 existing records. [2025-10-15T20:29:29.719496] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-15T20:29:29.812418] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:29:29.813213] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-15T20:29:29.813294] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-15T20:29:29.813633] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-15T20:29:29.813724] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-15T20:29:30.169787] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:30.514083] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-15T20:29:31.304320] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T20:29:31.314006] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-15T20:29:31.495982] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T20:29:32.113990] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-15T20:29:32.275928] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:29:32.914053] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-15T20:29:33.714080] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-15T20:29:33.899109] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T20:29:34.031688] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T20:29:34.394091] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-15T20:29:34.514192] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-15T20:29:35.314084] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-15T20:29:36.113991] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-15T20:29:36.219131] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T20:29:36.468031] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T20:29:36.864751] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T20:29:36.913990] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-15T20:29:37.656598] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:29:37.713967] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-15T20:29:38.514022] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-15T20:29:38.764996] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T20:29:39.314011] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-15T20:29:39.983708] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T20:29:40.114043] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-15T20:29:40.617114] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T20:29:40.798684] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-15T20:29:40.914116] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-15T20:29:41.714052] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-15T20:29:42.023554] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T20:29:42.514000] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-15T20:29:42.742803] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T20:29:43.314006] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-15T20:29:43.578858] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T20:29:44.113979] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-15T20:29:44.913987] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-15T20:29:44.969016] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T20:29:45.226629] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T20:29:45.714052] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-15T20:29:45.847173] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T20:29:46.513994] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-15T20:29:47.108150] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T20:29:47.110138] [INFO ] [REMOTE ] NMCO: Full fetch complete (23253 records). [2025-10-15T20:29:47.110265] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-15T20:29:47.110811] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:29:47.110934] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:29:47.110996] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:29:47.111062] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-15T20:29:47.111130] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-15T20:29:47.111167] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-15T20:29:47.111209] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-15T20:29:47.111319] [INFO ] [MAIN ] Update Progress: 1491/2369 symbols completed. NMCO took 29.1s. Estimated remaining: 2h 3m 29s. Rate: 7.1 symbols/min [2025-10-15T20:29:47.282939] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:47.288565] [DEBUG] [LOCAL ] NMI: Loaded 4060 existing records from primary storage. [2025-10-15T20:29:47.288781] [INFO ] [MAIN ] NMI: Loaded 4060 existing records. [2025-10-15T20:29:47.319085] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-15T20:29:47.466037] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:29:47.466253] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-15T20:29:47.466301] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-15T20:29:47.466454] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-15T20:29:47.466509] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-15T20:29:47.816859] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:47.849720] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-15T20:29:48.114054] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-15T20:29:48.293315] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T20:29:48.534065] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T20:29:48.539940] [INFO ] [REMOTE ] NLY: Full fetch complete (77314 records). [2025-10-15T20:29:48.540083] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-15T20:29:48.540975] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:29:48.541089] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:29:48.541162] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:29:48.541260] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-15T20:29:48.541340] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-15T20:29:48.541377] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-15T20:29:48.541416] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-15T20:29:48.541472] [INFO ] [MAIN ] Update Progress: 1492/2369 symbols completed. NLY took 46.1s. Estimated remaining: 2h 3m 17s. Rate: 7.1 symbols/min [2025-10-15T20:29:48.706821] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:48.706983] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-15T20:29:48.707018] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-15T20:29:48.707158] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-15T20:29:48.707227] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-15T20:29:48.707282] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-15T20:29:48.707316] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-15T20:29:48.919619] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-15T20:29:49.057950] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:49.714008] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-15T20:29:49.730324] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T20:29:50.514064] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-15T20:29:50.804511] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T20:29:51.313998] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-15T20:29:51.441931] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T20:29:51.443999] [INFO ] [REMOTE ] NMAI: Full fetch complete (19780 records). [2025-10-15T20:29:51.444071] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-15T20:29:51.817499] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-15T20:29:51.817579] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-15T20:29:51.818045] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-15T20:29:51.818106] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-15T20:29:51.818685] [DEBUG] [LOCAL ] NMAI: Trimmed 19780 records to 12861 (keeping 200 days of data) [2025-10-15T20:29:51.896715] [DEBUG] [LOCAL ] NMAI: Primary data saved (12861 records). [2025-10-15T20:29:51.896850] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-15T20:29:51.896930] [INFO ] [MAIN ] Update Progress: 1493/2369 symbols completed. NMAI took 43.3s. Estimated remaining: 2h 3m 5s. Rate: 7.1 symbols/min [2025-10-15T20:29:52.103315] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:29:52.114023] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-15T20:29:52.139969] [DEBUG] [LOCAL ] NMR: Loaded 35529 existing records from primary storage. [2025-10-15T20:29:52.140238] [INFO ] [MAIN ] NMR: Loaded 35529 existing records. [2025-10-15T20:29:52.320616] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:29:52.320838] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-15T20:29:52.320888] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-15T20:29:52.321197] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-15T20:29:52.321236] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-15T20:29:52.592970] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T20:29:52.690973] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:29:52.913987] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-15T20:29:52.934074] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T20:29:53.713982] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-15T20:29:54.007548] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T20:29:54.230756] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T20:29:54.514020] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-15T20:29:55.313985] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-15T20:29:55.410582] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:29:55.997784] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:29:56.114008] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-15T20:29:56.644967] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T20:29:56.914007] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-15T20:29:57.714006] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-15T20:29:58.332433] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T20:29:58.383897] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T20:29:58.513962] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-15T20:29:59.314052] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-15T20:30:00.013265] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T20:30:00.113973] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-15T20:30:00.350383] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T20:30:00.799779] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T20:30:00.914071] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-15T20:30:01.714034] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-15T20:30:01.958580] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T20:30:02.285739] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T20:30:02.514010] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-15T20:30:03.206614] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T20:30:03.314008] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-15T20:30:04.113998] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-15T20:30:04.873071] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T20:30:04.913951] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-15T20:30:05.081443] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T20:30:05.713996] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-15T20:30:06.413341] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T20:30:06.468998] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T20:30:06.513986] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-15T20:30:07.313972] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-15T20:30:08.113966] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-15T20:30:08.226930] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T20:30:08.246516] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T20:30:08.742324] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T20:30:08.914043] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-15T20:30:09.714046] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-15T20:30:09.922265] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T20:30:10.376901] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T20:30:10.514006] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-15T20:30:11.314016] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-15T20:30:11.928933] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T20:30:12.113971] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-15T20:30:12.204156] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:30:12.744024] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:30:12.744937] [INFO ] [REMOTE ] NMI: Full fetch complete (5770 records). [2025-10-15T20:30:12.745027] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-15T20:30:12.926695] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-15T20:30:13.151155] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-15T20:30:13.151240] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-15T20:30:13.151441] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-15T20:30:13.151482] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-15T20:30:13.151980] [DEBUG] [LOCAL ] NMI: Trimmed 5770 records to 4054 (keeping 200 days of data) [2025-10-15T20:30:13.176876] [DEBUG] [LOCAL ] NMI: Primary data saved (4054 records). [2025-10-15T20:30:13.177009] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-15T20:30:13.177090] [INFO ] [MAIN ] Update Progress: 1494/2369 symbols completed. NMI took 26.1s. Estimated remaining: 2h 3m 5s. Rate: 7.1 symbols/min [2025-10-15T20:30:13.346957] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:30:13.351728] [DEBUG] [LOCAL ] NMS: Loaded 2907 existing records from primary storage. [2025-10-15T20:30:13.351918] [INFO ] [MAIN ] NMS: Loaded 2907 existing records. [2025-10-15T20:30:13.530281] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:30:13.530507] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-15T20:30:13.530553] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-15T20:30:13.530723] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-15T20:30:13.530778] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-15T20:30:13.721167] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-15T20:30:13.893925] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:30:14.407350] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T20:30:14.514041] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-15T20:30:15.028899] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T20:30:15.033288] [INFO ] [REMOTE ] NMG: Full fetch complete (15071 records). [2025-10-15T20:30:15.033397] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-15T20:30:15.319180] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-15T20:30:15.399537] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-15T20:30:15.399618] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-15T20:30:15.400054] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-15T20:30:15.400129] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-15T20:30:15.400791] [DEBUG] [LOCAL ] NMG: Trimmed 15071 records to 10641 (keeping 200 days of data) [2025-10-15T20:30:15.462436] [DEBUG] [LOCAL ] NMG: Primary data saved (10641 records). [2025-10-15T20:30:15.462591] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-15T20:30:15.462699] [INFO ] [MAIN ] Update Progress: 1495/2369 symbols completed. NMG took 46.0s. Estimated remaining: 2h 2m 53s. Rate: 7.1 symbols/min [2025-10-15T20:30:15.637087] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:30:15.641723] [DEBUG] [LOCAL ] NMT: Loaded 2829 existing records from primary storage. [2025-10-15T20:30:15.641912] [INFO ] [MAIN ] NMT: Loaded 2829 existing records. [2025-10-15T20:30:15.825506] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:30:15.825768] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-15T20:30:15.825830] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-15T20:30:15.826011] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-15T20:30:15.826079] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-15T20:30:16.115101] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-15T20:30:16.134572] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T20:30:16.243453] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:30:16.393779] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T20:30:16.791031] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T20:30:16.914085] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-15T20:30:17.498729] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T20:30:17.714033] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-15T20:30:18.201203] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T20:30:18.514024] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-15T20:30:19.096756] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T20:30:19.314036] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-15T20:30:20.114034] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-15T20:30:20.347412] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T20:30:20.532992] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T20:30:20.914033] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-15T20:30:21.714071] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-15T20:30:22.281165] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T20:30:22.302997] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T20:30:22.514050] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-15T20:30:23.314075] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-15T20:30:23.892118] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T20:30:23.900017] [INFO ] [REMOTE ] NMR: Full fetch complete (51190 records). [2025-10-15T20:30:23.900184] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-15T20:30:24.102314] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T20:30:24.117726] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-15T20:30:24.334661] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-15T20:30:24.334749] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-15T20:30:24.335611] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-15T20:30:24.335680] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-15T20:30:24.336739] [DEBUG] [LOCAL ] NMR: Trimmed 51190 records to 35582 (keeping 200 days of data) [2025-10-15T20:30:24.535383] [DEBUG] [LOCAL ] NMR: Primary data saved (35582 records). [2025-10-15T20:30:24.535517] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-15T20:30:24.535596] [INFO ] [MAIN ] Update Progress: 1496/2369 symbols completed. NMR took 32.6s. Estimated remaining: 2h 2m 44s. Rate: 7.1 symbols/min [2025-10-15T20:30:24.702717] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:30:24.702881] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-15T20:30:24.702920] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-15T20:30:24.703029] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-15T20:30:24.703092] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-15T20:30:24.703134] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-15T20:30:24.703166] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-15T20:30:24.805727] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T20:30:24.919956] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-15T20:30:25.063143] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:30:25.671239] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T20:30:25.713987] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-15T20:30:26.210920] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T20:30:26.514001] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-15T20:30:26.956161] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T20:30:27.314125] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-15T20:30:27.914257] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T20:30:27.916280] [INFO ] [REMOTE ] NMM: Full fetch complete (21691 records). [2025-10-15T20:30:27.916356] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-15T20:30:27.916854] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:30:27.916937] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:30:27.916978] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:30:27.917020] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-15T20:30:27.917074] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-15T20:30:27.917109] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-15T20:30:27.917148] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-15T20:30:27.917200] [INFO ] [MAIN ] Update Progress: 1497/2369 symbols completed. NMM took 39.4s. Estimated remaining: 2h 2m 33s. Rate: 7.1 symbols/min [2025-10-15T20:30:28.087051] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:30:28.099065] [DEBUG] [LOCAL ] NNI: Loaded 10427 existing records from primary storage. [2025-10-15T20:30:28.099287] [INFO ] [MAIN ] NNI: Loaded 10427 existing records. [2025-10-15T20:30:28.119294] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-15T20:30:28.307886] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:30:28.308137] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-15T20:30:28.308188] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-15T20:30:28.308348] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-15T20:30:28.308387] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-15T20:30:28.672128] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:30:28.727995] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T20:30:28.914011] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-15T20:30:29.714004] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-15T20:30:30.008049] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T20:30:30.351780] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T20:30:30.513996] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-15T20:30:31.120041] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T20:30:31.314030] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-15T20:30:32.114030] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-15T20:30:32.447016] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T20:30:32.821234] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T20:30:32.914032] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-15T20:30:33.715932] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-15T20:30:33.718823] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T20:30:34.513990] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-15T20:30:34.866698] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T20:30:35.068019] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T20:30:35.314087] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-15T20:30:36.114056] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-15T20:30:36.339129] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T20:30:36.486475] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-15T20:30:36.914060] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-15T20:30:37.714049] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-15T20:30:38.187183] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T20:30:38.367255] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-15T20:30:38.514047] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-15T20:30:39.313999] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-15T20:30:39.609253] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T20:30:39.830567] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T20:30:39.831537] [INFO ] [REMOTE ] NMS: Full fetch complete (4085 records). [2025-10-15T20:30:39.831609] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-15T20:30:40.116685] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-15T20:30:40.199610] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-15T20:30:40.199711] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-15T20:30:40.199851] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-15T20:30:40.199889] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-15T20:30:40.200224] [DEBUG] [LOCAL ] NMS: Trimmed 4085 records to 2910 (keeping 200 days of data) [2025-10-15T20:30:40.218498] [DEBUG] [LOCAL ] NMS: Primary data saved (2910 records). [2025-10-15T20:30:40.218601] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-15T20:30:40.218715] [INFO ] [MAIN ] Update Progress: 1498/2369 symbols completed. NMS took 27.0s. Estimated remaining: 2h 2m 27s. Rate: 7.1 symbols/min [2025-10-15T20:30:40.402666] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:30:40.402867] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-15T20:30:40.402936] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-15T20:30:40.403054] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-15T20:30:40.403098] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-15T20:30:40.403142] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-15T20:30:40.403198] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-15T20:30:40.778145] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T20:30:40.782226] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:30:40.914059] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-15T20:30:41.714033] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-15T20:30:42.374894] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T20:30:42.434908] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T20:30:42.514023] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-15T20:30:43.313985] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-15T20:30:43.667571] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T20:30:44.114000] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-15T20:30:44.789219] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T20:30:44.913986] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-15T20:30:45.237590] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T20:30:45.714048] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-15T20:30:46.314294] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T20:30:46.514028] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-15T20:30:46.817270] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T20:30:47.309903] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T20:30:47.313939] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-15T20:30:48.114026] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-15T20:30:48.220307] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T20:30:48.913998] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-15T20:30:49.435855] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T20:30:49.713978] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-15T20:30:49.954340] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T20:30:50.514006] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-15T20:30:51.068546] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T20:30:51.314032] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-15T20:30:51.735875] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T20:30:51.738579] [INFO ] [REMOTE ] NMZ: Full fetch complete (31256 records). [2025-10-15T20:30:51.738682] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-15T20:30:51.739351] [FATAL] [VALIDATOR ] NMZ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:30:51.739473] [FATAL] [MAIN ] NMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:30:51.739515] [WARN ] [MAIN ] NMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:30:51.739586] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-15T20:30:51.739679] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-15T20:30:51.739922] [INFO ] [LOCAL ] NMZ: Starting deletion of derivative data. [2025-10-15T20:30:51.739965] [DEBUG] [LOCAL ] NMZ: No derivative data file found to delete. [2025-10-15T20:30:51.740018] [INFO ] [MAIN ] Update Progress: 1499/2369 symbols completed. NMZ took 27.2s. Estimated remaining: 2h 2m 20s. Rate: 7.1 symbols/min [2025-10-15T20:30:51.916103] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:30:51.923417] [DEBUG] [LOCAL ] NNY: Loaded 5641 existing records from primary storage. [2025-10-15T20:30:51.923677] [INFO ] [MAIN ] NNY: Loaded 5641 existing records. [2025-10-15T20:30:52.102522] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:30:52.102995] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-15T20:30:52.103051] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-15T20:30:52.103631] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-15T20:30:52.103732] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-15T20:30:52.124321] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-15T20:30:52.463851] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:30:52.497863] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T20:30:52.613998] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T20:30:52.914091] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-15T20:30:53.714028] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-15T20:30:54.017966] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T20:30:54.514019] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-15T20:30:55.314008] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-15T20:30:55.352226] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T20:30:55.432375] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T20:30:55.891953] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T20:30:56.114016] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-15T20:30:56.874286] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T20:30:56.914009] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-15T20:30:57.713981] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-15T20:30:57.896948] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T20:30:58.285056] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T20:30:58.513996] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-15T20:30:59.221901] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T20:30:59.313996] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-15T20:31:00.114005] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-15T20:31:00.122058] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T20:31:00.913972] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-15T20:31:00.989223] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T20:31:01.639158] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T20:31:01.713984] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-15T20:31:02.515129] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-15T20:31:02.517200] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T20:31:03.313976] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-15T20:31:03.333082] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T20:31:04.114006] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-15T20:31:04.216372] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T20:31:04.914035] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-15T20:31:05.713738] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T20:31:05.715125] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-15T20:31:05.715711] [INFO ] [REMOTE ] NNI: Full fetch complete (12937 records). [2025-10-15T20:31:05.715790] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-15T20:31:06.130903] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-15T20:31:06.138845] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-15T20:31:06.143183] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-15T20:31:06.143291] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-15T20:31:06.150101] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T20:31:06.160384] [DEBUG] [LOCAL ] NNI: Trimmed 12937 records to 10444 (keeping 200 days of data) [2025-10-15T20:31:06.228674] [DEBUG] [LOCAL ] NNI: Primary data saved (10444 records). [2025-10-15T20:31:06.228839] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-15T20:31:06.229018] [INFO ] [MAIN ] Update Progress: 1500/2369 symbols completed. NNI took 38.3s. Estimated remaining: 2h 2m 15s. Rate: 7.1 symbols/min [2025-10-15T20:31:06.405165] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:06.405451] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-15T20:31:06.405501] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-15T20:31:06.405610] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-15T20:31:06.405676] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-15T20:31:06.405739] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-15T20:31:06.405775] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-15T20:31:06.519084] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-15T20:31:06.696236] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T20:31:06.774796] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:06.922355] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T20:31:06.923217] [INFO ] [REMOTE ] NMT: Full fetch complete (3992 records). [2025-10-15T20:31:06.923286] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-15T20:31:07.274025] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-15T20:31:07.274104] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-15T20:31:07.274232] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-15T20:31:07.274271] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-15T20:31:07.274662] [DEBUG] [LOCAL ] NMT: Trimmed 3992 records to 2835 (keeping 200 days of data) [2025-10-15T20:31:07.292093] [DEBUG] [LOCAL ] NMT: Primary data saved (2835 records). [2025-10-15T20:31:07.292200] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-15T20:31:07.292277] [INFO ] [MAIN ] Update Progress: 1501/2369 symbols completed. NMT took 51.8s. Estimated remaining: 2h 2m 3s. Rate: 7.1 symbols/min [2025-10-15T20:31:07.320883] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-15T20:31:07.469312] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:07.469492] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-15T20:31:07.469537] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-15T20:31:07.469718] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-15T20:31:07.469792] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-15T20:31:07.469865] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-15T20:31:07.469958] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-15T20:31:07.820699] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:08.113971] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-15T20:31:08.913965] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-15T20:31:09.157784] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:31:09.254125] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T20:31:09.714052] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-15T20:31:10.366420] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T20:31:10.514033] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-15T20:31:10.658909] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T20:31:11.314023] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-15T20:31:11.557904] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T20:31:12.042350] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T20:31:12.113974] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-15T20:31:12.914025] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-15T20:31:13.099375] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T20:31:13.713983] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-15T20:31:14.513969] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-15T20:31:14.673618] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T20:31:14.701344] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T20:31:15.314027] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-15T20:31:15.347342] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T20:31:16.114042] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-15T20:31:16.436441] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T20:31:16.914008] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-15T20:31:17.531628] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T20:31:17.714036] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-15T20:31:17.752985] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T20:31:18.513973] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-15T20:31:18.667944] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T20:31:18.941947] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T20:31:18.947865] [INFO ] [REMOTE ] NNN: Full fetch complete (70020 records). [2025-10-15T20:31:18.948006] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-15T20:31:18.948905] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:31:18.949011] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:31:18.949086] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:31:18.949181] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-15T20:31:18.949247] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-15T20:31:18.949284] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-15T20:31:18.949325] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-15T20:31:18.949396] [INFO ] [MAIN ] Update Progress: 1502/2369 symbols completed. NNN took 38.7s. Estimated remaining: 2h 1m 56s. Rate: 7.1 symbols/min [2025-10-15T20:31:19.152158] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:19.152318] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-15T20:31:19.152360] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-15T20:31:19.152480] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-15T20:31:19.152522] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-15T20:31:19.152564] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-15T20:31:19.152597] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-15T20:31:19.319082] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-15T20:31:19.533782] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:20.003345] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:31:20.004558] [INFO ] [REMOTE ] NNY: Full fetch complete (8351 records). [2025-10-15T20:31:20.004693] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-15T20:31:20.121376] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-15T20:31:20.386139] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-15T20:31:20.386235] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-15T20:31:20.386444] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-15T20:31:20.386483] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-15T20:31:20.386909] [DEBUG] [LOCAL ] NNY: Trimmed 8351 records to 5659 (keeping 200 days of data) [2025-10-15T20:31:20.420253] [DEBUG] [LOCAL ] NNY: Primary data saved (5659 records). [2025-10-15T20:31:20.420360] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-15T20:31:20.420436] [INFO ] [MAIN ] Update Progress: 1503/2369 symbols completed. NNY took 28.7s. Estimated remaining: 2h 1m 44s. Rate: 7.1 symbols/min [2025-10-15T20:31:20.587008] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:20.587185] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-15T20:31:20.587223] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-15T20:31:20.587335] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-15T20:31:20.587376] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-15T20:31:20.587416] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-15T20:31:20.587448] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-15T20:31:20.940012] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:20.919549] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-15T20:31:21.363016] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T20:31:21.714009] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-15T20:31:22.514021] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-15T20:31:22.562951] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T20:31:23.314064] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-15T20:31:23.476611] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T20:31:23.615080] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T20:31:24.114021] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-15T20:31:24.403759] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T20:31:24.914044] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-15T20:31:25.714057] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-15T20:31:25.762270] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T20:31:26.520551] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-15T20:31:26.523918] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T20:31:26.748896] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T20:31:27.313983] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-15T20:31:27.518876] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T20:31:28.114082] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-15T20:31:28.913971] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-15T20:31:29.115288] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T20:31:29.714049] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-15T20:31:29.852776] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T20:31:29.957348] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T20:31:30.514054] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-15T20:31:31.141012] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:31:31.143680] [INFO ] [REMOTE ] NOAH: Full fetch complete (27736 records). [2025-10-15T20:31:31.143797] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-15T20:31:31.144392] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:31:31.144476] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:31:31.144522] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:31:31.144593] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-15T20:31:31.144707] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-15T20:31:31.144772] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-15T20:31:31.144831] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-15T20:31:31.144907] [INFO ] [MAIN ] Update Progress: 1504/2369 symbols completed. NOAH took 23.9s. Estimated remaining: 2h 1m 36s. Rate: 7.1 symbols/min [2025-10-15T20:31:31.316042] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-15T20:31:31.320696] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:31.390279] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-15T20:31:31.403225] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-15T20:31:31.447374] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T20:31:31.594109] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:31:31.594338] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-15T20:31:31.594388] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-15T20:31:31.595148] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-15T20:31:31.595205] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-15T20:31:32.009733] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:32.113975] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-15T20:31:32.914040] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-15T20:31:33.036228] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T20:31:33.075769] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T20:31:33.713998] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-15T20:31:34.514062] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-15T20:31:34.960197] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T20:31:35.314047] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-15T20:31:35.443632] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T20:31:36.113970] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-15T20:31:36.522776] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T20:31:36.913984] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-15T20:31:37.431733] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-15T20:31:37.713972] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-15T20:31:37.861303] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:31:37.905252] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T20:31:38.514021] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-15T20:31:39.314028] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-15T20:31:39.710406] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T20:31:39.952480] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T20:31:40.114042] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-15T20:31:40.396634] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T20:31:40.914032] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-15T20:31:41.370634] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T20:31:41.714044] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-15T20:31:42.513980] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-15T20:31:42.736825] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T20:31:42.865844] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T20:31:43.314046] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-15T20:31:44.114003] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-15T20:31:44.649339] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T20:31:44.913992] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-15T20:31:45.223203] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T20:31:45.710467] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T20:31:45.720939] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-15T20:31:46.059010] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T20:31:46.061319] [INFO ] [REMOTE ] NOA: Full fetch complete (22371 records). [2025-10-15T20:31:46.061389] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-15T20:31:46.062016] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:31:46.062103] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:31:46.062161] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:31:46.062201] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-15T20:31:46.062255] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-15T20:31:46.062292] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-15T20:31:46.062376] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-15T20:31:46.062436] [INFO ] [MAIN ] Update Progress: 1505/2369 symbols completed. NOA took 39.8s. Estimated remaining: 2h 1m 32s. Rate: 7.1 symbols/min [2025-10-15T20:31:46.226192] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:46.226343] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-15T20:31:46.226380] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-15T20:31:46.226487] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-15T20:31:46.226528] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-15T20:31:46.226569] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-15T20:31:46.226601] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-15T20:31:46.519134] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-15T20:31:46.578503] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:46.774506] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T20:31:47.313999] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-15T20:31:48.114056] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-15T20:31:48.350127] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T20:31:48.914046] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-15T20:31:49.713977] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-15T20:31:49.773332] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T20:31:49.864009] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-15T20:31:50.072481] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-15T20:31:50.514048] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-15T20:31:50.666328] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:31:51.314025] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-15T20:31:52.122453] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-15T20:31:52.142885] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T20:31:52.554892] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T20:31:52.766172] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T20:31:52.914012] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-15T20:31:53.656748] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:31:53.662884] [INFO ] [REMOTE ] NOG: Full fetch complete (73789 records). [2025-10-15T20:31:53.663031] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-15T20:31:53.663897] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:31:53.664012] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:31:53.664053] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:31:53.664110] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-15T20:31:53.664191] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-15T20:31:53.664227] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-15T20:31:53.664266] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-15T20:31:53.664319] [INFO ] [MAIN ] Update Progress: 1506/2369 symbols completed. NOG took 33.2s. Estimated remaining: 2h 1m 23s. Rate: 7.1 symbols/min [2025-10-15T20:31:53.719234] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-15T20:31:53.834746] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:31:53.834922] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-15T20:31:53.834976] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-15T20:31:53.835084] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-15T20:31:53.835125] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-15T20:31:53.835165] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-15T20:31:53.835196] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-15T20:31:54.181063] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:31:54.514051] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-15T20:31:55.314065] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-15T20:31:55.759501] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T20:31:55.808562] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-15T20:31:55.889377] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T20:31:56.113979] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-15T20:31:56.914023] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-15T20:31:57.370112] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T20:31:57.713973] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-15T20:31:58.177163] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T20:31:58.180686] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T20:31:58.513981] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-15T20:31:59.313983] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-15T20:31:59.706901] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-15T20:32:00.114001] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-15T20:32:00.575232] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T20:32:00.640401] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-15T20:32:00.914041] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-15T20:32:01.519818] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T20:32:01.714038] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-15T20:32:02.514031] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-15T20:32:03.217161] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T20:32:03.313972] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-15T20:32:04.114005] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-15T20:32:04.655954] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T20:32:04.705130] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T20:32:04.778789] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T20:32:04.914015] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-15T20:32:05.714007] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-15T20:32:06.514013] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-15T20:32:06.550685] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T20:32:06.556136] [INFO ] [REMOTE ] NOC: Full fetch complete (61500 records). [2025-10-15T20:32:06.556293] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-15T20:32:06.557143] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:32:06.557250] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:32:06.557331] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:32:06.557416] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-15T20:32:06.557494] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-15T20:32:06.557541] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-15T20:32:06.557589] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-15T20:32:06.557693] [INFO ] [MAIN ] Update Progress: 1507/2369 symbols completed. NOC took 47.6s. Estimated remaining: 2h 1m 17s. Rate: 7.1 symbols/min [2025-10-15T20:32:06.743139] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:06.781859] [DEBUG] [LOCAL ] NOTE: Loaded 40495 existing records from primary storage. [2025-10-15T20:32:06.782198] [INFO ] [MAIN ] NOTE: Loaded 40495 existing records. [2025-10-15T20:32:06.963018] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:32:06.963248] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-15T20:32:06.963297] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-15T20:32:06.963716] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-15T20:32:06.963775] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-15T20:32:07.076284] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T20:32:07.272489] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-15T20:32:07.309131] [INFO ] [REMOTE ] NOK: Full fetch complete (77764 records). [2025-10-15T20:32:07.314340] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-15T20:32:07.342075] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-15T20:32:07.394110] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:07.767260] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-15T20:32:07.767366] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-15T20:32:07.768848] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-15T20:32:07.768914] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-15T20:32:07.770429] [DEBUG] [LOCAL ] NOK: Trimmed 77764 records to 53622 (keeping 200 days of data) [2025-10-15T20:32:07.877336] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:32:07.878966] [INFO ] [REMOTE ] NOM: Full fetch complete (1569 records). [2025-10-15T20:32:07.884396] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-15T20:32:08.114513] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-15T20:32:08.201187] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-15T20:32:08.201587] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:32:08.203914] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:32:08.204838] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-15T20:32:08.205494] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-15T20:32:08.206699] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-15T20:32:08.207670] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-15T20:32:08.207802] [INFO ] [MAIN ] Update Progress: 1508/2369 symbols completed. NOM took 22.1s. Estimated remaining: 2h 1m 5s. Rate: 7.1 symbols/min [2025-10-15T20:32:08.471439] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:08.471969] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-15T20:32:08.472111] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-15T20:32:08.490715] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-15T20:32:08.502675] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-15T20:32:08.504696] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-15T20:32:08.506191] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-15T20:32:08.594231] [DEBUG] [LOCAL ] NOK: Primary data saved (53622 records). [2025-10-15T20:32:08.606179] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-15T20:32:08.619341] [INFO ] [MAIN ] Update Progress: 1509/2369 symbols completed. NOK took 37.5s. Estimated remaining: 2h 0m 52s. Rate: 7.1 symbols/min [2025-10-15T20:32:08.917816] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-15T20:32:08.962554] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:08.996765] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-15T20:32:09.023131] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-15T20:32:09.027629] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-15T20:32:09.028086] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-15T20:32:09.044216] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-15T20:32:09.054676] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-15T20:32:09.212633] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:09.517879] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:09.542537] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T20:32:09.713991] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-15T20:32:10.513979] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-15T20:32:10.999949] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-15T20:32:11.313973] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-15T20:32:11.486002] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T20:32:12.114019] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-15T20:32:12.320841] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T20:32:12.913972] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-15T20:32:12.948018] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T20:32:13.713981] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-15T20:32:13.795329] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T20:32:14.513982] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-15T20:32:14.889474] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-15T20:32:15.310410] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T20:32:15.319904] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-15T20:32:16.114080] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-15T20:32:16.322671] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T20:32:16.914065] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-15T20:32:17.126750] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:32:17.617746] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T20:32:17.714005] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-15T20:32:18.513989] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-15T20:32:18.786690] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T20:32:19.314021] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-15T20:32:19.409013] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T20:32:20.114078] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-15T20:32:20.600809] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-15T20:32:20.914002] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-15T20:32:20.992983] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T20:32:21.648234] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T20:32:21.713963] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-15T20:32:22.473589] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:32:22.513954] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-15T20:32:23.067300] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T20:32:23.313968] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-15T20:32:24.022838] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T20:32:24.114030] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-15T20:32:24.913990] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-15T20:32:25.188447] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T20:32:25.714120] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-15T20:32:26.208775] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T20:32:26.366274] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T20:32:26.514065] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-15T20:32:27.314929] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T20:32:27.315085] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-15T20:32:28.113988] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-15T20:32:28.379201] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T20:32:28.665484] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T20:32:28.914000] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-15T20:32:29.713994] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-15T20:32:29.906571] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T20:32:29.914168] [INFO ] [REMOTE ] NOMD: Full fetch complete (59871 records). [2025-10-15T20:32:29.914345] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-15T20:32:29.915153] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:32:29.915261] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:32:29.915306] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:32:29.915348] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-15T20:32:29.915404] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-15T20:32:29.915439] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-15T20:32:29.915477] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-15T20:32:29.915531] [INFO ] [MAIN ] Update Progress: 1510/2369 symbols completed. NOMD took 36.3s. Estimated remaining: 2h 0m 51s. Rate: 7.1 symbols/min [2025-10-15T20:32:30.087256] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:30.087433] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-15T20:32:30.087481] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-15T20:32:30.087588] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-15T20:32:30.087629] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-15T20:32:30.087710] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-15T20:32:30.087751] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-15T20:32:30.442910] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:30.487120] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-15T20:32:30.513955] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-15T20:32:31.314024] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-15T20:32:31.588437] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:32:31.588792] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-15T20:32:31.588882] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:32:31.588929] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-15T20:32:31.588991] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:32:31.589069] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-15T20:32:31.589133] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-15T20:32:31.589168] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-15T20:32:31.589207] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-15T20:32:31.589252] [INFO ] [MAIN ] Update Progress: 1511/2369 symbols completed. NP took 1.7s. Estimated remaining: 2h 0m 38s. Rate: 7.1 symbols/min [2025-10-15T20:32:31.727797] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T20:32:31.816747] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:31.816912] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-15T20:32:31.816967] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-15T20:32:31.817078] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-15T20:32:31.817118] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-15T20:32:31.817158] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-15T20:32:31.817190] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-15T20:32:32.124156] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-15T20:32:32.164311] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:32.396344] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T20:32:32.914005] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-15T20:32:33.713991] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-15T20:32:34.009087] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T20:32:34.514009] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-15T20:32:34.783620] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:32:34.783973] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-15T20:32:34.784074] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:32:34.784121] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-15T20:32:34.784181] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:32:34.784254] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-15T20:32:34.784317] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-15T20:32:34.784352] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-15T20:32:34.784391] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-15T20:32:34.784480] [INFO ] [MAIN ] Update Progress: 1512/2369 symbols completed. NPB took 3.2s. Estimated remaining: 2h 0m 27s. Rate: 7.1 symbols/min [2025-10-15T20:32:34.958879] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:34.959214] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-15T20:32:34.959437] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-15T20:32:34.959553] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-15T20:32:34.975424] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-15T20:32:34.988789] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-15T20:32:34.988861] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-15T20:32:35.091019] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T20:32:35.321570] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-15T20:32:35.362290] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:35.552254] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T20:32:36.114016] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-15T20:32:36.914018] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-15T20:32:37.011715] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T20:32:37.719197] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-15T20:32:37.725454] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T20:32:37.907165] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T20:32:38.514019] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-15T20:32:38.897157] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T20:32:39.228104] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:32:39.235812] [INFO ] [REMOTE ] NOV: Full fetch complete (76767 records). [2025-10-15T20:32:39.235980] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-15T20:32:39.236874] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:32:39.236964] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:32:39.237007] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:32:39.237047] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-15T20:32:39.237102] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-15T20:32:39.237136] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-15T20:32:39.237174] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-15T20:32:39.237229] [INFO ] [MAIN ] Update Progress: 1513/2369 symbols completed. NOV took 31.0s. Estimated remaining: 2h 0m 16s. Rate: 7.1 symbols/min [2025-10-15T20:32:39.319217] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-15T20:32:39.408668] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:39.421714] [DEBUG] [LOCAL ] NPFD: Loaded 10015 existing records from primary storage. [2025-10-15T20:32:39.421977] [INFO ] [MAIN ] NPFD: Loaded 10015 existing records. [2025-10-15T20:32:39.606279] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:32:39.606516] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-15T20:32:39.606573] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-15T20:32:39.606847] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-15T20:32:39.606907] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-15T20:32:39.982276] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:40.114063] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-15T20:32:40.914031] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-15T20:32:41.309859] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T20:32:41.315075] [INFO ] [REMOTE ] NOTE: Full fetch complete (62116 records). [2025-10-15T20:32:41.315220] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-15T20:32:41.675325] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-15T20:32:41.735899] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-15T20:32:41.782217] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-15T20:32:41.782312] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-15T20:32:41.783466] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-15T20:32:41.783574] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-15T20:32:41.784877] [DEBUG] [LOCAL ] NOTE: Trimmed 62116 records to 40429 (keeping 200 days of data) [2025-10-15T20:32:41.889902] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T20:32:42.040045] [DEBUG] [LOCAL ] NOTE: Primary data saved (40429 records). [2025-10-15T20:32:42.040181] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-15T20:32:42.040780] [INFO ] [MAIN ] Update Progress: 1514/2369 symbols completed. NOTE took 35.5s. Estimated remaining: 2h 0m 5s. Rate: 7.1 symbols/min [2025-10-15T20:32:42.213732] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:42.225061] [DEBUG] [LOCAL ] NPK: Loaded 8333 existing records from primary storage. [2025-10-15T20:32:42.225302] [INFO ] [MAIN ] NPK: Loaded 8333 existing records. [2025-10-15T20:32:42.433217] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:32:42.433438] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-15T20:32:42.433486] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-15T20:32:42.433683] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-15T20:32:42.433741] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-15T20:32:42.519195] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-15T20:32:42.813741] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:42.814269] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T20:32:43.205879] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T20:32:43.314000] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-15T20:32:44.113975] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-15T20:32:44.417598] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T20:32:44.914042] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-15T20:32:45.718006] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-15T20:32:45.718912] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T20:32:46.025296] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T20:32:46.352871] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T20:32:46.514022] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-15T20:32:47.261837] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T20:32:47.314057] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-15T20:32:48.113983] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-15T20:32:48.318486] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T20:32:48.913964] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-15T20:32:48.982756] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T20:32:49.713991] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-15T20:32:50.160882] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T20:32:50.513973] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-15T20:32:51.242241] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T20:32:51.313966] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-15T20:32:52.114062] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-15T20:32:52.181152] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T20:32:52.598172] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-15T20:32:52.914013] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-15T20:32:52.926447] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T20:32:53.714006] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-15T20:32:53.818318] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T20:32:54.492856] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T20:32:54.513986] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-15T20:32:55.222025] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:32:55.227692] [INFO ] [REMOTE ] NOW: Full fetch complete (70440 records). [2025-10-15T20:32:55.227875] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-15T20:32:55.228541] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:32:55.228625] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:32:55.228702] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:32:55.228777] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-15T20:32:55.228840] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-15T20:32:55.228875] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-15T20:32:55.228912] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-15T20:32:55.228968] [INFO ] [MAIN ] Update Progress: 1515/2369 symbols completed. NOW took 46.6s. Estimated remaining: 1h 59m 59s. Rate: 7.1 symbols/min [2025-10-15T20:32:55.319067] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-15T20:32:55.398693] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:32:55.398846] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-15T20:32:55.398884] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-15T20:32:55.398991] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-15T20:32:55.399032] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-15T20:32:55.399073] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-15T20:32:55.399105] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-15T20:32:55.763048] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:32:56.113989] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-15T20:32:56.286242] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T20:32:56.914011] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-15T20:32:56.924709] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T20:32:57.487676] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T20:32:57.713974] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-15T20:32:58.513976] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-15T20:32:58.577333] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T20:32:59.314064] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-15T20:32:59.619435] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T20:33:00.113996] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-15T20:33:00.462963] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T20:33:00.913987] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-15T20:33:01.233955] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T20:33:01.684188] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T20:33:01.713960] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-15T20:33:02.514062] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-15T20:33:02.632867] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T20:33:03.118766] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T20:33:03.314089] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-15T20:33:04.113995] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-15T20:33:04.206273] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T20:33:04.913572] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T20:33:04.914526] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-15T20:33:05.714088] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-15T20:33:06.191174] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T20:33:06.194227] [INFO ] [REMOTE ] NPCT: Full fetch complete (24650 records). [2025-10-15T20:33:06.194440] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-15T20:33:06.195084] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:33:06.195173] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:33:06.195218] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:33:06.195260] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-15T20:33:06.195324] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-15T20:33:06.195360] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-15T20:33:06.195400] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-15T20:33:06.195466] [INFO ] [MAIN ] Update Progress: 1516/2369 symbols completed. NPCT took 31.4s. Estimated remaining: 1h 59m 52s. Rate: 7.1 symbols/min [2025-10-15T20:33:06.377151] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:06.384291] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-15T20:33:06.393456] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-15T20:33:06.395878] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-15T20:33:06.396470] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-15T20:33:06.397099] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T20:33:06.397204] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-15T20:33:06.404401] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-15T20:33:06.519070] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-15T20:33:06.765222] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:07.313994] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-15T20:33:07.334726] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T20:33:08.114027] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-15T20:33:08.275081] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T20:33:08.914005] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-15T20:33:09.077786] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T20:33:09.670489] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:33:09.672169] [INFO ] [REMOTE ] NPK: Full fetch complete (11060 records). [2025-10-15T20:33:09.672258] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-15T20:33:09.724229] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-15T20:33:10.034193] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-15T20:33:10.034268] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-15T20:33:10.034531] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-15T20:33:10.034577] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-15T20:33:10.035034] [DEBUG] [LOCAL ] NPK: Trimmed 11060 records to 8408 (keeping 200 days of data) [2025-10-15T20:33:10.084889] [DEBUG] [LOCAL ] NPK: Primary data saved (8408 records). [2025-10-15T20:33:10.085015] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-15T20:33:10.085092] [INFO ] [MAIN ] Update Progress: 1517/2369 symbols completed. NPK took 28.0s. Estimated remaining: 1h 59m 41s. Rate: 7.1 symbols/min [2025-10-15T20:33:10.514002] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-15T20:33:10.563709] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T20:33:11.313991] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-15T20:33:11.471614] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:33:12.113993] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-15T20:33:12.764666] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T20:33:12.913968] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-15T20:33:12.923691] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T20:33:13.713990] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-15T20:33:14.292169] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T20:33:14.513989] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-15T20:33:14.682615] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T20:33:15.313998] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-15T20:33:16.057811] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T20:33:16.097819] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T20:33:16.100959] [INFO ] [REMOTE ] NPFD: Full fetch complete (14678 records). [2025-10-15T20:33:16.101115] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-15T20:33:16.119159] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-15T20:33:16.620446] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-15T20:33:16.620545] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-15T20:33:16.621009] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-15T20:33:16.621078] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-15T20:33:16.621945] [DEBUG] [LOCAL ] NPFD: Trimmed 14678 records to 10070 (keeping 200 days of data) [2025-10-15T20:33:16.689779] [DEBUG] [LOCAL ] NPFD: Primary data saved (10070 records). [2025-10-15T20:33:16.689932] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-15T20:33:16.690020] [INFO ] [MAIN ] Update Progress: 1518/2369 symbols completed. NPFD took 37.5s. Estimated remaining: 1h 59m 31s. Rate: 7.1 symbols/min [2025-10-15T20:33:16.914116] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-15T20:33:17.598364] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T20:33:17.714002] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-15T20:33:17.794123] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T20:33:18.514052] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-15T20:33:19.306129] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T20:33:19.315269] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-15T20:33:19.578567] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T20:33:20.114054] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-15T20:33:20.683979] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T20:33:20.800742] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T20:33:20.913990] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-15T20:33:21.714060] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-15T20:33:22.335577] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T20:33:22.514031] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-15T20:33:22.663246] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:33:23.209964] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:33:23.214445] [INFO ] [REMOTE ] NPKI: Full fetch complete (55618 records). [2025-10-15T20:33:23.214536] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-15T20:33:23.215128] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:33:23.215231] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:33:23.215308] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:33:23.215403] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-15T20:33:23.215501] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-15T20:33:23.215569] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-15T20:33:23.215626] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-15T20:33:23.215722] [INFO ] [MAIN ] Update Progress: 1519/2369 symbols completed. NPKI took 28.0s. Estimated remaining: 1h 59m 22s. Rate: 7.1 symbols/min [2025-10-15T20:33:23.314028] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-15T20:33:24.389694] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T20:33:24.393401] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-15T20:33:25.337893] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T20:33:25.341293] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-15T20:33:26.240492] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T20:33:26.244088] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-15T20:33:26.797993] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:33:26.800561] [INFO ] [REMOTE ] NPO: Full fetch complete (18585 records). [2025-10-15T20:33:26.800712] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-15T20:33:26.801151] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:33:26.801238] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:33:26.801283] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:33:26.801346] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-15T20:33:26.801409] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-15T20:33:26.801442] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-15T20:33:26.801480] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-15T20:33:26.801997] [INFO ] [MAIN ] Update Progress: 1520/2369 symbols completed. NPO took 20.6s. Estimated remaining: 1h 59m 11s. Rate: 7.1 symbols/min [2025-10-15T20:33:27.530239] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:27.499181] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:27.508278] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:27.553687] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:27.554994] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-15T20:33:27.555093] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-15T20:33:27.555860] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-15T20:33:27.556003] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-15T20:33:27.556170] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-15T20:33:27.556228] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-15T20:33:27.653411] [DEBUG] [LOCAL ] NQP: Loaded 9239 existing records from primary storage. [2025-10-15T20:33:27.669946] [INFO ] [MAIN ] NQP: Loaded 9239 existing records. [2025-10-15T20:33:27.678416] [DEBUG] [LOCAL ] NPV: Loaded 5319 existing records from primary storage. [2025-10-15T20:33:27.715521] [INFO ] [MAIN ] NPV: Loaded 5319 existing records. [2025-10-15T20:33:27.982522] [DEBUG] [LOCAL ] NRDY: Loaded 32673 existing records from primary storage. [2025-10-15T20:33:28.025571] [INFO ] [MAIN ] NRDY: Loaded 32673 existing records. [2025-10-15T20:33:28.276466] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:33:28.365489] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-15T20:33:28.403179] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-15T20:33:28.474048] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:33:28.467722] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-15T20:33:28.490131] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-15T20:33:28.548757] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-15T20:33:28.568790] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-15T20:33:28.571877] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:28.592523] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-15T20:33:28.601708] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-15T20:33:28.644831] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:33:28.663872] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-15T20:33:28.650083] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-15T20:33:28.681709] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-15T20:33:28.695942] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-15T20:33:28.726992] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-15T20:33:29.565803] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:29.583896] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-15T20:33:29.730884] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:29.749114] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-15T20:33:29.753057] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:29.754780] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-15T20:33:30.179179] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T20:33:30.186816] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-15T20:33:30.438012] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T20:33:30.446043] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T20:33:30.513999] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-15T20:33:31.184505] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T20:33:31.313972] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-15T20:33:31.475190] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T20:33:31.626426] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T20:33:31.902871] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T20:33:32.114049] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-15T20:33:32.913990] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-15T20:33:33.552204] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T20:33:33.714008] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-15T20:33:33.788940] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T20:33:34.514023] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-15T20:33:35.088091] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T20:33:35.179750] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T20:33:35.314017] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-15T20:33:36.114026] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-15T20:33:36.920071] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-15T20:33:36.923411] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T20:33:37.176942] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T20:33:37.653045] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T20:33:37.714027] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-15T20:33:38.252210] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T20:33:38.514000] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-15T20:33:39.175155] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T20:33:39.313984] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-15T20:33:40.113979] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-15T20:33:40.121119] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T20:33:40.914027] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-15T20:33:41.605498] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T20:33:41.714009] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-15T20:33:42.434501] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T20:33:42.514017] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-15T20:33:42.617140] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T20:33:43.314004] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-15T20:33:44.069609] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T20:33:44.113979] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-15T20:33:44.167887] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T20:33:44.913982] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-15T20:33:45.197155] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T20:33:45.714022] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-15T20:33:45.909956] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T20:33:46.513992] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-15T20:33:47.314050] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-15T20:33:47.635892] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T20:33:47.796532] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T20:33:48.113970] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-15T20:33:48.154179] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T20:33:48.686604] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T20:33:48.914010] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-15T20:33:49.012817] [DEBUG] [REMOTE ] NQP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-15T20:33:49.013278] [WARN ] [REMOTE ] NQP: No data returned for month 2025-08 [2025-10-15T20:33:49.013378] [FATAL] [REMOTE ] NQP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:33:49.013517] [FATAL] [MAIN ] NQP: Failed to fetch primary data. [2025-10-15T20:33:49.013594] [WARN ] [MAIN ] NQP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:33:49.013700] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-15T20:33:49.013782] [DEBUG] [LOCAL ] NQP: No primary data file found to delete. [2025-10-15T20:33:49.013823] [INFO ] [LOCAL ] NQP: Starting deletion of derivative data. [2025-10-15T20:33:49.014145] [DEBUG] [LOCAL ] NQP: Deleted derivative data file. [2025-10-15T20:33:49.014259] [INFO ] [MAIN ] Update Progress: 1521/2369 symbols completed. NQP took 22.2s. Estimated remaining: 1h 59m 10s. Rate: 7.1 symbols/min [2025-10-15T20:33:49.198318] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:49.211316] [DEBUG] [LOCAL ] NREF: Loaded 8027 existing records from primary storage. [2025-10-15T20:33:49.211624] [INFO ] [MAIN ] NREF: Loaded 8027 existing records. [2025-10-15T20:33:49.394080] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:33:49.394360] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-15T20:33:49.394413] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-15T20:33:49.394617] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-15T20:33:49.394714] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-15T20:33:49.722134] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-15T20:33:49.754075] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:50.378930] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T20:33:50.513995] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-15T20:33:51.314000] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-15T20:33:51.523544] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T20:33:51.991135] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:33:51.992517] [INFO ] [REMOTE ] NPV: Full fetch complete (7139 records). [2025-10-15T20:33:51.992586] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-15T20:33:52.119138] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-15T20:33:52.367552] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-15T20:33:52.367876] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-15T20:33:52.368142] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-15T20:33:52.368184] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-15T20:33:52.368613] [DEBUG] [LOCAL ] NPV: Trimmed 7139 records to 5356 (keeping 200 days of data) [2025-10-15T20:33:52.401372] [DEBUG] [LOCAL ] NPV: Primary data saved (5356 records). [2025-10-15T20:33:52.401475] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-15T20:33:52.401553] [INFO ] [MAIN ] Update Progress: 1522/2369 symbols completed. NPV took 25.6s. Estimated remaining: 1h 58m 59s. Rate: 7.1 symbols/min [2025-10-15T20:33:52.565738] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:33:52.565966] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-15T20:33:52.566008] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-15T20:33:52.566152] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-15T20:33:52.566192] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-15T20:33:52.566231] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-15T20:33:52.566262] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-15T20:33:52.919165] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-15T20:33:52.983910] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:33:52.991922] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T20:33:53.714025] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-15T20:33:54.514004] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-15T20:33:54.955545] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T20:33:55.073365] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T20:33:55.313982] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-15T20:33:56.032435] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T20:33:56.114014] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-15T20:33:56.761366] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-15T20:33:56.913987] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-15T20:33:57.713976] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-15T20:33:57.825915] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T20:33:58.513974] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-15T20:33:58.580779] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T20:33:58.698151] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T20:33:59.314052] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-15T20:34:00.107975] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T20:34:00.115957] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-15T20:34:00.816626] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T20:34:00.914052] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-15T20:34:01.714069] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-15T20:34:01.836787] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T20:34:02.328792] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T20:34:02.334393] [INFO ] [REMOTE ] NPWR: Full fetch complete (60051 records). [2025-10-15T20:34:02.334512] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-15T20:34:02.335330] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:34:02.335608] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:34:02.335718] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:34:02.335790] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-15T20:34:02.335857] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-15T20:34:02.335892] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-15T20:34:02.335930] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-15T20:34:02.335985] [INFO ] [MAIN ] Update Progress: 1523/2369 symbols completed. NPWR took 35.5s. Estimated remaining: 1h 58m 51s. Rate: 7.1 symbols/min [2025-10-15T20:34:02.473229] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T20:34:02.523362] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-15T20:34:02.561510] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:02.611665] [DEBUG] [LOCAL ] NRGV: Loaded 43667 existing records from primary storage. [2025-10-15T20:34:02.612058] [INFO ] [MAIN ] NRGV: Loaded 43667 existing records. [2025-10-15T20:34:02.794896] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:34:02.795176] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-15T20:34:02.795228] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-15T20:34:02.795694] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-15T20:34:02.795755] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-15T20:34:03.167269] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:03.314084] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-15T20:34:03.826465] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T20:34:04.114009] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-15T20:34:04.914043] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-15T20:34:05.150551] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T20:34:05.494458] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T20:34:05.522711] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T20:34:05.714042] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-15T20:34:06.514039] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-15T20:34:07.314056] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-15T20:34:07.750550] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T20:34:07.916404] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T20:34:08.114031] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-15T20:34:08.279026] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T20:34:08.914587] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-15T20:34:09.714025] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-15T20:34:09.984730] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T20:34:10.313006] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T20:34:10.514032] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-15T20:34:11.103369] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T20:34:11.314018] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-15T20:34:11.407879] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T20:34:12.113964] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-15T20:34:12.913992] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-15T20:34:13.576582] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-15T20:34:13.713972] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-15T20:34:13.824402] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T20:34:14.282830] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T20:34:14.287241] [INFO ] [REMOTE ] NRDY: Full fetch complete (50743 records). [2025-10-15T20:34:14.287353] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-15T20:34:14.519119] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-15T20:34:14.612608] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:34:14.679301] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-15T20:34:14.679372] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-15T20:34:14.680222] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-15T20:34:14.680282] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-15T20:34:14.681252] [DEBUG] [LOCAL ] NRDY: Trimmed 50743 records to 32694 (keeping 200 days of data) [2025-10-15T20:34:14.857133] [DEBUG] [LOCAL ] NRDY: Primary data saved (32694 records). [2025-10-15T20:34:14.857261] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-15T20:34:14.857355] [INFO ] [MAIN ] Update Progress: 1524/2369 symbols completed. NRDY took 48.0s. Estimated remaining: 1h 58m 45s. Rate: 7.1 symbols/min [2025-10-15T20:34:15.022097] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:15.022260] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-15T20:34:15.022296] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-15T20:34:15.022400] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-15T20:34:15.022441] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-15T20:34:15.022481] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-15T20:34:15.022528] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-15T20:34:15.319073] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-15T20:34:15.378690] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:16.114000] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-15T20:34:16.537177] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-15T20:34:16.914036] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-15T20:34:17.132538] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T20:34:17.185302] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T20:34:17.690516] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T20:34:17.713973] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-15T20:34:18.514017] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-15T20:34:18.562961] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T20:34:19.313965] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-15T20:34:19.631624] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T20:34:20.114022] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-15T20:34:20.914062] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-15T20:34:21.417146] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T20:34:21.714006] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-15T20:34:21.754386] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T20:34:22.035806] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T20:34:22.501379] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:34:22.502935] [INFO ] [REMOTE ] NREF: Full fetch complete (10971 records). [2025-10-15T20:34:22.503011] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-15T20:34:22.523750] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-15T20:34:22.877933] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-15T20:34:22.878022] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-15T20:34:22.878297] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-15T20:34:22.878337] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-15T20:34:22.878898] [DEBUG] [LOCAL ] NREF: Trimmed 10971 records to 7865 (keeping 200 days of data) [2025-10-15T20:34:22.927956] [DEBUG] [LOCAL ] NREF: Primary data saved (7865 records). [2025-10-15T20:34:22.928110] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-15T20:34:22.928222] [INFO ] [MAIN ] Update Progress: 1525/2369 symbols completed. NREF took 33.9s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-15T20:34:23.118522] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:23.125512] [DEBUG] [LOCAL ] NRP: Loaded 4200 existing records from primary storage. [2025-10-15T20:34:23.125765] [INFO ] [MAIN ] NRP: Loaded 4200 existing records. [2025-10-15T20:34:23.298996] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:34:23.299199] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-15T20:34:23.299246] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-15T20:34:23.299421] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-15T20:34:23.299476] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-15T20:34:23.320016] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-15T20:34:23.658482] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:24.113972] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-15T20:34:24.423787] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T20:34:24.614680] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-15T20:34:24.914076] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-15T20:34:25.211230] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T20:34:25.714015] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-15T20:34:26.513984] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-15T20:34:26.729255] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T20:34:26.841729] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T20:34:27.314006] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-15T20:34:27.875754] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:34:27.887232] [INFO ] [REMOTE ] NRG: Full fetch complete (76407 records). [2025-10-15T20:34:27.887508] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-15T20:34:27.889006] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:34:27.889139] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:34:27.889185] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:34:27.889240] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-15T20:34:27.889332] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-15T20:34:27.889371] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-15T20:34:27.889412] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-15T20:34:27.889480] [INFO ] [MAIN ] Update Progress: 1526/2369 symbols completed. NRG took 35.5s. Estimated remaining: 1h 58m 26s. Rate: 7.1 symbols/min [2025-10-15T20:34:28.108577] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:28.118523] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-15T20:34:28.136946] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T20:34:28.149300] [DEBUG] [LOCAL ] NRT: Loaded 4888 existing records from primary storage. [2025-10-15T20:34:28.150037] [INFO ] [MAIN ] NRT: Loaded 4888 existing records. [2025-10-15T20:34:28.335104] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:34:28.335361] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-15T20:34:28.335427] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-15T20:34:28.335593] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-15T20:34:28.335694] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-15T20:34:28.687809] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:28.913954] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-15T20:34:29.303222] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T20:34:29.713976] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-15T20:34:29.896498] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T20:34:30.399772] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T20:34:30.514006] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-15T20:34:31.313977] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-15T20:34:31.560388] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T20:34:32.114058] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-15T20:34:32.914054] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-15T20:34:32.949185] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T20:34:32.963952] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T20:34:33.713966] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-15T20:34:33.905498] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T20:34:34.461870] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T20:34:34.513981] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-15T20:34:35.314053] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-15T20:34:35.793892] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T20:34:35.998717] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:34:36.114009] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-15T20:34:36.914055] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-15T20:34:37.664789] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T20:34:37.713979] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-15T20:34:38.109767] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T20:34:38.235732] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T20:34:38.514038] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-15T20:34:39.193092] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T20:34:39.313978] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-15T20:34:40.079533] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:34:40.114040] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-15T20:34:40.672030] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T20:34:40.914053] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-15T20:34:41.679585] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:34:41.713984] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-15T20:34:42.513998] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-15T20:34:43.083186] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T20:34:43.313980] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-15T20:34:43.707792] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T20:34:43.789523] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T20:34:44.113993] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-15T20:34:44.769813] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:34:44.772553] [INFO ] [REMOTE ] NRK: Full fetch complete (27452 records). [2025-10-15T20:34:44.772687] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-15T20:34:44.773189] [FATAL] [VALIDATOR ] NRK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:34:44.773271] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:34:44.773317] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:34:44.773393] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-15T20:34:44.773469] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-15T20:34:44.773516] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-10-15T20:34:44.773571] [DEBUG] [LOCAL ] NRK: No derivative data file found to delete. [2025-10-15T20:34:44.773691] [INFO ] [MAIN ] Update Progress: 1527/2369 symbols completed. NRK took 29.9s. Estimated remaining: 1h 58m 22s. Rate: 7.1 symbols/min [2025-10-15T20:34:44.919113] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-15T20:34:44.951957] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:44.952101] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-15T20:34:44.952138] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-15T20:34:44.952244] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-15T20:34:44.952284] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-15T20:34:44.952324] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-15T20:34:44.952354] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-15T20:34:45.312459] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:45.714063] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-15T20:34:46.513999] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-15T20:34:46.585604] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T20:34:46.759682] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T20:34:46.766582] [INFO ] [REMOTE ] NRGV: Full fetch complete (62475 records). [2025-10-15T20:34:46.766753] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-15T20:34:47.180380] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-15T20:34:47.180524] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-15T20:34:47.182184] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-15T20:34:47.182251] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-15T20:34:47.184009] [DEBUG] [LOCAL ] NRGV: Trimmed 62475 records to 43749 (keeping 200 days of data) [2025-10-15T20:34:47.278070] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T20:34:47.316184] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-15T20:34:47.462217] [DEBUG] [LOCAL ] NRGV: Primary data saved (43749 records). [2025-10-15T20:34:47.462415] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-15T20:34:47.462521] [INFO ] [MAIN ] Update Progress: 1528/2369 symbols completed. NRGV took 45.1s. Estimated remaining: 1h 58m 11s. Rate: 7.1 symbols/min [2025-10-15T20:34:47.639891] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:47.640137] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-15T20:34:47.640185] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-15T20:34:47.640314] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-15T20:34:47.640357] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-15T20:34:47.640398] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-15T20:34:47.640430] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-15T20:34:47.839979] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T20:34:48.030692] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:48.114023] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-15T20:34:48.914027] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-15T20:34:49.563966] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T20:34:49.651196] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T20:34:49.713995] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-15T20:34:50.369465] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T20:34:50.514034] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-15T20:34:51.087483] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T20:34:51.093879] [INFO ] [REMOTE ] NRP: Full fetch complete (6356 records). [2025-10-15T20:34:51.094127] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-15T20:34:51.319169] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-15T20:34:51.479630] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-15T20:34:51.479743] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-15T20:34:51.479990] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-15T20:34:51.480054] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-15T20:34:51.480533] [DEBUG] [LOCAL ] NRP: Trimmed 6356 records to 4190 (keeping 200 days of data) [2025-10-15T20:34:51.507629] [DEBUG] [LOCAL ] NRP: Primary data saved (4190 records). [2025-10-15T20:34:51.507804] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-15T20:34:51.507929] [INFO ] [MAIN ] Update Progress: 1529/2369 symbols completed. NRP took 28.6s. Estimated remaining: 1h 57m 60s. Rate: 7.1 symbols/min [2025-10-15T20:34:51.678909] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:51.679076] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-15T20:34:51.679113] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-15T20:34:51.679227] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-15T20:34:51.679269] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-15T20:34:51.679310] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-15T20:34:51.679341] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-15T20:34:51.988216] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T20:34:52.070816] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:52.114019] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-15T20:34:52.914020] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-15T20:34:52.929743] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T20:34:53.714025] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-15T20:34:54.419217] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T20:34:54.452370] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T20:34:54.514016] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-15T20:34:55.117269] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T20:34:55.119146] [INFO ] [REMOTE ] NRT: Full fetch complete (7942 records). [2025-10-15T20:34:55.119239] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-15T20:34:55.322706] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-15T20:34:55.549285] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-15T20:34:55.549386] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-15T20:34:55.549748] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-15T20:34:55.549811] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-15T20:34:55.550287] [DEBUG] [LOCAL ] NRT: Trimmed 7942 records to 4917 (keeping 200 days of data) [2025-10-15T20:34:55.579690] [DEBUG] [LOCAL ] NRT: Primary data saved (4917 records). [2025-10-15T20:34:55.579801] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-15T20:34:55.579910] [INFO ] [MAIN ] Update Progress: 1530/2369 symbols completed. NRT took 27.7s. Estimated remaining: 1h 57m 49s. Rate: 7.1 symbols/min [2025-10-15T20:34:55.747175] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:34:55.747433] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-15T20:34:55.747489] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-15T20:34:55.747613] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-15T20:34:55.747696] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-15T20:34:55.747764] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-15T20:34:55.747799] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-15T20:34:56.118488] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-15T20:34:56.133826] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:34:56.814138] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T20:34:56.872004] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T20:34:56.913971] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-15T20:34:57.714056] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-15T20:34:58.514077] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-15T20:34:58.658418] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T20:34:59.313994] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-15T20:34:59.419437] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T20:34:59.930315] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T20:35:00.114024] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-15T20:35:00.914050] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-15T20:35:00.965756] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T20:35:01.320711] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T20:35:01.714080] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-15T20:35:02.439735] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T20:35:02.514028] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-15T20:35:02.535433] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T20:35:03.221269] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T20:35:03.314043] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-15T20:35:04.044376] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T20:35:04.114036] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-15T20:35:04.704154] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T20:35:04.914017] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-15T20:35:05.505857] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T20:35:05.714083] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-15T20:35:06.204844] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T20:35:06.514002] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-15T20:35:07.314041] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-15T20:35:08.061489] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T20:35:08.081159] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T20:35:08.113997] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-15T20:35:08.914053] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-15T20:35:09.616128] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T20:35:09.714023] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-15T20:35:10.120138] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T20:35:10.121224] [INFO ] [REMOTE ] NRUC: Full fetch complete (5368 records). [2025-10-15T20:35:10.121295] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-15T20:35:10.121697] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:35:10.121781] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:35:10.121824] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:35:10.121864] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-15T20:35:10.121922] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-15T20:35:10.121988] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-15T20:35:10.122072] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-15T20:35:10.122140] [INFO ] [MAIN ] Update Progress: 1531/2369 symbols completed. NRUC took 25.3s. Estimated remaining: 1h 57m 44s. Rate: 7.1 symbols/min [2025-10-15T20:35:10.298181] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:35:10.298371] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-15T20:35:10.298408] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-15T20:35:10.298520] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-15T20:35:10.298561] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-15T20:35:10.298603] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-15T20:35:10.298637] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-15T20:35:10.519206] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-15T20:35:10.676443] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:35:10.816257] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T20:35:11.314019] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-15T20:35:11.866208] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T20:35:12.114038] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-15T20:35:12.913970] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-15T20:35:13.111566] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T20:35:13.714030] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-15T20:35:13.827324] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T20:35:14.442963] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T20:35:14.513966] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-15T20:35:14.888945] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T20:35:15.314000] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-15T20:35:16.114007] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-15T20:35:16.506433] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T20:35:16.505521] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T20:35:16.914052] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-15T20:35:17.714003] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-15T20:35:18.100134] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T20:35:18.333550] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T20:35:18.430598] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T20:35:18.514009] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-15T20:35:19.313968] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-15T20:35:19.718566] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T20:35:20.114017] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-15T20:35:20.739505] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T20:35:20.914044] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-15T20:35:21.630742] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T20:35:21.714037] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-15T20:35:22.273151] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T20:35:22.514058] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-15T20:35:23.211626] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T20:35:23.314096] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-15T20:35:24.114005] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-15T20:35:24.203253] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T20:35:24.914016] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-15T20:35:25.041911] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T20:35:25.286065] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T20:35:25.713999] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-15T20:35:26.420758] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T20:35:26.513986] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-15T20:35:27.092118] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:35:27.097000] [INFO ] [REMOTE ] NSP: Full fetch complete (49782 records). [2025-10-15T20:35:27.097221] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-15T20:35:27.098288] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:35:27.098419] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:35:27.098477] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:35:27.098551] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-15T20:35:27.098635] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-15T20:35:27.098720] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-15T20:35:27.098817] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-15T20:35:27.098889] [INFO ] [MAIN ] Update Progress: 1532/2369 symbols completed. NSP took 31.5s. Estimated remaining: 1h 57m 40s. Rate: 7.1 symbols/min [2025-10-15T20:35:27.315580] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-15T20:35:27.315433] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:35:27.317176] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-15T20:35:27.317236] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-15T20:35:27.317368] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-15T20:35:27.317411] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-15T20:35:27.317454] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-15T20:35:27.317490] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-15T20:35:27.766635] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:35:27.800249] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-15T20:35:28.096460] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T20:35:28.101823] [INFO ] [REMOTE ] NSA: Full fetch complete (62081 records). [2025-10-15T20:35:28.101942] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-15T20:35:28.102770] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:35:28.102860] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:35:28.102904] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:35:28.102947] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-15T20:35:28.103008] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-15T20:35:28.103048] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-15T20:35:28.103099] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-15T20:35:28.103159] [INFO ] [MAIN ] Update Progress: 1533/2369 symbols completed. NSA took 40.6s. Estimated remaining: 1h 57m 28s. Rate: 7.1 symbols/min [2025-10-15T20:35:28.119161] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-15T20:35:28.280602] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:35:28.280835] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-15T20:35:28.280878] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-15T20:35:28.280996] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-15T20:35:28.281041] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-15T20:35:28.281087] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-15T20:35:28.281121] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-15T20:35:28.627583] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:35:28.846501] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T20:35:28.913975] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-15T20:35:29.537541] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T20:35:29.714023] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-15T20:35:30.514019] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-15T20:35:30.846610] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T20:35:31.314052] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-15T20:35:32.114074] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-15T20:35:32.331162] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T20:35:32.532167] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T20:35:32.690265] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T20:35:32.914043] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-15T20:35:33.713991] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-15T20:35:34.174458] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T20:35:34.514037] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-15T20:35:34.874156] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T20:35:35.314005] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-15T20:35:35.445223] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T20:35:36.114014] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-15T20:35:36.866493] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T20:35:36.914002] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-15T20:35:37.384537] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T20:35:37.714011] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-15T20:35:37.893789] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T20:35:38.514022] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-15T20:35:39.314109] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-15T20:35:39.381192] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T20:35:40.114064] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-15T20:35:40.247577] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T20:35:40.375686] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T20:35:40.641914] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T20:35:40.647317] [INFO ] [REMOTE ] NSC: Full fetch complete (70555 records). [2025-10-15T20:35:40.647469] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-15T20:35:40.648198] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:35:40.648294] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:35:40.648339] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:35:40.648417] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-15T20:35:40.648479] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-15T20:35:40.648514] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-15T20:35:40.648552] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-15T20:35:40.648611] [INFO ] [MAIN ] Update Progress: 1534/2369 symbols completed. NSC took 49.1s. Estimated remaining: 1h 57m 22s. Rate: 7.1 symbols/min [2025-10-15T20:35:40.822827] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:35:40.822991] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-15T20:35:40.823026] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-15T20:35:40.823141] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-15T20:35:40.823181] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-15T20:35:40.823222] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-15T20:35:40.823253] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-15T20:35:40.921397] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-15T20:35:41.189561] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:35:41.548259] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T20:35:41.714015] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-15T20:35:42.405741] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T20:35:42.514025] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-15T20:35:43.087530] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T20:35:43.314007] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-15T20:35:44.114051] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-15T20:35:44.913972] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-15T20:35:45.196859] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T20:35:45.707412] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T20:35:45.715694] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-15T20:35:46.040093] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T20:35:46.513978] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-15T20:35:46.935195] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T20:35:47.314049] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-15T20:35:48.114040] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-15T20:35:48.390128] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T20:35:48.497062] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T20:35:48.913998] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-15T20:35:49.480714] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T20:35:49.713983] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-15T20:35:49.949184] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T20:35:50.514020] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-15T20:35:50.995099] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T20:35:50.997954] [INFO ] [REMOTE ] NTB: Full fetch complete (30508 records). [2025-10-15T20:35:50.998051] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-15T20:35:50.998530] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:35:50.998616] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:35:50.998690] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:35:50.998741] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-15T20:35:50.998799] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-15T20:35:50.998833] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-15T20:35:50.998871] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-15T20:35:50.998924] [INFO ] [MAIN ] Update Progress: 1535/2369 symbols completed. NTB took 40.9s. Estimated remaining: 1h 57m 14s. Rate: 7.1 symbols/min [2025-10-15T20:35:51.176467] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:35:51.176858] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-15T20:35:51.176926] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-15T20:35:51.177167] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-15T20:35:51.177302] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-15T20:35:51.177408] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-15T20:35:51.177471] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-15T20:35:51.302879] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T20:35:51.314254] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-15T20:35:51.573816] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:35:52.114013] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-15T20:35:52.914025] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-15T20:35:53.284539] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T20:35:53.650847] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T20:35:53.713993] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-15T20:35:54.514052] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-15T20:35:55.160867] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-15T20:35:55.313994] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-15T20:35:55.628396] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T20:35:56.114031] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-15T20:35:56.160017] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T20:35:56.914002] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-15T20:35:57.386691] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T20:35:57.463806] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-15T20:35:57.714008] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-15T20:35:57.958224] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T20:35:57.982303] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-15T20:35:57.983083] [INFO ] [REMOTE ] NTEST: Full fetch complete (1962 records). [2025-10-15T20:35:57.983153] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-15T20:35:57.983510] [FATAL] [VALIDATOR ] NTEST: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:35:57.983593] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:35:57.983635] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:35:57.983730] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-15T20:35:57.983791] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-15T20:35:57.983825] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-15T20:35:57.983863] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-15T20:35:57.983916] [INFO ] [MAIN ] Update Progress: 1536/2369 symbols completed. NTEST took 30.9s. Estimated remaining: 1h 57m 5s. Rate: 7.1 symbols/min [2025-10-15T20:35:58.148343] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:35:58.148529] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-15T20:35:58.148581] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-15T20:35:58.148712] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-15T20:35:58.148765] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-15T20:35:58.148880] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-15T20:35:58.148928] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-15T20:35:58.487951] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:35:58.513951] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-15T20:35:59.314082] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-15T20:36:00.113995] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-15T20:36:00.446084] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T20:36:00.914058] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-15T20:36:01.611512] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-15T20:36:01.718603] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-15T20:36:01.724477] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T20:36:02.428258] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T20:36:02.514012] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-15T20:36:03.314030] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-15T20:36:03.971433] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-15T20:36:04.113966] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-15T20:36:04.628632] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-15T20:36:04.794211] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T20:36:04.913973] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-15T20:36:05.422982] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T20:36:05.428945] [INFO ] [REMOTE ] NTR: Full fetch complete (76119 records). [2025-10-15T20:36:05.429107] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-15T20:36:05.429976] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:36:05.430076] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:36:05.430119] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:36:05.430159] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-15T20:36:05.430235] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-15T20:36:05.430300] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-15T20:36:05.430366] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-15T20:36:05.430444] [INFO ] [MAIN ] Update Progress: 1537/2369 symbols completed. NTR took 37.3s. Estimated remaining: 1h 56m 56s. Rate: 7.1 symbols/min [2025-10-15T20:36:05.599364] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:05.599527] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-15T20:36:05.599565] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-15T20:36:05.599702] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-15T20:36:05.599754] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-15T20:36:05.599796] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-15T20:36:05.599830] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-15T20:36:05.719155] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-15T20:36:05.952029] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:06.516959] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-15T20:36:06.522988] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-15T20:36:07.313998] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-15T20:36:07.506998] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T20:36:08.027419] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T20:36:08.114000] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-15T20:36:08.628285] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T20:36:08.914037] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-15T20:36:09.719115] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-15T20:36:09.733584] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T20:36:10.220009] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T20:36:10.514212] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-15T20:36:11.314101] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-15T20:36:12.114039] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-15T20:36:12.243323] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:36:12.271186] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-15T20:36:12.914041] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-15T20:36:13.452951] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T20:36:13.487130] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T20:36:13.714012] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-15T20:36:14.412304] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:36:14.417781] [INFO ] [REMOTE ] NTST: Full fetch complete (61389 records). [2025-10-15T20:36:14.417952] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-15T20:36:14.418608] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:36:14.418715] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:36:14.418759] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:36:14.418823] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-15T20:36:14.418886] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-15T20:36:14.418923] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-15T20:36:14.418962] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-15T20:36:14.419018] [INFO ] [MAIN ] Update Progress: 1538/2369 symbols completed. NTST took 33.8s. Estimated remaining: 1h 56m 48s. Rate: 7.1 symbols/min [2025-10-15T20:36:14.520955] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-15T20:36:14.602116] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:14.625489] [DEBUG] [LOCAL ] NUV: Loaded 23639 existing records from primary storage. [2025-10-15T20:36:14.625768] [INFO ] [MAIN ] NUV: Loaded 23639 existing records. [2025-10-15T20:36:14.832561] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:36:14.832878] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-15T20:36:14.833019] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-15T20:36:14.833408] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-15T20:36:14.833515] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-15T20:36:14.978984] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-15T20:36:15.235435] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:15.313988] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-15T20:36:16.113979] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-15T20:36:16.665602] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T20:36:16.792326] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-15T20:36:16.914073] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-15T20:36:17.714037] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-15T20:36:18.029485] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T20:36:18.322389] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T20:36:18.514003] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-15T20:36:19.313967] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-15T20:36:19.741158] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-15T20:36:20.114032] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-15T20:36:20.386545] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T20:36:20.561963] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-15T20:36:20.914024] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-15T20:36:21.714043] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-15T20:36:21.992550] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T20:36:22.030769] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T20:36:22.514045] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-15T20:36:23.183702] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T20:36:23.313967] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-15T20:36:23.874684] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T20:36:24.114013] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-15T20:36:24.878349] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:36:24.914017] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-15T20:36:25.714078] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-15T20:36:26.251629] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T20:36:26.495301] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T20:36:26.513961] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-15T20:36:27.314001] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-15T20:36:27.666013] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T20:36:27.819116] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-15T20:36:28.113975] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-15T20:36:28.913994] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-15T20:36:29.034633] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T20:36:29.145199] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T20:36:29.658489] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:36:29.665134] [INFO ] [REMOTE ] NU: Full fetch complete (77535 records). [2025-10-15T20:36:29.665283] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-15T20:36:29.666144] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:36:29.666234] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:36:29.666276] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:36:29.666315] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-15T20:36:29.666369] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-15T20:36:29.666403] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-15T20:36:29.666442] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-15T20:36:29.666496] [INFO ] [MAIN ] Update Progress: 1539/2369 symbols completed. NU took 38.7s. Estimated remaining: 1h 56m 43s. Rate: 7.1 symbols/min [2025-10-15T20:36:29.719117] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-15T20:36:29.868504] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:29.919908] [DEBUG] [LOCAL ] NUVB: Loaded 51542 existing records from primary storage. [2025-10-15T20:36:29.920230] [INFO ] [MAIN ] NUVB: Loaded 51542 existing records. [2025-10-15T20:36:30.100336] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:36:30.100570] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-15T20:36:30.100636] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-15T20:36:30.100995] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-15T20:36:30.101052] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-15T20:36:30.454462] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:30.513992] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-15T20:36:31.314055] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-15T20:36:31.849974] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-15T20:36:31.931936] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T20:36:32.114005] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-15T20:36:32.790503] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T20:36:32.913990] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-15T20:36:33.595545] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T20:36:33.714003] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-15T20:36:34.517041] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-15T20:36:34.519617] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T20:36:35.297329] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T20:36:35.313966] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-15T20:36:35.347957] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T20:36:36.114039] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-15T20:36:36.914009] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-15T20:36:37.096915] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T20:36:37.242926] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T20:36:37.505493] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T20:36:37.511829] [INFO ] [REMOTE ] NUE: Full fetch complete (74490 records). [2025-10-15T20:36:37.512013] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-15T20:36:37.513055] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:36:37.513187] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:36:37.513242] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:36:37.513289] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-15T20:36:37.513358] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-15T20:36:37.513401] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-15T20:36:37.513443] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-15T20:36:37.513509] [INFO ] [MAIN ] Update Progress: 1540/2369 symbols completed. NUE took 39.5s. Estimated remaining: 1h 56m 34s. Rate: 7.1 symbols/min [2025-10-15T20:36:37.691201] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:37.702256] [DEBUG] [LOCAL ] NUW: Loaded 6802 existing records from primary storage. [2025-10-15T20:36:37.702527] [INFO ] [MAIN ] NUW: Loaded 6802 existing records. [2025-10-15T20:36:37.724290] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-15T20:36:37.895936] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:36:37.896272] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-15T20:36:37.896329] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-15T20:36:37.896821] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-15T20:36:37.896911] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-15T20:36:38.281777] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:38.514039] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-15T20:36:39.314029] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-15T20:36:39.452077] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T20:36:39.671932] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T20:36:40.114026] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-15T20:36:40.185501] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T20:36:40.914015] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-15T20:36:41.296790] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T20:36:41.714022] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-15T20:36:42.514038] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-15T20:36:42.598118] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T20:36:43.211895] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T20:36:43.314031] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-15T20:36:43.467294] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T20:36:43.993587] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:36:43.997967] [INFO ] [REMOTE ] NUS: Full fetch complete (53598 records). [2025-10-15T20:36:43.998098] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-15T20:36:43.998720] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:36:43.998827] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:36:43.998872] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:36:43.998910] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-15T20:36:43.998966] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-15T20:36:43.999001] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-15T20:36:43.999039] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-15T20:36:43.999093] [INFO ] [MAIN ] Update Progress: 1541/2369 symbols completed. NUS took 38.6s. Estimated remaining: 1h 56m 25s. Rate: 7.1 symbols/min [2025-10-15T20:36:44.119116] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-15T20:36:44.177010] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:44.177166] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-15T20:36:44.177204] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-15T20:36:44.177314] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-15T20:36:44.177357] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-15T20:36:44.177399] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-15T20:36:44.177433] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-15T20:36:44.546973] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:44.914033] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-15T20:36:45.713992] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-15T20:36:46.195040] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T20:36:46.403540] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T20:36:46.513982] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-15T20:36:46.532797] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T20:36:47.314059] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-15T20:36:47.615135] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T20:36:48.114095] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-15T20:36:48.528722] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T20:36:48.532542] [INFO ] [REMOTE ] NUV: Full fetch complete (34091 records). [2025-10-15T20:36:48.532674] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-15T20:36:48.907801] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-15T20:36:48.907903] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-15T20:36:48.908702] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-15T20:36:48.908766] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-15T20:36:48.909587] [DEBUG] [LOCAL ] NUV: Trimmed 34091 records to 23747 (keeping 200 days of data) [2025-10-15T20:36:48.913991] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-15T20:36:49.055944] [DEBUG] [LOCAL ] NUV: Primary data saved (23747 records). [2025-10-15T20:36:49.056080] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-15T20:36:49.056163] [INFO ] [MAIN ] Update Progress: 1542/2369 symbols completed. NUV took 34.6s. Estimated remaining: 1h 56m 15s. Rate: 7.1 symbols/min [2025-10-15T20:36:49.233095] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:49.233623] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-15T20:36:49.233728] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-15T20:36:49.233843] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-15T20:36:49.233884] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-15T20:36:49.233925] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-15T20:36:49.233957] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-15T20:36:49.510118] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T20:36:49.619086] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:49.713957] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-15T20:36:49.739934] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T20:36:50.514091] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-15T20:36:50.626769] [DEBUG] [REMOTE ] NUVB: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-15T20:36:50.627094] [WARN ] [REMOTE ] NUVB: No data returned for month 2025-07 [2025-10-15T20:36:50.627191] [FATAL] [REMOTE ] NUVB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:36:50.627270] [FATAL] [MAIN ] NUVB: Failed to fetch primary data. [2025-10-15T20:36:50.627351] [WARN ] [MAIN ] NUVB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:36:50.627399] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-15T20:36:50.627458] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-15T20:36:50.627494] [INFO ] [LOCAL ] NUVB: Starting deletion of derivative data. [2025-10-15T20:36:50.627684] [DEBUG] [LOCAL ] NUVB: Deleted derivative data file. [2025-10-15T20:36:50.628359] [INFO ] [MAIN ] Update Progress: 1543/2369 symbols completed. NUVB took 21.0s. Estimated remaining: 1h 56m 2s. Rate: 7.1 symbols/min [2025-10-15T20:36:50.800450] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:36:50.800605] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-15T20:36:50.800666] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-15T20:36:50.800782] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-15T20:36:50.800822] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-15T20:36:50.800872] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-15T20:36:50.800947] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-15T20:36:51.164075] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T20:36:51.168939] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:36:51.313953] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-15T20:36:52.114061] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-15T20:36:52.229692] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T20:36:52.870775] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T20:36:52.914044] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-15T20:36:53.713974] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-15T20:36:53.768355] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T20:36:54.464693] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T20:36:54.513970] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-15T20:36:55.314000] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-15T20:36:55.415449] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T20:36:56.114090] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-15T20:36:56.555056] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T20:36:56.914041] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-15T20:36:56.945222] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T20:36:57.714096] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-15T20:36:58.059311] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T20:36:58.514038] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-15T20:36:58.552037] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T20:36:59.314011] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-15T20:36:59.775215] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T20:37:00.114034] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-15T20:37:00.683843] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T20:37:00.710731] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T20:37:00.913967] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-15T20:37:01.714107] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-15T20:37:02.388801] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T20:37:02.408767] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T20:37:02.514062] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-15T20:37:03.301133] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T20:37:03.313989] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-15T20:37:03.987357] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T20:37:04.113975] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-15T20:37:04.914060] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-15T20:37:05.497551] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T20:37:05.714124] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-15T20:37:06.357980] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T20:37:06.514027] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-15T20:37:06.849798] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T20:37:07.096183] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:37:07.097235] [INFO ] [REMOTE ] NUW: Full fetch complete (10991 records). [2025-10-15T20:37:07.097307] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-15T20:37:07.319225] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-15T20:37:07.454088] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-15T20:37:07.454158] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-15T20:37:07.454427] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-15T20:37:07.454468] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-15T20:37:07.454912] [DEBUG] [LOCAL ] NUW: Trimmed 10991 records to 6769 (keeping 200 days of data) [2025-10-15T20:37:07.495588] [DEBUG] [LOCAL ] NUW: Primary data saved (6769 records). [2025-10-15T20:37:07.495722] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-15T20:37:07.495813] [INFO ] [MAIN ] Update Progress: 1544/2369 symbols completed. NUW took 30.0s. Estimated remaining: 1h 55m 59s. Rate: 7.1 symbols/min [2025-10-15T20:37:07.659048] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:37:07.678315] [DEBUG] [LOCAL ] NVR: Loaded 18538 existing records from primary storage. [2025-10-15T20:37:07.678547] [INFO ] [MAIN ] NVR: Loaded 18538 existing records. [2025-10-15T20:37:07.858220] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:37:07.858454] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-15T20:37:07.858511] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-15T20:37:07.858832] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-15T20:37:07.858889] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-15T20:37:08.119155] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-15T20:37:08.210476] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:37:08.241946] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T20:37:08.914059] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-15T20:37:09.667462] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T20:37:09.714013] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-15T20:37:09.975666] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T20:37:10.514029] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-15T20:37:11.050861] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T20:37:11.314027] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-15T20:37:11.584863] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T20:37:12.113973] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-15T20:37:12.350753] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T20:37:12.914081] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-15T20:37:13.629993] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T20:37:13.714055] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-15T20:37:14.149470] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T20:37:14.514055] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-15T20:37:14.981988] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T20:37:15.314100] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-15T20:37:15.534121] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T20:37:16.114005] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-15T20:37:16.436425] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T20:37:16.916816] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T20:37:16.914132] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-15T20:37:17.714035] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-15T20:37:18.262672] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T20:37:18.513991] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-15T20:37:19.314043] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-15T20:37:19.719354] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T20:37:20.114017] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-15T20:37:20.377750] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-15T20:37:20.404541] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T20:37:20.421551] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-15T20:37:20.425320] [INFO ] [REMOTE ] NVGS: Full fetch complete (41797 records). [2025-10-15T20:37:20.425466] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-15T20:37:20.426578] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:37:20.426711] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:37:20.426804] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:37:20.426908] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-15T20:37:20.427058] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-15T20:37:20.427138] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-15T20:37:20.427203] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-15T20:37:20.427333] [INFO ] [MAIN ] Update Progress: 1545/2369 symbols completed. NVGS took 31.4s. Estimated remaining: 1h 55m 52s. Rate: 7.1 symbols/min [2025-10-15T20:37:20.626685] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:37:20.626915] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-15T20:37:20.626955] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-15T20:37:20.627083] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-15T20:37:20.627125] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-15T20:37:20.627167] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-15T20:37:20.627200] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-15T20:37:20.919302] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-15T20:37:21.013415] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:37:21.714068] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-15T20:37:21.954965] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T20:37:22.197433] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T20:37:22.200634] [INFO ] [REMOTE ] NVG: Full fetch complete (39806 records). [2025-10-15T20:37:22.200756] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-15T20:37:22.201411] [FATAL] [VALIDATOR ] NVG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:37:22.201495] [FATAL] [MAIN ] NVG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:37:22.201537] [WARN ] [MAIN ] NVG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:37:22.201575] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-15T20:37:22.201628] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-15T20:37:22.201710] [INFO ] [LOCAL ] NVG: Starting deletion of derivative data. [2025-10-15T20:37:22.201768] [DEBUG] [LOCAL ] NVG: No derivative data file found to delete. [2025-10-15T20:37:22.201821] [INFO ] [MAIN ] Update Progress: 1546/2369 symbols completed. NVG took 38.2s. Estimated remaining: 1h 55m 40s. Rate: 7.1 symbols/min [2025-10-15T20:37:22.372058] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:37:22.372243] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-15T20:37:22.372309] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-15T20:37:22.372417] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-15T20:37:22.372457] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-15T20:37:22.372501] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-15T20:37:22.372532] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-15T20:37:22.513964] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-15T20:37:22.719224] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:37:23.061838] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:37:23.067751] [INFO ] [REMOTE ] NVO: Full fetch complete (77574 records). [2025-10-15T20:37:23.067859] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-15T20:37:23.069468] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:37:23.069557] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:37:23.069599] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:37:23.069638] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-15T20:37:23.069772] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-15T20:37:23.069825] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-15T20:37:23.069881] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-15T20:37:23.069939] [INFO ] [MAIN ] Update Progress: 1547/2369 symbols completed. NVO took 32.4s. Estimated remaining: 1h 55m 28s. Rate: 7.1 symbols/min [2025-10-15T20:37:23.237916] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:37:23.238120] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-15T20:37:23.238157] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-15T20:37:23.238268] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-15T20:37:23.238308] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-15T20:37:23.238347] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-15T20:37:23.238381] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-15T20:37:23.319107] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-15T20:37:23.590524] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:37:24.114046] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-15T20:37:24.656682] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T20:37:24.914081] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-15T20:37:25.714027] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-15T20:37:25.895785] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T20:37:26.514040] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-15T20:37:26.547925] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T20:37:26.730530] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T20:37:27.313996] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-15T20:37:28.113987] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-15T20:37:28.419503] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T20:37:28.860498] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T20:37:28.913967] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-15T20:37:29.319701] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T20:37:29.713989] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-15T20:37:30.513971] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-15T20:37:30.617384] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T20:37:30.850241] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T20:37:31.314023] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-15T20:37:32.114087] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-15T20:37:32.252460] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T20:37:32.283985] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T20:37:32.914071] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-15T20:37:33.720319] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-15T20:37:33.747332] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T20:37:33.927209] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T20:37:34.513987] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-15T20:37:35.139419] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T20:37:35.313967] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-15T20:37:35.518584] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T20:37:35.521343] [INFO ] [REMOTE ] NVR: Full fetch complete (29114 records). [2025-10-15T20:37:35.521413] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-15T20:37:35.882016] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-15T20:37:35.882100] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-15T20:37:35.882700] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-15T20:37:35.882761] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-15T20:37:35.883416] [DEBUG] [LOCAL ] NVR: Trimmed 29114 records to 18536 (keeping 200 days of data) [2025-10-15T20:37:35.994253] [DEBUG] [LOCAL ] NVR: Primary data saved (18536 records). [2025-10-15T20:37:35.994395] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-15T20:37:35.994474] [INFO ] [MAIN ] Update Progress: 1548/2369 symbols completed. NVR took 28.5s. Estimated remaining: 1h 55m 22s. Rate: 7.1 symbols/min [2025-10-15T20:37:36.119157] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-15T20:37:36.162344] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:37:36.162466] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-15T20:37:36.162503] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-15T20:37:36.162608] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-15T20:37:36.162675] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-15T20:37:36.162739] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-15T20:37:36.162774] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-15T20:37:36.521556] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:37:36.546729] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T20:37:36.914029] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-15T20:37:37.713977] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-15T20:37:38.463794] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-15T20:37:38.514000] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-15T20:37:38.846863] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T20:37:39.248242] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T20:37:39.314017] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-15T20:37:40.114034] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-15T20:37:40.320050] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T20:37:40.819281] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T20:37:40.913988] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-15T20:37:41.437958] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T20:37:41.714037] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-15T20:37:42.514058] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-15T20:37:42.673082] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T20:37:43.314009] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-15T20:37:43.826876] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T20:37:43.974130] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T20:37:44.113998] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-15T20:37:44.913992] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-15T20:37:45.008929] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T20:37:45.545931] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T20:37:45.714113] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-15T20:37:46.200246] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T20:37:46.514020] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-15T20:37:47.314081] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-15T20:37:47.626727] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T20:37:47.963805] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T20:37:48.114073] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-15T20:37:48.807763] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T20:37:48.914044] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-15T20:37:49.714016] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-15T20:37:49.970439] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T20:37:50.311915] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T20:37:50.514117] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-15T20:37:51.308024] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T20:37:51.318445] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-15T20:37:51.860285] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T20:37:52.114104] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-15T20:37:52.826800] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T20:37:52.914026] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-15T20:37:53.476534] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T20:37:53.714063] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-15T20:37:54.514077] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-15T20:37:54.962911] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T20:37:55.314044] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-15T20:37:55.434893] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T20:37:55.784548] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T20:37:56.114013] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-15T20:37:56.914087] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-15T20:37:56.992335] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T20:37:57.701132] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:37:57.706968] [INFO ] [REMOTE ] NVST: Full fetch complete (73962 records). [2025-10-15T20:37:57.707076] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-15T20:37:57.707961] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:37:57.708047] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:37:57.708089] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:37:57.708153] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-15T20:37:57.708215] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-15T20:37:57.708250] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-15T20:37:57.708288] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-15T20:37:57.708340] [INFO ] [MAIN ] Update Progress: 1549/2369 symbols completed. NVST took 34.6s. Estimated remaining: 1h 55m 21s. Rate: 7.1 symbols/min [2025-10-15T20:37:57.713974] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-15T20:37:57.879721] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:37:57.879906] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-15T20:37:57.880015] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-15T20:37:57.880281] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-15T20:37:57.880451] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-15T20:37:57.880527] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-15T20:37:57.880618] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-15T20:37:58.181416] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-15T20:37:58.278547] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:37:58.513962] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-15T20:37:59.314022] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-15T20:37:59.523998] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T20:38:00.114049] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-15T20:38:00.152633] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T20:38:00.914022] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-15T20:38:01.184628] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T20:38:01.713965] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-15T20:38:01.864464] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:38:02.239408] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T20:38:02.244264] [INFO ] [REMOTE ] NVRI: Full fetch complete (55699 records). [2025-10-15T20:38:02.244374] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-15T20:38:02.245038] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:38:02.245124] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:38:02.245169] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:38:02.245220] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-15T20:38:02.245298] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-15T20:38:02.245334] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-15T20:38:02.245373] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-15T20:38:02.245427] [INFO ] [MAIN ] Update Progress: 1550/2369 symbols completed. NVRI took 41.8s. Estimated remaining: 1h 55m 10s. Rate: 7.1 symbols/min [2025-10-15T20:38:02.417403] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:02.417575] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-15T20:38:02.417632] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-15T20:38:02.417764] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-15T20:38:02.417806] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-15T20:38:02.417849] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-15T20:38:02.417909] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-15T20:38:02.516978] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-15T20:38:02.785812] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:02.812003] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T20:38:03.314019] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-15T20:38:04.113976] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-15T20:38:04.542541] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T20:38:04.913980] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-15T20:38:05.017843] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T20:38:05.714028] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-15T20:38:05.796949] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T20:38:05.840604] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T20:38:06.514104] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-15T20:38:06.552582] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T20:38:06.558559] [INFO ] [REMOTE ] NVT: Full fetch complete (74437 records). [2025-10-15T20:38:06.558752] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-15T20:38:06.559511] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:38:06.559602] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:38:06.559679] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:38:06.559740] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-15T20:38:06.559800] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-15T20:38:06.559890] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-15T20:38:06.559955] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-15T20:38:06.560018] [INFO ] [MAIN ] Update Progress: 1551/2369 symbols completed. NVT took 30.6s. Estimated remaining: 1h 54m 59s. Rate: 7.1 symbols/min [2025-10-15T20:38:06.727399] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:06.727596] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-15T20:38:06.727633] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-15T20:38:06.727763] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-15T20:38:06.727804] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-15T20:38:06.727844] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-15T20:38:06.727875] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-15T20:38:07.072556] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:07.314026] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-15T20:38:08.114024] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-15T20:38:08.426937] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T20:38:08.914002] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-15T20:38:08.958303] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T20:38:09.226980] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T20:38:09.376042] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T20:38:09.382079] [INFO ] [REMOTE ] NVS: Full fetch complete (74687 records). [2025-10-15T20:38:09.382199] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-15T20:38:09.382997] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:38:09.383088] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:38:09.383153] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:38:09.383225] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-15T20:38:09.383295] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-15T20:38:09.383330] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-15T20:38:09.383369] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-15T20:38:09.383423] [INFO ] [MAIN ] Update Progress: 1552/2369 symbols completed. NVS took 47.2s. Estimated remaining: 1h 54m 48s. Rate: 7.1 symbols/min [2025-10-15T20:38:09.562990] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:09.570713] [DEBUG] [LOCAL ] NXC: Loaded 4141 existing records from primary storage. [2025-10-15T20:38:09.570903] [INFO ] [MAIN ] NXC: Loaded 4141 existing records. [2025-10-15T20:38:09.715789] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-15T20:38:09.753980] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:38:09.754286] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-15T20:38:09.754339] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-15T20:38:09.754478] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-15T20:38:09.754517] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-15T20:38:10.117290] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:10.514001] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-15T20:38:11.074130] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T20:38:11.233203] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T20:38:11.314026] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-15T20:38:11.850224] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T20:38:12.114031] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-15T20:38:12.913993] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-15T20:38:13.406979] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T20:38:13.713970] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-15T20:38:13.904990] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T20:38:14.190828] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-15T20:38:14.514006] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-15T20:38:15.314060] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-15T20:38:16.114071] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-15T20:38:16.364926] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T20:38:16.430267] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T20:38:16.815437] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T20:38:16.914054] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-15T20:38:17.714028] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-15T20:38:18.283131] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T20:38:18.302207] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T20:38:18.513994] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-15T20:38:19.177378] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T20:38:19.314009] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-15T20:38:20.114004] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-15T20:38:20.913971] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-15T20:38:21.215021] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T20:38:21.258400] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-15T20:38:21.714018] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-15T20:38:22.301410] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T20:38:22.513997] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-15T20:38:23.314017] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-15T20:38:23.515711] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T20:38:23.655221] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T20:38:23.870616] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T20:38:24.113997] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-15T20:38:24.914003] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-15T20:38:25.525929] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T20:38:25.588387] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T20:38:25.714059] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-15T20:38:26.514024] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-15T20:38:27.040202] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T20:38:27.229300] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T20:38:27.314007] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-15T20:38:28.113994] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-15T20:38:28.537874] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T20:38:28.913982] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-15T20:38:29.676761] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T20:38:29.714016] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-15T20:38:30.514073] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-15T20:38:30.635078] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T20:38:30.897962] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T20:38:30.913061] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T20:38:30.914055] [INFO ] [REMOTE ] NXC: Full fetch complete (5723 records). [2025-10-15T20:38:30.914125] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-15T20:38:31.296134] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-15T20:38:31.296218] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-15T20:38:31.296393] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-15T20:38:31.296435] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-15T20:38:31.296904] [DEBUG] [LOCAL ] NXC: Trimmed 5723 records to 4142 (keeping 200 days of data) [2025-10-15T20:38:31.316721] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-15T20:38:31.325800] [DEBUG] [LOCAL ] NXC: Primary data saved (4142 records). [2025-10-15T20:38:31.325971] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-15T20:38:31.326063] [INFO ] [MAIN ] Update Progress: 1553/2369 symbols completed. NXC took 21.9s. Estimated remaining: 1h 54m 47s. Rate: 7.1 symbols/min [2025-10-15T20:38:31.506496] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:31.506735] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-15T20:38:31.506784] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-15T20:38:31.506896] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-15T20:38:31.506939] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-15T20:38:31.506980] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-15T20:38:31.507012] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-15T20:38:31.883945] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:32.114012] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-15T20:38:32.410470] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:38:32.410835] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-15T20:38:32.410940] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:38:32.411013] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-15T20:38:32.411047] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:38:32.411084] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-15T20:38:32.411176] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-15T20:38:32.411226] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-15T20:38:32.411268] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-15T20:38:32.411314] [INFO ] [MAIN ] Update Progress: 1554/2369 symbols completed. NXDR took 1.1s. Estimated remaining: 1h 54m 34s. Rate: 7.1 symbols/min [2025-10-15T20:38:32.592327] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:32.609964] [DEBUG] [LOCAL ] NXDT: Loaded 14998 existing records from primary storage. [2025-10-15T20:38:32.610245] [INFO ] [MAIN ] NXDT: Loaded 14998 existing records. [2025-10-15T20:38:32.756605] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T20:38:32.817773] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:38:32.818016] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-15T20:38:32.818066] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-15T20:38:32.818291] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-15T20:38:32.818360] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-15T20:38:32.915919] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-15T20:38:33.172939] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:33.599571] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:38:33.603760] [INFO ] [REMOTE ] NWN: Full fetch complete (37166 records). [2025-10-15T20:38:33.603891] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-15T20:38:33.604563] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:38:33.604688] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:38:33.604755] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:38:33.604838] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-15T20:38:33.604941] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-15T20:38:33.605002] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-15T20:38:33.605062] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-15T20:38:33.605138] [INFO ] [MAIN ] Update Progress: 1555/2369 symbols completed. NWN took 31.4s. Estimated remaining: 1h 54m 22s. Rate: 7.1 symbols/min [2025-10-15T20:38:33.717736] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-15T20:38:33.790200] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:33.848053] [DEBUG] [LOCAL ] NXE: Loaded 53032 existing records from primary storage. [2025-10-15T20:38:33.848421] [INFO ] [MAIN ] NXE: Loaded 53032 existing records. [2025-10-15T20:38:34.023435] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:38:34.023732] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-15T20:38:34.023785] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-15T20:38:34.023992] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-15T20:38:34.024047] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-15T20:38:34.401514] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:34.513961] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-15T20:38:35.110934] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T20:38:35.313993] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-15T20:38:36.113988] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-15T20:38:36.474204] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T20:38:36.913992] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-15T20:38:36.951149] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T20:38:36.987341] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T20:38:37.714035] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-15T20:38:38.359262] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T20:38:38.480310] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T20:38:38.486555] [INFO ] [REMOTE ] NWG: Full fetch complete (73535 records). [2025-10-15T20:38:38.486755] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-15T20:38:38.487926] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:38:38.488024] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:38:38.488069] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:38:38.488119] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-15T20:38:38.488220] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-15T20:38:38.488267] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-15T20:38:38.488311] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-15T20:38:38.488380] [INFO ] [MAIN ] Update Progress: 1556/2369 symbols completed. NWG took 40.8s. Estimated remaining: 1h 54m 12s. Rate: 7.1 symbols/min [2025-10-15T20:38:38.519870] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-15T20:38:38.664012] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:38:38.677286] [DEBUG] [LOCAL ] NXG: Loaded 10498 existing records from primary storage. [2025-10-15T20:38:38.677518] [INFO ] [MAIN ] NXG: Loaded 10498 existing records. [2025-10-15T20:38:38.851695] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:38:38.851906] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-15T20:38:38.851954] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-15T20:38:38.852142] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-15T20:38:38.852197] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-15T20:38:39.196975] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:38:39.313994] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-15T20:38:39.730605] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T20:38:39.843611] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-15T20:38:40.114099] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-15T20:38:40.914019] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-15T20:38:41.616434] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T20:38:41.673824] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T20:38:41.713954] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-15T20:38:42.265526] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T20:38:42.514035] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-15T20:38:43.313976] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-15T20:38:43.416509] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T20:38:44.037321] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T20:38:44.114002] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-15T20:38:44.914022] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-15T20:38:45.714033] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-15T20:38:46.004797] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T20:38:46.055804] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T20:38:46.514055] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-15T20:38:46.638925] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T20:38:47.314093] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-15T20:38:48.114047] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-15T20:38:48.413209] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T20:38:48.554896] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T20:38:48.914023] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-15T20:38:49.714010] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-15T20:38:49.925113] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T20:38:49.983609] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T20:38:50.514063] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-15T20:38:51.200252] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:38:51.204783] [INFO ] [REMOTE ] NX: Full fetch complete (47889 records). [2025-10-15T20:38:51.204917] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-15T20:38:51.205720] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:38:51.205817] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:38:51.205872] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:38:51.205957] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-15T20:38:51.206045] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-15T20:38:51.206098] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-15T20:38:51.206182] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-15T20:38:51.206255] [INFO ] [MAIN ] Update Progress: 1557/2369 symbols completed. NX took 44.6s. Estimated remaining: 1h 54m 6s. Rate: 7.1 symbols/min [2025-10-15T20:38:51.313998] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-15T20:38:51.426026] [DEBUG] [REMOTE ] NXG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-15T20:38:51.426345] [WARN ] [REMOTE ] NXG: No data returned for month 2025-04 [2025-10-15T20:38:51.426433] [FATAL] [REMOTE ] NXG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:38:51.426509] [FATAL] [MAIN ] NXG: Failed to fetch primary data. [2025-10-15T20:38:51.426569] [WARN ] [MAIN ] NXG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:38:51.426638] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-15T20:38:51.426760] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-15T20:38:51.426798] [INFO ] [LOCAL ] NXG: Starting deletion of derivative data. [2025-10-15T20:38:51.426957] [DEBUG] [LOCAL ] NXG: Deleted derivative data file. [2025-10-15T20:38:51.427041] [INFO ] [MAIN ] Update Progress: 1558/2369 symbols completed. NXG took 12.9s. Estimated remaining: 1h 53m 53s. Rate: 7.1 symbols/min [2025-10-15T20:38:51.670222] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T20:38:52.113995] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-15T20:38:52.914019] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-15T20:38:53.724512] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T20:38:53.727997] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-15T20:38:53.862282] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T20:38:54.514012] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-15T20:38:54.725099] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T20:38:55.314039] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-15T20:38:56.398846] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T20:38:56.410112] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-15T20:38:56.448548] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T20:38:56.914052] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-15T20:38:57.807278] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T20:38:57.811000] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-15T20:38:58.129573] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T20:38:58.514078] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-15T20:38:58.683816] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T20:38:58.685873] [INFO ] [REMOTE ] NXDT: Full fetch complete (24322 records). [2025-10-15T20:38:58.685963] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-15T20:38:59.051847] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-15T20:38:59.051923] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-15T20:38:59.052418] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-15T20:38:59.052458] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-15T20:38:59.053106] [DEBUG] [LOCAL ] NXDT: Trimmed 24322 records to 14958 (keeping 200 days of data) [2025-10-15T20:38:59.148259] [DEBUG] [LOCAL ] NXDT: Primary data saved (14958 records). [2025-10-15T20:38:59.148412] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-15T20:38:59.148539] [INFO ] [MAIN ] Update Progress: 1559/2369 symbols completed. NXDT took 26.7s. Estimated remaining: 1h 53m 44s. Rate: 7.1 symbols/min [2025-10-15T20:39:00.511672] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T20:39:00.524237] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-15T20:39:02.549773] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T20:39:02.562604] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-15T20:39:04.638977] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T20:39:04.651088] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-15T20:39:06.622100] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-15T20:39:06.628715] [INFO ] [REMOTE ] NXE: Full fetch complete (76938 records). [2025-10-15T20:39:06.628865] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-15T20:39:07.037406] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-15T20:39:07.037498] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-15T20:39:07.038716] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-15T20:39:07.038784] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-15T20:39:07.040960] [DEBUG] [LOCAL ] NXE: Trimmed 76938 records to 53044 (keeping 200 days of data) [2025-10-15T20:39:07.350357] [DEBUG] [LOCAL ] NXE: Primary data saved (53044 records). [2025-10-15T20:39:07.350507] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-15T20:39:07.350591] [INFO ] [MAIN ] Update Progress: 1560/2369 symbols completed. NXE took 33.7s. Estimated remaining: 1h 53m 36s. Rate: 7.1 symbols/min [2025-10-15T20:39:07.993691] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:07.979528] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:08.006716] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-15T20:39:08.048276] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:08.013850] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-15T20:39:08.050597] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:08.051253] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-15T20:39:08.051361] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-15T20:39:08.051463] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-15T20:39:08.051544] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-15T20:39:08.051616] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-15T20:39:08.051684] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-15T20:39:08.062437] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-15T20:39:08.105459] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-15T20:39:08.126105] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-15T20:39:08.126181] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-15T20:39:08.185556] [DEBUG] [LOCAL ] NXN: Loaded 2256 existing records from primary storage. [2025-10-15T20:39:08.230151] [DEBUG] [LOCAL ] NXP: Loaded 12311 existing records from primary storage. [2025-10-15T20:39:08.229628] [INFO ] [MAIN ] NXN: Loaded 2256 existing records. [2025-10-15T20:39:08.265146] [INFO ] [MAIN ] NXP: Loaded 12311 existing records. [2025-10-15T20:39:08.876476] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:39:08.949809] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:39:08.955183] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-15T20:39:08.985843] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-15T20:39:08.997800] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-15T20:39:08.997278] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-15T20:39:09.048152] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-15T20:39:09.048309] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-15T20:39:09.029404] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-15T20:39:09.082312] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-15T20:39:09.145067] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:09.232112] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:09.242109] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-15T20:39:09.256200] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-15T20:39:09.885263] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:09.882265] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:09.885851] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-15T20:39:09.885589] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-15T20:39:10.292885] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:39:10.295911] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-15T20:39:10.642069] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T20:39:10.646603] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-15T20:39:10.643963] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T20:39:10.648691] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-15T20:39:11.088419] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T20:39:11.091290] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-15T20:39:11.173520] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T20:39:11.177081] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-15T20:39:11.250684] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T20:39:11.251868] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-15T20:39:11.489040] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T20:39:11.492498] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-15T20:39:11.887143] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T20:39:11.890146] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T20:39:11.892584] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-15T20:39:11.895053] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-15T20:39:11.931134] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T20:39:12.113960] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-15T20:39:12.168540] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:39:12.546095] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T20:39:12.613233] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T20:39:12.913993] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-15T20:39:12.953687] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T20:39:13.713978] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-15T20:39:14.095119] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T20:39:14.243059] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T20:39:14.513982] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-15T20:39:15.314024] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-15T20:39:15.409909] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T20:39:16.114010] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-15T20:39:16.179844] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T20:39:16.913982] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-15T20:39:17.235617] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T20:39:17.435811] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T20:39:17.714031] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-15T20:39:18.513996] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-15T20:39:18.738155] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T20:39:19.314013] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-15T20:39:19.417355] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T20:39:20.114061] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-15T20:39:20.225571] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T20:39:20.914038] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-15T20:39:21.004092] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T20:39:21.714025] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-15T20:39:21.807018] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T20:39:22.514026] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-15T20:39:22.908490] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T20:39:23.313976] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-15T20:39:23.532552] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T20:39:24.114006] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-15T20:39:24.232777] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T20:39:24.695942] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T20:39:24.914043] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-15T20:39:25.718920] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-15T20:39:25.723203] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T20:39:26.436234] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T20:39:26.514006] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-15T20:39:26.946744] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T20:39:27.313976] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-15T20:39:28.114013] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-15T20:39:28.393488] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T20:39:28.914048] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-15T20:39:28.941703] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T20:39:28.943591] [INFO ] [REMOTE ] NXP: Full fetch complete (16814 records). [2025-10-15T20:39:28.943992] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-15T20:39:29.321300] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-15T20:39:29.321400] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-15T20:39:29.322015] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-15T20:39:29.322082] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-15T20:39:29.322781] [DEBUG] [LOCAL ] NXP: Trimmed 16814 records to 12319 (keeping 200 days of data) [2025-10-15T20:39:29.404368] [DEBUG] [LOCAL ] NXP: Primary data saved (12319 records). [2025-10-15T20:39:29.404558] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-15T20:39:29.404693] [INFO ] [MAIN ] Update Progress: 1561/2369 symbols completed. NXP took 22.0s. Estimated remaining: 1h 53m 34s. Rate: 7.1 symbols/min [2025-10-15T20:39:29.577331] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:29.577569] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-15T20:39:29.577610] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-15T20:39:29.577760] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-15T20:39:29.577804] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-15T20:39:29.577847] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-15T20:39:29.577883] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-15T20:39:29.718758] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-15T20:39:29.969228] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:29.981014] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:39:30.514049] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-15T20:39:30.836932] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T20:39:31.313992] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-15T20:39:31.643716] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T20:39:31.998944] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T20:39:32.113970] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-15T20:39:32.758720] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T20:39:32.760368] [INFO ] [REMOTE ] NXJ: Full fetch complete (20408 records). [2025-10-15T20:39:32.760440] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-15T20:39:32.760866] [FATAL] [VALIDATOR ] NXJ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:39:32.760946] [FATAL] [MAIN ] NXJ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:39:32.761103] [WARN ] [MAIN ] NXJ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:39:32.761179] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-15T20:39:32.761241] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-15T20:39:32.761276] [INFO ] [LOCAL ] NXJ: Starting deletion of derivative data. [2025-10-15T20:39:32.761315] [DEBUG] [LOCAL ] NXJ: No derivative data file found to delete. [2025-10-15T20:39:32.761366] [INFO ] [MAIN ] Update Progress: 1562/2369 symbols completed. NXJ took 25.4s. Estimated remaining: 1h 53m 23s. Rate: 7.1 symbols/min [2025-10-15T20:39:32.926344] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-15T20:39:32.929919] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:32.931383] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-15T20:39:32.931435] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-15T20:39:32.931558] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-15T20:39:32.931601] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-15T20:39:32.931672] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-15T20:39:32.931729] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-15T20:39:33.290999] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:33.633362] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T20:39:33.714033] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-15T20:39:34.222272] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T20:39:34.514060] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-15T20:39:34.998946] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T20:39:34.999794] [INFO ] [REMOTE ] NXN: Full fetch complete (3517 records). [2025-10-15T20:39:34.999862] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-15T20:39:35.319120] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-15T20:39:35.395473] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-15T20:39:35.395539] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-15T20:39:35.395700] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-15T20:39:35.395760] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-15T20:39:35.396119] [DEBUG] [LOCAL ] NXN: Trimmed 3517 records to 2264 (keeping 200 days of data) [2025-10-15T20:39:35.410664] [DEBUG] [LOCAL ] NXN: Primary data saved (2264 records). [2025-10-15T20:39:35.410763] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-15T20:39:35.410849] [INFO ] [MAIN ] Update Progress: 1563/2369 symbols completed. NXN took 28.0s. Estimated remaining: 1h 53m 12s. Rate: 7.1 symbols/min [2025-10-15T20:39:35.575765] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:35.575948] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-15T20:39:35.575986] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-15T20:39:35.576099] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-15T20:39:35.576140] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-15T20:39:35.576180] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-15T20:39:35.576213] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-15T20:39:35.919604] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:36.114055] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-15T20:39:36.913978] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-15T20:39:37.178738] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T20:39:37.281328] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-15T20:39:37.714066] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-15T20:39:37.817485] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T20:39:38.513969] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-15T20:39:38.863132] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T20:39:39.314116] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-15T20:39:39.886576] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T20:39:40.114047] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-15T20:39:40.914012] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-15T20:39:40.953332] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T20:39:41.429366] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T20:39:41.502887] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T20:39:41.505608] [INFO ] [REMOTE ] NXRT: Full fetch complete (25701 records). [2025-10-15T20:39:41.505906] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-15T20:39:41.506505] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:39:41.506688] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:39:41.506742] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:39:41.506789] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-15T20:39:41.506855] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-15T20:39:41.506891] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-15T20:39:41.506983] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-15T20:39:41.507050] [INFO ] [MAIN ] Update Progress: 1564/2369 symbols completed. NXRT took 34.2s. Estimated remaining: 1h 53m 2s. Rate: 7.1 symbols/min [2025-10-15T20:39:41.692104] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:41.692353] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-15T20:39:41.692404] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-15T20:39:41.692528] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-15T20:39:41.692570] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-15T20:39:41.692614] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-15T20:39:41.692678] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-15T20:39:41.723946] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-15T20:39:42.077497] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:42.514080] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-15T20:39:43.314095] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-15T20:39:43.582388] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T20:39:43.890118] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T20:39:44.114010] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-15T20:39:44.914067] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-15T20:39:45.303984] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T20:39:45.413323] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-15T20:39:45.713971] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-15T20:39:45.906619] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-15T20:39:46.150797] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T20:39:46.513999] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-15T20:39:47.314037] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-15T20:39:48.113972] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-15T20:39:48.442461] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T20:39:48.624621] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T20:39:48.914018] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-15T20:39:49.004605] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-15T20:39:49.714001] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-15T20:39:50.000115] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T20:39:50.237631] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T20:39:50.513964] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-15T20:39:51.314013] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-15T20:39:51.897130] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T20:39:52.114036] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-15T20:39:52.913989] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-15T20:39:53.131150] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T20:39:53.504396] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T20:39:53.714062] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-15T20:39:54.514061] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-15T20:39:54.857177] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T20:39:54.935843] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T20:39:55.103415] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-15T20:39:55.314104] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-15T20:39:56.101248] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:39:56.107407] [INFO ] [REMOTE ] NZF: Full fetch complete (42385 records). [2025-10-15T20:39:56.107688] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-15T20:39:56.108633] [FATAL] [VALIDATOR ] NZF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:39:56.108766] [FATAL] [MAIN ] NZF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:39:56.108822] [WARN ] [MAIN ] NZF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:39:56.108875] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-15T20:39:56.109213] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-15T20:39:56.109382] [INFO ] [LOCAL ] NZF: Starting deletion of derivative data. [2025-10-15T20:39:56.109432] [DEBUG] [LOCAL ] NZF: No derivative data file found to delete. [2025-10-15T20:39:56.109536] [INFO ] [MAIN ] Update Progress: 1565/2369 symbols completed. NZF took 20.7s. Estimated remaining: 1h 52m 57s. Rate: 7.1 symbols/min [2025-10-15T20:39:56.119153] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-15T20:39:56.319245] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:39:56.319425] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-15T20:39:56.319465] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-15T20:39:56.319604] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-15T20:39:56.319681] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-15T20:39:56.319746] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-15T20:39:56.319782] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-15T20:39:56.670782] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:39:56.913998] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-15T20:39:57.714060] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-15T20:39:58.206897] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T20:39:58.315208] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-15T20:39:58.403135] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T20:39:58.514026] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-15T20:39:58.940804] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T20:39:59.314048] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-15T20:40:00.114096] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-15T20:40:00.507630] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T20:40:00.914099] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-15T20:40:00.959896] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T20:40:01.714071] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-15T20:40:02.514086] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-15T20:40:03.203873] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-15T20:40:03.314068] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-15T20:40:03.513264] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T20:40:03.687298] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-15T20:40:03.957788] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T20:40:04.114027] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-15T20:40:04.914004] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-15T20:40:05.713988] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-15T20:40:05.902114] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T20:40:06.160384] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T20:40:06.161325] [INFO ] [REMOTE ] NYC: Full fetch complete (1872 records). [2025-10-15T20:40:06.161400] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-15T20:40:06.356732] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T20:40:06.356981] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:40:06.357052] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:40:06.357130] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-15T20:40:06.357204] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-15T20:40:06.357242] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-15T20:40:06.357284] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-15T20:40:06.357350] [INFO ] [MAIN ] Update Progress: 1566/2369 symbols completed. NYC took 37.0s. Estimated remaining: 1h 52m 50s. Rate: 7.1 symbols/min [2025-10-15T20:40:06.533346] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-15T20:40:06.537099] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:06.537319] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-15T20:40:06.537361] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-15T20:40:06.537471] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-15T20:40:06.537512] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-15T20:40:06.537557] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-15T20:40:06.537588] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-15T20:40:06.931886] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:06.954156] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-15T20:40:07.314009] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-15T20:40:08.114039] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-15T20:40:08.402081] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T20:40:08.914010] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-15T20:40:09.349698] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T20:40:09.713999] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-15T20:40:10.442079] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-15T20:40:10.489603] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T20:40:10.513969] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-15T20:40:11.071426] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:40:11.076898] [INFO ] [REMOTE ] NYT: Full fetch complete (71874 records). [2025-10-15T20:40:11.077017] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-15T20:40:11.077788] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:40:11.077870] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:40:11.077948] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:40:11.078003] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-15T20:40:11.078093] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-15T20:40:11.078152] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-15T20:40:11.078206] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-15T20:40:11.078303] [INFO ] [MAIN ] Update Progress: 1567/2369 symbols completed. NYT took 38.3s. Estimated remaining: 1h 52m 39s. Rate: 7.1 symbols/min [2025-10-15T20:40:11.245352] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:11.245521] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-15T20:40:11.245557] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-15T20:40:11.245698] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-15T20:40:11.245758] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-15T20:40:11.245837] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-15T20:40:11.245890] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-15T20:40:11.319111] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-15T20:40:11.605154] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:11.890362] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T20:40:12.114012] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-15T20:40:12.419978] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T20:40:12.914048] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-15T20:40:13.714057] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-15T20:40:14.015579] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T20:40:14.513966] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-15T20:40:14.853234] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-15T20:40:14.965475] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T20:40:15.313969] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-15T20:40:15.393124] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T20:40:16.114056] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-15T20:40:16.901461] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T20:40:16.913969] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-15T20:40:17.144478] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T20:40:17.713999] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-15T20:40:17.995971] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T20:40:18.514008] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-15T20:40:19.285371] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T20:40:19.313959] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-15T20:40:20.114030] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-15T20:40:20.174407] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T20:40:20.847223] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T20:40:20.913952] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-15T20:40:21.174426] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T20:40:21.713986] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-15T20:40:22.513984] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-15T20:40:22.616729] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T20:40:22.699196] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T20:40:23.314010] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-15T20:40:24.114008] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-15T20:40:24.288284] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T20:40:24.653403] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T20:40:24.856101] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T20:40:24.914022] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-15T20:40:25.714067] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-15T20:40:25.836850] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T20:40:26.514085] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-15T20:40:27.314016] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-15T20:40:27.892698] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T20:40:28.114017] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-15T20:40:28.169613] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T20:40:28.206024] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-15T20:40:28.914008] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-15T20:40:29.612415] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T20:40:29.713980] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-15T20:40:30.514047] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-15T20:40:31.313971] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-15T20:40:31.580314] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T20:40:31.638513] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-15T20:40:31.726568] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T20:40:31.729129] [INFO ] [REMOTE ] OBK: Full fetch complete (23751 records). [2025-10-15T20:40:31.729229] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-15T20:40:31.729941] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:40:31.730027] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:40:31.730070] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:40:31.730110] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-15T20:40:31.730165] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-15T20:40:31.730202] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-15T20:40:31.730241] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-15T20:40:31.730297] [INFO ] [MAIN ] Update Progress: 1568/2369 symbols completed. OBK took 25.4s. Estimated remaining: 1h 52m 37s. Rate: 7.1 symbols/min [2025-10-15T20:40:31.912938] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:31.926669] [DEBUG] [LOCAL ] OCFT: Loaded 7476 existing records from primary storage. [2025-10-15T20:40:31.926947] [INFO ] [MAIN ] OCFT: Loaded 7476 existing records. [2025-10-15T20:40:32.110497] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:40:32.110900] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-15T20:40:32.111027] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-15T20:40:32.111368] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-15T20:40:32.111457] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-15T20:40:32.122257] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-15T20:40:32.398519] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T20:40:32.508215] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:32.913992] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-15T20:40:33.561952] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-15T20:40:33.714050] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-15T20:40:34.513956] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-15T20:40:34.716223] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-15T20:40:35.116914] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T20:40:35.314015] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-15T20:40:35.359290] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T20:40:35.909354] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T20:40:36.113997] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-15T20:40:36.913981] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-15T20:40:36.974086] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T20:40:37.590873] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:40:37.597202] [INFO ] [REMOTE ] OBDC: Full fetch complete (74929 records). [2025-10-15T20:40:37.597378] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-15T20:40:37.598324] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:40:37.598431] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:40:37.598475] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:40:37.598545] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-15T20:40:37.598665] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-15T20:40:37.598740] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-15T20:40:37.598804] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-15T20:40:37.598883] [INFO ] [MAIN ] Update Progress: 1569/2369 symbols completed. OBDC took 41.5s. Estimated remaining: 1h 52m 27s. Rate: 7.1 symbols/min [2025-10-15T20:40:37.719137] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-15T20:40:37.785639] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:37.796709] [DEBUG] [LOCAL ] ODC: Loaded 8510 existing records from primary storage. [2025-10-15T20:40:37.796969] [INFO ] [MAIN ] ODC: Loaded 8510 existing records. [2025-10-15T20:40:37.992478] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:40:37.992766] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-15T20:40:37.992844] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-15T20:40:37.993047] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-15T20:40:37.993103] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-15T20:40:38.365233] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:38.514030] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-15T20:40:39.239432] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T20:40:39.314014] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-15T20:40:39.366552] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T20:40:40.114018] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-15T20:40:40.123600] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T20:40:40.914078] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-15T20:40:40.958901] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T20:40:41.714059] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-15T20:40:42.514026] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-15T20:40:42.549756] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T20:40:43.314059] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-15T20:40:43.384829] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-15T20:40:43.406328] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T20:40:44.114040] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-15T20:40:44.142357] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T20:40:44.594626] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T20:40:44.913968] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-15T20:40:45.714034] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-15T20:40:45.751112] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T20:40:45.757353] [INFO ] [REMOTE ] O: Full fetch complete (77182 records). [2025-10-15T20:40:45.757530] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-15T20:40:45.758469] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:40:45.758568] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:40:45.758636] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:40:45.758733] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-15T20:40:45.758799] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-15T20:40:45.758835] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-15T20:40:45.758874] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-15T20:40:45.758933] [INFO ] [MAIN ] Update Progress: 1570/2369 symbols completed. O took 1m 4s. Estimated remaining: 1h 52m 19s. Rate: 7.1 symbols/min [2025-10-15T20:40:45.935125] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:45.965046] [DEBUG] [LOCAL ] ODV: Loaded 28719 existing records from primary storage. [2025-10-15T20:40:45.965339] [INFO ] [MAIN ] ODV: Loaded 28719 existing records. [2025-10-15T20:40:46.148371] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:40:46.148663] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-15T20:40:46.148727] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-15T20:40:46.149038] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-15T20:40:46.149094] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-15T20:40:46.498658] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:46.513963] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-15T20:40:47.319109] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-15T20:40:47.335193] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T20:40:47.546970] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T20:40:48.114034] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-15T20:40:48.179817] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T20:40:48.752883] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T20:40:48.914285] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-15T20:40:49.714100] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-15T20:40:49.745788] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T20:40:50.395981] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:40:50.401746] [INFO ] [REMOTE ] OC: Full fetch complete (64123 records). [2025-10-15T20:40:50.401940] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-15T20:40:50.402845] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:40:50.402943] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:40:50.402989] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:40:50.403060] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-15T20:40:50.403126] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-15T20:40:50.403163] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-15T20:40:50.403207] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-15T20:40:50.403268] [INFO ] [MAIN ] Update Progress: 1571/2369 symbols completed. OC took 39.3s. Estimated remaining: 1h 52m 8s. Rate: 7.1 symbols/min [2025-10-15T20:40:50.519167] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-15T20:40:50.590322] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:50.590802] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-15T20:40:50.590852] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-15T20:40:50.590968] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-15T20:40:50.591012] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-15T20:40:50.591054] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-15T20:40:50.591089] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-15T20:40:50.946727] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:51.304490] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T20:40:51.313953] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-15T20:40:51.818136] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-15T20:40:52.114056] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-15T20:40:52.914048] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-15T20:40:52.959855] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T20:40:53.714022] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-15T20:40:54.437566] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T20:40:54.513953] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-15T20:40:54.657808] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T20:40:55.313962] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-15T20:40:55.407778] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T20:40:56.113976] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-15T20:40:56.128705] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T20:40:56.668702] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:40:56.669677] [INFO ] [REMOTE ] OCFT: Full fetch complete (11655 records). [2025-10-15T20:40:56.669747] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-15T20:40:56.919081] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-15T20:40:57.056231] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-15T20:40:57.056310] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-15T20:40:57.056706] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-15T20:40:57.056799] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-15T20:40:57.057270] [DEBUG] [LOCAL ] OCFT: Trimmed 11655 records to 7359 (keeping 200 days of data) [2025-10-15T20:40:57.099152] [DEBUG] [LOCAL ] OCFT: Primary data saved (7359 records). [2025-10-15T20:40:57.099266] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-15T20:40:57.099345] [INFO ] [MAIN ] Update Progress: 1572/2369 symbols completed. OCFT took 25.4s. Estimated remaining: 1h 51m 59s. Rate: 7.1 symbols/min [2025-10-15T20:40:57.264096] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:40:57.264297] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-15T20:40:57.264353] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-15T20:40:57.264488] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-15T20:40:57.264566] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-15T20:40:57.264630] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-15T20:40:57.264715] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-15T20:40:57.615728] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:40:57.713984] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-15T20:40:57.870542] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T20:40:58.514008] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-15T20:40:58.897482] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T20:40:59.049518] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T20:40:59.313995] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-15T20:41:00.113985] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-15T20:41:00.206732] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T20:41:00.913998] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-15T20:41:01.437087] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T20:41:01.714013] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-15T20:41:01.947178] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T20:41:02.514066] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-15T20:41:03.103561] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T20:41:03.314031] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-15T20:41:04.119125] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-15T20:41:04.138012] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T20:41:04.573048] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T20:41:04.708323] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T20:41:04.914011] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-15T20:41:05.714020] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-15T20:41:06.034291] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T20:41:06.469914] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T20:41:06.513956] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-15T20:41:07.313972] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-15T20:41:07.553949] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T20:41:08.114046] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-15T20:41:08.782578] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T20:41:08.913987] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-15T20:41:09.552677] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T20:41:09.713997] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-15T20:41:10.412954] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:41:10.422780] [INFO ] [REMOTE ] ODC: Full fetch complete (11170 records). [2025-10-15T20:41:10.436084] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-15T20:41:10.437500] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T20:41:10.516762] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-15T20:41:10.829970] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-15T20:41:10.830053] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-15T20:41:10.830316] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-15T20:41:10.830356] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-15T20:41:10.830837] [DEBUG] [LOCAL ] ODC: Trimmed 11170 records to 8543 (keeping 200 days of data) [2025-10-15T20:41:10.880761] [DEBUG] [LOCAL ] ODC: Primary data saved (8543 records). [2025-10-15T20:41:10.880862] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-15T20:41:10.880937] [INFO ] [MAIN ] Update Progress: 1573/2369 symbols completed. ODC took 33.3s. Estimated remaining: 1h 51m 53s. Rate: 7.1 symbols/min [2025-10-15T20:41:11.046350] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:41:11.046531] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-15T20:41:11.046571] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-15T20:41:11.046704] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-15T20:41:11.046755] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-15T20:41:11.046798] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-15T20:41:11.046829] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-15T20:41:11.319169] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-15T20:41:11.399744] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:41:11.764043] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T20:41:12.113961] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-15T20:41:12.499822] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T20:41:12.913975] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-15T20:41:13.569115] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T20:41:13.695265] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T20:41:13.714027] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-15T20:41:14.514012] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-15T20:41:15.255002] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T20:41:15.313963] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-15T20:41:16.107313] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T20:41:16.114414] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-15T20:41:16.821450] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T20:41:16.913995] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-15T20:41:17.713972] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-15T20:41:18.103146] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T20:41:18.329186] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T20:41:18.514001] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-15T20:41:19.033971] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T20:41:19.314021] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-15T20:41:20.114040] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-15T20:41:20.153895] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T20:41:20.447237] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T20:41:20.770634] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:41:20.774995] [INFO ] [REMOTE ] OEC: Full fetch complete (52899 records). [2025-10-15T20:41:20.775116] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-15T20:41:20.775755] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:41:20.775859] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:41:20.775902] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:41:20.775940] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-15T20:41:20.775996] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-15T20:41:20.776030] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-15T20:41:20.776077] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-15T20:41:20.776132] [INFO ] [MAIN ] Update Progress: 1574/2369 symbols completed. OEC took 30.4s. Estimated remaining: 1h 51m 46s. Rate: 7.1 symbols/min [2025-10-15T20:41:20.920123] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-15T20:41:20.946773] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:41:20.946928] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-15T20:41:20.946964] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-15T20:41:20.947070] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-15T20:41:20.947111] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-15T20:41:20.947155] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-15T20:41:20.947186] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-15T20:41:21.303830] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:41:21.713997] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-15T20:41:22.157491] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T20:41:22.514049] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-15T20:41:23.314024] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-15T20:41:23.545300] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T20:41:23.622102] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T20:41:24.113987] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-15T20:41:24.913971] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-15T20:41:25.008921] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T20:41:25.017377] [INFO ] [REMOTE ] ODV: Full fetch complete (34968 records). [2025-10-15T20:41:25.017545] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-15T20:41:25.284536] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T20:41:25.415125] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-15T20:41:25.415236] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-15T20:41:25.416035] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-15T20:41:25.416108] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-15T20:41:25.417080] [DEBUG] [LOCAL ] ODV: Trimmed 34968 records to 28950 (keeping 200 days of data) [2025-10-15T20:41:25.583501] [DEBUG] [LOCAL ] ODV: Primary data saved (28950 records). [2025-10-15T20:41:25.583635] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-15T20:41:25.583757] [INFO ] [MAIN ] Update Progress: 1575/2369 symbols completed. ODV took 39.8s. Estimated remaining: 1h 51m 35s. Rate: 7.1 symbols/min [2025-10-15T20:41:25.721040] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-15T20:41:25.752127] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:41:25.752340] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-15T20:41:25.752405] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-15T20:41:25.752511] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-15T20:41:25.752552] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-15T20:41:25.752591] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-15T20:41:25.752622] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-15T20:41:26.102195] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:41:26.354141] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T20:41:26.461311] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:41:26.464185] [INFO ] [REMOTE ] OFG: Full fetch complete (33691 records). [2025-10-15T20:41:26.464287] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-15T20:41:26.464838] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:41:26.464924] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:41:26.464966] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:41:26.465031] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-15T20:41:26.465092] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-15T20:41:26.465127] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-15T20:41:26.465166] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-15T20:41:26.465220] [INFO ] [MAIN ] Update Progress: 1576/2369 symbols completed. OFG took 29.4s. Estimated remaining: 1h 51m 23s. Rate: 7.1 symbols/min [2025-10-15T20:41:26.519140] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-15T20:41:26.642695] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:41:26.642932] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-15T20:41:26.643055] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-15T20:41:26.643179] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-15T20:41:26.643238] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-15T20:41:26.643296] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-15T20:41:26.643340] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-15T20:41:26.997050] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:41:27.314000] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-15T20:41:28.114014] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-15T20:41:28.264782] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:41:28.914020] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-15T20:41:29.259115] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-15T20:41:29.714041] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-15T20:41:29.844200] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T20:41:30.513980] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-15T20:41:30.543631] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T20:41:31.314021] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-15T20:41:31.412991] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T20:41:31.981978] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T20:41:32.113993] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-15T20:41:32.913968] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-15T20:41:33.096535] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T20:41:33.156280] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:41:33.714042] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-15T20:41:34.514072] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-15T20:41:34.825979] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T20:41:35.314135] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-15T20:41:35.522089] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T20:41:35.962235] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T20:41:36.114067] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-15T20:41:36.914072] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-15T20:41:37.171358] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T20:41:37.629491] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T20:41:37.714003] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-15T20:41:38.514034] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-15T20:41:38.690221] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T20:41:38.721134] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T20:41:39.313972] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-15T20:41:40.113992] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-15T20:41:40.163406] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T20:41:40.914095] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-15T20:41:41.000411] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T20:41:41.241786] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T20:41:41.714014] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-15T20:41:42.513970] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-15T20:41:42.833460] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T20:41:43.314003] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-15T20:41:43.643382] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T20:41:44.119107] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-15T20:41:44.136880] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T20:41:44.380813] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T20:41:44.914047] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-15T20:41:45.714023] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-15T20:41:46.177758] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-15T20:41:46.358939] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T20:41:46.416227] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:41:46.421294] [INFO ] [REMOTE ] OGE: Full fetch complete (66500 records). [2025-10-15T20:41:46.421397] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-15T20:41:46.422199] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:41:46.422339] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:41:46.422404] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:41:46.422475] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-15T20:41:46.422537] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-15T20:41:46.422572] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-15T20:41:46.422610] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-15T20:41:46.422688] [INFO ] [MAIN ] Update Progress: 1577/2369 symbols completed. OGE took 35.5s. Estimated remaining: 1h 51m 20s. Rate: 7.1 symbols/min [2025-10-15T20:41:46.519125] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-15T20:41:46.593502] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:41:46.593635] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-15T20:41:46.593709] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-15T20:41:46.593815] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-15T20:41:46.593864] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-15T20:41:46.593913] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-15T20:41:46.593952] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-15T20:41:46.937332] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:41:47.314009] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-15T20:41:48.114007] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-15T20:41:48.341689] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T20:41:48.914115] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-15T20:41:48.989698] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T20:41:49.378408] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T20:41:49.714053] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-15T20:41:50.514038] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-15T20:41:50.899179] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T20:41:51.299295] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T20:41:51.313943] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-15T20:41:51.974221] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T20:41:52.114031] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-15T20:41:52.913999] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-15T20:41:53.164571] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T20:41:53.483973] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T20:41:53.714041] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-15T20:41:54.513977] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-15T20:41:54.757301] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T20:41:55.314048] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-15T20:41:55.578426] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T20:41:55.983789] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T20:41:56.113995] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-15T20:41:56.858529] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:41:56.864324] [INFO ] [REMOTE ] OHI: Full fetch complete (74910 records). [2025-10-15T20:41:56.864430] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-15T20:41:56.865216] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:41:56.865304] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:41:56.865346] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:41:56.865384] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-15T20:41:56.865455] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-15T20:41:56.865518] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-15T20:41:56.865573] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-15T20:41:56.865671] [INFO ] [MAIN ] Update Progress: 1578/2369 symbols completed. OHI took 30.4s. Estimated remaining: 1h 51m 13s. Rate: 7.1 symbols/min [2025-10-15T20:41:56.928160] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-15T20:41:57.044831] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T20:41:57.062721] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:41:57.086377] [DEBUG] [LOCAL ] OIA: Loaded 13151 existing records from primary storage. [2025-10-15T20:41:57.086601] [INFO ] [MAIN ] OIA: Loaded 13151 existing records. [2025-10-15T20:41:57.261569] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:41:57.261792] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-15T20:41:57.261840] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-15T20:41:57.262032] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-15T20:41:57.262087] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-15T20:41:57.604722] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:41:57.713983] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-15T20:41:58.514029] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-15T20:41:58.769803] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T20:41:58.769139] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T20:41:59.314091] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-15T20:41:59.628047] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T20:42:00.028189] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:42:00.037066] [INFO ] [REMOTE ] OGN: Full fetch complete (76570 records). [2025-10-15T20:42:00.037268] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-15T20:42:00.038355] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:42:00.038469] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:42:00.038527] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:42:00.038610] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-15T20:42:00.038765] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-15T20:42:00.038837] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-15T20:42:00.038902] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-15T20:42:00.039022] [INFO ] [MAIN ] Update Progress: 1579/2369 symbols completed. OGN took 39.3s. Estimated remaining: 1h 51m 2s. Rate: 7.1 symbols/min [2025-10-15T20:42:00.119116] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-15T20:42:00.218925] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:00.219088] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-15T20:42:00.219126] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-15T20:42:00.219234] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-15T20:42:00.219276] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-15T20:42:00.219328] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-15T20:42:00.219387] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-15T20:42:00.582875] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:00.914048] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-15T20:42:01.713987] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-15T20:42:01.801567] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T20:42:02.037429] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-15T20:42:02.040969] [INFO ] [REMOTE ] OGS: Full fetch complete (47612 records). [2025-10-15T20:42:02.041056] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-15T20:42:02.041717] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:42:02.041800] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:42:02.041842] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:42:02.041908] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-15T20:42:02.041972] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-15T20:42:02.042006] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-15T20:42:02.042044] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-15T20:42:02.042096] [INFO ] [MAIN ] Update Progress: 1580/2369 symbols completed. OGS took 36.5s. Estimated remaining: 1h 50m 50s. Rate: 7.1 symbols/min [2025-10-15T20:42:02.220698] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:02.259686] [DEBUG] [LOCAL ] OIS: Loaded 40014 existing records from primary storage. [2025-10-15T20:42:02.259970] [INFO ] [MAIN ] OIS: Loaded 40014 existing records. [2025-10-15T20:42:02.443827] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:42:02.444091] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-15T20:42:02.444155] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-15T20:42:02.444697] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-15T20:42:02.444784] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-15T20:42:02.520061] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-15T20:42:02.806884] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T20:42:02.861166] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:03.113562] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T20:42:03.314007] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-15T20:42:04.114006] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-15T20:42:04.400947] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T20:42:04.914082] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-15T20:42:05.714037] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-15T20:42:05.867566] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T20:42:05.908762] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T20:42:06.513985] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-15T20:42:06.934294] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T20:42:07.313979] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-15T20:42:07.510812] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T20:42:08.114029] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-15T20:42:08.913994] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-15T20:42:08.984040] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T20:42:09.034024] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T20:42:09.714012] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-15T20:42:10.420623] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T20:42:10.439017] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T20:42:10.514052] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-15T20:42:11.314006] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-15T20:42:11.879312] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T20:42:12.114007] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-15T20:42:12.775167] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T20:42:12.913995] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-15T20:42:13.679349] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T20:42:13.714026] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-15T20:42:13.925211] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T20:42:14.514042] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-15T20:42:15.181961] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T20:42:15.314078] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-15T20:42:16.113987] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-15T20:42:16.243000] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T20:42:16.577528] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T20:42:16.902041] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T20:42:16.913951] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-15T20:42:17.607337] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T20:42:17.713992] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-15T20:42:18.513977] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-15T20:42:19.240623] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T20:42:19.313952] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-15T20:42:20.114005] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-15T20:42:20.308441] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T20:42:20.913984] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-15T20:42:21.043845] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T20:42:21.285327] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T20:42:21.714012] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-15T20:42:22.368183] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T20:42:22.390987] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T20:42:22.513997] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-15T20:42:23.314052] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-15T20:42:23.945209] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T20:42:24.113997] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-15T20:42:24.913974] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-15T20:42:25.186058] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T20:42:25.713980] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-15T20:42:25.807903] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T20:42:26.212331] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T20:42:26.463860] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T20:42:26.465527] [INFO ] [REMOTE ] OIA: Full fetch complete (20531 records). [2025-10-15T20:42:26.465612] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-15T20:42:26.524064] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-15T20:42:26.849671] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-15T20:42:26.849757] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-15T20:42:26.850189] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-15T20:42:26.850228] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-15T20:42:26.850813] [DEBUG] [LOCAL ] OIA: Trimmed 20531 records to 13137 (keeping 200 days of data) [2025-10-15T20:42:26.928403] [DEBUG] [LOCAL ] OIA: Primary data saved (13137 records). [2025-10-15T20:42:26.928533] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-15T20:42:26.928610] [INFO ] [MAIN ] Update Progress: 1581/2369 symbols completed. OIA took 30.1s. Estimated remaining: 1h 50m 50s. Rate: 7.1 symbols/min [2025-10-15T20:42:27.100934] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:27.101366] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-15T20:42:27.101419] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-15T20:42:27.101493] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-15T20:42:27.101530] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-15T20:42:27.101570] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-15T20:42:27.101601] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-15T20:42:27.319160] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-15T20:42:27.452601] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:27.830976] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T20:42:28.114003] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-15T20:42:28.675144] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T20:42:28.913967] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-15T20:42:29.694431] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T20:42:29.713953] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-15T20:42:30.092549] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T20:42:30.474245] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:42:30.478979] [INFO ] [REMOTE ] OII: Full fetch complete (61529 records). [2025-10-15T20:42:30.479088] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-15T20:42:30.479754] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:42:30.479835] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:42:30.479878] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:42:30.479916] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-15T20:42:30.479970] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-15T20:42:30.480005] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-15T20:42:30.480043] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-15T20:42:30.480097] [INFO ] [MAIN ] Update Progress: 1582/2369 symbols completed. OII took 30.4s. Estimated remaining: 1h 50m 39s. Rate: 7.1 symbols/min [2025-10-15T20:42:30.519135] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-15T20:42:30.648604] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:30.648805] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-15T20:42:30.648848] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-15T20:42:30.648957] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-15T20:42:30.648998] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-15T20:42:30.649038] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-15T20:42:30.649069] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-15T20:42:31.024762] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:31.154923] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T20:42:31.160368] [INFO ] [REMOTE ] OI: Full fetch complete (67951 records). [2025-10-15T20:42:31.160489] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-15T20:42:31.161245] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:42:31.161332] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:42:31.161374] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:42:31.161412] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-15T20:42:31.161466] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-15T20:42:31.161501] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-15T20:42:31.161569] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-15T20:42:31.161638] [INFO ] [MAIN ] Update Progress: 1583/2369 symbols completed. OI took 44.7s. Estimated remaining: 1h 50m 27s. Rate: 7.1 symbols/min [2025-10-15T20:42:31.324116] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-15T20:42:31.328387] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:31.328612] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-15T20:42:31.328739] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-15T20:42:31.328862] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-15T20:42:31.328916] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-15T20:42:31.328959] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-15T20:42:31.328991] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-15T20:42:31.676586] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:32.114002] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-15T20:42:32.914074] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-15T20:42:33.330325] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T20:42:33.573591] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T20:42:33.714058] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-15T20:42:34.514026] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-15T20:42:35.099133] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T20:42:35.104158] [INFO ] [REMOTE ] OIS: Full fetch complete (57185 records). [2025-10-15T20:42:35.104316] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-15T20:42:35.319225] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-15T20:42:35.543864] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-15T20:42:35.543985] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-15T20:42:35.545411] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-15T20:42:35.545548] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-15T20:42:35.546879] [DEBUG] [LOCAL ] OIS: Trimmed 57185 records to 40031 (keeping 200 days of data) [2025-10-15T20:42:35.798783] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-15T20:42:35.834316] [DEBUG] [LOCAL ] OIS: Primary data saved (40031 records). [2025-10-15T20:42:35.834455] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-15T20:42:35.834540] [INFO ] [MAIN ] Update Progress: 1584/2369 symbols completed. OIS took 33.8s. Estimated remaining: 1h 50m 17s. Rate: 7.1 symbols/min [2025-10-15T20:42:36.026569] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:36.038763] [DEBUG] [LOCAL ] OLP: Loaded 10079 existing records from primary storage. [2025-10-15T20:42:36.039060] [INFO ] [MAIN ] OLP: Loaded 10079 existing records. [2025-10-15T20:42:36.117629] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-15T20:42:36.235844] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:42:36.236960] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-15T20:42:36.237019] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-15T20:42:36.237875] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-15T20:42:36.237954] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-15T20:42:36.569309] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T20:42:36.673538] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:36.913977] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-15T20:42:37.080482] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T20:42:37.713986] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-15T20:42:38.514019] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-15T20:42:38.634952] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T20:42:38.750423] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-15T20:42:39.314065] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-15T20:42:39.435120] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T20:42:39.535963] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T20:42:40.114057] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-15T20:42:40.913985] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-15T20:42:41.006219] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T20:42:41.071167] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T20:42:41.714031] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-15T20:42:42.292731] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T20:42:42.513984] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-15T20:42:43.313975] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-15T20:42:43.357974] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T20:42:43.609876] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-10-15T20:42:44.114017] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-15T20:42:44.835283] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T20:42:44.913975] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-15T20:42:45.713973] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-15T20:42:46.513976] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-15T20:42:46.811072] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T20:42:46.918404] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-15T20:42:47.161809] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T20:42:47.314042] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-15T20:42:47.400918] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T20:42:48.114049] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-15T20:42:48.913982] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-15T20:42:49.327890] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T20:42:49.630189] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T20:42:49.714006] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-15T20:42:50.520375] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-15T20:42:50.544256] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-15T20:42:51.313974] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-15T20:42:51.400080] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T20:42:51.557735] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T20:42:52.114003] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-15T20:42:52.914002] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-15T20:42:53.023797] [DEBUG] [REMOTE ] OLP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-15T20:42:53.024128] [WARN ] [REMOTE ] OLP: No data returned for month 2025-07 [2025-10-15T20:42:53.024223] [FATAL] [REMOTE ] OLP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:42:53.024324] [FATAL] [MAIN ] OLP: Failed to fetch primary data. [2025-10-15T20:42:53.024427] [WARN ] [MAIN ] OLP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:42:53.024517] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-15T20:42:53.024595] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-15T20:42:53.024670] [INFO ] [LOCAL ] OLP: Starting deletion of derivative data. [2025-10-15T20:42:53.024918] [DEBUG] [LOCAL ] OLP: Deleted derivative data file. [2025-10-15T20:42:53.025024] [INFO ] [MAIN ] Update Progress: 1585/2369 symbols completed. OLP took 17.2s. Estimated remaining: 1h 50m 13s. Rate: 7.1 symbols/min [2025-10-15T20:42:53.194789] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:42:53.194989] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-15T20:42:53.195028] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-15T20:42:53.195147] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-15T20:42:53.195192] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-15T20:42:53.195271] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-15T20:42:53.195322] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-15T20:42:53.537913] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:42:53.713960] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-15T20:42:53.880032] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T20:42:54.127141] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-15T20:42:54.513985] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-15T20:42:55.314043] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-15T20:42:55.651390] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T20:42:56.114044] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-15T20:42:56.914013] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-15T20:42:57.063182] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-15T20:42:57.105011] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T20:42:57.714055] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-15T20:42:57.861411] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T20:42:58.330194] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T20:42:58.514002] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-15T20:42:59.314092] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-15T20:42:59.409897] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T20:43:00.114028] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-15T20:43:00.914044] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-15T20:43:01.075817] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-15T20:43:01.137044] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T20:43:01.714042] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-15T20:43:02.202893] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T20:43:02.379666] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T20:43:02.514019] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-15T20:43:03.319215] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-15T20:43:03.333502] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T20:43:03.340265] [INFO ] [REMOTE ] OKE: Full fetch complete (77275 records). [2025-10-15T20:43:03.340420] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-15T20:43:03.341334] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:43:03.341428] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:43:03.341471] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:43:03.341510] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-15T20:43:03.341567] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-15T20:43:03.341603] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-15T20:43:03.341665] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-15T20:43:03.341793] [INFO ] [MAIN ] Update Progress: 1586/2369 symbols completed. OKE took 36.4s. Estimated remaining: 1h 50m 5s. Rate: 7.1 symbols/min [2025-10-15T20:43:03.525371] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:03.525629] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-15T20:43:03.525704] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-15T20:43:03.525864] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-15T20:43:03.525909] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-15T20:43:03.525955] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-15T20:43:03.525991] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-15T20:43:03.896949] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:04.113968] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-15T20:43:04.367227] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-15T20:43:04.913978] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-15T20:43:05.315398] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-15T20:43:05.714029] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-15T20:43:05.984744] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T20:43:06.267780] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T20:43:06.514038] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-15T20:43:07.192067] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T20:43:07.314035] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-15T20:43:08.114015] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-15T20:43:08.181392] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T20:43:08.913979] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-15T20:43:09.079222] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T20:43:09.714040] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-15T20:43:09.768824] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T20:43:10.514047] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-15T20:43:11.271794] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T20:43:11.313957] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-15T20:43:11.744124] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-15T20:43:12.113981] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-15T20:43:12.196698] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T20:43:12.507205] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T20:43:12.513277] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-15T20:43:12.513448] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-15T20:43:12.514445] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:43:12.514561] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:43:12.514604] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:43:12.514672] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-15T20:43:12.514754] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-15T20:43:12.514791] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-15T20:43:12.514831] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-15T20:43:12.514890] [INFO ] [MAIN ] Update Progress: 1587/2369 symbols completed. OKLO took 42.0s. Estimated remaining: 1h 49m 57s. Rate: 7.1 symbols/min [2025-10-15T20:43:12.692759] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:12.692964] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-15T20:43:12.693002] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-15T20:43:12.693120] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-15T20:43:12.693163] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-15T20:43:12.693204] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-15T20:43:12.693235] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-15T20:43:12.914605] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-15T20:43:13.074216] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:13.110434] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T20:43:13.714006] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-15T20:43:14.475110] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:43:14.482103] [INFO ] [REMOTE ] OLN: Full fetch complete (74443 records). [2025-10-15T20:43:14.482288] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-15T20:43:14.483180] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:43:14.483282] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:43:14.483329] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:43:14.483399] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-15T20:43:14.483467] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-15T20:43:14.483505] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-15T20:43:14.483548] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-15T20:43:14.483610] [INFO ] [MAIN ] Update Progress: 1588/2369 symbols completed. OLN took 43.3s. Estimated remaining: 1h 49m 45s. Rate: 7.1 symbols/min [2025-10-15T20:43:14.519116] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-15T20:43:14.692857] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:14.704623] [DEBUG] [LOCAL ] ONIT: Loaded 7643 existing records from primary storage. [2025-10-15T20:43:14.704914] [INFO ] [MAIN ] ONIT: Loaded 7643 existing records. [2025-10-15T20:43:14.925220] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:43:14.925505] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-15T20:43:14.952266] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-15T20:43:14.954022] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-15T20:43:14.953973] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T20:43:14.964361] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-15T20:43:15.319126] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-15T20:43:15.385385] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:16.113975] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-15T20:43:16.224981] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T20:43:16.893245] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T20:43:16.913954] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-15T20:43:17.152494] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T20:43:17.713978] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-15T20:43:18.514009] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-15T20:43:18.702618] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T20:43:19.238606] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T20:43:19.314081] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-15T20:43:20.113969] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-15T20:43:20.155865] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T20:43:20.236603] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T20:43:20.914028] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-15T20:43:21.674196] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T20:43:21.703435] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T20:43:21.713942] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-15T20:43:22.514074] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-15T20:43:22.536204] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T20:43:23.314077] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-15T20:43:24.042345] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T20:43:24.113985] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-15T20:43:24.913987] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-15T20:43:25.132100] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T20:43:25.560626] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T20:43:25.714054] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-15T20:43:26.518928] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-15T20:43:26.521374] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T20:43:26.935384] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T20:43:27.298517] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T20:43:27.305215] [INFO ] [REMOTE ] OMC: Full fetch complete (76805 records). [2025-10-15T20:43:27.305384] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-15T20:43:27.306635] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:43:27.306768] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:43:27.306813] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:43:27.306855] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-15T20:43:27.306919] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-15T20:43:27.306954] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-15T20:43:27.307004] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-15T20:43:27.307069] [INFO ] [MAIN ] Update Progress: 1589/2369 symbols completed. OMC took 34.3s. Estimated remaining: 1h 49m 39s. Rate: 7.1 symbols/min [2025-10-15T20:43:27.319109] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-15T20:43:27.484772] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:27.522097] [DEBUG] [LOCAL ] ONL: Loaded 29676 existing records from primary storage. [2025-10-15T20:43:27.522474] [INFO ] [MAIN ] ONL: Loaded 29676 existing records. [2025-10-15T20:43:27.717610] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:43:27.717907] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-15T20:43:27.717994] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-15T20:43:27.718378] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-15T20:43:27.718438] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-15T20:43:28.087875] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:28.104044] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T20:43:28.110113] [INFO ] [REMOTE ] OMF: Full fetch complete (67245 records). [2025-10-15T20:43:28.110295] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-15T20:43:28.111181] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:43:28.111278] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:43:28.111321] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:43:28.111382] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-15T20:43:28.111466] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-15T20:43:28.111505] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-15T20:43:28.111543] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-15T20:43:28.111604] [INFO ] [MAIN ] Update Progress: 1590/2369 symbols completed. OMF took 24.8s. Estimated remaining: 1h 49m 27s. Rate: 7.1 symbols/min [2025-10-15T20:43:28.121865] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-15T20:43:28.290203] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:28.290420] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-15T20:43:28.290478] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-15T20:43:28.290591] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-15T20:43:28.290691] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-15T20:43:28.290756] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-15T20:43:28.290791] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-15T20:43:28.635636] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:28.914026] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-15T20:43:29.441214] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T20:43:29.518297] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T20:43:29.714018] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-15T20:43:30.514054] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-15T20:43:31.313977] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-15T20:43:31.739515] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T20:43:32.113981] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-15T20:43:32.153764] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T20:43:32.720348] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T20:43:32.913980] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-15T20:43:32.951587] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T20:43:33.713993] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-15T20:43:34.514001] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-15T20:43:35.052900] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-15T20:43:35.088882] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T20:43:35.100031] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T20:43:35.314005] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-15T20:43:36.114012] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-15T20:43:36.909679] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T20:43:36.913943] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-15T20:43:37.337145] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-15T20:43:37.714045] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-15T20:43:37.775532] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T20:43:38.514037] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-15T20:43:39.313975] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-15T20:43:39.424810] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T20:43:39.617587] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T20:43:40.114025] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-15T20:43:40.901760] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T20:43:40.914018] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-15T20:43:41.332102] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T20:43:41.714074] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-15T20:43:42.514021] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-15T20:43:42.545919] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T20:43:42.547388] [INFO ] [REMOTE ] ONIT: Full fetch complete (11105 records). [2025-10-15T20:43:42.547594] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-15T20:43:42.678847] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T20:43:42.946287] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-15T20:43:42.946380] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-15T20:43:42.946762] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-15T20:43:42.946825] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-15T20:43:42.947295] [DEBUG] [LOCAL ] ONIT: Trimmed 11105 records to 7657 (keeping 200 days of data) [2025-10-15T20:43:42.991748] [DEBUG] [LOCAL ] ONIT: Primary data saved (7657 records). [2025-10-15T20:43:42.991883] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-15T20:43:42.991963] [INFO ] [MAIN ] Update Progress: 1591/2369 symbols completed. ONIT took 28.5s. Estimated remaining: 1h 49m 22s. Rate: 7.1 symbols/min [2025-10-15T20:43:43.159959] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:43.184527] [DEBUG] [LOCAL ] ONTF: Loaded 22546 existing records from primary storage. [2025-10-15T20:43:43.184813] [INFO ] [MAIN ] ONTF: Loaded 22546 existing records. [2025-10-15T20:43:43.321014] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-15T20:43:43.361548] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:43:43.361778] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-15T20:43:43.361843] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-15T20:43:43.362031] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-15T20:43:43.362070] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-15T20:43:43.714473] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:44.114076] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-15T20:43:44.700824] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-15T20:43:44.775023] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T20:43:44.913954] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-15T20:43:45.340156] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T20:43:45.714012] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-15T20:43:46.479854] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T20:43:46.513955] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-15T20:43:46.829923] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T20:43:47.314005] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-15T20:43:47.984988] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T20:43:48.114004] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-15T20:43:48.435990] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T20:43:48.913996] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-15T20:43:49.713980] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-15T20:43:49.795480] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T20:43:50.413327] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T20:43:50.513972] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-15T20:43:50.772851] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T20:43:51.314035] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-15T20:43:51.540436] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T20:43:52.114090] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-15T20:43:52.281807] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T20:43:52.914027] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-15T20:43:53.361045] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T20:43:53.714010] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-15T20:43:54.514062] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-15T20:43:54.789391] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T20:43:54.984251] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T20:43:55.314005] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-15T20:43:55.743552] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T20:43:56.114008] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-15T20:43:56.914128] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-15T20:43:57.116949] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T20:43:57.714043] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-15T20:43:57.850752] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T20:43:58.056357] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T20:43:58.059984] [INFO ] [REMOTE ] ONL: Full fetch complete (42886 records). [2025-10-15T20:43:58.060135] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-15T20:43:58.463689] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-15T20:43:58.463985] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-15T20:43:58.465427] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-15T20:43:58.465613] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-15T20:43:58.467211] [DEBUG] [LOCAL ] ONL: Trimmed 42886 records to 29572 (keeping 200 days of data) [2025-10-15T20:43:58.518872] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-15T20:43:58.572300] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T20:43:58.682077] [DEBUG] [LOCAL ] ONL: Primary data saved (29572 records). [2025-10-15T20:43:58.682298] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-15T20:43:58.682406] [INFO ] [MAIN ] Update Progress: 1592/2369 symbols completed. ONL took 31.4s. Estimated remaining: 1h 49m 17s. Rate: 7.1 symbols/min [2025-10-15T20:43:58.858283] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:43:58.858534] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-15T20:43:58.858575] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-15T20:43:58.858739] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-15T20:43:58.858788] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-15T20:43:58.858833] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-15T20:43:58.858868] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-15T20:43:59.246261] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:43:59.314044] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-15T20:44:00.114010] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-15T20:44:00.622582] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T20:44:00.914026] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-15T20:44:00.947036] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T20:44:00.987734] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T20:44:00.993462] [INFO ] [REMOTE ] OMI: Full fetch complete (64955 records). [2025-10-15T20:44:00.993597] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-15T20:44:00.994408] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:44:00.994496] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:44:00.994539] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:44:00.994579] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-15T20:44:00.994637] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-15T20:44:00.994722] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-15T20:44:00.994768] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-15T20:44:00.994826] [INFO ] [MAIN ] Update Progress: 1593/2369 symbols completed. OMI took 48.5s. Estimated remaining: 1h 49m 5s. Rate: 7.1 symbols/min [2025-10-15T20:44:01.158765] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:01.158978] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-15T20:44:01.159025] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-15T20:44:01.159159] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-15T20:44:01.159206] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-15T20:44:01.159246] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-15T20:44:01.159278] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-15T20:44:01.502841] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:01.714043] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-15T20:44:01.891830] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T20:44:02.513995] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-15T20:44:02.866508] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T20:44:03.314011] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-15T20:44:04.114038] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-15T20:44:04.685604] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T20:44:04.914011] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-15T20:44:05.005805] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T20:44:05.087147] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T20:44:05.714014] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-15T20:44:06.513999] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-15T20:44:06.729105] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T20:44:07.152930] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-15T20:44:07.313998] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-15T20:44:08.113967] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-15T20:44:08.247089] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T20:44:08.264191] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T20:44:08.913995] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-15T20:44:09.348861] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T20:44:09.713971] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-15T20:44:09.847379] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T20:44:10.513960] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-15T20:44:10.888126] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T20:44:11.314003] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-15T20:44:11.428125] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T20:44:12.113991] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-15T20:44:12.840960] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T20:44:12.866800] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T20:44:12.873514] [INFO ] [REMOTE ] ONON: Full fetch complete (77369 records). [2025-10-15T20:44:12.873689] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-15T20:44:12.874630] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:44:12.874798] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:44:12.874889] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:44:12.874964] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-15T20:44:12.875030] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-15T20:44:12.875066] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-15T20:44:12.875103] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-15T20:44:12.875160] [INFO ] [MAIN ] Update Progress: 1594/2369 symbols completed. ONON took 44.8s. Estimated remaining: 1h 48m 59s. Rate: 7.1 symbols/min [2025-10-15T20:44:12.919080] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-15T20:44:13.048545] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:13.073455] [DEBUG] [LOCAL ] OPAD: Loaded 24780 existing records from primary storage. [2025-10-15T20:44:13.073735] [INFO ] [MAIN ] OPAD: Loaded 24780 existing records. [2025-10-15T20:44:13.250490] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:44:13.250880] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-15T20:44:13.250950] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-15T20:44:13.251273] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-15T20:44:13.251343] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-15T20:44:13.613752] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:13.713989] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-15T20:44:14.227759] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T20:44:14.514006] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-15T20:44:14.561463] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T20:44:15.314016] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-15T20:44:15.997621] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T20:44:16.114008] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-15T20:44:16.452320] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T20:44:16.913968] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-15T20:44:17.207361] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T20:44:17.713972] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-15T20:44:17.995635] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T20:44:17.998785] [INFO ] [REMOTE ] ONTF: Full fetch complete (31445 records). [2025-10-15T20:44:17.998902] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-15T20:44:18.404585] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-15T20:44:18.404692] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-15T20:44:18.405392] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-15T20:44:18.405436] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-15T20:44:18.406376] [DEBUG] [LOCAL ] ONTF: Trimmed 31445 records to 22588 (keeping 200 days of data) [2025-10-15T20:44:18.514754] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-15T20:44:18.537420] [DEBUG] [LOCAL ] ONTF: Primary data saved (22588 records). [2025-10-15T20:44:18.537559] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-15T20:44:18.537677] [INFO ] [MAIN ] Update Progress: 1595/2369 symbols completed. ONTF took 35.5s. Estimated remaining: 1h 48m 49s. Rate: 7.1 symbols/min [2025-10-15T20:44:18.704599] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:18.704808] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-15T20:44:18.704855] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-15T20:44:18.704990] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-15T20:44:18.705053] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-15T20:44:18.705101] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-15T20:44:18.705135] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-15T20:44:18.888670] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T20:44:19.077882] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:19.313992] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-15T20:44:20.113962] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-15T20:44:20.524632] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T20:44:20.562329] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T20:44:20.913967] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-15T20:44:21.009856] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T20:44:21.714029] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-15T20:44:22.313500] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T20:44:22.513983] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-15T20:44:22.813090] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T20:44:23.314011] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-15T20:44:24.114012] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-15T20:44:24.260690] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T20:44:24.309699] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T20:44:24.808463] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T20:44:24.913957] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-15T20:44:25.658811] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T20:44:25.714012] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-15T20:44:26.514006] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-15T20:44:27.314047] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-15T20:44:27.427209] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T20:44:27.906398] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T20:44:27.908712] [INFO ] [REMOTE ] OOMA: Full fetch complete (25711 records). [2025-10-15T20:44:27.908788] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-15T20:44:27.909388] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:44:27.909468] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:44:27.909534] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:44:27.909605] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-15T20:44:27.909691] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-15T20:44:27.909744] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-15T20:44:27.909785] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-15T20:44:27.909839] [INFO ] [MAIN ] Update Progress: 1596/2369 symbols completed. OOMA took 26.9s. Estimated remaining: 1h 48m 41s. Rate: 7.1 symbols/min [2025-10-15T20:44:28.075954] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:28.117278] [DEBUG] [LOCAL ] OPP: Loaded 12246 existing records from primary storage. [2025-10-15T20:44:28.116868] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-15T20:44:28.117792] [INFO ] [MAIN ] OPP: Loaded 12246 existing records. [2025-10-15T20:44:28.141368] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T20:44:28.309916] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:44:28.310124] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-15T20:44:28.310173] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-15T20:44:28.310361] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-15T20:44:28.310416] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-15T20:44:28.662420] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:28.914010] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-15T20:44:29.714035] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-15T20:44:30.082754] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T20:44:30.463113] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T20:44:30.513969] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-15T20:44:30.666359] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T20:44:31.223406] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T20:44:31.314008] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-15T20:44:31.847734] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T20:44:31.853216] [INFO ] [REMOTE ] ONTO: Full fetch complete (66681 records). [2025-10-15T20:44:31.853335] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-15T20:44:31.853985] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:44:31.854070] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:44:31.854136] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:44:31.854222] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-15T20:44:31.854299] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-15T20:44:31.854345] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-15T20:44:31.854400] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-15T20:44:31.854471] [INFO ] [MAIN ] Update Progress: 1597/2369 symbols completed. ONTO took 33.2s. Estimated remaining: 1h 48m 30s. Rate: 7.1 symbols/min [2025-10-15T20:44:32.113993] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-15T20:44:32.913968] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-15T20:44:33.228295] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T20:44:33.714095] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-15T20:44:34.513981] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-15T20:44:34.562769] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T20:44:34.788202] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T20:44:34.963840] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T20:44:35.314070] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-15T20:44:36.114057] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-15T20:44:36.805136] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T20:44:36.914017] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-15T20:44:37.052694] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T20:44:37.445405] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T20:44:37.713996] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-15T20:44:38.513974] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-15T20:44:38.609573] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T20:44:39.314096] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-15T20:44:39.812447] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T20:44:40.114052] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-15T20:44:40.609767] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T20:44:40.914078] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-15T20:44:41.714081] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-15T20:44:41.930942] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T20:44:42.340541] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T20:44:42.514053] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-15T20:44:42.565523] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T20:44:43.314031] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-15T20:44:44.114080] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-15T20:44:44.136486] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T20:44:44.733335] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-15T20:44:44.914003] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-15T20:44:45.714070] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-15T20:44:45.882073] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T20:44:46.513981] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-15T20:44:46.566877] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T20:44:46.840685] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-15T20:44:46.846392] [INFO ] [REMOTE ] OPAD: Full fetch complete (27723 records). [2025-10-15T20:44:46.846480] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-15T20:44:47.212008] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-15T20:44:47.212085] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-15T20:44:47.212727] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-15T20:44:47.212828] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-15T20:44:47.213615] [DEBUG] [LOCAL ] OPAD: Trimmed 27723 records to 25096 (keeping 200 days of data) [2025-10-15T20:44:47.316732] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-15T20:44:47.359378] [DEBUG] [LOCAL ] OPAD: Primary data saved (25096 records). [2025-10-15T20:44:47.359527] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-15T20:44:47.359610] [INFO ] [MAIN ] Update Progress: 1598/2369 symbols completed. OPAD took 34.5s. Estimated remaining: 1h 48m 25s. Rate: 7.1 symbols/min [2025-10-15T20:44:48.209371] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T20:44:48.212759] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-15T20:44:48.261612] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:44:48.914121] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-15T20:44:49.091949] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T20:44:49.714008] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-15T20:44:50.666229] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T20:44:50.668840] [INFO ] [REMOTE ] OPP: Full fetch complete (17389 records). [2025-10-15T20:44:50.668923] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-15T20:44:50.963068] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T20:44:51.018872] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-15T20:44:51.124471] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-15T20:44:51.124561] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-15T20:44:51.125132] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-15T20:44:51.125237] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-15T20:44:51.125928] [DEBUG] [LOCAL ] OPP: Trimmed 17389 records to 12199 (keeping 200 days of data) [2025-10-15T20:44:51.202413] [DEBUG] [LOCAL ] OPP: Primary data saved (12199 records). [2025-10-15T20:44:51.202566] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-15T20:44:51.202679] [INFO ] [MAIN ] Update Progress: 1599/2369 symbols completed. OPP took 23.3s. Estimated remaining: 1h 48m 15s. Rate: 7.1 symbols/min [2025-10-15T20:44:51.749405] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:44:51.755399] [INFO ] [REMOTE ] OPFI: Full fetch complete (68375 records). [2025-10-15T20:44:51.755583] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-15T20:44:51.756665] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:44:51.756761] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:44:51.757089] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:44:51.757320] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-15T20:44:51.757408] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-15T20:44:51.757448] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-15T20:44:51.757487] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-15T20:44:51.757591] [INFO ] [MAIN ] Update Progress: 1600/2369 symbols completed. OPFI took 33.2s. Estimated remaining: 1h 48m 2s. Rate: 7.1 symbols/min [2025-10-15T20:44:52.306506] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:52.382890] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-15T20:44:52.430171] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:52.478994] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:52.479100] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-15T20:44:52.397078] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-15T20:44:52.479930] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-15T20:44:52.479994] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-15T20:44:52.494762] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-15T20:44:52.480546] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-15T20:44:52.496754] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-15T20:44:52.496868] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-15T20:44:52.496545] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-15T20:44:52.497764] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:44:52.496968] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-15T20:44:52.498257] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-15T20:44:52.498116] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-15T20:44:52.498495] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-15T20:44:52.498383] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-15T20:44:52.499002] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-15T20:44:52.511591] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-15T20:44:52.543705] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-15T20:44:53.218492] [DEBUG] [LOCAL ] ORC: Loaded 52516 existing records from primary storage. [2025-10-15T20:44:53.293161] [INFO ] [MAIN ] ORC: Loaded 52516 existing records. [2025-10-15T20:44:53.685832] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:53.749023] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-15T20:44:53.861135] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:53.820393] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:53.866607] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-15T20:44:53.877717] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-15T20:44:53.933461] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:44:53.933776] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-15T20:44:53.933832] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-15T20:44:53.934335] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-15T20:44:53.934403] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-15T20:44:54.291084] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:44:54.291404] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-15T20:44:55.044821] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T20:44:55.047089] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-15T20:44:55.227099] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T20:44:55.313955] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-15T20:44:55.340959] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T20:44:55.476301] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T20:44:55.792459] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T20:44:56.114076] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-15T20:44:56.909995] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T20:44:56.918129] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-15T20:44:57.594536] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:44:57.714001] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-15T20:44:57.780782] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T20:44:58.229406] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T20:44:58.514020] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-15T20:44:59.313994] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-15T20:45:00.114001] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-15T20:45:00.165835] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T20:45:00.170906] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T20:45:00.914025] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-15T20:45:01.515834] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T20:45:01.713982] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-15T20:45:02.514014] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-15T20:45:03.010068] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T20:45:03.132958] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T20:45:03.313976] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-15T20:45:03.393727] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T20:45:04.114004] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-15T20:45:04.914171] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-15T20:45:05.250999] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T20:45:05.714060] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-15T20:45:05.837151] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T20:45:06.198316] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T20:45:06.514037] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-15T20:45:07.314031] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-15T20:45:07.519874] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:45:07.842899] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T20:45:08.114015] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-15T20:45:08.616805] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-15T20:45:08.914004] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-15T20:45:09.714123] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-15T20:45:09.795685] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T20:45:10.411310] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T20:45:10.513983] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-15T20:45:11.314147] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-15T20:45:11.948175] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T20:45:11.985289] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-15T20:45:12.001489] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T20:45:12.113991] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-15T20:45:12.914018] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-15T20:45:13.065348] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T20:45:13.714021] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-15T20:45:14.513983] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-15T20:45:14.683498] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T20:45:15.313965] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-15T20:45:15.743321] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-15T20:45:15.995623] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:45:15.997363] [INFO ] [REMOTE ] OPY: Full fetch complete (10183 records). [2025-10-15T20:45:15.997451] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-15T20:45:16.118464] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-15T20:45:16.118391] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T20:45:16.222619] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T20:45:16.222964] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:45:16.223033] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:45:16.223106] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-15T20:45:16.223168] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-15T20:45:16.223203] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-15T20:45:16.223241] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-15T20:45:16.223311] [INFO ] [MAIN ] Update Progress: 1601/2369 symbols completed. OPY took 24.5s. Estimated remaining: 1h 48m 2s. Rate: 7.1 symbols/min [2025-10-15T20:45:16.387762] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:45:16.387930] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-15T20:45:16.387997] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-15T20:45:16.388114] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-15T20:45:16.388155] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-15T20:45:16.388216] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-15T20:45:16.388251] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-15T20:45:16.728703] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:45:16.913988] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-15T20:45:17.713983] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-15T20:45:17.893732] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T20:45:17.971806] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T20:45:18.514007] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-15T20:45:19.314008] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-15T20:45:19.919875] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T20:45:19.991877] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T20:45:20.113996] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-15T20:45:20.914048] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-15T20:45:21.714108] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-15T20:45:21.761622] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T20:45:21.876056] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-15T20:45:22.514075] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-15T20:45:22.582312] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T20:45:23.314022] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-15T20:45:23.469088] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T20:45:23.586087] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T20:45:24.114074] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-15T20:45:24.845852] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:45:24.851716] [INFO ] [REMOTE ] OR: Full fetch complete (66020 records). [2025-10-15T20:45:24.851846] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-15T20:45:24.852620] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:45:24.852736] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:45:24.852779] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:45:24.852818] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-15T20:45:24.852924] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-15T20:45:24.852981] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-15T20:45:24.853032] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-15T20:45:24.853103] [INFO ] [MAIN ] Update Progress: 1602/2369 symbols completed. OR took 33.1s. Estimated remaining: 1h 47m 53s. Rate: 7.1 symbols/min [2025-10-15T20:45:24.919150] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-15T20:45:25.021638] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:45:25.021855] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-15T20:45:25.021894] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-15T20:45:25.022002] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-15T20:45:25.022043] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-15T20:45:25.022163] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-15T20:45:25.022219] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-15T20:45:25.372122] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:45:25.698388] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-15T20:45:25.713957] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-15T20:45:26.423560] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T20:45:26.514058] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-15T20:45:27.314124] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-15T20:45:27.661046] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-15T20:45:28.114020] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-15T20:45:28.639186] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-15T20:45:28.913971] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-15T20:45:29.576279] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-15T20:45:29.714009] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-15T20:45:29.857914] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T20:45:30.514014] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-15T20:45:30.867501] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T20:45:30.874513] [INFO ] [REMOTE ] ORC: Full fetch complete (75557 records). [2025-10-15T20:45:30.874722] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-15T20:45:31.091717] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:45:31.186191] [INFO ] [REMOTE ] ORA: Full fetch complete (48743 records). [2025-10-15T20:45:31.197463] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-15T20:45:31.209034] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:45:31.226817] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:45:31.259699] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:45:31.264300] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-15T20:45:31.303568] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-15T20:45:31.303729] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-15T20:45:31.303364] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-15T20:45:31.305143] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-15T20:45:31.305239] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-15T20:45:31.305523] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-15T20:45:31.305609] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-15T20:45:31.305776] [INFO ] [MAIN ] Update Progress: 1603/2369 symbols completed. ORA took 39.5s. Estimated remaining: 1h 47m 44s. Rate: 7.1 symbols/min [2025-10-15T20:45:31.324884] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-15T20:45:31.355008] [DEBUG] [LOCAL ] ORC: Trimmed 75557 records to 52512 (keeping 200 days of data) [2025-10-15T20:45:31.717592] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:45:31.803204] [DEBUG] [LOCAL ] ORN: Loaded 30854 existing records from primary storage. [2025-10-15T20:45:31.820938] [INFO ] [MAIN ] ORN: Loaded 30854 existing records. [2025-10-15T20:45:32.014710] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:45:32.029886] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-15T20:45:32.029580] [DEBUG] [LOCAL ] ORC: Primary data saved (52512 records). [2025-10-15T20:45:32.030050] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-15T20:45:32.030253] [INFO ] [MAIN ] Update Progress: 1604/2369 symbols completed. ORC took 40.2s. Estimated remaining: 1h 47m 32s. Rate: 7.1 symbols/min [2025-10-15T20:45:32.030140] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-15T20:45:32.073493] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-15T20:45:32.111142] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-15T20:45:32.315760] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:45:32.366611] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-15T20:45:32.402882] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-15T20:45:32.434885] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-15T20:45:32.462308] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-15T20:45:32.474078] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-15T20:45:32.484410] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-15T20:45:32.673236] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:45:32.687606] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-15T20:45:32.911945] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-10-15T20:45:32.993973] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-15T20:45:32.993702] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:45:33.023015] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T20:45:33.713991] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-15T20:45:34.048217] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T20:45:34.513997] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-15T20:45:35.314091] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-15T20:45:35.411382] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T20:45:35.689975] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-15T20:45:35.757062] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T20:45:36.114031] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-15T20:45:36.820576] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T20:45:36.914064] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-15T20:45:37.714112] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-15T20:45:38.012961] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T20:45:38.432741] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-15T20:45:38.513992] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-15T20:45:39.314111] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-15T20:45:39.758166] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-15T20:45:40.114066] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-15T20:45:40.846405] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T20:45:40.913982] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-15T20:45:41.277801] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-15T20:45:41.714017] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-15T20:45:42.065204] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T20:45:42.269048] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T20:45:42.513999] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-15T20:45:43.314065] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-15T20:45:44.113969] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-15T20:45:44.313448] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T20:45:44.684595] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-15T20:45:44.799594] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T20:45:44.913996] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-15T20:45:45.714040] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-15T20:45:45.965562] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T20:45:46.045945] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T20:45:46.514042] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-15T20:45:47.314071] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-15T20:45:47.876993] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T20:45:48.114049] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-15T20:45:48.460793] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-15T20:45:48.914014] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-15T20:45:49.037023] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T20:45:49.363912] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T20:45:49.714065] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-15T20:45:50.513990] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-15T20:45:51.321000] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-15T20:45:51.325075] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-15T20:45:51.413439] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T20:45:52.114218] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-15T20:45:52.117269] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T20:45:52.723503] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T20:45:52.836428] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:45:52.842731] [INFO ] [REMOTE ] ORCL: Full fetch complete (77212 records). [2025-10-15T20:45:52.842910] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-15T20:45:52.843928] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:45:52.844042] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:45:52.844119] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:45:52.844219] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-15T20:45:52.844298] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-15T20:45:52.844335] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-15T20:45:52.844394] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-15T20:45:52.844453] [INFO ] [MAIN ] Update Progress: 1605/2369 symbols completed. ORCL took 36.6s. Estimated remaining: 1h 47m 29s. Rate: 7.1 symbols/min [2025-10-15T20:45:52.919137] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-15T20:45:53.025086] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:45:53.025195] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-15T20:45:53.025234] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-15T20:45:53.025369] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-15T20:45:53.025425] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-15T20:45:53.025470] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-15T20:45:53.025505] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-15T20:45:53.376624] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:45:53.714065] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-15T20:45:54.514039] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-15T20:45:55.132735] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T20:45:55.282391] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-15T20:45:55.314036] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-15T20:45:55.959509] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T20:45:56.113993] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-15T20:45:56.914009] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-15T20:45:57.075415] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T20:45:57.080237] [INFO ] [REMOTE ] ORN: Full fetch complete (45489 records). [2025-10-15T20:45:57.080460] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-15T20:45:57.489856] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-15T20:45:57.489967] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-15T20:45:57.491598] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-15T20:45:57.491688] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-15T20:45:57.493149] [DEBUG] [LOCAL ] ORN: Trimmed 45489 records to 30933 (keeping 200 days of data) [2025-10-15T20:45:57.686733] [DEBUG] [LOCAL ] ORN: Primary data saved (30933 records). [2025-10-15T20:45:57.687049] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-15T20:45:57.687269] [INFO ] [MAIN ] Update Progress: 1606/2369 symbols completed. ORN took 26.4s. Estimated remaining: 1h 47m 19s. Rate: 7.1 symbols/min [2025-10-15T20:45:57.719867] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-15T20:45:57.867604] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:45:57.867893] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-15T20:45:57.867940] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-15T20:45:57.868153] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-15T20:45:57.868210] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-15T20:45:57.868258] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-15T20:45:57.868296] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-15T20:45:58.011487] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-15T20:45:58.289549] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:45:58.519096] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-15T20:45:58.534529] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T20:45:59.095232] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T20:45:59.313986] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-15T20:45:59.855819] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T20:45:59.862119] [INFO ] [REMOTE ] ORI: Full fetch complete (70056 records). [2025-10-15T20:45:59.862282] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-15T20:45:59.863130] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:45:59.863230] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:45:59.863272] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:45:59.863312] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-15T20:45:59.863386] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-15T20:45:59.863445] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-15T20:45:59.863489] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-15T20:45:59.863564] [INFO ] [MAIN ] Update Progress: 1607/2369 symbols completed. ORI took 35.0s. Estimated remaining: 1h 47m 8s. Rate: 7.1 symbols/min [2025-10-15T20:46:00.039412] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:00.039674] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-15T20:46:00.039731] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-15T20:46:00.039869] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-15T20:46:00.039923] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-15T20:46:00.039969] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-15T20:46:00.040001] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-15T20:46:00.119161] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-15T20:46:00.409528] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:00.487110] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:46:00.487421] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-15T20:46:00.487530] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:46:00.487626] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-15T20:46:00.487738] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:46:00.487834] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-15T20:46:00.487916] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-15T20:46:00.487996] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-15T20:46:00.488059] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-15T20:46:00.488110] [INFO ] [MAIN ] Update Progress: 1608/2369 symbols completed. OTF took 2.8s. Estimated remaining: 1h 46m 55s. Rate: 7.1 symbols/min [2025-10-15T20:46:00.654577] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:00.654785] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-15T20:46:00.654849] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-15T20:46:00.654985] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-15T20:46:00.655053] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-15T20:46:00.655107] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-15T20:46:00.655142] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-15T20:46:00.922608] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-15T20:46:01.015053] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:01.483152] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-15T20:46:01.701845] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-10-15T20:46:01.714239] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-15T20:46:02.513983] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-15T20:46:03.314048] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-15T20:46:04.124538] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-15T20:46:04.130836] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T20:46:04.216678] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T20:46:04.396848] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-15T20:46:04.914017] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-15T20:46:05.476604] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T20:46:05.713994] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-15T20:46:06.513979] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-15T20:46:06.592885] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T20:46:07.313998] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-15T20:46:07.468947] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T20:46:08.113962] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-15T20:46:08.808997] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-15T20:46:08.846406] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T20:46:08.914918] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-15T20:46:08.921620] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T20:46:09.714003] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-15T20:46:10.514064] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-15T20:46:10.600632] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T20:46:10.938345] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T20:46:11.186835] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T20:46:11.192737] [INFO ] [REMOTE ] OSCR: Full fetch complete (77321 records). [2025-10-15T20:46:11.192841] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-15T20:46:11.193717] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:46:11.193807] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:46:11.193849] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:46:11.193901] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-15T20:46:11.194000] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-15T20:46:11.194037] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-15T20:46:11.194076] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-15T20:46:11.194130] [INFO ] [MAIN ] Update Progress: 1609/2369 symbols completed. OSCR took 39.2s. Estimated remaining: 1h 46m 48s. Rate: 7.1 symbols/min [2025-10-15T20:46:11.319086] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-15T20:46:11.363233] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:11.363439] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-15T20:46:11.363494] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-15T20:46:11.363603] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-15T20:46:11.363666] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-15T20:46:11.363735] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-15T20:46:11.363768] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-15T20:46:11.719068] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:12.114003] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-15T20:46:12.805578] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T20:46:12.913978] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-15T20:46:13.110368] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T20:46:13.713978] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-15T20:46:13.921482] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T20:46:14.514018] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-15T20:46:15.313965] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-15T20:46:15.373700] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T20:46:15.473987] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T20:46:16.114003] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-15T20:46:16.914035] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-15T20:46:17.084801] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T20:46:17.714003] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-15T20:46:17.856940] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T20:46:18.319004] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T20:46:18.353130] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T20:46:18.514054] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-15T20:46:19.314081] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-15T20:46:20.114023] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-15T20:46:20.162704] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T20:46:20.602000] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T20:46:20.914088] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-15T20:46:20.947266] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T20:46:21.714109] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-15T20:46:22.030414] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T20:46:22.514069] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-15T20:46:23.229249] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T20:46:23.313973] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-15T20:46:24.114010] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-15T20:46:24.241930] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:46:24.666055] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T20:46:24.914011] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-15T20:46:25.070155] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T20:46:25.660119] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T20:46:25.666181] [INFO ] [REMOTE ] OTIS: Full fetch complete (75892 records). [2025-10-15T20:46:25.666323] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-15T20:46:25.667210] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:46:25.667302] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:46:25.667344] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:46:25.667383] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-15T20:46:25.667438] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-15T20:46:25.667473] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-15T20:46:25.667525] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-15T20:46:25.667604] [INFO ] [MAIN ] Update Progress: 1610/2369 symbols completed. OTIS took 25.8s. Estimated remaining: 1h 46m 43s. Rate: 7.1 symbols/min [2025-10-15T20:46:25.719365] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-15T20:46:25.840362] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:25.840560] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-15T20:46:25.840597] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-15T20:46:25.840734] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-15T20:46:25.840777] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-15T20:46:25.840818] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-15T20:46:25.840851] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-15T20:46:26.199532] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:26.514076] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-15T20:46:26.514876] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T20:46:26.521051] [INFO ] [REMOTE ] OSK: Full fetch complete (60963 records). [2025-10-15T20:46:26.521171] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-15T20:46:26.521994] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:46:26.522080] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:46:26.522147] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:46:26.522219] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-15T20:46:26.522281] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-15T20:46:26.522317] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-15T20:46:26.522355] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-15T20:46:26.522428] [INFO ] [MAIN ] Update Progress: 1611/2369 symbols completed. OSK took 33.7s. Estimated remaining: 1h 46m 31s. Rate: 7.1 symbols/min [2025-10-15T20:46:26.704422] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:26.715458] [DEBUG] [LOCAL ] OWLT: Loaded 9291 existing records from primary storage. [2025-10-15T20:46:26.715719] [INFO ] [MAIN ] OWLT: Loaded 9291 existing records. [2025-10-15T20:46:26.889174] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:46:26.889381] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-15T20:46:26.889428] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-15T20:46:26.889588] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-15T20:46:26.889679] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-15T20:46:27.253608] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:27.314057] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-15T20:46:28.113999] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-15T20:46:28.365353] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T20:46:28.913989] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-15T20:46:29.001581] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T20:46:29.148131] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T20:46:29.714001] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-15T20:46:30.382116] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T20:46:30.513954] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-15T20:46:30.599058] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T20:46:31.196998] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:46:31.313995] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-15T20:46:32.114023] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-15T20:46:32.704105] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T20:46:32.830031] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T20:46:32.914005] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-15T20:46:33.652442] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:46:33.658595] [INFO ] [REMOTE ] OUT: Full fetch complete (68775 records). [2025-10-15T20:46:33.658833] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-15T20:46:33.661223] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:46:33.661489] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:46:33.661569] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:46:33.661684] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-15T20:46:33.661778] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-15T20:46:33.661823] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-15T20:46:33.661864] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-15T20:46:33.661934] [INFO ] [MAIN ] Update Progress: 1612/2369 symbols completed. OUT took 33.2s. Estimated remaining: 1h 46m 21s. Rate: 7.1 symbols/min [2025-10-15T20:46:33.723342] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-15T20:46:33.830514] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:33.830729] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-15T20:46:33.830783] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-15T20:46:33.830890] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-15T20:46:33.830931] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-15T20:46:33.830973] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-15T20:46:33.831004] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-15T20:46:34.186628] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:34.489147] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T20:46:34.514055] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-15T20:46:35.249566] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T20:46:35.314055] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-15T20:46:36.114032] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-15T20:46:36.887438] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T20:46:36.914003] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-15T20:46:37.714047] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-15T20:46:37.957166] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T20:46:38.514015] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-15T20:46:38.606167] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T20:46:38.843264] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:46:39.314050] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-15T20:46:39.958824] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T20:46:40.113980] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-15T20:46:40.239499] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T20:46:40.914057] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-15T20:46:41.714027] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-15T20:46:41.851497] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T20:46:41.991449] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T20:46:42.514017] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-15T20:46:42.994230] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T20:46:43.314013] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-15T20:46:44.113978] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-15T20:46:44.268568] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T20:46:44.409731] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T20:46:44.914018] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-15T20:46:45.141552] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T20:46:45.713999] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-15T20:46:46.495250] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T20:46:46.513951] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-15T20:46:47.190045] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T20:46:47.313995] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-15T20:46:48.113979] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-15T20:46:48.151918] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T20:46:48.522271] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T20:46:48.914006] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-15T20:46:49.631637] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T20:46:49.713979] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-15T20:46:50.333405] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T20:46:50.513975] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-15T20:46:51.313979] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-15T20:46:51.398370] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T20:46:52.119251] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-15T20:46:52.134709] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T20:46:52.832422] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T20:46:52.914026] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-15T20:46:53.713445] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T20:46:53.723849] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-15T20:46:54.488605] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T20:46:54.514242] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-15T20:46:54.515737] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T20:46:55.314019] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-15T20:46:56.012999] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T20:46:56.114002] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-15T20:46:56.862835] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T20:46:56.864702] [INFO ] [REMOTE ] OWLT: Full fetch complete (12042 records). [2025-10-15T20:46:56.864772] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-15T20:46:56.926029] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-15T20:46:57.260994] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-15T20:46:57.261138] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-15T20:46:57.261498] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-15T20:46:57.261760] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-15T20:46:57.263426] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T20:46:57.274055] [DEBUG] [LOCAL ] OWLT: Trimmed 12042 records to 9352 (keeping 200 days of data) [2025-10-15T20:46:57.325971] [DEBUG] [LOCAL ] OWLT: Primary data saved (9352 records). [2025-10-15T20:46:57.326096] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-15T20:46:57.326177] [INFO ] [MAIN ] Update Progress: 1613/2369 symbols completed. OWLT took 30.8s. Estimated remaining: 1h 46m 20s. Rate: 7.1 symbols/min [2025-10-15T20:46:57.488124] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:46:57.488320] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-15T20:46:57.488363] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-15T20:46:57.488469] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-15T20:46:57.488547] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-15T20:46:57.488609] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-15T20:46:57.488663] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-15T20:46:57.719235] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-15T20:46:57.881264] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:46:58.514032] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-15T20:46:58.744220] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T20:46:59.115343] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T20:46:59.314005] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-15T20:46:59.474736] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T20:47:00.071575] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:47:00.077626] [INFO ] [REMOTE ] OVV: Full fetch complete (77126 records). [2025-10-15T20:47:00.077778] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-15T20:47:00.078590] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:47:00.078700] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:47:00.078747] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:47:00.078812] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-15T20:47:00.078875] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-15T20:47:00.078910] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-15T20:47:00.078948] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-15T20:47:00.079002] [INFO ] [MAIN ] Update Progress: 1614/2369 symbols completed. OVV took 48.9s. Estimated remaining: 1h 46m 9s. Rate: 7.1 symbols/min [2025-10-15T20:47:00.119230] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-15T20:47:00.256359] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:00.256534] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-15T20:47:00.256571] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-15T20:47:00.256720] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-15T20:47:00.256769] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-15T20:47:00.256812] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-15T20:47:00.256844] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-15T20:47:00.606805] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:00.913995] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-15T20:47:01.714028] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-15T20:47:02.128522] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T20:47:02.265362] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T20:47:02.514004] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-15T20:47:02.774865] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T20:47:03.314055] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-15T20:47:04.113980] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-15T20:47:04.408999] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T20:47:04.839922] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T20:47:04.913993] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-15T20:47:05.291479] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-15T20:47:05.714014] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-15T20:47:05.826576] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T20:47:06.514011] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-15T20:47:07.323518] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-15T20:47:07.344685] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T20:47:08.113991] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-15T20:47:08.134246] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T20:47:08.139019] [INFO ] [REMOTE ] OXM: Full fetch complete (46030 records). [2025-10-15T20:47:08.139157] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-15T20:47:08.139967] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:47:08.140058] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:47:08.140102] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:47:08.140172] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-15T20:47:08.140274] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-15T20:47:08.140332] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-15T20:47:08.140376] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-15T20:47:08.140442] [INFO ] [MAIN ] Update Progress: 1615/2369 symbols completed. OXM took 34.5s. Estimated remaining: 1h 46m 0s. Rate: 7.1 symbols/min [2025-10-15T20:47:08.333446] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:08.369547] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T20:47:08.385981] [DEBUG] [LOCAL ] PAC: Loaded 11692 existing records from primary storage. [2025-10-15T20:47:08.386370] [INFO ] [MAIN ] PAC: Loaded 11692 existing records. [2025-10-15T20:47:08.576898] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:47:08.577334] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-15T20:47:08.577424] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-15T20:47:08.578142] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-15T20:47:08.578254] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-15T20:47:08.927728] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-15T20:47:08.992747] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:08.995831] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T20:47:09.714052] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-15T20:47:09.735998] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T20:47:09.742980] [INFO ] [REMOTE ] OWL: Full fetch complete (77314 records). [2025-10-15T20:47:09.743242] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-15T20:47:09.744568] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:47:09.744732] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:47:09.744787] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:47:09.744864] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-15T20:47:09.745035] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-15T20:47:09.745097] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-15T20:47:09.745156] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-15T20:47:09.745243] [INFO ] [MAIN ] Update Progress: 1616/2369 symbols completed. OWL took 44.1s. Estimated remaining: 1h 45m 49s. Rate: 7.1 symbols/min [2025-10-15T20:47:09.924827] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:09.965733] [DEBUG] [LOCAL ] PACK: Loaded 31902 existing records from primary storage. [2025-10-15T20:47:09.966156] [INFO ] [MAIN ] PACK: Loaded 31902 existing records. [2025-10-15T20:47:10.152065] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:47:10.152393] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-15T20:47:10.152454] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-15T20:47:10.152725] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-15T20:47:10.152791] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-15T20:47:10.521181] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-15T20:47:10.621982] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:11.314033] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-15T20:47:11.535705] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T20:47:11.855681] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T20:47:12.114055] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-15T20:47:12.494390] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T20:47:12.914022] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-15T20:47:13.099335] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T20:47:13.714000] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-15T20:47:14.118217] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T20:47:14.514030] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-15T20:47:14.675372] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T20:47:15.314032] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-15T20:47:15.741327] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T20:47:16.113967] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-15T20:47:16.246935] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T20:47:16.914058] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-15T20:47:17.044984] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T20:47:17.713986] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-15T20:47:18.215121] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T20:47:18.513979] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-15T20:47:18.593933] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T20:47:19.314039] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-15T20:47:19.806973] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T20:47:20.042173] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T20:47:20.113967] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-15T20:47:20.914073] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-15T20:47:21.128970] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T20:47:21.621364] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T20:47:21.713981] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-15T20:47:22.513986] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-15T20:47:22.661424] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T20:47:23.308114] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:47:23.313988] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-15T20:47:23.315418] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-15T20:47:23.315519] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-15T20:47:23.316876] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:47:23.317091] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:47:23.317176] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:47:23.317266] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-15T20:47:23.317342] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-15T20:47:23.317384] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-15T20:47:23.317428] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-15T20:47:23.317497] [INFO ] [MAIN ] Update Progress: 1617/2369 symbols completed. OXY took 26.0s. Estimated remaining: 1h 45m 43s. Rate: 7.1 symbols/min [2025-10-15T20:47:23.504392] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:23.504600] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-15T20:47:23.504671] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-15T20:47:23.504800] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-15T20:47:23.504845] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-15T20:47:23.504887] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-15T20:47:23.504921] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-15T20:47:23.914766] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:24.113977] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-15T20:47:24.487104] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T20:47:24.914040] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-15T20:47:25.533166] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T20:47:25.714035] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-15T20:47:26.513972] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-15T20:47:26.958049] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T20:47:27.026196] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T20:47:27.314016] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-15T20:47:27.313915] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T20:47:28.114060] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-15T20:47:28.163467] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T20:47:28.914016] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-15T20:47:29.689729] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T20:47:29.713985] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-15T20:47:29.935849] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T20:47:30.514009] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-15T20:47:31.314051] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-15T20:47:31.923781] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T20:47:32.046785] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T20:47:32.113963] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-15T20:47:32.669141] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T20:47:32.914007] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-15T20:47:33.713990] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-15T20:47:33.807222] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:47:34.050555] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-15T20:47:34.514049] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-15T20:47:35.030281] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T20:47:35.314022] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-15T20:47:36.114016] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-15T20:47:36.402799] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T20:47:36.758322] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T20:47:36.913979] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-15T20:47:36.977586] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T20:47:37.714054] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-15T20:47:38.135760] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T20:47:38.514019] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-15T20:47:39.313960] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-15T20:47:39.821365] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-15T20:47:39.869340] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T20:47:39.945520] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T20:47:40.113967] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-15T20:47:40.913988] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-15T20:47:41.434438] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T20:47:41.714031] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-15T20:47:42.514012] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-15T20:47:42.851290] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T20:47:43.114018] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T20:47:43.119902] [INFO ] [REMOTE ] PACK: Full fetch complete (44924 records). [2025-10-15T20:47:43.120074] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-15T20:47:43.321336] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-15T20:47:43.495953] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-15T20:47:43.496026] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-15T20:47:43.496851] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-15T20:47:43.496987] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-15T20:47:43.497944] [DEBUG] [LOCAL ] PACK: Trimmed 44924 records to 31968 (keeping 200 days of data) [2025-10-15T20:47:43.674549] [DEBUG] [LOCAL ] PACK: Primary data saved (31968 records). [2025-10-15T20:47:43.674718] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-15T20:47:43.674811] [INFO ] [MAIN ] Update Progress: 1618/2369 symbols completed. PACK took 33.9s. Estimated remaining: 1h 45m 40s. Rate: 7.1 symbols/min [2025-10-15T20:47:43.840691] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:43.840919] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-15T20:47:43.840988] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-15T20:47:43.841295] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-15T20:47:43.841361] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-15T20:47:43.841436] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-15T20:47:43.841473] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-15T20:47:43.984137] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T20:47:44.119233] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-15T20:47:44.222594] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:44.303459] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T20:47:44.312813] [INFO ] [REMOTE ] PAAS: Full fetch complete (77203 records). [2025-10-15T20:47:44.312982] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-15T20:47:44.314206] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:47:44.314321] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:47:44.314561] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:47:44.314630] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-15T20:47:44.314776] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-15T20:47:44.314859] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-15T20:47:44.314930] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-15T20:47:44.315021] [INFO ] [MAIN ] Update Progress: 1619/2369 symbols completed. PAAS took 44.2s. Estimated remaining: 1h 45m 28s. Rate: 7.1 symbols/min [2025-10-15T20:47:44.509853] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:44.510055] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-15T20:47:44.510091] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-15T20:47:44.510200] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-15T20:47:44.510241] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-15T20:47:44.510280] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-15T20:47:44.510311] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-15T20:47:44.855583] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:44.913953] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-15T20:47:45.011966] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T20:47:45.014840] [INFO ] [REMOTE ] PAC: Full fetch complete (16754 records). [2025-10-15T20:47:45.014933] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-15T20:47:45.374855] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-15T20:47:45.374928] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-15T20:47:45.375273] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-15T20:47:45.375311] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-15T20:47:45.375834] [DEBUG] [LOCAL ] PAC: Trimmed 16754 records to 11713 (keeping 200 days of data) [2025-10-15T20:47:45.446355] [DEBUG] [LOCAL ] PAC: Primary data saved (11713 records). [2025-10-15T20:47:45.446487] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-15T20:47:45.446564] [INFO ] [MAIN ] Update Progress: 1620/2369 symbols completed. PAC took 37.3s. Estimated remaining: 1h 45m 16s. Rate: 7.1 symbols/min [2025-10-15T20:47:45.609898] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:45.615217] [DEBUG] [LOCAL ] PAI: Loaded 2701 existing records from primary storage. [2025-10-15T20:47:45.615368] [INFO ] [MAIN ] PAI: Loaded 2701 existing records. [2025-10-15T20:47:45.719204] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-15T20:47:45.792150] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:47:45.793019] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-15T20:47:45.793092] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-15T20:47:45.793287] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-15T20:47:45.793343] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-15T20:47:46.226973] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:46.514010] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-15T20:47:46.664400] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:47:47.010689] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T20:47:47.086689] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T20:47:47.314000] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-15T20:47:48.114065] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-15T20:47:48.914031] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-15T20:47:48.950944] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T20:47:49.113616] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T20:47:49.572855] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T20:47:49.714064] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-15T20:47:50.514032] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-15T20:47:51.054392] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T20:47:51.314030] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-15T20:47:52.114070] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-15T20:47:52.266557] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T20:47:52.891568] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T20:47:52.913960] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-15T20:47:53.146389] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T20:47:53.629042] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:47:53.633465] [INFO ] [REMOTE ] PACS: Full fetch complete (50485 records). [2025-10-15T20:47:53.633616] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-15T20:47:53.634245] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:47:53.634334] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:47:53.634376] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:47:53.634414] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-15T20:47:53.634501] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-15T20:47:53.634558] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-15T20:47:53.634600] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-15T20:47:53.634685] [INFO ] [MAIN ] Update Progress: 1621/2369 symbols completed. PACS took 30.3s. Estimated remaining: 1h 45m 8s. Rate: 7.1 symbols/min [2025-10-15T20:47:53.719300] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-15T20:47:53.806491] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:53.806728] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-15T20:47:53.806777] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-15T20:47:53.806889] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-15T20:47:53.806930] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-15T20:47:53.806970] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-15T20:47:53.807002] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-15T20:47:54.161100] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:54.514012] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-15T20:47:55.036561] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T20:47:55.313992] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-15T20:47:55.753979] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-15T20:47:55.861803] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T20:47:56.114061] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-15T20:47:56.412336] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:47:56.412661] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-15T20:47:56.412749] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:47:56.412795] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-15T20:47:56.412857] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:47:56.412931] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-15T20:47:56.412995] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-15T20:47:56.413030] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-15T20:47:56.413070] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-15T20:47:56.413115] [INFO ] [MAIN ] Update Progress: 1622/2369 symbols completed. PAII took 2.8s. Estimated remaining: 1h 44m 56s. Rate: 7.1 symbols/min [2025-10-15T20:47:56.581203] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:47:56.581400] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-15T20:47:56.581441] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-15T20:47:56.581559] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-15T20:47:56.581599] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-15T20:47:56.581659] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-15T20:47:56.581716] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-15T20:47:56.913954] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-15T20:47:56.942272] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:47:57.497621] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T20:47:57.714043] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-15T20:47:58.513994] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-15T20:47:59.165717] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T20:47:59.313968] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-15T20:47:59.687051] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T20:47:59.769780] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T20:48:00.113991] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-15T20:48:00.914020] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-15T20:48:01.714087] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-15T20:48:01.984232] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T20:48:02.217521] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T20:48:02.514037] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-15T20:48:03.236437] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T20:48:03.313962] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-15T20:48:03.597786] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T20:48:04.114037] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-15T20:48:04.913959] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-15T20:48:05.048008] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T20:48:05.229119] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T20:48:05.714022] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-15T20:48:06.029112] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T20:48:06.514061] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-15T20:48:06.786453] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T20:48:07.313997] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-15T20:48:07.501493] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T20:48:08.114050] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-15T20:48:08.789391] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T20:48:08.914016] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-15T20:48:09.260696] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T20:48:09.714046] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-15T20:48:10.131317] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T20:48:10.514048] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-15T20:48:10.938173] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T20:48:11.314043] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-15T20:48:11.908751] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T20:48:12.113972] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-15T20:48:12.432744] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T20:48:12.914029] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-15T20:48:13.714033] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-15T20:48:13.780523] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T20:48:14.096609] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-15T20:48:14.171520] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T20:48:14.514037] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-15T20:48:15.314045] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-15T20:48:15.778574] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T20:48:15.789963] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T20:48:16.114030] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-15T20:48:16.913996] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-15T20:48:17.432190] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T20:48:17.714012] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-15T20:48:17.825769] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T20:48:18.514056] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-15T20:48:19.038800] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T20:48:19.314080] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-15T20:48:19.948818] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:48:19.954374] [INFO ] [REMOTE ] PAG: Full fetch complete (30483 records). [2025-10-15T20:48:19.954715] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-15T20:48:19.955859] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:48:19.955971] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:48:19.956037] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:48:19.956104] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-15T20:48:19.956191] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-15T20:48:19.956248] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-15T20:48:19.956310] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-15T20:48:19.956480] [INFO ] [MAIN ] Update Progress: 1623/2369 symbols completed. PAG took 36.3s. Estimated remaining: 1h 44m 55s. Rate: 7.1 symbols/min [2025-10-15T20:48:20.119256] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-15T20:48:20.194350] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:48:20.194888] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-15T20:48:20.194943] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-15T20:48:20.195149] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-15T20:48:20.195226] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-15T20:48:20.195272] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-15T20:48:20.195306] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-15T20:48:20.609410] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:48:20.633152] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-15T20:48:20.816689] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T20:48:20.914035] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-15T20:48:21.444843] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T20:48:21.445912] [INFO ] [REMOTE ] PAI: Full fetch complete (4095 records). [2025-10-15T20:48:21.445984] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-15T20:48:21.719138] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-15T20:48:21.837479] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-15T20:48:21.837560] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-15T20:48:21.837720] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-15T20:48:21.837784] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-15T20:48:21.838304] [DEBUG] [LOCAL ] PAI: Trimmed 4095 records to 2732 (keeping 200 days of data) [2025-10-15T20:48:21.858302] [DEBUG] [LOCAL ] PAI: Primary data saved (2732 records). [2025-10-15T20:48:21.858459] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-15T20:48:21.858566] [INFO ] [MAIN ] Update Progress: 1624/2369 symbols completed. PAI took 36.4s. Estimated remaining: 1h 44m 44s. Rate: 7.1 symbols/min [2025-10-15T20:48:22.043759] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:48:22.043953] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-15T20:48:22.043990] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-15T20:48:22.044107] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-15T20:48:22.044148] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-15T20:48:22.044188] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-15T20:48:22.044226] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-15T20:48:22.418929] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:48:22.514030] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-15T20:48:23.003875] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T20:48:23.010037] [INFO ] [REMOTE ] PAGS: Full fetch complete (76118 records). [2025-10-15T20:48:23.010204] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-15T20:48:23.011067] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:48:23.011165] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:48:23.011208] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:48:23.011248] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-15T20:48:23.011305] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-15T20:48:23.011339] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-15T20:48:23.011378] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-15T20:48:23.011439] [INFO ] [MAIN ] Update Progress: 1625/2369 symbols completed. PAGS took 38.7s. Estimated remaining: 1h 44m 32s. Rate: 7.1 symbols/min [2025-10-15T20:48:23.186306] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:48:23.186621] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-15T20:48:23.186861] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-15T20:48:23.205966] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-15T20:48:23.206231] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-15T20:48:23.207232] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-15T20:48:23.207300] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-15T20:48:23.208431] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T20:48:23.315714] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-15T20:48:23.578339] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:48:24.113984] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-15T20:48:24.744357] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T20:48:24.914027] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-15T20:48:25.214252] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T20:48:25.714096] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-15T20:48:26.344624] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T20:48:26.514018] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-15T20:48:27.076706] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T20:48:27.314015] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-15T20:48:28.007601] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:48:28.011462] [INFO ] [REMOTE ] PAM: Full fetch complete (41974 records). [2025-10-15T20:48:28.011560] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-15T20:48:28.012274] [FATAL] [VALIDATOR ] PAM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:48:28.012365] [FATAL] [MAIN ] PAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:48:28.012409] [WARN ] [MAIN ] PAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:48:28.012449] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-15T20:48:28.012507] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-15T20:48:28.012543] [INFO ] [LOCAL ] PAM: Starting deletion of derivative data. [2025-10-15T20:48:28.012584] [DEBUG] [LOCAL ] PAM: No derivative data file found to delete. [2025-10-15T20:48:28.012639] [INFO ] [MAIN ] Update Progress: 1626/2369 symbols completed. PAM took 31.6s. Estimated remaining: 1h 44m 22s. Rate: 7.1 symbols/min [2025-10-15T20:48:28.119163] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-15T20:48:28.184545] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:48:28.184713] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-15T20:48:28.184761] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-15T20:48:28.184865] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-15T20:48:28.184906] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-15T20:48:28.184949] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-15T20:48:28.184981] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-15T20:48:28.536249] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:48:28.913997] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-15T20:48:29.050362] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-15T20:48:29.529236] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T20:48:29.713978] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-15T20:48:30.356310] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T20:48:30.514029] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-15T20:48:31.314077] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-15T20:48:32.070267] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T20:48:32.113989] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-15T20:48:32.175124] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-15T20:48:32.292001] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T20:48:32.914018] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-15T20:48:33.115547] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T20:48:33.714020] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-15T20:48:34.513981] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-15T20:48:34.834394] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T20:48:34.996185] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-15T20:48:35.314050] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-15T20:48:35.963870] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T20:48:36.113978] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-15T20:48:36.244961] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T20:48:36.913981] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-15T20:48:37.685526] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T20:48:37.713974] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-15T20:48:38.004488] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T20:48:38.514016] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-15T20:48:39.314040] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-15T20:48:39.714913] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-15T20:48:40.113976] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-15T20:48:40.216821] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T20:48:40.396634] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T20:48:40.913989] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-15T20:48:41.030509] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T20:48:41.714044] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-15T20:48:42.457718] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T20:48:42.513986] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-15T20:48:42.822169] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T20:48:43.314030] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-15T20:48:44.055443] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T20:48:44.114005] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-15T20:48:44.397178] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T20:48:44.914075] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-15T20:48:45.714103] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-15T20:48:45.967338] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T20:48:46.085422] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T20:48:46.513999] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-15T20:48:47.314081] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-15T20:48:47.447461] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T20:48:47.585849] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T20:48:48.114007] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-15T20:48:48.418093] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T20:48:48.913984] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-15T20:48:49.714004] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-15T20:48:50.343574] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T20:48:50.446925] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T20:48:50.513955] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-15T20:48:51.313957] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-15T20:48:51.489722] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T20:48:52.114041] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-15T20:48:52.215138] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T20:48:52.623666] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T20:48:52.914016] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-15T20:48:53.529213] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T20:48:53.531779] [INFO ] [REMOTE ] PAXS: Full fetch complete (29929 records). [2025-10-15T20:48:53.532024] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-15T20:48:53.552250] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:48:53.568572] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:48:53.572637] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:48:53.573416] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-15T20:48:53.575406] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T20:48:53.575544] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-15T20:48:53.586478] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-15T20:48:53.587007] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-15T20:48:53.587114] [INFO ] [MAIN ] Update Progress: 1627/2369 symbols completed. PAXS took 25.6s. Estimated remaining: 1h 44m 21s. Rate: 7.1 symbols/min [2025-10-15T20:48:53.727370] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-15T20:48:53.759991] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:48:53.760302] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-15T20:48:53.760354] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-15T20:48:53.760489] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-15T20:48:53.760536] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-15T20:48:53.760616] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-15T20:48:53.760717] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-15T20:48:54.117432] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:48:54.513998] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-15T20:48:55.185920] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T20:48:55.191078] [INFO ] [REMOTE ] PARR: Full fetch complete (68732 records). [2025-10-15T20:48:55.191186] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-15T20:48:55.191882] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:48:55.191971] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:48:55.192013] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:48:55.192052] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-15T20:48:55.192107] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-15T20:48:55.192140] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-15T20:48:55.192179] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-15T20:48:55.192233] [INFO ] [MAIN ] Update Progress: 1628/2369 symbols completed. PARR took 33.3s. Estimated remaining: 1h 44m 10s. Rate: 7.1 symbols/min [2025-10-15T20:48:55.328997] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-15T20:48:55.359694] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:48:55.359804] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-15T20:48:55.359839] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-15T20:48:55.359941] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-15T20:48:55.359980] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-15T20:48:55.360021] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-15T20:48:55.360052] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-15T20:48:55.736842] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:48:55.786405] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-15T20:48:56.113989] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-15T20:48:56.913978] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-15T20:48:56.983834] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T20:48:57.714057] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-15T20:48:57.784243] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T20:48:57.861428] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T20:48:58.514075] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-15T20:48:59.314015] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-15T20:48:59.927242] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-15T20:49:00.011616] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T20:49:00.031110] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:49:00.035784] [INFO ] [REMOTE ] PAR: Full fetch complete (48500 records). [2025-10-15T20:49:00.035878] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-15T20:49:00.036443] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:00.036527] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:00.036569] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:00.036665] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-15T20:49:00.036744] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-15T20:49:00.036779] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-15T20:49:00.036821] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-15T20:49:00.036874] [INFO ] [MAIN ] Update Progress: 1629/2369 symbols completed. PAR took 40.1s. Estimated remaining: 1h 43m 60s. Rate: 7.1 symbols/min [2025-10-15T20:49:00.119103] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-15T20:49:00.223799] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:00.223981] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-15T20:49:00.224040] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-15T20:49:00.224152] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-15T20:49:00.224193] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-15T20:49:00.224234] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-15T20:49:00.224266] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-15T20:49:00.577239] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:00.913992] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-15T20:49:01.653632] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T20:49:01.713971] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-15T20:49:02.514067] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-15T20:49:03.078885] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T20:49:03.313974] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-15T20:49:03.403467] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-15T20:49:03.854627] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T20:49:04.113999] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-15T20:49:04.697470] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T20:49:04.914123] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-15T20:49:05.578789] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T20:49:05.584810] [INFO ] [REMOTE ] PATH: Full fetch complete (77461 records). [2025-10-15T20:49:05.584947] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-15T20:49:05.585796] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:05.585888] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:05.585929] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:05.585968] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-15T20:49:05.586045] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-15T20:49:05.586080] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-15T20:49:05.586118] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-15T20:49:05.586172] [INFO ] [MAIN ] Update Progress: 1630/2369 symbols completed. PATH took 42.6s. Estimated remaining: 1h 43m 50s. Rate: 7.1 symbols/min [2025-10-15T20:49:05.716663] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-15T20:49:05.771337] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:05.771617] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-15T20:49:05.771807] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-15T20:49:05.772035] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-15T20:49:05.772100] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-15T20:49:05.772232] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-15T20:49:05.772297] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-15T20:49:06.092546] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T20:49:06.186807] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:06.513987] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-15T20:49:07.319166] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-15T20:49:07.333296] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T20:49:07.654522] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T20:49:08.114044] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-15T20:49:08.914008] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-15T20:49:09.040733] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T20:49:09.490147] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T20:49:09.714010] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-15T20:49:10.245348] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T20:49:10.514042] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-15T20:49:11.314057] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-15T20:49:11.414236] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T20:49:12.114165] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-15T20:49:12.123181] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T20:49:12.913987] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-15T20:49:13.136094] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T20:49:13.480828] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T20:49:13.714042] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-15T20:49:14.056346] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T20:49:14.514050] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-15T20:49:15.313970] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-15T20:49:15.501910] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T20:49:16.068365] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T20:49:16.113990] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-15T20:49:16.590140] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T20:49:16.914027] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-15T20:49:17.617923] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T20:49:17.713994] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-15T20:49:18.513981] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-15T20:49:18.554331] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T20:49:19.300945] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T20:49:19.313959] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-15T20:49:20.097881] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T20:49:20.113962] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-15T20:49:20.914031] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-15T20:49:20.959907] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T20:49:21.726377] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-15T20:49:21.729462] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T20:49:22.514003] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-15T20:49:22.668358] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T20:49:23.065459] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:49:23.071086] [INFO ] [REMOTE ] PAY: Full fetch complete (53548 records). [2025-10-15T20:49:23.071289] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-15T20:49:23.072110] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:23.072218] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:23.072301] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:23.072385] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-15T20:49:23.072478] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-15T20:49:23.072542] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-15T20:49:23.072637] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-15T20:49:23.072749] [INFO ] [MAIN ] Update Progress: 1631/2369 symbols completed. PAY took 29.5s. Estimated remaining: 1h 43m 46s. Rate: 7.1 symbols/min [2025-10-15T20:49:23.272929] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:23.273329] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-15T20:49:23.273409] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-15T20:49:23.273763] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-15T20:49:23.274056] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-15T20:49:23.274222] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-15T20:49:23.274291] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-15T20:49:23.324232] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-15T20:49:23.578321] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T20:49:23.690011] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:24.114047] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-15T20:49:24.913979] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-15T20:49:25.006502] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T20:49:25.614701] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:49:25.619591] [INFO ] [REMOTE ] PAYC: Full fetch complete (52826 records). [2025-10-15T20:49:25.619755] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-15T20:49:25.620533] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:25.620670] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:25.620749] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:25.620836] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-15T20:49:25.620931] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-15T20:49:25.620988] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-15T20:49:25.621035] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-15T20:49:25.621123] [INFO ] [MAIN ] Update Progress: 1632/2369 symbols completed. PAYC took 30.4s. Estimated remaining: 1h 43m 34s. Rate: 7.1 symbols/min [2025-10-15T20:49:25.719102] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-15T20:49:25.820083] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:25.820309] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-15T20:49:25.820375] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-15T20:49:25.820508] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-15T20:49:25.820578] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-15T20:49:25.820696] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-15T20:49:25.820869] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-15T20:49:26.285568] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:26.290687] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T20:49:26.514086] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-15T20:49:27.314016] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-15T20:49:27.502168] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T20:49:27.778932] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T20:49:28.114048] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-15T20:49:28.914067] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-15T20:49:29.150123] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T20:49:29.714095] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-15T20:49:29.855999] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T20:49:30.120170] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T20:49:30.513987] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-15T20:49:31.300883] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T20:49:31.313956] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-15T20:49:32.113968] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-15T20:49:32.221741] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T20:49:32.880075] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T20:49:32.913978] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-15T20:49:33.417612] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T20:49:33.714013] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-15T20:49:34.514092] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-15T20:49:34.678826] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T20:49:34.706353] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T20:49:35.314069] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-15T20:49:35.941088] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T20:49:36.114083] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-15T20:49:36.914058] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-15T20:49:37.146525] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T20:49:37.423351] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T20:49:37.714087] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-15T20:49:38.338752] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T20:49:38.514058] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-15T20:49:39.314131] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-15T20:49:39.506784] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T20:49:39.548332] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T20:49:40.113999] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-15T20:49:40.914007] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-15T20:49:41.038681] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T20:49:41.331970] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T20:49:41.714077] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-15T20:49:42.514014] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-15T20:49:42.552760] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T20:49:43.314046] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-15T20:49:43.442021] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T20:49:44.114028] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-15T20:49:44.192228] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T20:49:44.223722] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T20:49:44.833920] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:49:44.839555] [INFO ] [REMOTE ] PBA: Full fetch complete (71266 records). [2025-10-15T20:49:44.839704] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-15T20:49:44.840541] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:44.840631] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:44.840718] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:44.840766] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-15T20:49:44.840823] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-15T20:49:44.840857] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-15T20:49:44.840895] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-15T20:49:44.840951] [INFO ] [MAIN ] Update Progress: 1633/2369 symbols completed. PBA took 39.3s. Estimated remaining: 1h 43m 31s. Rate: 7.1 symbols/min [2025-10-15T20:49:44.919132] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-15T20:49:45.011431] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:45.011573] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-15T20:49:45.011609] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-15T20:49:45.011735] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-15T20:49:45.011777] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-15T20:49:45.011817] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-15T20:49:45.011848] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-15T20:49:45.365053] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:45.713972] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-15T20:49:46.357171] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T20:49:46.513965] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-15T20:49:47.314038] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-15T20:49:47.564525] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T20:49:48.053701] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T20:49:48.113959] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-15T20:49:48.914022] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-15T20:49:48.956157] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T20:49:49.598295] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:49:49.603191] [INFO ] [REMOTE ] PB: Full fetch complete (58977 records). [2025-10-15T20:49:49.603292] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-15T20:49:49.603993] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:49.604120] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:49.604193] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:49.604289] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-15T20:49:49.604366] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-15T20:49:49.604404] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-15T20:49:49.604444] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-15T20:49:49.604501] [INFO ] [MAIN ] Update Progress: 1634/2369 symbols completed. PB took 49.6s. Estimated remaining: 1h 43m 21s. Rate: 7.1 symbols/min [2025-10-15T20:49:49.718387] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-15T20:49:49.785986] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T20:49:49.806688] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:49.806989] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-15T20:49:49.814820] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-15T20:49:49.815356] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-15T20:49:49.815425] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-15T20:49:49.815848] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-15T20:49:49.815911] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-15T20:49:50.158802] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:50.514000] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-15T20:49:51.313986] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-15T20:49:51.459414] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T20:49:51.649302] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T20:49:51.653412] [INFO ] [REMOTE ] PBH: Full fetch complete (44125 records). [2025-10-15T20:49:51.653584] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-15T20:49:51.654323] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:49:51.654418] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:49:51.654462] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:49:51.654530] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-15T20:49:51.654595] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-15T20:49:51.654631] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-15T20:49:51.654734] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-15T20:49:51.654801] [INFO ] [MAIN ] Update Progress: 1635/2369 symbols completed. PBH took 26.0s. Estimated remaining: 1h 43m 9s. Rate: 7.1 symbols/min [2025-10-15T20:49:51.827949] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:49:51.828203] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-15T20:49:51.828245] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-15T20:49:51.828356] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-15T20:49:51.828418] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-15T20:49:51.828486] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-15T20:49:51.828550] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-15T20:49:52.119087] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-15T20:49:52.190820] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:49:52.691135] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T20:49:52.913969] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-15T20:49:53.713987] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-15T20:49:53.984340] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T20:49:54.514072] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-15T20:49:55.057219] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-15T20:49:55.313998] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-15T20:49:55.614449] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T20:49:55.657968] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T20:49:56.114070] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-15T20:49:56.914057] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-15T20:49:57.141046] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T20:49:57.714007] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-15T20:49:57.935866] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T20:49:57.994304] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T20:49:58.514054] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-15T20:49:59.313989] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-15T20:49:59.495864] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T20:49:59.782515] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T20:50:00.114006] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-15T20:50:00.913993] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-15T20:50:00.992590] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T20:50:01.713997] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-15T20:50:01.991258] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T20:50:02.248324] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T20:50:02.514087] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-15T20:50:03.313996] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-15T20:50:03.591377] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T20:50:04.105018] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:50:04.111004] [INFO ] [REMOTE ] PBF: Full fetch complete (76361 records). [2025-10-15T20:50:04.111147] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-15T20:50:04.112032] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:50:04.112126] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:50:04.112172] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:50:04.112262] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-15T20:50:04.112340] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-15T20:50:04.112390] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-15T20:50:04.112446] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-15T20:50:04.112522] [INFO ] [MAIN ] Update Progress: 1636/2369 symbols completed. PBF took 41.0s. Estimated remaining: 1h 43m 3s. Rate: 7.1 symbols/min [2025-10-15T20:50:04.123694] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-15T20:50:04.376183] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:04.392591] [DEBUG] [LOCAL ] PCF: Loaded 9078 existing records from primary storage. [2025-10-15T20:50:04.392963] [INFO ] [MAIN ] PCF: Loaded 9078 existing records. [2025-10-15T20:50:04.660041] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:50:04.660347] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-15T20:50:04.660408] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-15T20:50:04.660780] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-15T20:50:04.660852] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-15T20:50:04.921046] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-15T20:50:05.151529] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-15T20:50:05.172154] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:05.320035] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T20:50:05.714016] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-15T20:50:06.514082] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-15T20:50:06.779278] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T20:50:06.813613] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-15T20:50:07.313997] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-15T20:50:08.114020] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-15T20:50:08.448331] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:50:08.837671] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-15T20:50:08.914016] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-15T20:50:09.642529] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T20:50:09.714048] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-15T20:50:09.965131] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T20:50:10.514059] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-15T20:50:11.314054] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-15T20:50:12.120438] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-15T20:50:12.155822] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T20:50:12.154353] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-15T20:50:12.566250] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T20:50:12.914010] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-15T20:50:13.352342] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T20:50:13.714012] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-15T20:50:14.513989] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-15T20:50:14.886638] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T20:50:15.139053] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T20:50:15.314051] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-15T20:50:16.114044] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-15T20:50:16.172185] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T20:50:16.472495] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T20:50:16.914036] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-15T20:50:17.489416] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:50:17.491725] [INFO ] [REMOTE ] PBT: Full fetch complete (24799 records). [2025-10-15T20:50:17.491805] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-15T20:50:17.492313] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:50:17.492394] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:50:17.492439] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:50:17.492506] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-15T20:50:17.492569] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-15T20:50:17.492605] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-15T20:50:17.492674] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-15T20:50:17.492754] [INFO ] [MAIN ] Update Progress: 1637/2369 symbols completed. PBT took 25.8s. Estimated remaining: 1h 42m 57s. Rate: 7.1 symbols/min [2025-10-15T20:50:17.714107] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-15T20:50:18.023638] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T20:50:18.514091] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-15T20:50:19.214811] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:50:19.220874] [INFO ] [REMOTE ] PBR: Full fetch complete (77491 records). [2025-10-15T20:50:19.221013] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-15T20:50:19.221889] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:50:19.222013] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:50:19.222085] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:50:19.222173] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-15T20:50:19.222250] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-15T20:50:19.222286] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-15T20:50:19.222327] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-15T20:50:19.222384] [INFO ] [MAIN ] Update Progress: 1638/2369 symbols completed. PBR took 29.6s. Estimated remaining: 1h 42m 45s. Rate: 7.1 symbols/min [2025-10-15T20:50:19.314048] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-15T20:50:19.650475] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T20:50:20.114044] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-15T20:50:20.189300] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T20:50:20.794212] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T20:50:20.799992] [INFO ] [REMOTE ] PBI: Full fetch complete (71965 records). [2025-10-15T20:50:20.800152] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-15T20:50:20.800981] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:50:20.801074] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:50:20.801120] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:50:20.801172] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-15T20:50:20.801240] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-15T20:50:20.801284] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-15T20:50:20.801332] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-15T20:50:20.801392] [INFO ] [MAIN ] Update Progress: 1639/2369 symbols completed. PBI took 36.0s. Estimated remaining: 1h 42m 34s. Rate: 7.1 symbols/min [2025-10-15T20:50:20.914106] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-15T20:50:21.564077] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T20:50:21.714082] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-15T20:50:22.594246] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T20:50:22.597031] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-15T20:50:23.287298] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T20:50:23.314006] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-15T20:50:24.044593] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T20:50:24.114103] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-15T20:50:25.021804] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T20:50:25.024463] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-15T20:50:25.835504] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T20:50:25.837842] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-15T20:50:26.743248] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T20:50:26.748433] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-15T20:50:27.380105] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:50:27.381763] [INFO ] [REMOTE ] PCF: Full fetch complete (13697 records). [2025-10-15T20:50:27.381839] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-15T20:50:27.761124] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-15T20:50:27.761208] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-15T20:50:27.761513] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-15T20:50:27.761552] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-15T20:50:27.762069] [DEBUG] [LOCAL ] PCF: Trimmed 13697 records to 9040 (keeping 200 days of data) [2025-10-15T20:50:27.814808] [DEBUG] [LOCAL ] PCF: Primary data saved (9040 records). [2025-10-15T20:50:27.814950] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-15T20:50:27.815030] [INFO ] [MAIN ] Update Progress: 1640/2369 symbols completed. PCF took 23.7s. Estimated remaining: 1h 42m 25s. Rate: 7.1 symbols/min [2025-10-15T20:50:28.432438] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:28.581262] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-15T20:50:28.639223] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-15T20:50:28.662473] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:28.663585] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-15T20:50:28.663391] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:28.663950] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-15T20:50:28.635910] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:28.664305] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-15T20:50:28.664222] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-15T20:50:28.664502] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-15T20:50:28.664432] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-15T20:50:28.664758] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-15T20:50:28.664836] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-15T20:50:28.664948] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-15T20:50:28.665022] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-15T20:50:28.665129] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-15T20:50:28.665264] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-15T20:50:28.665353] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-15T20:50:28.665480] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-15T20:50:28.670801] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-15T20:50:28.686394] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-15T20:50:28.896153] [DEBUG] [LOCAL ] PCM: Loaded 6804 existing records from primary storage. [2025-10-15T20:50:28.975104] [INFO ] [MAIN ] PCM: Loaded 6804 existing records. [2025-10-15T20:50:29.707100] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:50:29.770443] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-15T20:50:29.784125] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-15T20:50:29.854195] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-15T20:50:29.990883] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:29.981426] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-15T20:50:29.951503] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:30.007181] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-15T20:50:30.006955] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-15T20:50:30.087528] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:30.132436] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-15T20:50:30.454761] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:30.455094] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-15T20:50:31.346043] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T20:50:31.345839] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T20:50:31.348436] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-15T20:50:31.353057] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-15T20:50:31.622676] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T20:50:32.001570] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T20:50:32.114002] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-15T20:50:32.154579] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T20:50:32.271466] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T20:50:32.914013] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-15T20:50:33.714045] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-15T20:50:34.159950] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T20:50:34.215743] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T20:50:34.514047] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-15T20:50:34.961195] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T20:50:35.273227] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T20:50:35.314016] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-15T20:50:36.114034] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-15T20:50:36.725600] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T20:50:36.914025] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-15T20:50:37.714035] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-15T20:50:38.053703] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T20:50:38.106286] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T20:50:38.514023] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-15T20:50:39.223459] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T20:50:39.314024] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-15T20:50:39.985805] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T20:50:40.113999] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-15T20:50:40.771833] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T20:50:40.913998] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-15T20:50:41.443995] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T20:50:41.714052] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-15T20:50:42.513985] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-15T20:50:42.586493] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T20:50:43.004542] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T20:50:43.214566] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T20:50:43.313961] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-15T20:50:44.114069] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-15T20:50:44.835002] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T20:50:44.913993] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-15T20:50:45.300701] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T20:50:45.677028] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T20:50:45.714002] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-15T20:50:46.460783] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T20:50:46.513996] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-15T20:50:47.298349] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T20:50:47.313966] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-15T20:50:47.902541] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T20:50:48.113999] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-15T20:50:48.908859] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T20:50:48.913938] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-15T20:50:49.714112] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-15T20:50:49.752903] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T20:50:50.514007] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-15T20:50:51.314054] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-15T20:50:51.852582] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T20:50:51.852812] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T20:50:51.867318] [INFO ] [REMOTE ] PCM: Full fetch complete (10422 records). [2025-10-15T20:50:51.867687] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-15T20:50:52.119187] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-15T20:50:52.247209] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-15T20:50:52.247308] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-15T20:50:52.247610] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-15T20:50:52.247801] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-15T20:50:52.248469] [DEBUG] [LOCAL ] PCM: Trimmed 10422 records to 6810 (keeping 200 days of data) [2025-10-15T20:50:52.321676] [DEBUG] [LOCAL ] PCM: Primary data saved (6810 records). [2025-10-15T20:50:52.322542] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-15T20:50:52.322765] [INFO ] [MAIN ] Update Progress: 1641/2369 symbols completed. PCM took 24.5s. Estimated remaining: 1h 42m 23s. Rate: 7.1 symbols/min [2025-10-15T20:50:52.323895] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:50:52.508392] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:52.522582] [DEBUG] [LOCAL ] PCQ: Loaded 12132 existing records from primary storage. [2025-10-15T20:50:52.522833] [INFO ] [MAIN ] PCQ: Loaded 12132 existing records. [2025-10-15T20:50:52.698270] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:50:52.698484] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-15T20:50:52.698533] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-15T20:50:52.698792] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-15T20:50:52.698851] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-15T20:50:52.924009] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-15T20:50:53.054478] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:53.713962] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-15T20:50:53.920386] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T20:50:54.255992] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T20:50:54.514007] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-15T20:50:54.700733] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T20:50:55.314069] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-15T20:50:56.113988] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-15T20:50:56.257751] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T20:50:56.422235] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T20:50:56.914012] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-15T20:50:57.490314] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:50:57.493913] [INFO ] [REMOTE ] PCN: Full fetch complete (34179 records). [2025-10-15T20:50:57.494143] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-15T20:50:57.494673] [FATAL] [VALIDATOR ] PCN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:50:57.494757] [FATAL] [MAIN ] PCN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:50:57.494801] [WARN ] [MAIN ] PCN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:50:57.494875] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-15T20:50:57.494937] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-15T20:50:57.494974] [INFO ] [LOCAL ] PCN: Starting deletion of derivative data. [2025-10-15T20:50:57.495014] [DEBUG] [LOCAL ] PCN: No derivative data file found to delete. [2025-10-15T20:50:57.495070] [INFO ] [MAIN ] Update Progress: 1642/2369 symbols completed. PCN took 29.7s. Estimated remaining: 1h 42m 13s. Rate: 7.1 symbols/min [2025-10-15T20:50:57.666598] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:50:57.666962] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-15T20:50:57.667032] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-15T20:50:57.667366] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-15T20:50:57.667505] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-15T20:50:57.667835] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-15T20:50:57.667971] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-15T20:50:57.723964] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-15T20:50:57.821354] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T20:50:58.069117] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:50:58.465112] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T20:50:58.513968] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-15T20:50:59.314053] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-15T20:51:00.113996] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-15T20:51:00.264412] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T20:51:00.913982] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-15T20:51:01.221179] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T20:51:01.714041] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-15T20:51:02.182191] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T20:51:02.311584] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T20:51:02.514049] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-15T20:51:02.724113] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T20:51:03.313977] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-15T20:51:03.554913] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T20:51:04.114014] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-15T20:51:04.893166] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T20:51:04.913997] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-15T20:51:05.457833] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T20:51:05.714000] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-15T20:51:05.782420] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T20:51:06.514047] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-15T20:51:07.099928] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T20:51:07.314054] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-15T20:51:08.113983] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-15T20:51:08.309561] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T20:51:08.814409] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T20:51:08.815561] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T20:51:08.914030] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-15T20:51:09.670604] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T20:51:09.714015] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-15T20:51:10.514028] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-15T20:51:11.250613] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:51:11.258933] [INFO ] [REMOTE ] PCG: Full fetch complete (77507 records). [2025-10-15T20:51:11.259137] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-15T20:51:11.260176] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:51:11.260319] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:51:11.260409] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:51:11.260498] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-15T20:51:11.260582] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-15T20:51:11.260634] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-15T20:51:11.260739] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-15T20:51:11.260864] [INFO ] [MAIN ] Update Progress: 1643/2369 symbols completed. PCG took 43.4s. Estimated remaining: 1h 42m 7s. Rate: 7.1 symbols/min [2025-10-15T20:51:11.319364] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-15T20:51:11.439031] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:11.439310] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-15T20:51:11.439379] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-15T20:51:11.439572] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-15T20:51:11.439707] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-15T20:51:11.439814] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-15T20:51:11.439866] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-15T20:51:11.588473] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T20:51:11.834214] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:51:12.114070] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-15T20:51:12.833381] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:51:12.841575] [INFO ] [REMOTE ] PCOR: Full fetch complete (69118 records). [2025-10-15T20:51:12.841854] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-15T20:51:12.843166] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:51:12.844180] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:51:12.844305] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:51:12.844399] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-15T20:51:12.844496] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-15T20:51:12.844556] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-15T20:51:12.844606] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-15T20:51:12.844713] [INFO ] [MAIN ] Update Progress: 1644/2369 symbols completed. PCOR took 45.0s. Estimated remaining: 1h 41m 56s. Rate: 7.1 symbols/min [2025-10-15T20:51:12.919238] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-15T20:51:13.121722] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:13.122146] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-15T20:51:13.122229] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-15T20:51:13.122473] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-15T20:51:13.122555] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-15T20:51:13.122713] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-15T20:51:13.122818] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-15T20:51:13.300391] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T20:51:13.324705] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-15T20:51:13.603627] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:51:13.714004] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-15T20:51:14.514018] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-15T20:51:14.698156] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T20:51:15.314017] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-15T20:51:16.114021] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-15T20:51:16.304789] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T20:51:16.444034] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T20:51:16.877343] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T20:51:16.913960] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-15T20:51:17.713997] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-15T20:51:18.471611] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:51:18.475031] [INFO ] [REMOTE ] PCQ: Full fetch complete (16950 records). [2025-10-15T20:51:18.475151] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-15T20:51:18.519209] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-15T20:51:18.857058] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-15T20:51:18.857255] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-15T20:51:18.857674] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-15T20:51:18.867071] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-15T20:51:18.883188] [DEBUG] [LOCAL ] PCQ: Trimmed 16950 records to 12168 (keeping 200 days of data) [2025-10-15T20:51:18.885052] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T20:51:18.966614] [DEBUG] [LOCAL ] PCQ: Primary data saved (12168 records). [2025-10-15T20:51:18.966764] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-15T20:51:18.966887] [INFO ] [MAIN ] Update Progress: 1645/2369 symbols completed. PCQ took 26.6s. Estimated remaining: 1h 41m 46s. Rate: 7.1 symbols/min [2025-10-15T20:51:19.131924] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:19.132101] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-15T20:51:19.132141] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-15T20:51:19.132247] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-15T20:51:19.132292] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-15T20:51:19.132332] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-15T20:51:19.132363] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-15T20:51:19.319253] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-15T20:51:19.487718] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:51:19.904580] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T20:51:20.113973] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-15T20:51:20.188042] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T20:51:20.595494] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-15T20:51:20.914005] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-15T20:51:21.714038] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-15T20:51:22.468256] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T20:51:22.513960] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-15T20:51:23.034322] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T20:51:23.314082] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-15T20:51:23.996548] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T20:51:24.106612] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T20:51:24.115195] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-15T20:51:24.914014] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-15T20:51:25.713994] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-15T20:51:25.914777] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T20:51:26.049784] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T20:51:26.514007] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-15T20:51:27.222168] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T20:51:27.313979] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-15T20:51:28.114019] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-15T20:51:28.488581] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-15T20:51:28.536226] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T20:51:28.913975] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-15T20:51:29.165766] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T20:51:29.714003] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-15T20:51:30.514011] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-15T20:51:30.968520] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T20:51:31.313976] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-15T20:51:31.540154] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T20:51:31.707001] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T20:51:32.113991] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-15T20:51:32.913971] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-15T20:51:32.934196] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T20:51:32.939889] [INFO ] [REMOTE ] PD: Full fetch complete (67839 records). [2025-10-15T20:51:32.940018] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-15T20:51:32.940891] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:51:32.940981] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:51:32.941052] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:51:32.941124] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-15T20:51:32.941189] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-15T20:51:32.941226] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-15T20:51:32.941265] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-15T20:51:32.941320] [INFO ] [MAIN ] Update Progress: 1646/2369 symbols completed. PD took 35.4s. Estimated remaining: 1h 41m 40s. Rate: 7.1 symbols/min [2025-10-15T20:51:33.140186] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T20:51:33.142835] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:33.153527] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-15T20:51:33.153776] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-15T20:51:33.153957] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-15T20:51:33.154051] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-15T20:51:33.154491] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-15T20:51:33.154544] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-15T20:51:33.377264] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T20:51:33.511836] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:51:33.713988] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-15T20:51:34.208882] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T20:51:34.514007] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-15T20:51:35.313998] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-15T20:51:35.840398] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T20:51:36.113983] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-15T20:51:36.913964] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-15T20:51:37.163368] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-15T20:51:37.344440] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T20:51:37.714040] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-15T20:51:37.759590] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T20:51:38.514028] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-15T20:51:38.898869] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-15T20:51:39.031292] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T20:51:39.313996] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-15T20:51:40.114005] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-15T20:51:40.914023] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-15T20:51:41.002619] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T20:51:41.201236] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-15T20:51:41.201930] [INFO ] [REMOTE ] PDCC: Full fetch complete (1348 records). [2025-10-15T20:51:41.201998] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-15T20:51:41.373058] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-15T20:51:41.373253] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:51:41.373322] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:51:41.373396] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-15T20:51:41.373457] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-15T20:51:41.373493] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-15T20:51:41.373531] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-15T20:51:41.373585] [INFO ] [MAIN ] Update Progress: 1647/2369 symbols completed. PDCC took 30.1s. Estimated remaining: 1h 41m 32s. Rate: 7.1 symbols/min [2025-10-15T20:51:41.539249] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:41.557518] [DEBUG] [LOCAL ] PDS: Loaded 17289 existing records from primary storage. [2025-10-15T20:51:41.557798] [INFO ] [MAIN ] PDS: Loaded 17289 existing records. [2025-10-15T20:51:41.731398] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:51:41.726282] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-15T20:51:41.732461] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-15T20:51:41.732514] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-15T20:51:41.732797] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-15T20:51:41.732859] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-15T20:51:42.086191] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:51:42.118814] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T20:51:42.514013] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-15T20:51:43.189002] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T20:51:43.314017] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-15T20:51:44.071662] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T20:51:44.113970] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-15T20:51:44.704069] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T20:51:44.914031] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-15T20:51:45.714030] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-15T20:51:45.838881] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T20:51:46.061522] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T20:51:46.513996] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-15T20:51:46.928043] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T20:51:47.158057] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T20:51:47.313983] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-15T20:51:48.114056] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-15T20:51:48.390913] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T20:51:48.914094] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-15T20:51:49.687226] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T20:51:49.713958] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-15T20:51:50.107716] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T20:51:50.514015] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-15T20:51:50.946330] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T20:51:51.314051] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-15T20:51:51.863068] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T20:51:52.058104] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:51:52.063626] [INFO ] [REMOTE ] PDI: Full fetch complete (72723 records). [2025-10-15T20:51:52.063782] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-15T20:51:52.064576] [FATAL] [VALIDATOR ] PDI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:51:52.064694] [FATAL] [MAIN ] PDI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:51:52.064744] [WARN ] [MAIN ] PDI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:51:52.064829] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-15T20:51:52.064891] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-15T20:51:52.064924] [INFO ] [LOCAL ] PDI: Starting deletion of derivative data. [2025-10-15T20:51:52.064962] [DEBUG] [LOCAL ] PDI: No derivative data file found to delete. [2025-10-15T20:51:52.065018] [INFO ] [MAIN ] Update Progress: 1648/2369 symbols completed. PDI took 39.2s. Estimated remaining: 1h 41m 25s. Rate: 7.1 symbols/min [2025-10-15T20:51:52.114678] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-15T20:51:52.237741] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:52.256074] [DEBUG] [LOCAL ] PDT: Loaded 17577 existing records from primary storage. [2025-10-15T20:51:52.256310] [INFO ] [MAIN ] PDT: Loaded 17577 existing records. [2025-10-15T20:51:52.428307] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:51:52.428550] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-15T20:51:52.428625] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-15T20:51:52.428938] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-15T20:51:52.428996] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-15T20:51:52.806821] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:51:52.913980] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-15T20:51:53.447264] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T20:51:53.714077] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-15T20:51:54.487308] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T20:51:54.513976] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-15T20:51:54.725344] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T20:51:55.313992] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-15T20:51:55.644382] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T20:51:56.113967] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-15T20:51:56.424086] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T20:51:56.914050] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-15T20:51:57.261822] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T20:51:57.482844] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T20:51:57.714035] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-15T20:51:58.514015] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-15T20:51:58.906834] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T20:51:58.977555] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T20:51:58.982930] [INFO ] [REMOTE ] PDM: Full fetch complete (56968 records). [2025-10-15T20:51:58.983053] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-15T20:51:58.983818] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:51:58.983913] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:51:58.983958] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:51:58.984013] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-15T20:51:58.984119] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-15T20:51:58.984159] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-15T20:51:58.984200] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-15T20:51:58.984256] [INFO ] [MAIN ] Update Progress: 1649/2369 symbols completed. PDM took 40.0s. Estimated remaining: 1h 41m 15s. Rate: 7.1 symbols/min [2025-10-15T20:51:59.152236] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:51:59.152457] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-15T20:51:59.152512] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-15T20:51:59.152621] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-15T20:51:59.152694] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-15T20:51:59.152749] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-15T20:51:59.152781] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-15T20:51:59.326071] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-15T20:51:59.526238] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:00.114028] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-15T20:52:00.856510] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T20:52:00.913995] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-15T20:52:01.344112] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T20:52:01.714054] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-15T20:52:02.038263] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T20:52:02.514083] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-15T20:52:02.962132] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T20:52:03.314023] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-15T20:52:03.968437] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T20:52:04.063540] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T20:52:04.114088] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-15T20:52:04.834081] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T20:52:04.913989] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-15T20:52:05.714010] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-15T20:52:06.266793] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T20:52:06.513969] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-15T20:52:06.780473] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T20:52:06.858882] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T20:52:06.862780] [INFO ] [REMOTE ] PDO: Full fetch complete (46836 records). [2025-10-15T20:52:06.862871] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-15T20:52:06.863536] [FATAL] [VALIDATOR ] PDO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:52:06.863619] [FATAL] [MAIN ] PDO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:52:06.863693] [WARN ] [MAIN ] PDO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:52:06.863744] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-15T20:52:06.863799] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-15T20:52:06.863875] [INFO ] [LOCAL ] PDO: Starting deletion of derivative data. [2025-10-15T20:52:06.863937] [DEBUG] [LOCAL ] PDO: No derivative data file found to delete. [2025-10-15T20:52:06.863994] [INFO ] [MAIN ] Update Progress: 1650/2369 symbols completed. PDO took 33.9s. Estimated remaining: 1h 41m 7s. Rate: 7.1 symbols/min [2025-10-15T20:52:07.029834] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:07.030000] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-15T20:52:07.030036] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-15T20:52:07.030149] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-15T20:52:07.030189] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-15T20:52:07.030231] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-15T20:52:07.030264] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-15T20:52:07.319091] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-15T20:52:07.386932] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:08.113961] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-15T20:52:08.303591] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T20:52:08.913991] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-15T20:52:09.713974] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-15T20:52:09.865482] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:52:09.929001] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T20:52:10.513997] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-15T20:52:10.814776] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T20:52:11.314032] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-15T20:52:11.495042] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T20:52:12.114058] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-15T20:52:12.918077] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-15T20:52:12.923224] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T20:52:13.193276] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T20:52:13.714028] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-15T20:52:13.859947] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T20:52:14.514074] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-15T20:52:15.314032] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-15T20:52:15.342933] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T20:52:15.564076] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T20:52:16.114008] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-15T20:52:16.485262] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T20:52:16.729142] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T20:52:16.731310] [INFO ] [REMOTE ] PDS: Full fetch complete (25653 records). [2025-10-15T20:52:16.731390] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-15T20:52:16.919101] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-15T20:52:17.127227] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-15T20:52:17.127310] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-15T20:52:17.127872] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-15T20:52:17.127933] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-15T20:52:17.128683] [DEBUG] [LOCAL ] PDS: Trimmed 25653 records to 17227 (keeping 200 days of data) [2025-10-15T20:52:17.233177] [DEBUG] [LOCAL ] PDS: Primary data saved (17227 records). [2025-10-15T20:52:17.233392] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-15T20:52:17.233500] [INFO ] [MAIN ] Update Progress: 1651/2369 symbols completed. PDS took 35.9s. Estimated remaining: 1h 40m 59s. Rate: 7.1 symbols/min [2025-10-15T20:52:17.419068] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:17.419233] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-15T20:52:17.419269] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-15T20:52:17.419407] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-15T20:52:17.419485] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-15T20:52:17.419552] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-15T20:52:17.419586] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-15T20:52:17.719112] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-15T20:52:17.784316] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:18.487428] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T20:52:18.513969] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-15T20:52:18.748523] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T20:52:19.313994] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-15T20:52:19.659720] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T20:52:20.113982] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-15T20:52:20.914138] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-15T20:52:21.034001] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T20:52:21.086320] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T20:52:21.714024] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-15T20:52:22.006763] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T20:52:22.514034] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-15T20:52:23.313977] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-15T20:52:23.517536] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T20:52:23.518357] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T20:52:24.113972] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-15T20:52:24.409137] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T20:52:24.413353] [INFO ] [REMOTE ] PDT: Full fetch complete (25321 records). [2025-10-15T20:52:24.413468] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-15T20:52:24.788992] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-15T20:52:24.789064] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-15T20:52:24.789577] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-15T20:52:24.789628] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-15T20:52:24.790281] [DEBUG] [LOCAL ] PDT: Trimmed 25321 records to 17557 (keeping 200 days of data) [2025-10-15T20:52:24.901529] [DEBUG] [LOCAL ] PDT: Primary data saved (17557 records). [2025-10-15T20:52:24.901696] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-15T20:52:24.901818] [INFO ] [MAIN ] Update Progress: 1652/2369 symbols completed. PDT took 32.8s. Estimated remaining: 1h 40m 50s. Rate: 7.1 symbols/min [2025-10-15T20:52:24.921922] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-15T20:52:25.091459] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:25.091677] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-15T20:52:25.091731] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-15T20:52:25.091862] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-15T20:52:25.091905] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-15T20:52:25.091947] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-15T20:52:25.091980] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-15T20:52:25.455967] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:25.713953] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-15T20:52:25.891877] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T20:52:26.024567] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T20:52:26.514051] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-15T20:52:27.026725] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T20:52:27.314001] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-15T20:52:28.113968] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-15T20:52:28.540688] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T20:52:28.914037] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-15T20:52:29.091291] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T20:52:29.485839] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T20:52:29.690883] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T20:52:29.713949] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-15T20:52:30.275374] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:52:30.277249] [INFO ] [REMOTE ] PDX: Full fetch complete (23716 records). [2025-10-15T20:52:30.277333] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-15T20:52:30.277918] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:52:30.278047] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:52:30.278142] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:52:30.278230] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-15T20:52:30.278318] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-15T20:52:30.278362] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-15T20:52:30.278403] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-15T20:52:30.278459] [INFO ] [MAIN ] Update Progress: 1653/2369 symbols completed. PDX took 31.3s. Estimated remaining: 1h 40m 41s. Rate: 7.1 symbols/min [2025-10-15T20:52:30.446731] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:30.459901] [DEBUG] [LOCAL ] PEO: Loaded 11141 existing records from primary storage. [2025-10-15T20:52:30.460125] [INFO ] [MAIN ] PEO: Loaded 11141 existing records. [2025-10-15T20:52:30.519939] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-15T20:52:30.637752] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:52:30.637963] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-15T20:52:30.638030] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-15T20:52:30.638208] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-15T20:52:30.638246] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-15T20:52:30.989620] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:31.313994] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-15T20:52:32.113970] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-15T20:52:32.335516] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T20:52:32.913974] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-15T20:52:33.020823] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T20:52:33.060683] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T20:52:33.714045] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-15T20:52:34.312513] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T20:52:34.514023] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-15T20:52:34.811193] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T20:52:35.314066] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-15T20:52:36.113970] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-15T20:52:36.234479] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T20:52:36.913971] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-15T20:52:37.132961] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T20:52:37.251701] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T20:52:37.714008] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-15T20:52:38.514011] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-15T20:52:38.750432] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T20:52:39.183937] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T20:52:39.314023] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-15T20:52:40.120291] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-15T20:52:40.126417] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T20:52:40.145908] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T20:52:40.914029] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-15T20:52:41.617677] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T20:52:41.713956] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-15T20:52:42.514000] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-15T20:52:42.546517] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T20:52:42.852043] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T20:52:43.313999] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-15T20:52:43.805316] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T20:52:44.068616] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T20:52:44.114034] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-15T20:52:44.914032] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-15T20:52:44.933550] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T20:52:45.714016] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-15T20:52:46.447605] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:52:46.453587] [INFO ] [REMOTE ] PEB: Full fetch complete (72807 records). [2025-10-15T20:52:46.453739] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-15T20:52:46.454528] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:52:46.454613] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:52:46.454699] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:52:46.454792] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-15T20:52:46.454873] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-15T20:52:46.454910] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-15T20:52:46.454950] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-15T20:52:46.455006] [INFO ] [MAIN ] Update Progress: 1654/2369 symbols completed. PEB took 39.6s. Estimated remaining: 1h 40m 36s. Rate: 7.1 symbols/min [2025-10-15T20:52:46.519197] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-15T20:52:46.628451] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:46.644317] [DEBUG] [LOCAL ] PERF: Loaded 14374 existing records from primary storage. [2025-10-15T20:52:46.644564] [INFO ] [MAIN ] PERF: Loaded 14374 existing records. [2025-10-15T20:52:46.822031] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:52:46.822427] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-15T20:52:46.822498] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-15T20:52:46.822797] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-15T20:52:46.822937] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-15T20:52:46.967386] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T20:52:47.233426] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:47.313956] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-15T20:52:47.491862] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T20:52:48.113963] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-15T20:52:48.404599] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T20:52:48.914035] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-15T20:52:48.978293] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T20:52:49.713986] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-15T20:52:50.468805] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T20:52:50.513985] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-15T20:52:50.894207] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T20:52:51.314011] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-15T20:52:52.003911] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T20:52:52.113980] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-15T20:52:52.239069] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T20:52:52.914056] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-15T20:52:53.304063] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T20:52:53.498915] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:52:53.500620] [INFO ] [REMOTE ] PEO: Full fetch complete (16262 records). [2025-10-15T20:52:53.500714] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-15T20:52:53.719174] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-15T20:52:53.873693] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-15T20:52:53.873771] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-15T20:52:53.874116] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-15T20:52:53.874154] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-15T20:52:53.874636] [DEBUG] [LOCAL ] PEO: Trimmed 16262 records to 11154 (keeping 200 days of data) [2025-10-15T20:52:53.941117] [DEBUG] [LOCAL ] PEO: Primary data saved (11154 records). [2025-10-15T20:52:53.941236] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-15T20:52:53.941313] [INFO ] [MAIN ] Update Progress: 1655/2369 symbols completed. PEO took 23.7s. Estimated remaining: 1h 40m 27s. Rate: 7.1 symbols/min [2025-10-15T20:52:54.113795] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:54.113968] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-15T20:52:54.114006] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-15T20:52:54.114140] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-15T20:52:54.114243] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-15T20:52:54.114313] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-15T20:52:54.114359] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-15T20:52:54.457462] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:54.513966] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-15T20:52:54.793040] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:52:54.793473] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-15T20:52:54.793569] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:52:54.793617] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-15T20:52:54.793682] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:52:54.793759] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-15T20:52:54.793831] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-15T20:52:54.793867] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-15T20:52:54.793905] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-15T20:52:54.793956] [INFO ] [MAIN ] Update Progress: 1656/2369 symbols completed. PEW took 0.9s. Estimated remaining: 1h 40m 15s. Rate: 7.1 symbols/min [2025-10-15T20:52:54.961627] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:54.969940] [DEBUG] [LOCAL ] PFD: Loaded 5425 existing records from primary storage. [2025-10-15T20:52:54.970163] [INFO ] [MAIN ] PFD: Loaded 5425 existing records. [2025-10-15T20:52:55.148806] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:52:55.149057] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-15T20:52:55.149113] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-15T20:52:55.149250] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-15T20:52:55.149289] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-15T20:52:55.321060] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-15T20:52:55.506178] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:52:55.668743] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T20:52:56.114073] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-15T20:52:56.541468] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T20:52:56.914094] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-15T20:52:57.110250] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T20:52:57.714007] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-15T20:52:58.050827] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T20:52:58.486390] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T20:52:58.513952] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-15T20:52:59.314052] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-15T20:52:59.480344] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T20:52:59.782706] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T20:52:59.786068] [INFO ] [REMOTE ] PEN: Full fetch complete (44006 records). [2025-10-15T20:52:59.786155] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-15T20:52:59.786700] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:52:59.786784] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:52:59.786827] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:52:59.786866] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-15T20:52:59.786921] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-15T20:52:59.786955] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-15T20:52:59.786993] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-15T20:52:59.787046] [INFO ] [MAIN ] Update Progress: 1657/2369 symbols completed. PEN took 34.9s. Estimated remaining: 1h 40m 5s. Rate: 7.1 symbols/min [2025-10-15T20:52:59.950408] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:52:59.950577] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-15T20:52:59.950614] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-15T20:52:59.950748] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-15T20:52:59.950790] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-15T20:52:59.950829] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-15T20:52:59.950860] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-15T20:53:00.118284] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-15T20:53:00.296045] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:00.914016] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-15T20:53:01.105955] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T20:53:01.577902] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T20:53:01.713979] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-15T20:53:02.371636] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T20:53:02.513996] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-15T20:53:03.313990] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-15T20:53:04.113982] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-15T20:53:04.170793] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T20:53:04.914066] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-15T20:53:05.234534] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-15T20:53:05.525571] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T20:53:05.714022] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-15T20:53:06.040310] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T20:53:06.514044] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-15T20:53:06.781381] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T20:53:07.104802] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T20:53:07.110736] [INFO ] [REMOTE ] PEG: Full fetch complete (76546 records). [2025-10-15T20:53:07.110881] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-15T20:53:07.111630] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:53:07.111742] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:53:07.111785] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:53:07.111829] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-15T20:53:07.111885] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-15T20:53:07.111920] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-15T20:53:07.111958] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-15T20:53:07.112012] [INFO ] [MAIN ] Update Progress: 1658/2369 symbols completed. PEG took 49.9s. Estimated remaining: 1h 39m 56s. Rate: 7.1 symbols/min [2025-10-15T20:53:07.277828] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:07.278089] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-15T20:53:07.278137] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-15T20:53:07.278210] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-15T20:53:07.278246] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-15T20:53:07.278285] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-15T20:53:07.278315] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-15T20:53:07.319168] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-15T20:53:07.631562] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:08.114007] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-15T20:53:08.498276] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T20:53:08.914025] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-15T20:53:09.657767] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T20:53:09.714010] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-15T20:53:09.749289] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T20:53:10.427534] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T20:53:10.514022] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-15T20:53:11.181225] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T20:53:11.314002] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-15T20:53:12.114029] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-15T20:53:12.205933] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:53:12.914024] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-15T20:53:13.002783] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T20:53:13.714022] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-15T20:53:14.482156] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T20:53:14.513975] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-15T20:53:14.611175] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T20:53:15.314003] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-15T20:53:16.114031] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-15T20:53:16.239930] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T20:53:16.242324] [INFO ] [REMOTE ] PERF: Full fetch complete (22167 records). [2025-10-15T20:53:16.242419] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-15T20:53:16.621281] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-15T20:53:16.621361] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-15T20:53:16.621908] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-15T20:53:16.621974] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-15T20:53:16.622639] [DEBUG] [LOCAL ] PERF: Trimmed 22167 records to 14391 (keeping 200 days of data) [2025-10-15T20:53:16.704597] [DEBUG] [LOCAL ] PERF: Primary data saved (14391 records). [2025-10-15T20:53:16.704767] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-15T20:53:16.704861] [INFO ] [MAIN ] Update Progress: 1659/2369 symbols completed. PERF took 30.2s. Estimated remaining: 1h 39m 48s. Rate: 7.1 symbols/min [2025-10-15T20:53:16.884915] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:16.894234] [DEBUG] [LOCAL ] PFH: Loaded 6751 existing records from primary storage. [2025-10-15T20:53:16.894427] [INFO ] [MAIN ] PFH: Loaded 6751 existing records. [2025-10-15T20:53:16.924530] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-15T20:53:17.075199] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:53:17.075556] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-15T20:53:17.075690] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-15T20:53:17.075954] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-15T20:53:17.076012] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-15T20:53:17.184491] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T20:53:17.502050] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:17.497166] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.98 seconds). [2025-10-15T20:53:17.713963] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-15T20:53:18.498894] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T20:53:18.513949] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-15T20:53:19.314005] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-15T20:53:19.974418] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T20:53:20.090809] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-15T20:53:20.125670] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-15T20:53:20.128361] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T20:53:20.914002] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-15T20:53:21.649235] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:53:21.650524] [INFO ] [REMOTE ] PFD: Full fetch complete (7496 records). [2025-10-15T20:53:21.650592] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-15T20:53:21.721995] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-15T20:53:21.998540] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-15T20:53:21.998615] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-15T20:53:21.998843] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-15T20:53:21.998899] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-15T20:53:21.999328] [DEBUG] [LOCAL ] PFD: Trimmed 7496 records to 5425 (keeping 200 days of data) [2025-10-15T20:53:22.032676] [DEBUG] [LOCAL ] PFD: Primary data saved (5425 records). [2025-10-15T20:53:22.032784] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-15T20:53:22.032862] [INFO ] [MAIN ] Update Progress: 1660/2369 symbols completed. PFD took 27.2s. Estimated remaining: 1h 39m 38s. Rate: 7.1 symbols/min [2025-10-15T20:53:22.200067] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:22.215074] [DEBUG] [LOCAL ] PFL: Loaded 14241 existing records from primary storage. [2025-10-15T20:53:22.215292] [INFO ] [MAIN ] PFL: Loaded 14241 existing records. [2025-10-15T20:53:22.387973] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:53:22.388179] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-15T20:53:22.388228] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-15T20:53:22.388497] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-15T20:53:22.388552] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-15T20:53:22.514084] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-15T20:53:22.763128] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:22.764615] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:53:22.852564] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-15T20:53:23.314044] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-15T20:53:23.948870] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T20:53:24.113960] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-15T20:53:24.914063] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-15T20:53:25.714026] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-15T20:53:25.899996] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-15T20:53:25.915934] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T20:53:25.951336] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:53:26.511205] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T20:53:26.513938] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-15T20:53:27.251960] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T20:53:27.314008] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-15T20:53:28.088442] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T20:53:28.113955] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-15T20:53:28.913997] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-15T20:53:29.071144] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T20:53:29.714001] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-15T20:53:30.513996] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-15T20:53:30.912212] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T20:53:31.314005] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-15T20:53:31.928054] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-10-15T20:53:31.952298] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T20:53:32.113980] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-15T20:53:32.499481] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T20:53:32.913989] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-15T20:53:33.008138] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T20:53:33.714003] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-15T20:53:34.513991] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-15T20:53:34.799417] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T20:53:35.128755] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-15T20:53:35.313981] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-15T20:53:36.113980] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-15T20:53:36.205572] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T20:53:36.914011] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-15T20:53:36.934498] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T20:53:37.714050] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-15T20:53:37.774376] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-15T20:53:38.514011] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-15T20:53:38.627676] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T20:53:38.646543] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T20:53:39.314071] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-15T20:53:40.113980] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-15T20:53:40.191359] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T20:53:40.780095] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T20:53:40.913973] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-15T20:53:41.274830] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-15T20:53:41.713964] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-15T20:53:41.776200] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T20:53:42.514050] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-15T20:53:43.313971] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-15T20:53:43.397579] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T20:53:44.101059] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T20:53:44.113956] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-15T20:53:44.231185] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-15T20:53:44.914013] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-15T20:53:44.956361] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T20:53:45.714050] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-15T20:53:45.878727] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T20:53:45.881571] [INFO ] [REMOTE ] PFL: Full fetch complete (20571 records). [2025-10-15T20:53:45.881679] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-15T20:53:46.236221] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-15T20:53:46.236293] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-15T20:53:46.236736] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-15T20:53:46.236797] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-15T20:53:46.237327] [DEBUG] [LOCAL ] PFL: Trimmed 20571 records to 14344 (keeping 200 days of data) [2025-10-15T20:53:46.321290] [DEBUG] [LOCAL ] PFL: Primary data saved (14344 records). [2025-10-15T20:53:46.321412] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-15T20:53:46.321498] [INFO ] [MAIN ] Update Progress: 1661/2369 symbols completed. PFL took 24.3s. Estimated remaining: 1h 39m 37s. Rate: 7.1 symbols/min [2025-10-15T20:53:46.485218] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:46.485399] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-15T20:53:46.485439] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-15T20:53:46.485534] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-15T20:53:46.485594] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-15T20:53:46.485688] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-15T20:53:46.485752] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-15T20:53:46.519165] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-15T20:53:46.838855] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:47.313969] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-15T20:53:47.417550] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T20:53:47.432805] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T20:53:48.114062] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-15T20:53:48.832127] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:53:48.838299] [INFO ] [REMOTE ] PFE: Full fetch complete (77603 records). [2025-10-15T20:53:48.838794] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-15T20:53:48.839955] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:53:48.840071] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:53:48.840158] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:53:48.840254] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-15T20:53:48.840357] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-15T20:53:48.840398] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-15T20:53:48.840439] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-15T20:53:48.840499] [INFO ] [MAIN ] Update Progress: 1662/2369 symbols completed. PFE took 49.1s. Estimated remaining: 1h 39m 26s. Rate: 7.1 symbols/min [2025-10-15T20:53:48.922072] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-15T20:53:49.032637] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:49.066509] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:53:49.104086] [DEBUG] [LOCAL ] PFN: Loaded 22353 existing records from primary storage. [2025-10-15T20:53:49.104464] [INFO ] [MAIN ] PFN: Loaded 22353 existing records. [2025-10-15T20:53:49.337832] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:53:49.339111] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-15T20:53:49.339175] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-15T20:53:49.339992] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-15T20:53:49.340057] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-15T20:53:49.645050] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T20:53:49.724351] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-15T20:53:49.770415] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:50.498132] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T20:53:50.503372] [INFO ] [REMOTE ] PFGC: Full fetch complete (67400 records). [2025-10-15T20:53:50.503480] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-15T20:53:50.504195] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:53:50.504281] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:53:50.504322] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:53:50.504360] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-15T20:53:50.504414] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-15T20:53:50.504449] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-15T20:53:50.504487] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-15T20:53:50.504541] [INFO ] [MAIN ] Update Progress: 1663/2369 symbols completed. PFGC took 43.4s. Estimated remaining: 1h 39m 15s. Rate: 7.1 symbols/min [2025-10-15T20:53:50.519132] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-15T20:53:50.701209] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:50.710116] [DEBUG] [LOCAL ] PFO: Loaded 6095 existing records from primary storage. [2025-10-15T20:53:50.710332] [INFO ] [MAIN ] PFO: Loaded 6095 existing records. [2025-10-15T20:53:50.881907] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:53:50.882104] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-15T20:53:50.882150] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-15T20:53:50.882316] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-15T20:53:50.882371] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-15T20:53:51.222145] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:51.314014] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-15T20:53:51.899730] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T20:53:52.114004] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-15T20:53:52.192541] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T20:53:52.677955] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:53:52.679076] [INFO ] [REMOTE ] PFH: Full fetch complete (9944 records). [2025-10-15T20:53:52.679145] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-15T20:53:52.920499] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-15T20:53:53.040951] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-15T20:53:53.041025] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-15T20:53:53.041264] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-15T20:53:53.041302] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-15T20:53:53.041737] [DEBUG] [LOCAL ] PFH: Trimmed 9944 records to 6595 (keeping 200 days of data) [2025-10-15T20:53:53.081165] [DEBUG] [LOCAL ] PFH: Primary data saved (6595 records). [2025-10-15T20:53:53.081293] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-15T20:53:53.081373] [INFO ] [MAIN ] Update Progress: 1664/2369 symbols completed. PFH took 36.4s. Estimated remaining: 1h 39m 4s. Rate: 7.1 symbols/min [2025-10-15T20:53:53.255976] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:53:53.256176] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-15T20:53:53.256215] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-15T20:53:53.256332] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-15T20:53:53.256375] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-15T20:53:53.256418] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-15T20:53:53.256452] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-15T20:53:53.621294] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:53:53.713975] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-15T20:53:54.514000] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-15T20:53:54.682681] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T20:53:54.942201] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T20:53:54.992239] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-15T20:53:55.314035] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-15T20:53:55.932280] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-15T20:53:56.114005] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-15T20:53:56.662025] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T20:53:56.914036] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-15T20:53:57.714012] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-15T20:53:58.367097] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T20:53:58.514006] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-15T20:53:58.762791] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T20:53:58.950863] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T20:53:59.313998] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-15T20:54:00.110212] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T20:54:00.113949] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-15T20:54:00.665389] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T20:54:00.914020] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-15T20:54:01.671491] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T20:54:01.714007] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-15T20:54:02.514015] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-15T20:54:03.314037] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-15T20:54:03.526323] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T20:54:04.065779] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T20:54:04.083536] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T20:54:04.113957] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-15T20:54:04.914076] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-15T20:54:05.246734] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T20:54:05.713980] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-15T20:54:06.294395] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T20:54:06.514035] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-15T20:54:06.782340] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T20:54:07.314001] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-15T20:54:07.975459] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T20:54:08.113988] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-15T20:54:08.914339] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-15T20:54:08.919883] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T20:54:09.633411] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T20:54:09.713989] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-15T20:54:09.809425] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T20:54:10.514032] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-15T20:54:10.537444] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T20:54:11.314007] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-15T20:54:11.559706] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T20:54:12.113999] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-15T20:54:12.483958] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T20:54:12.914008] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-15T20:54:13.510058] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T20:54:13.714027] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-15T20:54:14.272040] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T20:54:14.513974] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-15T20:54:14.840086] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T20:54:15.314003] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-15T20:54:15.843032] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T20:54:16.114044] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-15T20:54:16.595427] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T20:54:16.913997] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-15T20:54:17.500905] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T20:54:17.714023] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-15T20:54:18.367826] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T20:54:18.424934] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:54:18.426002] [INFO ] [REMOTE ] PFO: Full fetch complete (7902 records). [2025-10-15T20:54:18.426082] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-15T20:54:18.522076] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-15T20:54:18.790985] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-15T20:54:18.791061] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-15T20:54:18.791280] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-15T20:54:18.791319] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-15T20:54:18.791786] [DEBUG] [LOCAL ] PFO: Trimmed 7902 records to 6104 (keeping 200 days of data) [2025-10-15T20:54:18.827708] [DEBUG] [LOCAL ] PFO: Primary data saved (6104 records). [2025-10-15T20:54:18.827804] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-15T20:54:18.827907] [INFO ] [MAIN ] Update Progress: 1665/2369 symbols completed. PFO took 28.3s. Estimated remaining: 1h 39m 2s. Rate: 7.1 symbols/min [2025-10-15T20:54:18.995408] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:54:18.995584] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-15T20:54:18.995671] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-15T20:54:18.995790] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-15T20:54:18.995835] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-15T20:54:18.995876] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-15T20:54:18.995954] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-15T20:54:19.319148] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-15T20:54:19.358375] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:54:20.114022] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-15T20:54:20.303744] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T20:54:20.600334] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T20:54:20.913978] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-15T20:54:21.329492] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T20:54:21.713996] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-15T20:54:22.362026] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T20:54:22.513953] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-15T20:54:22.661014] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T20:54:23.254080] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:54:23.258568] [INFO ] [REMOTE ] PFS: Full fetch complete (51738 records). [2025-10-15T20:54:23.258710] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-15T20:54:23.259384] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:54:23.259487] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:54:23.259530] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:54:23.259568] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-15T20:54:23.259624] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-15T20:54:23.259692] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-15T20:54:23.259750] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-15T20:54:23.259806] [INFO ] [MAIN ] Update Progress: 1666/2369 symbols completed. PFS took 30.2s. Estimated remaining: 1h 38m 52s. Rate: 7.1 symbols/min [2025-10-15T20:54:23.321114] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-15T20:54:23.430740] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:54:23.430898] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-15T20:54:23.430952] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-15T20:54:23.431061] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-15T20:54:23.431103] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-15T20:54:23.431145] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-15T20:54:23.431179] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-15T20:54:23.786846] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:54:24.114037] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-15T20:54:24.913965] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-15T20:54:25.390277] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-15T20:54:25.713986] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-15T20:54:26.058555] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T20:54:26.519173] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-15T20:54:26.532699] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T20:54:27.314086] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-15T20:54:27.546908] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T20:54:27.691137] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T20:54:27.694513] [INFO ] [REMOTE ] PFN: Full fetch complete (31161 records). [2025-10-15T20:54:27.694611] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-15T20:54:28.055961] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-15T20:54:28.056061] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-15T20:54:28.056733] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-15T20:54:28.056807] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-15T20:54:28.057504] [DEBUG] [LOCAL ] PFN: Trimmed 31161 records to 22372 (keeping 200 days of data) [2025-10-15T20:54:28.117462] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-15T20:54:28.192607] [DEBUG] [LOCAL ] PFN: Primary data saved (22372 records). [2025-10-15T20:54:28.192768] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-15T20:54:28.192854] [INFO ] [MAIN ] Update Progress: 1667/2369 symbols completed. PFN took 39.4s. Estimated remaining: 1h 38m 42s. Rate: 7.1 symbols/min [2025-10-15T20:54:28.356400] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:54:28.364701] [DEBUG] [LOCAL ] PGP: Loaded 5720 existing records from primary storage. [2025-10-15T20:54:28.364899] [INFO ] [MAIN ] PGP: Loaded 5720 existing records. [2025-10-15T20:54:28.563012] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:54:28.563228] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-15T20:54:28.563274] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-15T20:54:28.563444] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-15T20:54:28.563499] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-15T20:54:28.917408] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:54:28.914303] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-15T20:54:28.933472] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T20:54:28.939082] [INFO ] [REMOTE ] PFLT: Full fetch complete (63860 records). [2025-10-15T20:54:28.939191] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-15T20:54:28.939940] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:54:28.940029] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:54:28.940071] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:54:28.940128] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-15T20:54:28.940224] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-15T20:54:28.940309] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-15T20:54:28.940410] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-15T20:54:28.940517] [INFO ] [MAIN ] Update Progress: 1668/2369 symbols completed. PFLT took 42.6s. Estimated remaining: 1h 38m 31s. Rate: 7.1 symbols/min [2025-10-15T20:54:29.108110] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:54:29.108275] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-15T20:54:29.108312] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-15T20:54:29.108417] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-15T20:54:29.108457] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-15T20:54:29.108527] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-15T20:54:29.108591] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-15T20:54:29.467795] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:54:29.539750] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T20:54:29.713954] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-15T20:54:29.901291] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T20:54:30.514069] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-15T20:54:31.313985] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-15T20:54:31.813934] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T20:54:32.011393] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T20:54:32.113999] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-15T20:54:32.483064] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T20:54:32.913976] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-15T20:54:33.445412] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T20:54:33.609964] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T20:54:33.714035] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-15T20:54:34.514048] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-15T20:54:35.313992] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-15T20:54:35.957908] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-15T20:54:35.997305] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T20:54:36.014544] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T20:54:36.114075] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-15T20:54:36.914034] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-15T20:54:37.591776] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T20:54:37.719079] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-15T20:54:37.724489] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T20:54:38.514003] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-15T20:54:38.930474] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T20:54:39.314048] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-15T20:54:40.076360] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T20:54:40.113967] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-15T20:54:40.667798] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T20:54:40.825988] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-15T20:54:40.913956] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-15T20:54:41.713984] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-15T20:54:42.370985] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T20:54:42.514015] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-15T20:54:42.962874] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T20:54:43.206000] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-15T20:54:43.314054] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-15T20:54:44.114039] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-15T20:54:44.914046] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-15T20:54:45.150036] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T20:54:45.714012] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-15T20:54:46.132376] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T20:54:46.319852] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-15T20:54:46.405198] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T20:54:46.513997] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-15T20:54:47.313985] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-15T20:54:48.114060] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-15T20:54:48.594164] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T20:54:48.636325] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T20:54:48.837998] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T20:54:48.913958] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-15T20:54:49.714002] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-15T20:54:50.175435] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T20:54:50.406663] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:54:50.408152] [INFO ] [REMOTE ] PGP: Full fetch complete (7897 records). [2025-10-15T20:54:50.408238] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-15T20:54:50.519242] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-15T20:54:50.772069] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-15T20:54:50.772156] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-15T20:54:50.772439] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-15T20:54:50.772478] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-15T20:54:50.772929] [DEBUG] [LOCAL ] PGP: Trimmed 7897 records to 5700 (keeping 200 days of data) [2025-10-15T20:54:50.805990] [DEBUG] [LOCAL ] PGP: Primary data saved (5700 records). [2025-10-15T20:54:50.806092] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-15T20:54:50.806172] [INFO ] [MAIN ] Update Progress: 1669/2369 symbols completed. PGP took 22.6s. Estimated remaining: 1h 38m 28s. Rate: 7.1 symbols/min [2025-10-15T20:54:50.972118] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:54:51.017689] [DEBUG] [LOCAL ] PGRE: Loaded 46956 existing records from primary storage. [2025-10-15T20:54:51.017996] [INFO ] [MAIN ] PGRE: Loaded 46956 existing records. [2025-10-15T20:54:51.192867] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:54:51.193112] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-15T20:54:51.193199] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-15T20:54:51.193861] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-15T20:54:51.193916] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-15T20:54:51.319120] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-15T20:54:51.544993] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:54:52.114020] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-15T20:54:52.843516] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T20:54:52.913958] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-15T20:54:53.611017] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T20:54:53.714067] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-15T20:54:53.819914] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-15T20:54:54.513959] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-15T20:54:54.778792] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T20:54:54.820087] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T20:54:55.313993] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-15T20:54:56.114061] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-15T20:54:56.728789] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-15T20:54:56.793840] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T20:54:56.914016] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-15T20:54:57.714035] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-15T20:54:58.113711] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-15T20:54:58.514076] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-15T20:54:58.722483] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T20:54:58.984425] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T20:54:59.314068] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-15T20:55:00.113967] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-15T20:55:00.314686] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T20:55:00.320725] [INFO ] [REMOTE ] PG: Full fetch complete (77537 records). [2025-10-15T20:55:00.320855] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-15T20:55:00.321690] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:55:00.321783] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:55:00.321826] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:55:00.321864] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-15T20:55:00.321920] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-15T20:55:00.321954] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-15T20:55:00.321992] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-15T20:55:00.322047] [INFO ] [MAIN ] Update Progress: 1670/2369 symbols completed. PG took 37.1s. Estimated remaining: 1h 38m 20s. Rate: 7.1 symbols/min [2025-10-15T20:55:00.490781] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:00.498182] [DEBUG] [LOCAL ] PGZ: Loaded 5516 existing records from primary storage. [2025-10-15T20:55:00.498502] [INFO ] [MAIN ] PGZ: Loaded 5516 existing records. [2025-10-15T20:55:00.675738] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:55:00.676155] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-15T20:55:00.676230] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-15T20:55:00.676445] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-15T20:55:00.676500] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-15T20:55:00.911885] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T20:55:00.922720] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-15T20:55:00.952058] [INFO ] [REMOTE ] PFSI: Full fetch complete (41241 records). [2025-10-15T20:55:00.962670] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-15T20:55:00.993386] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:55:01.071438] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:55:01.104792] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:01.101420] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:55:01.107521] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-15T20:55:01.107794] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-15T20:55:01.119131] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-15T20:55:01.119499] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-15T20:55:01.119595] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-15T20:55:01.119848] [INFO ] [MAIN ] Update Progress: 1671/2369 symbols completed. PFSI took 42.3s. Estimated remaining: 1h 38m 8s. Rate: 7.1 symbols/min [2025-10-15T20:55:01.282930] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:01.283052] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-15T20:55:01.283089] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-15T20:55:01.283192] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-15T20:55:01.283232] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-15T20:55:01.283271] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-15T20:55:01.283301] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-15T20:55:01.625857] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:01.713987] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-15T20:55:02.453582] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T20:55:02.473325] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T20:55:02.514050] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-15T20:55:03.314030] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-15T20:55:04.114054] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-15T20:55:04.317207] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T20:55:04.914141] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-15T20:55:05.066495] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T20:55:05.714023] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-15T20:55:05.731231] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T20:55:05.947775] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T20:55:06.514031] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-15T20:55:07.119282] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T20:55:07.314087] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-15T20:55:08.114042] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-15T20:55:08.335166] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T20:55:08.914016] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-15T20:55:09.000672] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T20:55:09.416975] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T20:55:09.442795] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T20:55:09.448492] [INFO ] [REMOTE ] PGR: Full fetch complete (76328 records). [2025-10-15T20:55:09.448617] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-15T20:55:09.449548] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:55:09.449631] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:55:09.449714] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:55:09.449786] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-15T20:55:09.449852] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-15T20:55:09.449888] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-15T20:55:09.449927] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-15T20:55:09.449982] [INFO ] [MAIN ] Update Progress: 1672/2369 symbols completed. PGR took 40.5s. Estimated remaining: 1h 37m 60s. Rate: 7.1 symbols/min [2025-10-15T20:55:09.615903] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:09.616078] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-15T20:55:09.616115] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-15T20:55:09.616230] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-15T20:55:09.616300] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-15T20:55:09.616374] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-15T20:55:09.616417] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-15T20:55:09.719125] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-15T20:55:09.968788] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:10.514002] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-15T20:55:11.314001] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-15T20:55:11.365112] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T20:55:11.990476] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:55:12.113981] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-15T20:55:12.455281] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T20:55:12.776072] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T20:55:12.914009] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-15T20:55:13.636866] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T20:55:13.713992] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-15T20:55:14.198123] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T20:55:14.514005] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-15T20:55:15.029756] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T20:55:15.313977] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-15T20:55:16.069208] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T20:55:16.113973] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-15T20:55:16.914098] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-15T20:55:17.714025] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-15T20:55:17.964804] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T20:55:18.292405] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T20:55:18.513977] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-15T20:55:18.588302] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T20:55:19.314026] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-15T20:55:19.462220] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T20:55:20.114026] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-15T20:55:20.914017] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-15T20:55:21.106880] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T20:55:21.714024] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-15T20:55:21.929714] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T20:55:22.420872] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T20:55:22.514000] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-15T20:55:23.313986] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-15T20:55:23.531002] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T20:55:24.113997] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-15T20:55:24.217318] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T20:55:24.914000] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-15T20:55:25.020302] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T20:55:25.514379] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T20:55:25.515539] [INFO ] [REMOTE ] PGZ: Full fetch complete (8590 records). [2025-10-15T20:55:25.515607] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-15T20:55:25.724250] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-15T20:55:25.878421] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-15T20:55:25.878605] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-15T20:55:25.878949] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-15T20:55:25.879025] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-15T20:55:25.895148] [DEBUG] [LOCAL ] PGZ: Trimmed 8590 records to 5522 (keeping 200 days of data) [2025-10-15T20:55:25.907016] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T20:55:25.964742] [DEBUG] [LOCAL ] PGZ: Primary data saved (5522 records). [2025-10-15T20:55:25.964894] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-15T20:55:25.964985] [INFO ] [MAIN ] Update Progress: 1673/2369 symbols completed. PGZ took 25.6s. Estimated remaining: 1h 37m 55s. Rate: 7.1 symbols/min [2025-10-15T20:55:26.153472] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:26.170562] [DEBUG] [LOCAL ] PHI: Loaded 15149 existing records from primary storage. [2025-10-15T20:55:26.170817] [INFO ] [MAIN ] PHI: Loaded 15149 existing records. [2025-10-15T20:55:26.345110] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:55:26.345377] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-15T20:55:26.345450] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-15T20:55:26.345765] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-15T20:55:26.345833] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-15T20:55:26.521737] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-15T20:55:26.711285] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:27.313957] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-15T20:55:27.469573] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T20:55:28.118802] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-15T20:55:28.123432] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T20:55:28.845589] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T20:55:28.853511] [INFO ] [REMOTE ] PGRE: Full fetch complete (64382 records). [2025-10-15T20:55:28.853727] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-15T20:55:28.920757] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-15T20:55:29.238537] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-15T20:55:29.238612] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-15T20:55:29.239583] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-15T20:55:29.239662] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-15T20:55:29.240964] [DEBUG] [LOCAL ] PGRE: Trimmed 64382 records to 47027 (keeping 200 days of data) [2025-10-15T20:55:29.502410] [DEBUG] [LOCAL ] PGRE: Primary data saved (47027 records). [2025-10-15T20:55:29.502553] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-15T20:55:29.502660] [INFO ] [MAIN ] Update Progress: 1674/2369 symbols completed. PGRE took 38.7s. Estimated remaining: 1h 37m 44s. Rate: 7.1 symbols/min [2025-10-15T20:55:29.669824] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:29.669989] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-15T20:55:29.670028] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-15T20:55:29.670136] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-15T20:55:29.670178] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-15T20:55:29.670219] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-15T20:55:29.670251] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-15T20:55:29.721384] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-15T20:55:29.961760] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T20:55:30.047936] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:30.076102] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T20:55:30.514064] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-15T20:55:31.313974] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-15T20:55:31.466832] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:55:31.969950] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T20:55:32.113990] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-15T20:55:32.761521] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T20:55:32.913968] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-15T20:55:33.437582] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T20:55:33.714004] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-15T20:55:34.514010] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-15T20:55:34.578263] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T20:55:35.165166] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T20:55:35.314018] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-15T20:55:35.692523] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T20:55:35.945710] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T20:55:35.949263] [INFO ] [REMOTE ] PH: Full fetch complete (55575 records). [2025-10-15T20:55:35.949394] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-15T20:55:35.950093] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:55:35.950182] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:55:35.950225] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:55:35.950265] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-15T20:55:35.950325] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-15T20:55:35.950359] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-15T20:55:35.950398] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-15T20:55:35.950471] [INFO ] [MAIN ] Update Progress: 1675/2369 symbols completed. PH took 34.8s. Estimated remaining: 1h 37m 35s. Rate: 7.1 symbols/min [2025-10-15T20:55:36.119695] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-15T20:55:36.147330] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:36.173510] [DEBUG] [LOCAL ] PHK: Loaded 26724 existing records from primary storage. [2025-10-15T20:55:36.173777] [INFO ] [MAIN ] PHK: Loaded 26724 existing records. [2025-10-15T20:55:36.355346] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:55:36.355553] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-15T20:55:36.355601] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-15T20:55:36.355906] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-15T20:55:36.355964] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-15T20:55:36.709156] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:36.913995] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-15T20:55:37.201136] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T20:55:37.713990] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-15T20:55:38.414067] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T20:55:38.451433] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T20:55:38.514010] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-15T20:55:39.313978] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-15T20:55:40.059434] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T20:55:40.113970] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-15T20:55:40.913988] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-15T20:55:41.051553] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T20:55:41.503777] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T20:55:41.714035] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-15T20:55:41.895799] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T20:55:42.514018] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-15T20:55:43.216024] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T20:55:43.313956] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-15T20:55:43.587286] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T20:55:44.114004] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-15T20:55:44.873923] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T20:55:44.913959] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-15T20:55:45.490752] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T20:55:45.512722] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T20:55:45.517294] [INFO ] [REMOTE ] PHG: Full fetch complete (65291 records). [2025-10-15T20:55:45.517399] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-15T20:55:45.518216] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:55:45.518302] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:55:45.518398] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:55:45.518474] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-15T20:55:45.518539] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-15T20:55:45.518576] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-15T20:55:45.518617] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-15T20:55:45.518704] [INFO ] [MAIN ] Update Progress: 1676/2369 symbols completed. PHG took 36.1s. Estimated remaining: 1h 37m 27s. Rate: 7.1 symbols/min [2025-10-15T20:55:45.685722] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:55:45.685901] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-15T20:55:45.685938] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-15T20:55:45.686043] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-15T20:55:45.686084] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-15T20:55:45.686125] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-15T20:55:45.686157] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-15T20:55:45.719194] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-15T20:55:46.045525] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:55:46.514006] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-15T20:55:47.130454] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T20:55:47.314031] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-15T20:55:47.520945] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T20:55:48.114028] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-15T20:55:48.551222] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T20:55:48.914032] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-15T20:55:49.504729] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T20:55:49.713983] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-15T20:55:50.250284] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T20:55:50.514010] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-15T20:55:50.939961] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T20:55:51.314056] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-15T20:55:51.532094] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T20:55:52.114032] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-15T20:55:52.181963] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T20:55:52.914147] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-15T20:55:53.466153] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T20:55:53.714019] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-15T20:55:53.878218] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T20:55:54.513982] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-15T20:55:55.319206] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-15T20:55:55.336023] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T20:55:55.875439] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T20:55:56.114083] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-15T20:55:56.354940] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T20:55:56.850696] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T20:55:56.854141] [INFO ] [REMOTE ] PHIN: Full fetch complete (47416 records). [2025-10-15T20:55:56.854236] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-15T20:55:56.854792] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:55:56.854874] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:55:56.854916] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:55:56.854954] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-15T20:55:56.855007] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-15T20:55:56.855042] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-15T20:55:56.855080] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-15T20:55:56.855132] [INFO ] [MAIN ] Update Progress: 1677/2369 symbols completed. PHIN took 27.4s. Estimated remaining: 1h 37m 20s. Rate: 7.1 symbols/min [2025-10-15T20:55:56.914002] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-15T20:55:57.713997] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-15T20:55:58.514019] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-15T20:55:58.892068] [DEBUG] [REMOTE ] PHI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-15T20:55:58.902709] [WARN ] [REMOTE ] PHI: No data returned for month 2025-08 [2025-10-15T20:55:58.903101] [FATAL] [REMOTE ] PHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:55:58.904817] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T20:55:58.903806] [FATAL] [MAIN ] PHI: Failed to fetch primary data. [2025-10-15T20:55:58.915284] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:55:58.920998] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-15T20:55:58.930226] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-15T20:55:58.931217] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T20:55:58.930755] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-10-15T20:55:58.937416] [DEBUG] [LOCAL ] PHI: Deleted derivative data file. [2025-10-15T20:55:58.937500] [INFO ] [MAIN ] Update Progress: 1678/2369 symbols completed. PHI took 33.0s. Estimated remaining: 1h 37m 9s. Rate: 7.1 symbols/min [2025-10-15T20:55:59.313997] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-15T20:56:00.113988] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-15T20:56:00.500139] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T20:56:00.914054] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-15T20:56:02.044029] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T20:56:02.054229] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-15T20:56:02.070618] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T20:56:02.514023] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-15T20:56:03.805130] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T20:56:03.812498] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-15T20:56:04.016893] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T20:56:04.113991] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-15T20:56:05.022622] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T20:56:05.026284] [INFO ] [REMOTE ] PHK: Full fetch complete (39300 records). [2025-10-15T20:56:05.026362] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-15T20:56:05.392520] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-15T20:56:05.392594] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-15T20:56:05.393384] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-15T20:56:05.393446] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-15T20:56:05.394245] [DEBUG] [LOCAL ] PHK: Trimmed 39300 records to 26718 (keeping 200 days of data) [2025-10-15T20:56:05.541940] [DEBUG] [LOCAL ] PHK: Primary data saved (26718 records). [2025-10-15T20:56:05.542056] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-15T20:56:05.542131] [INFO ] [MAIN ] Update Progress: 1679/2369 symbols completed. PHK took 29.6s. Estimated remaining: 1h 36m 60s. Rate: 7.1 symbols/min [2025-10-15T20:56:06.063208] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T20:56:06.073987] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-15T20:56:07.979270] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T20:56:07.989859] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-15T20:56:09.774450] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T20:56:09.784713] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-15T20:56:11.776026] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T20:56:11.787527] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-15T20:56:13.706171] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T20:56:13.717164] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-15T20:56:15.607474] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T20:56:15.618493] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-15T20:56:16.406445] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:56:16.412160] [INFO ] [REMOTE ] PHM: Full fetch complete (74743 records). [2025-10-15T20:56:16.412285] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-15T20:56:16.413097] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:56:16.413205] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:56:16.413248] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:56:16.413287] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-15T20:56:16.413342] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-15T20:56:16.413377] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-15T20:56:16.413417] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-15T20:56:16.413471] [INFO ] [MAIN ] Update Progress: 1680/2369 symbols completed. PHM took 30.9s. Estimated remaining: 1h 36m 52s. Rate: 7.1 symbols/min [2025-10-15T20:56:17.040051] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:17.143442] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:17.151737] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:17.168003] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-15T20:56:17.168267] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-15T20:56:17.170477] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-15T20:56:17.170269] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:17.171008] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-15T20:56:17.170849] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-15T20:56:17.171597] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-15T20:56:17.171507] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-15T20:56:17.171691] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-15T20:56:17.171965] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-15T20:56:17.175956] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-15T20:56:17.199799] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-15T20:56:17.199970] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-15T20:56:17.254912] [DEBUG] [LOCAL ] PIM: Loaded 4836 existing records from primary storage. [2025-10-15T20:56:17.326305] [DEBUG] [LOCAL ] PINE: Loaded 14382 existing records from primary storage. [2025-10-15T20:56:17.360096] [INFO ] [MAIN ] PIM: Loaded 4836 existing records. [2025-10-15T20:56:17.380900] [INFO ] [MAIN ] PINE: Loaded 14382 existing records. [2025-10-15T20:56:18.166297] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:56:18.180407] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-15T20:56:18.169806] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:56:18.196309] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-15T20:56:18.211728] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-15T20:56:18.283304] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-15T20:56:18.300801] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-15T20:56:18.309230] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:18.309923] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-15T20:56:18.310254] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-15T20:56:18.347764] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-15T20:56:18.362479] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-15T20:56:18.371327] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:18.371693] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-15T20:56:19.035906] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:19.032631] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:19.036214] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-15T20:56:19.037355] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-15T20:56:19.587041] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T20:56:19.588790] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-15T20:56:19.916982] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T20:56:19.923952] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-15T20:56:20.187544] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T20:56:20.196863] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-15T20:56:20.233229] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T20:56:20.237027] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-15T20:56:20.240924] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T20:56:20.242229] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-15T20:56:20.918539] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T20:56:20.919986] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-15T20:56:21.145151] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T20:56:21.152167] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-15T20:56:21.282467] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T20:56:21.286292] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-15T20:56:21.725265] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T20:56:21.727095] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-15T20:56:21.909554] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T20:56:21.919674] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-15T20:56:22.036234] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T20:56:22.043236] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-15T20:56:22.305300] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T20:56:22.308864] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-15T20:56:22.373930] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T20:56:22.514016] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-15T20:56:23.123904] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T20:56:23.243902] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T20:56:23.314016] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-15T20:56:23.494234] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T20:56:23.526944] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T20:56:24.113975] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-15T20:56:24.464815] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T20:56:24.725011] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T20:56:24.913990] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-15T20:56:25.714001] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-15T20:56:26.513981] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-15T20:56:26.699104] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T20:56:26.718492] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T20:56:27.314004] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-15T20:56:27.964300] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T20:56:28.113969] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-15T20:56:28.914016] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-15T20:56:29.182829] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T20:56:29.417995] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T20:56:29.518793] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T20:56:29.714005] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-15T20:56:30.514006] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-15T20:56:31.314010] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-15T20:56:31.642303] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T20:56:31.934040] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T20:56:32.113970] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-15T20:56:32.343288] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T20:56:32.913994] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-15T20:56:33.558139] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T20:56:33.586346] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T20:56:33.713986] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-15T20:56:34.514043] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-15T20:56:35.069597] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T20:56:35.319075] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-15T20:56:35.333747] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T20:56:35.882977] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:56:35.884024] [INFO ] [REMOTE ] PIM: Full fetch complete (6469 records). [2025-10-15T20:56:35.884099] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-15T20:56:36.119105] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-15T20:56:36.247174] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-15T20:56:36.247250] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-15T20:56:36.247442] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-15T20:56:36.247484] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-15T20:56:36.247892] [DEBUG] [LOCAL ] PIM: Trimmed 6469 records to 4822 (keeping 200 days of data) [2025-10-15T20:56:36.275424] [DEBUG] [LOCAL ] PIM: Primary data saved (4822 records). [2025-10-15T20:56:36.275499] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-15T20:56:36.275571] [INFO ] [MAIN ] Update Progress: 1681/2369 symbols completed. PIM took 19.9s. Estimated remaining: 1h 36m 48s. Rate: 7.1 symbols/min [2025-10-15T20:56:36.444826] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:36.445004] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-15T20:56:36.445044] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-15T20:56:36.445154] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-15T20:56:36.445198] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-15T20:56:36.445242] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-15T20:56:36.445278] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-15T20:56:36.843793] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:36.913985] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-15T20:56:37.713964] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-15T20:56:37.886114] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T20:56:38.514022] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-15T20:56:38.970973] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T20:56:39.219407] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T20:56:39.224400] [INFO ] [REMOTE ] PHR: Full fetch complete (53006 records). [2025-10-15T20:56:39.224497] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-15T20:56:39.225096] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:56:39.225194] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:56:39.225282] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:56:39.225368] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-15T20:56:39.225444] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-15T20:56:39.225484] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-15T20:56:39.225527] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-15T20:56:39.225585] [INFO ] [MAIN ] Update Progress: 1682/2369 symbols completed. PHR took 22.8s. Estimated remaining: 1h 36m 38s. Rate: 7.1 symbols/min [2025-10-15T20:56:39.319803] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-15T20:56:39.396732] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:39.396999] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-15T20:56:39.397119] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-15T20:56:39.397270] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-15T20:56:39.397393] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-15T20:56:39.397527] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-15T20:56:39.397581] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-15T20:56:39.756769] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T20:56:39.802380] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:40.113998] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-15T20:56:40.914016] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-15T20:56:41.023933] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T20:56:41.212992] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-15T20:56:41.714035] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-15T20:56:42.471906] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T20:56:42.513963] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-15T20:56:42.591489] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T20:56:43.314026] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-15T20:56:43.490384] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T20:56:44.114025] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-15T20:56:44.914041] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-15T20:56:45.211215] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T20:56:45.292270] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-15T20:56:45.714034] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-15T20:56:46.064254] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T20:56:46.514038] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-15T20:56:47.313971] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-15T20:56:47.467884] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:56:48.114057] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-15T20:56:48.166536] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T20:56:48.549876] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T20:56:48.914000] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-15T20:56:49.714054] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-15T20:56:49.834821] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T20:56:50.485049] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T20:56:50.513956] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-15T20:56:51.090267] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T20:56:51.313990] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-15T20:56:51.617918] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T20:56:51.620430] [INFO ] [REMOTE ] PINE: Full fetch complete (21149 records). [2025-10-15T20:56:51.620524] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-15T20:56:51.994464] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-15T20:56:51.994557] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-15T20:56:51.995032] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-15T20:56:51.995097] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-15T20:56:51.996517] [DEBUG] [LOCAL ] PINE: Trimmed 21149 records to 14395 (keeping 200 days of data) [2025-10-15T20:56:52.082212] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T20:56:52.094773] [INFO ] [REMOTE ] PII: Full fetch complete (70993 records). [2025-10-15T20:56:52.099707] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-15T20:56:52.104327] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:56:52.104455] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:56:52.110346] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:56:52.113153] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-15T20:56:52.114685] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-15T20:56:52.118404] [DEBUG] [LOCAL ] PINE: Primary data saved (14395 records). [2025-10-15T20:56:52.118589] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-15T20:56:52.119737] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-15T20:56:52.119850] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-15T20:56:52.120125] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-15T20:56:52.120023] [INFO ] [MAIN ] Update Progress: 1683/2369 symbols completed. PII took 35.7s. Estimated remaining: 1h 36m 31s. Rate: 7.1 symbols/min [2025-10-15T20:56:52.120800] [INFO ] [MAIN ] Update Progress: 1684/2369 symbols completed. PINE took 35.7s. Estimated remaining: 1h 36m 19s. Rate: 7.1 symbols/min [2025-10-15T20:56:52.495985] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:52.523872] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:52.524480] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-15T20:56:52.524315] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-15T20:56:52.524668] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-15T20:56:52.524801] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-15T20:56:52.525154] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-15T20:56:52.525256] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-15T20:56:52.525458] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-15T20:56:52.525544] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-15T20:56:52.525375] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-15T20:56:52.562174] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-15T20:56:52.603241] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-15T20:56:52.610202] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-15T20:56:52.940215] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-15T20:56:53.216147] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:53.295370] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:56:53.328541] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T20:56:53.714082] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-15T20:56:54.514002] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-15T20:56:54.839590] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T20:56:55.061557] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-15T20:56:55.314020] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-15T20:56:55.642856] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T20:56:56.012099] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T20:56:56.113996] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-15T20:56:56.913998] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-15T20:56:57.393993] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T20:56:57.713996] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-15T20:56:58.513968] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-15T20:56:58.919900] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T20:56:59.283772] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T20:56:59.313949] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-15T20:56:59.417407] [DEBUG] [REMOTE ] PJT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-15T20:56:59.417918] [WARN ] [REMOTE ] PJT: No data returned for month 2025-03 [2025-10-15T20:56:59.418018] [FATAL] [REMOTE ] PJT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:56:59.418161] [FATAL] [MAIN ] PJT: Failed to fetch primary data. [2025-10-15T20:56:59.418251] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:56:59.418334] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-15T20:56:59.418407] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-15T20:56:59.418445] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-15T20:56:59.418485] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-15T20:56:59.418536] [INFO ] [MAIN ] Update Progress: 1685/2369 symbols completed. PJT took 7.3s. Estimated remaining: 1h 36m 10s. Rate: 7.1 symbols/min [2025-10-15T20:56:59.627746] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:56:59.645975] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T20:56:59.677722] [DEBUG] [LOCAL ] PKE: Loaded 14005 existing records from primary storage. [2025-10-15T20:56:59.678117] [INFO ] [MAIN ] PKE: Loaded 14005 existing records. [2025-10-15T20:56:59.891557] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:56:59.891935] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-15T20:56:59.891992] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-15T20:56:59.892298] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-15T20:56:59.892359] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-15T20:57:00.123215] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-15T20:57:00.296388] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:00.914023] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-15T20:57:01.714079] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-15T20:57:01.897323] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T20:57:02.317952] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-15T20:57:02.513970] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-15T20:57:02.607262] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T20:57:03.314027] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-15T20:57:04.114079] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-15T20:57:04.297729] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T20:57:04.663506] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T20:57:04.914019] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-15T20:57:05.707295] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T20:57:05.718180] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-15T20:57:05.884987] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T20:57:06.514018] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-15T20:57:07.313973] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-15T20:57:07.384225] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T20:57:07.780140] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T20:57:08.114034] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-15T20:57:08.205224] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T20:57:08.874461] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T20:57:08.880903] [INFO ] [REMOTE ] PINS: Full fetch complete (77481 records). [2025-10-15T20:57:08.881044] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-15T20:57:08.882021] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:57:08.882117] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:57:08.882162] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:57:08.882231] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-15T20:57:08.882297] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-15T20:57:08.882355] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-15T20:57:08.882403] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-15T20:57:08.882479] [INFO ] [MAIN ] Update Progress: 1686/2369 symbols completed. PINS took 32.6s. Estimated remaining: 1h 36m 2s. Rate: 7.1 symbols/min [2025-10-15T20:57:08.919163] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-15T20:57:09.055845] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:57:09.056040] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-15T20:57:09.056077] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-15T20:57:09.056185] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-15T20:57:09.056225] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-15T20:57:09.056311] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-15T20:57:09.056351] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-15T20:57:09.395928] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:09.713991] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-15T20:57:10.293380] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T20:57:10.295406] [INFO ] [REMOTE ] PIPR: Full fetch complete (20708 records). [2025-10-15T20:57:10.295475] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-15T20:57:10.295922] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:57:10.296001] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:57:10.296043] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:57:10.296082] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-15T20:57:10.296179] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-15T20:57:10.296239] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-15T20:57:10.296294] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-15T20:57:10.296361] [INFO ] [MAIN ] Update Progress: 1687/2369 symbols completed. PIPR took 31.1s. Estimated remaining: 1h 35m 51s. Rate: 7.1 symbols/min [2025-10-15T20:57:10.472918] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:57:10.473123] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-15T20:57:10.473165] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-15T20:57:10.473286] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-15T20:57:10.473338] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-15T20:57:10.473381] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-15T20:57:10.473421] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-15T20:57:10.519109] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-15T20:57:10.880139] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-15T20:57:10.884801] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:11.314016] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-15T20:57:11.412702] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T20:57:12.114056] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-15T20:57:12.855032] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T20:57:12.913981] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-15T20:57:13.714006] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-15T20:57:14.010933] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T20:57:14.076184] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T20:57:14.514037] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-15T20:57:15.314063] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-15T20:57:15.364134] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T20:57:15.435860] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T20:57:16.113984] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-15T20:57:16.191130] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T20:57:16.914013] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-15T20:57:17.058464] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T20:57:17.714011] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-15T20:57:18.352621] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T20:57:18.514016] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-15T20:57:18.908224] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T20:57:19.314026] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-15T20:57:20.113999] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-15T20:57:20.172628] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T20:57:20.913979] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-15T20:57:21.192561] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T20:57:21.276137] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T20:57:21.713991] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-15T20:57:22.514540] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-15T20:57:22.518561] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T20:57:22.521995] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T20:57:23.314043] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-15T20:57:23.595006] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T20:57:24.114056] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-15T20:57:24.913980] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-15T20:57:24.983066] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T20:57:25.038906] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T20:57:25.714047] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-15T20:57:25.961298] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T20:57:26.514024] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-15T20:57:27.314001] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-15T20:57:27.519630] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:57:28.033633] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T20:57:28.054711] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T20:57:28.114006] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-15T20:57:28.914017] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-15T20:57:29.714000] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-15T20:57:29.875239] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T20:57:30.055166] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T20:57:30.513977] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-15T20:57:30.702255] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T20:57:31.314025] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-15T20:57:31.736907] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T20:57:32.113974] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-15T20:57:32.158447] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T20:57:32.877327] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T20:57:32.913992] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-15T20:57:33.713964] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-15T20:57:33.935755] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T20:57:34.514037] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-15T20:57:35.256226] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T20:57:35.313999] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-15T20:57:35.874170] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T20:57:35.876670] [INFO ] [REMOTE ] PKST: Full fetch complete (28961 records). [2025-10-15T20:57:35.876748] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-15T20:57:35.877329] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:57:35.877413] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:57:35.877456] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:57:35.877536] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-15T20:57:35.877614] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-15T20:57:35.877676] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-15T20:57:35.877738] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-15T20:57:35.877807] [INFO ] [MAIN ] Update Progress: 1688/2369 symbols completed. PKST took 25.6s. Estimated remaining: 1h 35m 50s. Rate: 7.1 symbols/min [2025-10-15T20:57:36.044738] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:57:36.044992] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-15T20:57:36.045064] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-15T20:57:36.045201] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-15T20:57:36.045314] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-15T20:57:36.045370] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-15T20:57:36.045404] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-15T20:57:36.119100] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-15T20:57:36.431087] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:36.460729] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T20:57:36.913989] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-15T20:57:37.669547] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T20:57:37.714072] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-15T20:57:38.417312] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T20:57:38.422755] [INFO ] [REMOTE ] PKG: Full fetch complete (57352 records). [2025-10-15T20:57:38.422919] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-15T20:57:38.423674] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:57:38.423772] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:57:38.423826] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:57:38.423902] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-15T20:57:38.424007] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-15T20:57:38.424058] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-15T20:57:38.424102] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-15T20:57:38.424163] [INFO ] [MAIN ] Update Progress: 1689/2369 symbols completed. PKG took 29.5s. Estimated remaining: 1h 35m 39s. Rate: 7.1 symbols/min [2025-10-15T20:57:38.519248] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-15T20:57:38.650710] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:57:38.651051] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-15T20:57:38.651145] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-15T20:57:38.651478] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-15T20:57:38.651624] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-15T20:57:38.651735] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-15T20:57:38.651951] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-15T20:57:38.985351] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-15T20:57:39.076032] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:39.314015] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-15T20:57:39.625589] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T20:57:39.628928] [INFO ] [REMOTE ] PKE: Full fetch complete (18176 records). [2025-10-15T20:57:39.629019] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-15T20:57:40.007385] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-15T20:57:40.007503] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-15T20:57:40.008434] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-15T20:57:40.008502] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-15T20:57:40.009260] [DEBUG] [LOCAL ] PKE: Trimmed 18176 records to 14099 (keeping 200 days of data) [2025-10-15T20:57:40.103221] [DEBUG] [LOCAL ] PKE: Primary data saved (14099 records). [2025-10-15T20:57:40.103451] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-15T20:57:40.103559] [INFO ] [MAIN ] Update Progress: 1690/2369 symbols completed. PKE took 40.7s. Estimated remaining: 1h 35m 28s. Rate: 7.1 symbols/min [2025-10-15T20:57:40.119110] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-15T20:57:40.278541] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:57:40.278797] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-15T20:57:40.278842] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-15T20:57:40.279046] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-15T20:57:40.279146] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-15T20:57:40.279206] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-15T20:57:40.279242] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-15T20:57:40.643312] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:40.914017] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-15T20:57:41.014363] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T20:57:41.714027] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-15T20:57:41.841557] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T20:57:42.514010] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-15T20:57:43.050056] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T20:57:43.313976] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-15T20:57:43.740089] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T20:57:43.800404] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-15T20:57:44.114051] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-15T20:57:44.805456] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:57:44.811337] [INFO ] [REMOTE ] PK: Full fetch complete (76189 records). [2025-10-15T20:57:44.811463] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-15T20:57:44.812348] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:57:44.812440] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:57:44.812482] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:57:44.812544] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-15T20:57:44.812606] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-15T20:57:44.812664] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-15T20:57:44.812730] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-15T20:57:44.812792] [INFO ] [MAIN ] Update Progress: 1691/2369 symbols completed. PK took 52.7s. Estimated remaining: 1h 35m 18s. Rate: 7.1 symbols/min [2025-10-15T20:57:44.919083] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-15T20:57:44.980059] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:57:44.980333] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-15T20:57:44.980431] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-15T20:57:44.980635] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-15T20:57:44.980712] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-15T20:57:44.980761] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-15T20:57:44.980794] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-15T20:57:45.332551] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:57:45.380792] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-15T20:57:45.714108] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-15T20:57:46.513969] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-15T20:57:46.879159] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T20:57:47.314032] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-15T20:57:47.897534] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-15T20:57:48.113978] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-15T20:57:48.161839] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T20:57:48.913969] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-15T20:57:49.083547] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T20:57:49.140895] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T20:57:49.713999] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-15T20:57:50.409893] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T20:57:50.513954] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-15T20:57:51.313955] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-15T20:57:51.646277] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T20:57:52.114009] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-15T20:57:52.441847] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T20:57:52.810993] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T20:57:52.914005] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-15T20:57:53.714045] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-15T20:57:54.207819] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-15T20:57:54.441921] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T20:57:54.514000] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-15T20:57:55.313964] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-15T20:57:55.394373] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T20:57:56.114017] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-15T20:57:56.641327] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-15T20:57:56.914013] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-15T20:57:57.048978] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T20:57:57.634244] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T20:57:57.713973] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-15T20:57:58.514001] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-15T20:57:59.263119] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-15T20:57:59.313955] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-15T20:57:59.645999] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-15T20:57:59.823056] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T20:58:00.113989] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-15T20:58:00.913991] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-15T20:58:01.054354] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T20:58:01.368529] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T20:58:01.714055] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-15T20:58:02.514056] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-15T20:58:02.960703] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T20:58:03.072164] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T20:58:03.314095] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-15T20:58:04.114061] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-15T20:58:04.914055] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-15T20:58:05.055308] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-15T20:58:05.126464] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T20:58:05.151145] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T20:58:05.714066] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-15T20:58:06.513987] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-15T20:58:07.011877] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T20:58:07.313972] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-15T20:58:07.529220] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T20:58:08.114044] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-15T20:58:08.848436] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T20:58:08.879425] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-15T20:58:08.918402] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-15T20:58:08.921525] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T20:58:09.714016] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-15T20:58:10.466053] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T20:58:10.514010] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-15T20:58:11.242251] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T20:58:11.248142] [INFO ] [REMOTE ] PLD: Full fetch complete (77124 records). [2025-10-15T20:58:11.248289] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-15T20:58:11.249204] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:58:11.249293] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:58:11.249339] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:58:11.249380] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-15T20:58:11.249438] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-15T20:58:11.249474] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-15T20:58:11.249515] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-15T20:58:11.249572] [INFO ] [MAIN ] Update Progress: 1692/2369 symbols completed. PLD took 31.1s. Estimated remaining: 1h 35m 16s. Rate: 7.1 symbols/min [2025-10-15T20:58:11.321874] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-15T20:58:11.416521] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:11.416705] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-15T20:58:11.416754] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-15T20:58:11.416862] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-15T20:58:11.416903] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-15T20:58:11.416944] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-15T20:58:11.416975] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-15T20:58:11.763834] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:12.000318] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T20:58:12.113973] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-15T20:58:12.676116] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T20:58:12.914025] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-15T20:58:12.938446] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T20:58:12.945143] [INFO ] [REMOTE ] PL: Full fetch complete (76707 records). [2025-10-15T20:58:12.945293] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-15T20:58:12.946206] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:58:12.946345] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:58:12.946418] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:58:12.946469] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-15T20:58:12.946541] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-15T20:58:12.946597] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-15T20:58:12.946666] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-15T20:58:12.946763] [INFO ] [MAIN ] Update Progress: 1693/2369 symbols completed. PL took 34.5s. Estimated remaining: 1h 35m 5s. Rate: 7.1 symbols/min [2025-10-15T20:58:13.128665] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:13.128841] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-15T20:58:13.128878] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-15T20:58:13.128986] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-15T20:58:13.129026] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-15T20:58:13.129066] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-15T20:58:13.129096] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-15T20:58:13.472149] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:13.524178] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T20:58:13.526868] [INFO ] [REMOTE ] PKX: Full fetch complete (36225 records). [2025-10-15T20:58:13.526968] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-15T20:58:13.527554] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:58:13.527668] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:58:13.527727] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:58:13.527792] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-15T20:58:13.527856] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-15T20:58:13.527893] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-15T20:58:13.527930] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-15T20:58:13.527985] [INFO ] [MAIN ] Update Progress: 1694/2369 symbols completed. PKX took 37.7s. Estimated remaining: 1h 34m 54s. Rate: 7.1 symbols/min [2025-10-15T20:58:13.693133] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:13.693344] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-15T20:58:13.693405] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-15T20:58:13.693515] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-15T20:58:13.693556] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-15T20:58:13.693596] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-15T20:58:13.693631] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-15T20:58:13.722805] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-15T20:58:14.043538] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:14.514041] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-15T20:58:15.203241] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T20:58:15.314047] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-15T20:58:16.114054] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-15T20:58:16.562761] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T20:58:16.617039] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T20:58:16.851403] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T20:58:16.913997] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-15T20:58:17.630859] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T20:58:17.636346] [INFO ] [REMOTE ] PLNT: Full fetch complete (70341 records). [2025-10-15T20:58:17.636483] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-15T20:58:17.637308] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:58:17.637400] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:58:17.637443] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:58:17.637481] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-15T20:58:17.637534] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-15T20:58:17.637567] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-15T20:58:17.637605] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-15T20:58:17.637682] [INFO ] [MAIN ] Update Progress: 1695/2369 symbols completed. PLNT took 32.8s. Estimated remaining: 1h 34m 44s. Rate: 7.1 symbols/min [2025-10-15T20:58:17.719117] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-15T20:58:17.812465] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:17.833453] [DEBUG] [LOCAL ] PML: Loaded 21722 existing records from primary storage. [2025-10-15T20:58:17.833720] [INFO ] [MAIN ] PML: Loaded 21722 existing records. [2025-10-15T20:58:18.013607] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:58:18.013859] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-15T20:58:18.013907] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-15T20:58:18.014193] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-15T20:58:18.014249] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-15T20:58:18.369355] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:18.513961] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-15T20:58:19.313977] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-15T20:58:19.738867] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T20:58:19.782436] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T20:58:20.114028] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-15T20:58:20.602631] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T20:58:20.913970] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-15T20:58:21.714069] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-15T20:58:22.116592] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T20:58:22.189576] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T20:58:22.513985] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-15T20:58:23.111855] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T20:58:23.314026] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-15T20:58:24.113955] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-15T20:58:24.291033] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T20:58:24.592790] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T20:58:24.914005] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-15T20:58:24.968505] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T20:58:25.714001] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-15T20:58:26.513983] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-15T20:58:26.779507] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T20:58:27.085723] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-15T20:58:27.313957] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-15T20:58:27.696980] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T20:58:28.114025] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-15T20:58:28.897033] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T20:58:28.913948] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-15T20:58:29.147041] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T20:58:29.714020] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-15T20:58:29.998186] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T20:58:30.513998] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-15T20:58:30.817324] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T20:58:31.313965] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-15T20:58:31.513485] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T20:58:32.114006] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-15T20:58:32.689010] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T20:58:32.914023] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-15T20:58:33.713988] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-15T20:58:34.130203] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-15T20:58:34.173884] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T20:58:34.513975] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-15T20:58:34.928179] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T20:58:35.313967] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-15T20:58:35.332893] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T20:58:36.113962] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-15T20:58:36.491221] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T20:58:36.914055] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-15T20:58:37.461240] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T20:58:37.713975] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-15T20:58:38.513994] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-15T20:58:39.068177] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T20:58:39.233911] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-15T20:58:39.314019] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-15T20:58:39.721519] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T20:58:40.114004] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-15T20:58:40.914023] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-15T20:58:41.434591] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T20:58:41.623062] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T20:58:41.713963] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-15T20:58:42.191332] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T20:58:42.513995] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-15T20:58:43.314055] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-15T20:58:43.763175] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T20:58:43.791505] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T20:58:44.114016] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-15T20:58:44.418393] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T20:58:44.421825] [INFO ] [REMOTE ] PML: Full fetch complete (29690 records). [2025-10-15T20:58:44.421943] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-15T20:58:44.787029] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-15T20:58:44.787123] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-15T20:58:44.787924] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-15T20:58:44.787989] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-15T20:58:44.789018] [DEBUG] [LOCAL ] PML: Trimmed 29690 records to 21800 (keeping 200 days of data) [2025-10-15T20:58:44.918398] [DEBUG] [LOCAL ] PML: Primary data saved (21800 records). [2025-10-15T20:58:44.918701] [INFO ] [MAIN ] PML: Full history saved. [2025-10-15T20:58:44.919103] [INFO ] [MAIN ] Update Progress: 1696/2369 symbols completed. PML took 27.3s. Estimated remaining: 1h 34m 43s. Rate: 7.1 symbols/min [2025-10-15T20:58:44.918871] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-15T20:58:45.099302] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:45.111116] [DEBUG] [LOCAL ] PMM: Loaded 10205 existing records from primary storage. [2025-10-15T20:58:45.111345] [INFO ] [MAIN ] PMM: Loaded 10205 existing records. [2025-10-15T20:58:45.233590] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T20:58:45.333591] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:58:45.333837] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-15T20:58:45.333906] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-15T20:58:45.334081] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-15T20:58:45.334136] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-15T20:58:45.692128] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:45.709559] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T20:58:45.714887] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-15T20:58:45.716556] [INFO ] [REMOTE ] PM: Full fetch complete (77442 records). [2025-10-15T20:58:45.716674] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-15T20:58:45.717737] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:58:45.717819] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:58:45.718107] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:58:45.718180] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-15T20:58:45.718243] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-15T20:58:45.718279] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-15T20:58:45.718317] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-15T20:58:45.718372] [INFO ] [MAIN ] Update Progress: 1697/2369 symbols completed. PM took 32.2s. Estimated remaining: 1h 34m 31s. Rate: 7.1 symbols/min [2025-10-15T20:58:45.898992] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:45.912870] [DEBUG] [LOCAL ] PMO: Loaded 9904 existing records from primary storage. [2025-10-15T20:58:45.913156] [INFO ] [MAIN ] PMO: Loaded 9904 existing records. [2025-10-15T20:58:46.186787] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:58:46.187089] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-15T20:58:46.187155] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-15T20:58:46.187402] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-15T20:58:46.187476] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-15T20:58:46.519224] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-15T20:58:46.720910] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:47.238791] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T20:58:47.314042] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-15T20:58:47.556425] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T20:58:48.113994] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-15T20:58:48.419159] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T20:58:48.914002] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-15T20:58:49.132215] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T20:58:49.713983] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-15T20:58:49.742984] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T20:58:50.513970] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-15T20:58:50.744370] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T20:58:51.313981] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-15T20:58:51.384434] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T20:58:52.113975] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-15T20:58:52.261781] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T20:58:52.913994] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-15T20:58:53.078734] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T20:58:53.434033] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T20:58:53.437045] [INFO ] [REMOTE ] PLOW: Full fetch complete (28389 records). [2025-10-15T20:58:53.437274] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-15T20:58:53.438005] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:58:53.438119] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:58:53.438164] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:58:53.438242] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-15T20:58:53.438334] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-15T20:58:53.438383] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-15T20:58:53.438436] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-15T20:58:53.438514] [INFO ] [MAIN ] Update Progress: 1698/2369 symbols completed. PLOW took 42.2s. Estimated remaining: 1h 34m 22s. Rate: 7.1 symbols/min [2025-10-15T20:58:53.631813] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:58:53.632097] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-15T20:58:53.632136] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-15T20:58:53.632289] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-15T20:58:53.632360] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-15T20:58:53.632426] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-15T20:58:53.632464] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-15T20:58:53.719115] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-15T20:58:54.021773] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:58:54.514057] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-15T20:58:54.781268] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T20:58:55.314082] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-15T20:58:56.114116] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-15T20:58:56.294404] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T20:58:56.321808] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T20:58:56.914030] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-15T20:58:56.968464] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T20:58:57.714051] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-15T20:58:58.412089] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T20:58:58.514063] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-15T20:58:59.167786] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T20:58:59.313999] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-15T20:59:00.000425] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T20:59:00.114022] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-15T20:59:00.913991] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-15T20:59:01.012695] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T20:59:01.713973] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-15T20:59:01.832808] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T20:59:01.849255] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T20:59:02.514010] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-15T20:59:03.314081] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-15T20:59:03.321702] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T20:59:03.370442] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T20:59:04.114053] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-15T20:59:04.913961] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-15T20:59:04.935504] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T20:59:05.154322] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T20:59:05.588053] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T20:59:05.592718] [INFO ] [REMOTE ] PLYM: Full fetch complete (47433 records). [2025-10-15T20:59:05.592813] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-15T20:59:05.593443] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:59:05.593548] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:59:05.593590] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:59:05.593628] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-15T20:59:05.593721] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-15T20:59:05.593765] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-15T20:59:05.593806] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-15T20:59:05.593862] [INFO ] [MAIN ] Update Progress: 1699/2369 symbols completed. PLYM took 52.6s. Estimated remaining: 1h 34m 15s. Rate: 7.1 symbols/min [2025-10-15T20:59:05.719185] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-15T20:59:05.772057] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:05.772367] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-15T20:59:05.772412] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-15T20:59:05.772521] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-15T20:59:05.772563] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-15T20:59:05.772604] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-15T20:59:05.772636] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-15T20:59:06.115514] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:06.514032] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-15T20:59:06.675404] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T20:59:06.929931] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T20:59:07.313999] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-15T20:59:07.724942] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T20:59:08.114014] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-15T20:59:08.823298] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T20:59:08.914056] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-15T20:59:09.419400] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T20:59:09.714005] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-15T20:59:10.109486] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-15T20:59:10.514000] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-15T20:59:10.982863] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T20:59:11.314001] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-15T20:59:12.113990] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-15T20:59:12.234997] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T20:59:12.898434] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T20:59:12.913959] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-15T20:59:13.714037] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-15T20:59:13.723241] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T20:59:14.514028] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-15T20:59:15.077548] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T20:59:15.132391] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T20:59:15.314004] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-15T20:59:16.114002] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-15T20:59:16.779269] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T20:59:16.913985] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-15T20:59:16.932101] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T20:59:17.713995] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-15T20:59:18.159726] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T20:59:18.513978] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-15T20:59:18.726612] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T20:59:18.931799] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T20:59:19.314000] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-15T20:59:19.735804] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T20:59:20.114022] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-15T20:59:20.914045] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-15T20:59:21.039585] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T20:59:21.455628] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T20:59:21.457014] [INFO ] [REMOTE ] PMO: Full fetch complete (16390 records). [2025-10-15T20:59:21.457093] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-15T20:59:21.719128] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-15T20:59:21.822510] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-15T20:59:21.822596] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-15T20:59:21.823213] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-15T20:59:21.823277] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-15T20:59:21.824161] [DEBUG] [LOCAL ] PMO: Trimmed 16390 records to 9887 (keeping 200 days of data) [2025-10-15T20:59:21.887175] [DEBUG] [LOCAL ] PMO: Primary data saved (9887 records). [2025-10-15T20:59:21.887323] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-15T20:59:21.887425] [INFO ] [MAIN ] Update Progress: 1700/2369 symbols completed. PMO took 36.2s. Estimated remaining: 1h 34m 10s. Rate: 7.1 symbols/min [2025-10-15T20:59:22.058330] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:22.058554] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-15T20:59:22.058610] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-15T20:59:22.058744] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-15T20:59:22.058789] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-15T20:59:22.058833] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-15T20:59:22.058866] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-15T20:59:22.163700] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T20:59:22.416161] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:22.513960] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-15T20:59:22.776149] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:59:22.776481] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-15T20:59:22.776568] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:59:22.776619] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-15T20:59:22.776715] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:59:22.776802] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-15T20:59:22.776905] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-15T20:59:22.776967] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-15T20:59:22.777047] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-15T20:59:22.777160] [INFO ] [MAIN ] Update Progress: 1701/2369 symbols completed. PMTV took 0.9s. Estimated remaining: 1h 33m 59s. Rate: 7.1 symbols/min [2025-10-15T20:59:22.949688] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:22.949893] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-15T20:59:22.949931] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-15T20:59:22.950041] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-15T20:59:22.950081] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-15T20:59:22.950120] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-15T20:59:22.950150] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-15T20:59:23.300741] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:23.313993] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-15T20:59:23.609310] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T20:59:23.609629] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-15T20:59:23.609761] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T20:59:23.609857] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-15T20:59:23.609939] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T20:59:23.610032] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-15T20:59:23.610113] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-15T20:59:23.610150] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-15T20:59:23.610189] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-15T20:59:23.610235] [INFO ] [MAIN ] Update Progress: 1702/2369 symbols completed. PMTW took 0.8s. Estimated remaining: 1h 33m 47s. Rate: 7.1 symbols/min [2025-10-15T20:59:23.781596] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:23.781809] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-15T20:59:23.781850] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-15T20:59:23.781983] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-15T20:59:23.782087] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-15T20:59:23.782147] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-15T20:59:23.782182] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-15T20:59:24.118102] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-15T20:59:24.146586] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:24.524379] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T20:59:24.525173] [INFO ] [REMOTE ] PMTU: Full fetch complete (1205 records). [2025-10-15T20:59:24.525245] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-15T20:59:24.728447] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-15T20:59:24.728749] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:59:24.728830] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:59:24.728898] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-15T20:59:24.728972] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-15T20:59:24.729025] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-15T20:59:24.729067] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-15T20:59:24.729122] [INFO ] [MAIN ] Update Progress: 1703/2369 symbols completed. PMTU took 19.1s. Estimated remaining: 1h 33m 36s. Rate: 7.1 symbols/min [2025-10-15T20:59:24.900084] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:24.908444] [DEBUG] [LOCAL ] PNI: Loaded 6758 existing records from primary storage. [2025-10-15T20:59:24.908625] [INFO ] [MAIN ] PNI: Loaded 6758 existing records. [2025-10-15T20:59:24.919119] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-15T20:59:25.084095] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:59:25.084291] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-15T20:59:25.084335] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-15T20:59:25.084700] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-15T20:59:25.084757] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-15T20:59:25.455911] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:25.713984] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-15T20:59:26.514003] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-15T20:59:26.893047] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T20:59:27.059385] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T20:59:27.061519] [INFO ] [REMOTE ] PMM: Full fetch complete (17872 records). [2025-10-15T20:59:27.061594] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-15T20:59:27.317562] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-15T20:59:27.463498] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T20:59:27.495222] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-15T20:59:27.495613] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-15T20:59:27.496256] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-15T20:59:27.496764] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-15T20:59:27.497370] [DEBUG] [LOCAL ] PMM: Trimmed 17872 records to 10233 (keeping 200 days of data) [2025-10-15T20:59:27.554573] [DEBUG] [LOCAL ] PMM: Primary data saved (10233 records). [2025-10-15T20:59:27.554721] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-15T20:59:27.554811] [INFO ] [MAIN ] Update Progress: 1704/2369 symbols completed. PMM took 42.6s. Estimated remaining: 1h 33m 25s. Rate: 7.1 symbols/min [2025-10-15T20:59:27.719137] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:27.752176] [DEBUG] [LOCAL ] PNNT: Loaded 33436 existing records from primary storage. [2025-10-15T20:59:27.752428] [INFO ] [MAIN ] PNNT: Loaded 33436 existing records. [2025-10-15T20:59:27.929720] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T20:59:27.929966] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-15T20:59:27.930025] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-15T20:59:27.930296] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-15T20:59:27.930352] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-15T20:59:28.119185] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-15T20:59:28.285105] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:28.913964] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-15T20:59:28.984916] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T20:59:29.467132] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-15T20:59:29.714002] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-15T20:59:30.405813] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T20:59:30.430073] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T20:59:30.514008] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-15T20:59:31.313995] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-15T20:59:31.330277] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T20:59:32.113995] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-15T20:59:32.767721] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T20:59:32.913983] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-15T20:59:33.713963] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-15T20:59:33.903465] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T20:59:34.308148] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T20:59:34.407273] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T20:59:34.412726] [INFO ] [REMOTE ] PMT: Full fetch complete (58493 records). [2025-10-15T20:59:34.412876] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-15T20:59:34.413628] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T20:59:34.413738] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T20:59:34.413782] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T20:59:34.413820] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-15T20:59:34.413875] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-15T20:59:34.413909] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-15T20:59:34.413947] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-15T20:59:34.414034] [INFO ] [MAIN ] Update Progress: 1705/2369 symbols completed. PMT took 41.0s. Estimated remaining: 1h 33m 16s. Rate: 7.1 symbols/min [2025-10-15T20:59:34.522829] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-15T20:59:34.605849] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:34.606020] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-15T20:59:34.606057] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-15T20:59:34.606171] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-15T20:59:34.606212] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-15T20:59:34.606252] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-15T20:59:34.606287] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-15T20:59:34.956453] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:35.314019] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-15T20:59:35.898713] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T20:59:36.114022] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-15T20:59:36.913987] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-15T20:59:37.150991] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T20:59:37.604593] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T20:59:37.713975] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-15T20:59:37.793707] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T20:59:38.513984] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-15T20:59:38.594560] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T20:59:39.314081] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-15T20:59:40.114008] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-15T20:59:40.533345] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T20:59:40.854301] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T20:59:40.913972] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-15T20:59:41.451288] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T20:59:41.713990] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-15T20:59:42.454673] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T20:59:42.513989] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-15T20:59:43.314030] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-15T20:59:43.389965] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T20:59:44.024918] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T20:59:44.113978] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-15T20:59:44.914048] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-15T20:59:45.353609] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T20:59:45.432479] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T20:59:45.713979] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-15T20:59:45.924286] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T20:59:46.367357] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T20:59:46.514014] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-15T20:59:47.201359] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T20:59:47.314003] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-15T20:59:48.114016] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-15T20:59:48.136449] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T20:59:48.914021] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-15T20:59:49.714041] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-15T20:59:49.847481] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T20:59:50.210815] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T20:59:50.514042] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-15T20:59:51.314037] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-15T20:59:51.533833] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T20:59:52.091197] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T20:59:52.092258] [INFO ] [REMOTE ] PNI: Full fetch complete (9675 records). [2025-10-15T20:59:52.092327] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-15T20:59:52.123067] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-15T20:59:52.465194] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-15T20:59:52.465341] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-15T20:59:52.465624] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-15T20:59:52.465815] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-15T20:59:52.466414] [DEBUG] [LOCAL ] PNI: Trimmed 9675 records to 6782 (keeping 200 days of data) [2025-10-15T20:59:52.507534] [DEBUG] [LOCAL ] PNI: Primary data saved (6782 records). [2025-10-15T20:59:52.507680] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-15T20:59:52.507796] [INFO ] [MAIN ] Update Progress: 1706/2369 symbols completed. PNI took 27.8s. Estimated remaining: 1h 33m 12s. Rate: 7.1 symbols/min [2025-10-15T20:59:52.711301] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T20:59:52.708072] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-15T20:59:52.722002] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-15T20:59:52.722387] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-15T20:59:52.722512] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-15T20:59:52.722559] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-15T20:59:52.722947] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-15T20:59:52.722996] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-15T20:59:52.923161] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-15T20:59:53.085289] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T20:59:53.521963] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T20:59:53.714047] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-15T20:59:53.914323] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T20:59:54.514048] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-15T20:59:55.314050] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-15T20:59:55.405066] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T20:59:56.114001] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-15T20:59:56.212332] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T20:59:56.913976] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-15T20:59:56.971540] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T20:59:57.625183] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T20:59:57.713985] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-15T20:59:58.514024] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-15T20:59:58.735421] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T20:59:59.151769] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T20:59:59.313981] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-15T21:00:00.114026] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-15T21:00:00.146964] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T21:00:00.738729] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T21:00:00.914021] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-15T21:00:01.713991] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-15T21:00:01.732570] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T21:00:01.743341] [INFO ] [REMOTE ] PNC: Full fetch complete (75237 records). [2025-10-15T21:00:01.743574] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-15T21:00:01.744752] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:00:01.744880] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:00:01.744946] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:00:01.745021] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-15T21:00:01.745090] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-15T21:00:01.745131] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-15T21:00:01.745177] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-15T21:00:01.745243] [INFO ] [MAIN ] Update Progress: 1707/2369 symbols completed. PNC took 38.1s. Estimated remaining: 1h 33m 3s. Rate: 7.1 symbols/min [2025-10-15T21:00:01.954777] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:01.955087] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-15T21:00:01.955265] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-15T21:00:01.955605] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-15T21:00:01.955824] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-15T21:00:01.955895] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-15T21:00:01.956058] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-15T21:00:02.132480] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-15T21:00:02.433379] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:02.514007] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-15T21:00:03.314023] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-15T21:00:03.756839] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T21:00:04.114138] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-15T21:00:04.405409] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T21:00:04.913957] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-15T21:00:05.168185] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T21:00:05.373847] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T21:00:05.379308] [INFO ] [REMOTE ] PNR: Full fetch complete (69142 records). [2025-10-15T21:00:05.379447] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-15T21:00:05.380262] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:00:05.380350] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:00:05.380396] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:00:05.380477] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-15T21:00:05.380554] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-15T21:00:05.380609] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-15T21:00:05.380706] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-15T21:00:05.380795] [INFO ] [MAIN ] Update Progress: 1708/2369 symbols completed. PNR took 31.0s. Estimated remaining: 1h 32m 53s. Rate: 7.1 symbols/min [2025-10-15T21:00:05.514423] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T21:00:05.550787] [INFO ] [REMOTE ] PNNT: Full fetch complete (47929 records). [2025-10-15T21:00:05.568465] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:05.568564] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-15T21:00:05.568929] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-15T21:00:05.569031] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-15T21:00:05.569155] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-15T21:00:05.600459] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-15T21:00:05.632261] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-15T21:00:05.632368] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-15T21:00:05.720460] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-15T21:00:06.314372] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:06.314591] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-15T21:00:06.314706] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-15T21:00:06.315823] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-15T21:00:06.315885] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-15T21:00:06.316821] [DEBUG] [LOCAL ] PNNT: Trimmed 47929 records to 33478 (keeping 200 days of data) [2025-10-15T21:00:06.514698] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-15T21:00:06.517467] [DEBUG] [LOCAL ] PNNT: Primary data saved (33478 records). [2025-10-15T21:00:06.518560] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-15T21:00:06.518686] [INFO ] [MAIN ] Update Progress: 1709/2369 symbols completed. PNNT took 39.0s. Estimated remaining: 1h 32m 42s. Rate: 7.1 symbols/min [2025-10-15T21:00:06.704920] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:06.705170] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-15T21:00:06.705238] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-15T21:00:06.705363] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-15T21:00:06.705407] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-15T21:00:06.705450] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-15T21:00:06.705482] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-15T21:00:07.075544] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:07.314015] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-15T21:00:07.960552] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-15T21:00:08.113988] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-15T21:00:08.861731] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-15T21:00:08.913957] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-15T21:00:09.714014] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-15T21:00:09.836470] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T21:00:09.964806] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-15T21:00:10.470401] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T21:00:10.514017] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-15T21:00:11.313969] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-15T21:00:11.427891] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T21:00:12.113989] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-15T21:00:12.460089] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T21:00:12.914046] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-15T21:00:13.058224] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T21:00:13.714121] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-15T21:00:13.746227] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T21:00:14.514056] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-15T21:00:14.759233] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-15T21:00:15.313975] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-15T21:00:15.497615] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T21:00:16.114032] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-15T21:00:16.278787] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T21:00:16.914053] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-15T21:00:17.341155] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-15T21:00:17.410055] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T21:00:17.713987] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-15T21:00:18.427175] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T21:00:18.513964] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-15T21:00:19.011277] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T21:00:19.313997] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-15T21:00:19.902635] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T21:00:20.114063] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-15T21:00:20.913979] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-15T21:00:21.119221] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T21:00:21.697744] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T21:00:21.713967] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-15T21:00:22.382808] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T21:00:22.513992] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-15T21:00:23.117767] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T21:00:23.313983] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-15T21:00:24.114029] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-15T21:00:24.447861] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T21:00:24.915672] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-15T21:00:24.918544] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T21:00:25.494973] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T21:00:25.714004] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-15T21:00:26.513982] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-15T21:00:26.918528] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T21:00:27.115561] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T21:00:27.314007] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-15T21:00:28.114062] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-15T21:00:28.335400] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T21:00:28.914043] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-15T21:00:29.045612] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T21:00:29.688024] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:00:29.713958] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-15T21:00:30.513968] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-15T21:00:30.640197] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T21:00:31.247896] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T21:00:31.314033] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-15T21:00:32.114047] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-15T21:00:32.293543] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T21:00:32.914044] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-15T21:00:33.160118] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T21:00:33.161414] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T21:00:33.179217] [INFO ] [REMOTE ] POR: Full fetch complete (68079 records). [2025-10-15T21:00:33.179422] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-15T21:00:33.180407] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:00:33.180508] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:00:33.180556] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:00:33.180615] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-15T21:00:33.180736] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-15T21:00:33.180783] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-15T21:00:33.180826] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-15T21:00:33.180895] [INFO ] [MAIN ] Update Progress: 1710/2369 symbols completed. POR took 31.4s. Estimated remaining: 1h 32m 41s. Rate: 7.1 symbols/min [2025-10-15T21:00:33.357323] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:33.357741] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-15T21:00:33.357848] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-15T21:00:33.358137] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-15T21:00:33.358261] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-15T21:00:33.358385] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-15T21:00:33.358446] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-15T21:00:33.628590] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:00:33.665896] [INFO ] [REMOTE ] PNW: Full fetch complete (65762 records). [2025-10-15T21:00:33.666453] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-15T21:00:33.688863] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:00:33.706675] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:00:33.746583] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:00:33.727317] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-15T21:00:33.748139] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-15T21:00:33.746446] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:33.748589] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-15T21:00:33.748688] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-15T21:00:33.748757] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-15T21:00:33.748873] [INFO ] [MAIN ] Update Progress: 1711/2369 symbols completed. PNW took 41.2s. Estimated remaining: 1h 32m 29s. Rate: 7.1 symbols/min [2025-10-15T21:00:33.933529] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:33.956129] [DEBUG] [LOCAL ] PPT: Loaded 19920 existing records from primary storage. [2025-10-15T21:00:33.956463] [INFO ] [MAIN ] PPT: Loaded 19920 existing records. [2025-10-15T21:00:34.153075] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:00:34.153426] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-15T21:00:34.153479] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-15T21:00:34.153790] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-15T21:00:34.153849] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-15T21:00:34.517563] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-15T21:00:34.540197] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:34.553099] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:00:34.557607] [INFO ] [REMOTE ] POST: Full fetch complete (55267 records). [2025-10-15T21:00:34.557754] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-15T21:00:34.558549] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:00:34.558632] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:00:34.558720] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:00:34.558790] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-15T21:00:34.558854] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-15T21:00:34.558889] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-15T21:00:34.558928] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-15T21:00:34.558984] [INFO ] [MAIN ] Update Progress: 1712/2369 symbols completed. POST took 29.2s. Estimated remaining: 1h 32m 18s. Rate: 7.1 symbols/min [2025-10-15T21:00:34.724195] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:34.724381] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-15T21:00:34.724419] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-15T21:00:34.724527] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-15T21:00:34.724567] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-15T21:00:34.724606] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-15T21:00:34.724637] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-15T21:00:35.069907] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:35.313997] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-15T21:00:36.113984] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-15T21:00:36.913980] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-15T21:00:37.172994] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T21:00:37.714021] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-15T21:00:37.809337] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T21:00:38.147848] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T21:00:38.513963] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-15T21:00:39.313973] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-15T21:00:39.516136] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (5.00 seconds). [2025-10-15T21:00:40.113967] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-15T21:00:40.357962] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T21:00:40.431670] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T21:00:40.914090] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-15T21:00:41.626118] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (3.91 seconds). [2025-10-15T21:00:41.714080] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-15T21:00:41.963748] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T21:00:41.990346] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T21:00:42.514041] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-15T21:00:43.313978] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-15T21:00:43.505502] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T21:00:44.114025] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-15T21:00:44.352113] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T21:00:44.530741] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T21:00:44.914026] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-15T21:00:45.714046] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-15T21:00:46.060981] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T21:00:46.450096] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T21:00:46.513947] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-15T21:00:47.314042] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-15T21:00:47.866313] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-10-15T21:00:48.114052] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-15T21:00:48.302793] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T21:00:48.914078] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-15T21:00:49.132090] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T21:00:49.714076] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-15T21:00:49.971683] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T21:00:50.427976] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:00:50.433684] [INFO ] [REMOTE ] PPG: Full fetch complete (73637 records). [2025-10-15T21:00:50.433813] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-15T21:00:50.434638] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:00:50.434761] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:00:50.434817] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:00:50.434856] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-15T21:00:50.434913] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-15T21:00:50.434949] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-15T21:00:50.434988] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-15T21:00:50.435066] [INFO ] [MAIN ] Update Progress: 1713/2369 symbols completed. PPG took 43.9s. Estimated remaining: 1h 32m 12s. Rate: 7.1 symbols/min [2025-10-15T21:00:50.523755] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-15T21:00:50.618117] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:00:50.618372] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-15T21:00:50.618446] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-15T21:00:50.618680] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-15T21:00:50.618788] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-15T21:00:50.618929] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-15T21:00:50.619017] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-15T21:00:50.990178] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T21:00:51.067818] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:00:51.314003] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-15T21:00:52.114024] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-15T21:00:52.462535] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T21:00:52.686609] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-15T21:00:52.914062] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-15T21:00:53.713967] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-15T21:00:54.122708] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T21:00:54.278006] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T21:00:54.514055] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-15T21:00:55.314015] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-15T21:00:55.766261] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T21:00:56.114018] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-15T21:00:56.519840] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T21:00:56.528390] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T21:00:56.914017] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-15T21:00:57.713995] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-15T21:00:57.983085] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T21:00:58.099890] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T21:00:58.470440] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T21:00:58.513997] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-15T21:00:59.313970] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-15T21:00:59.684773] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T21:01:00.113997] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-15T21:01:00.913986] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-15T21:01:01.566040] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T21:01:01.713971] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-15T21:01:01.996952] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T21:01:02.041859] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T21:01:02.513996] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-15T21:01:02.718595] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T21:01:02.720996] [INFO ] [REMOTE ] PPT: Full fetch complete (28492 records). [2025-10-15T21:01:02.721098] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-15T21:01:03.092066] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-15T21:01:03.092188] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-15T21:01:03.092811] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-15T21:01:03.092872] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-15T21:01:03.094116] [DEBUG] [LOCAL ] PPT: Trimmed 28492 records to 19872 (keeping 200 days of data) [2025-10-15T21:01:03.206309] [DEBUG] [LOCAL ] PPT: Primary data saved (19872 records). [2025-10-15T21:01:03.206460] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-15T21:01:03.206556] [INFO ] [MAIN ] Update Progress: 1714/2369 symbols completed. PPT took 29.5s. Estimated remaining: 1h 32m 5s. Rate: 7.1 symbols/min [2025-10-15T21:01:03.319130] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-15T21:01:03.382330] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:03.387573] [DEBUG] [LOCAL ] PRCS: Loaded 2770 existing records from primary storage. [2025-10-15T21:01:03.387794] [INFO ] [MAIN ] PRCS: Loaded 2770 existing records. [2025-10-15T21:01:03.576319] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:01:03.576551] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-15T21:01:03.576602] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-15T21:01:03.576797] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-15T21:01:03.576855] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-15T21:01:03.980149] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:04.114008] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-15T21:01:04.352199] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T21:01:04.859677] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T21:01:04.913960] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-15T21:01:05.713973] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-15T21:01:06.278488] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T21:01:06.310224] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T21:01:06.316345] [INFO ] [REMOTE ] PPL: Full fetch complete (77212 records). [2025-10-15T21:01:06.316481] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-15T21:01:06.317384] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:01:06.317508] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:01:06.317551] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:01:06.317593] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-15T21:01:06.317678] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-15T21:01:06.317736] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-15T21:01:06.317783] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-15T21:01:06.317846] [INFO ] [MAIN ] Update Progress: 1715/2369 symbols completed. PPL took 33.1s. Estimated remaining: 1h 31m 55s. Rate: 7.1 symbols/min [2025-10-15T21:01:06.490805] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:06.491411] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-15T21:01:06.491518] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-15T21:01:06.491737] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-15T21:01:06.491795] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-15T21:01:06.491844] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-15T21:01:06.491883] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-15T21:01:06.524781] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-15T21:01:06.691392] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T21:01:06.925233] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:07.139072] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T21:01:07.313996] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-15T21:01:08.114006] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-15T21:01:08.871463] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T21:01:08.914002] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-15T21:01:09.643614] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T21:01:09.713971] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-15T21:01:10.496054] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T21:01:10.513972] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-15T21:01:11.022690] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T21:01:11.171705] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T21:01:11.314007] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-15T21:01:11.884849] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T21:01:12.114009] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-15T21:01:12.914005] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-15T21:01:13.442822] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T21:01:13.714023] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-15T21:01:14.194175] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T21:01:14.514004] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-15T21:01:15.074388] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T21:01:15.314065] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-15T21:01:15.583611] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T21:01:16.090384] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T21:01:16.096418] [INFO ] [REMOTE ] PR: Full fetch complete (77374 records). [2025-10-15T21:01:16.096560] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-15T21:01:16.097404] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:01:16.097496] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:01:16.097539] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:01:16.097580] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-15T21:01:16.097636] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-15T21:01:16.097715] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-15T21:01:16.097764] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-15T21:01:16.097822] [INFO ] [MAIN ] Update Progress: 1716/2369 symbols completed. PR took 41.5s. Estimated remaining: 1h 31m 47s. Rate: 7.1 symbols/min [2025-10-15T21:01:16.119150] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-15T21:01:16.268423] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:16.268638] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-15T21:01:16.268717] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-15T21:01:16.268851] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-15T21:01:16.268893] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-15T21:01:16.268933] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-15T21:01:16.268965] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-15T21:01:16.614915] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:16.858828] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T21:01:16.914015] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-15T21:01:17.713995] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-15T21:01:18.514033] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-15T21:01:18.604716] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:01:18.833474] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T21:01:19.314066] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-15T21:01:19.905284] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T21:01:20.114051] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-15T21:01:20.399701] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T21:01:20.914011] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-15T21:01:21.415567] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T21:01:21.424548] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T21:01:21.714065] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-15T21:01:22.256762] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T21:01:22.514053] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-15T21:01:23.314050] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-15T21:01:24.114064] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-15T21:01:24.202441] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T21:01:24.248451] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:01:24.445946] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T21:01:24.452149] [INFO ] [REMOTE ] PRA: Full fetch complete (44557 records). [2025-10-15T21:01:24.452342] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-15T21:01:24.453202] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:01:24.453320] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:01:24.453378] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:01:24.453461] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-15T21:01:24.453545] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-15T21:01:24.453599] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-15T21:01:24.453706] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-15T21:01:24.453803] [INFO ] [MAIN ] Update Progress: 1717/2369 symbols completed. PRA took 34.0s. Estimated remaining: 1h 31m 38s. Rate: 7.1 symbols/min [2025-10-15T21:01:24.914011] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-15T21:01:25.714017] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-15T21:01:26.294672] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T21:01:26.513995] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-15T21:01:26.645440] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T21:01:27.002790] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T21:01:27.313998] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-15T21:01:27.815819] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T21:01:27.816879] [INFO ] [REMOTE ] PRCS: Full fetch complete (3883 records). [2025-10-15T21:01:27.816952] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-15T21:01:28.119164] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-15T21:01:28.186935] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-15T21:01:28.187037] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-15T21:01:28.187214] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-15T21:01:28.187256] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-15T21:01:28.187683] [DEBUG] [LOCAL ] PRCS: Trimmed 3883 records to 2781 (keeping 200 days of data) [2025-10-15T21:01:28.204577] [DEBUG] [LOCAL ] PRCS: Primary data saved (2781 records). [2025-10-15T21:01:28.204723] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-15T21:01:28.204825] [INFO ] [MAIN ] Update Progress: 1718/2369 symbols completed. PRCS took 25.0s. Estimated remaining: 1h 31m 28s. Rate: 7.1 symbols/min [2025-10-15T21:01:28.914009] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-15T21:01:29.936766] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T21:01:29.947016] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-15T21:01:30.009772] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T21:01:30.514071] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-15T21:01:31.743856] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T21:01:31.756457] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-15T21:01:31.999961] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:01:32.114050] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-15T21:01:33.429490] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T21:01:33.436437] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-15T21:01:33.541575] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T21:01:33.714077] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-15T21:01:34.914744] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T21:01:34.922180] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-15T21:01:35.009294] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T21:01:35.314108] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-15T21:01:36.246441] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T21:01:36.252501] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-15T21:01:36.975522] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T21:01:36.985486] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-15T21:01:37.261554] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T21:01:37.713993] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-15T21:01:38.449534] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:01:38.453434] [INFO ] [REMOTE ] PRG: Full fetch complete (44087 records). [2025-10-15T21:01:38.453572] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-15T21:01:38.454189] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:01:38.454290] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:01:38.454363] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:01:38.454454] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-15T21:01:38.454534] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-15T21:01:38.454572] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-15T21:01:38.454615] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-15T21:01:38.454706] [INFO ] [MAIN ] Update Progress: 1719/2369 symbols completed. PRG took 32.1s. Estimated remaining: 1h 31m 21s. Rate: 7.1 symbols/min [2025-10-15T21:01:38.808200] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T21:01:38.823855] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-15T21:01:40.548200] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T21:01:40.558934] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-15T21:01:41.235204] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:01:41.240939] [INFO ] [REMOTE ] PRGO: Full fetch complete (68474 records). [2025-10-15T21:01:41.241048] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-15T21:01:41.241828] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:01:41.241919] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:01:41.241963] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:01:41.242002] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-15T21:01:41.242058] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-15T21:01:41.242092] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-15T21:01:41.242139] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-15T21:01:41.242194] [INFO ] [MAIN ] Update Progress: 1720/2369 symbols completed. PRGO took 25.1s. Estimated remaining: 1h 31m 10s. Rate: 7.1 symbols/min [2025-10-15T21:01:41.804984] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:41.997998] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:42.006153] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:42.002186] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:01:42.008290] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-15T21:01:42.008494] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-15T21:01:42.008630] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-15T21:01:42.007861] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-15T21:01:42.011865] [DEBUG] [LOCAL ] PRH: Loaded 4765 existing records from primary storage. [2025-10-15T21:01:42.011625] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-15T21:01:42.012434] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-15T21:01:42.008797] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-15T21:01:42.012088] [INFO ] [MAIN ] PRH: Loaded 4765 existing records. [2025-10-15T21:01:42.012745] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-15T21:01:42.032861] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-15T21:01:42.041696] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-15T21:01:42.057436] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-15T21:01:42.023548] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-15T21:01:42.069085] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-15T21:01:42.083131] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-15T21:01:42.088489] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-15T21:01:42.093768] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-15T21:01:42.098984] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-15T21:01:42.142364] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-15T21:01:42.602937] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:01:42.680766] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-15T21:01:42.769936] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-15T21:01:42.860610] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-15T21:01:42.957477] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-15T21:01:43.411149] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:43.450077] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-15T21:01:43.446347] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:43.475408] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-15T21:01:43.517572] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:43.538482] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-15T21:01:43.747997] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:01:43.748408] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-15T21:01:44.436126] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T21:01:44.437860] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-15T21:01:44.807495] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T21:01:44.813113] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-15T21:01:44.966853] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T21:01:44.967170] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T21:01:44.978532] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-15T21:01:45.223835] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:01:45.714018] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-15T21:01:46.032591] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T21:01:46.325507] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T21:01:46.514040] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-15T21:01:47.283932] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T21:01:47.285890] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T21:01:47.314019] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-15T21:01:48.114018] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-15T21:01:48.797805] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T21:01:48.912875] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T21:01:48.920819] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-15T21:01:49.714064] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-15T21:01:49.969582] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T21:01:50.514029] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-15T21:01:51.222697] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T21:01:51.314035] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-15T21:01:52.119261] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-15T21:01:52.137828] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T21:01:52.913980] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-15T21:01:52.985596] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T21:01:53.067004] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T21:01:53.714036] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-15T21:01:54.502104] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T21:01:54.514982] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-15T21:01:55.182118] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T21:01:55.314032] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-15T21:01:55.376706] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T21:01:56.114031] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-15T21:01:56.828944] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T21:01:56.913972] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-15T21:01:57.068534] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T21:01:57.564746] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T21:01:57.713996] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-15T21:01:58.514011] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-15T21:01:59.223346] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T21:01:59.314000] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-15T21:01:59.449830] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T21:01:59.757731] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T21:02:00.113991] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-15T21:02:00.914006] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-15T21:02:01.331585] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T21:02:01.352862] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T21:02:01.353813] [INFO ] [REMOTE ] PRH: Full fetch complete (7488 records). [2025-10-15T21:02:01.353880] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-15T21:02:01.707054] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-15T21:02:01.707164] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-15T21:02:01.707396] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-15T21:02:01.707436] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-15T21:02:01.707941] [DEBUG] [LOCAL ] PRH: Trimmed 7488 records to 4757 (keeping 200 days of data) [2025-10-15T21:02:01.720223] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-15T21:02:01.739280] [DEBUG] [LOCAL ] PRH: Primary data saved (4757 records). [2025-10-15T21:02:01.739393] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-15T21:02:01.739470] [INFO ] [MAIN ] Update Progress: 1721/2369 symbols completed. PRH took 20.5s. Estimated remaining: 1h 31m 6s. Rate: 7.1 symbols/min [2025-10-15T21:02:01.910761] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:01.910949] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-15T21:02:01.910986] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-15T21:02:01.911116] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-15T21:02:01.911156] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-15T21:02:01.911197] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-15T21:02:01.911230] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-15T21:02:02.299744] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:02.514024] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-15T21:02:03.311787] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T21:02:03.319626] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-15T21:02:03.375726] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T21:02:04.114038] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-15T21:02:04.913978] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-15T21:02:04.941834] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T21:02:05.578139] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T21:02:05.713968] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-15T21:02:06.220086] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T21:02:06.514003] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-15T21:02:07.314052] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-15T21:02:07.505433] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T21:02:08.114026] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-15T21:02:08.265083] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T21:02:08.570682] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T21:02:08.913990] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-15T21:02:09.588724] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T21:02:09.713996] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-15T21:02:10.514051] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-15T21:02:10.951219] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T21:02:11.075953] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T21:02:11.274772] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T21:02:11.279707] [INFO ] [REMOTE ] PRKS: Full fetch complete (61461 records). [2025-10-15T21:02:11.279817] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-15T21:02:11.280524] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:02:11.280662] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:02:11.280732] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:02:11.280802] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-15T21:02:11.280864] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-15T21:02:11.280899] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-15T21:02:11.280937] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-15T21:02:11.281006] [INFO ] [MAIN ] Update Progress: 1722/2369 symbols completed. PRKS took 30.0s. Estimated remaining: 1h 30m 58s. Rate: 7.1 symbols/min [2025-10-15T21:02:11.320208] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-15T21:02:11.454963] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:11.455129] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-15T21:02:11.455167] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-15T21:02:11.455280] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-15T21:02:11.455321] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-15T21:02:11.455362] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-15T21:02:11.455395] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-15T21:02:11.812136] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:12.113949] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-15T21:02:12.512062] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T21:02:12.914034] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-15T21:02:13.364763] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T21:02:13.714025] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-15T21:02:14.514026] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-15T21:02:14.684870] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T21:02:15.298410] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T21:02:15.314084] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-15T21:02:15.585800] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T21:02:16.114025] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-15T21:02:16.792996] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:02:16.797765] [INFO ] [REMOTE ] PRIM: Full fetch complete (63444 records). [2025-10-15T21:02:16.797876] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-15T21:02:16.798496] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:02:16.798579] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:02:16.798623] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:02:16.798715] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-15T21:02:16.798804] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-15T21:02:16.798859] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-15T21:02:16.798902] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-15T21:02:16.798972] [INFO ] [MAIN ] Update Progress: 1723/2369 symbols completed. PRIM took 35.5s. Estimated remaining: 1h 30m 49s. Rate: 7.1 symbols/min [2025-10-15T21:02:16.918896] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-15T21:02:16.968127] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:16.969164] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-15T21:02:16.969230] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-15T21:02:16.969376] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-15T21:02:16.969614] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-15T21:02:16.969748] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-15T21:02:16.969916] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-15T21:02:17.274691] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T21:02:17.364052] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:17.714013] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-15T21:02:18.083494] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T21:02:18.514012] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-15T21:02:18.924432] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T21:02:19.313999] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-15T21:02:20.057465] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T21:02:20.113990] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-15T21:02:20.914017] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-15T21:02:21.150383] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T21:02:21.446239] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:02:21.713978] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-15T21:02:21.975319] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T21:02:22.513989] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-15T21:02:23.313988] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-15T21:02:23.373109] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T21:02:23.820396] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T21:02:23.881442] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T21:02:23.883556] [INFO ] [REMOTE ] PRI: Full fetch complete (25400 records). [2025-10-15T21:02:23.883627] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-15T21:02:23.884266] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:02:23.884350] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:02:23.884392] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:02:23.884430] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-15T21:02:23.884484] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-15T21:02:23.884519] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-15T21:02:23.884557] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-15T21:02:23.884609] [INFO ] [MAIN ] Update Progress: 1724/2369 symbols completed. PRI took 42.6s. Estimated remaining: 1h 30m 40s. Rate: 7.1 symbols/min [2025-10-15T21:02:24.067249] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:24.067482] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-15T21:02:24.067533] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-15T21:02:24.067679] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-15T21:02:24.067735] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-15T21:02:24.067780] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-15T21:02:24.067817] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-15T21:02:24.119082] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-15T21:02:24.445192] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:24.913991] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-15T21:02:25.714026] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-15T21:02:25.791618] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:02:26.298234] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T21:02:26.514031] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-15T21:02:26.694487] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T21:02:27.313982] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-15T21:02:28.010875] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T21:02:28.113960] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-15T21:02:28.408469] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T21:02:28.914016] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-15T21:02:29.714015] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-15T21:02:29.892681] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T21:02:29.957164] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T21:02:30.514006] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-15T21:02:31.314045] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-15T21:02:31.448464] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:02:31.684502] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T21:02:32.114066] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-15T21:02:32.707049] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T21:02:32.913996] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-15T21:02:33.263205] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T21:02:33.714045] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-15T21:02:34.231191] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T21:02:34.514013] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-15T21:02:35.314012] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-15T21:02:35.406545] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T21:02:36.113998] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-15T21:02:36.180276] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T21:02:36.232127] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T21:02:36.914074] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-15T21:02:37.350934] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T21:02:37.590034] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T21:02:37.713998] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-15T21:02:38.344038] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T21:02:38.347014] [INFO ] [REMOTE ] PRLB: Full fetch complete (30142 records). [2025-10-15T21:02:38.347101] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-15T21:02:38.347555] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:02:38.347634] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:02:38.347714] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:02:38.347782] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-15T21:02:38.347844] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-15T21:02:38.347880] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-15T21:02:38.347918] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-15T21:02:38.347997] [INFO ] [MAIN ] Update Progress: 1725/2369 symbols completed. PRLB took 36.6s. Estimated remaining: 1h 30m 33s. Rate: 7.1 symbols/min [2025-10-15T21:02:38.513769] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:38.513925] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-15T21:02:38.514024] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-15T21:02:38.513963] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-15T21:02:38.515428] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-15T21:02:38.515482] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-15T21:02:38.515528] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-15T21:02:38.515559] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-15T21:02:38.871305] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:39.314005] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-15T21:02:39.357528] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T21:02:39.362462] [INFO ] [REMOTE ] PRM: Full fetch complete (64187 records). [2025-10-15T21:02:39.362562] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-15T21:02:39.363521] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:02:39.363623] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:02:39.363732] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:02:39.363822] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-15T21:02:39.363908] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-15T21:02:39.363983] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-15T21:02:39.364068] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-15T21:02:39.364162] [INFO ] [MAIN ] Update Progress: 1726/2369 symbols completed. PRM took 28.1s. Estimated remaining: 1h 30m 22s. Rate: 7.1 symbols/min [2025-10-15T21:02:39.540299] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:39.547719] [DEBUG] [LOCAL ] PRT: Loaded 5180 existing records from primary storage. [2025-10-15T21:02:39.547950] [INFO ] [MAIN ] PRT: Loaded 5180 existing records. [2025-10-15T21:02:39.735563] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:02:39.735823] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-15T21:02:39.735887] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-15T21:02:39.736146] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-15T21:02:39.736206] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-15T21:02:40.101419] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:40.113950] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-15T21:02:40.914002] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-15T21:02:41.180707] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T21:02:41.191944] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:02:41.192832] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-15T21:02:41.193248] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:02:41.193333] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-15T21:02:41.193399] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:02:41.193473] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-15T21:02:41.193540] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-15T21:02:41.193578] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-15T21:02:41.193618] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-15T21:02:41.193696] [INFO ] [MAIN ] Update Progress: 1727/2369 symbols completed. PRSU took 2.8s. Estimated remaining: 1h 30m 11s. Rate: 7.1 symbols/min [2025-10-15T21:02:41.359289] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:41.359443] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-15T21:02:41.359479] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-15T21:02:41.359585] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-15T21:02:41.359627] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-15T21:02:41.359707] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-15T21:02:41.359749] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-15T21:02:41.730177] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:41.726214] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-15T21:02:41.732800] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:02:42.513971] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-15T21:02:42.579758] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T21:02:43.314004] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-15T21:02:44.107695] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T21:02:44.116684] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-15T21:02:44.905240] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:02:44.915947] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-15T21:02:45.605009] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T21:02:45.714000] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-15T21:02:46.362157] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T21:02:46.514022] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-15T21:02:47.147933] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T21:02:47.314044] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-15T21:02:48.114020] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-15T21:02:48.140891] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T21:02:48.393859] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T21:02:48.914067] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-15T21:02:49.714044] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-15T21:02:49.794061] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T21:02:49.796158] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T21:02:50.514036] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-15T21:02:51.297396] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T21:02:51.313978] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-15T21:02:51.552422] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T21:02:52.114066] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-15T21:02:52.573108] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T21:02:52.914044] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-15T21:02:53.713978] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-15T21:02:53.952117] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T21:02:54.442044] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T21:02:54.513962] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-15T21:02:54.799402] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T21:02:55.169891] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T21:02:55.314019] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-15T21:02:56.114024] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-15T21:02:56.882769] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T21:02:56.913962] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-15T21:02:57.571635] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T21:02:57.580236] [INFO ] [REMOTE ] PRO: Full fetch complete (53026 records). [2025-10-15T21:02:57.580415] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-15T21:02:57.581308] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:02:57.581412] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:02:57.581467] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:02:57.581549] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-15T21:02:57.581634] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-15T21:02:57.581762] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-15T21:02:57.581847] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-15T21:02:57.581937] [INFO ] [MAIN ] Update Progress: 1728/2369 symbols completed. PRO took 33.7s. Estimated remaining: 1h 30m 6s. Rate: 7.1 symbols/min [2025-10-15T21:02:57.725768] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-15T21:02:57.758631] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:02:57.760041] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-15T21:02:57.760094] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-15T21:02:57.760220] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-15T21:02:57.760274] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-15T21:02:57.760317] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-15T21:02:57.760348] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-15T21:02:58.114686] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:02:58.158713] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T21:02:58.291408] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T21:02:58.514006] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-15T21:02:59.224676] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T21:02:59.313989] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-15T21:03:00.114189] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-15T21:03:00.914057] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-15T21:03:01.489109] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-15T21:03:01.602211] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T21:03:01.638037] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T21:03:01.713991] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-15T21:03:02.460950] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T21:03:02.513960] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-15T21:03:02.995681] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:03:02.996820] [INFO ] [REMOTE ] PRT: Full fetch complete (8778 records). [2025-10-15T21:03:02.996897] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-15T21:03:03.320971] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-15T21:03:03.365629] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-15T21:03:03.365741] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-15T21:03:03.366015] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-15T21:03:03.366057] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-15T21:03:03.366492] [DEBUG] [LOCAL ] PRT: Trimmed 8778 records to 5170 (keeping 200 days of data) [2025-10-15T21:03:03.399098] [DEBUG] [LOCAL ] PRT: Primary data saved (5170 records). [2025-10-15T21:03:03.399234] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-15T21:03:03.399318] [INFO ] [MAIN ] Update Progress: 1729/2369 symbols completed. PRT took 24.0s. Estimated remaining: 1h 29m 56s. Rate: 7.1 symbols/min [2025-10-15T21:03:03.566265] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:03.566431] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-15T21:03:03.566468] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-15T21:03:03.566577] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-15T21:03:03.566618] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-15T21:03:03.566695] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-15T21:03:03.566743] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-15T21:03:03.950837] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:04.114024] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-15T21:03:04.914015] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-15T21:03:05.329469] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T21:03:05.366706] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T21:03:05.712803] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T21:03:05.720531] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-15T21:03:06.514032] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-15T21:03:07.313993] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-15T21:03:07.664011] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T21:03:08.068471] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T21:03:08.103348] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:03:08.113959] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-15T21:03:08.914062] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-15T21:03:09.367730] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T21:03:09.610548] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T21:03:09.713990] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-15T21:03:10.514029] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-15T21:03:10.925169] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T21:03:11.314043] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-15T21:03:11.487434] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T21:03:12.114043] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-15T21:03:12.913992] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-15T21:03:12.945539] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:03:12.952082] [INFO ] [REMOTE ] PRU: Full fetch complete (74037 records). [2025-10-15T21:03:12.952262] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-15T21:03:12.953459] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:03:12.953570] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:03:12.953695] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:03:12.953830] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-15T21:03:12.954046] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-15T21:03:12.954189] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-15T21:03:12.954262] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-15T21:03:12.954335] [INFO ] [MAIN ] Update Progress: 1730/2369 symbols completed. PRU took 31.8s. Estimated remaining: 1h 29m 48s. Rate: 7.1 symbols/min [2025-10-15T21:03:13.139371] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:13.184286] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T21:03:13.181802] [DEBUG] [LOCAL ] PSBD: Loaded 7909 existing records from primary storage. [2025-10-15T21:03:13.195332] [INFO ] [MAIN ] PSBD: Loaded 7909 existing records. [2025-10-15T21:03:13.368804] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:03:13.369006] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-15T21:03:13.369079] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-15T21:03:13.369280] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-15T21:03:13.369338] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-15T21:03:13.712465] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:13.713951] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-15T21:03:14.384775] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T21:03:14.513966] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-15T21:03:14.638151] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T21:03:15.314056] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-15T21:03:16.096691] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T21:03:16.113984] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-15T21:03:16.340545] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T21:03:16.914007] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-15T21:03:17.713975] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-15T21:03:17.928097] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T21:03:17.952076] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T21:03:17.957860] [INFO ] [REMOTE ] PRMB: Full fetch complete (75901 records). [2025-10-15T21:03:17.957982] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-15T21:03:17.958818] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:03:17.958904] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:03:17.958946] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:03:17.958984] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-15T21:03:17.959040] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-15T21:03:17.959075] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-15T21:03:17.959115] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-15T21:03:17.959171] [INFO ] [MAIN ] Update Progress: 1731/2369 symbols completed. PRMB took 1m 1s. Estimated remaining: 1h 29m 39s. Rate: 7.1 symbols/min [2025-10-15T21:03:18.144523] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:18.157001] [DEBUG] [LOCAL ] PSF: Loaded 7000 existing records from primary storage. [2025-10-15T21:03:18.157343] [INFO ] [MAIN ] PSF: Loaded 7000 existing records. [2025-10-15T21:03:18.358964] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:03:18.359307] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-15T21:03:18.359362] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-15T21:03:18.359610] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-15T21:03:18.359712] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-15T21:03:18.521683] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-15T21:03:18.568464] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T21:03:18.764136] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:19.050181] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T21:03:19.314006] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-15T21:03:19.747736] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T21:03:20.114041] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-15T21:03:20.872207] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T21:03:20.913948] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-15T21:03:21.610097] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T21:03:21.713964] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-15T21:03:22.513995] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-15T21:03:23.124438] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T21:03:23.313997] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-15T21:03:23.425887] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T21:03:24.120810] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-15T21:03:24.125568] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T21:03:24.555328] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T21:03:24.914016] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-15T21:03:25.713995] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-15T21:03:25.761228] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T21:03:26.514128] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-15T21:03:27.174239] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T21:03:27.314023] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-15T21:03:27.354881] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T21:03:28.078231] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T21:03:28.113967] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-15T21:03:28.903881] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T21:03:28.913945] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-15T21:03:29.713970] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-15T21:03:29.726718] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T21:03:30.392254] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T21:03:30.514075] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-15T21:03:31.314086] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-15T21:03:31.337714] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T21:03:32.114027] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-15T21:03:32.145804] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T21:03:32.913996] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-15T21:03:33.325329] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-15T21:03:33.713991] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-15T21:03:33.832848] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T21:03:34.514071] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-15T21:03:34.563601] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T21:03:34.833866] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-15T21:03:35.314067] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-15T21:03:36.113980] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-15T21:03:36.259074] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T21:03:36.261539] [INFO ] [REMOTE ] PSBD: Full fetch complete (10473 records). [2025-10-15T21:03:36.261613] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-15T21:03:36.629462] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-15T21:03:36.629563] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-15T21:03:36.629875] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-15T21:03:36.629937] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-15T21:03:36.630365] [DEBUG] [LOCAL ] PSBD: Trimmed 10473 records to 7956 (keeping 200 days of data) [2025-10-15T21:03:36.685893] [DEBUG] [LOCAL ] PSBD: Primary data saved (7956 records). [2025-10-15T21:03:36.685996] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-15T21:03:36.686074] [INFO ] [MAIN ] Update Progress: 1732/2369 symbols completed. PSBD took 23.7s. Estimated remaining: 1h 29m 34s. Rate: 7.1 symbols/min [2025-10-15T21:03:36.861512] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:36.861701] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-15T21:03:36.861756] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-15T21:03:36.861870] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-15T21:03:36.861911] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-15T21:03:36.861952] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-15T21:03:36.861984] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-15T21:03:36.921609] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-15T21:03:36.981425] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T21:03:37.227738] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:37.713987] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-15T21:03:38.046044] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T21:03:38.046754] [INFO ] [REMOTE ] PRVS: Full fetch complete (1248 records). [2025-10-15T21:03:38.046821] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-15T21:03:38.227230] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-15T21:03:38.227419] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:03:38.227485] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:03:38.227535] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-15T21:03:38.227591] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-15T21:03:38.227629] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-15T21:03:38.227724] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-15T21:03:38.227792] [INFO ] [MAIN ] Update Progress: 1733/2369 symbols completed. PRVS took 40.6s. Estimated remaining: 1h 29m 23s. Rate: 7.1 symbols/min [2025-10-15T21:03:38.400900] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:38.401048] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-15T21:03:38.401103] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-15T21:03:38.401210] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-15T21:03:38.401250] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-15T21:03:38.401293] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-15T21:03:38.401325] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-15T21:03:38.517462] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-15T21:03:38.778804] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:38.800717] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T21:03:39.241078] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T21:03:39.313962] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-15T21:03:40.033885] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T21:03:40.113964] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-15T21:03:40.914058] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-15T21:03:41.484823] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:03:41.540067] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T21:03:41.713986] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-15T21:03:42.514065] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-15T21:03:43.313982] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-15T21:03:43.382055] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T21:03:44.089994] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T21:03:44.113953] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-15T21:03:44.146274] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T21:03:44.914001] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-15T21:03:45.624254] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:03:45.629330] [INFO ] [REMOTE ] PSA: Full fetch complete (59091 records). [2025-10-15T21:03:45.629465] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-15T21:03:45.630230] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:03:45.630321] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:03:45.630396] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:03:45.630483] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-15T21:03:45.630561] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-15T21:03:45.630612] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-15T21:03:45.630722] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-15T21:03:45.630812] [INFO ] [MAIN ] Update Progress: 1734/2369 symbols completed. PSA took 42.2s. Estimated remaining: 1h 29m 14s. Rate: 7.1 symbols/min [2025-10-15T21:03:45.718259] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-15T21:03:45.822317] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:45.822777] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-15T21:03:45.822937] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-15T21:03:45.823115] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-15T21:03:45.823289] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-15T21:03:45.823393] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-15T21:03:45.823582] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-15T21:03:45.955817] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T21:03:46.215144] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:46.514058] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-15T21:03:47.195739] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T21:03:47.314028] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-15T21:03:47.824347] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T21:03:48.114069] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-15T21:03:48.875936] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T21:03:48.913964] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-15T21:03:49.033999] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T21:03:49.459931] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T21:03:49.461316] [INFO ] [REMOTE ] PSF: Full fetch complete (9782 records). [2025-10-15T21:03:49.461385] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-15T21:03:49.719148] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-15T21:03:49.808276] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-15T21:03:49.808351] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-15T21:03:49.808608] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-15T21:03:49.808668] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-15T21:03:49.809095] [DEBUG] [LOCAL ] PSF: Trimmed 9782 records to 6982 (keeping 200 days of data) [2025-10-15T21:03:49.850396] [DEBUG] [LOCAL ] PSF: Primary data saved (6982 records). [2025-10-15T21:03:49.850494] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-15T21:03:49.850573] [INFO ] [MAIN ] Update Progress: 1735/2369 symbols completed. PSF took 31.9s. Estimated remaining: 1h 29m 4s. Rate: 7.1 symbols/min [2025-10-15T21:03:50.018418] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:03:50.054726] [DEBUG] [LOCAL ] PSQH: Loaded 35507 existing records from primary storage. [2025-10-15T21:03:50.055023] [INFO ] [MAIN ] PSQH: Loaded 35507 existing records. [2025-10-15T21:03:50.225115] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:03:50.225359] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-15T21:03:50.225414] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-15T21:03:50.225872] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-15T21:03:50.225931] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-15T21:03:50.519117] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-15T21:03:50.577952] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:03:51.116951] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T21:03:51.314022] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-15T21:03:52.048618] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T21:03:52.113965] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-15T21:03:52.913971] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-15T21:03:53.031370] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T21:03:53.440436] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T21:03:53.713994] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-15T21:03:54.315242] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T21:03:54.514038] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-15T21:03:55.313981] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-15T21:03:55.454675] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T21:03:56.114033] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-15T21:03:56.190196] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T21:03:56.914005] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-15T21:03:57.441079] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T21:03:57.509709] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T21:03:57.714004] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-15T21:03:58.514016] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-15T21:03:58.568365] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T21:03:59.168491] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T21:03:59.313990] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-15T21:04:00.114048] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-15T21:04:00.394366] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T21:04:00.463399] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T21:04:00.913974] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-15T21:04:01.621277] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T21:04:01.714051] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-15T21:04:02.356919] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T21:04:02.514017] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-15T21:04:02.620555] [DEBUG] [REMOTE ] PSO: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-15T21:04:02.620982] [WARN ] [REMOTE ] PSO: No data returned for month 2025-06 [2025-10-15T21:04:02.621104] [FATAL] [REMOTE ] PSO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:04:02.621219] [FATAL] [MAIN ] PSO: Failed to fetch primary data. [2025-10-15T21:04:02.621288] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:04:02.621356] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-15T21:04:02.621422] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-15T21:04:02.621462] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-15T21:04:02.621500] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-15T21:04:02.621545] [INFO ] [MAIN ] Update Progress: 1736/2369 symbols completed. PSO took 17.0s. Estimated remaining: 1h 28m 58s. Rate: 7.1 symbols/min [2025-10-15T21:04:02.788126] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:02.788303] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-15T21:04:02.788340] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-15T21:04:02.788444] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-15T21:04:02.788503] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-15T21:04:02.788544] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-15T21:04:02.788575] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-15T21:04:03.132535] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:03.314074] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-15T21:04:03.625048] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T21:04:04.114002] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-15T21:04:04.824633] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:04:04.913969] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-15T21:04:05.507189] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T21:04:05.714009] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-15T21:04:06.196318] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T21:04:06.514001] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-15T21:04:06.568434] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T21:04:07.314061] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-15T21:04:07.699787] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T21:04:07.703204] [INFO ] [REMOTE ] PSFE: Full fetch complete (42913 records). [2025-10-15T21:04:07.703292] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-15T21:04:07.703889] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:04:07.703976] [FATAL] [MAIN ] PSFE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:04:07.704019] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:04:07.704096] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-15T21:04:07.704198] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-15T21:04:07.704252] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-15T21:04:07.704295] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-15T21:04:07.704353] [INFO ] [MAIN ] Update Progress: 1737/2369 symbols completed. PSFE took 31.0s. Estimated remaining: 1h 28m 48s. Rate: 7.1 symbols/min [2025-10-15T21:04:07.903951] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:07.904186] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-15T21:04:07.904366] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-15T21:04:07.904499] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-15T21:04:07.904566] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-15T21:04:07.904722] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-15T21:04:07.904833] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-15T21:04:08.087464] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T21:04:08.120589] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-15T21:04:08.292932] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:08.914008] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-15T21:04:09.714021] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-15T21:04:10.206213] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-15T21:04:10.513980] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-15T21:04:10.572250] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T21:04:11.314046] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-15T21:04:11.366868] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T21:04:12.114049] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-15T21:04:12.417899] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T21:04:12.919101] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-15T21:04:12.934492] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T21:04:13.560953] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T21:04:13.713951] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-15T21:04:14.025759] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T21:04:14.513995] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-15T21:04:15.135943] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T21:04:15.314008] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-15T21:04:16.113975] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-15T21:04:16.461533] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-15T21:04:16.895269] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T21:04:16.914045] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-15T21:04:17.713980] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-15T21:04:17.828864] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T21:04:17.881017] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T21:04:18.513991] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-15T21:04:19.313976] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-15T21:04:19.579816] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T21:04:20.119744] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-15T21:04:20.136820] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T21:04:20.141934] [INFO ] [REMOTE ] PSN: Full fetch complete (66708 records). [2025-10-15T21:04:20.142034] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-15T21:04:20.142762] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:04:20.142849] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:04:20.142893] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:04:20.142933] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-15T21:04:20.142990] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-15T21:04:20.143027] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-15T21:04:20.143065] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-15T21:04:20.143144] [INFO ] [MAIN ] Update Progress: 1738/2369 symbols completed. PSN took 41.9s. Estimated remaining: 1h 28m 41s. Rate: 7.1 symbols/min [2025-10-15T21:04:20.314788] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:20.315066] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-15T21:04:20.315157] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-15T21:04:20.315284] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-15T21:04:20.315329] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-15T21:04:20.315484] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-15T21:04:20.315588] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-15T21:04:20.672188] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T21:04:20.711756] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:20.913950] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-15T21:04:21.272874] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T21:04:21.713988] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-15T21:04:22.447302] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T21:04:22.513974] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-15T21:04:23.313967] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-15T21:04:23.482465] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T21:04:23.487455] [INFO ] [REMOTE ] PSQH: Full fetch complete (53567 records). [2025-10-15T21:04:23.487545] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-15T21:04:23.855837] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-15T21:04:23.855911] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-15T21:04:23.856754] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-15T21:04:23.856814] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-15T21:04:23.857816] [DEBUG] [LOCAL ] PSQH: Trimmed 53567 records to 35505 (keeping 200 days of data) [2025-10-15T21:04:24.054936] [DEBUG] [LOCAL ] PSQH: Primary data saved (35505 records). [2025-10-15T21:04:24.055062] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-15T21:04:24.055139] [INFO ] [MAIN ] Update Progress: 1739/2369 symbols completed. PSQH took 34.2s. Estimated remaining: 1h 28m 31s. Rate: 7.1 symbols/min [2025-10-15T21:04:24.117395] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-15T21:04:24.224635] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:24.224843] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-15T21:04:24.224950] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-15T21:04:24.225062] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-15T21:04:24.225104] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-15T21:04:24.225145] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-15T21:04:24.225178] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-15T21:04:24.579074] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:24.607079] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T21:04:24.913958] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-15T21:04:25.312896] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T21:04:25.356595] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T21:04:25.713991] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-15T21:04:26.224145] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T21:04:26.514024] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-15T21:04:27.181036] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T21:04:27.313966] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-15T21:04:27.558139] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T21:04:28.113999] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-15T21:04:28.913977] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-15T21:04:29.141060] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T21:04:29.323198] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T21:04:29.464787] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T21:04:29.714016] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-15T21:04:30.514010] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-15T21:04:31.313978] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-15T21:04:31.590608] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T21:04:31.722130] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T21:04:31.983812] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T21:04:32.114050] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-15T21:04:32.914030] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-15T21:04:33.274352] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T21:04:33.714065] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-15T21:04:34.514058] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-15T21:04:34.760820] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-15T21:04:34.806363] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T21:04:35.314014] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-15T21:04:35.468841] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T21:04:36.114042] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-15T21:04:36.448297] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T21:04:36.914023] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-15T21:04:37.714014] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-15T21:04:37.865630] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T21:04:38.052421] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T21:04:38.513971] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-15T21:04:38.878325] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T21:04:39.313967] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-15T21:04:39.461449] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T21:04:39.754132] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T21:04:39.756861] [INFO ] [REMOTE ] PSTL: Full fetch complete (29506 records). [2025-10-15T21:04:39.756946] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-15T21:04:39.757413] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:04:39.757515] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:04:39.757558] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:04:39.757597] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-15T21:04:39.757701] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-15T21:04:39.757753] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-15T21:04:39.757796] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-15T21:04:39.757850] [INFO ] [MAIN ] Update Progress: 1740/2369 symbols completed. PSTL took 32.1s. Estimated remaining: 1h 28m 25s. Rate: 7.1 symbols/min [2025-10-15T21:04:39.930840] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:39.931025] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-15T21:04:39.931063] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-15T21:04:39.931176] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-15T21:04:39.931221] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-15T21:04:39.931307] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-15T21:04:39.931347] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-15T21:04:40.119213] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-15T21:04:40.292523] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:40.914001] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-15T21:04:41.714033] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-15T21:04:41.887113] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T21:04:42.130879] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-15T21:04:42.514002] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-15T21:04:43.218974] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T21:04:43.313970] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-15T21:04:44.113980] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-15T21:04:44.547519] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-15T21:04:44.833202] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T21:04:44.913993] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-15T21:04:45.714001] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-15T21:04:46.130130] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-15T21:04:46.206569] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T21:04:46.514017] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-15T21:04:47.253674] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:04:47.259488] [INFO ] [REMOTE ] PSTG: Full fetch complete (76320 records). [2025-10-15T21:04:47.259604] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-15T21:04:47.260394] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:04:47.260482] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:04:47.260525] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:04:47.260590] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-15T21:04:47.260677] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-15T21:04:47.260732] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-15T21:04:47.260775] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-15T21:04:47.260832] [INFO ] [MAIN ] Update Progress: 1741/2369 symbols completed. PSTG took 44.6s. Estimated remaining: 1h 28m 16s. Rate: 7.1 symbols/min [2025-10-15T21:04:47.320490] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-15T21:04:47.430742] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:47.430977] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-15T21:04:47.431079] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-15T21:04:47.431266] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-15T21:04:47.431311] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-15T21:04:47.431355] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-15T21:04:47.431393] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-15T21:04:47.559571] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T21:04:47.860176] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:48.114049] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-15T21:04:48.484255] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T21:04:48.914006] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-15T21:04:49.714031] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-15T21:04:49.861074] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T21:04:50.514045] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-15T21:04:50.631926] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T21:04:50.853014] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T21:04:51.314028] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-15T21:04:51.617744] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T21:04:52.114007] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-15T21:04:52.913971] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-15T21:04:52.974834] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T21:04:53.714038] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-15T21:04:54.076810] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T21:04:54.156573] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T21:04:54.513993] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-15T21:04:55.289799] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:04:55.313964] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-15T21:04:56.031618] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:04:56.034021] [INFO ] [REMOTE ] PTA: Full fetch complete (22507 records). [2025-10-15T21:04:56.034181] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-15T21:04:56.034735] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:04:56.034831] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:04:56.034878] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:04:56.034944] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-15T21:04:56.035028] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-15T21:04:56.035083] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-15T21:04:56.035143] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-15T21:04:56.035197] [INFO ] [MAIN ] Update Progress: 1742/2369 symbols completed. PTA took 32.0s. Estimated remaining: 1h 28m 8s. Rate: 7.1 symbols/min [2025-10-15T21:04:56.121191] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-15T21:04:56.213158] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:04:56.213445] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-15T21:04:56.213547] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-15T21:04:56.213701] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-15T21:04:56.213753] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-15T21:04:56.213796] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-15T21:04:56.213828] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-15T21:04:56.572433] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:04:56.602515] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-15T21:04:56.914011] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-15T21:04:57.352210] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T21:04:57.714006] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-15T21:04:58.287892] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:04:58.513987] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-15T21:04:59.314065] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-15T21:04:59.686300] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T21:05:00.114050] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-15T21:05:00.208263] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T21:05:00.914021] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-15T21:05:01.136309] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T21:05:01.399042] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T21:05:01.714049] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-15T21:05:01.737318] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T21:05:01.743516] [INFO ] [REMOTE ] PSX: Full fetch complete (76773 records). [2025-10-15T21:05:01.743724] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-15T21:05:01.744543] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:01.744634] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:01.744731] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:01.744817] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-15T21:05:01.744897] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-15T21:05:01.744946] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-15T21:05:01.745002] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-15T21:05:01.745076] [INFO ] [MAIN ] Update Progress: 1743/2369 symbols completed. PSX took 41.6s. Estimated remaining: 1h 27m 59s. Rate: 7.1 symbols/min [2025-10-15T21:05:01.917581] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:01.917773] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-15T21:05:01.917835] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-15T21:05:01.917949] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-15T21:05:01.917996] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-15T21:05:01.918101] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-15T21:05:01.918165] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-15T21:05:02.269428] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:02.514050] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-15T21:05:03.314010] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-15T21:05:03.549710] [DEBUG] [REMOTE ] PVH: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T21:05:03.550064] [WARN ] [REMOTE ] PVH: No data returned for month 2024-12 [2025-10-15T21:05:03.550185] [FATAL] [REMOTE ] PVH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:05:03.550265] [FATAL] [MAIN ] PVH: Failed to fetch primary data. [2025-10-15T21:05:03.550331] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:05:03.550405] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-15T21:05:03.550477] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-15T21:05:03.550547] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-15T21:05:03.550628] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-15T21:05:03.550731] [INFO ] [MAIN ] Update Progress: 1744/2369 symbols completed. PVH took 1.8s. Estimated remaining: 1h 27m 48s. Rate: 7.1 symbols/min [2025-10-15T21:05:03.802336] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-15T21:05:03.839291] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:03.847460] [DEBUG] [LOCAL ] PVL: Loaded 4715 existing records from primary storage. [2025-10-15T21:05:03.847724] [INFO ] [MAIN ] PVL: Loaded 4715 existing records. [2025-10-15T21:05:04.065403] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:05:04.065840] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-15T21:05:04.065905] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-15T21:05:04.066365] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-15T21:05:04.066428] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-15T21:05:04.136581] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-15T21:05:04.182192] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T21:05:04.481179] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:04.914000] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-15T21:05:05.714046] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-15T21:05:06.008485] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T21:05:06.092754] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T21:05:06.328988] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T21:05:06.514005] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-15T21:05:07.314062] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-15T21:05:07.998182] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T21:05:08.113984] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-15T21:05:08.491104] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T21:05:08.496288] [INFO ] [REMOTE ] PTY: Full fetch complete (53812 records). [2025-10-15T21:05:08.496419] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-15T21:05:08.497087] [FATAL] [VALIDATOR ] PTY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:08.497177] [FATAL] [MAIN ] PTY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:08.497218] [WARN ] [MAIN ] PTY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:08.497266] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-15T21:05:08.497320] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-15T21:05:08.497355] [INFO ] [LOCAL ] PTY: Starting deletion of derivative data. [2025-10-15T21:05:08.497393] [DEBUG] [LOCAL ] PTY: No derivative data file found to delete. [2025-10-15T21:05:08.497487] [INFO ] [MAIN ] Update Progress: 1745/2369 symbols completed. PTY took 28.7s. Estimated remaining: 1h 27m 38s. Rate: 7.1 symbols/min [2025-10-15T21:05:08.692628] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:08.693053] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-15T21:05:08.693142] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-15T21:05:08.693303] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-15T21:05:08.693395] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-15T21:05:08.693633] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-15T21:05:08.693801] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-15T21:05:08.920431] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-15T21:05:08.969863] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T21:05:09.321855] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:09.714049] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-15T21:05:09.753667] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T21:05:10.513963] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-15T21:05:11.170396] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T21:05:11.313962] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-15T21:05:11.498135] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T21:05:12.114037] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-15T21:05:12.801119] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T21:05:12.913990] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-15T21:05:13.074059] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T21:05:13.713982] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-15T21:05:14.513971] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-15T21:05:14.606747] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T21:05:15.313970] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-15T21:05:15.653791] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T21:05:16.113993] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-15T21:05:16.189047] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T21:05:16.596313] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T21:05:16.920189] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-15T21:05:16.936871] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T21:05:17.604516] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-15T21:05:17.713958] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-15T21:05:18.487791] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T21:05:18.513996] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-15T21:05:19.189565] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T21:05:19.314010] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-15T21:05:20.114075] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-15T21:05:20.913975] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-15T21:05:21.069823] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T21:05:21.559372] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T21:05:21.713993] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-15T21:05:21.971441] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T21:05:22.234506] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T21:05:22.514023] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-15T21:05:23.314088] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-15T21:05:24.114031] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-15T21:05:24.272527] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T21:05:24.502474] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T21:05:24.696490] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T21:05:24.697560] [INFO ] [REMOTE ] PVL: Full fetch complete (7176 records). [2025-10-15T21:05:24.697630] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-15T21:05:24.923010] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-15T21:05:25.050702] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-15T21:05:25.050785] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-15T21:05:25.050966] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-15T21:05:25.051006] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-15T21:05:25.051419] [DEBUG] [LOCAL ] PVL: Trimmed 7176 records to 4725 (keeping 200 days of data) [2025-10-15T21:05:25.079249] [DEBUG] [LOCAL ] PVL: Primary data saved (4725 records). [2025-10-15T21:05:25.079383] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-15T21:05:25.079465] [INFO ] [MAIN ] Update Progress: 1746/2369 symbols completed. PVL took 21.5s. Estimated remaining: 1h 27m 33s. Rate: 7.1 symbols/min [2025-10-15T21:05:25.253466] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:25.253707] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-15T21:05:25.253758] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-15T21:05:25.253872] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-15T21:05:25.253914] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-15T21:05:25.253956] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-15T21:05:25.253989] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-15T21:05:25.606862] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:25.714005] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-15T21:05:26.514021] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-15T21:05:27.286254] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T21:05:27.314005] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-15T21:05:27.332146] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T21:05:27.337713] [INFO ] [REMOTE ] PUK: Full fetch complete (64996 records). [2025-10-15T21:05:27.337949] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-15T21:05:27.339688] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:27.339807] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:27.339853] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:27.339900] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-15T21:05:27.339967] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-15T21:05:27.340008] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-15T21:05:27.340050] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-15T21:05:27.340118] [INFO ] [MAIN ] Update Progress: 1747/2369 symbols completed. PUK took 40.1s. Estimated remaining: 1h 27m 22s. Rate: 7.1 symbols/min [2025-10-15T21:05:27.529293] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:27.529499] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-15T21:05:27.529537] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-15T21:05:27.529679] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-15T21:05:27.529738] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-15T21:05:27.529782] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-15T21:05:27.529814] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-15T21:05:27.880059] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:28.113973] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-15T21:05:28.378022] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:05:28.378483] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-15T21:05:28.378599] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:05:28.378714] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-15T21:05:28.378797] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:05:28.378888] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-15T21:05:28.378972] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-15T21:05:28.379043] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-15T21:05:28.379125] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-15T21:05:28.379211] [INFO ] [MAIN ] Update Progress: 1748/2369 symbols completed. PXED took 1.0s. Estimated remaining: 1h 27m 11s. Rate: 7.1 symbols/min [2025-10-15T21:05:28.555663] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:28.555971] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-15T21:05:28.556050] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-15T21:05:28.556294] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-15T21:05:28.556349] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-15T21:05:28.556428] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-15T21:05:28.556492] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-15T21:05:28.891956] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T21:05:28.932929] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-15T21:05:28.973603] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:29.597741] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (4.67 seconds). [2025-10-15T21:05:29.714013] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-15T21:05:30.514051] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-15T21:05:31.313981] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-15T21:05:31.682261] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T21:05:31.962077] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-10-15T21:05:32.030464] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T21:05:32.066440] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T21:05:32.113985] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-15T21:05:32.914026] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-15T21:05:33.589404] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T21:05:33.714035] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-15T21:05:34.513987] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-15T21:05:34.710208] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T21:05:35.201624] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T21:05:35.313974] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-15T21:05:35.419057] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T21:05:36.114002] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-15T21:05:36.913986] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-15T21:05:37.171068] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T21:05:37.401471] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T21:05:37.698035] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T21:05:37.713954] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-15T21:05:38.514132] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-15T21:05:39.314049] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-15T21:05:39.446869] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T21:05:40.114040] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-15T21:05:40.236102] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T21:05:40.363411] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T21:05:40.914041] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-15T21:05:41.714063] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-15T21:05:42.013877] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T21:05:42.514034] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-15T21:05:42.623061] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T21:05:43.066135] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-15T21:05:43.313999] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-15T21:05:44.113998] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-15T21:05:44.235121] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T21:05:44.703330] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T21:05:44.819826] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:05:44.825402] [INFO ] [REMOTE ] PUMP: Full fetch complete (71388 records). [2025-10-15T21:05:44.825552] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-15T21:05:44.826292] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:44.826383] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:44.826427] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:44.826503] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-15T21:05:44.826582] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-15T21:05:44.826630] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-15T21:05:44.826731] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-15T21:05:44.826815] [INFO ] [MAIN ] Update Progress: 1749/2369 symbols completed. PUMP took 48.8s. Estimated remaining: 1h 27m 5s. Rate: 7.1 symbols/min [2025-10-15T21:05:44.919215] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-15T21:05:45.006189] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:45.033886] [DEBUG] [LOCAL ] QD: Loaded 27589 existing records from primary storage. [2025-10-15T21:05:45.034149] [INFO ] [MAIN ] QD: Loaded 27589 existing records. [2025-10-15T21:05:45.213433] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:05:45.213709] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-15T21:05:45.213772] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-15T21:05:45.214030] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-15T21:05:45.214085] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-15T21:05:45.563847] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:45.713987] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-15T21:05:46.459196] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T21:05:46.514005] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-15T21:05:47.159784] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T21:05:47.314005] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-15T21:05:48.014159] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T21:05:48.113955] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-15T21:05:48.914007] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-15T21:05:49.532017] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-15T21:05:49.713966] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-15T21:05:49.823322] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T21:05:49.898630] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T21:05:50.093594] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T21:05:50.098755] [INFO ] [REMOTE ] PWR: Full fetch complete (68840 records). [2025-10-15T21:05:50.098868] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-15T21:05:50.099638] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:50.099750] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:50.099793] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:50.099875] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-15T21:05:50.099954] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-15T21:05:50.099990] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-15T21:05:50.100030] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-15T21:05:50.100086] [INFO ] [MAIN ] Update Progress: 1750/2369 symbols completed. PWR took 41.6s. Estimated remaining: 1h 26m 56s. Rate: 7.1 symbols/min [2025-10-15T21:05:50.264558] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:50.264752] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-15T21:05:50.264808] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-15T21:05:50.264915] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-15T21:05:50.264956] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-15T21:05:50.264997] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-15T21:05:50.265029] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-15T21:05:50.519141] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-15T21:05:50.613210] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:51.313991] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-15T21:05:51.810454] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T21:05:52.114001] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-15T21:05:52.913972] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-15T21:05:53.118157] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T21:05:53.157824] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T21:05:53.224769] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-15T21:05:53.228198] [INFO ] [REMOTE ] PX: Full fetch complete (50063 records). [2025-10-15T21:05:53.228278] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-15T21:05:53.228899] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:53.228989] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:53.229063] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:53.229151] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-15T21:05:53.229230] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-15T21:05:53.229267] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-15T21:05:53.229308] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-15T21:05:53.229361] [INFO ] [MAIN ] Update Progress: 1751/2369 symbols completed. PX took 28.1s. Estimated remaining: 1h 26m 45s. Rate: 7.1 symbols/min [2025-10-15T21:05:53.397027] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:05:53.397208] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-15T21:05:53.397245] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-15T21:05:53.397380] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-15T21:05:53.397445] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-15T21:05:53.397495] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-15T21:05:53.397528] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-15T21:05:53.719131] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-15T21:05:53.778239] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:05:54.514066] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-15T21:05:55.313976] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-15T21:05:55.451264] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:05:55.513562] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T21:05:56.113962] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-15T21:05:56.170583] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T21:05:56.913998] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-15T21:05:57.714107] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-15T21:05:58.144613] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T21:05:58.514004] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-15T21:05:58.659102] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T21:05:58.833952] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-15T21:05:59.314017] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-15T21:05:59.935783] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T21:05:59.985328] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:05:59.991229] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-15T21:05:59.991349] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-15T21:05:59.992164] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:05:59.992258] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:05:59.992302] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:05:59.992341] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-15T21:05:59.992398] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-15T21:05:59.992433] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-15T21:05:59.992474] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-15T21:05:59.992529] [INFO ] [MAIN ] Update Progress: 1752/2369 symbols completed. QBTS took 31.6s. Estimated remaining: 1h 26m 36s. Rate: 7.1 symbols/min [2025-10-15T21:06:00.119121] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-15T21:06:00.167746] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:06:00.167936] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-15T21:06:00.167980] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-15T21:06:00.168172] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-15T21:06:00.168259] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-15T21:06:00.168326] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-15T21:06:00.168373] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-15T21:06:00.519575] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:06:00.914008] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-15T21:06:01.713988] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-15T21:06:02.517777] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-15T21:06:02.521580] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-15T21:06:02.819027] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T21:06:03.136939] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T21:06:03.314010] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-15T21:06:04.110228] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T21:06:04.118740] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-15T21:06:04.913989] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-15T21:06:05.437525] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T21:06:05.716346] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-15T21:06:05.721919] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T21:06:05.844052] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T21:06:06.514008] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-15T21:06:07.313999] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-15T21:06:07.556517] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T21:06:08.023474] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T21:06:08.096956] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:06:08.113953] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-15T21:06:08.914002] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-15T21:06:09.714024] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-15T21:06:09.983170] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T21:06:10.412627] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T21:06:10.513997] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-15T21:06:11.314042] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-15T21:06:11.569341] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:06:11.631453] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T21:06:12.113995] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-15T21:06:12.914004] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-15T21:06:12.958906] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T21:06:13.713990] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-15T21:06:14.142721] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-15T21:06:14.514003] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-15T21:06:14.703370] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T21:06:14.779176] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T21:06:15.314042] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-15T21:06:16.008913] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:06:16.114013] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-15T21:06:16.914001] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-15T21:06:17.066329] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T21:06:17.193043] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T21:06:17.198510] [INFO ] [REMOTE ] QD: Full fetch complete (40008 records). [2025-10-15T21:06:17.198709] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-15T21:06:17.730243] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-15T21:06:17.734211] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-15T21:06:17.735309] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-15T21:06:17.736879] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-15T21:06:17.737096] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-15T21:06:17.738631] [DEBUG] [LOCAL ] QD: Trimmed 40008 records to 27493 (keeping 200 days of data) [2025-10-15T21:06:17.915457] [DEBUG] [LOCAL ] QD: Primary data saved (27493 records). [2025-10-15T21:06:17.915594] [INFO ] [MAIN ] QD: Full history saved. [2025-10-15T21:06:17.915697] [INFO ] [MAIN ] Update Progress: 1753/2369 symbols completed. QD took 33.1s. Estimated remaining: 1h 26m 31s. Rate: 7.1 symbols/min [2025-10-15T21:06:18.109408] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:06:18.109622] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-15T21:06:18.109698] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-15T21:06:18.109822] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-15T21:06:18.109865] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-15T21:06:18.109908] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-15T21:06:18.109972] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-15T21:06:18.479704] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:06:18.513963] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-15T21:06:19.302408] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-15T21:06:19.314527] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-15T21:06:19.643177] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T21:06:20.114014] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-15T21:06:20.218258] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T21:06:20.914002] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-15T21:06:21.085630] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T21:06:21.682784] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:06:21.713980] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-15T21:06:22.498752] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T21:06:22.513994] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-15T21:06:23.313992] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-15T21:06:23.581285] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T21:06:24.114004] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-15T21:06:24.741315] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-15T21:06:24.911165] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T21:06:24.919292] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-15T21:06:25.663485] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:06:25.713964] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-15T21:06:26.274616] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T21:06:26.514055] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-15T21:06:27.314026] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-15T21:06:27.356498] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T21:06:28.113991] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-15T21:06:28.924723] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-15T21:06:28.950018] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-15T21:06:29.017604] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T21:06:29.377273] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T21:06:29.717760] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-15T21:06:29.721794] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T21:06:29.727896] [INFO ] [REMOTE ] QSR: Full fetch complete (75631 records). [2025-10-15T21:06:29.728001] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-15T21:06:29.728872] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:06:29.728980] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:06:29.729024] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:06:29.729063] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-15T21:06:29.729120] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-15T21:06:29.729155] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-15T21:06:29.729194] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-15T21:06:29.729250] [INFO ] [MAIN ] Update Progress: 1754/2369 symbols completed. QSR took 29.7s. Estimated remaining: 1h 26m 24s. Rate: 7.1 symbols/min [2025-10-15T21:06:29.897064] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:06:29.919410] [DEBUG] [LOCAL ] QUAD: Loaded 23359 existing records from primary storage. [2025-10-15T21:06:29.919700] [INFO ] [MAIN ] QUAD: Loaded 23359 existing records. [2025-10-15T21:06:30.090472] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:06:30.090690] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-15T21:06:30.090749] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-15T21:06:30.091023] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-15T21:06:30.091080] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-15T21:06:30.432303] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:06:30.513982] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-15T21:06:31.314061] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-15T21:06:31.422195] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T21:06:31.791165] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T21:06:32.113986] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-15T21:06:32.914004] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-15T21:06:33.577260] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T21:06:33.713965] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-15T21:06:33.740211] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:06:33.745907] [INFO ] [REMOTE ] QGEN: Full fetch complete (70103 records). [2025-10-15T21:06:33.746028] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-15T21:06:33.746797] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:06:33.746886] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:06:33.746951] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:06:33.747023] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-15T21:06:33.747086] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-15T21:06:33.747121] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-15T21:06:33.747159] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-15T21:06:33.747216] [INFO ] [MAIN ] Update Progress: 1755/2369 symbols completed. QGEN took 43.6s. Estimated remaining: 1h 26m 14s. Rate: 7.1 symbols/min [2025-10-15T21:06:33.917878] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:06:33.918031] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-15T21:06:33.918068] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-15T21:06:33.918215] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-15T21:06:33.918276] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-15T21:06:33.918322] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-15T21:06:33.918356] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-15T21:06:34.280315] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:06:34.320262] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-10-15T21:06:34.513997] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-15T21:06:34.924292] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T21:06:35.303102] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T21:06:35.313950] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-15T21:06:36.046503] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T21:06:36.114025] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-15T21:06:36.914044] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-15T21:06:37.714032] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-15T21:06:37.753027] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T21:06:38.061188] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T21:06:38.375880] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T21:06:38.514020] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-15T21:06:39.314011] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-15T21:06:40.113969] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-15T21:06:40.160631] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T21:06:40.168401] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T21:06:40.914062] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-15T21:06:41.711857] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T21:06:41.714437] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-15T21:06:42.513977] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-15T21:06:42.551712] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T21:06:42.608033] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-15T21:06:42.994088] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:06:42.999015] [INFO ] [REMOTE ] QTWO: Full fetch complete (57678 records). [2025-10-15T21:06:42.999114] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-15T21:06:42.999708] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:06:42.999790] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:06:42.999831] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:06:42.999869] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-15T21:06:42.999946] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-15T21:06:43.000010] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-15T21:06:43.000071] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-15T21:06:43.000143] [INFO ] [MAIN ] Update Progress: 1756/2369 symbols completed. QTWO took 25.1s. Estimated remaining: 1h 26m 6s. Rate: 7.1 symbols/min [2025-10-15T21:06:43.164380] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:06:43.171610] [DEBUG] [LOCAL ] QVCD: Loaded 4713 existing records from primary storage. [2025-10-15T21:06:43.171836] [INFO ] [MAIN ] QVCD: Loaded 4713 existing records. [2025-10-15T21:06:43.325476] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-15T21:06:43.346999] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:06:43.347900] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-15T21:06:43.347971] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-15T21:06:43.348182] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-15T21:06:43.348247] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-15T21:06:43.692184] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:06:44.113972] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-15T21:06:44.292464] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T21:06:44.785969] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T21:06:44.914047] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-15T21:06:45.714055] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-15T21:06:46.419770] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T21:06:46.514017] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-15T21:06:47.012205] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T21:06:47.314106] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-15T21:06:47.583100] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-15T21:06:47.992709] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T21:06:48.113993] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-15T21:06:48.755231] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T21:06:48.913958] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-15T21:06:49.714065] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-15T21:06:49.767660] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T21:06:50.514015] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-15T21:06:50.569281] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T21:06:51.235021] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T21:06:51.314103] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-15T21:06:52.116436] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-15T21:06:52.119251] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T21:06:52.601282] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:06:52.607264] [INFO ] [REMOTE ] QS: Full fetch complete (77530 records). [2025-10-15T21:06:52.607385] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-15T21:06:52.608153] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:06:52.608249] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:06:52.608293] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:06:52.608358] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-15T21:06:52.608421] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-15T21:06:52.608456] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-15T21:06:52.608493] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-15T21:06:52.608548] [INFO ] [MAIN ] Update Progress: 1757/2369 symbols completed. QS took 59.4s. Estimated remaining: 1h 25m 58s. Rate: 7.1 symbols/min [2025-10-15T21:06:52.913988] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-15T21:06:53.714030] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-15T21:06:54.235863] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T21:06:54.342053] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-15T21:06:54.514007] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-15T21:06:55.314030] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-15T21:06:55.341544] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T21:06:56.113992] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-15T21:06:56.513786] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T21:06:56.648789] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T21:06:56.650743] [INFO ] [REMOTE ] QVCC: Full fetch complete (12075 records). [2025-10-15T21:06:56.650821] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-15T21:06:56.651231] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:06:56.651315] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:06:56.651470] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:06:56.651546] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-15T21:06:56.651609] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-15T21:06:56.651670] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-15T21:06:56.651737] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-15T21:06:56.651794] [INFO ] [MAIN ] Update Progress: 1758/2369 symbols completed. QVCC took 22.9s. Estimated remaining: 1h 25m 48s. Rate: 7.1 symbols/min [2025-10-15T21:06:56.914007] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-15T21:06:57.633136] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T21:06:57.714014] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-15T21:06:58.271598] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T21:06:58.513999] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-15T21:06:59.313990] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-15T21:06:59.663951] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T21:07:00.016747] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T21:07:00.018469] [INFO ] [REMOTE ] QVCD: Full fetch complete (6294 records). [2025-10-15T21:07:00.018545] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-15T21:07:00.119071] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-15T21:07:00.419244] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-15T21:07:00.419336] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-15T21:07:00.419558] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-15T21:07:00.419610] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-15T21:07:00.420157] [DEBUG] [LOCAL ] QVCD: Trimmed 6294 records to 4697 (keeping 200 days of data) [2025-10-15T21:07:00.450230] [DEBUG] [LOCAL ] QVCD: Primary data saved (4697 records). [2025-10-15T21:07:00.450366] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-15T21:07:00.450449] [INFO ] [MAIN ] Update Progress: 1759/2369 symbols completed. QVCD took 17.5s. Estimated remaining: 1h 25m 38s. Rate: 7.1 symbols/min [2025-10-15T21:07:01.605457] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:07:01.612924] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-15T21:07:02.766067] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T21:07:02.771404] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-15T21:07:03.950179] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T21:07:03.955046] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-15T21:07:05.211124] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T21:07:05.217249] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-15T21:07:06.385587] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T21:07:06.390257] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-15T21:07:07.355681] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T21:07:07.358598] [INFO ] [REMOTE ] QUAD: Full fetch complete (34121 records). [2025-10-15T21:07:07.358703] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-15T21:07:07.732853] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-15T21:07:07.732929] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-15T21:07:07.733592] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-15T21:07:07.733678] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-15T21:07:07.734414] [DEBUG] [LOCAL ] QUAD: Trimmed 34121 records to 23361 (keeping 200 days of data) [2025-10-15T21:07:07.869232] [DEBUG] [LOCAL ] QUAD: Primary data saved (23361 records). [2025-10-15T21:07:07.869361] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-15T21:07:07.869441] [INFO ] [MAIN ] Update Progress: 1760/2369 symbols completed. QUAD took 38.1s. Estimated remaining: 1h 25m 29s. Rate: 7.1 symbols/min [2025-10-15T21:07:08.521932] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:08.535531] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:08.542311] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-15T21:07:08.542445] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-15T21:07:08.546297] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-15T21:07:08.556781] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-15T21:07:08.545394] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-15T21:07:08.556988] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-15T21:07:08.578638] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-15T21:07:08.625018] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-15T21:07:08.618697] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:08.625862] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-15T21:07:08.646789] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-15T21:07:08.606760] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-15T21:07:08.668117] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-15T21:07:08.646705] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:08.667979] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-15T21:07:08.668440] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-15T21:07:08.668558] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-15T21:07:08.677344] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-15T21:07:08.682610] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-15T21:07:08.668380] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-15T21:07:08.722347] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-15T21:07:08.752584] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-15T21:07:08.766957] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-15T21:07:08.767132] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-15T21:07:08.807411] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-15T21:07:08.852581] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-15T21:07:10.381601] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:10.449389] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:10.453627] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:10.459249] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-15T21:07:10.459538] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-15T21:07:10.443593] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-15T21:07:10.540574] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:10.541173] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-15T21:07:11.535123] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T21:07:11.540343] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-15T21:07:11.630946] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T21:07:11.637766] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-15T21:07:11.758179] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T21:07:11.763522] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-15T21:07:12.249438] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T21:07:12.259342] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-15T21:07:12.300921] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T21:07:12.305632] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-15T21:07:12.726884] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T21:07:12.733797] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-15T21:07:12.913523] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T21:07:12.920625] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-15T21:07:13.522959] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T21:07:13.718332] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-15T21:07:13.733212] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T21:07:13.783372] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T21:07:14.513967] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-15T21:07:14.572381] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T21:07:14.600706] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T21:07:15.314042] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-15T21:07:16.113984] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-15T21:07:16.192401] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T21:07:16.252216] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T21:07:16.914053] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-15T21:07:17.696709] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T21:07:17.713949] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-15T21:07:18.513991] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-15T21:07:18.795219] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:07:19.313997] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-15T21:07:19.387276] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T21:07:19.596071] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T21:07:20.114007] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-15T21:07:20.914035] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-15T21:07:21.034292] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T21:07:21.713969] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-15T21:07:21.989807] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:07:22.048992] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T21:07:22.514046] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-15T21:07:23.306967] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T21:07:23.313944] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-15T21:07:23.768369] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T21:07:24.114003] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-15T21:07:24.539142] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T21:07:24.914003] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-15T21:07:25.103949] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T21:07:25.714071] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-15T21:07:26.513970] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-15T21:07:26.906124] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T21:07:27.010456] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T21:07:27.313995] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-15T21:07:27.739581] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T21:07:28.113998] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-15T21:07:28.611810] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T21:07:28.914003] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-15T21:07:29.713996] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-15T21:07:30.118784] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T21:07:30.146908] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T21:07:30.514033] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-15T21:07:31.269699] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T21:07:31.313986] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-15T21:07:31.612340] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T21:07:31.721628] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T21:07:31.726502] [INFO ] [REMOTE ] RACE: Full fetch complete (48335 records). [2025-10-15T21:07:31.726622] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-15T21:07:31.727286] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:07:31.727370] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:07:31.727413] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:07:31.727453] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-15T21:07:31.727509] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-15T21:07:31.727545] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-15T21:07:31.727585] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-15T21:07:31.727639] [INFO ] [MAIN ] Update Progress: 1761/2369 symbols completed. RACE took 23.9s. Estimated remaining: 1h 25m 26s. Rate: 7.1 symbols/min [2025-10-15T21:07:31.910577] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:31.910786] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-15T21:07:31.910830] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-15T21:07:31.910987] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-15T21:07:31.911035] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-15T21:07:31.911076] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-15T21:07:31.911109] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-15T21:07:32.119110] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-15T21:07:32.263022] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:32.914056] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-15T21:07:33.714037] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-15T21:07:34.240393] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T21:07:34.357470] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T21:07:34.513974] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-15T21:07:35.262745] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T21:07:35.313963] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-15T21:07:35.978492] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T21:07:36.113992] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-15T21:07:36.575869] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T21:07:36.914014] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-15T21:07:37.228875] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T21:07:37.713999] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-15T21:07:37.814582] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T21:07:38.513969] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-15T21:07:39.120383] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T21:07:39.124027] [INFO ] [REMOTE ] R: Full fetch complete (42124 records). [2025-10-15T21:07:39.124130] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-15T21:07:39.124776] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:07:39.124882] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:07:39.124926] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:07:39.124964] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-15T21:07:39.125018] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-15T21:07:39.125066] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-15T21:07:39.125154] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-15T21:07:39.125229] [INFO ] [MAIN ] Update Progress: 1762/2369 symbols completed. R took 31.2s. Estimated remaining: 1h 25m 17s. Rate: 7.1 symbols/min [2025-10-15T21:07:39.297395] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:39.297592] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-15T21:07:39.297630] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-15T21:07:39.297762] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-15T21:07:39.297805] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-15T21:07:39.297848] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-15T21:07:39.297882] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-15T21:07:39.319159] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-15T21:07:39.656639] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:39.918584] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-15T21:07:39.979115] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T21:07:39.981928] [INFO ] [REMOTE ] RA: Full fetch complete (31634 records). [2025-10-15T21:07:39.982010] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-15T21:07:39.982513] [FATAL] [VALIDATOR ] RA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:07:39.982594] [FATAL] [MAIN ] RA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:07:39.982636] [WARN ] [MAIN ] RA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:07:39.982717] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-15T21:07:39.982776] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-15T21:07:39.982810] [INFO ] [LOCAL ] RA: Starting deletion of derivative data. [2025-10-15T21:07:39.982848] [DEBUG] [LOCAL ] RA: No derivative data file found to delete. [2025-10-15T21:07:39.982902] [INFO ] [MAIN ] Update Progress: 1763/2369 symbols completed. RA took 32.1s. Estimated remaining: 1h 25m 6s. Rate: 7.1 symbols/min [2025-10-15T21:07:40.125179] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-15T21:07:40.158026] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:40.158230] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-15T21:07:40.158274] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-15T21:07:40.158382] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-15T21:07:40.158425] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-15T21:07:40.158468] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-15T21:07:40.158502] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-15T21:07:40.533637] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:40.914043] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-15T21:07:41.714030] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-15T21:07:42.064580] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T21:07:42.362017] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-15T21:07:42.513997] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-15T21:07:43.314021] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-15T21:07:43.362907] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T21:07:44.113975] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-15T21:07:44.593072] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T21:07:44.914056] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-15T21:07:44.999522] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:07:45.381098] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T21:07:45.388073] [INFO ] [REMOTE ] QXO: Full fetch complete (75740 records). [2025-10-15T21:07:45.388327] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-15T21:07:45.389615] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:07:45.389759] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:07:45.389854] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:07:45.389936] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-15T21:07:45.390013] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-15T21:07:45.390052] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-15T21:07:45.390097] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-15T21:07:45.390162] [INFO ] [MAIN ] Update Progress: 1764/2369 symbols completed. QXO took 37.5s. Estimated remaining: 1h 24m 57s. Rate: 7.1 symbols/min [2025-10-15T21:07:45.577939] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:45.578704] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-15T21:07:45.578762] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-15T21:07:45.578972] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-15T21:07:45.579026] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-15T21:07:45.579071] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-15T21:07:45.579105] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-15T21:07:45.730769] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-15T21:07:45.932064] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T21:07:46.031704] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:46.514042] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-15T21:07:46.815610] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T21:07:47.314097] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-15T21:07:48.096394] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T21:07:48.113973] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-15T21:07:48.354418] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T21:07:48.914039] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-15T21:07:49.658791] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T21:07:49.714050] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-15T21:07:49.968944] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T21:07:50.514005] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-15T21:07:51.313986] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-15T21:07:51.408002] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T21:07:51.878055] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T21:07:52.114021] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-15T21:07:52.913974] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-15T21:07:53.217746] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T21:07:53.713978] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-15T21:07:53.809263] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-15T21:07:54.226357] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T21:07:54.410875] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T21:07:54.513986] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-15T21:07:55.314049] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-15T21:07:56.068756] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:07:56.113990] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-15T21:07:56.834713] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:07:56.840479] [INFO ] [REMOTE ] RAMP: Full fetch complete (54075 records). [2025-10-15T21:07:56.840674] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-15T21:07:56.841589] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:07:56.841703] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:07:56.841751] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:07:56.841822] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-15T21:07:56.841895] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-15T21:07:56.841933] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-15T21:07:56.841981] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-15T21:07:56.842045] [INFO ] [MAIN ] Update Progress: 1765/2369 symbols completed. RAMP took 25.1s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-15T21:07:56.919118] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-15T21:07:57.018441] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:07:57.028048] [DEBUG] [LOCAL ] RBOT: Loaded 6003 existing records from primary storage. [2025-10-15T21:07:57.028377] [INFO ] [MAIN ] RBOT: Loaded 6003 existing records. [2025-10-15T21:07:57.214985] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:07:57.215520] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-15T21:07:57.215696] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-15T21:07:57.216138] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-15T21:07:57.216202] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-15T21:07:57.541007] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T21:07:57.632899] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:07:57.713975] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-15T21:07:58.105077] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T21:07:58.514049] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-15T21:07:59.314025] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-15T21:07:59.460731] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T21:08:00.028156] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-15T21:08:00.113996] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-15T21:08:00.778962] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T21:08:00.913995] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-15T21:08:01.242135] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T21:08:01.714090] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-15T21:08:02.514075] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-15T21:08:02.947687] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-15T21:08:03.313986] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-15T21:08:03.566763] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T21:08:03.752026] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T21:08:04.113981] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-15T21:08:04.189296] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T21:08:04.913998] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-15T21:08:05.713984] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-15T21:08:05.757817] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T21:08:06.114536] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T21:08:06.513988] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-15T21:08:06.724340] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T21:08:07.235222] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T21:08:07.313986] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-15T21:08:07.742957] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T21:08:07.745316] [INFO ] [REMOTE ] RBC: Full fetch complete (21561 records). [2025-10-15T21:08:07.745415] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-15T21:08:07.745929] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:08:07.746009] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:08:07.746055] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:08:07.746122] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-15T21:08:07.746197] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-15T21:08:07.746233] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-15T21:08:07.746271] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-15T21:08:07.746352] [INFO ] [MAIN ] Update Progress: 1766/2369 symbols completed. RBC took 27.8s. Estimated remaining: 1h 24m 42s. Rate: 7.1 symbols/min [2025-10-15T21:08:07.912375] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:07.912565] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-15T21:08:07.912603] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-15T21:08:07.912738] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-15T21:08:07.912780] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-15T21:08:07.912820] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-15T21:08:07.912851] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-15T21:08:08.119402] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-15T21:08:08.257270] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:08.913991] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-15T21:08:09.713985] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-15T21:08:10.018196] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T21:08:10.514016] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-15T21:08:11.313979] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-15T21:08:11.400453] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-15T21:08:11.768924] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T21:08:11.817703] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T21:08:12.114008] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-15T21:08:12.309744] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T21:08:12.914002] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-15T21:08:13.714008] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-15T21:08:14.322605] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-15T21:08:14.514028] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-15T21:08:14.838297] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T21:08:15.297434] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T21:08:15.319168] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-15T21:08:15.333611] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T21:08:16.114002] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-15T21:08:16.913983] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-15T21:08:17.239120] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T21:08:17.713965] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-15T21:08:17.880407] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T21:08:18.318177] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T21:08:18.514013] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-15T21:08:19.303310] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T21:08:19.313942] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-15T21:08:19.550748] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-15T21:08:20.113972] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-15T21:08:20.164382] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T21:08:20.914060] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-15T21:08:21.713984] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-15T21:08:22.072993] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T21:08:22.467231] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T21:08:22.513983] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-15T21:08:22.641958] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T21:08:23.314029] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-15T21:08:23.448361] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T21:08:23.450734] [INFO ] [REMOTE ] RBOT: Full fetch complete (9228 records). [2025-10-15T21:08:23.450828] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-15T21:08:23.823829] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-15T21:08:23.823911] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-15T21:08:23.824154] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-15T21:08:23.824194] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-15T21:08:23.824598] [DEBUG] [LOCAL ] RBOT: Trimmed 9228 records to 6064 (keeping 200 days of data) [2025-10-15T21:08:23.859179] [DEBUG] [LOCAL ] RBOT: Primary data saved (6064 records). [2025-10-15T21:08:23.859292] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-15T21:08:23.859380] [INFO ] [MAIN ] Update Progress: 1767/2369 symbols completed. RBOT took 27.0s. Estimated remaining: 1h 24m 36s. Rate: 7.1 symbols/min [2025-10-15T21:08:24.028322] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:24.073243] [DEBUG] [LOCAL ] RC: Loaded 48924 existing records from primary storage. [2025-10-15T21:08:24.073544] [INFO ] [MAIN ] RC: Loaded 48924 existing records. [2025-10-15T21:08:24.126214] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-15T21:08:24.247910] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:08:24.248148] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-15T21:08:24.248205] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-15T21:08:24.248757] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-15T21:08:24.248813] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-15T21:08:24.593099] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:24.914081] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-15T21:08:25.393557] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T21:08:25.714021] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-15T21:08:25.778621] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T21:08:26.513996] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-15T21:08:26.796631] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T21:08:27.251282] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:08:27.314014] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-15T21:08:28.114011] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-15T21:08:28.913992] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-15T21:08:28.998470] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-15T21:08:29.170036] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T21:08:29.347794] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T21:08:29.353534] [INFO ] [REMOTE ] RBA: Full fetch complete (65857 records). [2025-10-15T21:08:29.353932] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-15T21:08:29.355405] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:08:29.355515] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:08:29.355586] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:08:29.355701] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-15T21:08:29.355793] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-15T21:08:29.355833] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-15T21:08:29.355875] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-15T21:08:29.355947] [INFO ] [MAIN ] Update Progress: 1768/2369 symbols completed. RBA took 50.2s. Estimated remaining: 1h 24m 27s. Rate: 7.1 symbols/min [2025-10-15T21:08:29.534838] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:29.535117] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-15T21:08:29.535160] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-15T21:08:29.535289] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-15T21:08:29.535362] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-15T21:08:29.535406] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-15T21:08:29.535440] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-15T21:08:29.726351] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-15T21:08:29.932936] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:29.967564] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T21:08:30.513974] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-15T21:08:30.567238] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T21:08:30.573342] [INFO ] [REMOTE ] RBLX: Full fetch complete (77495 records). [2025-10-15T21:08:30.573464] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-15T21:08:30.574272] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:08:30.574359] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:08:30.574404] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:08:30.574442] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-15T21:08:30.574497] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-15T21:08:30.574531] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-15T21:08:30.574569] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-15T21:08:30.574624] [INFO ] [MAIN ] Update Progress: 1769/2369 symbols completed. RBLX took 45.2s. Estimated remaining: 1h 24m 16s. Rate: 7.1 symbols/min [2025-10-15T21:08:30.746207] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:30.746427] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-15T21:08:30.746470] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-15T21:08:30.746589] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-15T21:08:30.746660] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-15T21:08:30.746728] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-15T21:08:30.746764] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-15T21:08:31.089251] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:31.314013] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-15T21:08:32.113983] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-15T21:08:32.253204] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T21:08:32.281069] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T21:08:32.594738] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T21:08:32.913980] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-15T21:08:33.714048] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-15T21:08:34.474756] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T21:08:34.513950] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-15T21:08:34.990743] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T21:08:35.042632] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T21:08:35.313999] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-15T21:08:35.906464] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T21:08:36.114065] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-15T21:08:36.914011] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-15T21:08:37.713989] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-15T21:08:37.771471] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T21:08:38.265075] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-15T21:08:38.362230] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T21:08:38.514005] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-15T21:08:39.151443] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T21:08:39.313989] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-15T21:08:39.958574] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T21:08:40.114011] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-15T21:08:40.914045] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-15T21:08:41.714016] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-15T21:08:42.040172] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T21:08:42.109112] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-15T21:08:42.514031] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-15T21:08:42.969336] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T21:08:43.225128] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T21:08:43.314015] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-15T21:08:44.113997] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-15T21:08:44.742399] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T21:08:44.914013] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-15T21:08:45.208941] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T21:08:45.523261] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T21:08:45.714044] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-15T21:08:46.514082] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-15T21:08:47.069197] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T21:08:47.314020] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-15T21:08:48.019742] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T21:08:48.045131] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-15T21:08:48.114029] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-15T21:08:48.621092] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-15T21:08:48.914039] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-15T21:08:49.328769] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-15T21:08:49.714034] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-15T21:08:50.392664] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T21:08:50.514044] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-15T21:08:51.136960] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T21:08:51.314026] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-15T21:08:51.607170] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-15T21:08:51.607944] [INFO ] [REMOTE ] RCB: Full fetch complete (3725 records). [2025-10-15T21:08:51.608047] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-15T21:08:51.608553] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:08:51.608638] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:08:51.608717] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:08:51.608770] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-15T21:08:51.608848] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-15T21:08:51.608885] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-15T21:08:51.608925] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-15T21:08:51.608977] [INFO ] [MAIN ] Update Progress: 1770/2369 symbols completed. RCB took 22.3s. Estimated remaining: 1h 24m 12s. Rate: 7.1 symbols/min [2025-10-15T21:08:51.774895] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:51.775078] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-15T21:08:51.775133] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-15T21:08:51.775241] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-15T21:08:51.775283] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-15T21:08:51.775326] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-15T21:08:51.775361] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-15T21:08:52.120737] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-15T21:08:52.120638] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:52.801325] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:08:52.807248] [INFO ] [REMOTE ] RBRK: Full fetch complete (76305 records). [2025-10-15T21:08:52.807378] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-15T21:08:52.808208] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:08:52.808298] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:08:52.808345] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:08:52.808430] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-15T21:08:52.808511] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-15T21:08:52.808560] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-15T21:08:52.808616] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-15T21:08:52.808738] [INFO ] [MAIN ] Update Progress: 1771/2369 symbols completed. RBRK took 45.1s. Estimated remaining: 1h 24m 1s. Rate: 7.1 symbols/min [2025-10-15T21:08:52.919103] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-15T21:08:53.011075] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:53.011244] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-15T21:08:53.011282] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-15T21:08:53.011393] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-15T21:08:53.011437] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-15T21:08:53.011480] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-15T21:08:53.011514] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-15T21:08:53.427489] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:53.714026] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-15T21:08:54.514001] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-15T21:08:54.714799] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T21:08:55.180179] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T21:08:55.314015] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-15T21:08:55.388678] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:08:55.628087] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-15T21:08:55.628952] [INFO ] [REMOTE ] RCD: Full fetch complete (6335 records). [2025-10-15T21:08:55.629021] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-15T21:08:55.629367] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:08:55.629445] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:08:55.629488] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:08:55.629526] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-15T21:08:55.629579] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-15T21:08:55.629612] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-15T21:08:55.629682] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-15T21:08:55.629753] [INFO ] [MAIN ] Update Progress: 1772/2369 symbols completed. RCD took 25.1s. Estimated remaining: 1h 23m 50s. Rate: 7.1 symbols/min [2025-10-15T21:08:55.795330] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:08:55.807989] [DEBUG] [LOCAL ] RCS: Loaded 12206 existing records from primary storage. [2025-10-15T21:08:55.808204] [INFO ] [MAIN ] RCS: Loaded 12206 existing records. [2025-10-15T21:08:55.981629] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:08:55.981898] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-15T21:08:55.981952] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-15T21:08:55.982126] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-15T21:08:55.982165] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-15T21:08:56.119111] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-15T21:08:56.330042] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:08:56.914024] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-15T21:08:57.713976] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-15T21:08:58.043035] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T21:08:58.195977] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-15T21:08:58.514048] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-15T21:08:59.303507] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:08:59.314411] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-15T21:08:59.704005] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T21:09:00.114294] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-15T21:09:00.914001] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-15T21:09:01.713986] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-15T21:09:01.852024] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-15T21:09:01.994566] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T21:09:01.995615] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T21:09:02.514005] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-15T21:09:03.319166] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-15T21:09:03.341078] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T21:09:04.114022] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-15T21:09:04.248430] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T21:09:04.502000] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T21:09:04.914048] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-15T21:09:05.714015] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-15T21:09:05.936159] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T21:09:06.327639] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T21:09:06.513996] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-15T21:09:06.668574] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T21:09:07.313966] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-15T21:09:07.357359] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T21:09:08.114024] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-15T21:09:08.914028] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-15T21:09:09.120114] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T21:09:09.566895] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-15T21:09:09.713967] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-15T21:09:10.432866] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T21:09:10.513992] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-15T21:09:11.314073] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-15T21:09:11.873111] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T21:09:12.114005] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-15T21:09:12.186523] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:09:12.913991] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-15T21:09:13.142375] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T21:09:13.714004] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-15T21:09:14.199794] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-15T21:09:14.514038] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-15T21:09:14.578039] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T21:09:15.314005] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-15T21:09:15.359120] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T21:09:16.114039] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-15T21:09:16.701854] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-15T21:09:16.863734] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T21:09:16.914007] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-15T21:09:17.008013] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T21:09:17.714047] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-15T21:09:18.514001] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-15T21:09:18.860610] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T21:09:19.174631] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T21:09:19.314065] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-15T21:09:19.411259] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T21:09:20.113999] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-15T21:09:20.211463] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T21:09:20.914087] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-15T21:09:21.714123] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-15T21:09:21.864436] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T21:09:22.514040] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-15T21:09:22.633179] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T21:09:22.639572] [INFO ] [REMOTE ] RC: Full fetch complete (71087 records). [2025-10-15T21:09:22.639760] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-15T21:09:23.040444] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-15T21:09:23.040555] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-15T21:09:23.041741] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-15T21:09:23.041806] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-15T21:09:23.043430] [DEBUG] [LOCAL ] RC: Trimmed 71087 records to 48911 (keeping 200 days of data) [2025-10-15T21:09:23.320508] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-15T21:09:23.337564] [DEBUG] [LOCAL ] RC: Primary data saved (48911 records). [2025-10-15T21:09:23.337731] [INFO ] [MAIN ] RC: Full history saved. [2025-10-15T21:09:23.338755] [INFO ] [MAIN ] Update Progress: 1773/2369 symbols completed. RC took 59.5s. Estimated remaining: 1h 23m 48s. Rate: 7.1 symbols/min [2025-10-15T21:09:23.517341] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:09:23.518539] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T21:09:23.521469] [INFO ] [REMOTE ] RCS: Full fetch complete (19286 records). [2025-10-15T21:09:23.521352] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-15T21:09:23.521835] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-15T21:09:23.521782] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-15T21:09:23.522003] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-15T21:09:23.522070] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-15T21:09:23.522292] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-15T21:09:23.523104] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-15T21:09:24.185995] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T21:09:24.258296] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-15T21:09:24.258582] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-15T21:09:24.279074] [INFO ] [REMOTE ] RCI: Full fetch complete (70328 records). [2025-10-15T21:09:24.279260] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-15T21:09:24.280219] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-15T21:09:24.280760] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-15T21:09:24.281942] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:09:24.289985] [DEBUG] [LOCAL ] RCS: Trimmed 19286 records to 12292 (keeping 200 days of data) [2025-10-15T21:09:24.296216] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-15T21:09:24.288290] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:09:24.318998] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:09:24.393450] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-15T21:09:24.425796] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-15T21:09:24.444142] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-15T21:09:24.457893] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-15T21:09:24.425321] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:09:24.458127] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-15T21:09:24.466037] [INFO ] [MAIN ] Update Progress: 1774/2369 symbols completed. RCI took 32.9s. Estimated remaining: 1h 23m 38s. Rate: 7.1 symbols/min [2025-10-15T21:09:24.546723] [DEBUG] [LOCAL ] RCS: Primary data saved (12292 records). [2025-10-15T21:09:24.563811] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-15T21:09:24.571135] [INFO ] [MAIN ] Update Progress: 1775/2369 symbols completed. RCS took 28.9s. Estimated remaining: 1h 23m 26s. Rate: 7.1 symbols/min [2025-10-15T21:09:24.842922] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:09:24.852232] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-15T21:09:24.868371] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-15T21:09:24.872153] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-15T21:09:24.871981] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:09:24.872362] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-15T21:09:24.872520] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-15T21:09:24.872759] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-15T21:09:24.872898] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-15T21:09:24.872701] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-15T21:09:24.904139] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-15T21:09:24.926757] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-15T21:09:24.920893] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-15T21:09:24.949825] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-15T21:09:24.955084] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-15T21:09:25.624464] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:09:25.638438] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:09:25.671551] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T21:09:25.713956] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-15T21:09:26.472312] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T21:09:26.513969] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-15T21:09:26.543326] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:09:26.549028] [INFO ] [REMOTE ] RCL: Full fetch complete (75074 records). [2025-10-15T21:09:26.549167] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-15T21:09:26.550005] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:09:26.550093] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:09:26.550135] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:09:26.550201] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-15T21:09:26.550300] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-15T21:09:26.550366] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-15T21:09:26.550421] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-15T21:09:26.550480] [INFO ] [MAIN ] Update Progress: 1776/2369 symbols completed. RCL took 33.7s. Estimated remaining: 1h 23m 16s. Rate: 7.1 symbols/min [2025-10-15T21:09:26.724708] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:09:26.724900] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-15T21:09:26.724939] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-15T21:09:26.725055] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-15T21:09:26.725098] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-15T21:09:26.725142] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-15T21:09:26.725175] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-15T21:09:27.073068] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:09:27.313976] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-15T21:09:28.031765] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T21:09:28.114005] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-15T21:09:28.914024] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-15T21:09:29.619857] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-15T21:09:29.680708] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T21:09:29.713973] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-15T21:09:30.513987] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-15T21:09:30.636988] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T21:09:31.314035] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-15T21:09:31.798076] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-15T21:09:32.105393] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:09:32.114699] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-15T21:09:32.629239] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T21:09:32.914047] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-15T21:09:33.714024] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-15T21:09:34.319767] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-15T21:09:34.386494] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T21:09:34.514043] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-15T21:09:35.314016] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-15T21:09:35.501005] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T21:09:36.114032] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-15T21:09:36.651854] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-15T21:09:36.913997] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-15T21:09:36.949040] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T21:09:37.696104] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:09:37.713952] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-15T21:09:38.514034] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-15T21:09:39.313996] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-15T21:09:39.414465] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-15T21:09:39.564410] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T21:09:40.114048] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-15T21:09:40.651105] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T21:09:40.914067] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-15T21:09:41.041168] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T21:09:41.713975] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-15T21:09:41.888738] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T21:09:42.514128] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-15T21:09:42.915497] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T21:09:43.314044] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-15T21:09:44.114001] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-15T21:09:44.180697] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:09:44.256562] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-15T21:09:44.816625] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T21:09:44.914019] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-15T21:09:45.713981] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-15T21:09:45.910685] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T21:09:46.089319] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T21:09:46.514054] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-15T21:09:47.325257] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-15T21:09:47.331678] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T21:09:48.113996] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-15T21:09:48.702790] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-15T21:09:48.914068] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-15T21:09:48.952232] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T21:09:49.546667] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T21:09:49.714003] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-15T21:09:50.514022] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-15T21:09:51.314031] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-15T21:09:51.365563] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T21:09:51.449259] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-15T21:09:52.114031] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-15T21:09:52.164357] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T21:09:52.170629] [INFO ] [REMOTE ] RCUS: Full fetch complete (60336 records). [2025-10-15T21:09:52.170821] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-15T21:09:52.171618] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:09:52.171752] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:09:52.171823] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:09:52.171895] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-15T21:09:52.171961] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-15T21:09:52.171996] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-15T21:09:52.172035] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-15T21:09:52.172091] [INFO ] [MAIN ] Update Progress: 1777/2369 symbols completed. RCUS took 28.8s. Estimated remaining: 1h 23m 13s. Rate: 7.1 symbols/min [2025-10-15T21:09:52.338973] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:09:52.339132] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-15T21:09:52.339168] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-15T21:09:52.339281] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-15T21:09:52.339321] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-15T21:09:52.339362] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-15T21:09:52.339396] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-15T21:09:52.699077] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:09:52.738572] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-15T21:09:52.914005] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-15T21:09:53.714050] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-15T21:09:54.513967] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-15T21:09:54.635204] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T21:09:54.794701] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T21:09:55.314004] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-15T21:09:55.706210] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T21:09:56.018951] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-15T21:09:56.113965] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-15T21:09:56.913997] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-15T21:09:57.000038] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T21:09:57.430329] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T21:09:57.435242] [INFO ] [REMOTE ] RDN: Full fetch complete (65692 records). [2025-10-15T21:09:57.435338] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-15T21:09:57.436056] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:09:57.436142] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:09:57.436183] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:09:57.436239] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-15T21:09:57.436298] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-15T21:09:57.436332] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-15T21:09:57.436371] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-15T21:09:57.436425] [INFO ] [MAIN ] Update Progress: 1778/2369 symbols completed. RDN took 32.9s. Estimated remaining: 1h 23m 4s. Rate: 7.1 symbols/min [2025-10-15T21:09:57.602393] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:09:57.602520] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-15T21:09:57.602557] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-15T21:09:57.602685] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-15T21:09:57.602738] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-15T21:09:57.602780] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-15T21:09:57.602812] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-15T21:09:57.719125] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-15T21:09:57.950896] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:09:58.186224] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-15T21:09:58.514021] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-15T21:09:59.078939] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T21:09:59.314055] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-15T21:10:00.102259] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:10:00.113957] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-15T21:10:00.914015] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-15T21:10:01.714000] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-15T21:10:01.715679] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T21:10:01.724270] [INFO ] [REMOTE ] RDW: Full fetch complete (75019 records). [2025-10-15T21:10:01.752698] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-15T21:10:01.755274] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T21:10:01.765824] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:10:01.766545] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:10:01.768552] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:10:01.768755] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-15T21:10:01.768878] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-15T21:10:01.768951] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-15T21:10:01.769134] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-15T21:10:01.769364] [INFO ] [MAIN ] Update Progress: 1779/2369 symbols completed. RDW took 35.2s. Estimated remaining: 1h 22m 54s. Rate: 7.1 symbols/min [2025-10-15T21:10:01.965760] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:02.004554] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-15T21:10:02.056951] [DEBUG] [LOCAL ] RERE: Loaded 41504 existing records from primary storage. [2025-10-15T21:10:02.057435] [INFO ] [MAIN ] RERE: Loaded 41504 existing records. [2025-10-15T21:10:02.248515] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:10:02.248818] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-15T21:10:02.248871] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-15T21:10:02.249280] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-15T21:10:02.249320] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-15T21:10:02.519168] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-15T21:10:02.642310] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:03.314100] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-15T21:10:03.624935] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T21:10:04.114007] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-15T21:10:04.257987] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T21:10:04.539315] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T21:10:04.914001] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-15T21:10:05.714029] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-15T21:10:05.928836] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T21:10:06.514049] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-15T21:10:06.744232] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T21:10:06.811068] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T21:10:07.314004] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-15T21:10:08.114004] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-15T21:10:08.310680] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T21:10:08.914035] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-15T21:10:09.145378] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T21:10:09.203293] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T21:10:09.713997] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-15T21:10:10.513981] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-15T21:10:10.783118] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T21:10:11.314000] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-15T21:10:11.442088] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T21:10:12.113997] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-15T21:10:12.787403] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T21:10:12.914086] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-15T21:10:12.986395] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-15T21:10:13.665050] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T21:10:13.713982] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-15T21:10:14.514106] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-15T21:10:14.603611] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T21:10:14.884054] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T21:10:15.313999] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-15T21:10:16.114038] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-15T21:10:16.913993] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-15T21:10:17.183202] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-15T21:10:17.245516] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T21:10:17.284362] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-15T21:10:17.714039] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-15T21:10:18.413789] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T21:10:18.514012] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-15T21:10:19.314005] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-15T21:10:20.114039] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-15T21:10:20.466452] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T21:10:20.517914] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-15T21:10:20.701290] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T21:10:20.914007] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-15T21:10:21.714015] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-15T21:10:21.774366] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T21:10:22.414803] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T21:10:22.514013] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-15T21:10:22.552630] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T21:10:22.558614] [INFO ] [REMOTE ] RDDT: Full fetch complete (77538 records). [2025-10-15T21:10:22.558761] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-15T21:10:22.559568] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:10:22.559681] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:10:22.559733] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:10:22.559782] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-15T21:10:22.559837] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-15T21:10:22.559871] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-15T21:10:22.559908] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-15T21:10:22.559961] [INFO ] [MAIN ] Update Progress: 1780/2369 symbols completed. RDDT took 58.1s. Estimated remaining: 1h 22m 49s. Rate: 7.1 symbols/min [2025-10-15T21:10:22.724812] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:22.769577] [DEBUG] [LOCAL ] RES: Loaded 46978 existing records from primary storage. [2025-10-15T21:10:22.769904] [INFO ] [MAIN ] RES: Loaded 46978 existing records. [2025-10-15T21:10:22.943035] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:10:22.943222] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-15T21:10:22.943267] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-15T21:10:22.943734] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-15T21:10:22.943795] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-15T21:10:23.293876] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:23.313956] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-15T21:10:23.330442] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T21:10:23.336755] [INFO ] [REMOTE ] RELX: Full fetch complete (67799 records). [2025-10-15T21:10:23.336914] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-15T21:10:23.337637] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:10:23.337749] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:10:23.337792] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:10:23.337856] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-15T21:10:23.337921] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-15T21:10:23.337956] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-15T21:10:23.337994] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-15T21:10:23.338049] [INFO ] [MAIN ] Update Progress: 1781/2369 symbols completed. RELX took 25.9s. Estimated remaining: 1h 22m 38s. Rate: 7.1 symbols/min [2025-10-15T21:10:23.532230] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:23.532453] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-15T21:10:23.532500] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-15T21:10:23.532615] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-15T21:10:23.532691] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-15T21:10:23.532750] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-15T21:10:23.532784] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-15T21:10:23.965826] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:24.114011] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-15T21:10:24.913979] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-15T21:10:25.069482] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T21:10:25.651152] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:10:25.656332] [INFO ] [REMOTE ] RDY: Full fetch complete (68554 records). [2025-10-15T21:10:25.656446] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-15T21:10:25.657293] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:10:25.657404] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:10:25.657447] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:10:25.657486] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-15T21:10:25.657541] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-15T21:10:25.657576] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-15T21:10:25.657615] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-15T21:10:25.657696] [INFO ] [MAIN ] Update Progress: 1782/2369 symbols completed. RDY took 33.5s. Estimated remaining: 1h 22m 28s. Rate: 7.1 symbols/min [2025-10-15T21:10:25.719321] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-15T21:10:25.856955] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:25.857554] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-15T21:10:25.858806] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T21:10:25.867619] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-15T21:10:25.867772] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-15T21:10:25.867816] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-15T21:10:25.867858] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-15T21:10:25.867890] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-15T21:10:26.226105] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:26.514012] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-15T21:10:27.313990] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-15T21:10:27.494096] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T21:10:27.935406] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T21:10:28.114023] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-15T21:10:28.864744] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T21:10:28.913968] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-15T21:10:29.519344] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T21:10:29.714006] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-15T21:10:30.514012] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-15T21:10:30.621693] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T21:10:31.313988] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-15T21:10:31.444269] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T21:10:32.106335] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T21:10:32.115485] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-15T21:10:32.161635] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T21:10:32.913989] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-15T21:10:33.715173] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-15T21:10:33.718284] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T21:10:33.952805] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T21:10:34.513988] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-15T21:10:35.313986] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-15T21:10:35.343282] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T21:10:36.113988] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-15T21:10:36.293207] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T21:10:36.341029] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T21:10:36.913977] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-15T21:10:37.493569] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T21:10:37.498767] [INFO ] [REMOTE ] RERE: Full fetch complete (57882 records). [2025-10-15T21:10:37.498870] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-15T21:10:37.721420] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-15T21:10:37.887500] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-15T21:10:37.887631] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-15T21:10:37.889191] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-15T21:10:37.889308] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-15T21:10:37.890504] [DEBUG] [LOCAL ] RERE: Trimmed 57882 records to 41543 (keeping 200 days of data) [2025-10-15T21:10:38.091817] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T21:10:38.132683] [DEBUG] [LOCAL ] RERE: Primary data saved (41543 records). [2025-10-15T21:10:38.132803] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-15T21:10:38.132897] [INFO ] [MAIN ] Update Progress: 1783/2369 symbols completed. RERE took 36.4s. Estimated remaining: 1h 22m 21s. Rate: 7.1 symbols/min [2025-10-15T21:10:38.302817] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:38.302991] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-15T21:10:38.303029] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-15T21:10:38.303173] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-15T21:10:38.303234] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-15T21:10:38.303282] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-15T21:10:38.303317] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-15T21:10:38.519405] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-15T21:10:38.670842] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:39.279432] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T21:10:39.313950] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-15T21:10:40.041823] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T21:10:40.113993] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-15T21:10:40.915115] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-15T21:10:40.920329] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T21:10:41.713992] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-15T21:10:41.933437] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T21:10:42.514050] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-15T21:10:42.744853] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T21:10:42.808082] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T21:10:43.314064] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-15T21:10:44.119127] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-15T21:10:44.134560] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T21:10:44.376335] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T21:10:44.914050] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-15T21:10:45.714041] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-15T21:10:45.861905] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:10:46.514013] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-15T21:10:46.552127] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T21:10:46.596052] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T21:10:47.314005] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-15T21:10:48.113982] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-15T21:10:48.274429] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T21:10:48.913965] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-15T21:10:48.955488] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T21:10:49.713978] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-15T21:10:49.751056] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T21:10:49.894048] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T21:10:50.514029] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-15T21:10:51.313967] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-15T21:10:51.424229] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T21:10:51.463630] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T21:10:52.114003] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-15T21:10:52.923970] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-15T21:10:52.927190] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T21:10:53.714076] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-15T21:10:53.753722] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T21:10:53.972581] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T21:10:54.514011] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-15T21:10:54.859021] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T21:10:54.861710] [INFO ] [REMOTE ] REX: Full fetch complete (20969 records). [2025-10-15T21:10:54.861797] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-15T21:10:54.862350] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:10:54.862447] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:10:54.862522] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:10:54.862611] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-15T21:10:54.862738] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-15T21:10:54.862793] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-15T21:10:54.862837] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-15T21:10:54.862895] [INFO ] [MAIN ] Update Progress: 1784/2369 symbols completed. REX took 29.2s. Estimated remaining: 1h 22m 15s. Rate: 7.1 symbols/min [2025-10-15T21:10:55.076973] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:55.077347] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-15T21:10:55.077400] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-15T21:10:55.077520] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-15T21:10:55.077587] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-15T21:10:55.077690] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-15T21:10:55.077755] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-15T21:10:55.315805] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-15T21:10:55.600563] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:55.639485] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T21:10:56.114051] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-15T21:10:56.914015] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-15T21:10:57.331126] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T21:10:57.620989] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T21:10:57.640513] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T21:10:57.644751] [INFO ] [REMOTE ] REVG: Full fetch complete (57828 records). [2025-10-15T21:10:57.644837] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-15T21:10:57.645455] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:10:57.645553] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:10:57.645624] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:10:57.645736] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-15T21:10:57.645810] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-15T21:10:57.645847] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-15T21:10:57.645887] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-15T21:10:57.645941] [INFO ] [MAIN ] Update Progress: 1785/2369 symbols completed. REVG took 34.3s. Estimated remaining: 1h 22m 5s. Rate: 7.1 symbols/min [2025-10-15T21:10:57.719139] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-15T21:10:57.820085] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:10:57.820251] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-15T21:10:57.820287] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-15T21:10:57.820428] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-15T21:10:57.820501] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-15T21:10:57.820559] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-15T21:10:57.820593] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-15T21:10:58.171721] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:10:58.514031] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-15T21:10:59.301882] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T21:10:59.313950] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-15T21:11:00.113964] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-15T21:11:00.389519] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T21:11:00.847188] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T21:11:00.913979] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-15T21:11:01.714044] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-15T21:11:01.839410] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T21:11:02.514030] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-15T21:11:02.670471] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T21:11:03.103749] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T21:11:03.112386] [INFO ] [REMOTE ] RES: Full fetch complete (68737 records). [2025-10-15T21:11:03.112602] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-15T21:11:03.324086] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-15T21:11:03.514571] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-15T21:11:03.514744] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-15T21:11:03.516352] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-15T21:11:03.516457] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-15T21:11:03.518443] [DEBUG] [LOCAL ] RES: Trimmed 68737 records to 46957 (keeping 200 days of data) [2025-10-15T21:11:03.815117] [DEBUG] [LOCAL ] RES: Primary data saved (46957 records). [2025-10-15T21:11:03.815324] [INFO ] [MAIN ] RES: Full history saved. [2025-10-15T21:11:03.815491] [INFO ] [MAIN ] Update Progress: 1786/2369 symbols completed. RES took 41.3s. Estimated remaining: 1h 21m 56s. Rate: 7.1 symbols/min [2025-10-15T21:11:03.995963] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:04.011907] [DEBUG] [LOCAL ] RFI: Loaded 10475 existing records from primary storage. [2025-10-15T21:11:04.012341] [INFO ] [MAIN ] RFI: Loaded 10475 existing records. [2025-10-15T21:11:04.119203] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-15T21:11:04.200086] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:11:04.200443] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-15T21:11:04.200637] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-15T21:11:04.201329] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-15T21:11:04.201396] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-15T21:11:04.614280] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:11:04.617258] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T21:11:04.914008] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-15T21:11:05.176158] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T21:11:05.713973] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-15T21:11:05.792501] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T21:11:06.359635] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T21:11:06.514012] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-15T21:11:07.325811] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-15T21:11:07.329332] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:11:07.495038] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T21:11:08.114069] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-15T21:11:08.914012] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-15T21:11:09.268867] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T21:11:09.714029] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-15T21:11:09.973344] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T21:11:10.520981] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-15T21:11:10.522429] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T21:11:11.112289] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T21:11:11.314015] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-15T21:11:12.114020] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-15T21:11:12.514876] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T21:11:12.707182] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T21:11:12.914027] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-15T21:11:13.527275] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T21:11:13.713959] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-15T21:11:14.513985] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-15T21:11:14.833421] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T21:11:14.927864] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T21:11:14.933713] [INFO ] [REMOTE ] REXR: Full fetch complete (74927 records). [2025-10-15T21:11:14.933856] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-15T21:11:14.934694] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:11:14.934786] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:11:14.934828] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:11:14.934866] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-15T21:11:14.934920] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-15T21:11:14.934954] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-15T21:11:14.934992] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-15T21:11:14.935048] [INFO ] [MAIN ] Update Progress: 1787/2369 symbols completed. REXR took 36.8s. Estimated remaining: 1h 21m 48s. Rate: 7.1 symbols/min [2025-10-15T21:11:15.102372] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:15.138983] [DEBUG] [LOCAL ] RFL: Loaded 11412 existing records from primary storage. [2025-10-15T21:11:15.140874] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:11:15.139702] [INFO ] [MAIN ] RFL: Loaded 11412 existing records. [2025-10-15T21:11:15.323519] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-15T21:11:15.328209] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:11:15.329187] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-15T21:11:15.329240] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-15T21:11:15.329544] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-15T21:11:15.329599] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-15T21:11:15.671709] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:11:16.113974] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-15T21:11:16.913989] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-15T21:11:17.217929] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T21:11:17.542046] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T21:11:17.713976] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-15T21:11:17.975927] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T21:11:18.136957] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T21:11:18.514005] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-15T21:11:19.314060] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-15T21:11:20.022559] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:11:20.028028] [INFO ] [REMOTE ] REZI: Full fetch complete (65762 records). [2025-10-15T21:11:20.028177] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-15T21:11:20.029044] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:11:20.029171] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:11:20.029225] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:11:20.029293] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-15T21:11:20.029367] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-15T21:11:20.029424] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-15T21:11:20.029467] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-15T21:11:20.029525] [INFO ] [MAIN ] Update Progress: 1788/2369 symbols completed. REZI took 25.2s. Estimated remaining: 1h 21m 39s. Rate: 7.1 symbols/min [2025-10-15T21:11:20.119284] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-15T21:11:20.202051] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:20.208711] [DEBUG] [LOCAL ] RFM: Loaded 4131 existing records from primary storage. [2025-10-15T21:11:20.208928] [INFO ] [MAIN ] RFM: Loaded 4131 existing records. [2025-10-15T21:11:20.388218] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:11:20.388514] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-15T21:11:20.388596] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-15T21:11:20.388892] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-15T21:11:20.388943] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-15T21:11:20.549162] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T21:11:20.650738] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T21:11:20.811322] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:11:20.913995] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-15T21:11:21.640144] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T21:11:21.714060] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-15T21:11:22.514013] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-15T21:11:23.163294] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T21:11:23.313990] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-15T21:11:23.498619] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T21:11:23.912046] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T21:11:24.114056] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-15T21:11:24.913981] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-15T21:11:25.051529] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T21:11:25.579055] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T21:11:25.713985] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-15T21:11:26.484278] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T21:11:26.513967] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-15T21:11:27.314037] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-15T21:11:27.436520] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T21:11:28.011454] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T21:11:28.114011] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-15T21:11:28.914033] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-15T21:11:28.923404] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T21:11:29.713978] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-15T21:11:29.792285] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T21:11:30.514014] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-15T21:11:31.279796] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T21:11:31.313963] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-15T21:11:31.531753] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T21:11:31.709180] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T21:11:32.114039] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-15T21:11:32.913998] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-15T21:11:33.025313] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T21:11:33.539092] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-15T21:11:33.714014] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-15T21:11:34.461980] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:11:34.470825] [INFO ] [REMOTE ] RF: Full fetch complete (77406 records). [2025-10-15T21:11:34.471016] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-15T21:11:34.472134] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:11:34.472245] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:11:34.472301] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:11:34.472385] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-15T21:11:34.472467] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-15T21:11:34.472515] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-15T21:11:34.472571] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-15T21:11:34.472675] [INFO ] [MAIN ] Update Progress: 1789/2369 symbols completed. RF took 36.8s. Estimated remaining: 1h 21m 32s. Rate: 7.1 symbols/min [2025-10-15T21:11:34.519109] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-15T21:11:34.652392] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:34.661963] [DEBUG] [LOCAL ] RFMZ: Loaded 8668 existing records from primary storage. [2025-10-15T21:11:34.662190] [INFO ] [MAIN ] RFMZ: Loaded 8668 existing records. [2025-10-15T21:11:34.840085] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:11:34.840299] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-15T21:11:34.840362] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-15T21:11:34.840817] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-15T21:11:34.840876] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-15T21:11:35.193714] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:11:35.313978] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-15T21:11:35.454211] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T21:11:36.113995] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-15T21:11:36.479626] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T21:11:36.913976] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-15T21:11:37.043692] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T21:11:37.486387] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T21:11:37.714018] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-15T21:11:38.513979] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-15T21:11:38.788523] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T21:11:39.313999] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-15T21:11:39.372934] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T21:11:40.090494] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T21:11:40.114023] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-15T21:11:40.840632] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T21:11:40.914060] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-15T21:11:41.711990] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T21:11:41.714168] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-15T21:11:42.514111] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-15T21:11:42.684227] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T21:11:43.313987] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-15T21:11:43.405032] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T21:11:44.114009] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-15T21:11:44.203553] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T21:11:44.913991] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-15T21:11:44.991311] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T21:11:45.613570] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T21:11:45.713998] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-15T21:11:46.513966] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-15T21:11:46.597709] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T21:11:47.314116] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-15T21:11:47.570746] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T21:11:47.919393] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T21:11:48.114061] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-15T21:11:48.852068] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:11:48.853684] [INFO ] [REMOTE ] RFI: Full fetch complete (15413 records). [2025-10-15T21:11:48.853757] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-15T21:11:48.919214] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-15T21:11:49.222961] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-15T21:11:49.223045] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-15T21:11:49.223399] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-15T21:11:49.223438] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-15T21:11:49.223945] [DEBUG] [LOCAL ] RFI: Trimmed 15413 records to 10434 (keeping 200 days of data) [2025-10-15T21:11:49.288158] [DEBUG] [LOCAL ] RFI: Primary data saved (10434 records). [2025-10-15T21:11:49.288290] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-15T21:11:49.288368] [INFO ] [MAIN ] Update Progress: 1790/2369 symbols completed. RFI took 45.5s. Estimated remaining: 1h 21m 26s. Rate: 7.1 symbols/min [2025-10-15T21:11:49.454966] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:49.455158] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-15T21:11:49.455195] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-15T21:11:49.455341] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-15T21:11:49.455413] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-15T21:11:49.455498] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-15T21:11:49.455541] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-15T21:11:49.715356] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-15T21:11:49.770720] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T21:11:49.849610] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:11:50.514042] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-15T21:11:50.571041] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T21:11:51.083973] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T21:11:51.085209] [INFO ] [REMOTE ] RFM: Full fetch complete (5838 records). [2025-10-15T21:11:51.085282] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-15T21:11:51.319281] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-15T21:11:51.459555] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-15T21:11:51.459683] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-15T21:11:51.459927] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-15T21:11:51.459973] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-15T21:11:51.460867] [DEBUG] [LOCAL ] RFM: Trimmed 5838 records to 4156 (keeping 200 days of data) [2025-10-15T21:11:51.488988] [DEBUG] [LOCAL ] RFM: Primary data saved (4156 records). [2025-10-15T21:11:51.489138] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-15T21:11:51.489231] [INFO ] [MAIN ] Update Progress: 1791/2369 symbols completed. RFM took 31.5s. Estimated remaining: 1h 21m 15s. Rate: 7.1 symbols/min [2025-10-15T21:11:51.662956] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:51.663134] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-15T21:11:51.663173] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-15T21:11:51.663284] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-15T21:11:51.663327] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-15T21:11:51.663368] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-15T21:11:51.663400] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-15T21:11:52.067285] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:11:52.114003] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-15T21:11:52.852119] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T21:11:52.914011] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-15T21:11:53.382803] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:11:53.714009] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-15T21:11:54.344130] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T21:11:54.514033] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-15T21:11:54.572215] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T21:11:55.314014] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-15T21:11:55.644091] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T21:11:56.046134] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T21:11:56.113987] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-15T21:11:56.913998] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-15T21:11:57.719061] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-15T21:11:57.732782] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T21:11:57.976512] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T21:11:58.498603] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T21:11:58.500307] [INFO ] [REMOTE ] RFL: Full fetch complete (13233 records). [2025-10-15T21:11:58.500402] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-15T21:11:58.521603] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-15T21:11:58.884117] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-15T21:11:58.884212] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-15T21:11:58.884667] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-15T21:11:58.884729] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-15T21:11:58.885351] [DEBUG] [LOCAL ] RFL: Trimmed 13233 records to 11445 (keeping 200 days of data) [2025-10-15T21:11:58.954517] [DEBUG] [LOCAL ] RFL: Primary data saved (11445 records). [2025-10-15T21:11:58.954673] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-15T21:11:58.954773] [INFO ] [MAIN ] Update Progress: 1792/2369 symbols completed. RFL took 44.0s. Estimated remaining: 1h 21m 7s. Rate: 7.1 symbols/min [2025-10-15T21:11:59.134023] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:11:59.138498] [DEBUG] [LOCAL ] RGT: Loaded 2710 existing records from primary storage. [2025-10-15T21:11:59.138684] [INFO ] [MAIN ] RGT: Loaded 2710 existing records. [2025-10-15T21:11:59.319259] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-15T21:11:59.324380] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:11:59.324786] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-15T21:11:59.324860] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-15T21:11:59.325060] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-15T21:11:59.325124] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-15T21:11:59.607481] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T21:11:59.687369] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:00.114002] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-15T21:12:00.457904] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T21:12:00.888058] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T21:12:00.890234] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12273 records). [2025-10-15T21:12:00.890323] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-15T21:12:00.919128] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-15T21:12:01.262698] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-15T21:12:01.262819] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-15T21:12:01.263179] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-15T21:12:01.263235] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-15T21:12:01.263702] [DEBUG] [LOCAL ] RFMZ: Trimmed 12273 records to 8716 (keeping 200 days of data) [2025-10-15T21:12:01.316418] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8716 records). [2025-10-15T21:12:01.316540] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-15T21:12:01.316628] [INFO ] [MAIN ] Update Progress: 1793/2369 symbols completed. RFMZ took 26.8s. Estimated remaining: 1h 20m 56s. Rate: 7.1 symbols/min [2025-10-15T21:12:01.480711] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:01.480904] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-15T21:12:01.480947] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-15T21:12:01.481073] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-15T21:12:01.481114] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-15T21:12:01.481155] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-15T21:12:01.481186] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-15T21:12:01.722470] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-15T21:12:01.865635] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:02.500431] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T21:12:02.513969] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-15T21:12:02.595596] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T21:12:03.038526] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T21:12:03.313994] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-15T21:12:03.843165] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T21:12:04.114026] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-15T21:12:04.789006] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T21:12:04.914036] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-15T21:12:05.714005] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-15T21:12:06.389490] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T21:12:06.514003] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-15T21:12:06.920530] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T21:12:07.129387] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T21:12:07.313992] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-15T21:12:08.114045] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-15T21:12:08.914028] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-15T21:12:08.980807] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T21:12:09.581923] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:12:09.714064] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-15T21:12:09.841431] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T21:12:10.265283] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T21:12:10.514059] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-15T21:12:11.314053] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-15T21:12:11.428925] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T21:12:11.848299] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T21:12:12.114052] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-15T21:12:12.914001] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-15T21:12:13.362979] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T21:12:13.713988] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-15T21:12:14.513979] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-15T21:12:14.516075] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T21:12:15.057007] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T21:12:15.131199] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T21:12:15.314008] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-15T21:12:15.880247] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T21:12:16.114029] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-15T21:12:16.914079] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-15T21:12:17.329774] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T21:12:17.713994] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-15T21:12:18.282685] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T21:12:18.434495] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T21:12:18.514020] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-15T21:12:18.970160] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T21:12:18.971464] [INFO ] [REMOTE ] RGT: Full fetch complete (4062 records). [2025-10-15T21:12:18.971557] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-15T21:12:19.319207] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-15T21:12:19.379472] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-15T21:12:19.379546] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-15T21:12:19.379707] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-15T21:12:19.379767] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-15T21:12:19.380114] [DEBUG] [LOCAL ] RGT: Trimmed 4062 records to 2747 (keeping 200 days of data) [2025-10-15T21:12:19.396605] [DEBUG] [LOCAL ] RGT: Primary data saved (2747 records). [2025-10-15T21:12:19.396735] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-15T21:12:19.396819] [INFO ] [MAIN ] Update Progress: 1794/2369 symbols completed. RGT took 20.4s. Estimated remaining: 1h 20m 51s. Rate: 7.1 symbols/min [2025-10-15T21:12:19.566545] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:19.566747] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-15T21:12:19.566794] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-15T21:12:19.566906] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-15T21:12:19.566949] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-15T21:12:19.566990] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-15T21:12:19.567022] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-15T21:12:19.918698] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:20.113994] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-15T21:12:20.914009] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-15T21:12:21.234451] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T21:12:21.677040] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T21:12:21.714003] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-15T21:12:22.116901] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T21:12:22.514000] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-15T21:12:23.146445] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:12:23.313999] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-15T21:12:23.633296] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T21:12:24.114051] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-15T21:12:24.732541] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T21:12:24.745882] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T21:12:24.749117] [INFO ] [REMOTE ] RGR: Full fetch complete (28769 records). [2025-10-15T21:12:24.749223] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-15T21:12:24.749799] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:12:24.749879] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:12:24.749922] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:12:24.749988] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-15T21:12:24.750049] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-15T21:12:24.750086] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-15T21:12:24.750124] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-15T21:12:24.750178] [INFO ] [MAIN ] Update Progress: 1795/2369 symbols completed. RGR took 33.3s. Estimated remaining: 1h 20m 41s. Rate: 7.1 symbols/min [2025-10-15T21:12:24.915127] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-15T21:12:24.915047] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:24.916068] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-15T21:12:24.916112] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-15T21:12:24.916214] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-15T21:12:24.916275] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-15T21:12:24.916353] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-15T21:12:24.916391] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-15T21:12:25.268010] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:25.714003] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-15T21:12:26.433982] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:12:26.437587] [INFO ] [REMOTE ] RGA: Full fetch complete (45070 records). [2025-10-15T21:12:26.437702] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-15T21:12:26.438258] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:12:26.438339] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:12:26.438382] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:12:26.438420] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-15T21:12:26.438472] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-15T21:12:26.438533] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-15T21:12:26.438575] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-15T21:12:26.438627] [INFO ] [MAIN ] Update Progress: 1796/2369 symbols completed. RGA took 37.2s. Estimated remaining: 1h 20m 31s. Rate: 7.1 symbols/min [2025-10-15T21:12:26.519106] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-15T21:12:26.611684] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:26.649967] [DEBUG] [LOCAL ] RHP: Loaded 40733 existing records from primary storage. [2025-10-15T21:12:26.650268] [INFO ] [MAIN ] RHP: Loaded 40733 existing records. [2025-10-15T21:12:26.832977] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:12:26.833277] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-15T21:12:26.833406] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-15T21:12:26.834350] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-15T21:12:26.834408] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-15T21:12:26.856053] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:12:26.856449] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-15T21:12:26.867183] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:12:26.867391] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-15T21:12:26.872731] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:12:26.900125] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-15T21:12:26.911587] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-15T21:12:26.934668] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-15T21:12:26.934794] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-15T21:12:26.937974] [INFO ] [MAIN ] Update Progress: 1797/2369 symbols completed. RHLD took 2.2s. Estimated remaining: 1h 20m 20s. Rate: 7.1 symbols/min [2025-10-15T21:12:27.013117] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-15T21:12:27.232105] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:27.313986] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-15T21:12:28.114015] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-15T21:12:28.855320] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:12:28.913965] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-15T21:12:29.714031] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-15T21:12:30.050548] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T21:12:30.133752] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T21:12:30.513991] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-15T21:12:30.903230] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T21:12:31.314059] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-15T21:12:32.114065] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-15T21:12:32.302098] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T21:12:32.927010] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-15T21:12:32.930047] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T21:12:33.376439] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T21:12:33.713996] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-15T21:12:34.514039] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-15T21:12:34.594090] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T21:12:35.057263] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T21:12:35.313995] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-15T21:12:35.886982] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T21:12:36.114080] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-15T21:12:36.913976] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-15T21:12:37.109725] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T21:12:37.714007] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-15T21:12:37.986554] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T21:12:38.514119] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-15T21:12:38.743560] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T21:12:39.180888] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:12:39.314072] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-15T21:12:39.981705] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:12:40.114470] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-15T21:12:40.914049] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-15T21:12:41.020916] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T21:12:41.713974] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-15T21:12:41.958781] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T21:12:42.215406] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T21:12:42.514072] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-15T21:12:43.314051] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-15T21:12:43.603505] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T21:12:43.658022] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T21:12:43.663123] [INFO ] [REMOTE ] RH: Full fetch complete (65648 records). [2025-10-15T21:12:43.663228] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-15T21:12:43.663926] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:12:43.664026] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:12:43.664105] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:12:43.664193] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-15T21:12:43.664268] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-15T21:12:43.664306] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-15T21:12:43.664347] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-15T21:12:43.664404] [INFO ] [MAIN ] Update Progress: 1798/2369 symbols completed. RH took 42.3s. Estimated remaining: 1h 20m 14s. Rate: 7.1 symbols/min [2025-10-15T21:12:44.068708] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T21:12:44.113954] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-15T21:12:44.914048] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-15T21:12:45.652242] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T21:12:45.714017] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-15T21:12:46.394062] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T21:12:46.513975] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-15T21:12:47.272091] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T21:12:47.313955] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-15T21:12:48.032526] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:12:48.037281] [INFO ] [REMOTE ] RHP: Full fetch complete (58063 records). [2025-10-15T21:12:48.037375] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-15T21:12:48.038066] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:12:48.038179] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:12:48.038230] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:12:48.038268] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-15T21:12:48.038321] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-15T21:12:48.038354] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-15T21:12:48.038531] [DEBUG] [LOCAL ] RHP: Deleted derivative data file. [2025-10-15T21:12:48.038620] [INFO ] [MAIN ] Update Progress: 1799/2369 symbols completed. RHP took 21.6s. Estimated remaining: 1h 20m 4s. Rate: 7.1 symbols/min [2025-10-15T21:12:48.207942] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T21:12:48.218853] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-15T21:12:48.888721] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:12:48.894487] [INFO ] [REMOTE ] RHI: Full fetch complete (70213 records). [2025-10-15T21:12:48.894599] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-15T21:12:48.895238] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:12:48.895320] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:12:48.895369] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:12:48.895430] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-15T21:12:48.895492] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-15T21:12:48.895526] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-15T21:12:48.895565] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-15T21:12:48.895619] [INFO ] [MAIN ] Update Progress: 1800/2369 symbols completed. RHI took 29.5s. Estimated remaining: 1h 19m 54s. Rate: 7.1 symbols/min [2025-10-15T21:12:49.478500] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:49.462862] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:49.533626] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-15T21:12:49.534420] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:49.547716] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-15T21:12:49.534574] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-15T21:12:49.547631] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-15T21:12:49.578823] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-15T21:12:49.581054] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-15T21:12:49.581868] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:12:49.580941] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-15T21:12:49.582469] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-15T21:12:49.582050] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-15T21:12:49.582572] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-15T21:12:49.582787] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-15T21:12:49.582851] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-15T21:12:49.583187] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-15T21:12:49.583264] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-15T21:12:49.583513] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-15T21:12:49.583400] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-15T21:12:49.583600] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-15T21:12:49.583449] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-15T21:12:50.335306] [DEBUG] [LOCAL ] RIG: Loaded 53674 existing records from primary storage. [2025-10-15T21:12:50.389724] [INFO ] [MAIN ] RIG: Loaded 53674 existing records. [2025-10-15T21:12:50.629453] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:50.685786] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-15T21:12:50.749571] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:50.761362] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-15T21:12:50.802298] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:50.839197] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-15T21:12:50.868594] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:12:50.869163] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-15T21:12:50.869217] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-15T21:12:50.870079] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-15T21:12:50.870137] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-15T21:12:51.208732] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:12:51.314066] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-15T21:12:51.864114] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T21:12:52.114098] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-15T21:12:52.861960] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T21:12:52.913954] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-15T21:12:53.000480] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-15T21:12:53.019991] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T21:12:53.476510] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-15T21:12:53.714031] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-15T21:12:54.514017] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-15T21:12:54.960513] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T21:12:55.204190] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T21:12:55.314040] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-15T21:12:55.859380] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-15T21:12:56.113959] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-15T21:12:56.187598] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T21:12:56.914050] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-15T21:12:57.713973] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-15T21:12:58.119595] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T21:12:58.513984] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-15T21:12:58.578211] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T21:12:58.748422] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T21:12:59.313985] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-15T21:13:00.113964] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-15T21:13:00.519198] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T21:13:00.914050] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-15T21:13:01.033233] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T21:13:01.647674] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-15T21:13:01.714004] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-15T21:13:02.514003] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-15T21:13:03.323101] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-15T21:13:03.326444] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-15T21:13:03.870400] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T21:13:03.903430] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T21:13:04.114044] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-15T21:13:04.439201] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T21:13:04.913961] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-15T21:13:05.294155] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T21:13:05.714047] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-15T21:13:06.513994] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-15T21:13:06.971304] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-15T21:13:07.314033] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-15T21:13:07.569911] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:13:07.941230] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-15T21:13:08.114017] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-15T21:13:08.898731] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T21:13:08.913947] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-15T21:13:09.714065] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-15T21:13:09.892602] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T21:13:10.514100] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-15T21:13:10.944973] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-15T21:13:11.314007] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-15T21:13:11.424248] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T21:13:11.453551] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T21:13:12.114031] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-15T21:13:12.914084] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-15T21:13:13.349389] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T21:13:13.714045] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-15T21:13:14.289746] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T21:13:14.514014] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-15T21:13:14.777727] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T21:13:15.313982] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-15T21:13:15.771687] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T21:13:16.114081] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-15T21:13:16.532055] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T21:13:16.895700] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T21:13:16.897939] [INFO ] [REMOTE ] RIV: Full fetch complete (17733 records). [2025-10-15T21:13:16.898012] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-15T21:13:16.898449] [FATAL] [VALIDATOR ] RIV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:13:16.898528] [FATAL] [MAIN ] RIV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:13:16.898572] [WARN ] [MAIN ] RIV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:13:16.898610] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-15T21:13:16.898697] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-15T21:13:16.898752] [INFO ] [LOCAL ] RIV: Starting deletion of derivative data. [2025-10-15T21:13:16.898795] [DEBUG] [LOCAL ] RIV: No derivative data file found to delete. [2025-10-15T21:13:16.898847] [INFO ] [MAIN ] Update Progress: 1801/2369 symbols completed. RIV took 28.0s. Estimated remaining: 1h 19m 51s. Rate: 7.1 symbols/min [2025-10-15T21:13:16.919971] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-15T21:13:17.073940] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:13:17.074253] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-15T21:13:17.074403] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-15T21:13:17.074537] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-15T21:13:17.074583] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-15T21:13:17.074625] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-15T21:13:17.074714] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-15T21:13:17.513479] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:13:17.544953] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T21:13:17.714047] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-15T21:13:18.514078] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-15T21:13:19.058335] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-15T21:13:19.292116] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T21:13:19.298313] [INFO ] [REMOTE ] RITM: Full fetch complete (76353 records). [2025-10-15T21:13:19.298457] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-15T21:13:19.299329] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:13:19.299438] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:13:19.299482] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:13:19.299561] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-15T21:13:19.299686] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-15T21:13:19.299750] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-15T21:13:19.299810] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-15T21:13:19.299885] [INFO ] [MAIN ] Update Progress: 1802/2369 symbols completed. RITM took 30.4s. Estimated remaining: 1h 19m 41s. Rate: 7.1 symbols/min [2025-10-15T21:13:19.320316] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-15T21:13:19.481397] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:13:19.481675] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-15T21:13:19.481847] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-15T21:13:19.482011] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-15T21:13:19.482087] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-15T21:13:19.482182] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-15T21:13:19.482379] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-15T21:13:19.798119] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T21:13:19.897736] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:13:20.113989] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-15T21:13:20.913999] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-15T21:13:21.524087] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-15T21:13:21.625616] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T21:13:21.714007] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-15T21:13:22.189583] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T21:13:22.514003] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-15T21:13:23.314035] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-15T21:13:23.485012] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T21:13:24.114020] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-15T21:13:24.511864] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T21:13:24.914068] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-15T21:13:25.577050] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-15T21:13:25.713997] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-15T21:13:25.858197] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T21:13:26.449220] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:13:26.455178] [INFO ] [REMOTE ] RIO: Full fetch complete (77121 records). [2025-10-15T21:13:26.455302] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-15T21:13:26.456111] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:13:26.456198] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:13:26.456242] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:13:26.456287] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-15T21:13:26.456341] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-15T21:13:26.456375] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-15T21:13:26.456413] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-15T21:13:26.456469] [INFO ] [MAIN ] Update Progress: 1803/2369 symbols completed. RIO took 37.6s. Estimated remaining: 1h 19m 32s. Rate: 7.1 symbols/min [2025-10-15T21:13:26.519265] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-15T21:13:26.626067] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:13:26.626226] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-15T21:13:26.626262] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-15T21:13:26.626369] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-15T21:13:26.626414] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-15T21:13:26.626454] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-15T21:13:26.626486] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-15T21:13:27.004307] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:13:27.077199] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-15T21:13:27.314016] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-15T21:13:28.114020] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-15T21:13:28.333043] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T21:13:28.914007] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-15T21:13:29.010018] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T21:13:29.714052] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-15T21:13:29.853298] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T21:13:30.514032] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-15T21:13:30.905271] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T21:13:31.011688] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T21:13:31.314038] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-15T21:13:32.113992] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-15T21:13:32.292659] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T21:13:32.914020] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-15T21:13:32.960512] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T21:13:33.714037] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-15T21:13:34.232509] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T21:13:34.514004] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-15T21:13:35.037792] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T21:13:35.047282] [INFO ] [REMOTE ] RIG: Full fetch complete (77846 records). [2025-10-15T21:13:35.047508] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-15T21:13:35.318596] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-15T21:13:35.459571] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-15T21:13:35.459728] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-15T21:13:35.461092] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-15T21:13:35.461182] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-15T21:13:35.463109] [DEBUG] [LOCAL ] RIG: Trimmed 77846 records to 53675 (keeping 200 days of data) [2025-10-15T21:13:35.580229] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T21:13:35.809848] [DEBUG] [LOCAL ] RIG: Primary data saved (53675 records). [2025-10-15T21:13:35.809980] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-15T21:13:35.810092] [INFO ] [MAIN ] Update Progress: 1804/2369 symbols completed. RIG took 46.9s. Estimated remaining: 1h 19m 24s. Rate: 7.1 symbols/min [2025-10-15T21:13:35.984765] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:13:35.984941] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-15T21:13:35.984985] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-15T21:13:35.985092] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-15T21:13:35.985132] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-15T21:13:35.985174] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-15T21:13:35.985206] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-15T21:13:36.135204] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-15T21:13:36.355765] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:13:36.393328] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T21:13:36.913990] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-15T21:13:37.141199] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:13:37.714019] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-15T21:13:37.877030] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T21:13:38.100458] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T21:13:38.514035] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-15T21:13:39.314050] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-15T21:13:39.556394] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T21:13:39.957429] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T21:13:40.114003] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-15T21:13:40.914023] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-15T21:13:41.309121] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-15T21:13:41.380231] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T21:13:41.714008] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-15T21:13:42.513972] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-15T21:13:42.702731] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T21:13:43.073075] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T21:13:43.314014] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-15T21:13:44.114046] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-15T21:13:44.251258] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:13:44.914007] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-15T21:13:44.942156] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T21:13:45.714061] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-15T21:13:46.477627] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-15T21:13:46.514041] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-15T21:13:46.851811] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T21:13:47.314108] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-15T21:13:47.351084] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T21:13:47.420327] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T21:13:48.114012] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-15T21:13:48.654337] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T21:13:48.914007] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-15T21:13:49.714035] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-15T21:13:49.801826] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T21:13:50.514072] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-15T21:13:50.874937] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T21:13:51.314038] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-15T21:13:52.038631] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:13:52.048102] [INFO ] [REMOTE ] RJF: Full fetch complete (68182 records). [2025-10-15T21:13:52.048474] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-15T21:13:52.049937] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:13:52.050049] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:13:52.050111] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:13:52.050175] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-15T21:13:52.050267] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-15T21:13:52.050322] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-15T21:13:52.050385] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-15T21:13:52.050475] [INFO ] [MAIN ] Update Progress: 1805/2369 symbols completed. RJF took 35.2s. Estimated remaining: 1h 19m 18s. Rate: 7.1 symbols/min [2025-10-15T21:13:52.116722] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-15T21:13:52.211975] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-15T21:13:52.301847] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:13:52.302171] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-15T21:13:52.302364] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-15T21:13:52.302526] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-15T21:13:52.302582] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-15T21:13:52.302628] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-15T21:13:52.302708] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-15T21:13:52.625744] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-15T21:13:52.709813] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:13:52.913997] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-15T21:13:53.669539] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T21:13:53.713964] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-15T21:13:54.164115] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T21:13:54.513998] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-15T21:13:55.194998] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:13:55.199206] [INFO ] [REMOTE ] RL: Full fetch complete (59523 records). [2025-10-15T21:13:55.199325] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-15T21:13:55.200007] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:13:55.200091] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:13:55.200133] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:13:55.200198] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-15T21:13:55.200260] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-15T21:13:55.200296] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-15T21:13:55.200335] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-15T21:13:55.200390] [INFO ] [MAIN ] Update Progress: 1806/2369 symbols completed. RL took 28.7s. Estimated remaining: 1h 19m 8s. Rate: 7.1 symbols/min [2025-10-15T21:13:55.320618] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-15T21:13:55.389817] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:13:55.401393] [DEBUG] [LOCAL ] RLTY: Loaded 11158 existing records from primary storage. [2025-10-15T21:13:55.401631] [INFO ] [MAIN ] RLTY: Loaded 11158 existing records. [2025-10-15T21:13:55.606918] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:13:55.609407] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-15T21:13:55.609271] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T21:13:55.609606] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-15T21:13:55.620441] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-15T21:13:55.620503] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-15T21:13:55.967298] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:13:56.114049] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-15T21:13:56.913993] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-15T21:13:57.706058] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-15T21:13:57.716782] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-15T21:13:57.864366] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T21:13:58.146265] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T21:13:58.513985] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-15T21:13:58.769020] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T21:13:59.314060] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-15T21:14:00.113981] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-15T21:14:00.198063] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T21:14:00.278865] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T21:14:00.770305] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T21:14:00.776299] [INFO ] [REMOTE ] RKT: Full fetch complete (77183 records). [2025-10-15T21:14:00.776417] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-15T21:14:00.777255] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:14:00.777344] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:14:00.777385] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:14:00.777424] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-15T21:14:00.777492] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-15T21:14:00.777556] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-15T21:14:00.777622] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-15T21:14:00.777740] [INFO ] [MAIN ] Update Progress: 1807/2369 symbols completed. RKT took 41.5s. Estimated remaining: 1h 18m 59s. Rate: 7.1 symbols/min [2025-10-15T21:14:00.920476] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-15T21:14:00.945499] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:00.989067] [DEBUG] [LOCAL ] RLX: Loaded 48143 existing records from primary storage. [2025-10-15T21:14:00.989375] [INFO ] [MAIN ] RLX: Loaded 48143 existing records. [2025-10-15T21:14:01.165917] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:14:01.166138] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-15T21:14:01.166220] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-15T21:14:01.167167] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-15T21:14:01.167226] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-15T21:14:01.510695] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:01.714008] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-15T21:14:02.513995] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-15T21:14:02.687437] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T21:14:03.314021] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-15T21:14:03.392452] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T21:14:03.550446] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T21:14:04.114059] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-15T21:14:04.914004] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-15T21:14:05.137474] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T21:14:05.713967] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-15T21:14:05.845596] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:14:05.865275] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T21:14:06.514045] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-15T21:14:07.314002] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-15T21:14:07.362679] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T21:14:08.114023] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-15T21:14:08.221929] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T21:14:08.260244] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T21:14:08.914026] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-15T21:14:09.595321] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T21:14:09.714004] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-15T21:14:09.763146] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T21:14:10.514011] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-15T21:14:10.955297] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T21:14:11.314005] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-15T21:14:12.051507] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:14:12.055969] [INFO ] [REMOTE ] RLI: Full fetch complete (48173 records). [2025-10-15T21:14:12.056087] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-15T21:14:12.056864] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:14:12.057090] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:14:12.057181] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:14:12.057476] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-15T21:14:12.057696] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-15T21:14:12.057755] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-15T21:14:12.057801] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-15T21:14:12.057863] [INFO ] [MAIN ] Update Progress: 1808/2369 symbols completed. RLI took 36.2s. Estimated remaining: 1h 18m 51s. Rate: 7.1 symbols/min [2025-10-15T21:14:12.119136] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-15T21:14:12.290791] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:12.295382] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T21:14:12.314794] [DEBUG] [LOCAL ] RM: Loaded 7559 existing records from primary storage. [2025-10-15T21:14:12.315060] [INFO ] [MAIN ] RM: Loaded 7559 existing records. [2025-10-15T21:14:12.489982] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:14:12.490205] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-15T21:14:12.490277] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-15T21:14:12.490624] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-15T21:14:12.490735] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-15T21:14:12.853195] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:12.914033] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-15T21:14:13.714040] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-15T21:14:13.762935] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T21:14:13.947036] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T21:14:14.514070] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-15T21:14:14.644928] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T21:14:15.314026] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-15T21:14:16.096821] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T21:14:16.113974] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-15T21:14:16.278131] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T21:14:16.914003] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-15T21:14:16.965815] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T21:14:17.714034] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-15T21:14:18.515280] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T21:14:18.513976] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-15T21:14:18.540941] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T21:14:19.313983] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-15T21:14:19.405534] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T21:14:20.114005] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-15T21:14:20.914051] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-15T21:14:21.009298] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T21:14:21.047808] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T21:14:21.714027] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-15T21:14:21.896061] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T21:14:22.432629] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:14:22.440841] [INFO ] [REMOTE ] RLJ: Full fetch complete (69045 records). [2025-10-15T21:14:22.441041] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-15T21:14:22.442072] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:14:22.442205] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:14:22.442268] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:14:22.442411] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-15T21:14:22.442517] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-15T21:14:22.442579] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-15T21:14:22.442670] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-15T21:14:22.442790] [INFO ] [MAIN ] Update Progress: 1809/2369 symbols completed. RLJ took 30.4s. Estimated remaining: 1h 18m 43s. Rate: 7.1 symbols/min [2025-10-15T21:14:22.519146] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-15T21:14:22.618851] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:22.619098] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-15T21:14:22.619154] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-15T21:14:22.619274] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-15T21:14:22.619315] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-15T21:14:22.619355] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-15T21:14:22.619386] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-15T21:14:22.970199] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:23.314002] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-15T21:14:23.414682] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T21:14:24.113985] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-15T21:14:24.360330] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T21:14:24.860408] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:14:24.862312] [INFO ] [REMOTE ] RLTY: Full fetch complete (17425 records). [2025-10-15T21:14:24.862382] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-15T21:14:24.919161] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-15T21:14:25.237777] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-15T21:14:25.237856] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-15T21:14:25.238200] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-15T21:14:25.238258] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-15T21:14:25.238773] [DEBUG] [LOCAL ] RLTY: Trimmed 17425 records to 11163 (keeping 200 days of data) [2025-10-15T21:14:25.305297] [DEBUG] [LOCAL ] RLTY: Primary data saved (11163 records). [2025-10-15T21:14:25.305415] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-15T21:14:25.305494] [INFO ] [MAIN ] Update Progress: 1810/2369 symbols completed. RLTY took 30.1s. Estimated remaining: 1h 18m 33s. Rate: 7.1 symbols/min [2025-10-15T21:14:25.470872] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:25.471027] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-15T21:14:25.471063] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-15T21:14:25.471167] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-15T21:14:25.471208] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-15T21:14:25.471247] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-15T21:14:25.471279] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-15T21:14:25.724419] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-15T21:14:25.827349] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:25.842765] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T21:14:26.513991] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-15T21:14:26.940535] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T21:14:27.219105] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T21:14:27.314101] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-15T21:14:28.113998] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-15T21:14:28.879906] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T21:14:28.913950] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-15T21:14:29.713992] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-15T21:14:29.880073] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T21:14:30.218236] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T21:14:30.513966] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-15T21:14:30.701505] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T21:14:31.314012] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-15T21:14:32.071484] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T21:14:32.113971] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-15T21:14:32.141250] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T21:14:32.913985] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-15T21:14:33.714032] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-15T21:14:33.760407] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T21:14:34.513976] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-15T21:14:34.612551] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T21:14:34.680446] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T21:14:35.285594] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T21:14:35.313966] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-15T21:14:36.114071] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-15T21:14:36.284834] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T21:14:36.859803] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:14:36.861340] [INFO ] [REMOTE ] RM: Full fetch complete (11550 records). [2025-10-15T21:14:36.861422] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-15T21:14:36.921097] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-15T21:14:37.254981] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-15T21:14:37.255122] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-15T21:14:37.255800] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-15T21:14:37.255882] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-15T21:14:37.256627] [DEBUG] [LOCAL ] RM: Trimmed 11550 records to 7558 (keeping 200 days of data) [2025-10-15T21:14:37.306173] [DEBUG] [LOCAL ] RM: Primary data saved (7558 records). [2025-10-15T21:14:37.306373] [INFO ] [MAIN ] RM: Full history saved. [2025-10-15T21:14:37.306479] [INFO ] [MAIN ] Update Progress: 1811/2369 symbols completed. RM took 25.2s. Estimated remaining: 1h 18m 26s. Rate: 7.1 symbols/min [2025-10-15T21:14:37.483118] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:37.483400] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-15T21:14:37.483444] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-15T21:14:37.483565] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-15T21:14:37.483611] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-15T21:14:37.483698] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-15T21:14:37.483746] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-15T21:14:37.719252] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-15T21:14:37.859707] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:38.513992] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-15T21:14:38.765358] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T21:14:38.882313] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T21:14:39.314004] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-15T21:14:40.114055] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-15T21:14:40.384810] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T21:14:40.417586] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T21:14:40.867718] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T21:14:40.914020] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-15T21:14:41.444992] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T21:14:41.714097] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-15T21:14:42.514005] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-15T21:14:42.829368] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T21:14:43.313998] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-15T21:14:44.113977] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-15T21:14:44.244734] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T21:14:44.519801] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T21:14:44.913984] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-15T21:14:45.422894] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T21:14:45.628809] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T21:14:45.713998] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-15T21:14:46.514037] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-15T21:14:47.313970] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-15T21:14:47.512552] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T21:14:47.773161] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T21:14:48.114087] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-15T21:14:48.914043] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-15T21:14:49.026593] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T21:14:49.083792] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T21:14:49.527552] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T21:14:49.714030] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-15T21:14:50.271517] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T21:14:50.274153] [INFO ] [REMOTE ] RMAX: Full fetch complete (29824 records). [2025-10-15T21:14:50.274234] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-15T21:14:50.275753] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:14:50.276023] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:14:50.276095] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:14:50.276176] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-15T21:14:50.276255] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-15T21:14:50.276296] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-15T21:14:50.276346] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-15T21:14:50.276422] [INFO ] [MAIN ] Update Progress: 1812/2369 symbols completed. RMAX took 27.8s. Estimated remaining: 1h 18m 19s. Rate: 7.1 symbols/min [2025-10-15T21:14:50.450132] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:50.450414] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-15T21:14:50.450455] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-15T21:14:50.450588] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-15T21:14:50.450632] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-15T21:14:50.450722] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-15T21:14:50.450768] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-15T21:14:50.519214] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-15T21:14:50.844465] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:51.246163] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T21:14:51.314015] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-15T21:14:52.114009] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-15T21:14:52.873033] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T21:14:52.879024] [INFO ] [REMOTE ] RLX: Full fetch complete (70292 records). [2025-10-15T21:14:52.879132] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-15T21:14:52.919259] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-15T21:14:53.067914] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T21:14:53.276278] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-15T21:14:53.276359] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-15T21:14:53.277443] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-15T21:14:53.277505] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-15T21:14:53.278948] [DEBUG] [LOCAL ] RLX: Trimmed 70292 records to 48146 (keeping 200 days of data) [2025-10-15T21:14:53.554276] [DEBUG] [LOCAL ] RLX: Primary data saved (48146 records). [2025-10-15T21:14:53.554559] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-15T21:14:53.554679] [INFO ] [MAIN ] Update Progress: 1813/2369 symbols completed. RLX took 52.8s. Estimated remaining: 1h 18m 9s. Rate: 7.1 symbols/min [2025-10-15T21:14:53.719000] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:14:53.719075] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-15T21:14:53.726370] [DEBUG] [LOCAL ] RMMZ: Loaded 4801 existing records from primary storage. [2025-10-15T21:14:53.726555] [INFO ] [MAIN ] RMMZ: Loaded 4801 existing records. [2025-10-15T21:14:53.899181] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:14:53.899406] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-15T21:14:53.899455] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-15T21:14:53.899736] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-15T21:14:53.899794] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-15T21:14:54.244984] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:14:54.513970] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-15T21:14:54.576522] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T21:14:54.598285] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T21:14:55.075132] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-15T21:14:55.313980] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-15T21:14:55.960550] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T21:14:56.114035] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-15T21:14:56.913988] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-15T21:14:57.713980] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-15T21:14:57.740012] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T21:14:57.835215] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T21:14:58.267896] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T21:14:58.514004] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-15T21:14:59.205629] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T21:14:59.314036] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-15T21:15:00.105549] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T21:15:00.113978] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-15T21:15:00.865637] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T21:15:00.914012] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-15T21:15:01.414491] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T21:15:01.415728] [INFO ] [REMOTE ] RMI: Full fetch complete (6058 records). [2025-10-15T21:15:01.415816] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-15T21:15:01.416298] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:15:01.416386] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:15:01.416431] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:15:01.416498] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-15T21:15:01.416570] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-15T21:15:01.416609] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-15T21:15:01.416682] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-15T21:15:01.416766] [INFO ] [MAIN ] Update Progress: 1814/2369 symbols completed. RMI took 24.1s. Estimated remaining: 1h 18m 0s. Rate: 7.1 symbols/min [2025-10-15T21:15:01.605243] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:01.626861] [DEBUG] [LOCAL ] RMT: Loaded 17399 existing records from primary storage. [2025-10-15T21:15:01.627222] [INFO ] [MAIN ] RMT: Loaded 17399 existing records. [2025-10-15T21:15:01.719215] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-15T21:15:01.834195] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:15:01.834468] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-15T21:15:01.834517] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-15T21:15:01.835087] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-15T21:15:01.835146] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-15T21:15:02.241834] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:02.513996] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-15T21:15:02.741492] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T21:15:03.102330] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T21:15:03.314051] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-15T21:15:04.114020] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-15T21:15:04.490719] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T21:15:04.886702] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T21:15:04.914040] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-15T21:15:05.714029] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-15T21:15:06.095562] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T21:15:06.514036] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-15T21:15:07.187259] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T21:15:07.314040] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-15T21:15:07.397060] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T21:15:08.010480] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T21:15:08.114018] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-15T21:15:08.914019] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-15T21:15:09.020027] [DEBUG] [REMOTE ] RMMZ: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-15T21:15:09.020342] [WARN ] [REMOTE ] RMMZ: No data returned for month 2025-06 [2025-10-15T21:15:09.020431] [FATAL] [REMOTE ] RMMZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:15:09.020506] [FATAL] [MAIN ] RMMZ: Failed to fetch primary data. [2025-10-15T21:15:09.020542] [WARN ] [MAIN ] RMMZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:15:09.020580] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-15T21:15:09.020634] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-15T21:15:09.020709] [INFO ] [LOCAL ] RMMZ: Starting deletion of derivative data. [2025-10-15T21:15:09.020895] [DEBUG] [LOCAL ] RMMZ: Deleted derivative data file. [2025-10-15T21:15:09.020977] [INFO ] [MAIN ] Update Progress: 1815/2369 symbols completed. RMMZ took 15.5s. Estimated remaining: 1h 17m 51s. Rate: 7.1 symbols/min [2025-10-15T21:15:09.195393] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:09.195529] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-15T21:15:09.195570] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-15T21:15:09.195740] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-15T21:15:09.195798] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-15T21:15:09.195843] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-15T21:15:09.195877] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-15T21:15:09.398009] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T21:15:09.585107] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:09.714002] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-15T21:15:10.514062] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-15T21:15:11.320950] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-15T21:15:11.323559] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T21:15:11.563982] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T21:15:12.083269] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T21:15:12.087972] [INFO ] [REMOTE ] RMD: Full fetch complete (61002 records). [2025-10-15T21:15:12.088100] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-15T21:15:12.088862] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:15:12.088953] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:15:12.088995] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:15:12.089039] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-15T21:15:12.089120] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-15T21:15:12.089194] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-15T21:15:12.089236] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-15T21:15:12.089292] [INFO ] [MAIN ] Update Progress: 1816/2369 symbols completed. RMD took 46.8s. Estimated remaining: 1h 17m 41s. Rate: 7.1 symbols/min [2025-10-15T21:15:12.119110] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-15T21:15:12.265073] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:12.265240] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-15T21:15:12.265276] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-15T21:15:12.265391] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-15T21:15:12.265432] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-15T21:15:12.265471] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-15T21:15:12.265502] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-15T21:15:12.645291] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:12.913968] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-15T21:15:13.116357] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T21:15:13.714011] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-15T21:15:13.835675] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T21:15:14.514015] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-15T21:15:15.313991] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-15T21:15:15.520729] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T21:15:15.554769] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T21:15:16.114026] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-15T21:15:16.170389] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T21:15:16.914036] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-15T21:15:17.714053] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-15T21:15:17.751401] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T21:15:17.933909] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T21:15:18.514055] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-15T21:15:18.935428] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T21:15:19.314028] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-15T21:15:19.475191] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T21:15:20.113989] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-15T21:15:20.530239] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T21:15:20.914004] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-15T21:15:21.714089] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-15T21:15:21.877535] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T21:15:22.095839] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T21:15:22.514018] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-15T21:15:22.648130] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T21:15:23.175017] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T21:15:23.314063] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-15T21:15:24.114035] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-15T21:15:24.319560] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T21:15:24.914000] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-15T21:15:25.714040] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-15T21:15:25.777692] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T21:15:26.016213] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T21:15:26.514050] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-15T21:15:26.794245] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T21:15:27.057564] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T21:15:27.059212] [INFO ] [REMOTE ] RMM: Full fetch complete (14755 records). [2025-10-15T21:15:27.059281] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-15T21:15:27.059681] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:15:27.059765] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:15:27.059806] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:15:27.059845] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-15T21:15:27.059899] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-15T21:15:27.059936] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-15T21:15:27.059975] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-15T21:15:27.060026] [INFO ] [MAIN ] Update Progress: 1817/2369 symbols completed. RMM took 36.8s. Estimated remaining: 1h 17m 35s. Rate: 7.1 symbols/min [2025-10-15T21:15:27.232431] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:27.247981] [DEBUG] [LOCAL ] RNP: Loaded 16228 existing records from primary storage. [2025-10-15T21:15:27.248242] [INFO ] [MAIN ] RNP: Loaded 16228 existing records. [2025-10-15T21:15:27.319252] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-15T21:15:27.436792] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:15:27.437014] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-15T21:15:27.437061] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-15T21:15:27.437512] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-15T21:15:27.437570] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-15T21:15:27.779628] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:28.114020] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-15T21:15:28.447516] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T21:15:28.913963] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-15T21:15:29.299145] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T21:15:29.714021] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-15T21:15:30.362025] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T21:15:30.514009] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-15T21:15:30.864590] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T21:15:31.314025] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-15T21:15:31.693828] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T21:15:31.975951] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T21:15:32.114066] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-15T21:15:32.913964] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-15T21:15:33.300890] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T21:15:33.714034] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-15T21:15:34.232985] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T21:15:34.514109] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-15T21:15:35.314030] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-15T21:15:35.354205] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T21:15:35.559166] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T21:15:36.113987] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-15T21:15:36.483786] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T21:15:36.914124] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-15T21:15:37.135922] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T21:15:37.139116] [INFO ] [REMOTE ] RMT: Full fetch complete (25632 records). [2025-10-15T21:15:37.139257] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-15T21:15:37.526306] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-15T21:15:37.526410] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-15T21:15:37.527266] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-15T21:15:37.527332] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-15T21:15:37.528334] [DEBUG] [LOCAL ] RMT: Trimmed 25632 records to 17509 (keeping 200 days of data) [2025-10-15T21:15:37.653584] [DEBUG] [LOCAL ] RMT: Primary data saved (17509 records). [2025-10-15T21:15:37.653922] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-15T21:15:37.654044] [INFO ] [MAIN ] Update Progress: 1818/2369 symbols completed. RMT took 36.2s. Estimated remaining: 1h 17m 27s. Rate: 7.1 symbols/min [2025-10-15T21:15:37.724510] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-15T21:15:37.849594] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:37.849880] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-15T21:15:37.849929] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-15T21:15:37.850086] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-15T21:15:37.850129] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-15T21:15:37.850172] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-15T21:15:37.850207] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-15T21:15:38.172309] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T21:15:38.253902] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:38.514081] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-15T21:15:38.916979] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T21:15:39.314058] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-15T21:15:40.114011] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-15T21:15:40.377232] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T21:15:40.920889] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-15T21:15:40.926081] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T21:15:41.493067] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T21:15:41.714006] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-15T21:15:42.000241] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T21:15:42.514007] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-15T21:15:43.313986] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-15T21:15:43.370482] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T21:15:44.114003] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-15T21:15:44.338237] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T21:15:44.650421] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T21:15:44.807549] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T21:15:44.913990] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-15T21:15:45.714007] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-15T21:15:46.514035] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-15T21:15:46.622956] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T21:15:47.292026] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T21:15:47.313971] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-15T21:15:47.338524] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T21:15:48.114016] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-15T21:15:48.468306] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T21:15:48.892848] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T21:15:48.913953] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-15T21:15:49.713986] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-15T21:15:50.014591] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T21:15:50.439947] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T21:15:50.445558] [INFO ] [REMOTE ] RNG: Full fetch complete (69375 records). [2025-10-15T21:15:50.445699] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-15T21:15:50.446422] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:15:50.446509] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:15:50.446563] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:15:50.446679] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-15T21:15:50.446784] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-15T21:15:50.446857] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-15T21:15:50.446923] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-15T21:15:50.447012] [INFO ] [MAIN ] Update Progress: 1819/2369 symbols completed. RNG took 41.4s. Estimated remaining: 1h 17m 20s. Rate: 7.1 symbols/min [2025-10-15T21:15:50.519106] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-15T21:15:50.625636] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:50.625856] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-15T21:15:50.625918] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-15T21:15:50.626028] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-15T21:15:50.626070] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-15T21:15:50.626111] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-15T21:15:50.626148] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-15T21:15:50.983346] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:51.231088] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:15:51.233867] [INFO ] [REMOTE ] RNGR: Full fetch complete (28293 records). [2025-10-15T21:15:51.233946] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-15T21:15:51.234401] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:15:51.234531] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:15:51.234578] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:15:51.234617] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-15T21:15:51.234719] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-15T21:15:51.234773] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-15T21:15:51.234814] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-15T21:15:51.234868] [INFO ] [MAIN ] Update Progress: 1820/2369 symbols completed. RNGR took 39.1s. Estimated remaining: 1h 17m 9s. Rate: 7.1 symbols/min [2025-10-15T21:15:51.319104] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-15T21:15:51.405749] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:51.405911] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-15T21:15:51.405946] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-15T21:15:51.406056] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-15T21:15:51.406096] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-15T21:15:51.406136] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-15T21:15:51.406167] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-15T21:15:51.763943] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:52.114020] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-15T21:15:52.451564] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T21:15:52.914006] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-15T21:15:53.521093] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T21:15:53.714011] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-15T21:15:54.267035] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T21:15:54.513966] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-15T21:15:54.778374] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T21:15:55.314057] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-15T21:15:55.992366] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T21:15:56.113976] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-15T21:15:56.349678] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T21:15:56.352568] [INFO ] [REMOTE ] RNP: Full fetch complete (23740 records). [2025-10-15T21:15:56.352637] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-15T21:15:56.712050] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-15T21:15:56.712144] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-15T21:15:56.712795] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-15T21:15:56.712857] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-15T21:15:56.713455] [DEBUG] [LOCAL ] RNP: Trimmed 23740 records to 16190 (keeping 200 days of data) [2025-10-15T21:15:56.817066] [DEBUG] [LOCAL ] RNP: Primary data saved (16190 records). [2025-10-15T21:15:56.817201] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-15T21:15:56.817280] [INFO ] [MAIN ] Update Progress: 1821/2369 symbols completed. RNP took 29.8s. Estimated remaining: 1h 17m 0s. Rate: 7.1 symbols/min [2025-10-15T21:15:56.915738] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-15T21:15:56.986332] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:15:56.986601] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-15T21:15:56.986677] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-15T21:15:56.986815] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-15T21:15:56.986857] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-15T21:15:56.986915] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-15T21:15:56.986947] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-15T21:15:57.357429] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:15:57.489282] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T21:15:57.664001] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T21:15:57.714032] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-15T21:15:58.514059] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-15T21:15:59.318603] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-15T21:15:59.320761] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T21:15:59.954130] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T21:16:00.113996] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-15T21:16:00.383272] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T21:16:00.914046] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-15T21:16:01.713971] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-15T21:16:01.993522] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T21:16:02.497415] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T21:16:02.513942] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-15T21:16:03.314041] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-15T21:16:03.446288] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T21:16:04.043826] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T21:16:04.113955] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-15T21:16:04.729209] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T21:16:04.913999] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-15T21:16:05.653238] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T21:16:05.713998] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-15T21:16:06.402703] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T21:16:06.513953] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-15T21:16:07.313966] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-15T21:16:07.500605] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T21:16:07.763826] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T21:16:08.114029] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-15T21:16:08.315146] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T21:16:08.914002] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-15T21:16:09.713970] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-15T21:16:09.820801] [DEBUG] [REMOTE ] RNST: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-15T21:16:09.821074] [WARN ] [REMOTE ] RNST: No data returned for month 2025-05 [2025-10-15T21:16:09.821175] [FATAL] [REMOTE ] RNST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:16:09.821302] [FATAL] [MAIN ] RNST: Failed to fetch primary data. [2025-10-15T21:16:09.821381] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:16:09.821468] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-15T21:16:09.821545] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-15T21:16:09.821597] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-15T21:16:09.821720] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-15T21:16:09.821884] [INFO ] [MAIN ] Update Progress: 1822/2369 symbols completed. RNST took 19.4s. Estimated remaining: 1h 16m 53s. Rate: 7.1 symbols/min [2025-10-15T21:16:10.032180] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:10.032949] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-15T21:16:10.035667] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-15T21:16:10.035482] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T21:16:10.044955] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-15T21:16:10.045761] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-15T21:16:10.046244] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-15T21:16:10.046303] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-15T21:16:10.343762] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T21:16:10.423312] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:10.513997] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-15T21:16:11.314056] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-15T21:16:12.114042] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-15T21:16:12.226955] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T21:16:12.467330] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T21:16:12.914012] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-15T21:16:13.714003] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-15T21:16:13.868580] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T21:16:14.513969] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-15T21:16:15.010811] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T21:16:15.081014] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T21:16:15.313998] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-15T21:16:16.114074] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-15T21:16:16.901862] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T21:16:16.906978] [INFO ] [REMOTE ] RNR: Full fetch complete (50817 records). [2025-10-15T21:16:16.907237] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-15T21:16:16.908321] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:16:16.908408] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:16:16.908453] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:16:16.908519] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-15T21:16:16.908587] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-15T21:16:16.908625] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-15T21:16:16.908705] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-15T21:16:16.908816] [INFO ] [MAIN ] Update Progress: 1823/2369 symbols completed. RNR took 39.3s. Estimated remaining: 1h 16m 44s. Rate: 7.1 symbols/min [2025-10-15T21:16:16.939963] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-15T21:16:17.082782] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:17.083143] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-15T21:16:17.083498] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-15T21:16:17.083762] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-15T21:16:17.083972] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-15T21:16:17.084128] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-15T21:16:17.084241] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-15T21:16:17.343880] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T21:16:17.452743] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-15T21:16:17.539287] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:17.714043] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-15T21:16:18.213815] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T21:16:18.514045] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-15T21:16:19.313983] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-15T21:16:19.586332] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T21:16:20.069912] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T21:16:20.113950] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-15T21:16:20.861747] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T21:16:20.913954] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-15T21:16:21.714024] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-15T21:16:21.947890] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T21:16:22.513972] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-15T21:16:22.811285] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T21:16:22.844291] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T21:16:23.314001] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-15T21:16:23.659318] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T21:16:23.921574] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T21:16:23.923900] [INFO ] [REMOTE ] ROG: Full fetch complete (30787 records). [2025-10-15T21:16:23.923997] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-15T21:16:23.924606] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:16:23.924712] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:16:23.924754] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:16:23.924792] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-15T21:16:23.924846] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-15T21:16:23.924879] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-15T21:16:23.924921] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-15T21:16:23.924977] [INFO ] [MAIN ] Update Progress: 1824/2369 symbols completed. ROG took 32.7s. Estimated remaining: 1h 16m 35s. Rate: 7.1 symbols/min [2025-10-15T21:16:24.102223] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:24.119150] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-15T21:16:24.121755] [DEBUG] [LOCAL ] RPT: Loaded 19159 existing records from primary storage. [2025-10-15T21:16:24.122209] [INFO ] [MAIN ] RPT: Loaded 19159 existing records. [2025-10-15T21:16:24.319507] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:16:24.319771] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-15T21:16:24.319820] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-15T21:16:24.320450] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-15T21:16:24.320515] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-15T21:16:24.664795] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:24.913998] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-15T21:16:25.432895] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T21:16:25.714022] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-15T21:16:26.514071] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-15T21:16:26.737331] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:16:27.314012] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-15T21:16:27.532794] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T21:16:27.680624] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T21:16:28.114072] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-15T21:16:28.914076] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-15T21:16:29.069146] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T21:16:29.259150] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T21:16:29.714121] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-15T21:16:30.353870] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T21:16:30.514054] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-15T21:16:31.314022] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-15T21:16:31.443116] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T21:16:31.716432] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T21:16:32.114005] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-15T21:16:32.914016] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-15T21:16:33.069508] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T21:16:33.315237] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T21:16:33.713998] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-15T21:16:34.352013] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T21:16:34.514040] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-15T21:16:35.241421] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T21:16:35.313998] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-15T21:16:36.114008] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-15T21:16:36.254004] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T21:16:36.914037] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-15T21:16:37.223418] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T21:16:37.275689] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T21:16:37.714070] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-15T21:16:38.514076] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-15T21:16:38.592509] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T21:16:38.632454] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T21:16:39.313981] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-15T21:16:39.618792] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T21:16:40.023696] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:16:40.029459] [INFO ] [REMOTE ] ROL: Full fetch complete (72774 records). [2025-10-15T21:16:40.029571] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-15T21:16:40.030515] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:16:40.030609] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:16:40.030681] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:16:40.030736] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-15T21:16:40.030805] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-15T21:16:40.030860] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-15T21:16:40.030901] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-15T21:16:40.030956] [INFO ] [MAIN ] Update Progress: 1825/2369 symbols completed. ROL took 30.2s. Estimated remaining: 1h 16m 29s. Rate: 7.1 symbols/min [2025-10-15T21:16:40.119098] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-15T21:16:40.235988] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:40.236174] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-15T21:16:40.236212] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-15T21:16:40.236329] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-15T21:16:40.236391] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-15T21:16:40.236432] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-15T21:16:40.236465] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-15T21:16:40.581594] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:40.903590] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T21:16:40.908133] [INFO ] [REMOTE ] ROK: Full fetch complete (62445 records). [2025-10-15T21:16:40.908258] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-15T21:16:40.908876] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:16:40.908960] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:16:40.909002] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:16:40.909040] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-15T21:16:40.909096] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-15T21:16:40.909130] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-15T21:16:40.909167] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-15T21:16:40.909219] [INFO ] [MAIN ] Update Progress: 1826/2369 symbols completed. ROK took 44.1s. Estimated remaining: 1h 16m 18s. Rate: 7.1 symbols/min [2025-10-15T21:16:40.920095] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-15T21:16:41.087058] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:41.087223] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-15T21:16:41.087261] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-15T21:16:41.087372] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-15T21:16:41.087415] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-15T21:16:41.087456] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-15T21:16:41.087489] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-15T21:16:41.491982] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:41.713987] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-15T21:16:42.514058] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-15T21:16:42.635987] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T21:16:43.314032] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-15T21:16:43.452187] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T21:16:43.518480] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T21:16:44.114015] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-15T21:16:44.218119] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T21:16:44.914052] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-15T21:16:45.714005] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-15T21:16:45.774789] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T21:16:46.514034] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-15T21:16:46.757450] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T21:16:46.819353] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T21:16:47.314004] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-15T21:16:47.628866] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T21:16:48.114009] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-15T21:16:48.577355] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T21:16:48.913984] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-15T21:16:49.337520] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T21:16:49.714024] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-15T21:16:50.513968] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-15T21:16:50.610802] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T21:16:51.084041] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T21:16:51.313962] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-15T21:16:51.695046] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T21:16:52.113990] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-15T21:16:52.741788] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T21:16:52.913998] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-15T21:16:53.225082] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T21:16:53.713996] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-15T21:16:54.513980] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-15T21:16:54.673382] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T21:16:54.676077] [INFO ] [REMOTE ] RPT: Full fetch complete (28445 records). [2025-10-15T21:16:54.676152] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-15T21:16:55.106212] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T21:16:55.106546] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-15T21:16:55.106706] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-15T21:16:55.117608] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-15T21:16:55.118098] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-15T21:16:55.119986] [DEBUG] [LOCAL ] RPT: Trimmed 28445 records to 19093 (keeping 200 days of data) [2025-10-15T21:16:55.185267] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:16:55.216762] [INFO ] [REMOTE ] RPM: Full fetch complete (59379 records). [2025-10-15T21:16:55.218632] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-15T21:16:55.220307] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:16:55.220716] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:16:55.221315] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:16:55.221623] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-15T21:16:55.222518] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-15T21:16:55.223374] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-15T21:16:55.225203] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-15T21:16:55.225576] [INFO ] [MAIN ] Update Progress: 1827/2369 symbols completed. RPM took 38.3s. Estimated remaining: 1h 16m 12s. Rate: 7.1 symbols/min [2025-10-15T21:16:55.319121] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-15T21:16:55.432005] [DEBUG] [LOCAL ] RPT: Primary data saved (19093 records). [2025-10-15T21:16:55.432118] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-15T21:16:55.432223] [INFO ] [MAIN ] Update Progress: 1828/2369 symbols completed. RPT took 31.5s. Estimated remaining: 1h 16m 1s. Rate: 7.1 symbols/min [2025-10-15T21:16:55.431898] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:55.443980] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-15T21:16:55.476038] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-15T21:16:55.476162] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-15T21:16:55.476226] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-15T21:16:55.503064] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-15T21:16:55.509063] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-15T21:16:55.760995] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:16:55.811581] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-15T21:16:55.844043] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-15T21:16:55.860814] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-15T21:16:55.879982] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-15T21:16:55.882574] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-15T21:16:55.883032] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-15T21:16:56.067029] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:56.125063] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-15T21:16:56.330380] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:16:56.568870] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T21:16:56.913999] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-15T21:16:57.540936] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T21:16:57.714033] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-15T21:16:58.143247] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T21:16:58.514034] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-15T21:16:59.314020] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-15T21:16:59.364915] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T21:17:00.114000] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-15T21:17:00.417854] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T21:17:00.799582] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T21:17:00.913968] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-15T21:17:01.421218] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T21:17:01.714093] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-15T21:17:02.514028] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-15T21:17:02.559557] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T21:17:03.314062] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-15T21:17:03.592871] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:17:03.898695] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T21:17:04.113998] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-15T21:17:04.920743] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-15T21:17:04.942388] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T21:17:05.348809] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T21:17:05.714040] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-15T21:17:06.513988] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-15T21:17:06.705034] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T21:17:07.314086] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-15T21:17:07.536589] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T21:17:07.712084] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T21:17:08.114082] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-15T21:17:08.700806] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T21:17:08.914031] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-15T21:17:09.393448] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T21:17:09.713989] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-15T21:17:10.513954] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-15T21:17:10.621376] [DEBUG] [REMOTE ] RQI: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-15T21:17:10.621717] [WARN ] [REMOTE ] RQI: No data returned for month 2025-10 [2025-10-15T21:17:10.621804] [FATAL] [REMOTE ] RQI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:17:10.621877] [FATAL] [MAIN ] RQI: Failed to fetch primary data. [2025-10-15T21:17:10.621939] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:17:10.622016] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-15T21:17:10.622093] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-15T21:17:10.622130] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-15T21:17:10.622169] [DEBUG] [LOCAL ] RQI: No derivative data file found to delete. [2025-10-15T21:17:10.622213] [INFO ] [MAIN ] Update Progress: 1829/2369 symbols completed. RQI took 30.6s. Estimated remaining: 1h 15m 54s. Rate: 7.1 symbols/min [2025-10-15T21:17:10.792873] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:17:10.799281] [DEBUG] [LOCAL ] RSF: Loaded 4325 existing records from primary storage. [2025-10-15T21:17:10.799467] [INFO ] [MAIN ] RSF: Loaded 4325 existing records. [2025-10-15T21:17:10.977413] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:17:10.977772] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-15T21:17:10.977929] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-15T21:17:10.988668] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-15T21:17:11.006824] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-15T21:17:11.083533] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-15T21:17:11.327378] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-15T21:17:11.405949] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:17:11.427057] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T21:17:12.114041] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-15T21:17:12.705683] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T21:17:12.914016] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-15T21:17:12.995065] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:17:13.342578] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T21:17:13.714054] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-15T21:17:14.513992] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-15T21:17:15.314028] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-15T21:17:15.353757] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T21:17:15.964312] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T21:17:16.113988] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-15T21:17:16.913960] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-15T21:17:17.200140] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T21:17:17.314730] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T21:17:17.714032] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-15T21:17:18.306309] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T21:17:18.514064] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-15T21:17:18.985175] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T21:17:19.314046] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-15T21:17:20.114059] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-15T21:17:20.189772] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T21:17:20.670510] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T21:17:20.728826] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T21:17:20.914041] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-15T21:17:21.714059] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-15T21:17:21.743590] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:17:21.748237] [INFO ] [REMOTE ] RRX: Full fetch complete (58418 records). [2025-10-15T21:17:21.748335] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-15T21:17:21.749046] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:17:21.749131] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:17:21.749174] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:17:21.749214] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-15T21:17:21.749271] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-15T21:17:21.749306] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-15T21:17:21.749346] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-15T21:17:21.749399] [INFO ] [MAIN ] Update Progress: 1830/2369 symbols completed. RRX took 26.5s. Estimated remaining: 1h 15m 47s. Rate: 7.1 symbols/min [2025-10-15T21:17:21.917141] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:17:21.917293] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-15T21:17:21.917332] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-15T21:17:21.917437] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-15T21:17:21.917479] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-15T21:17:21.917522] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-15T21:17:21.917556] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-15T21:17:22.279500] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:17:22.513987] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-15T21:17:23.314039] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-15T21:17:23.416534] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T21:17:24.114059] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-15T21:17:24.327143] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T21:17:24.588282] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T21:17:24.920509] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-15T21:17:24.923117] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T21:17:24.930493] [INFO ] [REMOTE ] RRC: Full fetch complete (76315 records). [2025-10-15T21:17:24.930736] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-15T21:17:24.931862] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:17:24.931959] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:17:24.932007] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:17:24.932052] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-15T21:17:24.932119] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-15T21:17:24.932158] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-15T21:17:24.932232] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-15T21:17:24.932325] [INFO ] [MAIN ] Update Progress: 1831/2369 symbols completed. RRC took 44.0s. Estimated remaining: 1h 15m 37s. Rate: 7.1 symbols/min [2025-10-15T21:17:25.118084] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:17:25.118566] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-15T21:17:25.118744] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-15T21:17:25.118936] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-15T21:17:25.118994] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-15T21:17:25.119053] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-15T21:17:25.119089] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-15T21:17:25.510989] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:17:25.714064] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-15T21:17:26.514055] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-15T21:17:26.652390] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:17:26.890374] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T21:17:27.313997] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-15T21:17:28.113967] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-15T21:17:28.285983] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T21:17:28.721062] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T21:17:28.914023] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-15T21:17:29.070824] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T21:17:29.304686] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T21:17:29.713996] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-15T21:17:30.514022] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-15T21:17:30.524404] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T21:17:30.528085] [INFO ] [REMOTE ] RS: Full fetch complete (38671 records). [2025-10-15T21:17:30.528192] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-15T21:17:30.528949] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:17:30.529068] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:17:30.529137] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:17:30.529213] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-15T21:17:30.529286] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-15T21:17:30.529323] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-15T21:17:30.529361] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-15T21:17:30.529452] [INFO ] [MAIN ] Update Progress: 1832/2369 symbols completed. RS took 35.1s. Estimated remaining: 1h 15m 28s. Rate: 7.1 symbols/min [2025-10-15T21:17:30.709630] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:17:30.740946] [DEBUG] [LOCAL ] RSKD: Loaded 33488 existing records from primary storage. [2025-10-15T21:17:30.741264] [INFO ] [MAIN ] RSKD: Loaded 33488 existing records. [2025-10-15T21:17:30.920411] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:17:30.920632] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-15T21:17:30.920716] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-15T21:17:30.921300] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-15T21:17:30.921359] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-15T21:17:31.219103] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T21:17:31.293213] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:17:31.313955] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-15T21:17:32.114023] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-15T21:17:32.743444] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T21:17:32.744155] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T21:17:32.914034] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-15T21:17:33.713997] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-15T21:17:34.467828] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T21:17:34.513971] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-15T21:17:34.741261] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T21:17:35.144451] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T21:17:35.314000] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-15T21:17:36.114075] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-15T21:17:36.914072] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-15T21:17:37.376803] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T21:17:37.479276] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T21:17:37.552372] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T21:17:37.713987] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-15T21:17:38.514056] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-15T21:17:39.180957] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T21:17:39.181098] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:17:39.187894] [INFO ] [REMOTE ] RSF: Full fetch complete (5684 records). [2025-10-15T21:17:39.188384] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-15T21:17:39.325104] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-15T21:17:39.543291] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-15T21:17:39.543376] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-15T21:17:39.543563] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-15T21:17:39.543601] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-15T21:17:39.543987] [DEBUG] [LOCAL ] RSF: Trimmed 5684 records to 4330 (keeping 200 days of data) [2025-10-15T21:17:39.570762] [DEBUG] [LOCAL ] RSF: Primary data saved (4330 records). [2025-10-15T21:17:39.570847] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-15T21:17:39.570926] [INFO ] [MAIN ] Update Progress: 1833/2369 symbols completed. RSF took 28.9s. Estimated remaining: 1h 15m 19s. Rate: 7.1 symbols/min [2025-10-15T21:17:39.737951] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:17:39.738114] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-15T21:17:39.738172] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-15T21:17:39.738291] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-15T21:17:39.738336] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-15T21:17:39.738376] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-15T21:17:39.738409] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-15T21:17:40.081244] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:17:40.113995] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-15T21:17:40.914007] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-15T21:17:41.243321] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T21:17:41.715243] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T21:17:41.714331] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-15T21:17:42.513999] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-15T21:17:42.732189] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:17:42.793399] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T21:17:43.314029] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-15T21:17:44.114875] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T21:17:44.115018] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-15T21:17:44.914064] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-15T21:17:45.035380] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T21:17:45.713994] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-15T21:17:45.874036] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T21:17:45.917179] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T21:17:46.514015] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-15T21:17:47.224716] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:17:47.313961] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-15T21:17:48.113975] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-15T21:17:48.379689] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T21:17:48.913997] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-15T21:17:48.992419] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T21:17:49.433851] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T21:17:49.713994] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-15T21:17:50.011857] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T21:17:50.513984] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-15T21:17:51.324740] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-15T21:17:51.330063] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T21:17:52.114000] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-15T21:17:52.338266] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T21:17:52.710000] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T21:17:52.914021] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-15T21:17:53.713997] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-15T21:17:53.832262] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T21:17:53.925366] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T21:17:54.514032] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-15T21:17:54.880792] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T21:17:55.313983] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-15T21:17:56.114031] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-15T21:17:56.162845] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T21:17:56.875104] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T21:17:56.913961] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-15T21:17:57.308619] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T21:17:57.714028] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-15T21:17:57.914091] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T21:17:58.029525] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-15T21:17:58.035509] [INFO ] [REMOTE ] RSG: Full fetch complete (67990 records). [2025-10-15T21:17:58.035734] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-15T21:17:58.036901] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:17:58.037398] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:17:58.037560] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:17:58.037761] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-15T21:17:58.037847] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-15T21:17:58.037887] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-15T21:17:58.037930] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-15T21:17:58.038021] [INFO ] [MAIN ] Update Progress: 1834/2369 symbols completed. RSG took 36.3s. Estimated remaining: 1h 15m 14s. Rate: 7.1 symbols/min [2025-10-15T21:17:58.208453] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:17:58.208791] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-15T21:17:58.208854] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-15T21:17:58.208968] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-15T21:17:58.209011] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-15T21:17:58.209052] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-15T21:17:58.209110] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-15T21:17:58.519136] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-15T21:17:58.556760] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:17:59.314049] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-15T21:18:00.114030] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-15T21:18:00.248192] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T21:18:00.914043] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-15T21:18:01.415075] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T21:18:01.419327] [INFO ] [REMOTE ] RSKD: Full fetch complete (48480 records). [2025-10-15T21:18:01.419421] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-15T21:18:01.716270] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-15T21:18:01.799879] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-15T21:18:01.850386] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-15T21:18:01.850445] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-15T21:18:01.851399] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-15T21:18:01.851460] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-15T21:18:01.852397] [DEBUG] [LOCAL ] RSKD: Trimmed 48480 records to 33461 (keeping 200 days of data) [2025-10-15T21:18:02.036201] [DEBUG] [LOCAL ] RSKD: Primary data saved (33461 records). [2025-10-15T21:18:02.036332] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-15T21:18:02.036720] [INFO ] [MAIN ] Update Progress: 1835/2369 symbols completed. RSKD took 31.5s. Estimated remaining: 1h 15m 4s. Rate: 7.1 symbols/min [2025-10-15T21:18:02.205121] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:02.205462] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-15T21:18:02.205541] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-15T21:18:02.205773] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-15T21:18:02.205829] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-15T21:18:02.205873] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-15T21:18:02.205905] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-15T21:18:02.516613] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-15T21:18:02.571714] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:02.596670] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T21:18:03.322021] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-15T21:18:03.331507] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T21:18:04.114008] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-15T21:18:04.321147] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T21:18:04.531289] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T21:18:04.914075] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-15T21:18:05.713987] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-15T21:18:05.776149] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T21:18:06.508216] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:18:06.516988] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-15T21:18:07.082214] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T21:18:07.314070] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-15T21:18:08.114001] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-15T21:18:08.504150] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T21:18:08.787744] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T21:18:08.914030] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-15T21:18:09.683031] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:18:09.713966] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-15T21:18:10.514008] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-15T21:18:10.713114] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T21:18:11.304184] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T21:18:11.309567] [INFO ] [REMOTE ] RTO: Full fetch complete (58428 records). [2025-10-15T21:18:11.309714] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-15T21:18:11.310327] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:18:11.310411] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:11.310454] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:11.310494] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-15T21:18:11.310552] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-15T21:18:11.310587] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-15T21:18:11.310626] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-15T21:18:11.310719] [INFO ] [MAIN ] Update Progress: 1836/2369 symbols completed. RTO took 31.7s. Estimated remaining: 1h 14m 56s. Rate: 7.1 symbols/min [2025-10-15T21:18:11.321533] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-15T21:18:11.511012] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:11.530036] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-15T21:18:11.541209] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-15T21:18:11.541472] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-15T21:18:11.541705] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-15T21:18:11.541983] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-15T21:18:11.542507] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-15T21:18:11.543688] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T21:18:11.921511] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:12.114091] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-15T21:18:12.914073] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-15T21:18:12.967487] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T21:18:13.096849] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T21:18:13.714025] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-15T21:18:14.514044] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-15T21:18:14.706866] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T21:18:15.222390] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-15T21:18:15.247888] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T21:18:15.253511] [INFO ] [REMOTE ] RSI: Full fetch complete (69345 records). [2025-10-15T21:18:15.253615] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-15T21:18:15.254292] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:18:15.254374] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:15.254415] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:15.254453] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-15T21:18:15.254507] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-15T21:18:15.254540] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-15T21:18:15.254577] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-15T21:18:15.254630] [INFO ] [MAIN ] Update Progress: 1837/2369 symbols completed. RSI took 50.3s. Estimated remaining: 1h 14m 46s. Rate: 7.1 symbols/min [2025-10-15T21:18:15.313966] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-15T21:18:16.114058] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-15T21:18:16.913974] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-15T21:18:17.447427] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-15T21:18:17.492872] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T21:18:17.714012] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-15T21:18:18.098708] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T21:18:18.513995] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-15T21:18:19.313977] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-15T21:18:19.511375] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T21:18:19.569509] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T21:18:20.114008] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-15T21:18:20.913995] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-15T21:18:21.457163] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T21:18:21.630429] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-15T21:18:21.714012] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-15T21:18:22.513987] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-15T21:18:22.733545] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:18:23.314055] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-15T21:18:23.753380] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T21:18:23.949695] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T21:18:24.113972] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-15T21:18:24.914025] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-15T21:18:25.011815] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T21:18:25.714010] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-15T21:18:26.168526] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T21:18:26.366360] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T21:18:26.514003] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-15T21:18:27.314003] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-15T21:18:27.343084] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T21:18:27.508389] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T21:18:28.114074] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-15T21:18:28.731148] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T21:18:28.795984] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:18:28.803175] [INFO ] [REMOTE ] RTX: Full fetch complete (77479 records). [2025-10-15T21:18:28.803433] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-15T21:18:28.804895] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:18:28.805040] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:28.805086] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:28.805133] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-15T21:18:28.805205] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-15T21:18:28.805247] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-15T21:18:28.805289] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-15T21:18:28.805362] [INFO ] [MAIN ] Update Progress: 1838/2369 symbols completed. RTX took 30.8s. Estimated remaining: 1h 14m 39s. Rate: 7.1 symbols/min [2025-10-15T21:18:28.914100] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-15T21:18:29.714014] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-15T21:18:30.161524] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T21:18:30.514051] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-15T21:18:31.434039] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T21:18:31.445907] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-15T21:18:31.744488] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T21:18:32.114042] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-15T21:18:32.759508] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T21:18:32.763160] [INFO ] [REMOTE ] RVT: Full fetch complete (38986 records). [2025-10-15T21:18:32.763280] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-15T21:18:32.763904] [FATAL] [VALIDATOR ] RVT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:18:32.763990] [FATAL] [MAIN ] RVT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:32.764067] [WARN ] [MAIN ] RVT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:32.764150] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-15T21:18:32.764222] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-15T21:18:32.764283] [INFO ] [LOCAL ] RVT: Starting deletion of derivative data. [2025-10-15T21:18:32.764324] [DEBUG] [LOCAL ] RVT: No derivative data file found to delete. [2025-10-15T21:18:32.764383] [INFO ] [MAIN ] Update Progress: 1839/2369 symbols completed. RVT took 21.5s. Estimated remaining: 1h 14m 29s. Rate: 7.1 symbols/min [2025-10-15T21:18:33.014914] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T21:18:33.025724] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-15T21:18:33.746206] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T21:18:33.752225] [INFO ] [REMOTE ] RVLV: Full fetch complete (68694 records). [2025-10-15T21:18:33.752409] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-15T21:18:33.753519] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:18:33.753623] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:33.753949] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:33.754051] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-15T21:18:33.754168] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-15T21:18:33.754246] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-15T21:18:33.754341] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-15T21:18:33.754464] [INFO ] [MAIN ] Update Progress: 1840/2369 symbols completed. RVLV took 31.7s. Estimated remaining: 1h 14m 19s. Rate: 7.1 symbols/min [2025-10-15T21:18:34.430585] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:34.482905] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:34.503137] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:34.503260] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-15T21:18:34.510041] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-15T21:18:34.509941] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-15T21:18:34.517253] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-15T21:18:34.521678] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-15T21:18:34.539861] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-15T21:18:34.536499] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-15T21:18:34.540058] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-15T21:18:34.540601] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-15T21:18:34.555442] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:34.555741] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-15T21:18:34.565738] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-15T21:18:34.555874] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-15T21:18:34.575160] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-15T21:18:34.575321] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-15T21:18:34.566007] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-15T21:18:34.585833] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-15T21:18:34.597304] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-15T21:18:34.597164] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-15T21:18:35.053825] [DEBUG] [LOCAL ] RWT: Loaded 40829 existing records from primary storage. [2025-10-15T21:18:35.115034] [INFO ] [MAIN ] RWT: Loaded 40829 existing records. [2025-10-15T21:18:35.797176] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:35.850176] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-15T21:18:35.881940] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:18:35.883111] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-15T21:18:35.895587] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-15T21:18:35.954567] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:35.951269] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-15T21:18:35.957164] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-15T21:18:35.957258] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-15T21:18:36.008836] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:36.018543] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-15T21:18:36.336664] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:36.336987] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-15T21:18:36.521427] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T21:18:36.541074] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T21:18:36.913988] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-15T21:18:37.546602] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T21:18:37.713999] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-15T21:18:37.805580] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T21:18:37.879818] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:18:38.340265] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T21:18:38.514032] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-15T21:18:39.006735] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T21:18:39.314015] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-15T21:18:39.831989] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T21:18:40.114016] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-15T21:18:40.654911] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T21:18:40.914056] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-15T21:18:41.473856] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T21:18:41.714021] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-15T21:18:42.254253] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T21:18:42.514033] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-15T21:18:43.035415] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T21:18:43.314027] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-15T21:18:43.979397] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T21:18:44.114051] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-15T21:18:44.914069] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-15T21:18:45.463587] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T21:18:45.713989] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-15T21:18:45.758119] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T21:18:46.481020] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T21:18:46.513997] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-15T21:18:47.137680] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T21:18:47.313993] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-15T21:18:47.812548] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-15T21:18:48.113984] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-15T21:18:48.607933] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T21:18:48.913976] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-15T21:18:49.713994] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-15T21:18:50.115711] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T21:18:50.514039] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-15T21:18:50.545188] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T21:18:51.060600] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T21:18:51.061803] [INFO ] [REMOTE ] RWTO: Full fetch complete (4815 records). [2025-10-15T21:18:51.061879] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-15T21:18:51.247280] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T21:18:51.247678] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:51.247744] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:51.247794] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-15T21:18:51.247859] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-15T21:18:51.247896] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-15T21:18:51.247935] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-15T21:18:51.247998] [INFO ] [MAIN ] Update Progress: 1841/2369 symbols completed. RWTO took 17.5s. Estimated remaining: 1h 14m 13s. Rate: 7.1 symbols/min [2025-10-15T21:18:51.319187] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-15T21:18:51.423010] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:51.423246] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-15T21:18:51.423287] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-15T21:18:51.423411] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-15T21:18:51.423454] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-15T21:18:51.423495] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-15T21:18:51.423529] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-15T21:18:51.793763] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:52.114065] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-15T21:18:52.549343] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T21:18:52.914011] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-15T21:18:53.176468] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T21:18:53.713995] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-15T21:18:54.445228] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T21:18:54.473989] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T21:18:54.513997] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-15T21:18:55.314023] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-15T21:18:55.839961] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T21:18:55.906944] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T21:18:56.114003] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-15T21:18:56.569492] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T21:18:56.570309] [INFO ] [REMOTE ] RWTN: Full fetch complete (3151 records). [2025-10-15T21:18:56.570407] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-15T21:18:56.742318] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-15T21:18:56.742520] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:18:56.742588] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:18:56.742683] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-15T21:18:56.742777] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-15T21:18:56.742832] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-15T21:18:56.742875] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-15T21:18:56.742931] [INFO ] [MAIN ] Update Progress: 1842/2369 symbols completed. RWTN took 23.0s. Estimated remaining: 1h 14m 4s. Rate: 7.1 symbols/min [2025-10-15T21:18:56.905221] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:56.905384] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-15T21:18:56.905420] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-15T21:18:56.905531] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-15T21:18:56.905571] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-15T21:18:56.905612] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-15T21:18:56.905669] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-15T21:18:56.919164] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-15T21:18:57.273439] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:57.714056] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-15T21:18:57.984621] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:18:57.985181] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-15T21:18:57.985301] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:18:57.985349] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-15T21:18:57.985405] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:18:57.985479] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-15T21:18:57.985549] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-15T21:18:57.985680] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-15T21:18:57.985747] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-15T21:18:57.985801] [INFO ] [MAIN ] Update Progress: 1843/2369 symbols completed. RWTP took 6.7s. Estimated remaining: 1h 13m 53s. Rate: 7.1 symbols/min [2025-10-15T21:18:58.190612] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:18:58.190870] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-15T21:18:58.190913] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-15T21:18:58.191037] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-15T21:18:58.191081] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-15T21:18:58.191122] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-15T21:18:58.191157] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-15T21:18:58.518943] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-15T21:18:58.585749] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:18:58.643690] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T21:18:59.314078] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-15T21:19:00.114020] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-15T21:19:00.410909] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T21:19:00.914039] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-15T21:19:00.973336] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T21:19:01.713972] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-15T21:19:01.989844] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T21:19:02.514019] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-15T21:19:02.566934] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T21:19:03.313970] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-15T21:19:03.431017] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T21:19:04.113997] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-15T21:19:04.288405] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T21:19:04.914018] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-15T21:19:04.989910] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T21:19:05.714040] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-15T21:19:05.831103] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T21:19:06.509064] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T21:19:06.517392] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-15T21:19:07.314042] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-15T21:19:07.396435] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T21:19:08.114037] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-15T21:19:08.361091] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T21:19:08.913964] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-15T21:19:09.142391] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T21:19:09.351636] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T21:19:09.714028] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-15T21:19:10.513984] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-15T21:19:10.680419] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T21:19:11.020571] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T21:19:11.314000] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-15T21:19:12.113984] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-15T21:19:12.167619] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T21:19:12.919142] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-15T21:19:12.942178] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T21:19:13.554637] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T21:19:13.713967] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-15T21:19:14.266968] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T21:19:14.513992] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-15T21:19:15.261604] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:19:15.267746] [INFO ] [REMOTE ] RVTY: Full fetch complete (67172 records). [2025-10-15T21:19:15.267989] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-15T21:19:15.268907] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:19:15.269001] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:19:15.269045] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:19:15.269088] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-15T21:19:15.269177] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-15T21:19:15.269213] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-15T21:19:15.269280] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-15T21:19:15.269385] [INFO ] [MAIN ] Update Progress: 1844/2369 symbols completed. RVTY took 41.5s. Estimated remaining: 1h 13m 47s. Rate: 7.1 symbols/min [2025-10-15T21:19:15.324638] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-15T21:19:15.456637] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:19:15.457079] [DEBUG] [LOCAL ] RYAM: No existing data file found in primary storage. [2025-10-15T21:19:15.457328] [WARN ] [MAIN ] RYAM: No existing data found, performing full refresh instead. [2025-10-15T21:19:15.457545] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-15T21:19:15.457710] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-15T21:19:15.457864] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-15T21:19:15.457925] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-15T21:19:15.871807] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-15T21:19:15.923925] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:19:16.114001] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-15T21:19:16.711738] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T21:19:16.914005] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-15T21:19:17.073120] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T21:19:17.714007] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-15T21:19:18.514035] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-15T21:19:18.580746] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T21:19:18.676762] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T21:19:19.314022] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-15T21:19:19.876632] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T21:19:20.114038] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-15T21:19:20.618451] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T21:19:20.914092] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-15T21:19:21.714036] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-15T21:19:21.791547] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T21:19:22.514055] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-15T21:19:22.587843] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T21:19:23.106882] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T21:19:23.314080] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-15T21:19:24.005851] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T21:19:24.011595] [INFO ] [REMOTE ] RWT: Full fetch complete (58279 records). [2025-10-15T21:19:24.011835] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-15T21:19:24.119338] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-15T21:19:24.414437] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-15T21:19:24.414543] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-15T21:19:24.416202] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-15T21:19:24.416274] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-15T21:19:24.417957] [DEBUG] [LOCAL ] RWT: Trimmed 58279 records to 40745 (keeping 200 days of data) [2025-10-15T21:19:24.658066] [DEBUG] [LOCAL ] RWT: Primary data saved (40745 records). [2025-10-15T21:19:24.658238] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-15T21:19:24.658364] [INFO ] [MAIN ] Update Progress: 1845/2369 symbols completed. RWT took 50.9s. Estimated remaining: 1h 13m 39s. Rate: 7.1 symbols/min [2025-10-15T21:19:24.843799] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:19:24.844088] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-15T21:19:24.844250] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-15T21:19:24.844537] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-15T21:19:24.844766] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-15T21:19:24.844985] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-15T21:19:24.845057] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-15T21:19:24.918489] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-15T21:19:25.032939] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T21:19:25.275208] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:19:25.714003] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-15T21:19:25.840558] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T21:19:26.514031] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-15T21:19:26.810876] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T21:19:27.259268] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T21:19:27.313999] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-15T21:19:27.796682] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T21:19:28.114066] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-15T21:19:28.913983] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-15T21:19:29.092946] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T21:19:29.550122] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T21:19:29.713999] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-15T21:19:30.513963] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-15T21:19:30.643550] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T21:19:31.314056] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-15T21:19:31.395356] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T21:19:32.114007] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-15T21:19:32.231976] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T21:19:32.914034] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-15T21:19:33.136341] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T21:19:33.446920] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T21:19:33.473230] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T21:19:33.479996] [INFO ] [REMOTE ] RY: Full fetch complete (68859 records). [2025-10-15T21:19:33.480201] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-15T21:19:33.481362] [FATAL] [VALIDATOR ] RY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:19:33.481459] [FATAL] [MAIN ] RY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:19:33.481504] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:19:33.481580] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-15T21:19:33.481701] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-15T21:19:33.481761] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-15T21:19:33.481810] [DEBUG] [LOCAL ] RY: No derivative data file found to delete. [2025-10-15T21:19:33.481878] [INFO ] [MAIN ] Update Progress: 1846/2369 symbols completed. RY took 35.5s. Estimated remaining: 1h 13m 31s. Rate: 7.1 symbols/min [2025-10-15T21:19:33.663719] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:19:33.663955] [DEBUG] [LOCAL ] RYI: No existing data file found in primary storage. [2025-10-15T21:19:33.663996] [WARN ] [MAIN ] RYI: No existing data found, performing full refresh instead. [2025-10-15T21:19:33.664122] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-15T21:19:33.664164] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-15T21:19:33.664207] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-15T21:19:33.664240] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-15T21:19:33.719199] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-15T21:19:34.034215] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:19:34.514069] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-15T21:19:35.314356] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-15T21:19:35.330526] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T21:19:35.354337] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T21:19:35.360287] [INFO ] [REMOTE ] RXO: Full fetch complete (68419 records). [2025-10-15T21:19:35.360400] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-15T21:19:35.361196] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:19:35.361298] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:19:35.361364] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:19:35.361452] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-15T21:19:35.361529] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-15T21:19:35.361576] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-15T21:19:35.361631] [DEBUG] [LOCAL ] RXO: No derivative data file found to delete. [2025-10-15T21:19:35.361774] [INFO ] [MAIN ] Update Progress: 1847/2369 symbols completed. RXO took 38.6s. Estimated remaining: 1h 13m 21s. Rate: 7.1 symbols/min [2025-10-15T21:19:35.529189] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:19:35.572312] [DEBUG] [LOCAL ] RYN: Loaded 45455 existing records from primary storage. [2025-10-15T21:19:35.572602] [INFO ] [MAIN ] RYN: Loaded 45455 existing records. [2025-10-15T21:19:35.747534] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:19:35.747782] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-15T21:19:35.747851] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-15T21:19:35.748784] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-15T21:19:35.748845] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-15T21:19:36.103384] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:19:36.113994] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-15T21:19:36.796547] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T21:19:36.914005] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-15T21:19:37.269013] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T21:19:37.714038] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-15T21:19:38.514079] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-15T21:19:38.585721] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:19:39.187138] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T21:19:39.314014] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-15T21:19:40.107841] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:19:40.117337] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-15T21:19:40.755274] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T21:19:40.914043] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-15T21:19:41.708206] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:19:41.716570] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-15T21:19:42.095614] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T21:19:42.514021] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-15T21:19:43.313987] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-15T21:19:43.501590] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T21:19:43.673009] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T21:19:43.966009] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T21:19:43.970484] [INFO ] [REMOTE ] RYAM: Full fetch complete (48869 records). [2025-10-15T21:19:43.970599] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-15T21:19:43.971348] [FATAL] [VALIDATOR ] RYAM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:19:43.971438] [FATAL] [MAIN ] RYAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:19:43.971483] [WARN ] [MAIN ] RYAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:19:43.971526] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-15T21:19:43.971592] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-15T21:19:43.971627] [INFO ] [LOCAL ] RYAM: Starting deletion of derivative data. [2025-10-15T21:19:43.971722] [DEBUG] [LOCAL ] RYAM: No derivative data file found to delete. [2025-10-15T21:19:43.971794] [INFO ] [MAIN ] Update Progress: 1848/2369 symbols completed. RYAM took 28.7s. Estimated remaining: 1h 13m 12s. Rate: 7.1 symbols/min [2025-10-15T21:19:44.121782] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-15T21:19:44.151946] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:19:44.152289] [DEBUG] [LOCAL ] RZB: No existing data file found in primary storage. [2025-10-15T21:19:44.152340] [WARN ] [MAIN ] RZB: No existing data found, performing full refresh instead. [2025-10-15T21:19:44.152475] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-15T21:19:44.152522] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-15T21:19:44.152566] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-15T21:19:44.152599] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-15T21:19:44.537164] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:19:44.914002] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-15T21:19:45.424772] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T21:19:45.714082] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-15T21:19:46.256488] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T21:19:46.514013] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-15T21:19:46.911955] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T21:19:47.314012] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-15T21:19:47.325342] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T21:19:48.114053] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-15T21:19:48.815827] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T21:19:48.914032] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-15T21:19:49.095918] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T21:19:49.714061] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-15T21:19:50.355416] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T21:19:50.519778] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-15T21:19:50.537837] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:19:51.314052] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-15T21:19:52.114030] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-15T21:19:52.215268] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T21:19:52.496852] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T21:19:52.914002] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-15T21:19:53.187482] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T21:19:53.714128] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-15T21:19:54.513980] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-15T21:19:54.550870] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T21:19:54.591411] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T21:19:55.314029] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-15T21:19:55.959109] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T21:19:56.113991] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-15T21:19:56.235790] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T21:19:56.914036] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-15T21:19:57.539503] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:19:57.595060] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-15T21:19:57.714020] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-15T21:19:58.514107] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-15T21:19:59.313987] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-15T21:19:59.416694] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T21:19:59.455693] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T21:20:00.114013] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-15T21:20:00.313219] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T21:20:00.914009] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-15T21:20:01.548102] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T21:20:01.669090] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T21:20:01.714009] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-15T21:20:02.432632] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T21:20:02.514035] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-15T21:20:03.314050] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-15T21:20:03.997585] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T21:20:04.114047] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-15T21:20:04.330540] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T21:20:04.348295] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-15T21:20:04.349525] [INFO ] [REMOTE ] RZB: Full fetch complete (8431 records). [2025-10-15T21:20:04.349600] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-15T21:20:04.350141] [FATAL] [VALIDATOR ] RZB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:20:04.350227] [FATAL] [MAIN ] RZB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:20:04.350394] [WARN ] [MAIN ] RZB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:20:04.350484] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-15T21:20:04.350607] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-15T21:20:04.350673] [INFO ] [LOCAL ] RZB: Starting deletion of derivative data. [2025-10-15T21:20:04.350741] [DEBUG] [LOCAL ] RZB: No derivative data file found to delete. [2025-10-15T21:20:04.350806] [INFO ] [MAIN ] Update Progress: 1849/2369 symbols completed. RZB took 20.4s. Estimated remaining: 1h 13m 7s. Rate: 7.1 symbols/min [2025-10-15T21:20:04.544882] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:04.555030] [DEBUG] [LOCAL ] RZC: Loaded 6756 existing records from primary storage. [2025-10-15T21:20:04.555386] [INFO ] [MAIN ] RZC: Loaded 6756 existing records. [2025-10-15T21:20:04.765076] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:04.765409] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-15T21:20:04.765464] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-15T21:20:04.765896] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-15T21:20:04.765957] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-15T21:20:04.919133] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-15T21:20:05.132766] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:05.714008] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-15T21:20:06.218789] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T21:20:06.514005] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-15T21:20:07.313973] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-15T21:20:07.498488] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T21:20:07.534053] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T21:20:08.114046] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-15T21:20:08.372856] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T21:20:08.806949] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T21:20:08.913998] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-15T21:20:09.714048] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-15T21:20:10.507229] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T21:20:10.513948] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-15T21:20:10.626418] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T21:20:11.313997] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-15T21:20:11.345739] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T21:20:11.764212] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T21:20:11.766977] [INFO ] [REMOTE ] RYI: Full fetch complete (31876 records). [2025-10-15T21:20:11.767066] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-15T21:20:11.767613] [FATAL] [VALIDATOR ] RYI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:20:11.767737] [FATAL] [MAIN ] RYI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:20:11.767812] [WARN ] [MAIN ] RYI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:20:11.767892] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-15T21:20:11.767997] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-15T21:20:11.768081] [INFO ] [LOCAL ] RYI: Starting deletion of derivative data. [2025-10-15T21:20:11.768139] [DEBUG] [LOCAL ] RYI: No derivative data file found to delete. [2025-10-15T21:20:11.768239] [INFO ] [MAIN ] Update Progress: 1850/2369 symbols completed. RYI took 38.3s. Estimated remaining: 1h 12m 58s. Rate: 7.1 symbols/min [2025-10-15T21:20:11.937107] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:11.986791] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-15T21:20:11.987097] [INFO ] [MAIN ] S: Loaded 53536 existing records. [2025-10-15T21:20:12.129266] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-15T21:20:12.171583] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:12.172231] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-15T21:20:12.172284] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-15T21:20:12.173440] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-15T21:20:12.173499] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-15T21:20:12.725107] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:12.914087] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-15T21:20:12.955521] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:20:12.965292] [INFO ] [REMOTE ] RYAN: Full fetch complete (64270 records). [2025-10-15T21:20:12.965633] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-15T21:20:12.967017] [FATAL] [VALIDATOR ] RYAN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:20:12.967158] [FATAL] [MAIN ] RYAN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:20:12.967216] [WARN ] [MAIN ] RYAN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:20:12.967276] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-15T21:20:12.967375] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-15T21:20:12.967441] [INFO ] [LOCAL ] RYAN: Starting deletion of derivative data. [2025-10-15T21:20:12.967498] [DEBUG] [LOCAL ] RYAN: No derivative data file found to delete. [2025-10-15T21:20:12.967602] [INFO ] [MAIN ] Update Progress: 1851/2369 symbols completed. RYAN took 48.3s. Estimated remaining: 1h 12m 48s. Rate: 7.1 symbols/min [2025-10-15T21:20:13.165681] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:13.220066] [DEBUG] [LOCAL ] SA: Loaded 44313 existing records from primary storage. [2025-10-15T21:20:13.220749] [INFO ] [MAIN ] SA: Loaded 44313 existing records. [2025-10-15T21:20:13.425283] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:13.425504] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-15T21:20:13.425554] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-15T21:20:13.426428] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-15T21:20:13.426489] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-15T21:20:13.719153] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-15T21:20:13.821163] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:13.822906] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T21:20:14.514007] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-15T21:20:15.218417] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T21:20:15.314006] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-15T21:20:15.454176] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T21:20:15.876336] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T21:20:16.114015] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-15T21:20:16.914077] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-15T21:20:17.711239] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T21:20:17.713939] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-15T21:20:18.492880] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T21:20:18.520479] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-15T21:20:18.530072] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T21:20:19.313964] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-15T21:20:19.346761] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T21:20:19.351977] [INFO ] [REMOTE ] RYN: Full fetch complete (64996 records). [2025-10-15T21:20:19.352122] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-15T21:20:19.352888] [FATAL] [VALIDATOR ] RYN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:20:19.352981] [FATAL] [MAIN ] RYN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:20:19.353025] [WARN ] [MAIN ] RYN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:20:19.353100] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-15T21:20:19.353174] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-15T21:20:19.353241] [INFO ] [LOCAL ] RYN: Starting deletion of derivative data. [2025-10-15T21:20:19.353410] [DEBUG] [LOCAL ] RYN: Deleted derivative data file. [2025-10-15T21:20:19.353500] [INFO ] [MAIN ] Update Progress: 1852/2369 symbols completed. RYN took 44.0s. Estimated remaining: 1h 12m 39s. Rate: 7.1 symbols/min [2025-10-15T21:20:19.534165] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:19.544456] [DEBUG] [LOCAL ] SABA: Loaded 9326 existing records from primary storage. [2025-10-15T21:20:19.544709] [INFO ] [MAIN ] SABA: Loaded 9326 existing records. [2025-10-15T21:20:19.735469] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:19.735697] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-15T21:20:19.735753] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-15T21:20:19.736040] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-15T21:20:19.736096] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-15T21:20:20.089534] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:20.113979] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-15T21:20:20.802468] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T21:20:20.914028] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-15T21:20:21.378829] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T21:20:21.404981] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T21:20:21.406169] [INFO ] [REMOTE ] RZC: Full fetch complete (9660 records). [2025-10-15T21:20:21.406266] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-15T21:20:21.406700] [FATAL] [VALIDATOR ] RZC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T21:20:21.406790] [FATAL] [MAIN ] RZC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:20:21.406834] [WARN ] [MAIN ] RZC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:20:21.406898] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-15T21:20:21.406965] [DEBUG] [LOCAL ] RZC: No primary data file found to delete. [2025-10-15T21:20:21.407001] [INFO ] [LOCAL ] RZC: Starting deletion of derivative data. [2025-10-15T21:20:21.407155] [DEBUG] [LOCAL ] RZC: Deleted derivative data file. [2025-10-15T21:20:21.407245] [INFO ] [MAIN ] Update Progress: 1853/2369 symbols completed. RZC took 17.1s. Estimated remaining: 1h 12m 29s. Rate: 7.1 symbols/min [2025-10-15T21:20:21.586014] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:21.617216] [DEBUG] [LOCAL ] SAFE: Loaded 30390 existing records from primary storage. [2025-10-15T21:20:21.617487] [INFO ] [MAIN ] SAFE: Loaded 30390 existing records. [2025-10-15T21:20:21.719127] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-15T21:20:21.816306] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:21.816530] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-15T21:20:21.816595] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-15T21:20:21.817471] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-15T21:20:21.817530] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-15T21:20:22.171194] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:22.513997] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-15T21:20:22.619927] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T21:20:23.314005] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-15T21:20:24.113998] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-15T21:20:24.555083] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-15T21:20:24.637182] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T21:20:24.860126] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T21:20:24.913990] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-15T21:20:25.714013] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-15T21:20:26.514020] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-15T21:20:26.569733] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T21:20:27.136950] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-15T21:20:27.314008] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-15T21:20:27.863849] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T21:20:28.114011] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-15T21:20:28.125841] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T21:20:28.913999] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-15T21:20:29.546920] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T21:20:29.713987] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-15T21:20:29.787582] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T21:20:30.513997] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-15T21:20:31.313988] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-15T21:20:31.828954] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T21:20:31.846808] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T21:20:32.098314] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T21:20:32.113944] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-15T21:20:32.913999] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-15T21:20:33.714030] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-15T21:20:33.810148] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T21:20:34.514002] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-15T21:20:34.982189] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T21:20:35.058998] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T21:20:35.314013] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-15T21:20:35.857340] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T21:20:36.114009] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-15T21:20:36.913997] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-15T21:20:37.370411] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-15T21:20:37.457990] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T21:20:37.713996] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-15T21:20:37.795136] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T21:20:38.514014] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-15T21:20:39.018114] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T21:20:39.314032] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-15T21:20:40.113997] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-15T21:20:40.615671] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T21:20:40.798623] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T21:20:40.903933] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T21:20:40.913963] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-15T21:20:41.713970] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-15T21:20:42.155985] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T21:20:42.206923] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T21:20:42.513993] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-15T21:20:43.314027] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-15T21:20:44.114010] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-15T21:20:44.180691] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:20:44.181558] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T21:20:44.913995] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-15T21:20:45.714075] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-15T21:20:46.298793] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T21:20:46.471347] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T21:20:46.472970] [INFO ] [REMOTE ] SABA: Full fetch complete (15270 records). [2025-10-15T21:20:46.473063] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-15T21:20:46.515742] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-15T21:20:46.767170] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-15T21:20:46.882327] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-15T21:20:46.882415] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-15T21:20:46.882851] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-15T21:20:46.882911] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-15T21:20:46.883394] [DEBUG] [LOCAL ] SABA: Trimmed 15270 records to 9309 (keeping 200 days of data) [2025-10-15T21:20:46.939059] [DEBUG] [LOCAL ] SABA: Primary data saved (9309 records). [2025-10-15T21:20:46.939202] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-15T21:20:46.939289] [INFO ] [MAIN ] Update Progress: 1854/2369 symbols completed. SABA took 27.6s. Estimated remaining: 1h 12m 25s. Rate: 7.1 symbols/min [2025-10-15T21:20:47.135188] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:47.157304] [DEBUG] [LOCAL ] SAH: Loaded 21418 existing records from primary storage. [2025-10-15T21:20:47.157583] [INFO ] [MAIN ] SAH: Loaded 21418 existing records. [2025-10-15T21:20:47.318074] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-15T21:20:47.343878] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:47.344195] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-15T21:20:47.344244] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-15T21:20:47.344915] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-15T21:20:47.344973] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-15T21:20:47.693919] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:48.114060] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-15T21:20:48.770744] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-15T21:20:48.855393] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T21:20:48.886023] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:20:48.913956] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-15T21:20:49.714047] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-15T21:20:50.514016] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-15T21:20:50.622703] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T21:20:51.313991] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-15T21:20:51.735161] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-15T21:20:51.744060] [INFO ] [REMOTE ] S: Full fetch complete (77658 records). [2025-10-15T21:20:51.744227] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-15T21:20:51.949304] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T21:20:52.115394] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-15T21:20:52.212113] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-15T21:20:52.212203] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-15T21:20:52.213316] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-15T21:20:52.213381] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-15T21:20:52.214837] [DEBUG] [LOCAL ] S: Trimmed 77658 records to 53536 (keeping 200 days of data) [2025-10-15T21:20:52.531926] [DEBUG] [LOCAL ] S: Primary data saved (53536 records). [2025-10-15T21:20:52.532077] [INFO ] [MAIN ] S: Full history saved. [2025-10-15T21:20:52.532373] [INFO ] [MAIN ] Update Progress: 1855/2369 symbols completed. S took 40.8s. Estimated remaining: 1h 12m 16s. Rate: 7.1 symbols/min [2025-10-15T21:20:52.709951] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:52.710171] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-15T21:20:52.710239] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-15T21:20:52.710421] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-15T21:20:52.710573] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-15T21:20:52.710686] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-15T21:20:52.710741] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-15T21:20:52.923835] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-15T21:20:53.020897] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T21:20:53.112814] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:53.495751] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T21:20:53.714737] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-15T21:20:53.719619] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T21:20:54.514020] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-15T21:20:54.757073] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T21:20:55.313969] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-15T21:20:55.546574] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T21:20:55.632248] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T21:20:56.114080] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-15T21:20:56.913985] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-15T21:20:57.025181] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T21:20:57.028836] [INFO ] [REMOTE ] SAFE: Full fetch complete (44545 records). [2025-10-15T21:20:57.028951] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-15T21:20:57.295460] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-15T21:20:57.406804] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-15T21:20:57.406898] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-15T21:20:57.407817] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-15T21:20:57.407882] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-15T21:20:57.409196] [DEBUG] [LOCAL ] SAFE: Trimmed 44545 records to 30428 (keeping 200 days of data) [2025-10-15T21:20:57.596155] [DEBUG] [LOCAL ] SAFE: Primary data saved (30428 records). [2025-10-15T21:20:57.596299] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-15T21:20:57.596381] [INFO ] [MAIN ] Update Progress: 1856/2369 symbols completed. SAFE took 36.2s. Estimated remaining: 1h 12m 7s. Rate: 7.1 symbols/min [2025-10-15T21:20:57.719074] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-15T21:20:57.765210] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:20:57.787104] [DEBUG] [LOCAL ] SAM: Loaded 21426 existing records from primary storage. [2025-10-15T21:20:57.787368] [INFO ] [MAIN ] SAM: Loaded 21426 existing records. [2025-10-15T21:20:57.962669] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:20:57.962943] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-15T21:20:57.962995] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-15T21:20:57.963152] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-15T21:20:57.963189] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-15T21:20:58.128554] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T21:20:58.313293] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:20:58.514017] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-15T21:20:59.313978] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-15T21:20:59.435428] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T21:21:00.113968] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-15T21:21:00.362275] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T21:21:00.913984] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-15T21:21:01.713997] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-15T21:21:01.961291] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T21:21:01.967356] [INFO ] [REMOTE ] SA: Full fetch complete (63229 records). [2025-10-15T21:21:01.967456] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-15T21:21:02.353991] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-15T21:21:02.354099] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-15T21:21:02.355097] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-15T21:21:02.355243] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-15T21:21:02.372078] [DEBUG] [LOCAL ] SA: Trimmed 63229 records to 44342 (keeping 200 days of data) [2025-10-15T21:21:02.373192] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T21:21:02.540432] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-15T21:21:02.637695] [DEBUG] [LOCAL ] SA: Primary data saved (44342 records). [2025-10-15T21:21:02.637816] [INFO ] [MAIN ] SA: Full history saved. [2025-10-15T21:21:02.638613] [INFO ] [MAIN ] Update Progress: 1857/2369 symbols completed. SA took 49.7s. Estimated remaining: 1h 11m 57s. Rate: 7.1 symbols/min [2025-10-15T21:21:02.823623] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:02.875973] [DEBUG] [LOCAL ] SAN: Loaded 52972 existing records from primary storage. [2025-10-15T21:21:02.876298] [INFO ] [MAIN ] SAN: Loaded 52972 existing records. [2025-10-15T21:21:03.016795] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T21:21:03.088136] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:21:03.088388] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-15T21:21:03.088441] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-15T21:21:03.088870] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-15T21:21:03.088928] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-15T21:21:03.323829] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-15T21:21:03.440212] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:21:03.698015] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-15T21:21:04.022036] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T21:21:04.114049] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-15T21:21:04.913973] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-15T21:21:05.196334] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T21:21:05.714033] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-15T21:21:06.062735] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T21:21:06.514027] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-15T21:21:06.722478] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T21:21:07.314045] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-15T21:21:07.597875] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T21:21:08.114012] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-15T21:21:08.435736] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T21:21:08.913974] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-15T21:21:09.025247] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T21:21:09.222607] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T21:21:09.714049] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-15T21:21:10.513978] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-15T21:21:10.764512] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T21:21:10.846048] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T21:21:11.314021] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-15T21:21:12.114051] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-15T21:21:12.449218] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T21:21:12.913990] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-15T21:21:13.385082] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-15T21:21:13.713990] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-15T21:21:14.124907] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-15T21:21:14.150101] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:21:14.514064] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-15T21:21:15.313978] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-15T21:21:15.567997] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-15T21:21:15.569574] [INFO ] [REMOTE ] SAJ: Full fetch complete (921 records). [2025-10-15T21:21:15.571463] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:21:15.571666] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-15T21:21:15.767388] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-15T21:21:15.767597] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:21:15.767688] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:21:15.767764] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-15T21:21:15.767827] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-15T21:21:15.767911] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-15T21:21:15.767961] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-15T21:21:15.768022] [INFO ] [MAIN ] Update Progress: 1858/2369 symbols completed. SAJ took 23.2s. Estimated remaining: 1h 11m 50s. Rate: 7.1 symbols/min [2025-10-15T21:21:15.963566] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:16.017010] [DEBUG] [LOCAL ] SAND: Loaded 51857 existing records from primary storage. [2025-10-15T21:21:16.017410] [INFO ] [MAIN ] SAND: Loaded 51857 existing records. [2025-10-15T21:21:16.119204] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-15T21:21:16.234430] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:21:16.234744] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-15T21:21:16.234822] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-15T21:21:16.236159] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-15T21:21:16.236219] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-15T21:21:16.605834] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:21:16.913994] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-15T21:21:17.288049] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T21:21:17.714025] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-15T21:21:18.513995] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-15T21:21:18.860056] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T21:21:19.114793] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T21:21:19.314012] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-15T21:21:19.483489] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T21:21:20.113996] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-15T21:21:20.496309] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T21:21:20.914454] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-15T21:21:21.713993] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-15T21:21:21.808430] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T21:21:21.810194] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T21:21:21.822705] [INFO ] [REMOTE ] SAH: Full fetch complete (30816 records). [2025-10-15T21:21:21.823334] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-15T21:21:22.184270] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-15T21:21:22.184357] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-15T21:21:22.185023] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-15T21:21:22.185084] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-15T21:21:22.185863] [DEBUG] [LOCAL ] SAH: Trimmed 30816 records to 21266 (keeping 200 days of data) [2025-10-15T21:21:22.312706] [DEBUG] [LOCAL ] SAH: Primary data saved (21266 records). [2025-10-15T21:21:22.312827] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-15T21:21:22.312901] [INFO ] [MAIN ] Update Progress: 1859/2369 symbols completed. SAH took 35.4s. Estimated remaining: 1h 11m 41s. Rate: 7.1 symbols/min [2025-10-15T21:21:22.475272] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:22.517514] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-15T21:21:22.519523] [DEBUG] [LOCAL ] SAP: Loaded 49909 existing records from primary storage. [2025-10-15T21:21:22.519785] [INFO ] [MAIN ] SAP: Loaded 49909 existing records. [2025-10-15T21:21:22.692827] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:21:22.693018] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-15T21:21:22.693082] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-15T21:21:22.694009] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-15T21:21:22.694066] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-15T21:21:23.038568] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:21:23.314020] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-15T21:21:23.549949] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T21:21:23.656391] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T21:21:24.114005] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-15T21:21:24.897226] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:21:24.913948] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-15T21:21:25.363588] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T21:21:25.713993] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-15T21:21:26.514017] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-15T21:21:26.856538] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T21:21:27.313980] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-15T21:21:27.529389] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T21:21:28.114044] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-15T21:21:28.347470] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T21:21:28.773225] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T21:21:28.914007] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-15T21:21:29.459066] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T21:21:29.713995] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-15T21:21:30.514003] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-15T21:21:30.822307] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T21:21:31.313967] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-15T21:21:31.655256] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T21:21:32.114015] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-15T21:21:32.279107] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T21:21:32.763334] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T21:21:32.913963] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-15T21:21:33.714017] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-15T21:21:33.837319] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T21:21:34.513983] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-15T21:21:34.866523] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T21:21:34.927003] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T21:21:35.314000] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-15T21:21:36.114006] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-15T21:21:36.445881] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T21:21:36.902708] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T21:21:36.913944] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-15T21:21:36.990310] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T21:21:37.713998] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-15T21:21:37.969408] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T21:21:37.972460] [INFO ] [REMOTE ] SAM: Full fetch complete (31079 records). [2025-10-15T21:21:37.972556] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-15T21:21:38.333976] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-15T21:21:38.334053] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-15T21:21:38.334703] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-15T21:21:38.334763] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-15T21:21:38.335441] [DEBUG] [LOCAL ] SAM: Trimmed 31079 records to 21391 (keeping 200 days of data) [2025-10-15T21:21:38.467486] [DEBUG] [LOCAL ] SAM: Primary data saved (21391 records). [2025-10-15T21:21:38.467613] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-15T21:21:38.467721] [INFO ] [MAIN ] Update Progress: 1860/2369 symbols completed. SAM took 40.9s. Estimated remaining: 1h 11m 35s. Rate: 7.1 symbols/min [2025-10-15T21:21:38.519130] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-15T21:21:38.676487] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:38.694477] [DEBUG] [LOCAL ] SAR: Loaded 17198 existing records from primary storage. [2025-10-15T21:21:38.694752] [INFO ] [MAIN ] SAR: Loaded 17198 existing records. [2025-10-15T21:21:38.867956] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:21:38.868194] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-15T21:21:38.868252] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-15T21:21:38.868501] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-15T21:21:38.868557] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-15T21:21:39.218781] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:21:39.313991] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-15T21:21:39.489623] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T21:21:39.496402] [INFO ] [REMOTE ] SAN: Full fetch complete (76515 records). [2025-10-15T21:21:39.496529] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-15T21:21:39.888120] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-15T21:21:39.888244] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-15T21:21:39.889402] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-15T21:21:39.889469] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-15T21:21:39.891089] [DEBUG] [LOCAL ] SAN: Trimmed 76515 records to 52965 (keeping 200 days of data) [2025-10-15T21:21:40.115290] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-15T21:21:40.212768] [DEBUG] [LOCAL ] SAN: Primary data saved (52965 records). [2025-10-15T21:21:40.212913] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-15T21:21:40.213819] [INFO ] [MAIN ] Update Progress: 1861/2369 symbols completed. SAN took 37.6s. Estimated remaining: 1h 11m 24s. Rate: 7.1 symbols/min [2025-10-15T21:21:40.355025] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T21:21:40.416118] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:40.454537] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T21:21:40.505076] [DEBUG] [LOCAL ] SARO: Loaded 48343 existing records from primary storage. [2025-10-15T21:21:40.505434] [INFO ] [MAIN ] SARO: Loaded 48343 existing records. [2025-10-15T21:21:40.717165] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:21:40.717379] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-15T21:21:40.717425] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-15T21:21:40.717630] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-15T21:21:40.717722] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-15T21:21:40.925532] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-15T21:21:41.076594] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:21:41.714023] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-15T21:21:41.812554] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T21:21:42.442004] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T21:21:42.513999] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-15T21:21:42.965846] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T21:21:43.313997] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-15T21:21:43.506996] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T21:21:44.114043] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-15T21:21:44.913987] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-15T21:21:45.137223] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T21:21:45.242320] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T21:21:45.714037] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-15T21:21:46.513980] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-15T21:21:46.702422] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T21:21:46.704069] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T21:21:47.314005] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-15T21:21:47.871628] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T21:21:48.113966] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-15T21:21:48.316749] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T21:21:48.914000] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-15T21:21:49.405889] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T21:21:49.714022] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-15T21:21:50.514095] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-15T21:21:50.717630] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T21:21:51.215739] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T21:21:51.314021] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-15T21:21:51.926168] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T21:21:52.114014] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-15T21:21:52.913982] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-15T21:21:53.299489] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T21:21:53.714046] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-15T21:21:53.756546] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T21:21:54.430852] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T21:21:54.513990] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-15T21:21:55.033567] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T21:21:55.040329] [INFO ] [REMOTE ] SAND: Full fetch complete (74737 records). [2025-10-15T21:21:55.040484] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-15T21:21:55.319202] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-15T21:21:55.466475] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-15T21:21:55.466577] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-15T21:21:55.467686] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-15T21:21:55.467748] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-15T21:21:55.469142] [DEBUG] [LOCAL ] SAND: Trimmed 74737 records to 51858 (keeping 200 days of data) [2025-10-15T21:21:55.792549] [DEBUG] [LOCAL ] SAND: Primary data saved (51858 records). [2025-10-15T21:21:55.792726] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-15T21:21:55.793119] [INFO ] [MAIN ] Update Progress: 1862/2369 symbols completed. SAND took 40.0s. Estimated remaining: 1h 11m 18s. Rate: 7.1 symbols/min [2025-10-15T21:21:55.970590] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:55.970820] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-15T21:21:55.970863] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-15T21:21:55.970989] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-15T21:21:55.971042] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-15T21:21:55.971085] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-15T21:21:55.971118] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-15T21:21:56.133678] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-15T21:21:56.343151] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:21:56.379823] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T21:21:56.913999] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-15T21:21:56.964638] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T21:21:57.297557] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T21:21:57.714007] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-15T21:21:58.514009] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-15T21:21:58.739477] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T21:21:58.745739] [INFO ] [REMOTE ] SAP: Full fetch complete (72130 records). [2025-10-15T21:21:58.745899] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-15T21:21:59.037113] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-15T21:21:59.148177] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-15T21:21:59.148524] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-15T21:21:59.149828] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-15T21:21:59.149943] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-15T21:21:59.151561] [DEBUG] [LOCAL ] SAP: Trimmed 72130 records to 49879 (keeping 200 days of data) [2025-10-15T21:21:59.337051] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-15T21:21:59.417982] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T21:21:59.510939] [DEBUG] [LOCAL ] SAP: Primary data saved (49879 records). [2025-10-15T21:21:59.511104] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-15T21:21:59.511220] [INFO ] [MAIN ] Update Progress: 1863/2369 symbols completed. SAP took 37.2s. Estimated remaining: 1h 11m 8s. Rate: 7.1 symbols/min [2025-10-15T21:21:59.677400] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:21:59.677569] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-15T21:21:59.677626] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-15T21:21:59.677758] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-15T21:21:59.677802] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-15T21:21:59.677843] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-15T21:21:59.677878] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-15T21:21:59.817689] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-15T21:22:00.035076] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:00.113993] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-15T21:22:00.554188] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T21:22:00.913993] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-15T21:22:01.249627] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T21:22:01.714016] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-15T21:22:02.513992] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-15T21:22:02.851310] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T21:22:03.313978] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-15T21:22:03.420727] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T21:22:03.582024] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-15T21:22:04.114012] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-15T21:22:04.458832] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T21:22:04.914021] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-15T21:22:05.714020] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-15T21:22:06.144480] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T21:22:06.507184] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T21:22:06.516890] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-15T21:22:07.314021] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-15T21:22:07.597173] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-15T21:22:07.623074] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T21:22:08.114064] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-15T21:22:08.899990] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T21:22:08.913945] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-15T21:22:09.714003] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-15T21:22:10.047785] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T21:22:10.513997] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-15T21:22:10.847743] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T21:22:11.284797] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:22:11.313968] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-15T21:22:12.114001] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-15T21:22:12.898128] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T21:22:12.914101] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-15T21:22:13.097270] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T21:22:13.102755] [INFO ] [REMOTE ] SAR: Full fetch complete (23862 records). [2025-10-15T21:22:13.102949] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-15T21:22:13.301602] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T21:22:13.607032] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-15T21:22:13.607122] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-15T21:22:13.607732] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-15T21:22:13.607794] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-15T21:22:13.608586] [DEBUG] [LOCAL ] SAR: Trimmed 23862 records to 17223 (keeping 200 days of data) [2025-10-15T21:22:13.714000] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-15T21:22:13.724170] [DEBUG] [LOCAL ] SAR: Primary data saved (17223 records). [2025-10-15T21:22:13.724318] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-15T21:22:13.724401] [INFO ] [MAIN ] Update Progress: 1864/2369 symbols completed. SAR took 35.3s. Estimated remaining: 1h 11m 1s. Rate: 7.1 symbols/min [2025-10-15T21:22:13.890080] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:22:13.890224] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-15T21:22:13.890261] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-15T21:22:13.890363] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-15T21:22:13.890418] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-15T21:22:13.890484] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-15T21:22:13.890518] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-15T21:22:14.233219] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:14.514037] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-15T21:22:14.853993] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-15T21:22:15.182752] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T21:22:15.189031] [INFO ] [REMOTE ] SARO: Full fetch complete (68921 records). [2025-10-15T21:22:15.189221] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-15T21:22:15.319112] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-15T21:22:15.598571] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-15T21:22:15.598676] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-15T21:22:15.599845] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-15T21:22:15.599910] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-15T21:22:15.601244] [DEBUG] [LOCAL ] SARO: Trimmed 68921 records to 48340 (keeping 200 days of data) [2025-10-15T21:22:15.824211] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T21:22:15.889854] [DEBUG] [LOCAL ] SARO: Primary data saved (48340 records). [2025-10-15T21:22:15.890027] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-15T21:22:15.891107] [INFO ] [MAIN ] Update Progress: 1865/2369 symbols completed. SARO took 35.7s. Estimated remaining: 1h 10m 51s. Rate: 7.1 symbols/min [2025-10-15T21:22:16.054726] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:22:16.089622] [DEBUG] [LOCAL ] SB: Loaded 32929 existing records from primary storage. [2025-10-15T21:22:16.089954] [INFO ] [MAIN ] SB: Loaded 32929 existing records. [2025-10-15T21:22:16.119184] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-15T21:22:16.283473] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:22:16.283708] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-15T21:22:16.283765] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-15T21:22:16.284014] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-15T21:22:16.284070] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-15T21:22:16.547750] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T21:22:16.637912] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:16.914058] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-15T21:22:17.714049] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-15T21:22:18.060198] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-15T21:22:18.408092] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T21:22:18.513998] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-15T21:22:19.314072] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-15T21:22:19.846041] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T21:22:19.867145] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T21:22:20.114006] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-15T21:22:20.443953] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T21:22:20.913994] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-15T21:22:21.247830] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T21:22:21.714010] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-15T21:22:22.047229] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-15T21:22:22.513989] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-15T21:22:22.841306] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T21:22:23.314049] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-15T21:22:23.701502] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T21:22:24.114013] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-15T21:22:24.643619] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T21:22:24.914005] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-15T21:22:25.236377] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-15T21:22:25.713996] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-15T21:22:26.043912] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-15T21:22:26.514027] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-15T21:22:27.314004] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-15T21:22:27.627368] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-15T21:22:27.628139] [INFO ] [REMOTE ] SAT: Full fetch complete (1516 records). [2025-10-15T21:22:27.628238] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-15T21:22:27.825766] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T21:22:27.826032] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:22:27.826101] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:22:27.826173] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-15T21:22:27.826236] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-15T21:22:27.826270] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-15T21:22:27.826308] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-15T21:22:27.826361] [INFO ] [MAIN ] Update Progress: 1866/2369 symbols completed. SAT took 32.0s. Estimated remaining: 1h 10m 44s. Rate: 7.1 symbols/min [2025-10-15T21:22:28.030143] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:22:28.027782] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:22:28.030423] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-15T21:22:28.037819] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-15T21:22:28.038358] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-15T21:22:28.038809] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-15T21:22:28.038879] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-15T21:22:28.038915] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-15T21:22:28.119146] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-15T21:22:28.386969] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:28.914008] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-15T21:22:29.124536] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:22:29.124921] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-15T21:22:29.125012] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:22:29.125058] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-15T21:22:29.125090] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:22:29.125156] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-15T21:22:29.125220] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-15T21:22:29.125255] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-15T21:22:29.125294] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-15T21:22:29.125340] [INFO ] [MAIN ] Update Progress: 1867/2369 symbols completed. SBDS took 1.3s. Estimated remaining: 1h 10m 33s. Rate: 7.1 symbols/min [2025-10-15T21:22:29.297779] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:22:29.346931] [DEBUG] [LOCAL ] SBH: Loaded 49865 existing records from primary storage. [2025-10-15T21:22:29.347280] [INFO ] [MAIN ] SBH: Loaded 49865 existing records. [2025-10-15T21:22:29.536377] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:22:29.536662] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-15T21:22:29.536907] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-15T21:22:29.537292] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-15T21:22:29.537348] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-15T21:22:29.714812] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T21:22:29.738735] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-15T21:22:29.932759] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:30.316141] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T21:22:30.513983] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-15T21:22:31.313995] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-15T21:22:31.751091] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T21:22:32.113989] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-15T21:22:32.172972] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T21:22:32.914004] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-15T21:22:33.539170] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T21:22:33.713974] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-15T21:22:34.519337] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-15T21:22:34.542533] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T21:22:35.034604] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T21:22:35.045787] [INFO ] [REMOTE ] SAY: Full fetch complete (1360 records). [2025-10-15T21:22:35.052057] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-15T21:22:35.117405] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T21:22:35.240639] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-15T21:22:35.240977] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:22:35.241044] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:22:35.241111] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-15T21:22:35.241171] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-15T21:22:35.241209] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-15T21:22:35.241255] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-15T21:22:35.241309] [INFO ] [MAIN ] Update Progress: 1868/2369 symbols completed. SAY took 35.7s. Estimated remaining: 1h 10m 24s. Rate: 7.1 symbols/min [2025-10-15T21:22:35.319095] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-15T21:22:35.415891] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:22:35.427993] [DEBUG] [LOCAL ] SBI: Loaded 7464 existing records from primary storage. [2025-10-15T21:22:35.428233] [INFO ] [MAIN ] SBI: Loaded 7464 existing records. [2025-10-15T21:22:35.608230] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:22:35.608451] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-15T21:22:35.608498] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-15T21:22:35.608727] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-15T21:22:35.608807] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-15T21:22:35.969808] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:36.113993] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-15T21:22:36.640591] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T21:22:36.835423] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T21:22:36.913973] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-15T21:22:37.714010] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-15T21:22:38.517459] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-15T21:22:38.524145] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T21:22:38.562033] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T21:22:39.313999] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-15T21:22:39.913952] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T21:22:39.965326] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T21:22:40.113994] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-15T21:22:40.914036] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-15T21:22:41.416120] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T21:22:41.714069] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-15T21:22:42.245320] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:22:42.493495] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T21:22:42.513989] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-15T21:22:43.314046] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-15T21:22:43.713209] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T21:22:43.732857] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T21:22:44.114058] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-15T21:22:44.876486] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T21:22:44.914002] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-15T21:22:45.244064] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T21:22:45.714053] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-15T21:22:46.513992] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-15T21:22:46.889456] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T21:22:46.895214] [INFO ] [REMOTE ] SB: Full fetch complete (49726 records). [2025-10-15T21:22:46.895381] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-15T21:22:47.213287] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T21:22:47.312552] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-15T21:22:47.312639] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-15T21:22:47.313709] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-15T21:22:47.313774] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-15T21:22:47.313968] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-15T21:22:47.315688] [DEBUG] [LOCAL ] SB: Trimmed 49726 records to 32932 (keeping 200 days of data) [2025-10-15T21:22:47.510640] [DEBUG] [LOCAL ] SB: Primary data saved (32932 records). [2025-10-15T21:22:47.510813] [INFO ] [MAIN ] SB: Full history saved. [2025-10-15T21:22:47.510897] [INFO ] [MAIN ] Update Progress: 1869/2369 symbols completed. SB took 31.6s. Estimated remaining: 1h 10m 17s. Rate: 7.1 symbols/min [2025-10-15T21:22:47.685078] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:22:47.694757] [DEBUG] [LOCAL ] SBR: Loaded 7790 existing records from primary storage. [2025-10-15T21:22:47.694966] [INFO ] [MAIN ] SBR: Loaded 7790 existing records. [2025-10-15T21:22:47.876145] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:22:47.876377] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-15T21:22:47.876425] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-15T21:22:47.876566] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-15T21:22:47.876605] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-15T21:22:48.119087] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-15T21:22:48.229752] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:22:48.896259] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T21:22:48.913976] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-15T21:22:48.999129] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T21:22:49.604910] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T21:22:49.714004] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-15T21:22:50.492711] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T21:22:50.513986] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-15T21:22:50.860117] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-15T21:22:51.313995] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-15T21:22:52.113999] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-15T21:22:52.914057] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-15T21:22:53.714033] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-15T21:23:06.217942] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (13.30 seconds). [2025-10-15T21:23:06.222320] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (14.11 seconds). [2025-10-15T21:23:06.225633] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-15T21:23:06.240457] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-15T21:23:07.626283] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T21:23:07.629333] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-15T21:23:07.789408] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T21:23:07.799726] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-15T21:23:07.980591] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (16.67 seconds). [2025-10-15T21:23:07.983219] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-15T21:23:08.067079] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T21:23:08.068758] [INFO ] [REMOTE ] SBI: Full fetch complete (10495 records). [2025-10-15T21:23:08.068866] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-15T21:23:08.408211] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (14.69 seconds). [2025-10-15T21:23:08.449376] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-15T21:23:08.483838] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-15T21:23:08.483928] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-15T21:23:08.484215] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-15T21:23:08.484255] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-15T21:23:08.484725] [DEBUG] [LOCAL ] SBI: Trimmed 10495 records to 7530 (keeping 200 days of data) [2025-10-15T21:23:08.532249] [DEBUG] [LOCAL ] SBI: Primary data saved (7530 records). [2025-10-15T21:23:08.532373] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-15T21:23:08.532455] [INFO ] [MAIN ] Update Progress: 1870/2369 symbols completed. SBI took 33.3s. Estimated remaining: 1h 10m 12s. Rate: 7.1 symbols/min [2025-10-15T21:23:08.703790] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:08.740553] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T21:23:08.743330] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-15T21:23:08.766503] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-15T21:23:08.767479] [INFO ] [REMOTE ] SAZ: Full fetch complete (1851 records). [2025-10-15T21:23:08.768450] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-15T21:23:08.768347] [DEBUG] [LOCAL ] SBS: Loaded 49325 existing records from primary storage. [2025-10-15T21:23:08.817442] [INFO ] [MAIN ] SBS: Loaded 49325 existing records. [2025-10-15T21:23:09.156109] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T21:23:09.151741] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:23:09.156430] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:23:09.156727] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-15T21:23:09.156673] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:23:09.157048] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-15T21:23:09.157136] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-15T21:23:09.157276] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-15T21:23:09.157352] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-15T21:23:09.157467] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-15T21:23:09.157547] [INFO ] [MAIN ] Update Progress: 1871/2369 symbols completed. SAZ took 55.4s. Estimated remaining: 1h 10m 1s. Rate: 7.1 symbols/min [2025-10-15T21:23:09.170794] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-15T21:23:09.194018] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-15T21:23:09.566703] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:09.645768] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T21:23:09.649152] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-15T21:23:09.744740] [DEBUG] [LOCAL ] SBSI: Loaded 14876 existing records from primary storage. [2025-10-15T21:23:09.775755] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T21:23:09.779943] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:09.776081] [INFO ] [MAIN ] SBSI: Loaded 14876 existing records. [2025-10-15T21:23:09.832750] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-15T21:23:09.865630] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-15T21:23:09.973079] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:23:09.973311] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-15T21:23:09.973359] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-15T21:23:09.973545] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-15T21:23:09.973599] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-15T21:23:10.331768] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:10.332098] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-15T21:23:10.488524] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T21:23:10.490786] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-15T21:23:11.257245] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T21:23:11.261233] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-15T21:23:11.279728] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T21:23:11.282637] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-15T21:23:11.484065] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T21:23:11.493606] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-15T21:23:11.630477] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T21:23:11.641685] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-15T21:23:11.730091] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T21:23:11.733451] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-15T21:23:11.898537] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T21:23:11.902331] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-15T21:23:12.168505] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T21:23:12.170513] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-15T21:23:12.685753] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T21:23:12.695115] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-15T21:23:12.796317] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T21:23:12.799751] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-15T21:23:12.925401] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T21:23:12.929406] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-15T21:23:13.187610] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:23:13.198921] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-15T21:23:13.369847] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T21:23:13.377077] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-15T21:23:13.455053] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T21:23:13.714079] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-15T21:23:13.843401] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T21:23:14.320132] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T21:23:14.323045] [INFO ] [REMOTE ] SBR: Full fetch complete (11313 records). [2025-10-15T21:23:14.323124] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-15T21:23:14.489474] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T21:23:14.516302] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-15T21:23:14.787137] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-15T21:23:14.787322] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-15T21:23:14.793520] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-15T21:23:14.803003] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-15T21:23:14.804169] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T21:23:14.810546] [DEBUG] [LOCAL ] SBR: Trimmed 11313 records to 7811 (keeping 200 days of data) [2025-10-15T21:23:14.810970] [INFO ] [REMOTE ] SBH: Full fetch complete (73085 records). [2025-10-15T21:23:14.811255] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-15T21:23:15.166818] [DEBUG] [LOCAL ] SBR: Primary data saved (7811 records). [2025-10-15T21:23:15.187625] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-15T21:23:15.188097] [INFO ] [MAIN ] Update Progress: 1872/2369 symbols completed. SBR took 27.7s. Estimated remaining: 1h 9m 52s. Rate: 7.1 symbols/min [2025-10-15T21:23:15.322882] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-15T21:23:15.398987] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-15T21:23:15.399669] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-15T21:23:15.427357] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-15T21:23:15.427452] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-15T21:23:15.475711] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:15.475899] [DEBUG] [LOCAL ] SBH: Trimmed 73085 records to 49860 (keeping 200 days of data) [2025-10-15T21:23:15.683412] [DEBUG] [LOCAL ] SBSW: Loaded 53165 existing records from primary storage. [2025-10-15T21:23:15.710613] [INFO ] [MAIN ] SBSW: Loaded 53165 existing records. [2025-10-15T21:23:15.916278] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:23:15.917702] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-15T21:23:15.918738] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-15T21:23:15.919889] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-15T21:23:15.920046] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-15T21:23:16.350930] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T21:23:16.445437] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-15T21:23:16.453953] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:16.457032] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T21:23:16.465565] [DEBUG] [LOCAL ] SBH: Primary data saved (49860 records). [2025-10-15T21:23:16.465721] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-15T21:23:16.466061] [INFO ] [MAIN ] Update Progress: 1873/2369 symbols completed. SBH took 47.3s. Estimated remaining: 1h 9m 42s. Rate: 7.1 symbols/min [2025-10-15T21:23:16.636633] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:16.636814] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-15T21:23:16.636853] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-15T21:23:16.636961] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-15T21:23:16.637001] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-15T21:23:16.637041] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-15T21:23:16.637072] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-15T21:23:16.914892] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-15T21:23:17.001063] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:17.714005] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-15T21:23:18.273182] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T21:23:18.513991] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-15T21:23:18.607607] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T21:23:18.871725] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T21:23:19.313996] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-15T21:23:19.541156] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-10-15T21:23:20.119087] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-15T21:23:20.137079] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:23:20.381220] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-15T21:23:20.913997] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-15T21:23:21.714007] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-15T21:23:22.483290] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T21:23:22.513949] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-15T21:23:22.696214] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T21:23:23.314108] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-15T21:23:24.103190] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T21:23:24.113941] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-15T21:23:24.205407] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T21:23:24.914009] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-15T21:23:25.041587] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T21:23:25.714018] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-15T21:23:26.024762] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T21:23:26.514058] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-15T21:23:26.786947] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T21:23:27.314061] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-15T21:23:27.411634] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T21:23:27.414419] [INFO ] [REMOTE ] SBSI: Full fetch complete (21183 records). [2025-10-15T21:23:27.414533] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-15T21:23:27.527663] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-15T21:23:27.819010] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-15T21:23:27.819083] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-15T21:23:27.819609] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-15T21:23:27.819673] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-15T21:23:27.820250] [DEBUG] [LOCAL ] SBSI: Trimmed 21183 records to 14905 (keeping 200 days of data) [2025-10-15T21:23:27.916196] [DEBUG] [LOCAL ] SBSI: Primary data saved (14905 records). [2025-10-15T21:23:27.916347] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-15T21:23:27.916433] [INFO ] [MAIN ] Update Progress: 1874/2369 symbols completed. SBSI took 18.8s. Estimated remaining: 1h 9m 34s. Rate: 7.1 symbols/min [2025-10-15T21:23:28.087086] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:28.113992] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-15T21:23:28.136186] [DEBUG] [LOCAL ] SCCO: Loaded 49600 existing records from primary storage. [2025-10-15T21:23:28.136501] [INFO ] [MAIN ] SCCO: Loaded 49600 existing records. [2025-10-15T21:23:28.317707] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:23:28.317991] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-15T21:23:28.318060] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-15T21:23:28.318596] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-15T21:23:28.318718] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-15T21:23:28.686356] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:28.914000] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-15T21:23:29.713982] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-15T21:23:29.959080] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-15T21:23:30.020936] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T21:23:30.189296] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T21:23:30.513998] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-15T21:23:31.314005] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-15T21:23:32.114004] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-15T21:23:32.471698] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T21:23:32.480347] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T21:23:32.923340] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-15T21:23:32.926552] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T21:23:33.711316] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T21:23:33.713969] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-15T21:23:34.514068] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-15T21:23:35.313983] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-15T21:23:35.657074] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T21:23:35.779929] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T21:23:35.866313] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T21:23:36.114003] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-15T21:23:36.913964] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-15T21:23:37.714105] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-15T21:23:37.746283] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T21:23:38.513975] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-15T21:23:38.906195] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T21:23:39.314031] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-15T21:23:39.374475] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T21:23:39.773810] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T21:23:40.114021] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-15T21:23:40.379364] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T21:23:40.914045] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-15T21:23:41.238546] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T21:23:41.244520] [INFO ] [REMOTE ] SBS: Full fetch complete (70325 records). [2025-10-15T21:23:41.244732] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-15T21:23:41.647094] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-15T21:23:41.647190] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-15T21:23:41.648286] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-15T21:23:41.648357] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-15T21:23:41.649869] [DEBUG] [LOCAL ] SBS: Trimmed 70325 records to 49319 (keeping 200 days of data) [2025-10-15T21:23:41.716707] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-15T21:23:41.963786] [DEBUG] [LOCAL ] SBS: Primary data saved (49319 records). [2025-10-15T21:23:41.963953] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-15T21:23:41.964068] [INFO ] [MAIN ] Update Progress: 1875/2369 symbols completed. SBS took 33.4s. Estimated remaining: 1h 9m 27s. Rate: 7.1 symbols/min [2025-10-15T21:23:42.130384] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:42.144123] [DEBUG] [LOCAL ] SCD: Loaded 13173 existing records from primary storage. [2025-10-15T21:23:42.144351] [INFO ] [MAIN ] SCD: Loaded 13173 existing records. [2025-10-15T21:23:42.320769] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:23:42.320982] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-15T21:23:42.321032] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-15T21:23:42.321236] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-15T21:23:42.321295] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-15T21:23:42.537755] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-15T21:23:42.690975] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:42.839774] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-15T21:23:42.939735] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T21:23:43.147248] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T21:23:43.313978] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-15T21:23:44.114105] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-15T21:23:44.914038] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-15T21:23:45.239896] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T21:23:45.240802] [INFO ] [REMOTE ] SBXD: Full fetch complete (3118 records). [2025-10-15T21:23:45.240900] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-15T21:23:45.440670] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-10-15T21:23:45.441387] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:23:45.441682] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:23:45.441788] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-15T21:23:45.442041] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-15T21:23:45.442248] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-15T21:23:45.442317] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-15T21:23:45.442419] [INFO ] [MAIN ] Update Progress: 1876/2369 symbols completed. SBXD took 29.0s. Estimated remaining: 1h 9m 18s. Rate: 7.1 symbols/min [2025-10-15T21:23:45.663373] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-15T21:23:45.667004] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:23:45.714033] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-15T21:23:45.743708] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-15T21:23:45.744256] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-15T21:23:45.935583] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:23:45.936094] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-15T21:23:45.936182] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-15T21:23:45.936896] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-15T21:23:45.936956] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-15T21:23:46.241396] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-15T21:23:46.385993] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:23:46.514052] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-15T21:23:47.314080] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-15T21:23:47.647559] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T21:23:48.014981] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T21:23:48.114012] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-15T21:23:48.261744] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T21:23:48.914061] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-15T21:23:49.714035] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-15T21:23:50.170492] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T21:23:50.514031] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-15T21:23:50.749029] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T21:23:51.309809] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T21:23:51.313945] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-15T21:23:51.578021] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T21:23:52.014072] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T21:23:52.113998] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-15T21:23:52.840455] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T21:23:52.914063] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-15T21:23:53.520425] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T21:23:53.714022] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-15T21:23:54.423446] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T21:23:54.514006] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-15T21:23:55.314001] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-15T21:23:56.114078] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-15T21:23:56.406455] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-15T21:23:56.914031] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-15T21:23:57.025763] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T21:23:57.714087] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-15T21:23:58.069092] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T21:23:58.078382] [INFO ] [REMOTE ] SBSW: Full fetch complete (76722 records). [2025-10-15T21:23:58.078554] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-15T21:23:58.518535] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-15T21:23:58.694212] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T21:23:58.700959] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-15T21:23:58.701111] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-15T21:23:58.703049] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-15T21:23:58.703189] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-15T21:23:58.721467] [DEBUG] [LOCAL ] SBSW: Trimmed 76722 records to 53172 (keeping 200 days of data) [2025-10-15T21:23:58.752086] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T21:23:59.096689] [DEBUG] [LOCAL ] SBSW: Primary data saved (53172 records). [2025-10-15T21:23:59.096842] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-15T21:23:59.096923] [INFO ] [MAIN ] Update Progress: 1877/2369 symbols completed. SBSW took 43.9s. Estimated remaining: 1h 9m 11s. Rate: 7.1 symbols/min [2025-10-15T21:23:59.314043] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-15T21:24:00.114020] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-15T21:24:00.266121] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T21:24:00.404755] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T21:24:00.914007] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-15T21:24:01.714114] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-15T21:24:02.079235] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T21:24:02.361196] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-15T21:24:02.514016] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-15T21:24:03.314091] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-15T21:24:03.655539] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-15T21:24:03.662398] [INFO ] [REMOTE ] SCCO: Full fetch complete (71700 records). [2025-10-15T21:24:03.662555] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-15T21:24:04.047442] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-15T21:24:04.047634] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-15T21:24:04.048853] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-15T21:24:04.048942] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-15T21:24:04.050401] [DEBUG] [LOCAL ] SCCO: Trimmed 71700 records to 49593 (keeping 200 days of data) [2025-10-15T21:24:04.279619] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T21:24:04.307749] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-15T21:24:04.406469] [DEBUG] [LOCAL ] SCCO: Primary data saved (49593 records). [2025-10-15T21:24:04.406812] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-15T21:24:04.406952] [INFO ] [MAIN ] Update Progress: 1878/2369 symbols completed. SCCO took 36.5s. Estimated remaining: 1h 9m 1s. Rate: 7.1 symbols/min [2025-10-15T21:24:04.459768] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T21:24:04.914082] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-15T21:24:05.096937] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T21:24:05.098946] [INFO ] [REMOTE ] SCD: Full fetch complete (16776 records). [2025-10-15T21:24:05.099015] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-15T21:24:05.451778] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-15T21:24:05.451853] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-15T21:24:05.452188] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-15T21:24:05.452227] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-15T21:24:05.452757] [DEBUG] [LOCAL ] SCD: Trimmed 16776 records to 13297 (keeping 200 days of data) [2025-10-15T21:24:05.532197] [DEBUG] [LOCAL ] SCD: Primary data saved (13297 records). [2025-10-15T21:24:05.532331] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-15T21:24:05.532421] [INFO ] [MAIN ] Update Progress: 1879/2369 symbols completed. SCD took 23.6s. Estimated remaining: 1h 8m 51s. Rate: 7.1 symbols/min [2025-10-15T21:24:06.840172] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T21:24:06.851801] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-15T21:24:08.731769] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T21:24:08.742951] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-15T21:24:10.867377] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-15T21:24:10.879173] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-15T21:24:12.869213] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T21:24:12.880479] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-15T21:24:14.775726] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T21:24:14.790954] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-15T21:24:16.597939] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T21:24:16.604335] [INFO ] [REMOTE ] SCHW: Full fetch complete (77864 records). [2025-10-15T21:24:16.604466] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-15T21:24:16.996006] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-15T21:24:16.996089] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-15T21:24:16.997209] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-15T21:24:16.997271] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-15T21:24:16.998764] [DEBUG] [LOCAL ] SCHW: Trimmed 77864 records to 53685 (keeping 200 days of data) [2025-10-15T21:24:17.324745] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-15T21:24:17.324891] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-15T21:24:17.325262] [INFO ] [MAIN ] Update Progress: 1880/2369 symbols completed. SCHW took 31.9s. Estimated remaining: 1h 8m 43s. Rate: 7.1 symbols/min [2025-10-15T21:24:17.857892] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:17.921631] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:17.990070] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:18.019984] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:18.047321] [DEBUG] [LOCAL ] SCL: Loaded 14853 existing records from primary storage. [2025-10-15T21:24:18.047739] [INFO ] [MAIN ] SCL: Loaded 14853 existing records. [2025-10-15T21:24:18.200908] [DEBUG] [LOCAL ] SCS: Loaded 43528 existing records from primary storage. [2025-10-15T21:24:18.188075] [DEBUG] [LOCAL ] SCM: Loaded 20160 existing records from primary storage. [2025-10-15T21:24:18.207499] [INFO ] [MAIN ] SCM: Loaded 20160 existing records. [2025-10-15T21:24:18.207379] [DEBUG] [LOCAL ] SCI: Loaded 46575 existing records from primary storage. [2025-10-15T21:24:18.223164] [INFO ] [MAIN ] SCS: Loaded 43528 existing records. [2025-10-15T21:24:18.239320] [INFO ] [MAIN ] SCI: Loaded 46575 existing records. [2025-10-15T21:24:18.567773] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:18.670677] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-15T21:24:18.719945] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-15T21:24:18.722827] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:18.747509] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:18.747690] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-15T21:24:18.786847] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-15T21:24:18.752972] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-15T21:24:18.787071] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-15T21:24:18.758306] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-15T21:24:18.850847] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:18.851169] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-15T21:24:18.851067] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-15T21:24:18.851100] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-15T21:24:18.877987] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-15T21:24:18.903818] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-15T21:24:18.893424] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-15T21:24:18.953622] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-15T21:24:18.953722] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-15T21:24:19.037368] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-15T21:24:19.762416] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:19.967004] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-15T21:24:20.189196] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:20.246858] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:20.252260] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-15T21:24:20.292928] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-15T21:24:20.320187] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:20.320770] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-15T21:24:20.876876] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T21:24:20.879996] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-15T21:24:21.129256] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T21:24:21.133762] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-15T21:24:21.777173] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T21:24:21.786140] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-15T21:24:21.833902] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:24:21.842816] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-15T21:24:21.870349] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T21:24:21.874987] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-15T21:24:21.942244] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T21:24:21.946237] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-15T21:24:22.787394] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T21:24:22.790639] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-15T21:24:22.841495] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T21:24:22.845361] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-15T21:24:23.203197] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T21:24:23.212879] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-15T21:24:23.395252] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T21:24:23.404800] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-15T21:24:23.818698] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T21:24:23.822480] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-15T21:24:23.975963] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T21:24:23.982581] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-15T21:24:24.180625] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T21:24:24.189798] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-15T21:24:24.875014] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T21:24:24.879504] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-15T21:24:25.029760] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T21:24:25.040518] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-15T21:24:25.080040] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T21:24:25.085613] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-15T21:24:25.743228] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T21:24:25.752804] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-15T21:24:25.838221] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T21:24:25.916465] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T21:24:26.331460] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T21:24:26.514005] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-15T21:24:27.286584] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T21:24:27.314002] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-15T21:24:27.345054] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T21:24:28.113980] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-15T21:24:28.205406] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T21:24:28.913991] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-15T21:24:29.713999] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-15T21:24:29.849290] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T21:24:29.897181] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T21:24:30.514050] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-15T21:24:31.113280] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T21:24:31.313981] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-15T21:24:31.354479] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T21:24:32.114056] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-15T21:24:32.742822] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T21:24:32.914023] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-15T21:24:33.293370] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T21:24:33.714027] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-15T21:24:34.513965] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-15T21:24:34.557614] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T21:24:35.253885] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T21:24:35.314030] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-15T21:24:35.512925] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T21:24:36.114054] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-15T21:24:36.913973] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-15T21:24:37.014956] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T21:24:37.078810] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T21:24:37.714063] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-15T21:24:37.961510] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T21:24:38.514005] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-15T21:24:39.313987] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-15T21:24:39.406358] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T21:24:39.456384] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T21:24:39.458729] [INFO ] [REMOTE ] SCL: Full fetch complete (21503 records). [2025-10-15T21:24:39.458820] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-15T21:24:39.816145] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-15T21:24:39.816230] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-15T21:24:39.816760] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-15T21:24:39.816860] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-15T21:24:39.817549] [DEBUG] [LOCAL ] SCL: Trimmed 21503 records to 14940 (keeping 200 days of data) [2025-10-15T21:24:39.911435] [DEBUG] [LOCAL ] SCL: Primary data saved (14940 records). [2025-10-15T21:24:39.911572] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-15T21:24:39.911682] [INFO ] [MAIN ] Update Progress: 1881/2369 symbols completed. SCL took 22.6s. Estimated remaining: 1h 8m 39s. Rate: 7.1 symbols/min [2025-10-15T21:24:40.079397] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:40.108698] [DEBUG] [LOCAL ] SD: Loaded 28747 existing records from primary storage. [2025-10-15T21:24:40.108965] [INFO ] [MAIN ] SD: Loaded 28747 existing records. [2025-10-15T21:24:40.120414] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-15T21:24:40.292888] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:40.293303] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-15T21:24:40.293386] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-15T21:24:40.293775] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-15T21:24:40.293833] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-15T21:24:40.563254] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T21:24:40.600121] [INFO ] [REMOTE ] SCM: Full fetch complete (29061 records). [2025-10-15T21:24:40.600334] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-15T21:24:40.796678] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:40.923846] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-15T21:24:41.058511] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-15T21:24:41.058611] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-15T21:24:41.059225] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-15T21:24:41.059283] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-15T21:24:41.060511] [DEBUG] [LOCAL ] SCM: Trimmed 29061 records to 20187 (keeping 200 days of data) [2025-10-15T21:24:41.182762] [DEBUG] [LOCAL ] SCM: Primary data saved (20187 records). [2025-10-15T21:24:41.182883] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-15T21:24:41.182958] [INFO ] [MAIN ] Update Progress: 1882/2369 symbols completed. SCM took 23.8s. Estimated remaining: 1h 8m 28s. Rate: 7.1 symbols/min [2025-10-15T21:24:41.352235] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:41.363576] [DEBUG] [LOCAL ] SDHC: Loaded 10325 existing records from primary storage. [2025-10-15T21:24:41.363851] [INFO ] [MAIN ] SDHC: Loaded 10325 existing records. [2025-10-15T21:24:41.542850] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:41.543165] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-15T21:24:41.543223] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-15T21:24:41.543380] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-15T21:24:41.543434] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-15T21:24:41.724245] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-15T21:24:41.753265] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T21:24:41.852103] [INFO ] [REMOTE ] SCS: Full fetch complete (61125 records). [2025-10-15T21:24:41.857979] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-15T21:24:42.045459] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:42.318791] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-15T21:24:42.318897] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-15T21:24:42.319884] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-15T21:24:42.319966] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-15T21:24:42.338060] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T21:24:42.344314] [DEBUG] [LOCAL ] SCS: Trimmed 61125 records to 43524 (keeping 200 days of data) [2025-10-15T21:24:42.519903] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-15T21:24:42.612820] [DEBUG] [LOCAL ] SCS: Primary data saved (43524 records). [2025-10-15T21:24:42.612968] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-15T21:24:42.613051] [INFO ] [MAIN ] Update Progress: 1883/2369 symbols completed. SCS took 25.3s. Estimated remaining: 1h 8m 18s. Rate: 7.1 symbols/min [2025-10-15T21:24:42.784399] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:42.796618] [DEBUG] [LOCAL ] SDHY: Loaded 11019 existing records from primary storage. [2025-10-15T21:24:42.796867] [INFO ] [MAIN ] SDHY: Loaded 11019 existing records. [2025-10-15T21:24:42.980950] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:42.981239] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-15T21:24:42.981308] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-15T21:24:42.981514] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-15T21:24:42.981577] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-15T21:24:43.321339] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-15T21:24:43.352662] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:43.392816] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T21:24:43.417952] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T21:24:44.113971] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-15T21:24:44.288829] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T21:24:44.914034] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-15T21:24:45.713993] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-15T21:24:45.770195] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T21:24:45.818915] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T21:24:46.513967] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-15T21:24:46.651732] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T21:24:47.314001] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-15T21:24:47.351956] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T21:24:48.113997] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-15T21:24:48.415193] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T21:24:48.914077] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-15T21:24:49.719215] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-15T21:24:49.744837] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T21:24:49.838218] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T21:24:50.514007] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-15T21:24:50.571447] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T21:24:51.314016] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-15T21:24:51.793761] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T21:24:52.074739] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T21:24:52.114016] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-15T21:24:52.914026] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-15T21:24:53.592966] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T21:24:53.659134] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:24:53.713960] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-15T21:24:54.514031] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-15T21:24:55.078957] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T21:24:55.084565] [INFO ] [REMOTE ] SCI: Full fetch complete (67652 records). [2025-10-15T21:24:55.084748] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-15T21:24:55.209039] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T21:24:55.321721] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-15T21:24:55.485091] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-15T21:24:55.485167] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-15T21:24:55.486186] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-15T21:24:55.486248] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-15T21:24:55.488373] [DEBUG] [LOCAL ] SCI: Trimmed 67652 records to 46535 (keeping 200 days of data) [2025-10-15T21:24:55.772500] [DEBUG] [LOCAL ] SCI: Primary data saved (46535 records). [2025-10-15T21:24:55.772638] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-15T21:24:55.772759] [INFO ] [MAIN ] Update Progress: 1884/2369 symbols completed. SCI took 38.4s. Estimated remaining: 1h 8m 11s. Rate: 7.1 symbols/min [2025-10-15T21:24:55.936407] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:24:55.975207] [DEBUG] [LOCAL ] SDRL: Loaded 41556 existing records from primary storage. [2025-10-15T21:24:55.975508] [INFO ] [MAIN ] SDRL: Loaded 41556 existing records. [2025-10-15T21:24:56.119209] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-15T21:24:56.154817] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:24:56.155242] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-15T21:24:56.155297] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-15T21:24:56.155760] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-15T21:24:56.155816] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-15T21:24:56.542431] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:24:56.700059] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T21:24:56.914003] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-15T21:24:57.140566] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T21:24:57.714016] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-15T21:24:58.524107] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-15T21:24:58.529954] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T21:24:58.979532] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T21:24:58.993581] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T21:24:59.314009] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-15T21:25:00.062454] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T21:25:00.114008] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-15T21:25:00.914004] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-15T21:25:01.686804] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T21:25:01.719172] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-15T21:25:01.736263] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T21:25:02.382212] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T21:25:02.514004] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-15T21:25:03.314048] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-15T21:25:03.404548] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T21:25:03.872786] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T21:25:04.114021] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-15T21:25:04.914019] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-15T21:25:05.660979] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:25:05.662944] [INFO ] [REMOTE ] SDHY: Full fetch complete (15720 records). [2025-10-15T21:25:05.663010] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-15T21:25:05.723296] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-15T21:25:05.938538] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T21:25:06.069992] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-15T21:25:06.070086] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-15T21:25:06.070597] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-15T21:25:06.070695] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-15T21:25:06.071503] [DEBUG] [LOCAL ] SDHY: Trimmed 15720 records to 11036 (keeping 200 days of data) [2025-10-15T21:25:06.149564] [DEBUG] [LOCAL ] SDHY: Primary data saved (11036 records). [2025-10-15T21:25:06.149745] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-15T21:25:06.150030] [INFO ] [MAIN ] Update Progress: 1885/2369 symbols completed. SDHY took 23.5s. Estimated remaining: 1h 8m 3s. Rate: 7.1 symbols/min [2025-10-15T21:25:06.372415] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:25:06.456426] [DEBUG] [LOCAL ] SE: Loaded 53305 existing records from primary storage. [2025-10-15T21:25:06.457109] [INFO ] [MAIN ] SE: Loaded 53305 existing records. [2025-10-15T21:25:06.519536] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-15T21:25:06.727943] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:25:06.728295] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-15T21:25:06.728363] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-15T21:25:06.729025] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-15T21:25:06.729102] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-15T21:25:07.260088] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T21:25:07.316315] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-15T21:25:07.328582] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:25:07.485226] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T21:25:08.114027] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-15T21:25:08.883183] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T21:25:08.914576] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-15T21:25:08.916714] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T21:25:09.714017] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-15T21:25:10.454699] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T21:25:10.514034] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-15T21:25:10.530566] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T21:25:11.314050] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-15T21:25:12.007187] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:25:12.114028] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-15T21:25:12.914016] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-15T21:25:12.940297] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T21:25:13.107313] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T21:25:13.713966] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-15T21:25:14.431561] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T21:25:14.467396] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:25:14.469593] [INFO ] [REMOTE ] SDHC: Full fetch complete (17084 records). [2025-10-15T21:25:14.469728] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-15T21:25:14.519179] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-15T21:25:14.854015] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-15T21:25:14.854114] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-15T21:25:14.854528] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-15T21:25:14.854568] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-15T21:25:14.855112] [DEBUG] [LOCAL ] SDHC: Trimmed 17084 records to 10340 (keeping 200 days of data) [2025-10-15T21:25:14.918374] [DEBUG] [LOCAL ] SDHC: Primary data saved (10340 records). [2025-10-15T21:25:14.918507] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-15T21:25:14.918588] [INFO ] [MAIN ] Update Progress: 1886/2369 symbols completed. SDHC took 33.7s. Estimated remaining: 1h 7m 55s. Rate: 7.1 symbols/min [2025-10-15T21:25:15.093595] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:25:15.145745] [DEBUG] [LOCAL ] SEE: Loaded 48203 existing records from primary storage. [2025-10-15T21:25:15.146105] [INFO ] [MAIN ] SEE: Loaded 48203 existing records. [2025-10-15T21:25:15.324972] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:25:15.319410] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-15T21:25:15.325584] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-15T21:25:15.325704] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-15T21:25:15.327026] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-15T21:25:15.327092] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-15T21:25:15.697594] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:25:15.806350] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T21:25:16.114042] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-15T21:25:16.913981] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-15T21:25:17.294973] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-15T21:25:17.348826] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T21:25:17.714054] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-15T21:25:18.422824] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T21:25:18.513961] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-15T21:25:18.846136] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T21:25:19.314050] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-15T21:25:19.999854] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T21:25:20.114000] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-15T21:25:20.890822] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T21:25:20.913976] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-15T21:25:21.190458] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T21:25:21.194224] [INFO ] [REMOTE ] SD: Full fetch complete (41019 records). [2025-10-15T21:25:21.194349] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-15T21:25:21.569638] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-15T21:25:21.569749] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-15T21:25:21.570708] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-15T21:25:21.570773] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-15T21:25:21.571740] [DEBUG] [LOCAL ] SD: Trimmed 41019 records to 28737 (keeping 200 days of data) [2025-10-15T21:25:21.724789] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-15T21:25:21.743913] [DEBUG] [LOCAL ] SD: Primary data saved (28737 records). [2025-10-15T21:25:21.744025] [INFO ] [MAIN ] SD: Full history saved. [2025-10-15T21:25:21.744102] [INFO ] [MAIN ] Update Progress: 1887/2369 symbols completed. SD took 41.8s. Estimated remaining: 1h 7m 46s. Rate: 7.1 symbols/min [2025-10-15T21:25:21.912201] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:25:21.925979] [DEBUG] [LOCAL ] SEG: Loaded 13042 existing records from primary storage. [2025-10-15T21:25:21.926192] [INFO ] [MAIN ] SEG: Loaded 13042 existing records. [2025-10-15T21:25:22.107591] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:25:22.107810] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-15T21:25:22.107865] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-15T21:25:22.108045] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-15T21:25:22.108084] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-15T21:25:22.483824] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:25:22.510352] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T21:25:22.519258] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-15T21:25:23.283502] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T21:25:23.313986] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-15T21:25:23.647207] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T21:25:24.114017] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-15T21:25:24.177095] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T21:25:24.914036] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-15T21:25:25.714044] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-15T21:25:26.213817] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-15T21:25:26.292706] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T21:25:26.484384] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T21:25:26.513965] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-15T21:25:27.313998] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-15T21:25:28.088435] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T21:25:28.113968] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-15T21:25:28.299040] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T21:25:28.914006] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-15T21:25:29.713981] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-15T21:25:29.788157] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:25:30.076817] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T21:25:30.083172] [INFO ] [REMOTE ] SDRL: Full fetch complete (61704 records). [2025-10-15T21:25:30.083350] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-15T21:25:30.473882] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-15T21:25:30.473959] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-15T21:25:30.474929] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-15T21:25:30.475011] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-15T21:25:30.476290] [DEBUG] [LOCAL ] SDRL: Trimmed 61704 records to 41576 (keeping 200 days of data) [2025-10-15T21:25:30.525353] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-15T21:25:30.721215] [DEBUG] [LOCAL ] SDRL: Primary data saved (41576 records). [2025-10-15T21:25:30.721341] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-15T21:25:30.721418] [INFO ] [MAIN ] Update Progress: 1888/2369 symbols completed. SDRL took 34.9s. Estimated remaining: 1h 7m 37s. Rate: 7.1 symbols/min [2025-10-15T21:25:30.891575] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:25:30.938292] [DEBUG] [LOCAL ] SEI: Loaded 49923 existing records from primary storage. [2025-10-15T21:25:30.938594] [INFO ] [MAIN ] SEI: Loaded 49923 existing records. [2025-10-15T21:25:31.112007] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:25:31.112233] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-15T21:25:31.112281] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-15T21:25:31.112857] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-15T21:25:31.112915] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-15T21:25:31.319176] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-15T21:25:31.467524] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:25:31.667742] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T21:25:31.843045] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T21:25:32.113988] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-15T21:25:32.914012] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-15T21:25:33.075515] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T21:25:33.713992] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-15T21:25:33.804512] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T21:25:34.011557] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T21:25:34.514058] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-15T21:25:35.256889] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T21:25:35.313962] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-15T21:25:35.415745] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T21:25:36.114036] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-15T21:25:36.837041] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T21:25:36.914030] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-15T21:25:37.714048] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-15T21:25:38.514090] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-15T21:25:39.138447] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (3.02 seconds). [2025-10-15T21:25:39.258954] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T21:25:39.293221] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T21:25:39.313956] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-15T21:25:39.750849] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:25:40.113999] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-15T21:25:40.232107] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T21:25:40.914049] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-15T21:25:41.649033] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T21:25:41.714032] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-15T21:25:42.465701] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T21:25:42.513970] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-15T21:25:42.800960] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T21:25:43.314074] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-15T21:25:44.024784] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:25:44.114003] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-15T21:25:44.307544] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T21:25:44.315724] [INFO ] [REMOTE ] SEE: Full fetch complete (70005 records). [2025-10-15T21:25:44.315909] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-15T21:25:44.706787] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-15T21:25:44.706869] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-15T21:25:44.707922] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-15T21:25:44.707985] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-15T21:25:44.709417] [DEBUG] [LOCAL ] SEE: Trimmed 70005 records to 48189 (keeping 200 days of data) [2025-10-15T21:25:44.914886] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-15T21:25:45.001858] [DEBUG] [LOCAL ] SEE: Primary data saved (48189 records). [2025-10-15T21:25:45.002004] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-15T21:25:45.002088] [INFO ] [MAIN ] Update Progress: 1889/2369 symbols completed. SEE took 30.1s. Estimated remaining: 1h 7m 31s. Rate: 7.1 symbols/min [2025-10-15T21:25:45.180863] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:25:45.224600] [DEBUG] [LOCAL ] SEM: Loaded 43155 existing records from primary storage. [2025-10-15T21:25:45.224961] [INFO ] [MAIN ] SEM: Loaded 43155 existing records. [2025-10-15T21:25:45.400189] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:25:45.400528] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-15T21:25:45.400580] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-15T21:25:45.401062] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-15T21:25:45.401122] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-15T21:25:45.721925] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-15T21:25:45.756514] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:25:45.788796] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:25:45.806526] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T21:25:46.514017] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-15T21:25:47.314067] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-15T21:25:47.959769] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T21:25:47.987084] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:25:47.989005] [INFO ] [REMOTE ] SEG: Full fetch complete (19778 records). [2025-10-15T21:25:47.989090] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-15T21:25:48.119123] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-15T21:25:48.389322] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-15T21:25:48.389495] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-15T21:25:48.390011] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-15T21:25:48.390091] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-15T21:25:48.390932] [DEBUG] [LOCAL ] SEG: Trimmed 19778 records to 12834 (keeping 200 days of data) [2025-10-15T21:25:48.487904] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T21:25:48.510884] [DEBUG] [LOCAL ] SEG: Primary data saved (12834 records). [2025-10-15T21:25:48.511040] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-15T21:25:48.511126] [INFO ] [MAIN ] Update Progress: 1890/2369 symbols completed. SEG took 26.8s. Estimated remaining: 1h 7m 21s. Rate: 7.1 symbols/min [2025-10-15T21:25:48.676860] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:25:48.716069] [DEBUG] [LOCAL ] SEMR: Loaded 41977 existing records from primary storage. [2025-10-15T21:25:48.716420] [INFO ] [MAIN ] SEMR: Loaded 41977 existing records. [2025-10-15T21:25:48.893622] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:25:48.893859] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-15T21:25:48.893906] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-15T21:25:48.894456] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-15T21:25:48.894514] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-15T21:25:48.924459] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-15T21:25:49.241204] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:25:49.714047] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-15T21:25:50.364337] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T21:25:50.513983] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-15T21:25:50.556223] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T21:25:51.014170] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T21:25:51.313985] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-15T21:25:52.114066] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-15T21:25:52.178425] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T21:25:52.747517] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T21:25:52.914047] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-15T21:25:53.586535] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T21:25:53.713997] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-15T21:25:54.372550] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T21:25:54.513989] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-15T21:25:55.314037] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-15T21:25:55.407828] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T21:25:55.946496] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T21:25:56.113999] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-15T21:25:56.913973] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-15T21:25:57.091310] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T21:25:57.714022] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-15T21:25:57.932309] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T21:25:58.124824] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T21:25:58.514086] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-15T21:25:59.314007] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-15T21:25:59.637473] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T21:25:59.644764] [INFO ] [REMOTE ] SE: Full fetch complete (77233 records). [2025-10-15T21:25:59.644998] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-15T21:26:00.070632] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-15T21:26:00.070999] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-15T21:26:00.072708] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-15T21:26:00.072791] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-15T21:26:00.075191] [DEBUG] [LOCAL ] SE: Trimmed 77233 records to 53302 (keeping 200 days of data) [2025-10-15T21:26:00.155387] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-15T21:26:00.175262] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T21:26:00.467927] [DEBUG] [LOCAL ] SE: Primary data saved (53302 records). [2025-10-15T21:26:00.468076] [INFO ] [MAIN ] SE: Full history saved. [2025-10-15T21:26:00.468818] [INFO ] [MAIN ] Update Progress: 1891/2369 symbols completed. SE took 54.3s. Estimated remaining: 1h 7m 13s. Rate: 7.1 symbols/min [2025-10-15T21:26:00.643420] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:00.695763] [DEBUG] [LOCAL ] SES: Loaded 51578 existing records from primary storage. [2025-10-15T21:26:00.696084] [INFO ] [MAIN ] SES: Loaded 51578 existing records. [2025-10-15T21:26:00.869830] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:00.870088] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-15T21:26:00.870137] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-15T21:26:00.870635] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-15T21:26:00.870734] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-15T21:26:00.924787] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-15T21:26:01.238817] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:01.413996] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T21:26:01.714091] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-15T21:26:01.886527] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T21:26:02.514028] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-15T21:26:02.640018] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T21:26:03.314059] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-15T21:26:03.681263] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T21:26:04.114059] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-15T21:26:04.341781] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T21:26:04.848765] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T21:26:04.913955] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-15T21:26:05.714080] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-15T21:26:06.072949] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T21:26:06.174778] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T21:26:06.514052] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-15T21:26:07.314063] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-15T21:26:07.441852] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T21:26:07.449468] [INFO ] [REMOTE ] SEI: Full fetch complete (70820 records). [2025-10-15T21:26:07.449715] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-15T21:26:07.854678] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-15T21:26:07.854781] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-15T21:26:07.855955] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-15T21:26:07.856021] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-15T21:26:07.857589] [DEBUG] [LOCAL ] SEI: Trimmed 70820 records to 49935 (keeping 200 days of data) [2025-10-15T21:26:08.115899] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-15T21:26:08.124531] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T21:26:08.209979] [DEBUG] [LOCAL ] SEI: Primary data saved (49935 records). [2025-10-15T21:26:08.210124] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-15T21:26:08.211184] [INFO ] [MAIN ] Update Progress: 1892/2369 symbols completed. SEI took 37.5s. Estimated remaining: 1h 7m 5s. Rate: 7.1 symbols/min [2025-10-15T21:26:08.376878] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:08.420716] [DEBUG] [LOCAL ] SF: Loaded 41638 existing records from primary storage. [2025-10-15T21:26:08.420996] [INFO ] [MAIN ] SF: Loaded 41638 existing records. [2025-10-15T21:26:08.602536] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:08.602804] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-15T21:26:08.602853] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-15T21:26:08.603349] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-15T21:26:08.603407] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-15T21:26:08.914612] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-15T21:26:08.989834] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:09.025760] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T21:26:09.713999] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-15T21:26:10.446209] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-15T21:26:10.520079] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-15T21:26:10.537383] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T21:26:10.924337] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T21:26:11.314005] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-15T21:26:12.114009] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-15T21:26:12.662492] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T21:26:12.913985] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-15T21:26:13.032445] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-15T21:26:13.691425] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T21:26:13.713948] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-15T21:26:14.040047] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T21:26:14.514007] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-15T21:26:15.219055] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:26:15.313997] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-15T21:26:16.114005] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-15T21:26:16.861440] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:26:16.913981] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-15T21:26:16.967864] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-15T21:26:17.713983] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-15T21:26:17.782807] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:26:17.926709] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T21:26:17.932157] [INFO ] [REMOTE ] SEM: Full fetch complete (61640 records). [2025-10-15T21:26:17.932282] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-15T21:26:18.323255] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-15T21:26:18.323348] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-15T21:26:18.324332] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-15T21:26:18.324399] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-15T21:26:18.325745] [DEBUG] [LOCAL ] SEM: Trimmed 61640 records to 43203 (keeping 200 days of data) [2025-10-15T21:26:18.534582] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-15T21:26:18.594554] [DEBUG] [LOCAL ] SEM: Primary data saved (43203 records). [2025-10-15T21:26:18.594797] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-15T21:26:18.594908] [INFO ] [MAIN ] Update Progress: 1893/2369 symbols completed. SEM took 33.6s. Estimated remaining: 1h 6m 57s. Rate: 7.1 symbols/min [2025-10-15T21:26:18.771179] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:18.779710] [DEBUG] [LOCAL ] SFB: Loaded 3900 existing records from primary storage. [2025-10-15T21:26:18.779909] [INFO ] [MAIN ] SFB: Loaded 3900 existing records. [2025-10-15T21:26:18.957500] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:18.957751] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-15T21:26:18.957804] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-15T21:26:18.957968] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-15T21:26:18.958024] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-15T21:26:19.303611] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:19.313956] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-15T21:26:20.120443] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-15T21:26:20.144764] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-15T21:26:20.165352] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T21:26:20.280018] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T21:26:20.914052] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-15T21:26:21.714060] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-15T21:26:21.789785] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T21:26:22.471146] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T21:26:22.513998] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-15T21:26:23.313979] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-15T21:26:23.876150] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T21:26:23.970118] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-15T21:26:24.007621] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T21:26:24.114004] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-15T21:26:24.914055] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-15T21:26:25.636296] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T21:26:25.713960] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-15T21:26:26.514016] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-15T21:26:26.636580] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T21:26:27.264204] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:26:27.313958] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-15T21:26:28.079024] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:26:28.114002] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-15T21:26:28.354378] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T21:26:28.363117] [INFO ] [REMOTE ] SEMR: Full fetch complete (60157 records). [2025-10-15T21:26:28.363288] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-15T21:26:28.751820] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-15T21:26:28.751931] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-15T21:26:28.752981] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-15T21:26:28.753055] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-15T21:26:28.754386] [DEBUG] [LOCAL ] SEMR: Trimmed 60157 records to 42055 (keeping 200 days of data) [2025-10-15T21:26:28.918048] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-15T21:26:29.000948] [DEBUG] [LOCAL ] SEMR: Primary data saved (42055 records). [2025-10-15T21:26:29.001087] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-15T21:26:29.001171] [INFO ] [MAIN ] Update Progress: 1894/2369 symbols completed. SEMR took 40.5s. Estimated remaining: 1h 6m 49s. Rate: 7.1 symbols/min [2025-10-15T21:26:29.167061] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:29.187483] [DEBUG] [LOCAL ] SFBS: Loaded 21185 existing records from primary storage. [2025-10-15T21:26:29.187760] [INFO ] [MAIN ] SFBS: Loaded 21185 existing records. [2025-10-15T21:26:29.362265] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:29.362487] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-15T21:26:29.362560] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-15T21:26:29.362857] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-15T21:26:29.362913] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-15T21:26:29.722610] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-15T21:26:29.727959] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:29.752979] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T21:26:30.214894] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T21:26:30.514023] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-15T21:26:30.849896] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T21:26:31.179000] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T21:26:31.314033] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-15T21:26:32.114053] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-15T21:26:32.295396] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T21:26:32.914050] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-15T21:26:33.414243] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T21:26:33.419276] [INFO ] [REMOTE ] SF: Full fetch complete (60181 records). [2025-10-15T21:26:33.419375] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-15T21:26:33.719161] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-15T21:26:33.801257] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-15T21:26:33.801331] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-15T21:26:33.802286] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-15T21:26:33.802348] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-15T21:26:33.803801] [DEBUG] [LOCAL ] SF: Trimmed 60181 records to 41554 (keeping 200 days of data) [2025-10-15T21:26:34.060715] [DEBUG] [LOCAL ] SF: Primary data saved (41554 records). [2025-10-15T21:26:34.060835] [INFO ] [MAIN ] SF: Full history saved. [2025-10-15T21:26:34.060911] [INFO ] [MAIN ] Update Progress: 1895/2369 symbols completed. SF took 25.8s. Estimated remaining: 1h 6m 39s. Rate: 7.1 symbols/min [2025-10-15T21:26:34.225043] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:34.266405] [DEBUG] [LOCAL ] SFL: Loaded 45328 existing records from primary storage. [2025-10-15T21:26:34.266717] [INFO ] [MAIN ] SFL: Loaded 45328 existing records. [2025-10-15T21:26:34.445809] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:34.446003] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-15T21:26:34.446051] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-15T21:26:34.446552] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-15T21:26:34.446608] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-15T21:26:34.517762] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-15T21:26:34.805986] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:34.827564] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T21:26:34.998964] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T21:26:35.202809] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T21:26:35.314007] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-15T21:26:36.113998] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-15T21:26:36.914008] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-15T21:26:37.478300] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T21:26:37.617067] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T21:26:37.714025] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-15T21:26:37.763989] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-15T21:26:37.770458] [INFO ] [REMOTE ] SES: Full fetch complete (75648 records). [2025-10-15T21:26:37.770585] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-15T21:26:38.159849] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-15T21:26:38.159954] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-15T21:26:38.161111] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-15T21:26:38.161188] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-15T21:26:38.162595] [DEBUG] [LOCAL ] SES: Trimmed 75648 records to 51578 (keeping 200 days of data) [2025-10-15T21:26:38.462176] [DEBUG] [LOCAL ] SES: Primary data saved (51578 records). [2025-10-15T21:26:38.462308] [INFO ] [MAIN ] SES: Full history saved. [2025-10-15T21:26:38.462903] [INFO ] [MAIN ] Update Progress: 1896/2369 symbols completed. SES took 38.0s. Estimated remaining: 1h 6m 30s. Rate: 7.1 symbols/min [2025-10-15T21:26:38.523937] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-15T21:26:38.631767] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:38.685105] [DEBUG] [LOCAL ] SG: Loaded 53488 existing records from primary storage. [2025-10-15T21:26:38.685421] [INFO ] [MAIN ] SG: Loaded 53488 existing records. [2025-10-15T21:26:38.817064] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T21:26:38.882574] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:38.882810] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-15T21:26:38.882859] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-15T21:26:38.883329] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-15T21:26:38.883381] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-15T21:26:39.230942] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:39.313995] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-15T21:26:40.036007] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T21:26:40.114017] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-15T21:26:40.362854] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T21:26:40.914006] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-15T21:26:41.713978] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-15T21:26:41.903353] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T21:26:42.513967] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-15T21:26:42.565269] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T21:26:42.943606] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T21:26:43.314044] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-15T21:26:43.874946] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T21:26:44.114005] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-15T21:26:44.281222] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T21:26:44.681962] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T21:26:44.914058] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-15T21:26:45.714091] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-15T21:26:46.230451] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T21:26:46.513978] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-15T21:26:46.751419] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T21:26:47.094574] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T21:26:47.314052] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-15T21:26:48.114066] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-15T21:26:48.913983] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-15T21:26:49.076235] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T21:26:49.258317] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T21:26:49.304771] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T21:26:49.305737] [INFO ] [REMOTE ] SFB: Full fetch complete (5818 records). [2025-10-15T21:26:49.305808] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-15T21:26:49.668456] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-15T21:26:49.668559] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-15T21:26:49.668778] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-15T21:26:49.668841] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-15T21:26:49.669223] [DEBUG] [LOCAL ] SFB: Trimmed 5818 records to 3827 (keeping 200 days of data) [2025-10-15T21:26:49.692550] [DEBUG] [LOCAL ] SFB: Primary data saved (3827 records). [2025-10-15T21:26:49.692661] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-15T21:26:49.692761] [INFO ] [MAIN ] Update Progress: 1897/2369 symbols completed. SFB took 31.1s. Estimated remaining: 1h 6m 22s. Rate: 7.1 symbols/min [2025-10-15T21:26:49.721226] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-15T21:26:49.870597] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:26:49.915344] [DEBUG] [LOCAL ] SGHC: Loaded 46928 existing records from primary storage. [2025-10-15T21:26:49.915634] [INFO ] [MAIN ] SGHC: Loaded 46928 existing records. [2025-10-15T21:26:50.093071] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:26:50.093314] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-15T21:26:50.093363] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-15T21:26:50.093899] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-15T21:26:50.093956] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-15T21:26:50.458077] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:26:50.514063] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-15T21:26:51.302114] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T21:26:51.314361] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-15T21:26:51.840021] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-15T21:26:52.114057] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-15T21:26:52.735899] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T21:26:52.914029] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-15T21:26:53.713970] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-15T21:26:53.836241] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T21:26:54.514053] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-15T21:26:54.554756] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T21:26:55.109022] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T21:26:55.314045] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-15T21:26:55.727992] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T21:26:56.093054] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T21:26:56.113980] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-15T21:26:56.914002] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-15T21:26:57.213987] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T21:26:57.714077] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-15T21:26:58.356034] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T21:26:58.513959] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-15T21:26:59.313970] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-15T21:26:59.527857] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T21:27:00.101232] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T21:27:00.113965] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-15T21:27:00.769288] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T21:27:00.913959] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-15T21:27:01.714009] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-15T21:27:02.151356] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T21:27:02.514046] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-15T21:27:02.687076] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T21:27:02.797143] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T21:27:03.314007] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-15T21:27:04.114010] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-15T21:27:04.329683] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T21:27:04.419032] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T21:27:04.914007] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-15T21:27:05.669578] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T21:27:05.713978] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-15T21:27:06.494031] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T21:27:06.513950] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-15T21:27:06.662638] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T21:27:06.669806] [INFO ] [REMOTE ] SFL: Full fetch complete (65888 records). [2025-10-15T21:27:06.670010] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-15T21:27:07.050729] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-15T21:27:07.050826] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-15T21:27:07.051862] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-15T21:27:07.051935] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-15T21:27:07.053315] [DEBUG] [LOCAL ] SFL: Trimmed 65888 records to 45346 (keeping 200 days of data) [2025-10-15T21:27:07.314075] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-15T21:27:07.318561] [DEBUG] [LOCAL ] SFL: Primary data saved (45346 records). [2025-10-15T21:27:07.318759] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-15T21:27:07.319774] [INFO ] [MAIN ] Update Progress: 1898/2369 symbols completed. SFL took 33.3s. Estimated remaining: 1h 6m 16s. Rate: 7.1 symbols/min [2025-10-15T21:27:07.486372] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:07.486572] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-15T21:27:07.486614] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-15T21:27:07.486765] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-15T21:27:07.486837] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-15T21:27:07.486881] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-15T21:27:07.486912] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-15T21:27:07.857226] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:08.028875] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T21:27:08.077629] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T21:27:08.080979] [INFO ] [REMOTE ] SFBS: Full fetch complete (30266 records). [2025-10-15T21:27:08.081069] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-15T21:27:08.119139] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-15T21:27:08.475945] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-15T21:27:08.476037] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-15T21:27:08.476752] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-15T21:27:08.476814] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-15T21:27:08.477676] [DEBUG] [LOCAL ] SFBS: Trimmed 30266 records to 21196 (keeping 200 days of data) [2025-10-15T21:27:08.628795] [DEBUG] [LOCAL ] SFBS: Primary data saved (21196 records). [2025-10-15T21:27:08.628982] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-15T21:27:08.629097] [INFO ] [MAIN ] Update Progress: 1899/2369 symbols completed. SFBS took 39.6s. Estimated remaining: 1h 6m 6s. Rate: 7.1 symbols/min [2025-10-15T21:27:08.830973] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:08.841276] [DEBUG] [LOCAL ] SGU: Loaded 6580 existing records from primary storage. [2025-10-15T21:27:08.841576] [INFO ] [MAIN ] SGU: Loaded 6580 existing records. [2025-10-15T21:27:08.919149] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-15T21:27:09.099239] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:09.099673] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-15T21:27:09.099754] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-15T21:27:09.100030] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-15T21:27:09.100091] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-15T21:27:09.180493] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:27:09.208233] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-15T21:27:09.208398] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:27:09.208451] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-15T21:27:09.208878] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:27:09.224698] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-15T21:27:09.247737] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-15T21:27:09.252942] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-15T21:27:09.267833] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-15T21:27:09.277069] [INFO ] [MAIN ] Update Progress: 1900/2369 symbols completed. SGI took 2.0s. Estimated remaining: 1h 5m 56s. Rate: 7.1 symbols/min [2025-10-15T21:27:09.611296] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:09.654358] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:09.700699] [DEBUG] [LOCAL ] SHAK: Loaded 48851 existing records from primary storage. [2025-10-15T21:27:09.701028] [INFO ] [MAIN ] SHAK: Loaded 48851 existing records. [2025-10-15T21:27:09.721697] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-15T21:27:09.885372] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:09.885600] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-15T21:27:09.885706] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-15T21:27:09.894935] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-15T21:27:09.907275] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-15T21:27:09.979733] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T21:27:10.268323] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:10.435709] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T21:27:10.514007] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-15T21:27:11.314034] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-15T21:27:11.862448] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T21:27:12.114036] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-15T21:27:12.735044] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T21:27:12.913962] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-15T21:27:13.330330] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-15T21:27:13.511280] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T21:27:13.713989] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-15T21:27:14.514001] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-15T21:27:15.151144] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T21:27:15.313958] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-15T21:27:15.397811] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T21:27:15.404141] [INFO ] [REMOTE ] SG: Full fetch complete (77462 records). [2025-10-15T21:27:15.404262] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-15T21:27:15.791674] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-15T21:27:15.791772] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-15T21:27:15.792860] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-15T21:27:15.792927] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-15T21:27:15.794326] [DEBUG] [LOCAL ] SG: Trimmed 77462 records to 53494 (keeping 200 days of data) [2025-10-15T21:27:16.106112] [DEBUG] [LOCAL ] SG: Primary data saved (53494 records). [2025-10-15T21:27:16.106240] [INFO ] [MAIN ] SG: Full history saved. [2025-10-15T21:27:16.106595] [INFO ] [MAIN ] Update Progress: 1901/2369 symbols completed. SG took 37.6s. Estimated remaining: 1h 5m 47s. Rate: 7.1 symbols/min [2025-10-15T21:27:16.119119] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-15T21:27:16.283536] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:16.310184] [DEBUG] [LOCAL ] SHCO: Loaded 25511 existing records from primary storage. [2025-10-15T21:27:16.310446] [INFO ] [MAIN ] SHCO: Loaded 25511 existing records. [2025-10-15T21:27:16.489858] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:16.490097] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-15T21:27:16.490147] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-15T21:27:16.490383] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-15T21:27:16.490422] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-15T21:27:16.851535] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:16.914010] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-15T21:27:16.944378] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T21:27:17.591331] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T21:27:17.713960] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-15T21:27:18.186877] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-15T21:27:18.319924] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T21:27:18.514069] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-15T21:27:19.132275] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T21:27:19.314049] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-15T21:27:20.035732] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T21:27:20.114017] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-15T21:27:20.913997] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-15T21:27:20.996135] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T21:27:21.714021] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-15T21:27:22.514036] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-15T21:27:22.674836] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T21:27:22.971081] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T21:27:23.314021] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-15T21:27:23.645576] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T21:27:24.114023] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-15T21:27:24.660252] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T21:27:24.914016] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-15T21:27:25.714023] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-15T21:27:25.878393] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T21:27:25.937304] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T21:27:26.417812] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T21:27:26.513995] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-15T21:27:27.027244] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T21:27:27.028504] [INFO ] [REMOTE ] SGU: Full fetch complete (9037 records). [2025-10-15T21:27:27.028583] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-15T21:27:27.319637] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-15T21:27:27.408524] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-15T21:27:27.408612] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-15T21:27:27.408933] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-15T21:27:27.408993] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-15T21:27:27.409424] [DEBUG] [LOCAL ] SGU: Trimmed 9037 records to 6594 (keeping 200 days of data) [2025-10-15T21:27:27.449264] [DEBUG] [LOCAL ] SGU: Primary data saved (6594 records). [2025-10-15T21:27:27.449389] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-15T21:27:27.449477] [INFO ] [MAIN ] Update Progress: 1902/2369 symbols completed. SGU took 18.8s. Estimated remaining: 1h 5m 39s. Rate: 7.1 symbols/min [2025-10-15T21:27:27.636901] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:27.690408] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-10-15T21:27:27.690853] [INFO ] [MAIN ] SHEL: Loaded 53673 existing records. [2025-10-15T21:27:27.868998] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:27.869205] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-15T21:27:27.869250] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-15T21:27:27.869690] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-15T21:27:27.869745] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-15T21:27:28.119216] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-15T21:27:28.216904] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:28.914013] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-15T21:27:29.217699] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T21:27:29.714004] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-15T21:27:29.981260] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T21:27:30.010104] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T21:27:30.514053] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-15T21:27:31.313991] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-15T21:27:31.372111] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T21:27:31.379151] [INFO ] [REMOTE ] SGHC: Full fetch complete (64974 records). [2025-10-15T21:27:31.379308] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-15T21:27:31.788842] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-15T21:27:31.788960] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-15T21:27:31.790034] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-15T21:27:31.790117] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-15T21:27:31.811825] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T21:27:31.819223] [DEBUG] [LOCAL ] SGHC: Trimmed 64974 records to 47022 (keeping 200 days of data) [2025-10-15T21:27:32.114136] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-15T21:27:32.126667] [DEBUG] [LOCAL ] SGHC: Primary data saved (47022 records). [2025-10-15T21:27:32.126813] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-15T21:27:32.126897] [INFO ] [MAIN ] Update Progress: 1903/2369 symbols completed. SGHC took 42.4s. Estimated remaining: 1h 5m 30s. Rate: 7.1 symbols/min [2025-10-15T21:27:32.292111] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:32.318583] [DEBUG] [LOCAL ] SHG: Loaded 26502 existing records from primary storage. [2025-10-15T21:27:32.318924] [INFO ] [MAIN ] SHG: Loaded 26502 existing records. [2025-10-15T21:27:32.492097] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:32.492313] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-15T21:27:32.492384] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-15T21:27:32.492699] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-15T21:27:32.492756] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-15T21:27:32.844697] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:32.921112] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-15T21:27:32.926702] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T21:27:33.713973] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-15T21:27:34.008726] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T21:27:34.195604] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:27:34.514036] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-15T21:27:35.314014] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-15T21:27:35.426129] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T21:27:35.711275] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T21:27:36.113994] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-15T21:27:36.895676] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T21:27:36.913954] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-15T21:27:37.083664] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T21:27:37.714053] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-15T21:27:37.866767] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T21:27:38.513962] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-15T21:27:38.987267] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T21:27:39.314054] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-15T21:27:40.114050] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-15T21:27:40.143546] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T21:27:40.684125] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T21:27:40.914036] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-15T21:27:41.325166] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T21:27:41.714005] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-15T21:27:42.513989] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-15T21:27:42.907234] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T21:27:43.314020] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-15T21:27:43.557679] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T21:27:43.850240] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T21:27:44.114090] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-15T21:27:44.913969] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-15T21:27:45.455216] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T21:27:45.500190] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T21:27:45.714029] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-15T21:27:46.037953] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T21:27:46.514011] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-15T21:27:47.314067] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-15T21:27:47.555835] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T21:27:48.114054] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-15T21:27:48.130344] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T21:27:48.136320] [INFO ] [REMOTE ] SHAK: Full fetch complete (71100 records). [2025-10-15T21:27:48.136438] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-15T21:27:48.525570] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-15T21:27:48.525673] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-15T21:27:48.526763] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-15T21:27:48.526826] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-15T21:27:48.528210] [DEBUG] [LOCAL ] SHAK: Trimmed 71100 records to 48835 (keeping 200 days of data) [2025-10-15T21:27:48.636567] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T21:27:48.842361] [DEBUG] [LOCAL ] SHAK: Primary data saved (48835 records). [2025-10-15T21:27:48.842498] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-15T21:27:48.842576] [INFO ] [MAIN ] Update Progress: 1904/2369 symbols completed. SHAK took 39.6s. Estimated remaining: 1h 5m 23s. Rate: 7.1 symbols/min [2025-10-15T21:27:48.919127] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-15T21:27:49.011123] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:49.055467] [DEBUG] [LOCAL ] SHO: Loaded 49430 existing records from primary storage. [2025-10-15T21:27:49.055818] [INFO ] [MAIN ] SHO: Loaded 49430 existing records. [2025-10-15T21:27:49.232123] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:49.232356] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-15T21:27:49.232402] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-15T21:27:49.232825] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-15T21:27:49.232882] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-15T21:27:49.585753] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:49.651676] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T21:27:49.713958] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-15T21:27:50.003500] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T21:27:50.006831] [INFO ] [REMOTE ] SHCO: Full fetch complete (37488 records). [2025-10-15T21:27:50.006923] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-15T21:27:50.395534] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-15T21:27:50.395674] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-15T21:27:50.396428] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-15T21:27:50.396476] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-15T21:27:50.397255] [DEBUG] [LOCAL ] SHCO: Trimmed 37488 records to 25461 (keeping 200 days of data) [2025-10-15T21:27:50.518259] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-15T21:27:50.537007] [DEBUG] [LOCAL ] SHCO: Primary data saved (25461 records). [2025-10-15T21:27:50.537089] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-15T21:27:50.537164] [INFO ] [MAIN ] Update Progress: 1905/2369 symbols completed. SHCO took 34.4s. Estimated remaining: 1h 5m 13s. Rate: 7.1 symbols/min [2025-10-15T21:27:50.703627] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:27:50.708470] [DEBUG] [LOCAL ] SHOC: Loaded 3300 existing records from primary storage. [2025-10-15T21:27:50.708621] [INFO ] [MAIN ] SHOC: Loaded 3300 existing records. [2025-10-15T21:27:50.887772] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:27:50.888052] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-15T21:27:50.888101] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-15T21:27:50.888337] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-15T21:27:50.888393] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-15T21:27:51.249419] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:27:51.280055] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T21:27:51.313972] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-15T21:27:52.114002] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-15T21:27:52.155450] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T21:27:52.591186] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-15T21:27:52.914032] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-15T21:27:53.490970] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T21:27:53.654131] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T21:27:53.713957] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-15T21:27:54.324361] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T21:27:54.513992] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-15T21:27:55.314074] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-15T21:27:55.804918] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T21:27:56.069869] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T21:27:56.113950] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-15T21:27:56.612275] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-15T21:27:56.914081] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-15T21:27:57.361852] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T21:27:57.713997] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-15T21:27:58.513959] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-15T21:27:58.987931] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T21:27:59.035363] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T21:27:59.314003] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-15T21:27:59.930725] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T21:28:00.113987] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-15T21:28:00.914103] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-15T21:28:01.317063] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T21:28:01.714010] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-15T21:28:02.514046] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-15T21:28:03.069732] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T21:28:03.210752] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-15T21:28:03.313981] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-15T21:28:04.050243] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T21:28:04.113974] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-15T21:28:04.914030] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-15T21:28:05.010228] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T21:28:05.374188] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T21:28:05.714017] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-15T21:28:05.777730] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T21:28:06.372415] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T21:28:06.514007] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-15T21:28:06.993550] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:28:06.994601] [INFO ] [REMOTE ] SHOC: Full fetch complete (7012 records). [2025-10-15T21:28:06.994703] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-15T21:28:07.320142] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-15T21:28:07.363030] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-15T21:28:07.363109] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-15T21:28:07.363445] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-15T21:28:07.363508] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-15T21:28:07.363936] [DEBUG] [LOCAL ] SHOC: Trimmed 7012 records to 3243 (keeping 200 days of data) [2025-10-15T21:28:07.384590] [DEBUG] [LOCAL ] SHOC: Primary data saved (3243 records). [2025-10-15T21:28:07.384713] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-15T21:28:07.384803] [INFO ] [MAIN ] Update Progress: 1906/2369 symbols completed. SHOC took 16.8s. Estimated remaining: 1h 5m 7s. Rate: 7.1 symbols/min [2025-10-15T21:28:07.555176] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:07.602842] [DEBUG] [LOCAL ] SHW: Loaded 50357 existing records from primary storage. [2025-10-15T21:28:07.603176] [INFO ] [MAIN ] SHW: Loaded 50357 existing records. [2025-10-15T21:28:07.784831] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:07.785089] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-15T21:28:07.785136] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-15T21:28:07.785735] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-15T21:28:07.785793] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-15T21:28:08.119104] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-15T21:28:08.184423] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:08.410621] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T21:28:08.913994] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-15T21:28:09.713974] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-15T21:28:10.123733] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T21:28:10.137467] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T21:28:10.514018] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-15T21:28:11.314061] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-15T21:28:11.375385] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T21:28:12.125607] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-15T21:28:12.130864] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T21:28:12.914016] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-15T21:28:13.053731] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T21:28:13.060123] [INFO ] [REMOTE ] SHEL: Full fetch complete (77835 records). [2025-10-15T21:28:13.060240] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-15T21:28:13.445112] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-15T21:28:13.445246] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-15T21:28:13.446465] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-15T21:28:13.446530] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-15T21:28:13.448043] [DEBUG] [LOCAL ] SHEL: Trimmed 77835 records to 53673 (keeping 200 days of data) [2025-10-15T21:28:13.729238] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-15T21:28:13.778955] [DEBUG] [LOCAL ] SHEL: Primary data saved (53673 records). [2025-10-15T21:28:13.779198] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-15T21:28:13.779389] [INFO ] [MAIN ] Update Progress: 1907/2369 symbols completed. SHEL took 46.3s. Estimated remaining: 1h 4m 58s. Rate: 7.1 symbols/min [2025-10-15T21:28:13.976927] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T21:28:13.979580] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:14.006356] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-15T21:28:14.008490] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T21:28:14.007622] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-15T21:28:14.012487] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-15T21:28:14.012727] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-15T21:28:14.012795] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-15T21:28:14.012830] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-15T21:28:14.045846] [INFO ] [REMOTE ] SHG: Full fetch complete (41178 records). [2025-10-15T21:28:14.081026] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-15T21:28:14.525695] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-15T21:28:14.740189] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:14.779949] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-15T21:28:14.780018] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-15T21:28:14.780932] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-15T21:28:14.780994] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-15T21:28:14.784732] [DEBUG] [LOCAL ] SHG: Trimmed 41178 records to 26500 (keeping 200 days of data) [2025-10-15T21:28:14.937952] [DEBUG] [LOCAL ] SHG: Primary data saved (26500 records). [2025-10-15T21:28:14.938081] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-15T21:28:14.938229] [INFO ] [MAIN ] Update Progress: 1908/2369 symbols completed. SHG took 42.8s. Estimated remaining: 1h 4m 48s. Rate: 7.1 symbols/min [2025-10-15T21:28:15.120049] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:15.160253] [DEBUG] [LOCAL ] SID: Loaded 42651 existing records from primary storage. [2025-10-15T21:28:15.160521] [INFO ] [MAIN ] SID: Loaded 42651 existing records. [2025-10-15T21:28:15.320221] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-15T21:28:15.341859] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:15.342836] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-15T21:28:15.342892] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-15T21:28:15.343141] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-15T21:28:15.343262] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-15T21:28:15.629537] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:28:15.640191] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-15T21:28:15.658318] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:28:15.674310] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-15T21:28:15.685062] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:28:15.709690] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-15T21:28:15.749393] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-15T21:28:15.768881] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-15T21:28:15.773373] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-15T21:28:15.776984] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-15T21:28:15.776706] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:15.786371] [INFO ] [MAIN ] Update Progress: 1909/2369 symbols completed. SI took 2.0s. Estimated remaining: 1h 4m 37s. Rate: 7.1 symbols/min [2025-10-15T21:28:15.957831] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:16.001419] [DEBUG] [LOCAL ] SIG: Loaded 45688 existing records from primary storage. [2025-10-15T21:28:16.023384] [INFO ] [MAIN ] SIG: Loaded 45688 existing records. [2025-10-15T21:28:16.107833] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T21:28:16.125555] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-15T21:28:16.218016] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:16.218231] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-15T21:28:16.218291] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-15T21:28:16.218682] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-15T21:28:16.218738] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-15T21:28:16.560932] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:16.914000] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-15T21:28:17.714001] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-15T21:28:17.927071] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T21:28:18.506183] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:28:18.514959] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-15T21:28:19.314007] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-15T21:28:19.386728] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T21:28:20.113964] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-15T21:28:20.274793] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T21:28:20.913986] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-15T21:28:20.951274] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T21:28:21.693477] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T21:28:21.713948] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-15T21:28:22.232462] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T21:28:22.513994] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-15T21:28:23.313973] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-15T21:28:23.370860] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T21:28:23.962834] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T21:28:24.113974] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-15T21:28:24.517909] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T21:28:24.914017] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-15T21:28:25.458113] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T21:28:25.714022] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-15T21:28:26.514001] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-15T21:28:26.809870] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T21:28:27.266683] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T21:28:27.313988] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-15T21:28:28.114012] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-15T21:28:28.205129] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T21:28:28.914047] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-15T21:28:29.137292] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:28:29.254353] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T21:28:29.714085] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-15T21:28:30.514014] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-15T21:28:30.641876] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T21:28:31.314056] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-15T21:28:31.433568] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T21:28:31.897615] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T21:28:32.114021] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-15T21:28:32.654679] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T21:28:32.913995] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-15T21:28:33.618531] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T21:28:33.713993] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-15T21:28:34.513981] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-15T21:28:34.641938] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T21:28:35.123334] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T21:28:35.129545] [INFO ] [REMOTE ] SHO: Full fetch complete (70988 records). [2025-10-15T21:28:35.129751] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-15T21:28:35.319689] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-15T21:28:35.543197] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-15T21:28:35.543283] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-15T21:28:35.544503] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-15T21:28:35.544586] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-15T21:28:35.546032] [DEBUG] [LOCAL ] SHO: Trimmed 70988 records to 49400 (keeping 200 days of data) [2025-10-15T21:28:35.842964] [DEBUG] [LOCAL ] SHO: Primary data saved (49400 records). [2025-10-15T21:28:35.843098] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-15T21:28:35.844031] [INFO ] [MAIN ] Update Progress: 1910/2369 symbols completed. SHO took 47.0s. Estimated remaining: 1h 4m 32s. Rate: 7.1 symbols/min [2025-10-15T21:28:36.020637] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:36.045237] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T21:28:36.075894] [DEBUG] [LOCAL ] SII: Loaded 23971 existing records from primary storage. [2025-10-15T21:28:36.076152] [INFO ] [MAIN ] SII: Loaded 23971 existing records. [2025-10-15T21:28:36.119111] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-15T21:28:36.253052] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:36.253285] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-15T21:28:36.253342] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-15T21:28:36.253669] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-15T21:28:36.253730] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-15T21:28:36.598627] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:36.913969] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-15T21:28:37.168884] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T21:28:37.678450] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T21:28:37.713949] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-15T21:28:38.504328] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T21:28:38.516296] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-15T21:28:39.183580] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T21:28:39.313973] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-15T21:28:39.475239] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T21:28:40.114007] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-15T21:28:40.913361] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T21:28:40.917282] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-15T21:28:41.595143] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T21:28:41.714052] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-15T21:28:41.819585] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T21:28:42.514088] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-15T21:28:43.313965] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-15T21:28:43.354318] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T21:28:43.360625] [INFO ] [REMOTE ] SHW: Full fetch complete (73246 records). [2025-10-15T21:28:43.360815] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-15T21:28:43.545546] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T21:28:43.759744] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-15T21:28:43.759823] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-15T21:28:43.760874] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-15T21:28:43.760954] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-15T21:28:43.762270] [DEBUG] [LOCAL ] SHW: Trimmed 73246 records to 50362 (keeping 200 days of data) [2025-10-15T21:28:44.076710] [DEBUG] [LOCAL ] SHW: Primary data saved (50362 records). [2025-10-15T21:28:44.076875] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-15T21:28:44.077250] [INFO ] [MAIN ] Update Progress: 1911/2369 symbols completed. SHW took 36.7s. Estimated remaining: 1h 4m 23s. Rate: 7.1 symbols/min [2025-10-15T21:28:44.119456] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-15T21:28:44.245689] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:44.276953] [DEBUG] [LOCAL ] SILA: Loaded 30520 existing records from primary storage. [2025-10-15T21:28:44.277217] [INFO ] [MAIN ] SILA: Loaded 30520 existing records. [2025-10-15T21:28:44.455898] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:44.456105] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-15T21:28:44.456152] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-15T21:28:44.456404] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-15T21:28:44.456459] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-15T21:28:44.801475] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:44.827782] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T21:28:44.913962] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-15T21:28:45.654880] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T21:28:45.660568] [INFO ] [REMOTE ] SID: Full fetch complete (60931 records). [2025-10-15T21:28:45.660732] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-15T21:28:45.723227] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-15T21:28:46.044086] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-15T21:28:46.044200] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-15T21:28:46.045412] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-15T21:28:46.045591] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-15T21:28:46.047081] [DEBUG] [LOCAL ] SID: Trimmed 60931 records to 42687 (keeping 200 days of data) [2025-10-15T21:28:46.267608] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T21:28:46.322485] [DEBUG] [LOCAL ] SID: Primary data saved (42687 records). [2025-10-15T21:28:46.322605] [INFO ] [MAIN ] SID: Full history saved. [2025-10-15T21:28:46.322701] [INFO ] [MAIN ] Update Progress: 1912/2369 symbols completed. SID took 31.4s. Estimated remaining: 1h 4m 13s. Rate: 7.1 symbols/min [2025-10-15T21:28:46.493763] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:46.517433] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-15T21:28:46.536447] [DEBUG] [LOCAL ] SITC: Loaded 41760 existing records from primary storage. [2025-10-15T21:28:46.536770] [INFO ] [MAIN ] SITC: Loaded 41760 existing records. [2025-10-15T21:28:46.713136] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:46.713327] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-15T21:28:46.713387] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-15T21:28:46.713826] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-15T21:28:46.713885] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-15T21:28:47.069092] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:47.087159] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T21:28:47.314009] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-15T21:28:47.859381] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T21:28:47.864768] [INFO ] [REMOTE ] SIG: Full fetch complete (67971 records). [2025-10-15T21:28:47.864881] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-15T21:28:48.121490] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-15T21:28:48.249690] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-15T21:28:48.249779] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-15T21:28:48.250843] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-15T21:28:48.250905] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-15T21:28:48.252226] [DEBUG] [LOCAL ] SIG: Trimmed 67971 records to 45678 (keeping 200 days of data) [2025-10-15T21:28:48.546428] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T21:28:48.562021] [DEBUG] [LOCAL ] SIG: Primary data saved (45678 records). [2025-10-15T21:28:48.562113] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-15T21:28:48.562185] [INFO ] [MAIN ] Update Progress: 1913/2369 symbols completed. SIG took 32.8s. Estimated remaining: 1h 4m 3s. Rate: 7.1 symbols/min [2025-10-15T21:28:48.725454] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:28:48.759858] [DEBUG] [LOCAL ] SITE: Loaded 35503 existing records from primary storage. [2025-10-15T21:28:48.760139] [INFO ] [MAIN ] SITE: Loaded 35503 existing records. [2025-10-15T21:28:48.916997] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-15T21:28:48.937366] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:28:48.938345] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-15T21:28:48.938394] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-15T21:28:48.939173] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-15T21:28:48.939231] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-15T21:28:49.286271] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:28:49.656746] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:28:49.713954] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-15T21:28:49.993450] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T21:28:50.513988] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-15T21:28:51.249950] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T21:28:51.313953] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-15T21:28:51.784868] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T21:28:52.114077] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-15T21:28:52.703127] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T21:28:52.946244] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-15T21:28:52.970280] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T21:28:53.714029] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-15T21:28:54.528245] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-15T21:28:54.537999] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T21:28:54.601927] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T21:28:55.313993] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-15T21:28:55.681229] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T21:28:56.114022] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-15T21:28:56.647633] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:28:56.914036] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-15T21:28:57.251409] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T21:28:57.714006] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-15T21:28:58.288559] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T21:28:58.514045] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-15T21:28:59.195436] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T21:28:59.314029] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-15T21:28:59.710050] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T21:29:00.114060] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-15T21:29:00.484252] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T21:29:00.914076] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-15T21:29:01.637737] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T21:29:01.714034] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-15T21:29:01.789286] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T21:29:02.514044] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-15T21:29:02.769158] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:29:03.314035] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-15T21:29:03.932673] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T21:29:04.113997] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-15T21:29:04.744192] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T21:29:04.914019] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-15T21:29:05.714047] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-15T21:29:05.749157] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T21:29:06.317929] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T21:29:06.513966] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-15T21:29:06.866510] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T21:29:07.314010] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-15T21:29:07.819716] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T21:29:08.114029] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-15T21:29:08.294923] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T21:29:08.298700] [INFO ] [REMOTE ] SII: Full fetch complete (31053 records). [2025-10-15T21:29:08.298778] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-15T21:29:08.662973] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-15T21:29:08.663050] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-15T21:29:08.663666] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-15T21:29:08.663748] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-15T21:29:08.664427] [DEBUG] [LOCAL ] SII: Trimmed 31053 records to 23989 (keeping 200 days of data) [2025-10-15T21:29:08.810556] [DEBUG] [LOCAL ] SII: Primary data saved (23989 records). [2025-10-15T21:29:08.810705] [INFO ] [MAIN ] SII: Full history saved. [2025-10-15T21:29:08.810794] [INFO ] [MAIN ] Update Progress: 1914/2369 symbols completed. SII took 33.0s. Estimated remaining: 1h 3m 58s. Rate: 7.1 symbols/min [2025-10-15T21:29:08.919152] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-15T21:29:08.985227] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:09.031262] [DEBUG] [LOCAL ] SJM: Loaded 50116 existing records from primary storage. [2025-10-15T21:29:09.031548] [INFO ] [MAIN ] SJM: Loaded 50116 existing records. [2025-10-15T21:29:09.206436] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:09.206692] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-15T21:29:09.206749] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-15T21:29:09.207771] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-15T21:29:09.207828] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-15T21:29:09.527273] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T21:29:09.584371] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:09.713975] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-15T21:29:10.294156] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T21:29:10.513994] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-15T21:29:11.041522] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:29:11.314012] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-15T21:29:12.113991] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-15T21:29:12.286851] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T21:29:12.914028] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-15T21:29:12.964119] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T21:29:13.332125] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T21:29:13.714043] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-15T21:29:14.515101] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-15T21:29:14.520161] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T21:29:15.119353] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T21:29:15.124634] [INFO ] [REMOTE ] SITC: Full fetch complete (60703 records). [2025-10-15T21:29:15.124783] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-15T21:29:15.320167] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-15T21:29:15.470159] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T21:29:15.525801] [INFO ] [REMOTE ] SILA: Full fetch complete (44603 records). [2025-10-15T21:29:15.529036] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-15T21:29:15.529110] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-15T21:29:15.530116] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-15T21:29:15.528954] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-15T21:29:15.530226] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-15T21:29:15.621361] [DEBUG] [LOCAL ] SITC: Trimmed 60703 records to 41805 (keeping 200 days of data) [2025-10-15T21:29:16.129921] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-15T21:29:16.129668] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-15T21:29:16.139089] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-15T21:29:16.140390] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-15T21:29:16.140921] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-15T21:29:16.145883] [DEBUG] [LOCAL ] SILA: Trimmed 44603 records to 30516 (keeping 200 days of data) [2025-10-15T21:29:16.277830] [DEBUG] [LOCAL ] SITC: Primary data saved (41805 records). [2025-10-15T21:29:16.283705] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-15T21:29:16.287932] [INFO ] [MAIN ] Update Progress: 1915/2369 symbols completed. SITC took 30.0s. Estimated remaining: 1h 3m 49s. Rate: 7.1 symbols/min [2025-10-15T21:29:16.465202] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:16.540312] [DEBUG] [LOCAL ] SJT: Loaded 22467 existing records from primary storage. [2025-10-15T21:29:16.547185] [DEBUG] [LOCAL ] SILA: Primary data saved (30516 records). [2025-10-15T21:29:16.547554] [INFO ] [MAIN ] SJT: Loaded 22467 existing records. [2025-10-15T21:29:16.578348] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-15T21:29:16.589996] [INFO ] [MAIN ] Update Progress: 1916/2369 symbols completed. SILA took 32.5s. Estimated remaining: 1h 3m 39s. Rate: 7.1 symbols/min [2025-10-15T21:29:16.827414] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:16.850833] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-15T21:29:16.853986] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-15T21:29:16.859949] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-15T21:29:16.860120] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-15T21:29:17.021444] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:17.338169] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T21:29:17.342210] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:17.351574] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-15T21:29:17.363830] [DEBUG] [LOCAL ] SKE: Loaded 36810 existing records from primary storage. [2025-10-15T21:29:17.364167] [INFO ] [MAIN ] SKE: Loaded 36810 existing records. [2025-10-15T21:29:17.546391] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:17.546739] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-15T21:29:17.546813] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-15T21:29:17.547450] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-15T21:29:17.547508] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-15T21:29:17.725315] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-15T21:29:17.921953] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:17.951801] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T21:29:18.514030] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-15T21:29:18.577521] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T21:29:19.206279] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T21:29:19.313967] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-15T21:29:20.004536] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T21:29:20.113971] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-15T21:29:20.560188] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T21:29:20.913962] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-15T21:29:21.394150] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T21:29:21.713964] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-15T21:29:22.383246] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T21:29:22.514003] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-15T21:29:23.191624] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T21:29:23.313985] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-15T21:29:24.040215] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T21:29:24.114045] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-15T21:29:24.264925] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T21:29:24.914006] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-15T21:29:25.713984] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-15T21:29:25.966098] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-15T21:29:26.047149] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T21:29:26.474629] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T21:29:26.513958] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-15T21:29:27.314001] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-15T21:29:27.849702] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T21:29:27.854522] [INFO ] [REMOTE ] SITE: Full fetch complete (50502 records). [2025-10-15T21:29:27.854621] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-15T21:29:28.119186] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-15T21:29:28.223791] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-15T21:29:28.223873] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-15T21:29:28.224792] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-15T21:29:28.224854] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-15T21:29:28.225870] [DEBUG] [LOCAL ] SITE: Trimmed 50502 records to 35608 (keeping 200 days of data) [2025-10-15T21:29:28.441973] [DEBUG] [LOCAL ] SITE: Primary data saved (35608 records). [2025-10-15T21:29:28.442132] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-15T21:29:28.442226] [INFO ] [MAIN ] Update Progress: 1917/2369 symbols completed. SITE took 39.9s. Estimated remaining: 1h 3m 31s. Rate: 7.1 symbols/min [2025-10-15T21:29:28.880158] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:29:28.914045] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-15T21:29:29.063713] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T21:29:29.714019] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-15T21:29:29.919902] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T21:29:30.514061] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-15T21:29:31.314031] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-15T21:29:31.483971] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T21:29:31.849290] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T21:29:32.113998] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-15T21:29:32.418167] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T21:29:32.902729] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T21:29:32.914114] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-15T21:29:33.714066] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-15T21:29:34.351429] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T21:29:34.514016] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-15T21:29:34.717889] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T21:29:35.314023] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-15T21:29:36.054722] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T21:29:36.060679] [INFO ] [REMOTE ] SJM: Full fetch complete (72254 records). [2025-10-15T21:29:36.060812] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-15T21:29:36.122722] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-15T21:29:36.459960] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-15T21:29:36.460069] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-15T21:29:36.462267] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-15T21:29:36.462342] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-15T21:29:36.464375] [DEBUG] [LOCAL ] SJM: Trimmed 72254 records to 50137 (keeping 200 days of data) [2025-10-15T21:29:36.722176] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T21:29:36.845149] [DEBUG] [LOCAL ] SJM: Primary data saved (50137 records). [2025-10-15T21:29:36.845291] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-15T21:29:36.846306] [INFO ] [MAIN ] Update Progress: 1918/2369 symbols completed. SJM took 28.0s. Estimated remaining: 1h 3m 23s. Rate: 7.1 symbols/min [2025-10-15T21:29:36.913994] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-15T21:29:37.201803] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T21:29:37.714055] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-15T21:29:38.301952] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T21:29:38.513984] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-15T21:29:38.925093] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T21:29:39.314004] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-15T21:29:39.900884] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T21:29:40.114005] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-15T21:29:40.461592] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T21:29:40.913995] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-15T21:29:41.424980] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T21:29:41.713969] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-15T21:29:41.885804] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T21:29:42.514034] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-15T21:29:43.194680] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T21:29:43.313955] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-15T21:29:43.607280] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T21:29:44.114119] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-15T21:29:44.803956] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T21:29:44.814040] [INFO ] [REMOTE ] SKE: Full fetch complete (51849 records). [2025-10-15T21:29:44.814338] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-15T21:29:45.288143] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-15T21:29:45.289166] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T21:29:45.289415] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-15T21:29:45.296554] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-15T21:29:45.296699] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-15T21:29:45.297490] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-15T21:29:45.300070] [DEBUG] [LOCAL ] SKE: Trimmed 51849 records to 36903 (keeping 200 days of data) [2025-10-15T21:29:45.510000] [DEBUG] [LOCAL ] SKE: Primary data saved (36903 records). [2025-10-15T21:29:45.510138] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-15T21:29:45.510217] [INFO ] [MAIN ] Update Progress: 1919/2369 symbols completed. SKE took 28.9s. Estimated remaining: 1h 3m 14s. Rate: 7.1 symbols/min [2025-10-15T21:29:46.283583] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T21:29:46.286719] [INFO ] [REMOTE ] SJT: Full fetch complete (32010 records). [2025-10-15T21:29:46.286796] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-15T21:29:46.649403] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-15T21:29:46.649476] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-15T21:29:46.650122] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-15T21:29:46.650182] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-15T21:29:46.650937] [DEBUG] [LOCAL ] SJT: Trimmed 32010 records to 22559 (keeping 200 days of data) [2025-10-15T21:29:46.770964] [DEBUG] [LOCAL ] SJT: Primary data saved (22559 records). [2025-10-15T21:29:46.771087] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-15T21:29:46.771163] [INFO ] [MAIN ] Update Progress: 1920/2369 symbols completed. SJT took 30.5s. Estimated remaining: 1h 3m 4s. Rate: 7.1 symbols/min [2025-10-15T21:29:47.407456] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:47.428385] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:47.457903] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:47.476429] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:29:47.484168] [DEBUG] [LOCAL ] SKIL: Loaded 6572 existing records from primary storage. [2025-10-15T21:29:47.484670] [INFO ] [MAIN ] SKIL: Loaded 6572 existing records. [2025-10-15T21:29:47.558748] [DEBUG] [LOCAL ] SKLZ: Loaded 11578 existing records from primary storage. [2025-10-15T21:29:47.581403] [INFO ] [MAIN ] SKLZ: Loaded 11578 existing records. [2025-10-15T21:29:47.790034] [DEBUG] [LOCAL ] SKT: Loaded 42544 existing records from primary storage. [2025-10-15T21:29:47.840113] [DEBUG] [LOCAL ] SKM: Loaded 35146 existing records from primary storage. [2025-10-15T21:29:47.805007] [INFO ] [MAIN ] SKT: Loaded 42544 existing records. [2025-10-15T21:29:47.867132] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:47.872303] [INFO ] [MAIN ] SKM: Loaded 35146 existing records. [2025-10-15T21:29:47.917484] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-15T21:29:47.982413] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-15T21:29:47.982290] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:48.007322] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-15T21:29:48.023066] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-15T21:29:48.023236] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-15T21:29:48.007489] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-15T21:29:48.062526] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-15T21:29:48.097818] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-15T21:29:48.492587] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:48.550811] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-15T21:29:48.614944] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-15T21:29:48.578639] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:29:48.648377] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-15T21:29:48.648495] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-15T21:29:48.726566] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-15T21:29:48.790681] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-15T21:29:48.879320] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-15T21:29:48.922312] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-15T21:29:49.260161] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:49.293046] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-15T21:29:49.389208] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:49.412832] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-15T21:29:49.745272] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:49.764196] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-15T21:29:49.794598] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:29:49.795176] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-15T21:29:50.181908] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T21:29:50.184055] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-15T21:29:50.684941] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:29:50.689416] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-15T21:29:50.760996] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T21:29:50.766760] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-15T21:29:50.935522] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T21:29:51.318304] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-15T21:29:51.319210] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T21:29:51.357890] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T21:29:51.641987] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T21:29:52.084545] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T21:29:52.113953] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-15T21:29:52.835220] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T21:29:52.914059] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-15T21:29:53.713983] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-15T21:29:54.057948] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T21:29:54.414134] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T21:29:54.513986] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-15T21:29:55.314042] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-15T21:29:56.114042] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-15T21:29:56.137349] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T21:29:56.616863] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T21:29:56.703669] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T21:29:56.914028] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-15T21:29:57.670936] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T21:29:57.713959] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-15T21:29:58.499805] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T21:29:58.513953] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-15T21:29:59.082382] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T21:29:59.313998] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-15T21:30:00.114020] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-15T21:30:00.845010] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T21:30:00.860046] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T21:30:00.913987] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-15T21:30:01.621872] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:30:01.623602] [INFO ] [REMOTE ] SKIL: Full fetch complete (10240 records). [2025-10-15T21:30:01.623698] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-15T21:30:01.722024] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-15T21:30:01.998709] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-15T21:30:01.998799] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-15T21:30:01.999142] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-15T21:30:01.999227] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-15T21:30:01.999765] [DEBUG] [LOCAL ] SKIL: Trimmed 10240 records to 6591 (keeping 200 days of data) [2025-10-15T21:30:02.040404] [DEBUG] [LOCAL ] SKIL: Primary data saved (6591 records). [2025-10-15T21:30:02.040541] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-15T21:30:02.040627] [INFO ] [MAIN ] Update Progress: 1921/2369 symbols completed. SKIL took 15.3s. Estimated remaining: 1h 2m 57s. Rate: 7.1 symbols/min [2025-10-15T21:30:02.210290] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:02.247236] [DEBUG] [LOCAL ] SKY: Loaded 38409 existing records from primary storage. [2025-10-15T21:30:02.247554] [INFO ] [MAIN ] SKY: Loaded 38409 existing records. [2025-10-15T21:30:02.426355] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:30:02.426571] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-15T21:30:02.426619] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-15T21:30:02.427281] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-15T21:30:02.427354] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-15T21:30:02.520988] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-15T21:30:02.721228] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T21:30:02.832665] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:30:03.314059] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-15T21:30:04.004664] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T21:30:04.113954] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-15T21:30:04.736080] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T21:30:04.914019] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-15T21:30:05.714010] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-15T21:30:05.779758] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:30:06.514007] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-15T21:30:06.717214] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T21:30:07.314054] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-15T21:30:07.395334] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T21:30:08.044893] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T21:30:08.080397] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T21:30:08.113952] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-15T21:30:08.913997] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-15T21:30:09.047078] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T21:30:09.714014] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-15T21:30:10.278128] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T21:30:10.501740] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T21:30:10.514002] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-15T21:30:11.314010] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-15T21:30:11.857285] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T21:30:12.113983] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-15T21:30:12.172247] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T21:30:12.913996] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-15T21:30:13.439883] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T21:30:13.714051] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-15T21:30:14.122525] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T21:30:14.514006] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-15T21:30:14.707026] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T21:30:15.314052] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-15T21:30:15.911212] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T21:30:16.114006] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-15T21:30:16.670889] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T21:30:16.913993] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-15T21:30:17.161804] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T21:30:17.714036] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-15T21:30:18.464025] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T21:30:18.513956] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-15T21:30:18.648488] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T21:30:19.314010] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-15T21:30:19.733623] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T21:30:20.113977] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-15T21:30:20.536072] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T21:30:20.540571] [INFO ] [REMOTE ] SKM: Full fetch complete (48898 records). [2025-10-15T21:30:20.540681] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-15T21:30:20.921145] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-15T21:30:20.942636] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-15T21:30:20.943867] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-15T21:30:20.944820] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-15T21:30:20.944887] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-15T21:30:20.946311] [DEBUG] [LOCAL ] SKM: Trimmed 48898 records to 35250 (keeping 200 days of data) [2025-10-15T21:30:21.163974] [DEBUG] [LOCAL ] SKM: Primary data saved (35250 records). [2025-10-15T21:30:21.164137] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-15T21:30:21.164690] [INFO ] [MAIN ] Update Progress: 1922/2369 symbols completed. SKM took 34.4s. Estimated remaining: 1h 2m 52s. Rate: 7.1 symbols/min [2025-10-15T21:30:21.343454] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:21.369983] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T21:30:21.391539] [DEBUG] [LOCAL ] SKYH: Loaded 16330 existing records from primary storage. [2025-10-15T21:30:21.391848] [INFO ] [MAIN ] SKYH: Loaded 16330 existing records. [2025-10-15T21:30:21.574117] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:30:21.574294] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-15T21:30:21.574340] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-15T21:30:21.574867] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-15T21:30:21.574925] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-15T21:30:21.719136] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-15T21:30:21.947566] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:30:21.961277] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T21:30:22.514052] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-15T21:30:23.154315] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T21:30:23.159257] [INFO ] [REMOTE ] SKT: Full fetch complete (60461 records). [2025-10-15T21:30:23.159357] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-15T21:30:23.335829] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-15T21:30:23.553927] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-15T21:30:23.554035] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-15T21:30:23.555117] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-15T21:30:23.555182] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-15T21:30:23.556459] [DEBUG] [LOCAL ] SKT: Trimmed 60461 records to 42516 (keeping 200 days of data) [2025-10-15T21:30:23.812259] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T21:30:23.843396] [DEBUG] [LOCAL ] SKT: Primary data saved (42516 records). [2025-10-15T21:30:23.843515] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-15T21:30:23.843590] [INFO ] [MAIN ] Update Progress: 1923/2369 symbols completed. SKT took 37.1s. Estimated remaining: 1h 2m 42s. Rate: 7.1 symbols/min [2025-10-15T21:30:24.017281] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:24.073033] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-15T21:30:24.073444] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-15T21:30:24.120237] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-15T21:30:24.272938] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:30:24.273135] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-15T21:30:24.273182] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-15T21:30:24.274463] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-15T21:30:24.274521] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-15T21:30:24.571077] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T21:30:24.651053] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:30:24.913998] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-15T21:30:25.607066] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:30:25.713963] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-15T21:30:25.732395] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T21:30:26.513996] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-15T21:30:27.110663] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T21:30:27.314023] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-15T21:30:28.113990] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-15T21:30:28.131862] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T21:30:28.698975] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T21:30:28.857379] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T21:30:28.913974] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-15T21:30:29.713975] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-15T21:30:29.879127] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T21:30:30.457621] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:30:30.459377] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18191 records). [2025-10-15T21:30:30.459470] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-15T21:30:30.520018] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-15T21:30:30.836277] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-15T21:30:30.836356] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-15T21:30:30.836816] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-15T21:30:30.836879] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-15T21:30:30.837439] [DEBUG] [LOCAL ] SKLZ: Trimmed 18191 records to 11597 (keeping 200 days of data) [2025-10-15T21:30:30.902670] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11597 records). [2025-10-15T21:30:30.902821] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-15T21:30:30.902949] [INFO ] [MAIN ] Update Progress: 1924/2369 symbols completed. SKLZ took 44.1s. Estimated remaining: 1h 2m 33s. Rate: 7.1 symbols/min [2025-10-15T21:30:31.069768] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:31.107356] [DEBUG] [LOCAL ] SLF: Loaded 38782 existing records from primary storage. [2025-10-15T21:30:31.107624] [INFO ] [MAIN ] SLF: Loaded 38782 existing records. [2025-10-15T21:30:31.288997] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:30:31.289223] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-15T21:30:31.289270] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-15T21:30:31.290275] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-15T21:30:31.290333] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-15T21:30:31.320363] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-15T21:30:31.641545] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:30:32.113966] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-15T21:30:32.504552] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T21:30:32.683424] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-15T21:30:32.914072] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-15T21:30:33.200360] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T21:30:33.714085] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-15T21:30:34.239183] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T21:30:34.514074] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-15T21:30:34.648015] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T21:30:35.314012] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-15T21:30:36.050826] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T21:30:36.113970] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-15T21:30:36.279817] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T21:30:36.914087] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-15T21:30:37.645035] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T21:30:37.713954] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-15T21:30:38.463544] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T21:30:38.514000] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-15T21:30:39.168680] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T21:30:39.173458] [INFO ] [REMOTE ] SKY: Full fetch complete (54201 records). [2025-10-15T21:30:39.173553] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-15T21:30:39.319118] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-15T21:30:39.561623] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-15T21:30:39.561725] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-15T21:30:39.562610] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-15T21:30:39.562676] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-15T21:30:39.563764] [DEBUG] [LOCAL ] SKY: Trimmed 54201 records to 38486 (keeping 200 days of data) [2025-10-15T21:30:39.790061] [DEBUG] [LOCAL ] SKY: Primary data saved (38486 records). [2025-10-15T21:30:39.790199] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-15T21:30:39.790290] [INFO ] [MAIN ] Update Progress: 1925/2369 symbols completed. SKY took 37.7s. Estimated remaining: 1h 2m 25s. Rate: 7.1 symbols/min [2025-10-15T21:30:39.966992] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:40.006930] [DEBUG] [LOCAL ] SLG: Loaded 45469 existing records from primary storage. [2025-10-15T21:30:40.007385] [INFO ] [MAIN ] SLG: Loaded 45469 existing records. [2025-10-15T21:30:40.119800] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-15T21:30:40.183000] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T21:30:40.235086] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:30:40.235273] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-15T21:30:40.235333] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-15T21:30:40.236625] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-15T21:30:40.236715] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-15T21:30:40.593705] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:30:40.913960] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-15T21:30:41.076593] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T21:30:41.139925] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T21:30:41.713988] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-15T21:30:42.426824] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T21:30:42.514030] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-15T21:30:43.173407] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T21:30:43.313971] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-15T21:30:43.483548] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T21:30:44.114004] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-15T21:30:44.822580] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T21:30:44.913970] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-15T21:30:45.713975] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-15T21:30:46.131336] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T21:30:46.379775] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:30:46.513970] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-15T21:30:47.313990] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-15T21:30:47.371607] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T21:30:47.900305] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T21:30:48.114039] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-15T21:30:48.913999] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-15T21:30:49.583252] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-15T21:30:49.617616] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T21:30:49.713985] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-15T21:30:49.881067] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T21:30:50.513997] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-15T21:30:51.313985] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-15T21:30:51.344042] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T21:30:51.993757] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T21:30:52.114036] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-15T21:30:52.914084] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-15T21:30:52.983008] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:30:53.665499] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T21:30:53.713968] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-15T21:30:54.464061] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T21:30:54.514022] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-15T21:30:55.132112] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T21:30:55.314027] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-15T21:30:56.114012] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-15T21:30:56.509763] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T21:30:56.514326] [INFO ] [REMOTE ] SLF: Full fetch complete (56401 records). [2025-10-15T21:30:56.514428] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-15T21:30:56.655400] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-15T21:30:56.917526] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-15T21:30:56.935440] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-15T21:30:56.935506] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-15T21:30:56.936424] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-15T21:30:56.936485] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-15T21:30:56.937800] [DEBUG] [LOCAL ] SLF: Trimmed 56401 records to 38743 (keeping 200 days of data) [2025-10-15T21:30:57.175393] [DEBUG] [LOCAL ] SLF: Primary data saved (38743 records). [2025-10-15T21:30:57.175551] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-15T21:30:57.175639] [INFO ] [MAIN ] Update Progress: 1926/2369 symbols completed. SLF took 26.3s. Estimated remaining: 1h 2m 18s. Rate: 7.1 symbols/min [2025-10-15T21:30:57.345357] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:57.382126] [DEBUG] [LOCAL ] SLGN: Loaded 40779 existing records from primary storage. [2025-10-15T21:30:57.382395] [INFO ] [MAIN ] SLGN: Loaded 40779 existing records. [2025-10-15T21:30:57.561064] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:30:57.561300] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-15T21:30:57.561451] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-15T21:30:57.562505] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-15T21:30:57.562565] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-15T21:30:57.714605] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-15T21:30:57.938243] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:30:57.967186] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:30:58.513986] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-15T21:30:58.680330] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T21:30:58.682969] [INFO ] [REMOTE ] SKYH: Full fetch complete (22461 records). [2025-10-15T21:30:58.683043] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-15T21:30:59.086039] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-15T21:30:59.086209] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-15T21:30:59.086896] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-15T21:30:59.087004] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-15T21:30:59.087918] [DEBUG] [LOCAL ] SKYH: Trimmed 22461 records to 16201 (keeping 200 days of data) [2025-10-15T21:30:59.212011] [DEBUG] [LOCAL ] SKYH: Primary data saved (16201 records). [2025-10-15T21:30:59.212741] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-15T21:30:59.213980] [INFO ] [MAIN ] Update Progress: 1927/2369 symbols completed. SKYH took 38.0s. Estimated remaining: 1h 2m 8s. Rate: 7.1 symbols/min [2025-10-15T21:30:59.213798] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-15T21:30:59.323973] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-15T21:30:59.395321] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:30:59.395492] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-15T21:30:59.395548] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-15T21:30:59.395678] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-15T21:30:59.395743] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-15T21:30:59.395809] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-15T21:30:59.395845] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-15T21:30:59.747631] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:00.020209] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T21:31:00.113978] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-15T21:31:00.534289] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T21:31:00.604798] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T21:31:00.913999] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-15T21:31:01.714020] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-15T21:31:02.513998] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-15T21:31:03.016449] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-15T21:31:03.048570] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-15T21:31:03.155848] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T21:31:03.314014] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-15T21:31:04.114007] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-15T21:31:04.450367] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T21:31:04.921485] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-15T21:31:04.931459] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T21:31:05.714025] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-15T21:31:06.378448] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T21:31:06.514011] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-15T21:31:07.191312] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T21:31:07.314019] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-15T21:31:07.709905] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T21:31:08.114001] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-15T21:31:08.914009] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-15T21:31:09.358545] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T21:31:09.365095] [INFO ] [REMOTE ] SLB: Full fetch complete (77877 records). [2025-10-15T21:31:09.365264] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-15T21:31:09.732777] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-15T21:31:09.811448] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-15T21:31:09.811605] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-15T21:31:09.813920] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-15T21:31:09.814099] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-15T21:31:09.841294] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T21:31:09.840268] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 53697 (keeping 200 days of data) [2025-10-15T21:31:10.157791] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T21:31:10.201550] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-15T21:31:10.201729] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-15T21:31:10.201842] [INFO ] [MAIN ] Update Progress: 1928/2369 symbols completed. SLB took 46.4s. Estimated remaining: 1h 2m 1s. Rate: 7.1 symbols/min [2025-10-15T21:31:10.377679] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:10.417051] [DEBUG] [LOCAL ] SLQT: Loaded 43549 existing records from primary storage. [2025-10-15T21:31:10.417453] [INFO ] [MAIN ] SLQT: Loaded 43549 existing records. [2025-10-15T21:31:10.515607] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-15T21:31:10.597099] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:31:10.597378] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-15T21:31:10.597435] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-15T21:31:10.608163] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-15T21:31:10.608271] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-15T21:31:10.728474] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T21:31:10.985018] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:11.314004] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-15T21:31:12.006359] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:31:12.114002] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-15T21:31:12.758318] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T21:31:12.914018] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-15T21:31:13.713974] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-15T21:31:13.896908] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T21:31:14.025516] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T21:31:14.051004] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T21:31:14.514005] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-15T21:31:15.314053] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-15T21:31:15.987280] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T21:31:16.113985] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-15T21:31:16.487242] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-15T21:31:16.877286] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T21:31:16.882702] [INFO ] [REMOTE ] SLG: Full fetch complete (65068 records). [2025-10-15T21:31:16.882822] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-15T21:31:16.919124] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-15T21:31:17.273244] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-15T21:31:17.273324] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-15T21:31:17.274317] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-15T21:31:17.274380] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-15T21:31:17.275614] [DEBUG] [LOCAL ] SLG: Trimmed 65068 records to 45584 (keeping 200 days of data) [2025-10-15T21:31:17.339553] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T21:31:17.556357] [DEBUG] [LOCAL ] SLG: Primary data saved (45584 records). [2025-10-15T21:31:17.556508] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-15T21:31:17.556601] [INFO ] [MAIN ] Update Progress: 1929/2369 symbols completed. SLG took 37.8s. Estimated remaining: 1h 1m 52s. Rate: 7.1 symbols/min [2025-10-15T21:31:17.725740] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-15T21:31:17.729341] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:17.757778] [DEBUG] [LOCAL ] SLVM: Loaded 27784 existing records from primary storage. [2025-10-15T21:31:17.758049] [INFO ] [MAIN ] SLVM: Loaded 27784 existing records. [2025-10-15T21:31:17.954003] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:31:17.954257] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-15T21:31:17.954307] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-15T21:31:17.954899] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-15T21:31:17.954967] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-15T21:31:18.062624] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T21:31:18.327105] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:18.513995] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-15T21:31:18.840947] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T21:31:19.313993] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-15T21:31:20.114047] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-15T21:31:20.468889] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T21:31:20.914029] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-15T21:31:21.578715] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T21:31:21.713970] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-15T21:31:22.187523] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T21:31:22.514053] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-15T21:31:22.969517] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T21:31:23.314053] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-15T21:31:24.117590] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-15T21:31:24.122704] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T21:31:24.861052] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T21:31:24.894459] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T21:31:24.913961] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-15T21:31:25.714006] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-15T21:31:26.059186] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T21:31:26.514038] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-15T21:31:27.208074] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T21:31:27.208791] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1039 records). [2025-10-15T21:31:27.208859] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-15T21:31:27.318942] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-15T21:31:27.426138] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T21:31:27.434937] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-15T21:31:27.435159] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:31:27.444287] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:31:27.444708] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-15T21:31:27.444789] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-15T21:31:27.445090] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-15T21:31:27.445155] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-15T21:31:27.445216] [INFO ] [MAIN ] Update Progress: 1930/2369 symbols completed. SLNZ took 28.2s. Estimated remaining: 1h 1m 44s. Rate: 7.1 symbols/min [2025-10-15T21:31:27.632397] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:27.684940] [DEBUG] [LOCAL ] SM: Loaded 52369 existing records from primary storage. [2025-10-15T21:31:27.685346] [INFO ] [MAIN ] SM: Loaded 52369 existing records. [2025-10-15T21:31:27.859020] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:31:27.859243] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-15T21:31:27.859289] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-15T21:31:27.860197] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-15T21:31:27.860253] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-15T21:31:28.120045] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-15T21:31:28.207472] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:28.832970] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T21:31:28.840508] [INFO ] [REMOTE ] SLGN: Full fetch complete (59172 records). [2025-10-15T21:31:28.840791] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-15T21:31:28.919281] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-15T21:31:29.438859] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-15T21:31:29.439042] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-15T21:31:29.440493] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-15T21:31:29.446221] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-15T21:31:29.458334] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T21:31:29.466014] [DEBUG] [LOCAL ] SLGN: Trimmed 59172 records to 40857 (keeping 200 days of data) [2025-10-15T21:31:29.718955] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-15T21:31:29.747038] [DEBUG] [LOCAL ] SLGN: Primary data saved (40857 records). [2025-10-15T21:31:29.747231] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-15T21:31:29.747363] [INFO ] [MAIN ] Update Progress: 1931/2369 symbols completed. SLGN took 32.6s. Estimated remaining: 1h 1m 34s. Rate: 7.1 symbols/min [2025-10-15T21:31:29.945612] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:29.945925] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-15T21:31:29.945995] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-15T21:31:29.946133] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-15T21:31:29.946178] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-15T21:31:29.946220] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-15T21:31:29.946253] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-15T21:31:30.339830] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:30.513997] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-15T21:31:30.618544] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T21:31:31.048559] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:31:31.314041] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-15T21:31:31.523994] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:31:31.524306] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-15T21:31:31.524393] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:31:31.524444] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-15T21:31:31.524477] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:31:31.524514] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-15T21:31:31.524566] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-15T21:31:31.524599] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-15T21:31:31.524638] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-15T21:31:31.524729] [INFO ] [MAIN ] Update Progress: 1932/2369 symbols completed. SMA took 1.8s. Estimated remaining: 1h 1m 24s. Rate: 7.1 symbols/min [2025-10-15T21:31:31.702706] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:31.711307] [DEBUG] [LOCAL ] SMBK: Loaded 8212 existing records from primary storage. [2025-10-15T21:31:31.711485] [INFO ] [MAIN ] SMBK: Loaded 8212 existing records. [2025-10-15T21:31:31.919548] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:31:31.919870] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-15T21:31:31.919921] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-15T21:31:31.920205] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-15T21:31:31.920263] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-15T21:31:32.103789] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:31:32.120329] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-15T21:31:32.338092] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:32.914063] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-15T21:31:33.452440] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-15T21:31:33.713988] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-15T21:31:34.431564] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T21:31:34.514005] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-15T21:31:34.580682] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T21:31:35.313978] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-15T21:31:35.554692] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T21:31:36.114007] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-15T21:31:36.913974] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-15T21:31:37.012900] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T21:31:37.390514] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T21:31:37.666736] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T21:31:37.713985] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-15T21:31:38.514001] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-15T21:31:39.313975] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-15T21:31:39.480280] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T21:31:39.635924] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T21:31:40.010921] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T21:31:40.113976] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-15T21:31:40.914012] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-15T21:31:41.281910] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T21:31:41.666602] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T21:31:41.713996] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-15T21:31:42.494421] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T21:31:42.513973] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-15T21:31:43.233090] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T21:31:43.313981] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-15T21:31:44.074883] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T21:31:44.113969] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-15T21:31:44.893182] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T21:31:44.913976] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-15T21:31:45.714048] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-15T21:31:46.487123] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T21:31:46.513957] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-15T21:31:46.597109] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T21:31:47.290613] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T21:31:47.313951] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-15T21:31:47.953040] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T21:31:47.954604] [INFO ] [REMOTE ] SMBK: Full fetch complete (11785 records). [2025-10-15T21:31:47.954712] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-15T21:31:48.124717] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-15T21:31:48.327085] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-15T21:31:48.327161] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-15T21:31:48.327459] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-15T21:31:48.327499] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-15T21:31:48.327966] [DEBUG] [LOCAL ] SMBK: Trimmed 11785 records to 8201 (keeping 200 days of data) [2025-10-15T21:31:48.378741] [DEBUG] [LOCAL ] SMBK: Primary data saved (8201 records). [2025-10-15T21:31:48.378929] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-15T21:31:48.379056] [INFO ] [MAIN ] Update Progress: 1933/2369 symbols completed. SMBK took 16.9s. Estimated remaining: 1h 1m 17s. Rate: 7.1 symbols/min [2025-10-15T21:31:48.548435] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:48.559437] [DEBUG] [LOCAL ] SMC: Loaded 11268 existing records from primary storage. [2025-10-15T21:31:48.559634] [INFO ] [MAIN ] SMC: Loaded 11268 existing records. [2025-10-15T21:31:48.771940] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:31:48.772167] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-15T21:31:48.772214] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-15T21:31:48.772527] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-15T21:31:48.772583] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-15T21:31:48.919324] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-15T21:31:49.125812] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:49.713964] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-15T21:31:49.979154] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T21:31:50.053607] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T21:31:50.514016] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-15T21:31:50.544089] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T21:31:51.313973] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-15T21:31:51.793200] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T21:31:52.113998] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-15T21:31:52.905119] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T21:31:52.916265] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-15T21:31:52.927382] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T21:31:53.714071] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-15T21:31:54.146601] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T21:31:54.150577] [INFO ] [REMOTE ] SLVM: Full fetch complete (40195 records). [2025-10-15T21:31:54.150703] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-15T21:31:54.323379] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T21:31:54.527736] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-15T21:31:54.544722] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-15T21:31:54.544808] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-15T21:31:54.545723] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-15T21:31:54.545785] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-15T21:31:54.546663] [DEBUG] [LOCAL ] SLVM: Trimmed 40195 records to 27812 (keeping 200 days of data) [2025-10-15T21:31:54.715776] [DEBUG] [LOCAL ] SLVM: Primary data saved (27812 records). [2025-10-15T21:31:54.715911] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-15T21:31:54.715991] [INFO ] [MAIN ] Update Progress: 1934/2369 symbols completed. SLVM took 37.2s. Estimated remaining: 1h 1m 9s. Rate: 7.1 symbols/min [2025-10-15T21:31:54.882702] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:31:54.925237] [DEBUG] [LOCAL ] SMFG: Loaded 48339 existing records from primary storage. [2025-10-15T21:31:54.925577] [INFO ] [MAIN ] SMFG: Loaded 48339 existing records. [2025-10-15T21:31:55.101874] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:31:55.102605] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-15T21:31:55.102701] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-15T21:31:55.103526] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-15T21:31:55.103585] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-15T21:31:55.320587] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-15T21:31:55.459895] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:31:55.469559] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T21:31:56.114031] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-15T21:31:56.914060] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-15T21:31:57.196783] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T21:31:57.621072] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T21:31:57.714029] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-15T21:31:57.856210] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T21:31:58.513996] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-15T21:31:59.250278] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T21:31:59.314034] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-15T21:31:59.442823] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T21:32:00.114069] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-15T21:32:00.903775] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T21:32:00.913938] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-15T21:32:01.153873] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T21:32:01.710017] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T21:32:01.713948] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-15T21:32:02.520534] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-15T21:32:02.522540] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T21:32:03.314011] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-15T21:32:03.840016] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T21:32:03.845326] [INFO ] [REMOTE ] SLQT: Full fetch complete (63901 records). [2025-10-15T21:32:03.845442] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-15T21:32:04.119146] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-15T21:32:04.257570] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-15T21:32:04.257678] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-15T21:32:04.258860] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-15T21:32:04.258926] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-15T21:32:04.260206] [DEBUG] [LOCAL ] SLQT: Trimmed 63901 records to 43522 (keeping 200 days of data) [2025-10-15T21:32:04.498554] [DEBUG] [LOCAL ] SLQT: Primary data saved (43522 records). [2025-10-15T21:32:04.498706] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-15T21:32:04.498797] [INFO ] [MAIN ] Update Progress: 1935/2369 symbols completed. SLQT took 54.3s. Estimated remaining: 1h 1m 0s. Rate: 7.1 symbols/min [2025-10-15T21:32:04.673207] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:04.711370] [DEBUG] [LOCAL ] SMG: Loaded 43417 existing records from primary storage. [2025-10-15T21:32:04.711674] [INFO ] [MAIN ] SMG: Loaded 43417 existing records. [2025-10-15T21:32:04.893542] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:32:04.893841] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-15T21:32:04.893889] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-15T21:32:04.894615] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-15T21:32:04.894704] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-15T21:32:04.925944] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-15T21:32:05.020126] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T21:32:05.283032] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:05.316502] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T21:32:05.714012] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-15T21:32:06.203699] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T21:32:06.461094] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:32:06.462924] [INFO ] [REMOTE ] SMC: Full fetch complete (16577 records). [2025-10-15T21:32:06.462998] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-15T21:32:06.522626] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-15T21:32:06.815450] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-15T21:32:06.815524] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-15T21:32:06.815880] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-15T21:32:06.815942] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-15T21:32:06.816409] [DEBUG] [LOCAL ] SMC: Trimmed 16577 records to 11266 (keeping 200 days of data) [2025-10-15T21:32:06.884907] [DEBUG] [LOCAL ] SMC: Primary data saved (11266 records). [2025-10-15T21:32:06.885122] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-15T21:32:06.885210] [INFO ] [MAIN ] Update Progress: 1936/2369 symbols completed. SMC took 18.5s. Estimated remaining: 1h 0m 51s. Rate: 7.1 symbols/min [2025-10-15T21:32:07.049312] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:07.061742] [DEBUG] [LOCAL ] SMHI: Loaded 13133 existing records from primary storage. [2025-10-15T21:32:07.061949] [INFO ] [MAIN ] SMHI: Loaded 13133 existing records. [2025-10-15T21:32:07.232067] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:32:07.232318] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-15T21:32:07.232364] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-15T21:32:07.232843] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-15T21:32:07.232901] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-15T21:32:07.319197] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-15T21:32:07.580199] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:08.051458] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T21:32:08.113953] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-15T21:32:08.914013] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-15T21:32:09.113959] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T21:32:09.332812] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T21:32:09.713966] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-15T21:32:10.187263] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:32:10.513998] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-15T21:32:11.313976] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-15T21:32:11.552431] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T21:32:11.981350] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T21:32:12.113971] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-15T21:32:12.380291] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T21:32:12.914053] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-15T21:32:13.620638] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:32:13.713990] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-15T21:32:14.514060] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-15T21:32:14.643682] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T21:32:15.313989] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-15T21:32:15.434225] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T21:32:15.474368] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T21:32:16.113999] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-15T21:32:16.914014] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-15T21:32:17.029055] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T21:32:17.036536] [INFO ] [REMOTE ] SM: Full fetch complete (75793 records). [2025-10-15T21:32:17.036779] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-15T21:32:17.180169] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T21:32:17.466153] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-15T21:32:17.466237] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-15T21:32:17.467336] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-15T21:32:17.467401] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-15T21:32:17.468905] [DEBUG] [LOCAL ] SM: Trimmed 75793 records to 52378 (keeping 200 days of data) [2025-10-15T21:32:17.713997] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-15T21:32:17.788020] [DEBUG] [LOCAL ] SM: Primary data saved (52378 records). [2025-10-15T21:32:17.788158] [INFO ] [MAIN ] SM: Full history saved. [2025-10-15T21:32:17.788614] [INFO ] [MAIN ] Update Progress: 1937/2369 symbols completed. SM took 50.3s. Estimated remaining: 1h 0m 43s. Rate: 7.1 symbols/min [2025-10-15T21:32:17.960435] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:17.979507] [DEBUG] [LOCAL ] SMP: Loaded 18889 existing records from primary storage. [2025-10-15T21:32:17.979883] [INFO ] [MAIN ] SMP: Loaded 18889 existing records. [2025-10-15T21:32:18.171116] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:32:18.171395] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-15T21:32:18.171444] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-15T21:32:18.172031] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-15T21:32:18.172090] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-15T21:32:18.513963] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-15T21:32:18.535709] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:18.749842] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T21:32:18.774032] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T21:32:19.314006] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-15T21:32:20.114057] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-15T21:32:20.323167] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T21:32:20.657100] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T21:32:20.878675] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T21:32:20.913997] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-15T21:32:21.713988] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-15T21:32:22.512628] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T21:32:22.515995] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-15T21:32:23.313979] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-15T21:32:23.442053] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T21:32:23.442911] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T21:32:23.927925] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T21:32:24.114037] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-15T21:32:24.914035] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-15T21:32:24.968974] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T21:32:25.714070] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-15T21:32:26.223154] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T21:32:26.513990] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-15T21:32:26.657788] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T21:32:27.314017] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-15T21:32:28.090343] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T21:32:28.113970] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-15T21:32:28.135316] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T21:32:28.914064] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-15T21:32:29.713961] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-15T21:32:29.878390] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T21:32:30.089174] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T21:32:30.206028] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T21:32:30.514050] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-15T21:32:31.314014] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-15T21:32:31.648540] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T21:32:32.113986] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-15T21:32:32.885252] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:32:32.913952] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-15T21:32:33.178047] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T21:32:33.714052] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-15T21:32:34.437701] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T21:32:34.457321] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T21:32:34.513961] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-15T21:32:35.314022] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-15T21:32:35.512774] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T21:32:36.114009] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-15T21:32:36.667820] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T21:32:36.672777] [INFO ] [REMOTE ] SMG: Full fetch complete (62998 records). [2025-10-15T21:32:36.672899] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-15T21:32:36.919196] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-15T21:32:37.056513] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-15T21:32:37.056595] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-15T21:32:37.057586] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-15T21:32:37.057673] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-15T21:32:37.059008] [DEBUG] [LOCAL ] SMG: Trimmed 62998 records to 43369 (keeping 200 days of data) [2025-10-15T21:32:37.326322] [DEBUG] [LOCAL ] SMG: Primary data saved (43369 records). [2025-10-15T21:32:37.326464] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-15T21:32:37.326609] [INFO ] [MAIN ] Update Progress: 1938/2369 symbols completed. SMG took 32.8s. Estimated remaining: 1h 0m 37s. Rate: 7.1 symbols/min [2025-10-15T21:32:37.499209] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:37.553465] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-15T21:32:37.553810] [INFO ] [MAIN ] SMR: Loaded 53799 existing records. [2025-10-15T21:32:37.715332] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-15T21:32:37.737313] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:32:37.738468] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-15T21:32:37.738631] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-15T21:32:37.739864] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-15T21:32:37.739923] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-15T21:32:37.830770] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T21:32:38.000937] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T21:32:38.163328] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:38.514055] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-15T21:32:38.829015] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T21:32:39.314129] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-15T21:32:39.966258] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T21:32:39.968812] [INFO ] [REMOTE ] SMHI: Full fetch complete (21857 records). [2025-10-15T21:32:39.969094] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-15T21:32:40.123005] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-15T21:32:40.357154] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-15T21:32:40.357229] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-15T21:32:40.357698] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-15T21:32:40.357758] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-15T21:32:40.358333] [DEBUG] [LOCAL ] SMHI: Trimmed 21857 records to 13111 (keeping 200 days of data) [2025-10-15T21:32:40.428688] [DEBUG] [LOCAL ] SMHI: Primary data saved (13111 records). [2025-10-15T21:32:40.428820] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-15T21:32:40.428899] [INFO ] [MAIN ] Update Progress: 1939/2369 symbols completed. SMHI took 33.5s. Estimated remaining: 1h 0m 27s. Rate: 7.1 symbols/min [2025-10-15T21:32:40.593470] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:40.634699] [DEBUG] [LOCAL ] SMRT: Loaded 43957 existing records from primary storage. [2025-10-15T21:32:40.635020] [INFO ] [MAIN ] SMRT: Loaded 43957 existing records. [2025-10-15T21:32:40.812797] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:32:40.813012] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-15T21:32:40.813059] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-15T21:32:40.813777] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-15T21:32:40.813835] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-15T21:32:40.914487] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-15T21:32:41.183637] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:41.225622] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-15T21:32:41.714030] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-15T21:32:41.874573] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T21:32:41.898010] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T21:32:42.514028] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-15T21:32:42.902013] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T21:32:43.314084] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-15T21:32:43.377819] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T21:32:43.380845] [INFO ] [REMOTE ] SMP: Full fetch complete (26312 records). [2025-10-15T21:32:43.380934] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-15T21:32:43.794589] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-15T21:32:43.794702] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-15T21:32:43.795460] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-15T21:32:43.795550] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-15T21:32:43.796467] [DEBUG] [LOCAL ] SMP: Trimmed 26312 records to 18828 (keeping 200 days of data) [2025-10-15T21:32:43.917499] [DEBUG] [LOCAL ] SMP: Primary data saved (18828 records). [2025-10-15T21:32:43.917712] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-15T21:32:43.917805] [INFO ] [MAIN ] Update Progress: 1940/2369 symbols completed. SMP took 26.1s. Estimated remaining: 1h 0m 18s. Rate: 7.1 symbols/min [2025-10-15T21:32:44.091713] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:44.091961] [DEBUG] [LOCAL ] SMWB: No existing data file found in primary storage. [2025-10-15T21:32:44.092008] [WARN ] [MAIN ] SMWB: No existing data found, performing full refresh instead. [2025-10-15T21:32:44.092124] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-15T21:32:44.092165] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-15T21:32:44.092205] [DEBUG] [LOCAL ] SMWB: No primary data file found to delete. [2025-10-15T21:32:44.092237] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-15T21:32:44.119215] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-15T21:32:44.510972] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:44.670955] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T21:32:44.914018] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-15T21:32:45.714054] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-15T21:32:46.315855] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T21:32:46.441233] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-15T21:32:46.513983] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-15T21:32:47.183228] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T21:32:47.189763] [INFO ] [REMOTE ] SMFG: Full fetch complete (69339 records). [2025-10-15T21:32:47.189879] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-15T21:32:47.319080] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-15T21:32:47.587722] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-15T21:32:47.587836] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-15T21:32:47.589075] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-15T21:32:47.589164] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-15T21:32:47.614476] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T21:32:47.623615] [DEBUG] [LOCAL ] SMFG: Trimmed 69339 records to 48360 (keeping 200 days of data) [2025-10-15T21:32:47.927337] [DEBUG] [LOCAL ] SMFG: Primary data saved (48360 records). [2025-10-15T21:32:47.927521] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-15T21:32:47.927684] [INFO ] [MAIN ] Update Progress: 1941/2369 symbols completed. SMFG took 53.2s. Estimated remaining: 1h 0m 8s. Rate: 7.1 symbols/min [2025-10-15T21:32:48.106916] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:32:48.114013] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-15T21:32:48.153602] [DEBUG] [LOCAL ] SN: Loaded 49980 existing records from primary storage. [2025-10-15T21:32:48.153951] [INFO ] [MAIN ] SN: Loaded 49980 existing records. [2025-10-15T21:32:48.332832] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:32:48.333066] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-15T21:32:48.333115] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-15T21:32:48.333975] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-15T21:32:48.334033] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-15T21:32:48.703613] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:32:48.915213] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-15T21:32:48.918698] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T21:32:49.714049] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-15T21:32:50.505684] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:32:50.516257] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-15T21:32:50.552767] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-15T21:32:51.014128] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T21:32:51.314015] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-15T21:32:52.112902] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T21:32:52.121506] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-15T21:32:52.713914] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T21:32:52.913995] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-15T21:32:53.714070] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-15T21:32:54.246964] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T21:32:54.522783] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-15T21:32:54.548461] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T21:32:55.314041] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-15T21:32:55.356755] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T21:32:55.957862] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T21:32:56.113966] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-15T21:32:56.914069] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-15T21:32:57.516419] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T21:32:57.713973] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-15T21:32:57.841421] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-15T21:32:58.231627] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T21:32:58.514014] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-15T21:32:59.052067] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T21:32:59.314046] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-15T21:33:00.076198] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T21:33:00.113990] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-15T21:33:00.914011] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-15T21:33:01.131727] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T21:33:01.714072] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-15T21:33:01.874594] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T21:33:01.950546] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T21:33:02.514029] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-15T21:33:03.314046] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-15T21:33:03.991478] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T21:33:04.114043] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-15T21:33:04.420354] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-15T21:33:04.461822] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T21:33:04.914038] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-15T21:33:05.708130] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T21:33:05.716021] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-15T21:33:06.514047] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-15T21:33:07.314003] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-15T21:33:07.535511] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:33:07.597440] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-15T21:33:07.636787] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T21:33:07.642106] [INFO ] [REMOTE ] SMRT: Full fetch complete (62211 records). [2025-10-15T21:33:07.642256] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-15T21:33:08.023256] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-15T21:33:08.023344] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-15T21:33:08.024314] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-15T21:33:08.024376] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-15T21:33:08.025574] [DEBUG] [LOCAL ] SMRT: Trimmed 62211 records to 43964 (keeping 200 days of data) [2025-10-15T21:33:08.119768] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-15T21:33:08.280198] [DEBUG] [LOCAL ] SMRT: Primary data saved (43964 records). [2025-10-15T21:33:08.280334] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-15T21:33:08.281184] [INFO ] [MAIN ] Update Progress: 1942/2369 symbols completed. SMRT took 27.9s. Estimated remaining: 1h 0m 2s. Rate: 7.1 symbols/min [2025-10-15T21:33:08.454663] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:08.481583] [DEBUG] [LOCAL ] SNA: Loaded 25723 existing records from primary storage. [2025-10-15T21:33:08.481892] [INFO ] [MAIN ] SNA: Loaded 25723 existing records. [2025-10-15T21:33:08.675687] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:08.688784] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T21:33:08.688025] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-15T21:33:08.695687] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-15T21:33:08.696497] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-15T21:33:08.696563] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-15T21:33:08.921927] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-15T21:33:09.051104] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:33:09.714019] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-15T21:33:10.514015] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-15T21:33:10.735561] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T21:33:10.969750] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-15T21:33:10.997548] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T21:33:11.313976] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-15T21:33:11.571816] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:33:12.114044] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-15T21:33:12.914026] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-15T21:33:13.714009] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-15T21:33:13.921615] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T21:33:13.985932] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-15T21:33:14.033453] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T21:33:14.513985] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-15T21:33:14.700074] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T21:33:15.314010] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-15T21:33:16.114002] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-15T21:33:16.260279] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T21:33:16.646102] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T21:33:16.914039] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-15T21:33:17.714004] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-15T21:33:17.942089] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T21:33:18.514048] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-15T21:33:18.826590] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-15T21:33:19.313980] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-15T21:33:19.397638] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T21:33:19.946776] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T21:33:20.113968] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-15T21:33:20.914102] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-15T21:33:21.337456] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T21:33:21.713969] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-15T21:33:21.908003] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-15T21:33:21.914933] [INFO ] [REMOTE ] SMR: Full fetch complete (77977 records). [2025-10-15T21:33:21.915087] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-15T21:33:22.031278] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T21:33:22.051223] [INFO ] [REMOTE ] SMWB: Full fetch complete (49094 records). [2025-10-15T21:33:22.074416] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-15T21:33:22.518509] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-15T21:33:22.577500] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-15T21:33:22.603692] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-15T21:33:22.617337] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-15T21:33:22.617821] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-15T21:33:22.674938] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 53799 (keeping 200 days of data) [2025-10-15T21:33:22.793997] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-15T21:33:22.802765] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-15T21:33:22.803751] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-15T21:33:22.803894] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-15T21:33:22.843271] [DEBUG] [LOCAL ] SMWB: Trimmed 49094 records to 32187 (keeping 200 days of data) [2025-10-15T21:33:23.139394] [DEBUG] [LOCAL ] SMWB: Primary data saved (32187 records). [2025-10-15T21:33:23.140048] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-15T21:33:23.142584] [INFO ] [MAIN ] Update Progress: 1943/2369 symbols completed. SMWB took 39.2s. Estimated remaining: 59m 55s. Rate: 7.1 symbols/min [2025-10-15T21:33:23.417081] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T21:33:23.417198] [DEBUG] [LOCAL ] SMR: Primary data saved (53799 records). [2025-10-15T21:33:23.424136] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-15T21:33:23.457976] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:23.455193] [INFO ] [MAIN ] Update Progress: 1944/2369 symbols completed. SMR took 46.1s. Estimated remaining: 59m 45s. Rate: 7.1 symbols/min [2025-10-15T21:33:23.470258] [INFO ] [REMOTE ] SN: Full fetch complete (71552 records). [2025-10-15T21:33:23.497364] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-15T21:33:23.786948] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:23.930500] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-15T21:33:23.952465] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-15T21:33:23.968952] [DEBUG] [LOCAL ] SNDA: Loaded 4467 existing records from primary storage. [2025-10-15T21:33:24.005877] [INFO ] [MAIN ] SNDA: Loaded 4467 existing records. [2025-10-15T21:33:24.166783] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T21:33:24.226846] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-15T21:33:24.391404] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:24.419814] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-15T21:33:24.446589] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-15T21:33:24.446743] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-15T21:33:24.464966] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-15T21:33:24.477063] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-15T21:33:24.477158] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-15T21:33:24.477291] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-15T21:33:24.486072] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-15T21:33:24.520883] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:24.594881] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-15T21:33:24.600373] [DEBUG] [LOCAL ] SN: Trimmed 71552 records to 49983 (keeping 200 days of data) [2025-10-15T21:33:24.600465] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-15T21:33:24.623198] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-15T21:33:24.644301] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-15T21:33:25.170595] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:33:25.203034] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-15T21:33:25.386074] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:33:25.451232] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-15T21:33:25.595344] [DEBUG] [LOCAL ] SN: Primary data saved (49983 records). [2025-10-15T21:33:25.595563] [INFO ] [MAIN ] SN: Full history saved. [2025-10-15T21:33:25.595721] [INFO ] [MAIN ] Update Progress: 1945/2369 symbols completed. SN took 37.7s. Estimated remaining: 59m 35s. Rate: 7.1 symbols/min [2025-10-15T21:33:25.704704] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T21:33:25.748271] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-15T21:33:25.815137] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:25.860870] [DEBUG] [LOCAL ] SNDR: Loaded 41514 existing records from primary storage. [2025-10-15T21:33:25.861285] [INFO ] [MAIN ] SNDR: Loaded 41514 existing records. [2025-10-15T21:33:26.055718] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:26.056032] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-15T21:33:26.057581] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-15T21:33:26.058774] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-15T21:33:26.058837] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-15T21:33:26.383071] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T21:33:26.457289] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:33:26.513972] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-15T21:33:26.571600] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T21:33:27.264839] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T21:33:27.314002] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-15T21:33:27.972808] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T21:33:28.114054] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-15T21:33:28.703716] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T21:33:28.913969] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-15T21:33:29.644349] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-15T21:33:29.714010] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-15T21:33:30.090209] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T21:33:30.093728] [INFO ] [REMOTE ] SNA: Full fetch complete (38873 records). [2025-10-15T21:33:30.093825] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-15T21:33:30.455588] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-15T21:33:30.455693] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-15T21:33:30.456456] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-15T21:33:30.456499] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-15T21:33:30.457403] [DEBUG] [LOCAL ] SNA: Trimmed 38873 records to 25783 (keeping 200 days of data) [2025-10-15T21:33:30.516103] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-15T21:33:30.628875] [DEBUG] [LOCAL ] SNA: Primary data saved (25783 records). [2025-10-15T21:33:30.629059] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-15T21:33:30.629219] [INFO ] [MAIN ] Update Progress: 1946/2369 symbols completed. SNA took 22.3s. Estimated remaining: 59m 26s. Rate: 7.1 symbols/min [2025-10-15T21:33:30.816741] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:30.862777] [DEBUG] [LOCAL ] SNN: Loaded 44352 existing records from primary storage. [2025-10-15T21:33:30.863186] [INFO ] [MAIN ] SNN: Loaded 44352 existing records. [2025-10-15T21:33:31.155435] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:31.156017] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-15T21:33:31.156156] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-15T21:33:31.157273] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-15T21:33:31.157355] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-15T21:33:31.322544] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-15T21:33:31.400435] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T21:33:31.641052] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:33:31.916793] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-15T21:33:32.113987] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-15T21:33:32.772628] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T21:33:32.774364] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T21:33:32.913963] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-15T21:33:33.714051] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-15T21:33:34.341314] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T21:33:34.514064] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-15T21:33:35.186187] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:33:35.313977] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-15T21:33:36.114037] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-15T21:33:36.849315] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T21:33:36.914041] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-15T21:33:37.007409] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-15T21:33:37.297505] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T21:33:37.714013] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-15T21:33:38.384928] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T21:33:38.513979] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-15T21:33:39.314047] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-15T21:33:40.023021] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T21:33:40.061475] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T21:33:40.114013] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-15T21:33:40.182094] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-15T21:33:40.914053] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-15T21:33:41.713956] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-15T21:33:41.827917] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T21:33:42.514005] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-15T21:33:43.030544] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-15T21:33:43.154046] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T21:33:43.283113] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T21:33:43.313949] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-15T21:33:44.114041] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-15T21:33:44.807981] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T21:33:44.833228] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T21:33:44.913996] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-15T21:33:45.714056] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-15T21:33:46.352035] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T21:33:46.514027] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-15T21:33:47.314052] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-15T21:33:47.899383] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T21:33:47.987799] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-15T21:33:48.113963] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-15T21:33:48.147474] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T21:33:48.914008] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-15T21:33:49.494376] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T21:33:49.714033] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-15T21:33:50.154529] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T21:33:50.514019] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-15T21:33:50.547532] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T21:33:51.314001] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-15T21:33:52.085036] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:33:52.113959] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-15T21:33:52.626975] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T21:33:52.913990] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-15T21:33:53.619124] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T21:33:53.714032] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-15T21:33:54.514006] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-15T21:33:54.546260] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T21:33:54.931839] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T21:33:55.098273] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T21:33:55.313962] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-15T21:33:56.114046] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-15T21:33:56.913993] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-15T21:33:57.567682] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T21:33:57.573530] [INFO ] [REMOTE ] SNDR: Full fetch complete (59956 records). [2025-10-15T21:33:57.573633] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-15T21:33:57.714409] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-15T21:33:57.974494] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-15T21:33:57.974631] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-15T21:33:57.976168] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-15T21:33:57.976261] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-15T21:33:58.010826] [DEBUG] [LOCAL ] SNDR: Trimmed 59956 records to 41524 (keeping 200 days of data) [2025-10-15T21:33:58.014004] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-15T21:33:58.286880] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T21:33:58.282961] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T21:33:58.298726] [INFO ] [REMOTE ] SNDA: Full fetch complete (7598 records). [2025-10-15T21:33:58.301342] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-15T21:33:58.519220] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-15T21:33:58.691111] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-15T21:33:58.692674] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-15T21:33:58.693185] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-15T21:33:58.693494] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-15T21:33:58.695839] [DEBUG] [LOCAL ] SNDA: Trimmed 7598 records to 4464 (keeping 200 days of data) [2025-10-15T21:33:58.725733] [DEBUG] [LOCAL ] SNDA: Primary data saved (4464 records). [2025-10-15T21:33:58.726183] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-15T21:33:58.726312] [INFO ] [MAIN ] Update Progress: 1947/2369 symbols completed. SNDA took 35.3s. Estimated remaining: 59m 22s. Rate: 7.1 symbols/min [2025-10-15T21:33:58.918209] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:58.921352] [DEBUG] [LOCAL ] SNDR: Primary data saved (41524 records). [2025-10-15T21:33:58.921545] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-15T21:33:58.921679] [INFO ] [MAIN ] Update Progress: 1948/2369 symbols completed. SNDR took 33.3s. Estimated remaining: 59m 12s. Rate: 7.1 symbols/min [2025-10-15T21:33:59.123607] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:33:59.146941] [DEBUG] [LOCAL ] SNOW: Loaded 53595 existing records from primary storage. [2025-10-15T21:33:59.147378] [INFO ] [MAIN ] SNOW: Loaded 53595 existing records. [2025-10-15T21:33:59.317192] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-15T21:33:59.339996] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:59.341952] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-15T21:33:59.342061] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-15T21:33:59.356617] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-15T21:33:59.356936] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-15T21:33:59.403576] [DEBUG] [LOCAL ] SNV: Loaded 49028 existing records from primary storage. [2025-10-15T21:33:59.437885] [INFO ] [MAIN ] SNV: Loaded 49028 existing records. [2025-10-15T21:33:59.845609] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:33:59.869500] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-15T21:33:59.871868] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-15T21:33:59.877579] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-15T21:33:59.877711] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-15T21:34:00.065030] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:00.123868] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-15T21:34:00.322471] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:00.914034] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-15T21:34:01.065504] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-15T21:34:01.151519] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T21:34:01.714020] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-15T21:34:02.279950] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:34:02.513970] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-15T21:34:02.585989] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-15T21:34:02.717470] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T21:34:02.722536] [INFO ] [REMOTE ] SNN: Full fetch complete (63189 records). [2025-10-15T21:34:02.722674] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-15T21:34:03.109328] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-15T21:34:03.109419] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-15T21:34:03.110415] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-15T21:34:03.110480] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-15T21:34:03.111847] [DEBUG] [LOCAL ] SNN: Trimmed 63189 records to 44365 (keeping 200 days of data) [2025-10-15T21:34:03.323969] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-15T21:34:03.386312] [DEBUG] [LOCAL ] SNN: Primary data saved (44365 records). [2025-10-15T21:34:03.386438] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-15T21:34:03.387313] [INFO ] [MAIN ] Update Progress: 1949/2369 symbols completed. SNN took 32.8s. Estimated remaining: 59m 2s. Rate: 7.1 symbols/min [2025-10-15T21:34:03.556048] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:03.602532] [DEBUG] [LOCAL ] SNX: Loaded 39600 existing records from primary storage. [2025-10-15T21:34:03.602834] [INFO ] [MAIN ] SNX: Loaded 39600 existing records. [2025-10-15T21:34:03.776528] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:03.776799] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-15T21:34:03.776855] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-15T21:34:03.777879] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-15T21:34:03.777936] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-15T21:34:04.127128] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:04.127490] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-15T21:34:04.258890] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T21:34:04.914008] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-15T21:34:05.597179] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:34:05.678579] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-15T21:34:05.713958] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-15T21:34:06.483497] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T21:34:06.514003] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-15T21:34:07.313999] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-15T21:34:07.937257] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T21:34:08.031339] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-15T21:34:08.113980] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-15T21:34:08.914001] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-15T21:34:08.945551] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T21:34:09.714010] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-15T21:34:10.437872] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-15T21:34:10.513954] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-15T21:34:10.676577] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T21:34:10.753032] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T21:34:11.314026] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-15T21:34:12.114051] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-15T21:34:12.843041] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-15T21:34:12.915247] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-15T21:34:12.920102] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T21:34:13.713968] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-15T21:34:13.783301] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:34:14.514019] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-15T21:34:15.297987] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-15T21:34:15.304496] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-15T21:34:15.304620] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-15T21:34:15.336210] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-15T21:34:15.711463] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-15T21:34:15.711685] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-15T21:34:15.712924] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-15T21:34:15.713086] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-15T21:34:15.714915] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 53796 (keeping 200 days of data) [2025-10-15T21:34:15.851585] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-15T21:34:16.018491] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T21:34:16.114389] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-15T21:34:16.136798] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-15T21:34:16.137292] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-15T21:34:16.137745] [INFO ] [MAIN ] Update Progress: 1950/2369 symbols completed. SNAP took 53.0s. Estimated remaining: 58m 55s. Rate: 7.1 symbols/min [2025-10-15T21:34:16.302002] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:16.349924] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-15T21:34:16.350265] [INFO ] [MAIN ] SO: Loaded 53614 existing records. [2025-10-15T21:34:16.524448] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:16.524687] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-15T21:34:16.524743] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-15T21:34:16.525785] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-15T21:34:16.525841] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-15T21:34:16.887847] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:16.912774] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T21:34:16.921249] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-15T21:34:17.714051] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-15T21:34:18.443115] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T21:34:18.482294] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-15T21:34:18.513954] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-15T21:34:19.314062] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-15T21:34:19.581374] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T21:34:20.114023] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-15T21:34:20.920927] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-15T21:34:20.936631] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T21:34:20.984636] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-15T21:34:21.713974] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-15T21:34:22.039984] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T21:34:22.513974] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-15T21:34:22.926765] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T21:34:23.314100] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-15T21:34:24.091132] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-15T21:34:24.113953] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-15T21:34:24.240165] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T21:34:24.913991] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-15T21:34:24.959019] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T21:34:25.714027] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-15T21:34:26.405294] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T21:34:26.479666] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:34:26.513963] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-15T21:34:27.320286] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-15T21:34:27.325547] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T21:34:28.114022] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-15T21:34:28.745726] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:34:28.825935] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-15T21:34:28.832324] [INFO ] [REMOTE ] SNOW: Full fetch complete (77734 records). [2025-10-15T21:34:28.832452] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-15T21:34:28.924297] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-15T21:34:29.220686] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-15T21:34:29.220784] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-15T21:34:29.221916] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-15T21:34:29.221981] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-15T21:34:29.223471] [DEBUG] [LOCAL ] SNOW: Trimmed 77734 records to 53594 (keeping 200 days of data) [2025-10-15T21:34:29.544153] [DEBUG] [LOCAL ] SNOW: Primary data saved (53594 records). [2025-10-15T21:34:29.544291] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-15T21:34:29.544419] [INFO ] [MAIN ] Update Progress: 1951/2369 symbols completed. SNOW took 30.8s. Estimated remaining: 58m 48s. Rate: 7.1 symbols/min [2025-10-15T21:34:29.714724] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-15T21:34:29.716157] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:29.760703] [DEBUG] [LOCAL ] SOBO: Loaded 39409 existing records from primary storage. [2025-10-15T21:34:29.761000] [INFO ] [MAIN ] SOBO: Loaded 39409 existing records. [2025-10-15T21:34:29.940369] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:29.940782] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-15T21:34:29.940931] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-15T21:34:29.941426] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-15T21:34:29.941486] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-15T21:34:30.299198] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:30.331581] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-15T21:34:30.489230] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T21:34:30.513981] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-15T21:34:31.314025] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-15T21:34:31.347718] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T21:34:31.354201] [INFO ] [REMOTE ] SNV: Full fetch complete (71609 records). [2025-10-15T21:34:31.354373] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-15T21:34:31.744508] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-15T21:34:31.744597] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-15T21:34:31.745622] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-15T21:34:31.745708] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-15T21:34:31.747026] [DEBUG] [LOCAL ] SNV: Trimmed 71609 records to 49036 (keeping 200 days of data) [2025-10-15T21:34:31.977163] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T21:34:31.983816] [INFO ] [REMOTE ] SNX: Full fetch complete (57253 records). [2025-10-15T21:34:31.984720] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-15T21:34:32.118890] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-15T21:34:32.413221] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-15T21:34:32.415292] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-15T21:34:32.419024] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-15T21:34:32.419565] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-15T21:34:32.428474] [DEBUG] [LOCAL ] SNX: Trimmed 57253 records to 39434 (keeping 200 days of data) [2025-10-15T21:34:32.592604] [DEBUG] [LOCAL ] SNV: Primary data saved (49036 records). [2025-10-15T21:34:32.594506] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-15T21:34:32.594966] [INFO ] [MAIN ] Update Progress: 1952/2369 symbols completed. SNV took 33.7s. Estimated remaining: 58m 38s. Rate: 7.1 symbols/min [2025-10-15T21:34:32.770853] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:32.929296] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T21:34:32.939757] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-15T21:34:32.941138] [DEBUG] [LOCAL ] SOC: Loaded 50853 existing records from primary storage. [2025-10-15T21:34:32.944357] [INFO ] [MAIN ] SOC: Loaded 50853 existing records. [2025-10-15T21:34:33.189801] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:33.192517] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-15T21:34:33.192890] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-15T21:34:33.194359] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-15T21:34:33.194784] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-15T21:34:33.305027] [DEBUG] [LOCAL ] SNX: Primary data saved (39434 records). [2025-10-15T21:34:33.305210] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-15T21:34:33.305326] [INFO ] [MAIN ] Update Progress: 1953/2369 symbols completed. SNX took 29.9s. Estimated remaining: 58m 28s. Rate: 7.1 symbols/min [2025-10-15T21:34:33.665120] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:33.752512] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:33.753019] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-15T21:34:33.755936] [DEBUG] [LOCAL ] SOJC: Loaded 4906 existing records from primary storage. [2025-10-15T21:34:33.756976] [INFO ] [MAIN ] SOJC: Loaded 4906 existing records. [2025-10-15T21:34:33.942694] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:33.942959] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-15T21:34:33.943017] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-15T21:34:33.943171] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-15T21:34:33.943209] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-15T21:34:34.307085] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:34.346919] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-15T21:34:34.457769] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T21:34:34.513983] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-15T21:34:35.314076] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-15T21:34:35.443357] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:34:35.513213] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T21:34:36.113973] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-15T21:34:36.913967] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-15T21:34:37.240709] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T21:34:37.357733] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T21:34:37.714033] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-15T21:34:38.399724] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T21:34:38.513963] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-15T21:34:39.320007] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-15T21:34:39.322506] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T21:34:39.961702] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T21:34:40.113987] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-15T21:34:40.769808] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T21:34:40.914030] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-15T21:34:41.586918] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:34:41.711580] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T21:34:41.714358] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-15T21:34:42.383624] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T21:34:42.514029] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-15T21:34:43.240395] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T21:34:43.313963] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-15T21:34:44.113998] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-15T21:34:44.806322] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T21:34:44.913960] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-15T21:34:45.335747] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T21:34:45.626387] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T21:34:45.713975] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-15T21:34:46.301873] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T21:34:46.514006] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-15T21:34:47.314018] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-15T21:34:47.964722] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T21:34:48.113973] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-15T21:34:48.277891] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T21:34:48.914060] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-15T21:34:49.714031] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-15T21:34:49.815889] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T21:34:50.282292] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T21:34:50.389696] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T21:34:50.513962] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-15T21:34:51.314014] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-15T21:34:51.821946] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T21:34:52.113997] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-15T21:34:52.913970] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-15T21:34:53.028353] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T21:34:53.472665] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T21:34:53.714024] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-15T21:34:53.822363] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T21:34:54.514006] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-15T21:34:55.090891] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T21:34:55.105390] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T21:34:55.313955] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-15T21:34:56.114037] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-15T21:34:56.914056] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-15T21:34:57.031723] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T21:34:57.413247] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T21:34:57.414354] [INFO ] [REMOTE ] SOJC: Full fetch complete (7474 records). [2025-10-15T21:34:57.414422] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-15T21:34:57.718929] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-15T21:34:57.774794] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-15T21:34:57.774891] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-15T21:34:57.775200] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-15T21:34:57.775285] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-15T21:34:57.776092] [DEBUG] [LOCAL ] SOJC: Trimmed 7474 records to 4812 (keeping 200 days of data) [2025-10-15T21:34:57.794347] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T21:34:57.822264] [INFO ] [REMOTE ] SO: Full fetch complete (77771 records). [2025-10-15T21:34:57.825453] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-15T21:34:57.862455] [DEBUG] [LOCAL ] SOJC: Primary data saved (4812 records). [2025-10-15T21:34:57.893794] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-15T21:34:57.899271] [INFO ] [MAIN ] Update Progress: 1954/2369 symbols completed. SOJC took 24.6s. Estimated remaining: 58m 23s. Rate: 7.1 symbols/min [2025-10-15T21:34:58.268753] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:58.414675] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-15T21:34:58.414471] [DEBUG] [LOCAL ] SOJD: Loaded 12989 existing records from primary storage. [2025-10-15T21:34:58.414932] [INFO ] [MAIN ] SOJD: Loaded 12989 existing records. [2025-10-15T21:34:58.432144] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-15T21:34:58.458698] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-15T21:34:58.471932] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-15T21:34:58.525600] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-15T21:34:58.552534] [DEBUG] [LOCAL ] SO: Trimmed 77771 records to 53614 (keeping 200 days of data) [2025-10-15T21:34:58.630928] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:58.692075] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-15T21:34:58.692478] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-15T21:34:58.717878] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-15T21:34:58.718299] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-15T21:34:59.149714] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:34:59.279904] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T21:34:59.315700] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-15T21:34:59.403573] [DEBUG] [LOCAL ] SO: Primary data saved (53614 records). [2025-10-15T21:34:59.403734] [INFO ] [MAIN ] SO: Full history saved. [2025-10-15T21:34:59.404115] [INFO ] [MAIN ] Update Progress: 1955/2369 symbols completed. SO took 43.3s. Estimated remaining: 58m 13s. Rate: 7.1 symbols/min [2025-10-15T21:34:59.567814] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:34:59.578842] [DEBUG] [LOCAL ] SOJE: Loaded 8970 existing records from primary storage. [2025-10-15T21:34:59.579093] [INFO ] [MAIN ] SOJE: Loaded 8970 existing records. [2025-10-15T21:34:59.750590] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:34:59.750843] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-15T21:34:59.750902] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-15T21:34:59.751210] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-15T21:34:59.751265] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-15T21:35:00.098972] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:00.119119] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-15T21:35:00.131710] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T21:35:00.681674] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:35:00.914008] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-15T21:35:01.616465] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T21:35:01.714034] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-15T21:35:02.378978] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T21:35:02.514034] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-15T21:35:03.082023] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T21:35:03.087728] [INFO ] [REMOTE ] SOBO: Full fetch complete (58427 records). [2025-10-15T21:35:03.087903] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-15T21:35:03.319108] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-15T21:35:03.472972] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-15T21:35:03.473087] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-15T21:35:03.474110] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-15T21:35:03.474196] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-15T21:35:03.475523] [DEBUG] [LOCAL ] SOBO: Trimmed 58427 records to 39401 (keeping 200 days of data) [2025-10-15T21:35:03.583631] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T21:35:03.738701] [DEBUG] [LOCAL ] SOBO: Primary data saved (39401 records). [2025-10-15T21:35:03.738857] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-15T21:35:03.738960] [INFO ] [MAIN ] Update Progress: 1956/2369 symbols completed. SOBO took 34.2s. Estimated remaining: 58m 4s. Rate: 7.1 symbols/min [2025-10-15T21:35:03.901877] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:03.902002] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-15T21:35:03.902038] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-15T21:35:03.902142] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-15T21:35:03.902183] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-15T21:35:03.902222] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-15T21:35:03.902252] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-15T21:35:04.124377] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-15T21:35:04.196560] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T21:35:04.276782] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:04.914062] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-15T21:35:05.714009] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-15T21:35:05.746495] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T21:35:06.017194] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T21:35:06.184300] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T21:35:06.514005] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-15T21:35:06.717145] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:35:06.717470] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-15T21:35:06.717562] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:35:06.717619] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-15T21:35:06.717695] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:35:06.717774] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-15T21:35:06.717846] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-15T21:35:06.717894] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-15T21:35:06.717935] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-15T21:35:06.717988] [INFO ] [MAIN ] Update Progress: 1957/2369 symbols completed. SOJF took 3.0s. Estimated remaining: 57m 54s. Rate: 7.1 symbols/min [2025-10-15T21:35:07.314036] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-15T21:35:08.114050] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-15T21:35:08.914031] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-15T21:35:09.013175] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T21:35:09.042427] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T21:35:09.048626] [INFO ] [REMOTE ] SOC: Full fetch complete (72013 records). [2025-10-15T21:35:09.048760] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-15T21:35:09.435373] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-15T21:35:09.435452] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-15T21:35:09.436519] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-15T21:35:09.436582] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-15T21:35:09.437930] [DEBUG] [LOCAL ] SOC: Trimmed 72013 records to 50966 (keeping 200 days of data) [2025-10-15T21:35:09.647504] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T21:35:09.725573] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-15T21:35:09.753855] [DEBUG] [LOCAL ] SOC: Primary data saved (50966 records). [2025-10-15T21:35:09.754031] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-15T21:35:09.754138] [INFO ] [MAIN ] Update Progress: 1958/2369 symbols completed. SOC took 37.2s. Estimated remaining: 57m 45s. Rate: 7.1 symbols/min [2025-10-15T21:35:10.514004] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-15T21:35:10.595281] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T21:35:11.192803] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T21:35:11.313973] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-15T21:35:12.084262] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T21:35:12.113990] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-15T21:35:12.914026] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-15T21:35:13.019681] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T21:35:13.713996] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-15T21:35:13.947894] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T21:35:14.306870] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T21:35:14.514060] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-15T21:35:15.248999] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T21:35:15.314104] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-15T21:35:16.113991] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-15T21:35:16.197016] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T21:35:16.913790] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T21:35:16.916023] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-15T21:35:17.713995] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-15T21:35:17.842223] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T21:35:18.117621] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T21:35:18.514012] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-15T21:35:19.154710] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T21:35:19.156687] [INFO ] [REMOTE ] SOJE: Full fetch complete (13744 records). [2025-10-15T21:35:19.156789] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-15T21:35:19.318188] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-15T21:35:19.524736] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-15T21:35:19.524812] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-15T21:35:19.525120] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-15T21:35:19.525159] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-15T21:35:19.525609] [DEBUG] [LOCAL ] SOJE: Trimmed 13744 records to 8875 (keeping 200 days of data) [2025-10-15T21:35:19.582637] [DEBUG] [LOCAL ] SOJE: Primary data saved (8875 records). [2025-10-15T21:35:19.582856] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-15T21:35:19.582966] [INFO ] [MAIN ] Update Progress: 1959/2369 symbols completed. SOJE took 20.2s. Estimated remaining: 57m 36s. Rate: 7.1 symbols/min [2025-10-15T21:35:20.201626] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T21:35:20.205361] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-15T21:35:21.053399] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T21:35:21.056583] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-15T21:35:21.846106] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T21:35:21.848029] [INFO ] [REMOTE ] SOJD: Full fetch complete (19333 records). [2025-10-15T21:35:21.848097] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-15T21:35:22.203760] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-15T21:35:22.203853] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-15T21:35:22.204268] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-15T21:35:22.204327] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-15T21:35:22.204942] [DEBUG] [LOCAL ] SOJD: Trimmed 19333 records to 12977 (keeping 200 days of data) [2025-10-15T21:35:22.282808] [DEBUG] [LOCAL ] SOJD: Primary data saved (12977 records). [2025-10-15T21:35:22.282939] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-15T21:35:22.283019] [INFO ] [MAIN ] Update Progress: 1960/2369 symbols completed. SOJD took 24.4s. Estimated remaining: 57m 27s. Rate: 7.1 symbols/min [2025-10-15T21:35:22.843583] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:22.916738] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:22.993696] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:23.015144] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:23.022033] [DEBUG] [LOCAL ] SOL: Loaded 13206 existing records from primary storage. [2025-10-15T21:35:23.022293] [INFO ] [MAIN ] SOL: Loaded 13206 existing records. [2025-10-15T21:35:23.232789] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:23.233140] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-15T21:35:23.233192] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-15T21:35:23.233514] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-15T21:35:23.233572] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-15T21:35:23.342355] [DEBUG] [LOCAL ] SONY: Loaded 53379 existing records from primary storage. [2025-10-15T21:35:23.371076] [INFO ] [MAIN ] SONY: Loaded 53379 existing records. [2025-10-15T21:35:23.392265] [DEBUG] [LOCAL ] SON: Loaded 43266 existing records from primary storage. [2025-10-15T21:35:23.475904] [DEBUG] [LOCAL ] SOLV: Loaded 43830 existing records from primary storage. [2025-10-15T21:35:23.454574] [INFO ] [MAIN ] SON: Loaded 43266 existing records. [2025-10-15T21:35:23.556893] [INFO ] [MAIN ] SOLV: Loaded 43830 existing records. [2025-10-15T21:35:24.027873] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:24.184792] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:24.204478] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-15T21:35:24.264932] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:24.260143] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:24.260591] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-15T21:35:24.260682] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-15T21:35:24.266072] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-15T21:35:24.265295] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-15T21:35:24.267393] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-15T21:35:24.267586] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-15T21:35:24.268539] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-15T21:35:24.268709] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-15T21:35:24.268636] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-15T21:35:24.268843] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-15T21:35:24.274092] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-15T21:35:24.316198] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-15T21:35:25.265111] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:25.326297] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:25.326610] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-15T21:35:25.337322] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-15T21:35:25.403577] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:25.403854] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-15T21:35:25.502409] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T21:35:25.507294] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-15T21:35:26.225910] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T21:35:26.230630] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-15T21:35:26.628071] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T21:35:26.636500] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-15T21:35:26.839399] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T21:35:27.157766] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T21:35:27.314020] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-15T21:35:27.504861] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-15T21:35:27.822088] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T21:35:28.114049] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-15T21:35:28.145095] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T21:35:28.914016] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-15T21:35:29.653914] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T21:35:29.714061] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-15T21:35:30.408466] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T21:35:30.513982] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-15T21:35:31.167828] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T21:35:31.314026] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-15T21:35:32.104925] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T21:35:32.114188] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-15T21:35:32.916254] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-15T21:35:32.921329] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T21:35:33.714000] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-15T21:35:34.043340] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T21:35:34.514090] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-15T21:35:34.553554] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T21:35:35.314026] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-15T21:35:35.420184] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T21:35:35.429987] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T21:35:36.114008] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-15T21:35:36.913978] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-15T21:35:36.939846] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T21:35:37.340272] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T21:35:37.714036] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-15T21:35:38.519162] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-15T21:35:38.538928] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:35:39.223861] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T21:35:39.314018] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-15T21:35:39.543879] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T21:35:40.113994] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-15T21:35:40.749485] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T21:35:40.913971] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-15T21:35:41.056766] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T21:35:41.713994] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-15T21:35:42.514027] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-15T21:35:42.975501] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-15T21:35:43.313983] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-15T21:35:43.453242] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T21:35:43.459693] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T21:35:44.113997] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-15T21:35:44.914041] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-15T21:35:45.369959] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T21:35:45.537499] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T21:35:45.714004] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-15T21:35:45.737513] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T21:35:46.514018] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-15T21:35:47.312985] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T21:35:47.316840] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-15T21:35:47.493868] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T21:35:47.496471] [INFO ] [REMOTE ] SOL: Full fetch complete (21247 records). [2025-10-15T21:35:47.496556] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-15T21:35:47.872591] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-15T21:35:47.872716] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-15T21:35:47.873314] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-15T21:35:47.873355] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-15T21:35:47.873923] [DEBUG] [LOCAL ] SOL: Trimmed 21247 records to 13195 (keeping 200 days of data) [2025-10-15T21:35:47.951729] [DEBUG] [LOCAL ] SOL: Primary data saved (13195 records). [2025-10-15T21:35:47.951888] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-15T21:35:47.951974] [INFO ] [MAIN ] Update Progress: 1961/2369 symbols completed. SOL took 25.7s. Estimated remaining: 57m 22s. Rate: 7.1 symbols/min [2025-10-15T21:35:48.115927] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:48.116034] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-15T21:35:48.122802] [DEBUG] [LOCAL ] SOR: Loaded 2904 existing records from primary storage. [2025-10-15T21:35:48.122983] [INFO ] [MAIN ] SOR: Loaded 2904 existing records. [2025-10-15T21:35:48.294781] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:48.295002] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-15T21:35:48.295052] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-15T21:35:48.295212] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-15T21:35:48.295269] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-15T21:35:48.648521] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:48.837823] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T21:35:48.913958] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-15T21:35:49.714076] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-15T21:35:50.166770] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T21:35:50.513976] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-15T21:35:50.628189] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T21:35:51.019982] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T21:35:51.253793] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T21:35:51.313957] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-15T21:35:52.045356] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T21:35:52.113974] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-15T21:35:52.914012] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-15T21:35:53.489537] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T21:35:53.496185] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T21:35:53.502322] [INFO ] [REMOTE ] SOLV: Full fetch complete (63485 records). [2025-10-15T21:35:53.503099] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-15T21:35:53.719066] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-15T21:35:53.990528] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-15T21:35:53.990604] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-15T21:35:53.991581] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-15T21:35:53.991663] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-15T21:35:53.992873] [DEBUG] [LOCAL ] SOLV: Trimmed 63485 records to 43745 (keeping 200 days of data) [2025-10-15T21:35:54.249121] [DEBUG] [LOCAL ] SOLV: Primary data saved (43745 records). [2025-10-15T21:35:54.249243] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-15T21:35:54.249321] [INFO ] [MAIN ] Update Progress: 1962/2369 symbols completed. SOLV took 31.9s. Estimated remaining: 57m 13s. Rate: 7.1 symbols/min [2025-10-15T21:35:54.423675] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:54.435380] [DEBUG] [LOCAL ] SOS: Loaded 9409 existing records from primary storage. [2025-10-15T21:35:54.435605] [INFO ] [MAIN ] SOS: Loaded 9409 existing records. [2025-10-15T21:35:54.519099] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-15T21:35:54.625983] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:54.626138] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-15T21:35:54.626186] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-15T21:35:54.626350] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-15T21:35:54.626390] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-15T21:35:54.997383] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:55.314048] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-15T21:35:55.334915] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T21:35:55.341209] [INFO ] [REMOTE ] SON: Full fetch complete (62723 records). [2025-10-15T21:35:55.341324] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-15T21:35:55.722222] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-15T21:35:55.722305] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-15T21:35:55.723290] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-15T21:35:55.723353] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-15T21:35:55.724589] [DEBUG] [LOCAL ] SON: Trimmed 62723 records to 43365 (keeping 200 days of data) [2025-10-15T21:35:55.816614] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T21:35:55.988289] [DEBUG] [LOCAL ] SON: Primary data saved (43365 records). [2025-10-15T21:35:55.988438] [INFO ] [MAIN ] SON: Full history saved. [2025-10-15T21:35:55.988946] [INFO ] [MAIN ] Update Progress: 1963/2369 symbols completed. SON took 33.7s. Estimated remaining: 57m 3s. Rate: 7.1 symbols/min [2025-10-15T21:35:56.128413] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-15T21:35:56.159957] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:35:56.205093] [DEBUG] [LOCAL ] SPB: Loaded 34199 existing records from primary storage. [2025-10-15T21:35:56.205375] [INFO ] [MAIN ] SPB: Loaded 34199 existing records. [2025-10-15T21:35:56.384151] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:35:56.384519] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-15T21:35:56.384635] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-15T21:35:56.385060] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-15T21:35:56.385115] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-15T21:35:56.670749] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T21:35:56.678394] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-15T21:35:56.789525] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:35:56.913989] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-15T21:35:57.714022] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-15T21:35:58.156431] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T21:35:58.514003] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-15T21:35:58.775855] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T21:35:59.143172] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T21:35:59.313993] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-15T21:36:00.114003] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-15T21:36:00.858230] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T21:36:00.913995] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-15T21:36:01.283757] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-15T21:36:01.714086] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-15T21:36:02.192290] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T21:36:02.341432] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T21:36:02.514001] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-15T21:36:03.106281] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T21:36:03.314035] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-15T21:36:04.114039] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-15T21:36:04.705366] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T21:36:04.913959] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-15T21:36:05.380243] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T21:36:05.426006] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-15T21:36:05.714006] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-15T21:36:06.514012] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-15T21:36:07.059139] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T21:36:07.313999] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-15T21:36:08.114005] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-15T21:36:08.509282] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T21:36:08.597635] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T21:36:08.746238] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T21:36:08.913964] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-15T21:36:09.424233] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-15T21:36:09.713946] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-15T21:36:10.198027] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T21:36:10.514004] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-15T21:36:11.314077] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-15T21:36:11.991351] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T21:36:12.114059] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-15T21:36:12.582080] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T21:36:12.914031] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-15T21:36:13.250083] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T21:36:13.251420] [INFO ] [REMOTE ] SOR: Full fetch complete (4419 records). [2025-10-15T21:36:13.251554] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-15T21:36:13.342959] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T21:36:13.383930] [INFO ] [REMOTE ] SONY: Full fetch complete (77388 records). [2025-10-15T21:36:13.389628] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-15T21:36:13.719197] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-15T21:36:14.001243] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-15T21:36:14.011573] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-15T21:36:14.035303] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-15T21:36:14.037917] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-15T21:36:14.060458] [DEBUG] [LOCAL ] SOR: Trimmed 4419 records to 2893 (keeping 200 days of data) [2025-10-15T21:36:14.085425] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-15T21:36:14.085503] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-15T21:36:14.086567] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-15T21:36:14.086665] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-15T21:36:14.104449] [DEBUG] [LOCAL ] SOR: Primary data saved (2893 records). [2025-10-15T21:36:14.104682] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-15T21:36:14.104852] [INFO ] [MAIN ] Update Progress: 1964/2369 symbols completed. SOR took 26.2s. Estimated remaining: 56m 57s. Rate: 7.1 symbols/min [2025-10-15T21:36:14.136291] [DEBUG] [LOCAL ] SONY: Trimmed 77388 records to 53380 (keeping 200 days of data) [2025-10-15T21:36:14.364210] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:36:14.426599] [DEBUG] [LOCAL ] SPCE: Loaded 49963 existing records from primary storage. [2025-10-15T21:36:14.430698] [INFO ] [MAIN ] SPCE: Loaded 49963 existing records. [2025-10-15T21:36:14.591357] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-15T21:36:14.720337] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:36:14.722046] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-15T21:36:14.722982] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-15T21:36:14.726177] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-15T21:36:14.727538] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-15T21:36:15.130031] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:36:15.246688] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T21:36:15.262542] [DEBUG] [LOCAL ] SONY: Primary data saved (53380 records). [2025-10-15T21:36:15.262747] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-15T21:36:15.262846] [INFO ] [MAIN ] Update Progress: 1965/2369 symbols completed. SONY took 53.0s. Estimated remaining: 56m 47s. Rate: 7.1 symbols/min [2025-10-15T21:36:15.319240] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-15T21:36:15.361586] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T21:36:15.452756] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:36:15.460476] [DEBUG] [LOCAL ] SPE: Loaded 6303 existing records from primary storage. [2025-10-15T21:36:15.460733] [INFO ] [MAIN ] SPE: Loaded 6303 existing records. [2025-10-15T21:36:15.647391] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:36:15.647607] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-15T21:36:15.647683] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-15T21:36:15.647964] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-15T21:36:15.648022] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-15T21:36:16.034778] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:36:16.114013] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-15T21:36:16.840829] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T21:36:16.914016] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-15T21:36:17.462509] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T21:36:17.617768] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T21:36:17.713995] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-15T21:36:18.034207] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T21:36:18.514008] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-15T21:36:19.314004] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-15T21:36:19.637214] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T21:36:19.842431] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T21:36:20.114025] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-15T21:36:20.913977] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-15T21:36:21.175721] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:36:21.622029] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T21:36:21.713986] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-15T21:36:22.513998] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-15T21:36:23.245986] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T21:36:23.314006] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-15T21:36:23.740911] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T21:36:23.922112] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T21:36:24.114069] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-15T21:36:24.913999] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-15T21:36:25.304058] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T21:36:25.713995] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-15T21:36:26.338314] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T21:36:26.513999] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-15T21:36:26.602411] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T21:36:27.188268] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T21:36:27.314074] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-15T21:36:27.973478] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T21:36:28.114073] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-15T21:36:28.841008] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T21:36:28.913964] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-15T21:36:29.714044] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-15T21:36:30.259716] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T21:36:30.514026] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-15T21:36:30.698097] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T21:36:30.700103] [INFO ] [REMOTE ] SOS: Full fetch complete (11244 records). [2025-10-15T21:36:30.700173] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-15T21:36:31.058005] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-15T21:36:31.058079] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-15T21:36:31.058391] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-15T21:36:31.058452] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-15T21:36:31.058928] [DEBUG] [LOCAL ] SOS: Trimmed 11244 records to 9468 (keeping 200 days of data) [2025-10-15T21:36:31.109565] [DEBUG] [LOCAL ] SOS: Primary data saved (9468 records). [2025-10-15T21:36:31.109707] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-15T21:36:31.109799] [INFO ] [MAIN ] Update Progress: 1966/2369 symbols completed. SOS took 36.9s. Estimated remaining: 56m 40s. Rate: 7.1 symbols/min [2025-10-15T21:36:31.284327] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:36:31.313998] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-15T21:36:31.332965] [DEBUG] [LOCAL ] SPG: Loaded 50221 existing records from primary storage. [2025-10-15T21:36:31.333295] [INFO ] [MAIN ] SPG: Loaded 50221 existing records. [2025-10-15T21:36:31.515001] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:36:31.515232] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-15T21:36:31.515298] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-15T21:36:31.516461] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-15T21:36:31.516524] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-15T21:36:31.901053] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:36:31.948990] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T21:36:31.950167] [INFO ] [REMOTE ] SPE: Full fetch complete (9868 records). [2025-10-15T21:36:31.950236] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-15T21:36:32.114309] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-15T21:36:32.336336] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-15T21:36:32.336491] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-15T21:36:32.336818] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-15T21:36:32.336909] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-15T21:36:32.337472] [DEBUG] [LOCAL ] SPE: Trimmed 9868 records to 6264 (keeping 200 days of data) [2025-10-15T21:36:32.398134] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:36:32.416818] [DEBUG] [LOCAL ] SPE: Primary data saved (6264 records). [2025-10-15T21:36:32.416942] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-15T21:36:32.417022] [INFO ] [MAIN ] Update Progress: 1967/2369 symbols completed. SPE took 17.2s. Estimated remaining: 56m 30s. Rate: 7.1 symbols/min [2025-10-15T21:36:32.580889] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:36:32.621302] [DEBUG] [LOCAL ] SPGI: Loaded 45881 existing records from primary storage. [2025-10-15T21:36:32.621592] [INFO ] [MAIN ] SPGI: Loaded 45881 existing records. [2025-10-15T21:36:32.793306] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:36:32.793529] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-15T21:36:32.793576] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-15T21:36:32.794570] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-15T21:36:32.794626] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-15T21:36:32.919432] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-15T21:36:33.147896] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:36:33.575585] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T21:36:33.714038] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-15T21:36:34.513993] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-15T21:36:34.722422] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T21:36:35.314028] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-15T21:36:35.458039] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T21:36:35.961631] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T21:36:36.114023] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-15T21:36:36.913989] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-15T21:36:37.529515] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-15T21:36:37.674271] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T21:36:37.714024] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-15T21:36:38.228336] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T21:36:38.514050] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-15T21:36:39.313987] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-15T21:36:39.418960] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T21:36:40.110928] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T21:36:40.122551] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-15T21:36:40.216853] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T21:36:40.220782] [INFO ] [REMOTE ] SPB: Full fetch complete (47684 records). [2025-10-15T21:36:40.220873] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-15T21:36:40.604925] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-15T21:36:40.605001] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-15T21:36:40.605798] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-15T21:36:40.605860] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-15T21:36:40.606807] [DEBUG] [LOCAL ] SPB: Trimmed 47684 records to 34181 (keeping 200 days of data) [2025-10-15T21:36:40.809502] [DEBUG] [LOCAL ] SPB: Primary data saved (34181 records). [2025-10-15T21:36:40.809627] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-15T21:36:40.809946] [INFO ] [MAIN ] Update Progress: 1968/2369 symbols completed. SPB took 44.8s. Estimated remaining: 56m 22s. Rate: 7.1 symbols/min [2025-10-15T21:36:40.919099] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-15T21:36:40.982025] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:36:41.000442] [DEBUG] [LOCAL ] SPH: Loaded 16691 existing records from primary storage. [2025-10-15T21:36:41.000704] [INFO ] [MAIN ] SPH: Loaded 16691 existing records. [2025-10-15T21:36:41.176266] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:36:41.176474] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-15T21:36:41.176527] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-15T21:36:41.177231] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-15T21:36:41.177303] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-15T21:36:41.525695] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:36:41.713953] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-15T21:36:42.048157] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-15T21:36:42.513997] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-15T21:36:42.705959] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T21:36:42.781138] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T21:36:43.314094] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-15T21:36:44.114038] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-15T21:36:44.495091] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T21:36:44.548621] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T21:36:44.914063] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-15T21:36:45.714017] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-15T21:36:46.076321] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T21:36:46.254798] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T21:36:46.514043] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-15T21:36:47.313957] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-15T21:36:47.419102] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T21:36:48.113974] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-15T21:36:48.388811] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T21:36:48.913980] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-15T21:36:49.315893] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T21:36:49.697836] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T21:36:49.713965] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-15T21:36:50.514066] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-15T21:36:50.742586] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T21:36:51.301093] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T21:36:51.313964] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-15T21:36:52.114056] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-15T21:36:52.440557] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T21:36:52.913997] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-15T21:36:53.002865] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T21:36:53.713999] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-15T21:36:53.857972] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:36:54.514034] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-15T21:36:54.939587] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T21:36:54.964590] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T21:36:54.970992] [INFO ] [REMOTE ] SPCE: Full fetch complete (72590 records). [2025-10-15T21:36:54.971096] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-15T21:36:55.326848] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-15T21:36:55.351780] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-15T21:36:55.351912] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-15T21:36:55.354101] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-15T21:36:55.354197] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-15T21:36:55.356478] [DEBUG] [LOCAL ] SPCE: Trimmed 72590 records to 49975 (keeping 200 days of data) [2025-10-15T21:36:55.668129] [DEBUG] [LOCAL ] SPCE: Primary data saved (49975 records). [2025-10-15T21:36:55.668357] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-15T21:36:55.668481] [INFO ] [MAIN ] Update Progress: 1969/2369 symbols completed. SPCE took 41.6s. Estimated remaining: 56m 15s. Rate: 7.1 symbols/min [2025-10-15T21:36:55.846692] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:36:55.846927] [DEBUG] [LOCAL ] SPHR: No existing data file found in primary storage. [2025-10-15T21:36:55.846969] [WARN ] [MAIN ] SPHR: No existing data found, performing full refresh instead. [2025-10-15T21:36:55.847131] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-15T21:36:55.847185] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-15T21:36:55.847229] [DEBUG] [LOCAL ] SPHR: No primary data file found to delete. [2025-10-15T21:36:55.847264] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-15T21:36:56.119303] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-15T21:36:56.218052] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:36:56.250866] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T21:36:56.913978] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-15T21:36:57.067130] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:36:57.110531] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T21:36:57.714000] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-15T21:36:58.054706] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T21:36:58.514050] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-15T21:36:59.314027] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-15T21:36:59.396399] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T21:36:59.495317] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T21:37:00.113993] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-15T21:37:00.913971] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-15T21:37:01.152128] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T21:37:01.373847] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T21:37:01.714083] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-15T21:37:02.514011] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-15T21:37:02.622179] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T21:37:03.092551] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T21:37:03.314035] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-15T21:37:04.113997] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-15T21:37:04.342782] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T21:37:04.914008] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-15T21:37:04.976576] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T21:37:04.982475] [INFO ] [REMOTE ] SPG: Full fetch complete (72190 records). [2025-10-15T21:37:04.982580] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-15T21:37:05.386531] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-15T21:37:05.386638] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-15T21:37:05.387846] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-15T21:37:05.388016] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-15T21:37:05.389514] [DEBUG] [LOCAL ] SPG: Trimmed 72190 records to 50225 (keeping 200 days of data) [2025-10-15T21:37:05.509865] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T21:37:05.714719] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-15T21:37:05.731923] [DEBUG] [LOCAL ] SPG: Primary data saved (50225 records). [2025-10-15T21:37:05.732010] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-15T21:37:05.732101] [INFO ] [MAIN ] Update Progress: 1970/2369 symbols completed. SPG took 34.6s. Estimated remaining: 56m 6s. Rate: 7.1 symbols/min [2025-10-15T21:37:05.903171] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:05.920562] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T21:37:05.949604] [DEBUG] [LOCAL ] SPIR: Loaded 37592 existing records from primary storage. [2025-10-15T21:37:05.949927] [INFO ] [MAIN ] SPIR: Loaded 37592 existing records. [2025-10-15T21:37:06.127820] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:06.128024] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-15T21:37:06.128089] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-15T21:37:06.128368] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-15T21:37:06.128425] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-15T21:37:06.493804] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:06.513967] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-15T21:37:07.315036] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-15T21:37:07.318770] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T21:37:07.377124] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T21:37:08.114011] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-15T21:37:08.311951] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T21:37:08.914016] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-15T21:37:09.159487] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T21:37:09.713994] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-15T21:37:09.871310] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T21:37:10.514006] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-15T21:37:11.266194] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T21:37:11.313949] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-15T21:37:11.671472] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T21:37:12.113998] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-15T21:37:12.786856] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T21:37:12.913968] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-15T21:37:13.632912] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T21:37:13.714027] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-15T21:37:14.480081] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T21:37:14.513967] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-15T21:37:15.314015] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-15T21:37:15.611824] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T21:37:16.059976] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T21:37:16.114290] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-15T21:37:16.693347] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T21:37:16.703109] [INFO ] [REMOTE ] SPGI: Full fetch complete (67456 records). [2025-10-15T21:37:16.703333] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-15T21:37:16.923536] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-15T21:37:16.925283] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T21:37:17.207379] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-15T21:37:17.207473] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-15T21:37:17.208760] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-15T21:37:17.208863] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-15T21:37:17.210475] [DEBUG] [LOCAL ] SPGI: Trimmed 67456 records to 45865 (keeping 200 days of data) [2025-10-15T21:37:17.530637] [DEBUG] [LOCAL ] SPGI: Primary data saved (45865 records). [2025-10-15T21:37:17.530829] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-15T21:37:17.532007] [INFO ] [MAIN ] Update Progress: 1971/2369 symbols completed. SPGI took 45.1s. Estimated remaining: 55m 59s. Rate: 7.1 symbols/min [2025-10-15T21:37:17.714210] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-15T21:37:17.715733] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:17.724695] [DEBUG] [LOCAL ] SPMC: Loaded 5266 existing records from primary storage. [2025-10-15T21:37:17.724945] [INFO ] [MAIN ] SPMC: Loaded 5266 existing records. [2025-10-15T21:37:17.821986] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T21:37:17.845937] [INFO ] [REMOTE ] SPH: Full fetch complete (27921 records). [2025-10-15T21:37:17.856285] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-15T21:37:18.002686] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:18.026537] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-15T21:37:18.026682] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-15T21:37:18.027014] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-15T21:37:18.042703] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-15T21:37:18.531297] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-15T21:37:18.622509] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-15T21:37:18.644581] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-15T21:37:18.656397] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-15T21:37:18.662345] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-15T21:37:18.680290] [DEBUG] [LOCAL ] SPH: Trimmed 27921 records to 16693 (keeping 200 days of data) [2025-10-15T21:37:18.813192] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:18.865339] [DEBUG] [LOCAL ] SPH: Primary data saved (16693 records). [2025-10-15T21:37:18.865452] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-15T21:37:18.865526] [INFO ] [MAIN ] Update Progress: 1972/2369 symbols completed. SPH took 38.1s. Estimated remaining: 55m 49s. Rate: 7.1 symbols/min [2025-10-15T21:37:19.036910] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:19.060767] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-15T21:37:19.063669] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-15T21:37:19.065559] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T21:37:19.073238] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-15T21:37:19.073622] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-15T21:37:19.073895] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-15T21:37:19.074000] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-15T21:37:19.323841] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-15T21:37:19.428474] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:20.113969] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-15T21:37:20.269925] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:37:20.303612] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:37:20.303930] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-15T21:37:20.304015] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:37:20.304065] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-15T21:37:20.304103] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:37:20.304170] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-15T21:37:20.304233] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-15T21:37:20.304268] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-15T21:37:20.304313] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-15T21:37:20.304360] [INFO ] [MAIN ] Update Progress: 1973/2369 symbols completed. SPME took 1.4s. Estimated remaining: 55m 39s. Rate: 7.1 symbols/min [2025-10-15T21:37:20.475974] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:20.510201] [DEBUG] [LOCAL ] SPNT: Loaded 34701 existing records from primary storage. [2025-10-15T21:37:20.510548] [INFO ] [MAIN ] SPNT: Loaded 34701 existing records. [2025-10-15T21:37:20.693363] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:20.693740] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-15T21:37:20.693907] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-15T21:37:20.694579] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-15T21:37:20.694638] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-15T21:37:20.923785] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-15T21:37:20.978400] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T21:37:21.087489] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:21.714063] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-15T21:37:22.293252] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T21:37:22.432065] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T21:37:22.514043] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-15T21:37:23.088160] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T21:37:23.314031] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-15T21:37:24.033591] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T21:37:24.114018] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-15T21:37:24.875901] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T21:37:24.913975] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-15T21:37:25.605392] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T21:37:25.714006] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-15T21:37:26.327798] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T21:37:26.514047] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-15T21:37:27.314058] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-15T21:37:27.841238] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T21:37:27.931115] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T21:37:28.114075] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-15T21:37:28.914074] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-15T21:37:29.291868] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T21:37:29.493000] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T21:37:29.714049] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-15T21:37:30.514014] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-15T21:37:31.069936] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T21:37:31.154696] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T21:37:31.313971] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-15T21:37:32.113992] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-15T21:37:32.696688] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T21:37:32.784471] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T21:37:32.914019] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-15T21:37:33.714024] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-15T21:37:34.351331] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T21:37:34.514023] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-15T21:37:35.006319] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T21:37:35.007859] [INFO ] [REMOTE ] SPMC: Full fetch complete (8115 records). [2025-10-15T21:37:35.007945] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-15T21:37:35.331557] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-15T21:37:35.429777] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-15T21:37:35.429884] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-15T21:37:35.430314] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-15T21:37:35.430401] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-15T21:37:35.431061] [DEBUG] [LOCAL ] SPMC: Trimmed 8115 records to 5228 (keeping 200 days of data) [2025-10-15T21:37:35.495318] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T21:37:35.508794] [DEBUG] [LOCAL ] SPMC: Primary data saved (5228 records). [2025-10-15T21:37:35.509333] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-15T21:37:35.509480] [INFO ] [MAIN ] Update Progress: 1974/2369 symbols completed. SPMC took 18.0s. Estimated remaining: 55m 32s. Rate: 7.1 symbols/min [2025-10-15T21:37:35.685775] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:35.734827] [DEBUG] [LOCAL ] SPOT: Loaded 50374 existing records from primary storage. [2025-10-15T21:37:35.735140] [INFO ] [MAIN ] SPOT: Loaded 50374 existing records. [2025-10-15T21:37:35.912874] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:35.913109] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-15T21:37:35.913156] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-15T21:37:35.914256] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-15T21:37:35.914313] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-15T21:37:36.124301] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-15T21:37:36.258795] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:36.806162] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:37:36.914016] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-15T21:37:37.650968] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T21:37:37.656746] [INFO ] [REMOTE ] SPHR: Full fetch complete (58589 records). [2025-10-15T21:37:37.656889] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-15T21:37:37.719812] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-15T21:37:38.041438] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-15T21:37:38.041523] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-15T21:37:38.042463] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-15T21:37:38.042531] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-15T21:37:38.044200] [DEBUG] [LOCAL ] SPHR: Trimmed 58589 records to 40567 (keeping 200 days of data) [2025-10-15T21:37:38.285264] [DEBUG] [LOCAL ] SPHR: Primary data saved (40567 records). [2025-10-15T21:37:38.285385] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-15T21:37:38.285471] [INFO ] [MAIN ] Update Progress: 1975/2369 symbols completed. SPHR took 42.6s. Estimated remaining: 55m 22s. Rate: 7.1 symbols/min [2025-10-15T21:37:38.420805] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T21:37:38.479298] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:38.514892] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-15T21:37:38.516514] [DEBUG] [LOCAL ] SPR: Loaded 41128 existing records from primary storage. [2025-10-15T21:37:38.516850] [INFO ] [MAIN ] SPR: Loaded 41128 existing records. [2025-10-15T21:37:38.693298] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:38.693500] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-15T21:37:38.693567] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-15T21:37:38.694273] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-15T21:37:38.694333] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-15T21:37:39.036406] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:39.313976] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-15T21:37:39.725698] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T21:37:39.791002] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T21:37:40.114073] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-15T21:37:40.860461] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T21:37:40.914029] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-15T21:37:41.564417] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T21:37:41.713991] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-15T21:37:42.262944] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T21:37:42.514058] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-15T21:37:43.250594] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T21:37:43.313959] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-15T21:37:44.013734] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T21:37:44.113982] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-15T21:37:44.699173] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T21:37:44.913999] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-15T21:37:45.603489] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T21:37:45.608351] [INFO ] [REMOTE ] SPIR: Full fetch complete (53713 records). [2025-10-15T21:37:45.608452] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-15T21:37:45.719206] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-15T21:37:45.986127] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-15T21:37:45.986213] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-15T21:37:45.987285] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-15T21:37:45.987347] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-15T21:37:45.988424] [DEBUG] [LOCAL ] SPIR: Trimmed 53713 records to 37593 (keeping 200 days of data) [2025-10-15T21:37:46.202737] [DEBUG] [LOCAL ] SPIR: Primary data saved (37593 records). [2025-10-15T21:37:46.202860] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-15T21:37:46.202938] [INFO ] [MAIN ] Update Progress: 1976/2369 symbols completed. SPIR took 40.5s. Estimated remaining: 55m 14s. Rate: 7.1 symbols/min [2025-10-15T21:37:46.371797] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:46.393249] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T21:37:46.407527] [DEBUG] [LOCAL ] SPRU: Loaded 9725 existing records from primary storage. [2025-10-15T21:37:46.407750] [INFO ] [MAIN ] SPRU: Loaded 9725 existing records. [2025-10-15T21:37:46.519094] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-15T21:37:46.587354] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:46.587535] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-15T21:37:46.587593] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-15T21:37:46.587930] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-15T21:37:46.587987] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-15T21:37:46.928854] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:47.314047] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-15T21:37:47.791773] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-15T21:37:48.114019] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-15T21:37:48.165910] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T21:37:48.203958] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T21:37:48.914068] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-15T21:37:48.996281] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T21:37:49.000811] [INFO ] [REMOTE ] SPNT: Full fetch complete (48740 records). [2025-10-15T21:37:49.000966] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-15T21:37:49.415376] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-15T21:37:49.415485] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-15T21:37:49.416895] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-15T21:37:49.416976] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-15T21:37:49.418713] [DEBUG] [LOCAL ] SPNT: Trimmed 48740 records to 34702 (keeping 200 days of data) [2025-10-15T21:37:49.638685] [DEBUG] [LOCAL ] SPNT: Primary data saved (34702 records). [2025-10-15T21:37:49.638884] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-15T21:37:49.639251] [INFO ] [MAIN ] Update Progress: 1977/2369 symbols completed. SPNT took 29.3s. Estimated remaining: 55m 4s. Rate: 7.1 symbols/min [2025-10-15T21:37:49.719268] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-15T21:37:49.842516] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:37:49.871062] [DEBUG] [LOCAL ] SPXC: Loaded 23372 existing records from primary storage. [2025-10-15T21:37:49.871491] [INFO ] [MAIN ] SPXC: Loaded 23372 existing records. [2025-10-15T21:37:50.056112] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:37:50.056430] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-15T21:37:50.056523] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-15T21:37:50.057175] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-15T21:37:50.057235] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-15T21:37:50.444153] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:37:50.514063] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-15T21:37:50.737909] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T21:37:51.143208] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T21:37:51.313998] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-15T21:37:51.864992] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T21:37:51.974920] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-15T21:37:52.114013] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-15T21:37:52.914043] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-15T21:37:53.713983] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-15T21:37:54.023012] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T21:37:54.472062] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-15T21:37:54.514051] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-15T21:37:55.251155] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T21:37:55.314023] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-15T21:37:56.114001] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-15T21:37:56.671406] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T21:37:56.818201] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-15T21:37:56.888550] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T21:37:56.913956] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-15T21:37:57.714024] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-15T21:37:58.057178] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T21:37:58.514022] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-15T21:37:59.072472] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T21:37:59.314023] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-15T21:37:59.982142] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-15T21:38:00.114010] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-15T21:38:00.758541] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T21:38:00.868175] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T21:38:00.913976] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-15T21:38:01.714025] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-15T21:38:02.405429] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T21:38:02.514025] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-15T21:38:02.532257] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T21:38:03.313965] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-15T21:38:03.664365] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T21:38:04.114018] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-15T21:38:04.914023] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-15T21:38:05.466687] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-15T21:38:05.680097] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T21:38:05.713969] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-15T21:38:06.163708] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T21:38:06.514082] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-15T21:38:06.758195] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T21:38:06.766127] [INFO ] [REMOTE ] SPR: Full fetch complete (60150 records). [2025-10-15T21:38:06.766338] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-15T21:38:07.104073] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T21:38:07.190025] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-15T21:38:07.190150] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-15T21:38:07.192042] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-15T21:38:07.192114] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-15T21:38:07.193915] [DEBUG] [LOCAL ] SPR: Trimmed 60150 records to 41138 (keeping 200 days of data) [2025-10-15T21:38:07.314700] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-15T21:38:07.458612] [DEBUG] [LOCAL ] SPR: Primary data saved (41138 records). [2025-10-15T21:38:07.458832] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-15T21:38:07.458954] [INFO ] [MAIN ] Update Progress: 1978/2369 symbols completed. SPR took 29.2s. Estimated remaining: 54m 58s. Rate: 7.1 symbols/min [2025-10-15T21:38:07.642362] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:38:07.655785] [DEBUG] [LOCAL ] SPXX: Loaded 9392 existing records from primary storage. [2025-10-15T21:38:07.656045] [INFO ] [MAIN ] SPXX: Loaded 9392 existing records. [2025-10-15T21:38:07.843237] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:38:07.843572] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-15T21:38:07.843631] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-15T21:38:07.844192] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-15T21:38:07.844254] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-15T21:38:08.039351] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T21:38:08.119059] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-15T21:38:08.241497] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:38:08.914115] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-15T21:38:09.714099] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-15T21:38:10.046991] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T21:38:10.423013] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T21:38:10.514011] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-15T21:38:10.951253] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-15T21:38:11.173856] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T21:38:11.314063] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-15T21:38:12.067616] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T21:38:12.113979] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-15T21:38:12.918016] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-15T21:38:12.921125] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T21:38:13.713984] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-15T21:38:14.514030] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-15T21:38:14.577939] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T21:38:15.100782] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T21:38:15.313999] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-15T21:38:15.620426] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T21:38:16.114016] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-15T21:38:16.913996] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-15T21:38:17.270734] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T21:38:17.437344] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-15T21:38:17.455847] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T21:38:17.714055] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-15T21:38:18.454084] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T21:38:18.514089] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-15T21:38:19.314042] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-15T21:38:19.960029] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T21:38:20.114028] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-15T21:38:20.342412] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T21:38:20.897451] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T21:38:20.913966] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-15T21:38:21.653519] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-15T21:38:21.714044] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-15T21:38:22.514001] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-15T21:38:22.887571] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T21:38:23.314031] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-15T21:38:23.352101] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T21:38:24.113990] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-15T21:38:24.171958] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T21:38:24.913999] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-15T21:38:24.975605] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T21:38:24.978080] [INFO ] [REMOTE ] SPRU: Full fetch complete (12027 records). [2025-10-15T21:38:24.978197] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-15T21:38:25.365421] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-15T21:38:25.365518] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-15T21:38:25.366037] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-15T21:38:25.366101] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-15T21:38:25.366684] [DEBUG] [LOCAL ] SPRU: Trimmed 12027 records to 9767 (keeping 200 days of data) [2025-10-15T21:38:25.425818] [DEBUG] [LOCAL ] SPRU: Primary data saved (9767 records). [2025-10-15T21:38:25.426007] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-15T21:38:25.426119] [INFO ] [MAIN ] Update Progress: 1979/2369 symbols completed. SPRU took 39.2s. Estimated remaining: 54m 51s. Rate: 7.1 symbols/min [2025-10-15T21:38:25.633673] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:38:25.684606] [DEBUG] [LOCAL ] SQM: Loaded 48759 existing records from primary storage. [2025-10-15T21:38:25.685084] [INFO ] [MAIN ] SQM: Loaded 48759 existing records. [2025-10-15T21:38:25.719181] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-15T21:38:25.876251] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:38:25.876490] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-15T21:38:25.876538] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-15T21:38:25.877276] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-15T21:38:25.877335] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-15T21:38:26.227823] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:38:26.357758] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T21:38:26.360274] [INFO ] [REMOTE ] SPXX: Full fetch complete (13378 records). [2025-10-15T21:38:26.360395] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-15T21:38:26.520147] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-15T21:38:26.758148] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-15T21:38:26.758311] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-15T21:38:26.758885] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-15T21:38:26.758971] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-15T21:38:26.759912] [DEBUG] [LOCAL ] SPXX: Trimmed 13378 records to 9312 (keeping 200 days of data) [2025-10-15T21:38:26.821731] [DEBUG] [LOCAL ] SPXX: Primary data saved (9312 records). [2025-10-15T21:38:26.821939] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-15T21:38:26.822051] [INFO ] [MAIN ] Update Progress: 1980/2369 symbols completed. SPXX took 19.4s. Estimated remaining: 54m 41s. Rate: 7.1 symbols/min [2025-10-15T21:38:27.022729] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:38:27.024576] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-15T21:38:27.032364] [INFO ] [REMOTE ] SPOT: Full fetch complete (73725 records). [2025-10-15T21:38:27.032521] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-15T21:38:27.324296] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-15T21:38:27.292436] [DEBUG] [LOCAL ] SQNS: Loaded 27373 existing records from primary storage. [2025-10-15T21:38:27.346448] [INFO ] [MAIN ] SQNS: Loaded 27373 existing records. [2025-10-15T21:38:27.575635] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T21:38:27.662628] [INFO ] [REMOTE ] SPXC: Full fetch complete (34096 records). [2025-10-15T21:38:27.711517] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-15T21:38:27.712483] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-15T21:38:27.715670] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:38:27.715982] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-15T21:38:27.729150] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-15T21:38:27.717296] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-15T21:38:27.738586] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-15T21:38:27.738750] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-15T21:38:27.760398] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-15T21:38:27.785627] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-15T21:38:27.899474] [DEBUG] [LOCAL ] SPOT: Trimmed 73725 records to 50317 (keeping 200 days of data) [2025-10-15T21:38:28.478983] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-15T21:38:28.488866] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-15T21:38:28.501280] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-15T21:38:28.506821] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-15T21:38:28.566913] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:38:28.570260] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-15T21:38:28.573342] [DEBUG] [LOCAL ] SPXC: Trimmed 34096 records to 23421 (keeping 200 days of data) [2025-10-15T21:38:28.929086] [DEBUG] [LOCAL ] SPXC: Primary data saved (23421 records). [2025-10-15T21:38:28.929204] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-15T21:38:28.929312] [INFO ] [MAIN ] Update Progress: 1981/2369 symbols completed. SPXC took 39.3s. Estimated remaining: 54m 32s. Rate: 7.1 symbols/min [2025-10-15T21:38:28.929001] [DEBUG] [LOCAL ] SPOT: Primary data saved (50317 records). [2025-10-15T21:38:28.940666] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-15T21:38:28.951777] [INFO ] [MAIN ] Update Progress: 1982/2369 symbols completed. SPOT took 53.4s. Estimated remaining: 54m 22s. Rate: 7.1 symbols/min [2025-10-15T21:38:29.243426] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:38:29.276332] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:38:29.308059] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-15T21:38:29.318471] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-15T21:38:29.359072] [DEBUG] [LOCAL ] SR: Loaded 32518 existing records from primary storage. [2025-10-15T21:38:29.359530] [INFO ] [MAIN ] SR: Loaded 32518 existing records. [2025-10-15T21:38:29.533909] [DEBUG] [LOCAL ] SRE: Loaded 53419 existing records from primary storage. [2025-10-15T21:38:29.581178] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:38:29.576489] [INFO ] [MAIN ] SRE: Loaded 53419 existing records. [2025-10-15T21:38:29.585562] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-15T21:38:29.617499] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T21:38:29.617058] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-15T21:38:29.633345] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-15T21:38:29.664375] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-15T21:38:29.719142] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-15T21:38:29.921564] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:38:29.930033] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-15T21:38:29.931346] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-15T21:38:29.946730] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-15T21:38:29.980940] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-15T21:38:30.277951] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:38:30.465359] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:38:30.513947] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-15T21:38:30.712288] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T21:38:30.887936] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T21:38:31.314082] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-15T21:38:32.114033] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-15T21:38:32.228072] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T21:38:32.481678] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T21:38:32.914045] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-15T21:38:33.645765] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T21:38:33.713998] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-15T21:38:34.514060] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-15T21:38:34.686234] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T21:38:35.314030] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-15T21:38:35.414264] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T21:38:35.442985] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T21:38:36.114036] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-15T21:38:36.827334] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T21:38:36.913948] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-15T21:38:37.714050] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-15T21:38:37.794217] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T21:38:38.430861] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T21:38:38.513957] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-15T21:38:38.687288] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T21:38:39.314058] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-15T21:38:39.745954] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T21:38:40.114062] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-15T21:38:40.869002] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T21:38:40.875250] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T21:38:40.914007] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-15T21:38:41.713966] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-15T21:38:42.172211] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T21:38:42.513972] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-15T21:38:42.672484] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T21:38:43.313994] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-15T21:38:44.113982] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-15T21:38:44.202258] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T21:38:44.914070] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-15T21:38:45.459172] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T21:38:45.624726] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-15T21:38:45.713970] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-15T21:38:46.513989] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-15T21:38:46.728979] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T21:38:47.313959] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-15T21:38:47.711313] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T21:38:47.784365] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T21:38:48.113984] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-15T21:38:48.850688] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T21:38:48.913978] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-15T21:38:49.658014] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T21:38:49.713952] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-15T21:38:50.514014] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-15T21:38:50.818205] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T21:38:50.837711] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T21:38:50.840903] [INFO ] [REMOTE ] SQNS: Full fetch complete (33057 records). [2025-10-15T21:38:50.840977] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-15T21:38:51.199893] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-15T21:38:51.199966] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-15T21:38:51.200631] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-15T21:38:51.200705] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-15T21:38:51.201493] [DEBUG] [LOCAL ] SQNS: Trimmed 33057 records to 27540 (keeping 200 days of data) [2025-10-15T21:38:51.329629] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-15T21:38:51.355626] [DEBUG] [LOCAL ] SQNS: Primary data saved (27540 records). [2025-10-15T21:38:51.355837] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-15T21:38:51.355919] [INFO ] [MAIN ] Update Progress: 1983/2369 symbols completed. SQNS took 24.5s. Estimated remaining: 54m 16s. Rate: 7.1 symbols/min [2025-10-15T21:38:51.522778] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:38:51.533495] [DEBUG] [LOCAL ] SREA: Loaded 10122 existing records from primary storage. [2025-10-15T21:38:51.533743] [INFO ] [MAIN ] SREA: Loaded 10122 existing records. [2025-10-15T21:38:51.705117] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:38:51.705352] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-15T21:38:51.705400] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-15T21:38:51.705724] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-15T21:38:51.705783] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-15T21:38:52.068250] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:38:52.113954] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-15T21:38:52.275258] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T21:38:52.672859] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T21:38:52.689873] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T21:38:52.914036] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-15T21:38:53.714009] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-15T21:38:54.331627] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T21:38:54.513992] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-15T21:38:55.313980] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-15T21:38:55.529077] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T21:38:55.820013] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T21:38:55.892600] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T21:38:56.113985] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-15T21:38:56.913962] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-15T21:38:57.365781] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T21:38:57.713987] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-15T21:38:58.514014] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-15T21:38:58.772701] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T21:38:59.250286] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T21:38:59.313949] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-15T21:38:59.867050] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T21:39:00.113995] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-15T21:39:00.748801] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:39:00.914078] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-15T21:39:01.701286] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T21:39:01.714034] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-15T21:39:02.103155] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T21:39:02.198711] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-15T21:39:02.514043] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-15T21:39:03.314060] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-15T21:39:03.870234] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T21:39:04.113996] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-15T21:39:04.157133] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T21:39:04.914002] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-15T21:39:05.714019] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-15T21:39:05.838851] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T21:39:05.855368] [INFO ] [REMOTE ] SQM: Full fetch complete (69607 records). [2025-10-15T21:39:05.856629] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-15T21:39:05.856480] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T21:39:06.287359] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-15T21:39:06.287492] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-15T21:39:06.289371] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-15T21:39:06.289444] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-15T21:39:06.291592] [DEBUG] [LOCAL ] SQM: Trimmed 69607 records to 48822 (keeping 200 days of data) [2025-10-15T21:39:06.402375] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T21:39:06.423034] [INFO ] [REMOTE ] SRE: Full fetch complete (77485 records). [2025-10-15T21:39:06.433071] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-15T21:39:06.534363] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-15T21:39:06.834517] [DEBUG] [LOCAL ] SQM: Primary data saved (48822 records). [2025-10-15T21:39:06.894671] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-15T21:39:06.905959] [INFO ] [MAIN ] Update Progress: 1984/2369 symbols completed. SQM took 41.5s. Estimated remaining: 54m 9s. Rate: 7.1 symbols/min [2025-10-15T21:39:07.199974] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:07.222634] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-15T21:39:07.222757] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-15T21:39:07.223928] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-15T21:39:07.224095] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-15T21:39:07.225584] [DEBUG] [LOCAL ] SRE: Trimmed 77485 records to 53420 (keeping 200 days of data) [2025-10-15T21:39:07.317222] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-15T21:39:07.355372] [DEBUG] [LOCAL ] SRFM: Loaded 38827 existing records from primary storage. [2025-10-15T21:39:07.359470] [INFO ] [MAIN ] SRFM: Loaded 38827 existing records. [2025-10-15T21:39:07.623683] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:39:07.633185] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-15T21:39:07.633252] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-15T21:39:07.659508] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-15T21:39:07.660547] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-15T21:39:07.929830] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T21:39:08.006718] [INFO ] [REMOTE ] SR: Full fetch complete (46207 records). [2025-10-15T21:39:08.014824] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-15T21:39:08.273021] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:08.274290] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-15T21:39:08.281939] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T21:39:08.629470] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-15T21:39:08.630379] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-15T21:39:08.631620] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-15T21:39:08.632014] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-15T21:39:08.637727] [DEBUG] [LOCAL ] SR: Trimmed 46207 records to 32516 (keeping 200 days of data) [2025-10-15T21:39:08.643987] [DEBUG] [LOCAL ] SRE: Primary data saved (53420 records). [2025-10-15T21:39:08.644137] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-15T21:39:08.644223] [INFO ] [MAIN ] Update Progress: 1985/2369 symbols completed. SRE took 39.7s. Estimated remaining: 53m 59s. Rate: 7.1 symbols/min [2025-10-15T21:39:08.920620] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-15T21:39:08.951900] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:08.979233] [DEBUG] [LOCAL ] SRG: Loaded 15358 existing records from primary storage. [2025-10-15T21:39:08.980697] [INFO ] [MAIN ] SRG: Loaded 15358 existing records. [2025-10-15T21:39:09.178597] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:39:09.184371] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-15T21:39:09.184486] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-15T21:39:09.184842] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-15T21:39:09.222143] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-15T21:39:09.623416] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:09.627223] [DEBUG] [LOCAL ] SR: Primary data saved (32516 records). [2025-10-15T21:39:09.627588] [INFO ] [MAIN ] SR: Full history saved. [2025-10-15T21:39:09.627702] [INFO ] [MAIN ] Update Progress: 1986/2369 symbols completed. SR took 40.7s. Estimated remaining: 53m 49s. Rate: 7.1 symbols/min [2025-10-15T21:39:09.719905] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-15T21:39:09.791388] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T21:39:09.817634] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:09.844803] [DEBUG] [LOCAL ] SRI: Loaded 26491 existing records from primary storage. [2025-10-15T21:39:09.845060] [INFO ] [MAIN ] SRI: Loaded 26491 existing records. [2025-10-15T21:39:10.022435] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:39:10.022739] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-15T21:39:10.022864] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-15T21:39:10.023371] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-15T21:39:10.023426] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-15T21:39:10.194353] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-15T21:39:10.416104] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:10.513951] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-15T21:39:10.962410] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T21:39:11.313989] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-15T21:39:11.427622] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T21:39:12.114008] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-15T21:39:12.282983] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T21:39:12.844108] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T21:39:12.914032] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-15T21:39:13.644052] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T21:39:13.714044] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-15T21:39:14.514072] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-15T21:39:14.927310] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T21:39:15.196515] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:39:15.198014] [INFO ] [REMOTE ] SREA: Full fetch complete (15318 records). [2025-10-15T21:39:15.198083] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-15T21:39:15.319183] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-15T21:39:15.556705] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-15T21:39:15.556787] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-15T21:39:15.557113] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-15T21:39:15.557152] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-15T21:39:15.557756] [DEBUG] [LOCAL ] SREA: Trimmed 15318 records to 10033 (keeping 200 days of data) [2025-10-15T21:39:15.620576] [DEBUG] [LOCAL ] SREA: Primary data saved (10033 records). [2025-10-15T21:39:15.620756] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-15T21:39:15.620865] [INFO ] [MAIN ] Update Progress: 1987/2369 symbols completed. SREA took 24.3s. Estimated remaining: 53m 40s. Rate: 7.1 symbols/min [2025-10-15T21:39:15.796052] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:15.797253] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-15T21:39:15.797307] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-15T21:39:15.797488] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-15T21:39:15.797542] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-15T21:39:15.797585] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-15T21:39:15.797795] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-15T21:39:16.121579] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-15T21:39:16.151376] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:16.695172] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T21:39:16.712057] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T21:39:16.914002] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-15T21:39:17.714001] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-15T21:39:17.959518] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T21:39:18.513999] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-15T21:39:19.105339] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T21:39:19.155814] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T21:39:19.313996] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-15T21:39:19.786279] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T21:39:20.114011] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-15T21:39:20.476561] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T21:39:20.914016] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-15T21:39:21.714010] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-15T21:39:22.293380] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T21:39:22.514025] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-15T21:39:22.865139] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T21:39:23.314043] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-15T21:39:23.916165] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T21:39:24.114015] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-15T21:39:24.552891] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T21:39:24.914015] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-15T21:39:25.086251] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T21:39:25.714003] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-15T21:39:26.197988] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T21:39:26.513981] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-15T21:39:26.551880] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T21:39:26.871317] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T21:39:27.314022] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-15T21:39:28.114017] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-15T21:39:28.645325] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T21:39:28.913971] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-15T21:39:29.218340] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T21:39:29.714010] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-15T21:39:30.193261] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T21:39:30.201561] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-15T21:39:30.514047] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-15T21:39:30.952408] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T21:39:31.313987] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-15T21:39:32.114025] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-15T21:39:32.369115] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T21:39:32.914055] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-15T21:39:33.209325] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T21:39:33.714045] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-15T21:39:33.829460] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T21:39:34.056081] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T21:39:34.514045] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-15T21:39:35.261699] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T21:39:35.313986] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-15T21:39:35.655385] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T21:39:36.114006] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-15T21:39:36.895947] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T21:39:36.913957] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-15T21:39:37.714028] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-15T21:39:37.856171] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T21:39:38.514022] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-15T21:39:39.314007] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-15T21:39:39.539236] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T21:39:39.554395] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T21:39:39.557047] [INFO ] [REMOTE ] SRI: Full fetch complete (40205 records). [2025-10-15T21:39:39.557127] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-15T21:39:39.964488] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-15T21:39:39.964574] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-15T21:39:39.965468] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-15T21:39:39.965535] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-15T21:39:39.966535] [DEBUG] [LOCAL ] SRI: Trimmed 40205 records to 26475 (keeping 200 days of data) [2025-10-15T21:39:40.115555] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-15T21:39:40.125525] [DEBUG] [LOCAL ] SRI: Primary data saved (26475 records). [2025-10-15T21:39:40.125715] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-15T21:39:40.125839] [INFO ] [MAIN ] Update Progress: 1988/2369 symbols completed. SRI took 30.5s. Estimated remaining: 53m 35s. Rate: 7.1 symbols/min [2025-10-15T21:39:40.324847] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:40.335771] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T21:39:40.346839] [DEBUG] [LOCAL ] SRV: Loaded 7392 existing records from primary storage. [2025-10-15T21:39:40.347070] [INFO ] [MAIN ] SRV: Loaded 7392 existing records. [2025-10-15T21:39:40.484215] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-15T21:39:40.551310] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:39:40.551553] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-15T21:39:40.551638] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-15T21:39:40.552105] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-15T21:39:40.552184] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-15T21:39:40.921367] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-15T21:39:40.957796] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:41.299572] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-15T21:39:41.714013] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-15T21:39:42.457156] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T21:39:42.513960] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-15T21:39:43.277715] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T21:39:43.313955] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-15T21:39:44.012622] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T21:39:44.114011] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-15T21:39:44.913996] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-15T21:39:45.668798] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T21:39:45.670956] [INFO ] [REMOTE ] SRG: Full fetch complete (23403 records). [2025-10-15T21:39:45.671041] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-15T21:39:45.719271] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-15T21:39:46.050875] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-15T21:39:46.050978] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-15T21:39:46.051706] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-15T21:39:46.051768] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-15T21:39:46.052496] [DEBUG] [LOCAL ] SRG: Trimmed 23403 records to 15416 (keeping 200 days of data) [2025-10-15T21:39:46.145713] [DEBUG] [LOCAL ] SRG: Primary data saved (15416 records). [2025-10-15T21:39:46.145912] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-15T21:39:46.146041] [INFO ] [MAIN ] Update Progress: 1989/2369 symbols completed. SRG took 37.5s. Estimated remaining: 53m 26s. Rate: 7.1 symbols/min [2025-10-15T21:39:46.325826] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:46.368111] [DEBUG] [LOCAL ] SSB: Loaded 42733 existing records from primary storage. [2025-10-15T21:39:46.368899] [INFO ] [MAIN ] SSB: Loaded 42733 existing records. [2025-10-15T21:39:46.516061] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-15T21:39:46.556201] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:39:46.565386] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-15T21:39:46.565954] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T21:39:46.566226] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-15T21:39:46.570969] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-15T21:39:46.571043] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-15T21:39:46.943775] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T21:39:46.988069] [INFO ] [REMOTE ] SRL: Full fetch complete (1944 records). [2025-10-15T21:39:46.963794] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-15T21:39:46.994229] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-15T21:39:46.994099] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:47.193770] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T21:39:47.193988] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:39:47.194069] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:39:47.194144] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-15T21:39:47.194212] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-15T21:39:47.194297] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-15T21:39:47.194355] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-15T21:39:47.194414] [INFO ] [MAIN ] Update Progress: 1990/2369 symbols completed. SRL took 31.6s. Estimated remaining: 53m 16s. Rate: 7.1 symbols/min [2025-10-15T21:39:47.319231] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-15T21:39:47.365410] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:39:47.390560] [DEBUG] [LOCAL ] SSD: Loaded 22619 existing records from primary storage. [2025-10-15T21:39:47.390848] [INFO ] [MAIN ] SSD: Loaded 22619 existing records. [2025-10-15T21:39:47.561979] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:39:47.562216] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-15T21:39:47.562265] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-15T21:39:47.562815] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-15T21:39:47.562873] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-15T21:39:47.929976] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:39:48.114002] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-15T21:39:48.914060] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-15T21:39:49.200983] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T21:39:49.511831] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T21:39:49.714008] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-15T21:39:50.394002] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T21:39:50.513970] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-15T21:39:50.823730] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T21:39:51.260752] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T21:39:51.313968] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-15T21:39:51.794971] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T21:39:52.114007] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-15T21:39:52.914000] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-15T21:39:53.002536] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T21:39:53.714003] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-15T21:39:54.472634] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T21:39:54.513971] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-15T21:39:54.807937] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T21:39:55.314063] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-15T21:39:55.573790] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T21:39:56.034083] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T21:39:56.113989] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-15T21:39:56.832698] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T21:39:56.913963] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-15T21:39:57.713987] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-15T21:39:58.445338] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T21:39:58.446482] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T21:39:58.514008] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-15T21:39:59.314026] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-15T21:40:00.113999] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-15T21:40:00.290969] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T21:40:00.429564] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T21:40:00.914016] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-15T21:40:01.714041] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-15T21:40:02.248300] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-15T21:40:02.391912] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:40:02.393293] [INFO ] [REMOTE ] SRV: Full fetch complete (11357 records). [2025-10-15T21:40:02.393364] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-15T21:40:02.515082] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-15T21:40:02.730760] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:40:02.816403] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-15T21:40:02.816485] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-15T21:40:02.816831] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-15T21:40:02.816893] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-15T21:40:02.817355] [DEBUG] [LOCAL ] SRV: Trimmed 11357 records to 7403 (keeping 200 days of data) [2025-10-15T21:40:02.867138] [DEBUG] [LOCAL ] SRV: Primary data saved (7403 records). [2025-10-15T21:40:02.867325] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-15T21:40:02.867435] [INFO ] [MAIN ] Update Progress: 1991/2369 symbols completed. SRV took 22.7s. Estimated remaining: 53m 9s. Rate: 7.1 symbols/min [2025-10-15T21:40:03.060738] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:40:03.100458] [DEBUG] [LOCAL ] SSL: Loaded 41508 existing records from primary storage. [2025-10-15T21:40:03.100808] [INFO ] [MAIN ] SSL: Loaded 41508 existing records. [2025-10-15T21:40:03.277513] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:40:03.277763] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-15T21:40:03.277828] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-15T21:40:03.278489] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-15T21:40:03.278548] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-15T21:40:03.320522] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-15T21:40:03.635160] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:40:04.114020] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-15T21:40:04.830582] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-15T21:40:04.836797] [INFO ] [REMOTE ] SRFM: Full fetch complete (50800 records). [2025-10-15T21:40:04.836931] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-15T21:40:04.917169] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-15T21:40:05.230088] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-15T21:40:05.230504] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-15T21:40:05.245473] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-15T21:40:05.251700] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-15T21:40:05.256289] [DEBUG] [LOCAL ] SRFM: Trimmed 50800 records to 39060 (keeping 200 days of data) [2025-10-15T21:40:05.257216] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-15T21:40:05.366948] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T21:40:05.512547] [DEBUG] [LOCAL ] SRFM: Primary data saved (39060 records). [2025-10-15T21:40:05.512710] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-15T21:40:05.512801] [INFO ] [MAIN ] Update Progress: 1992/2369 symbols completed. SRFM took 58.6s. Estimated remaining: 52m 60s. Rate: 7.1 symbols/min [2025-10-15T21:40:05.681725] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:40:05.694416] [DEBUG] [LOCAL ] SST: Loaded 11578 existing records from primary storage. [2025-10-15T21:40:05.694686] [INFO ] [MAIN ] SST: Loaded 11578 existing records. [2025-10-15T21:40:05.725053] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-15T21:40:05.873676] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:40:05.873865] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-15T21:40:05.873914] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-15T21:40:05.874074] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-15T21:40:05.874113] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-15T21:40:06.238769] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:40:06.359434] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T21:40:06.513981] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-15T21:40:07.313966] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-15T21:40:07.331717] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T21:40:07.504981] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T21:40:08.114009] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-15T21:40:08.914023] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-15T21:40:09.118537] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T21:40:09.178514] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T21:40:09.662798] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T21:40:09.714051] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-15T21:40:10.514008] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-15T21:40:10.796391] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T21:40:11.314013] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-15T21:40:11.941566] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:40:12.114016] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-15T21:40:12.156777] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T21:40:12.913998] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-15T21:40:13.285519] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T21:40:13.714009] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-15T21:40:14.368114] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T21:40:14.513964] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-15T21:40:14.847355] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T21:40:15.314061] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-15T21:40:15.500239] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T21:40:16.114030] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-15T21:40:16.837850] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T21:40:16.914032] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-15T21:40:17.719751] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-15T21:40:17.725557] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T21:40:17.860057] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T21:40:18.514018] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-15T21:40:19.314069] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-15T21:40:19.441684] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T21:40:19.866150] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T21:40:19.871326] [INFO ] [REMOTE ] SSB: Full fetch complete (61554 records). [2025-10-15T21:40:19.871418] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-15T21:40:20.114402] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-15T21:40:20.237159] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T21:40:20.294713] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-15T21:40:20.294795] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-15T21:40:20.295853] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-15T21:40:20.295919] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-15T21:40:20.297165] [DEBUG] [LOCAL ] SSB: Trimmed 61554 records to 42768 (keeping 200 days of data) [2025-10-15T21:40:20.558939] [DEBUG] [LOCAL ] SSB: Primary data saved (42768 records). [2025-10-15T21:40:20.559041] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-15T21:40:20.559847] [INFO ] [MAIN ] Update Progress: 1993/2369 symbols completed. SSB took 34.4s. Estimated remaining: 52m 53s. Rate: 7.1 symbols/min [2025-10-15T21:40:20.733791] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:40:20.760474] [DEBUG] [LOCAL ] SSTK: Loaded 25249 existing records from primary storage. [2025-10-15T21:40:20.760765] [INFO ] [MAIN ] SSTK: Loaded 25249 existing records. [2025-10-15T21:40:20.915929] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-15T21:40:20.937482] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:40:20.937778] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-15T21:40:20.938599] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-15T21:40:20.938842] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-15T21:40:20.938897] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-15T21:40:21.286214] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:40:21.713997] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-15T21:40:21.798776] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T21:40:21.863283] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T21:40:22.514022] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-15T21:40:22.823813] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T21:40:23.314063] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-15T21:40:23.865558] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T21:40:24.114018] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-15T21:40:24.346612] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T21:40:24.350764] [INFO ] [REMOTE ] SSD: Full fetch complete (32340 records). [2025-10-15T21:40:24.350888] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-15T21:40:24.724912] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-15T21:40:24.724986] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-15T21:40:24.725707] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-15T21:40:24.725769] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-15T21:40:24.726638] [DEBUG] [LOCAL ] SSD: Trimmed 32340 records to 22608 (keeping 200 days of data) [2025-10-15T21:40:24.868034] [DEBUG] [LOCAL ] SSD: Primary data saved (22608 records). [2025-10-15T21:40:24.868159] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-15T21:40:24.868254] [INFO ] [MAIN ] Update Progress: 1994/2369 symbols completed. SSD took 37.7s. Estimated remaining: 52m 43s. Rate: 7.1 symbols/min [2025-10-15T21:40:24.928980] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-15T21:40:25.039436] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:40:25.047675] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T21:40:25.097055] [DEBUG] [LOCAL ] ST: Loaded 49853 existing records from primary storage. [2025-10-15T21:40:25.097387] [INFO ] [MAIN ] ST: Loaded 49853 existing records. [2025-10-15T21:40:25.272115] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:40:25.272384] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-15T21:40:25.272442] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-15T21:40:25.272848] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-15T21:40:25.272903] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-15T21:40:25.619110] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:40:25.713951] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-15T21:40:26.514051] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-15T21:40:26.552718] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T21:40:27.269546] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T21:40:27.313961] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-15T21:40:27.448858] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T21:40:27.699668] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-15T21:40:28.113997] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-15T21:40:28.914058] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-15T21:40:29.719807] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-15T21:40:29.730882] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T21:40:30.251233] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T21:40:30.252451] [INFO ] [REMOTE ] SST: Full fetch complete (18472 records). [2025-10-15T21:40:30.252519] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-15T21:40:30.519148] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-15T21:40:30.619008] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-15T21:40:30.619085] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-15T21:40:30.619474] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-15T21:40:30.619513] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-15T21:40:30.620052] [DEBUG] [LOCAL ] SST: Trimmed 18472 records to 11585 (keeping 200 days of data) [2025-10-15T21:40:30.699674] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T21:40:30.727528] [DEBUG] [LOCAL ] SST: Primary data saved (11585 records). [2025-10-15T21:40:30.727699] [INFO ] [MAIN ] SST: Full history saved. [2025-10-15T21:40:30.727793] [INFO ] [MAIN ] Update Progress: 1995/2369 symbols completed. SST took 25.2s. Estimated remaining: 52m 34s. Rate: 7.1 symbols/min [2025-10-15T21:40:30.892175] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:40:30.936211] [DEBUG] [LOCAL ] STAG: Loaded 50116 existing records from primary storage. [2025-10-15T21:40:30.936533] [INFO ] [MAIN ] STAG: Loaded 50116 existing records. [2025-10-15T21:40:31.109072] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:40:31.109323] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-15T21:40:31.109369] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-15T21:40:31.109671] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-15T21:40:31.109729] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-15T21:40:31.319390] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-15T21:40:31.463811] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:40:32.064095] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T21:40:32.113970] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-15T21:40:32.911223] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:40:32.918886] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-15T21:40:33.713986] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-15T21:40:33.764065] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T21:40:34.514025] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-15T21:40:34.547572] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T21:40:35.118169] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T21:40:35.314066] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-15T21:40:35.936867] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T21:40:36.113992] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-15T21:40:36.913979] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-15T21:40:37.027817] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T21:40:37.481009] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T21:40:37.486193] [INFO ] [REMOTE ] SSL: Full fetch complete (60104 records). [2025-10-15T21:40:37.486310] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-15T21:40:37.721993] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-15T21:40:37.871770] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-15T21:40:37.871846] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-15T21:40:37.872784] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-15T21:40:37.872844] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-15T21:40:37.873991] [DEBUG] [LOCAL ] SSL: Trimmed 60104 records to 41512 (keeping 200 days of data) [2025-10-15T21:40:38.103392] [DEBUG] [LOCAL ] SSL: Primary data saved (41512 records). [2025-10-15T21:40:38.103521] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-15T21:40:38.104074] [INFO ] [MAIN ] Update Progress: 1996/2369 symbols completed. SSL took 35.2s. Estimated remaining: 52m 26s. Rate: 7.1 symbols/min [2025-10-15T21:40:38.272519] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:40:38.292187] [DEBUG] [LOCAL ] STC: Loaded 17320 existing records from primary storage. [2025-10-15T21:40:38.292424] [INFO ] [MAIN ] STC: Loaded 17320 existing records. [2025-10-15T21:40:38.471819] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:40:38.472087] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-15T21:40:38.472137] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-15T21:40:38.472365] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-15T21:40:38.472426] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-15T21:40:38.519171] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-15T21:40:38.725175] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T21:40:38.880794] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:40:39.313958] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-15T21:40:39.513700] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T21:40:40.114042] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-15T21:40:40.281043] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T21:40:40.328380] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T21:40:40.914051] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-15T21:40:41.713981] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-15T21:40:41.750292] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T21:40:42.472850] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T21:40:42.513950] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-15T21:40:42.816061] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T21:40:43.314046] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-15T21:40:44.114033] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-15T21:40:44.349372] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T21:40:44.900452] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T21:40:44.913942] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-15T21:40:45.259969] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T21:40:45.714034] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-15T21:40:46.518909] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-15T21:40:46.525089] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T21:40:46.902138] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T21:40:47.314005] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-15T21:40:47.561610] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T21:40:48.114013] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-15T21:40:48.913971] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-15T21:40:49.152487] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T21:40:49.193957] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T21:40:49.714017] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-15T21:40:50.084523] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T21:40:50.513999] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-15T21:40:51.317929] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-15T21:40:51.320949] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T21:40:52.114000] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-15T21:40:52.260492] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T21:40:52.482806] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T21:40:52.914051] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-15T21:40:53.714003] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-15T21:40:53.756944] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T21:40:54.113939] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T21:40:54.514012] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-15T21:40:55.160319] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T21:40:55.313903] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-15T21:40:55.555786] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T21:40:56.114077] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-15T21:40:56.744338] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T21:40:56.750482] [INFO ] [REMOTE ] ST: Full fetch complete (72113 records). [2025-10-15T21:40:56.750587] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-15T21:40:56.923564] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-15T21:40:57.084802] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T21:40:57.104677] [INFO ] [REMOTE ] SSTK: Full fetch complete (41601 records). [2025-10-15T21:40:57.115118] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-15T21:40:57.305372] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-15T21:40:57.311232] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-15T21:40:57.317701] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-15T21:40:57.317790] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-15T21:40:57.376327] [DEBUG] [LOCAL ] ST: Trimmed 72113 records to 49847 (keeping 200 days of data) [2025-10-15T21:40:57.775559] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-15T21:40:57.823032] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-15T21:40:57.823528] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-15T21:40:57.844311] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-15T21:40:57.849636] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-15T21:40:57.866369] [DEBUG] [LOCAL ] SSTK: Trimmed 41601 records to 25292 (keeping 200 days of data) [2025-10-15T21:40:58.020340] [DEBUG] [LOCAL ] ST: Primary data saved (49847 records). [2025-10-15T21:40:58.023003] [INFO ] [MAIN ] ST: Full history saved. [2025-10-15T21:40:58.023433] [INFO ] [MAIN ] Update Progress: 1997/2369 symbols completed. ST took 33.2s. Estimated remaining: 52m 19s. Rate: 7.1 symbols/min [2025-10-15T21:40:58.084951] [DEBUG] [LOCAL ] SSTK: Primary data saved (25292 records). [2025-10-15T21:40:58.085110] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-15T21:40:58.085203] [INFO ] [MAIN ] Update Progress: 1998/2369 symbols completed. SSTK took 37.5s. Estimated remaining: 52m 9s. Rate: 7.1 symbols/min [2025-10-15T21:40:58.755747] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T21:40:58.766892] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-15T21:40:58.807968] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T21:40:59.314013] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-15T21:41:00.344545] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T21:41:00.349083] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-15T21:41:00.572754] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T21:41:00.914033] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-15T21:41:01.448031] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T21:41:01.714467] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-15T21:41:02.467594] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:41:02.513972] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-15T21:41:02.817739] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T21:41:03.314008] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-15T21:41:04.136694] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T21:41:04.143730] [INFO ] [REMOTE ] STAG: Full fetch complete (72471 records). [2025-10-15T21:41:04.143886] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-15T21:41:04.422784] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T21:41:04.462983] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-15T21:41:04.593581] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-15T21:41:04.593708] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-15T21:41:04.594818] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-15T21:41:04.594896] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-15T21:41:04.596405] [DEBUG] [LOCAL ] STAG: Trimmed 72471 records to 50134 (keeping 200 days of data) [2025-10-15T21:41:04.907219] [DEBUG] [LOCAL ] STAG: Primary data saved (50134 records). [2025-10-15T21:41:04.907347] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-15T21:41:04.907439] [INFO ] [MAIN ] Update Progress: 1999/2369 symbols completed. STAG took 34.2s. Estimated remaining: 52m 1s. Rate: 7.1 symbols/min [2025-10-15T21:41:05.484676] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T21:41:05.488857] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-15T21:41:06.388277] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T21:41:06.391489] [INFO ] [REMOTE ] STC: Full fetch complete (25579 records). [2025-10-15T21:41:06.391585] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-15T21:41:06.753364] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-15T21:41:06.753438] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-15T21:41:06.753978] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-15T21:41:06.754058] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-15T21:41:06.754679] [DEBUG] [LOCAL ] STC: Trimmed 25579 records to 17323 (keeping 200 days of data) [2025-10-15T21:41:06.863026] [DEBUG] [LOCAL ] STC: Primary data saved (17323 records). [2025-10-15T21:41:06.863181] [INFO ] [MAIN ] STC: Full history saved. [2025-10-15T21:41:06.863261] [INFO ] [MAIN ] Update Progress: 2000/2369 symbols completed. STC took 28.8s. Estimated remaining: 51m 51s. Rate: 7.1 symbols/min [2025-10-15T21:41:07.533515] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:07.534944] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:07.637482] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:07.658398] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:07.677041] [DEBUG] [LOCAL ] STEL: Loaded 22708 existing records from primary storage. [2025-10-15T21:41:07.677342] [INFO ] [MAIN ] STEL: Loaded 22708 existing records. [2025-10-15T21:41:07.832694] [DEBUG] [LOCAL ] STEW: Loaded 15793 existing records from primary storage. [2025-10-15T21:41:07.834005] [DEBUG] [LOCAL ] STE: Loaded 35362 existing records from primary storage. [2025-10-15T21:41:07.849666] [INFO ] [MAIN ] STEW: Loaded 15793 existing records. [2025-10-15T21:41:07.865958] [INFO ] [MAIN ] STE: Loaded 35362 existing records. [2025-10-15T21:41:07.901529] [DEBUG] [LOCAL ] STEM: Loaded 38827 existing records from primary storage. [2025-10-15T21:41:07.995417] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:08.035024] [INFO ] [MAIN ] STEM: Loaded 38827 existing records. [2025-10-15T21:41:08.102890] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-15T21:41:08.140837] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-15T21:41:08.205863] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-15T21:41:08.221571] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-15T21:41:08.547639] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:08.576802] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:08.591033] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-15T21:41:08.596278] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-15T21:41:08.596380] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-15T21:41:08.590889] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:08.606976] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-15T21:41:08.606917] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-15T21:41:08.637928] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-15T21:41:08.669123] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-15T21:41:08.687096] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-15T21:41:08.639667] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-15T21:41:08.697564] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-15T21:41:08.791672] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-15T21:41:08.841050] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-15T21:41:09.278297] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:09.314397] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-15T21:41:09.833676] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:09.860436] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-15T21:41:09.960514] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:09.971549] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-15T21:41:10.001461] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:10.002106] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-15T21:41:10.580158] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:41:10.585842] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-15T21:41:10.954114] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T21:41:10.957786] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-15T21:41:11.359418] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T21:41:11.366772] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-15T21:41:11.519400] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T21:41:11.529903] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-15T21:41:11.608191] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T21:41:11.746703] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T21:41:12.114070] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-15T21:41:12.634890] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T21:41:12.914025] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-15T21:41:13.097030] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T21:41:13.713959] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-15T21:41:13.890946] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-15T21:41:14.151907] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T21:41:14.169364] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-15T21:41:14.514056] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-15T21:41:15.314028] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-15T21:41:15.823986] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T21:41:16.114068] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-15T21:41:16.299391] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T21:41:16.913997] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-15T21:41:17.511742] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T21:41:17.714054] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-15T21:41:18.107634] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T21:41:18.422984] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T21:41:18.514029] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-15T21:41:19.306208] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T21:41:19.313947] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-15T21:41:20.113956] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-15T21:41:20.552189] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:41:20.914005] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-15T21:41:21.263950] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T21:41:21.714020] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-15T21:41:21.969879] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T21:41:22.514060] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-15T21:41:23.183417] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T21:41:23.208300] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T21:41:23.313969] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-15T21:41:24.113971] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-15T21:41:24.327331] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T21:41:24.914013] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-15T21:41:25.713961] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-15T21:41:25.925778] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T21:41:25.980852] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T21:41:26.513970] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-15T21:41:26.582204] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T21:41:26.584906] [INFO ] [REMOTE ] STEL: Full fetch complete (31981 records). [2025-10-15T21:41:26.584988] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-15T21:41:26.953490] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-15T21:41:26.953590] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-15T21:41:26.954257] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-15T21:41:26.954318] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-15T21:41:26.955041] [DEBUG] [LOCAL ] STEL: Trimmed 31981 records to 22665 (keeping 200 days of data) [2025-10-15T21:41:27.090924] [DEBUG] [LOCAL ] STEL: Primary data saved (22665 records). [2025-10-15T21:41:27.091043] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-15T21:41:27.091120] [INFO ] [MAIN ] Update Progress: 2001/2369 symbols completed. STEL took 20.2s. Estimated remaining: 51m 45s. Rate: 7.1 symbols/min [2025-10-15T21:41:27.259285] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:27.259446] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-15T21:41:27.259484] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-15T21:41:27.259619] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-15T21:41:27.259693] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-15T21:41:27.259752] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-15T21:41:27.259787] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-15T21:41:27.321291] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-15T21:41:27.612398] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:28.113982] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-15T21:41:28.343003] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T21:41:28.919008] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-15T21:41:28.923430] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T21:41:29.010525] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T21:41:29.714068] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-15T21:41:30.513987] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-15T21:41:30.627803] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T21:41:30.732380] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T21:41:31.313998] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-15T21:41:32.034962] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T21:41:32.114010] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-15T21:41:32.210745] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T21:41:32.913999] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-15T21:41:33.241054] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T21:41:33.714029] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-15T21:41:33.811915] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T21:41:34.513995] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-15T21:41:34.950748] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:41:35.314013] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-15T21:41:36.089816] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T21:41:36.113957] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-15T21:41:36.141251] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T21:41:36.888401] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T21:41:36.890494] [INFO ] [REMOTE ] STEW: Full fetch complete (21730 records). [2025-10-15T21:41:36.890566] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-15T21:41:36.919670] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-15T21:41:37.271865] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-15T21:41:37.272163] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-15T21:41:37.272631] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-15T21:41:37.272728] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-15T21:41:37.273819] [DEBUG] [LOCAL ] STEW: Trimmed 21730 records to 15684 (keeping 200 days of data) [2025-10-15T21:41:37.369086] [DEBUG] [LOCAL ] STEW: Primary data saved (15684 records). [2025-10-15T21:41:37.369222] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-15T21:41:37.369302] [INFO ] [MAIN ] Update Progress: 2002/2369 symbols completed. STEW took 30.4s. Estimated remaining: 51m 37s. Rate: 7.1 symbols/min [2025-10-15T21:41:37.534567] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:37.546078] [DEBUG] [LOCAL ] STK: Loaded 9720 existing records from primary storage. [2025-10-15T21:41:37.546277] [INFO ] [MAIN ] STK: Loaded 9720 existing records. [2025-10-15T21:41:37.718400] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-15T21:41:37.718298] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:37.719848] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-15T21:41:37.719925] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-15T21:41:37.720354] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-15T21:41:37.720411] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-15T21:41:38.071851] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:38.372838] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T21:41:38.513996] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-15T21:41:39.146045] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:41:39.314007] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-15T21:41:39.949437] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T21:41:40.114030] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-15T21:41:40.596766] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-15T21:41:40.623787] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T21:41:40.914007] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-15T21:41:41.714005] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-15T21:41:42.458514] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T21:41:42.463384] [INFO ] [REMOTE ] STEM: Full fetch complete (61428 records). [2025-10-15T21:41:42.463498] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-15T21:41:42.524204] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-15T21:41:42.649841] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T21:41:42.862525] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-15T21:41:42.862629] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-15T21:41:42.863792] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-15T21:41:42.863857] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-15T21:41:42.865108] [DEBUG] [LOCAL ] STEM: Trimmed 61428 records to 38841 (keeping 200 days of data) [2025-10-15T21:41:43.079127] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T21:41:43.092454] [DEBUG] [LOCAL ] STEM: Primary data saved (38841 records). [2025-10-15T21:41:43.092572] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-15T21:41:43.092670] [INFO ] [MAIN ] Update Progress: 2003/2369 symbols completed. STEM took 36.2s. Estimated remaining: 51m 28s. Rate: 7.1 symbols/min [2025-10-15T21:41:43.257438] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:43.307888] [DEBUG] [LOCAL ] STLA: Loaded 53555 existing records from primary storage. [2025-10-15T21:41:43.308279] [INFO ] [MAIN ] STLA: Loaded 53555 existing records. [2025-10-15T21:41:43.319131] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-15T21:41:43.483951] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:43.484172] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-15T21:41:43.484220] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-15T21:41:43.484522] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-15T21:41:43.484560] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-15T21:41:43.828507] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:44.114032] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-15T21:41:44.654352] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T21:41:44.659340] [INFO ] [REMOTE ] STE: Full fetch complete (50797 records). [2025-10-15T21:41:44.659462] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-15T21:41:44.922822] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-15T21:41:44.955438] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T21:41:45.159453] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-15T21:41:45.159527] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-15T21:41:45.160614] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-15T21:41:45.160707] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-15T21:41:45.164601] [DEBUG] [LOCAL ] STE: Trimmed 50797 records to 35387 (keeping 200 days of data) [2025-10-15T21:41:45.397772] [DEBUG] [LOCAL ] STE: Primary data saved (35387 records). [2025-10-15T21:41:45.397915] [INFO ] [MAIN ] STE: Full history saved. [2025-10-15T21:41:45.398014] [INFO ] [MAIN ] Update Progress: 2004/2369 symbols completed. STE took 38.5s. Estimated remaining: 51m 18s. Rate: 7.1 symbols/min [2025-10-15T21:41:45.564524] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:45.617164] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-15T21:41:45.617487] [INFO ] [MAIN ] STM: Loaded 53573 existing records. [2025-10-15T21:41:45.719231] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-15T21:41:45.798151] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:45.798389] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-15T21:41:45.798439] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-15T21:41:45.798939] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-15T21:41:45.798996] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-15T21:41:46.148089] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T21:41:46.147946] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:46.514054] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-15T21:41:47.140622] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-15T21:41:47.159691] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T21:41:47.313995] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-15T21:41:48.114029] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-15T21:41:48.436915] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-15T21:41:48.914049] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-15T21:41:49.466232] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-15T21:41:49.501850] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T21:41:49.713996] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-15T21:41:50.514008] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-15T21:41:50.849495] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T21:41:51.313996] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-15T21:41:51.820255] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-15T21:41:52.113989] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-15T21:41:52.453805] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T21:41:52.913998] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-15T21:41:53.225916] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T21:41:53.714035] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-15T21:41:54.433932] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T21:41:54.514128] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-15T21:41:54.953836] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T21:41:55.314013] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-15T21:41:55.341159] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T21:41:55.754671] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T21:41:56.114001] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-15T21:41:56.840508] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T21:41:56.914008] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-15T21:41:57.347962] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T21:41:57.714007] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-15T21:41:58.514031] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-15T21:41:58.883538] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-15T21:41:58.884270] [INFO ] [REMOTE ] STG: Full fetch complete (2502 records). [2025-10-15T21:41:58.884339] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-15T21:41:59.073801] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-15T21:41:59.074023] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:41:59.074097] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:41:59.074167] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-15T21:41:59.074236] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-15T21:41:59.074273] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-15T21:41:59.074313] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-15T21:41:59.074370] [INFO ] [MAIN ] Update Progress: 2005/2369 symbols completed. STG took 32.0s. Estimated remaining: 51m 11s. Rate: 7.1 symbols/min [2025-10-15T21:41:59.242698] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:41:59.264811] [DEBUG] [LOCAL ] STN: Loaded 22823 existing records from primary storage. [2025-10-15T21:41:59.265059] [INFO ] [MAIN ] STN: Loaded 22823 existing records. [2025-10-15T21:41:59.320902] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-15T21:41:59.448425] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:41:59.448688] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-15T21:41:59.448747] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-15T21:41:59.448944] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-15T21:41:59.448998] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-15T21:41:59.836732] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:41:59.839674] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-15T21:42:00.114042] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-15T21:42:00.914034] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-15T21:42:01.222699] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T21:42:01.713968] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-15T21:42:01.806541] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-15T21:42:02.514019] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-15T21:42:02.790319] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T21:42:02.879102] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T21:42:03.316776] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T21:42:03.316859] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-15T21:42:04.114049] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-15T21:42:04.914033] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-15T21:42:05.453769] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T21:42:05.714098] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-15T21:42:05.748371] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T21:42:05.889903] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T21:42:06.513998] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-15T21:42:06.867353] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T21:42:07.314036] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-15T21:42:08.114027] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-15T21:42:08.728755] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T21:42:08.747124] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T21:42:08.913969] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-15T21:42:09.353614] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T21:42:09.714065] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-15T21:42:10.514043] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-15T21:42:10.576247] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T21:42:11.013727] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-15T21:42:11.314000] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-15T21:42:12.113993] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-15T21:42:12.914102] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-15T21:42:13.014753] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-15T21:42:13.171297] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T21:42:13.277318] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-15T21:42:13.404885] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T21:42:13.407182] [INFO ] [REMOTE ] STK: Full fetch complete (14253 records). [2025-10-15T21:42:13.407315] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-15T21:42:13.719170] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-15T21:42:13.797519] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-15T21:42:13.797614] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-15T21:42:13.797988] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-15T21:42:13.798045] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-15T21:42:13.798807] [DEBUG] [LOCAL ] STK: Trimmed 14253 records to 9726 (keeping 200 days of data) [2025-10-15T21:42:13.859341] [DEBUG] [LOCAL ] STK: Primary data saved (9726 records). [2025-10-15T21:42:13.859510] [INFO ] [MAIN ] STK: Full history saved. [2025-10-15T21:42:13.859602] [INFO ] [MAIN ] Update Progress: 2006/2369 symbols completed. STK took 36.5s. Estimated remaining: 51m 3s. Rate: 7.1 symbols/min [2025-10-15T21:42:14.028362] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:14.070029] [DEBUG] [LOCAL ] STNG: Loaded 43645 existing records from primary storage. [2025-10-15T21:42:14.070311] [INFO ] [MAIN ] STNG: Loaded 43645 existing records. [2025-10-15T21:42:14.273234] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:42:14.273436] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-15T21:42:14.273483] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-15T21:42:14.273797] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-15T21:42:14.273854] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-15T21:42:14.519140] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-15T21:42:14.631010] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:15.004978] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T21:42:15.314012] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-15T21:42:16.114032] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-15T21:42:16.920339] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-15T21:42:16.928032] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T21:42:17.149141] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T21:42:17.714116] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-15T21:42:17.954896] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T21:42:18.241385] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T21:42:18.514002] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-15T21:42:19.313998] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-15T21:42:19.679446] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T21:42:19.927481] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T21:42:20.113967] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-15T21:42:20.454360] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T21:42:20.913993] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-15T21:42:21.693226] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:42:21.714011] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-15T21:42:22.514062] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-15T21:42:22.993029] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T21:42:23.303340] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T21:42:23.313946] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-15T21:42:23.505626] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T21:42:24.114037] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-15T21:42:24.472491] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T21:42:24.914015] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-15T21:42:25.424160] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T21:42:25.713992] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-15T21:42:26.097407] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T21:42:26.514043] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-15T21:42:27.313995] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-15T21:42:27.875191] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-15T21:42:27.882081] [INFO ] [REMOTE ] STLA: Full fetch complete (77652 records). [2025-10-15T21:42:27.882228] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-15T21:42:28.114743] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-15T21:42:28.311607] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T21:42:28.320944] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-15T21:42:28.321411] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-15T21:42:28.322988] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-15T21:42:28.323059] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-15T21:42:28.324573] [DEBUG] [LOCAL ] STLA: Trimmed 77652 records to 53555 (keeping 200 days of data) [2025-10-15T21:42:28.656529] [DEBUG] [LOCAL ] STLA: Primary data saved (53555 records). [2025-10-15T21:42:28.656722] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-15T21:42:28.656828] [INFO ] [MAIN ] Update Progress: 2007/2369 symbols completed. STLA took 45.6s. Estimated remaining: 50m 56s. Rate: 7.1 symbols/min [2025-10-15T21:42:28.843819] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:28.856948] [DEBUG] [LOCAL ] STRV: Loaded 11234 existing records from primary storage. [2025-10-15T21:42:28.857238] [INFO ] [MAIN ] STRV: Loaded 11234 existing records. [2025-10-15T21:42:28.919153] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-15T21:42:29.059081] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:42:29.059339] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-15T21:42:29.059439] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-15T21:42:29.059782] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-15T21:42:29.059842] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-15T21:42:29.307581] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T21:42:29.377191] [INFO ] [REMOTE ] STN: Full fetch complete (32444 records). [2025-10-15T21:42:29.381904] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-15T21:42:29.396088] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-15T21:42:29.499288] [INFO ] [REMOTE ] STM: Full fetch complete (77691 records). [2025-10-15T21:42:29.513071] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-15T21:42:29.596302] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:29.717301] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-15T21:42:30.301517] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-15T21:42:30.305115] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-15T21:42:30.324750] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-15T21:42:30.324982] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-15T21:42:30.325429] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-15T21:42:30.326314] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-15T21:42:30.325331] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-15T21:42:30.326447] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-15T21:42:30.328587] [DEBUG] [LOCAL ] STN: Trimmed 32444 records to 22793 (keeping 200 days of data) [2025-10-15T21:42:30.328733] [DEBUG] [LOCAL ] STM: Trimmed 77691 records to 53572 (keeping 200 days of data) [2025-10-15T21:42:30.586190] [DEBUG] [LOCAL ] STN: Primary data saved (22793 records). [2025-10-15T21:42:30.587566] [INFO ] [MAIN ] STN: Full history saved. [2025-10-15T21:42:30.588213] [INFO ] [MAIN ] Update Progress: 2008/2369 symbols completed. STN took 31.5s. Estimated remaining: 50m 47s. Rate: 7.1 symbols/min [2025-10-15T21:42:30.733489] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T21:42:30.874559] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-15T21:42:30.873767] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:30.939984] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T21:42:31.068364] [DEBUG] [LOCAL ] STM: Primary data saved (53572 records). [2025-10-15T21:42:31.082626] [INFO ] [MAIN ] STM: Full history saved. [2025-10-15T21:42:31.082820] [INFO ] [MAIN ] Update Progress: 2009/2369 symbols completed. STM took 45.7s. Estimated remaining: 50m 37s. Rate: 7.1 symbols/min [2025-10-15T21:42:31.127252] [DEBUG] [LOCAL ] STT: Loaded 51051 existing records from primary storage. [2025-10-15T21:42:31.159677] [INFO ] [MAIN ] STT: Loaded 51051 existing records. [2025-10-15T21:42:31.323145] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-15T21:42:31.383703] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:31.405383] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-15T21:42:31.425938] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-15T21:42:31.431635] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-15T21:42:31.437330] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-15T21:42:31.440882] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-15T21:42:31.447816] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-15T21:42:31.552934] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:42:31.572398] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-15T21:42:31.574766] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-15T21:42:31.575229] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-15T21:42:31.580808] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-15T21:42:32.108841] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:32.133010] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-15T21:42:32.243024] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:32.339905] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T21:42:32.355387] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:42:32.355631] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-15T21:42:32.355741] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:42:32.355788] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-15T21:42:32.355847] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:42:32.355920] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-15T21:42:32.355984] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-15T21:42:32.356021] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-15T21:42:32.356132] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-15T21:42:32.356188] [INFO ] [MAIN ] Update Progress: 2010/2369 symbols completed. STUB took 1.3s. Estimated remaining: 50m 27s. Rate: 7.1 symbols/min [2025-10-15T21:42:32.524957] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:32.550692] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T21:42:32.580775] [DEBUG] [LOCAL ] STVN: Loaded 26710 existing records from primary storage. [2025-10-15T21:42:32.581053] [INFO ] [MAIN ] STVN: Loaded 26710 existing records. [2025-10-15T21:42:32.761060] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:42:32.761327] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-15T21:42:32.761375] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-15T21:42:32.761634] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-15T21:42:32.761730] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-15T21:42:32.917708] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-15T21:42:33.112148] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:33.714046] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-15T21:42:34.513994] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-15T21:42:34.873130] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T21:42:35.020167] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T21:42:35.313973] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-15T21:42:35.334710] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T21:42:36.114031] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-15T21:42:36.914012] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-15T21:42:37.105235] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T21:42:37.332108] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T21:42:37.713968] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-15T21:42:37.851504] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T21:42:38.513988] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-15T21:42:38.925177] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T21:42:39.314027] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-15T21:42:40.113974] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-15T21:42:40.477329] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T21:42:40.557814] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T21:42:40.913995] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-15T21:42:41.616428] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T21:42:41.713997] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-15T21:42:42.020678] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T21:42:42.513976] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-15T21:42:43.313960] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-15T21:42:43.459195] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T21:42:43.479721] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T21:42:44.113999] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-15T21:42:44.764050] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T21:42:44.913966] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-15T21:42:45.544691] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T21:42:45.714004] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-15T21:42:46.189194] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T21:42:46.514006] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-15T21:42:46.813762] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T21:42:47.314043] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-15T21:42:47.326434] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T21:42:48.114042] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-15T21:42:48.914027] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-15T21:42:49.015344] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T21:42:49.017433] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T21:42:49.714021] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-15T21:42:50.215373] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T21:42:50.220393] [INFO ] [REMOTE ] STNG: Full fetch complete (64358 records). [2025-10-15T21:42:50.220519] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-15T21:42:50.515826] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-15T21:42:50.626962] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-15T21:42:50.627864] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T21:42:50.627593] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-15T21:42:50.631945] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-15T21:42:50.632369] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-15T21:42:50.633601] [DEBUG] [LOCAL ] STNG: Trimmed 64358 records to 43606 (keeping 200 days of data) [2025-10-15T21:42:50.905154] [DEBUG] [LOCAL ] STNG: Primary data saved (43606 records). [2025-10-15T21:42:50.905277] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-15T21:42:50.905620] [INFO ] [MAIN ] Update Progress: 2011/2369 symbols completed. STNG took 37.0s. Estimated remaining: 50m 20s. Rate: 7.1 symbols/min [2025-10-15T21:42:51.072207] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:51.122344] [DEBUG] [LOCAL ] STWD: Loaded 51984 existing records from primary storage. [2025-10-15T21:42:51.122703] [INFO ] [MAIN ] STWD: Loaded 51984 existing records. [2025-10-15T21:42:51.298566] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:42:51.298907] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-15T21:42:51.298964] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-15T21:42:51.299410] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-15T21:42:51.299467] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-15T21:42:51.319515] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-15T21:42:51.662078] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:51.762016] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T21:42:52.113997] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-15T21:42:52.123324] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T21:42:52.914085] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-15T21:42:53.713976] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-15T21:42:53.832783] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T21:42:54.506418] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T21:42:54.513949] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-15T21:42:54.589342] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T21:42:55.189702] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T21:42:55.191401] [INFO ] [REMOTE ] STRV: Full fetch complete (17706 records). [2025-10-15T21:42:55.191477] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-15T21:42:55.319113] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-15T21:42:55.556288] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-15T21:42:55.556364] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-15T21:42:55.556807] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-15T21:42:55.556869] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-15T21:42:55.557385] [DEBUG] [LOCAL ] STRV: Trimmed 17706 records to 11163 (keeping 200 days of data) [2025-10-15T21:42:55.626209] [DEBUG] [LOCAL ] STRV: Primary data saved (11163 records). [2025-10-15T21:42:55.626334] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-15T21:42:55.626412] [INFO ] [MAIN ] Update Progress: 2012/2369 symbols completed. STRV took 27.0s. Estimated remaining: 50m 11s. Rate: 7.1 symbols/min [2025-10-15T21:42:55.791049] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:42:55.794513] [DEBUG] [LOCAL ] STXD: Loaded 1241 existing records from primary storage. [2025-10-15T21:42:55.794717] [INFO ] [MAIN ] STXD: Loaded 1241 existing records. [2025-10-15T21:42:55.968073] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:42:55.968411] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-15T21:42:55.968467] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-15T21:42:55.968699] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-15T21:42:55.968754] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-15T21:42:56.137420] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-15T21:42:56.319219] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:42:56.914095] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-15T21:42:57.114485] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T21:42:57.441246] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-15T21:42:57.714001] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-15T21:42:58.041207] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T21:42:58.514054] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-15T21:42:59.308505] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T21:42:59.317524] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-15T21:42:59.618348] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T21:43:00.114038] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-15T21:43:00.539477] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T21:43:00.905679] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T21:43:00.916475] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-15T21:43:01.714019] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-15T21:43:02.167604] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T21:43:02.237259] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T21:43:02.514041] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-15T21:43:03.314020] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-15T21:43:03.775890] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T21:43:04.114000] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-15T21:43:04.267463] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T21:43:04.914065] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-15T21:43:05.353366] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T21:43:05.714021] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-15T21:43:05.818485] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T21:43:06.514002] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-15T21:43:06.930307] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T21:43:07.244732] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T21:43:07.250821] [INFO ] [REMOTE ] STT: Full fetch complete (74384 records). [2025-10-15T21:43:07.250933] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-15T21:43:07.319215] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-15T21:43:07.629017] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-15T21:43:07.629089] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-15T21:43:07.630135] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-15T21:43:07.630197] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-15T21:43:07.631497] [DEBUG] [LOCAL ] STT: Trimmed 74384 records to 51037 (keeping 200 days of data) [2025-10-15T21:43:07.946520] [DEBUG] [LOCAL ] STT: Primary data saved (51037 records). [2025-10-15T21:43:07.946678] [INFO ] [MAIN ] STT: Full history saved. [2025-10-15T21:43:07.946786] [INFO ] [MAIN ] Update Progress: 2013/2369 symbols completed. STT took 37.4s. Estimated remaining: 50m 4s. Rate: 7.1 symbols/min [2025-10-15T21:43:08.111573] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:08.113996] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-15T21:43:08.117044] [DEBUG] [LOCAL ] STXE: Loaded 2085 existing records from primary storage. [2025-10-15T21:43:08.117273] [INFO ] [MAIN ] STXE: Loaded 2085 existing records. [2025-10-15T21:43:08.291856] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:43:08.292047] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-15T21:43:08.292093] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-15T21:43:08.292303] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-15T21:43:08.292359] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-15T21:43:08.642141] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:08.659484] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T21:43:08.914003] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-15T21:43:09.628505] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T21:43:09.713967] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-15T21:43:10.087014] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T21:43:10.310670] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T21:43:10.514013] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-15T21:43:11.314032] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-15T21:43:11.645968] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-15T21:43:12.114024] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-15T21:43:12.230906] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T21:43:12.914031] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-15T21:43:13.386259] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T21:43:13.390245] [INFO ] [REMOTE ] STVN: Full fetch complete (39335 records). [2025-10-15T21:43:13.390330] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-15T21:43:13.719256] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-15T21:43:13.787238] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-15T21:43:13.787310] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-15T21:43:13.788260] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-15T21:43:13.788321] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-15T21:43:13.789161] [DEBUG] [LOCAL ] STVN: Trimmed 39335 records to 26820 (keeping 200 days of data) [2025-10-15T21:43:13.940467] [DEBUG] [LOCAL ] STVN: Primary data saved (26820 records). [2025-10-15T21:43:13.940598] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-15T21:43:13.940706] [INFO ] [MAIN ] Update Progress: 2014/2369 symbols completed. STVN took 41.6s. Estimated remaining: 49m 55s. Rate: 7.1 symbols/min [2025-10-15T21:43:14.103121] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:14.107703] [DEBUG] [LOCAL ] STXG: Loaded 2428 existing records from primary storage. [2025-10-15T21:43:14.107863] [INFO ] [MAIN ] STXG: Loaded 2428 existing records. [2025-10-15T21:43:14.267009] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T21:43:14.290659] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:43:14.290837] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-15T21:43:14.290886] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-15T21:43:14.291054] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-15T21:43:14.291109] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-15T21:43:14.519301] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-15T21:43:14.642065] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:14.669101] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T21:43:15.126363] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T21:43:15.313987] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-15T21:43:16.113993] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-15T21:43:16.710862] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T21:43:16.913966] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-15T21:43:17.102998] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T21:43:17.256438] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T21:43:17.714006] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-15T21:43:18.042804] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T21:43:18.514003] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-15T21:43:19.314046] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-15T21:43:19.717512] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T21:43:20.113982] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-15T21:43:20.273179] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T21:43:20.658673] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T21:43:20.913999] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-15T21:43:21.463349] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T21:43:21.714033] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-15T21:43:22.514035] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-15T21:43:23.072114] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T21:43:23.313971] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-15T21:43:23.402676] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T21:43:23.588327] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-15T21:43:24.113990] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-15T21:43:24.539278] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T21:43:24.913989] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-15T21:43:25.714000] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-15T21:43:26.265773] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T21:43:26.513974] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-15T21:43:26.685910] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T21:43:26.692442] [INFO ] [REMOTE ] STWD: Full fetch complete (75366 records). [2025-10-15T21:43:26.692589] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-15T21:43:27.115784] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-15T21:43:27.115898] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-15T21:43:27.116979] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-15T21:43:27.117042] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-15T21:43:27.118463] [DEBUG] [LOCAL ] STWD: Trimmed 75366 records to 51983 (keeping 200 days of data) [2025-10-15T21:43:27.213416] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T21:43:27.318289] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-15T21:43:27.459985] [DEBUG] [LOCAL ] STWD: Primary data saved (51983 records). [2025-10-15T21:43:27.460116] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-15T21:43:27.460417] [INFO ] [MAIN ] Update Progress: 2015/2369 symbols completed. STWD took 36.6s. Estimated remaining: 49m 47s. Rate: 7.1 symbols/min [2025-10-15T21:43:27.651894] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:27.655729] [DEBUG] [LOCAL ] STXK: Loaded 1522 existing records from primary storage. [2025-10-15T21:43:27.655885] [INFO ] [MAIN ] STXK: Loaded 1522 existing records. [2025-10-15T21:43:27.808281] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T21:43:27.842202] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:43:27.842410] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-15T21:43:27.842463] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-15T21:43:27.842593] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-15T21:43:27.842638] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-15T21:43:28.116571] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-15T21:43:28.195454] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:28.486105] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-15T21:43:28.486816] [INFO ] [REMOTE ] STXD: Full fetch complete (2051 records). [2025-10-15T21:43:28.486884] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-15T21:43:28.832776] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-15T21:43:28.832852] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-15T21:43:28.832944] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-15T21:43:28.832982] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-15T21:43:28.833279] [DEBUG] [LOCAL ] STXD: Trimmed 2051 records to 1243 (keeping 200 days of data) [2025-10-15T21:43:28.841174] [DEBUG] [LOCAL ] STXD: Primary data saved (1243 records). [2025-10-15T21:43:28.841231] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-15T21:43:28.841292] [INFO ] [MAIN ] Update Progress: 2016/2369 symbols completed. STXD took 33.2s. Estimated remaining: 49m 37s. Rate: 7.1 symbols/min [2025-10-15T21:43:28.919137] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-15T21:43:29.009106] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:29.009297] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-15T21:43:29.009341] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-15T21:43:29.009444] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-15T21:43:29.009484] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-15T21:43:29.009524] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-15T21:43:29.009556] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-15T21:43:29.357474] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:29.463861] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T21:43:29.713994] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-15T21:43:30.168523] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T21:43:30.514020] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-15T21:43:30.956240] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T21:43:31.313991] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-15T21:43:31.750859] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T21:43:32.114027] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-15T21:43:32.559885] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T21:43:32.914047] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-15T21:43:33.346873] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T21:43:33.714010] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-15T21:43:34.085298] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-15T21:43:34.086129] [INFO ] [REMOTE ] STXG: Full fetch complete (4077 records). [2025-10-15T21:43:34.086197] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-15T21:43:34.433062] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-15T21:43:34.433130] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-15T21:43:34.433248] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-15T21:43:34.433285] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-15T21:43:34.433607] [DEBUG] [LOCAL ] STXG: Trimmed 4077 records to 2410 (keeping 200 days of data) [2025-10-15T21:43:34.448496] [DEBUG] [LOCAL ] STXG: Primary data saved (2410 records). [2025-10-15T21:43:34.448556] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-15T21:43:34.448618] [INFO ] [MAIN ] Update Progress: 2017/2369 symbols completed. STXG took 20.5s. Estimated remaining: 49m 29s. Rate: 7.1 symbols/min [2025-10-15T21:43:34.519318] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-15T21:43:34.618281] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:34.623380] [DEBUG] [LOCAL ] STXT: Loaded 2493 existing records from primary storage. [2025-10-15T21:43:34.623540] [INFO ] [MAIN ] STXT: Loaded 2493 existing records. [2025-10-15T21:43:34.800638] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:43:34.800908] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-15T21:43:34.800962] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-15T21:43:34.801137] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-15T21:43:34.801196] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-15T21:43:34.911374] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-15T21:43:35.153744] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:35.313978] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-15T21:43:35.962717] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-15T21:43:36.113990] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-15T21:43:36.444814] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T21:43:36.913998] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-15T21:43:37.369124] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T21:43:37.714051] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-15T21:43:38.174598] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-15T21:43:38.514007] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-15T21:43:38.881989] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-15T21:43:38.883192] [INFO ] [REMOTE ] STXE: Full fetch complete (3500 records). [2025-10-15T21:43:38.883271] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-15T21:43:39.242810] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-15T21:43:39.242888] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-15T21:43:39.243013] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-15T21:43:39.243052] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-15T21:43:39.243396] [DEBUG] [LOCAL ] STXE: Trimmed 3500 records to 2092 (keeping 200 days of data) [2025-10-15T21:43:39.257458] [DEBUG] [LOCAL ] STXE: Primary data saved (2092 records). [2025-10-15T21:43:39.257627] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-15T21:43:39.257777] [INFO ] [MAIN ] Update Progress: 2018/2369 symbols completed. STXE took 31.3s. Estimated remaining: 49m 19s. Rate: 7.1 symbols/min [2025-10-15T21:43:39.319993] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-15T21:43:39.430538] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:39.434585] [DEBUG] [LOCAL ] STXV: Loaded 1522 existing records from primary storage. [2025-10-15T21:43:39.434769] [INFO ] [MAIN ] STXV: Loaded 1522 existing records. [2025-10-15T21:43:39.613761] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:43:39.613998] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-15T21:43:39.614045] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-15T21:43:39.614205] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-15T21:43:39.614259] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-15T21:43:39.883402] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T21:43:39.979933] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:40.113964] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-15T21:43:40.633139] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T21:43:40.914013] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-15T21:43:41.249837] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T21:43:41.713994] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-15T21:43:42.158269] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T21:43:42.514027] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-15T21:43:42.855561] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T21:43:43.314003] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-15T21:43:43.868198] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T21:43:44.113991] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-15T21:43:44.642069] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T21:43:44.914002] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-15T21:43:45.438096] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T21:43:45.714016] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-15T21:43:46.152276] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T21:43:46.514022] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-15T21:43:46.935622] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T21:43:47.314017] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-15T21:43:47.751327] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T21:43:48.114024] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-15T21:43:48.445223] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-15T21:43:48.913997] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-15T21:43:49.250407] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T21:43:49.714001] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-15T21:43:50.050800] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T21:43:50.514001] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-15T21:43:50.835564] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-15T21:43:51.314012] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-15T21:43:51.652698] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T21:43:51.653574] [INFO ] [REMOTE ] STXM: Full fetch complete (1404 records). [2025-10-15T21:43:51.653685] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-15T21:43:51.875544] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-15T21:43:51.876592] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:43:51.876687] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:43:51.876765] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-15T21:43:51.876845] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-15T21:43:51.876901] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-15T21:43:51.876948] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-15T21:43:51.877015] [INFO ] [MAIN ] Update Progress: 2019/2369 symbols completed. STXM took 23.0s. Estimated remaining: 49m 12s. Rate: 7.1 symbols/min [2025-10-15T21:43:52.053015] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:43:52.110885] [DEBUG] [LOCAL ] STZ: Loaded 52396 existing records from primary storage. [2025-10-15T21:43:52.111330] [INFO ] [MAIN ] STZ: Loaded 52396 existing records. [2025-10-15T21:43:52.122294] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-15T21:43:52.294991] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:43:52.295351] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-15T21:43:52.295403] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-15T21:43:52.296076] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-15T21:43:52.296133] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-15T21:43:52.677265] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:43:52.682121] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T21:43:52.914045] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-15T21:43:53.511913] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T21:43:53.714070] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-15T21:43:54.159092] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T21:43:54.514092] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-15T21:43:54.981033] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T21:43:55.314109] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-15T21:43:56.114031] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-15T21:43:56.608346] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T21:43:56.914007] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-15T21:43:57.032662] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T21:43:57.353441] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T21:43:57.714021] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-15T21:43:58.175296] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T21:43:58.513997] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-15T21:43:59.314003] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-15T21:43:59.837112] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T21:44:00.114053] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-15T21:44:00.340168] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T21:44:00.677780] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T21:44:00.914018] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-15T21:44:01.383205] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T21:44:01.714040] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-15T21:44:02.160031] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T21:44:02.514020] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-15T21:44:03.008693] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T21:44:03.314035] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-15T21:44:03.753333] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T21:44:04.114041] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-15T21:44:04.914054] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-15T21:44:05.453185] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T21:44:05.714056] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-15T21:44:06.142820] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T21:44:06.513982] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-15T21:44:06.589426] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-15T21:44:06.901465] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T21:44:06.902323] [INFO ] [REMOTE ] STXK: Full fetch complete (2431 records). [2025-10-15T21:44:06.902392] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-15T21:44:07.254480] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-15T21:44:07.254572] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-15T21:44:07.254708] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-15T21:44:07.254769] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-15T21:44:07.255110] [DEBUG] [LOCAL ] STXK: Trimmed 2431 records to 1521 (keeping 200 days of data) [2025-10-15T21:44:07.264701] [DEBUG] [LOCAL ] STXK: Primary data saved (1521 records). [2025-10-15T21:44:07.264759] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-15T21:44:07.264821] [INFO ] [MAIN ] Update Progress: 2020/2369 symbols completed. STXK took 39.8s. Estimated remaining: 49m 5s. Rate: 7.1 symbols/min [2025-10-15T21:44:07.319134] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-15T21:44:07.453154] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:07.505564] [DEBUG] [LOCAL ] SU: Loaded 53426 existing records from primary storage. [2025-10-15T21:44:07.505889] [INFO ] [MAIN ] SU: Loaded 53426 existing records. [2025-10-15T21:44:07.677430] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:07.677625] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-15T21:44:07.677711] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-15T21:44:07.677953] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-15T21:44:07.678019] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-15T21:44:08.018770] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:08.113965] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-15T21:44:08.913970] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-15T21:44:09.373526] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T21:44:09.393248] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T21:44:09.493916] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T21:44:09.713999] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-15T21:44:10.158123] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T21:44:10.513982] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-15T21:44:10.975329] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T21:44:11.314006] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-15T21:44:12.114050] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-15T21:44:12.464574] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T21:44:12.465809] [INFO ] [REMOTE ] STXT: Full fetch complete (3892 records). [2025-10-15T21:44:12.465891] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-15T21:44:12.864380] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-15T21:44:12.864465] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-15T21:44:12.864631] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-15T21:44:12.864714] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-15T21:44:12.865169] [DEBUG] [LOCAL ] STXT: Trimmed 3892 records to 2491 (keeping 200 days of data) [2025-10-15T21:44:12.882950] [DEBUG] [LOCAL ] STXT: Primary data saved (2491 records). [2025-10-15T21:44:12.883095] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-15T21:44:12.883217] [INFO ] [MAIN ] Update Progress: 2021/2369 symbols completed. STXT took 38.4s. Estimated remaining: 48m 56s. Rate: 7.1 symbols/min [2025-10-15T21:44:12.919840] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-15T21:44:13.057706] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:13.098338] [DEBUG] [LOCAL ] SUI: Loaded 42002 existing records from primary storage. [2025-10-15T21:44:13.098763] [INFO ] [MAIN ] SUI: Loaded 42002 existing records. [2025-10-15T21:44:13.230874] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T21:44:13.318830] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:13.319043] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-15T21:44:13.319093] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-15T21:44:13.319295] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-15T21:44:13.319335] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-15T21:44:13.421003] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T21:44:13.678309] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:13.713969] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-15T21:44:14.514079] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-15T21:44:14.958018] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T21:44:15.291926] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T21:44:15.313966] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-15T21:44:15.773441] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T21:44:16.114035] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-15T21:44:16.914004] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-15T21:44:17.251282] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T21:44:17.252047] [INFO ] [REMOTE ] STXV: Full fetch complete (2532 records). [2025-10-15T21:44:17.252116] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-15T21:44:17.614015] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-15T21:44:17.614109] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-15T21:44:17.614228] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-15T21:44:17.614388] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-15T21:44:17.615051] [DEBUG] [LOCAL ] STXV: Trimmed 2532 records to 1517 (keeping 200 days of data) [2025-10-15T21:44:17.625233] [DEBUG] [LOCAL ] STXV: Primary data saved (1517 records). [2025-10-15T21:44:17.625416] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-15T21:44:17.625511] [INFO ] [MAIN ] Update Progress: 2022/2369 symbols completed. STXV took 38.4s. Estimated remaining: 48m 47s. Rate: 7.1 symbols/min [2025-10-15T21:44:17.715300] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-15T21:44:17.799215] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:17.824910] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T21:44:17.866885] [DEBUG] [LOCAL ] SUN: Loaded 38233 existing records from primary storage. [2025-10-15T21:44:17.867189] [INFO ] [MAIN ] SUN: Loaded 38233 existing records. [2025-10-15T21:44:18.047282] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:18.047483] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-15T21:44:18.047529] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-15T21:44:18.047908] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-15T21:44:18.047964] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-15T21:44:18.393268] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:18.513975] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-15T21:44:19.313990] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-15T21:44:19.894562] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T21:44:19.939390] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T21:44:20.113995] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-15T21:44:20.425426] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T21:44:20.914021] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-15T21:44:21.527044] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T21:44:21.714052] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-15T21:44:22.514012] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-15T21:44:22.661185] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T21:44:22.763451] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T21:44:23.314022] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-15T21:44:24.113977] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-15T21:44:24.220206] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T21:44:24.647575] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:44:24.914083] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-15T21:44:25.714081] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-15T21:44:26.101671] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T21:44:26.514011] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-15T21:44:26.732545] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T21:44:27.315136] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-15T21:44:27.320526] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T21:44:27.732610] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T21:44:28.114048] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-15T21:44:28.914048] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-15T21:44:29.520538] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T21:44:29.656527] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T21:44:29.714001] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-15T21:44:30.514006] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-15T21:44:30.854067] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T21:44:30.890798] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T21:44:31.314009] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-15T21:44:32.026405] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T21:44:32.113967] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-15T21:44:32.457841] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T21:44:32.914002] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-15T21:44:33.589054] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T21:44:33.714032] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-15T21:44:34.429743] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T21:44:34.513971] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-15T21:44:35.314008] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-15T21:44:35.466085] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T21:44:35.887799] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T21:44:36.113995] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-15T21:44:36.770807] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T21:44:36.913979] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-15T21:44:37.534860] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T21:44:37.540011] [INFO ] [REMOTE ] SUN: Full fetch complete (55292 records). [2025-10-15T21:44:37.540095] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-15T21:44:37.719507] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-15T21:44:37.936357] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-15T21:44:37.936439] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-15T21:44:37.937472] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-15T21:44:37.937534] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-15T21:44:37.938734] [DEBUG] [LOCAL ] SUN: Trimmed 55292 records to 38400 (keeping 200 days of data) [2025-10-15T21:44:38.176429] [DEBUG] [LOCAL ] SUN: Primary data saved (38400 records). [2025-10-15T21:44:38.176591] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-15T21:44:38.176712] [INFO ] [MAIN ] Update Progress: 2023/2369 symbols completed. SUN took 20.6s. Estimated remaining: 48m 40s. Rate: 7.1 symbols/min [2025-10-15T21:44:38.355561] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:38.399706] [DEBUG] [LOCAL ] SUPV: Loaded 47754 existing records from primary storage. [2025-10-15T21:44:38.400008] [INFO ] [MAIN ] SUPV: Loaded 47754 existing records. [2025-10-15T21:44:38.517989] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-15T21:44:38.585042] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:38.585753] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-15T21:44:38.585812] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-15T21:44:38.586068] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-15T21:44:38.586108] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-15T21:44:38.771564] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T21:44:38.981086] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:39.313987] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-15T21:44:39.701102] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T21:44:40.114018] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-15T21:44:40.459475] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T21:44:40.682609] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:44:40.914024] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-15T21:44:41.660323] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T21:44:41.719997] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-15T21:44:41.725558] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T21:44:42.513996] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-15T21:44:43.314077] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-15T21:44:43.441214] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T21:44:43.618193] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T21:44:44.113988] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-15T21:44:44.914018] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-15T21:44:45.156206] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T21:44:45.213315] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T21:44:45.713998] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-15T21:44:46.514018] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-15T21:44:47.039222] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T21:44:47.048604] [INFO ] [REMOTE ] SUI: Full fetch complete (61059 records). [2025-10-15T21:44:47.048874] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-15T21:44:47.199821] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-15T21:44:47.256251] [INFO ] [REMOTE ] STZ: Full fetch complete (76132 records). [2025-10-15T21:44:47.280833] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-15T21:44:47.323871] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-15T21:44:47.895700] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-15T21:44:47.901299] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-15T21:44:47.914304] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-15T21:44:47.919723] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-15T21:44:48.016201] [DEBUG] [LOCAL ] SUI: Trimmed 61059 records to 42096 (keeping 200 days of data) [2025-10-15T21:44:48.250412] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-15T21:44:48.250628] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-15T21:44:48.253477] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-15T21:44:48.261080] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-15T21:44:48.278191] [DEBUG] [LOCAL ] STZ: Trimmed 76132 records to 52414 (keeping 200 days of data) [2025-10-15T21:44:48.391902] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:44:48.434588] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-15T21:44:48.723704] [DEBUG] [LOCAL ] SUI: Primary data saved (42096 records). [2025-10-15T21:44:48.732445] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-15T21:44:48.736783] [INFO ] [MAIN ] Update Progress: 2024/2369 symbols completed. SUI took 35.9s. Estimated remaining: 48m 32s. Rate: 7.1 symbols/min [2025-10-15T21:44:48.970320] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:49.013615] [DEBUG] [LOCAL ] STZ: Primary data saved (52414 records). [2025-10-15T21:44:49.014000] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-15T21:44:49.014196] [INFO ] [MAIN ] Update Progress: 2025/2369 symbols completed. STZ took 57.1s. Estimated remaining: 48m 22s. Rate: 7.1 symbols/min [2025-10-15T21:44:49.155531] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T21:44:49.183587] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-15T21:44:49.263430] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:49.264393] [DEBUG] [LOCAL ] SUZ: Loaded 45714 existing records from primary storage. [2025-10-15T21:44:49.265053] [INFO ] [MAIN ] SUZ: Loaded 45714 existing records. [2025-10-15T21:44:49.457811] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:49.458075] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-15T21:44:49.458137] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-15T21:44:49.458570] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-15T21:44:49.458626] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-15T21:44:49.571518] [DEBUG] [LOCAL ] SVV: Loaded 40167 existing records from primary storage. [2025-10-15T21:44:49.582589] [INFO ] [MAIN ] SVV: Loaded 40167 existing records. [2025-10-15T21:44:49.902732] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:49.916036] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-15T21:44:49.940350] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-15T21:44:49.960487] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-15T21:44:49.976114] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-15T21:44:50.043250] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:50.064198] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-15T21:44:50.405419] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:50.434702] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T21:44:50.514013] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-15T21:44:50.806325] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T21:44:51.313993] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-15T21:44:51.720590] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T21:44:52.089690] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T21:44:52.113958] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-15T21:44:52.914004] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-15T21:44:52.945306] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T21:44:52.954463] [INFO ] [REMOTE ] SU: Full fetch complete (77564 records). [2025-10-15T21:44:52.954703] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-15T21:44:53.344316] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-15T21:44:53.344466] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-15T21:44:53.345730] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-15T21:44:53.345794] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-15T21:44:53.347236] [DEBUG] [LOCAL ] SU: Trimmed 77564 records to 53426 (keeping 200 days of data) [2025-10-15T21:44:53.685048] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T21:44:53.714127] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-15T21:44:53.718817] [DEBUG] [LOCAL ] SU: Primary data saved (53426 records). [2025-10-15T21:44:53.718897] [INFO ] [MAIN ] SU: Full history saved. [2025-10-15T21:44:53.719183] [INFO ] [MAIN ] Update Progress: 2026/2369 symbols completed. SU took 46.5s. Estimated remaining: 48m 13s. Rate: 7.1 symbols/min [2025-10-15T21:44:53.885295] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:44:53.938059] [DEBUG] [LOCAL ] SW: Loaded 53187 existing records from primary storage. [2025-10-15T21:44:53.938458] [INFO ] [MAIN ] SW: Loaded 53187 existing records. [2025-10-15T21:44:54.114008] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:44:54.114217] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-15T21:44:54.114263] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-15T21:44:54.114709] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-15T21:44:54.114764] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-15T21:44:54.471404] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:44:54.501127] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:44:54.513968] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-15T21:44:55.314043] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-15T21:44:55.393447] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T21:44:55.998631] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T21:44:56.114020] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-15T21:44:56.223257] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T21:44:56.914074] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-15T21:44:57.714064] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-15T21:44:57.833523] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T21:44:58.485374] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:44:58.513971] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-15T21:44:58.845310] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T21:44:59.314058] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-15T21:45:00.114068] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-15T21:45:00.238638] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T21:45:00.919101] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-15T21:45:00.932611] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T21:45:01.496457] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T21:45:01.714001] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-15T21:45:02.514125] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-15T21:45:03.167943] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-15T21:45:03.314019] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-15T21:45:03.433371] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T21:45:03.440476] [INFO ] [REMOTE ] SUPV: Full fetch complete (68793 records). [2025-10-15T21:45:03.440752] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-15T21:45:03.837357] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-15T21:45:03.837557] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-15T21:45:03.839151] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-15T21:45:03.839413] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-15T21:45:03.841615] [DEBUG] [LOCAL ] SUPV: Trimmed 68793 records to 47878 (keeping 200 days of data) [2025-10-15T21:45:03.997273] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T21:45:04.114712] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-15T21:45:04.177936] [DEBUG] [LOCAL ] SUPV: Primary data saved (47878 records). [2025-10-15T21:45:04.178074] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-15T21:45:04.178970] [INFO ] [MAIN ] Update Progress: 2027/2369 symbols completed. SUPV took 26.0s. Estimated remaining: 48m 5s. Rate: 7.1 symbols/min [2025-10-15T21:45:04.357676] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:04.410935] [DEBUG] [LOCAL ] SWK: Loaded 52481 existing records from primary storage. [2025-10-15T21:45:04.411227] [INFO ] [MAIN ] SWK: Loaded 52481 existing records. [2025-10-15T21:45:04.595582] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:04.595819] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-15T21:45:04.595870] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-15T21:45:04.596121] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-15T21:45:04.596162] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-15T21:45:04.923161] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-15T21:45:04.954301] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:05.101495] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T21:45:05.526983] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T21:45:05.714046] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-15T21:45:06.377230] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T21:45:06.513980] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-15T21:45:06.923706] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T21:45:07.314057] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-15T21:45:08.046095] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T21:45:08.113991] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-15T21:45:08.872143] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T21:45:08.914014] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-15T21:45:09.512872] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T21:45:09.714038] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-15T21:45:10.466186] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T21:45:10.513960] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-15T21:45:11.211588] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T21:45:11.314020] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-15T21:45:12.119103] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-15T21:45:12.146785] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T21:45:12.583730] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T21:45:12.914015] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-15T21:45:13.714043] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-15T21:45:14.011724] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T21:45:14.463990] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T21:45:14.514002] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-15T21:45:14.710332] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T21:45:15.314007] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-15T21:45:16.114031] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-15T21:45:16.258053] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T21:45:16.725101] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T21:45:16.730827] [INFO ] [REMOTE ] SUZ: Full fetch complete (66827 records). [2025-10-15T21:45:16.730954] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-15T21:45:16.920782] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-15T21:45:17.126770] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-15T21:45:17.126862] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-15T21:45:17.127880] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-15T21:45:17.127942] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-15T21:45:17.129334] [DEBUG] [LOCAL ] SUZ: Trimmed 66827 records to 45702 (keeping 200 days of data) [2025-10-15T21:45:17.385429] [DEBUG] [LOCAL ] SUZ: Primary data saved (45702 records). [2025-10-15T21:45:17.385558] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-15T21:45:17.385637] [INFO ] [MAIN ] Update Progress: 2028/2369 symbols completed. SUZ took 28.6s. Estimated remaining: 47m 57s. Rate: 7.1 symbols/min [2025-10-15T21:45:17.553280] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:17.584056] [DEBUG] [LOCAL ] SWX: Loaded 31078 existing records from primary storage. [2025-10-15T21:45:17.584311] [INFO ] [MAIN ] SWX: Loaded 31078 existing records. [2025-10-15T21:45:17.721818] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-15T21:45:17.761463] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:17.761961] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-15T21:45:17.762088] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-15T21:45:17.762500] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-15T21:45:17.762557] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-15T21:45:18.123568] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:18.154921] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T21:45:18.453918] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T21:45:18.514006] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-15T21:45:19.148874] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T21:45:19.314040] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-15T21:45:20.095495] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T21:45:20.113959] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-15T21:45:20.162849] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T21:45:20.914031] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-15T21:45:21.568731] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T21:45:21.574015] [INFO ] [REMOTE ] SVV: Full fetch complete (57127 records). [2025-10-15T21:45:21.574155] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-15T21:45:21.720838] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-15T21:45:21.955806] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-15T21:45:21.955883] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-15T21:45:21.956809] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-15T21:45:21.956871] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-15T21:45:21.958026] [DEBUG] [LOCAL ] SVV: Trimmed 57127 records to 40205 (keeping 200 days of data) [2025-10-15T21:45:22.179350] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T21:45:22.218132] [DEBUG] [LOCAL ] SVV: Primary data saved (40205 records). [2025-10-15T21:45:22.218286] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-15T21:45:22.218375] [INFO ] [MAIN ] Update Progress: 2029/2369 symbols completed. SVV took 33.2s. Estimated remaining: 47m 48s. Rate: 7.1 symbols/min [2025-10-15T21:45:22.384126] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:22.391421] [DEBUG] [LOCAL ] SWZ: Loaded 6078 existing records from primary storage. [2025-10-15T21:45:22.391630] [INFO ] [MAIN ] SWZ: Loaded 6078 existing records. [2025-10-15T21:45:22.529060] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-15T21:45:22.569772] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:22.569960] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-15T21:45:22.570014] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-15T21:45:22.570181] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-15T21:45:22.570238] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-15T21:45:22.961194] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:23.314088] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-15T21:45:23.614571] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T21:45:23.752184] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T21:45:24.114012] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-15T21:45:24.873699] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T21:45:24.913951] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-15T21:45:25.494886] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T21:45:25.714036] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-15T21:45:26.273035] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T21:45:26.514035] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-15T21:45:27.107386] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T21:45:27.313991] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-15T21:45:28.114089] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-15T21:45:28.416448] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T21:45:28.669573] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T21:45:28.913975] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-15T21:45:29.714001] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-15T21:45:30.020140] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T21:45:30.249881] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T21:45:30.514059] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-15T21:45:30.995673] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T21:45:31.314033] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-15T21:45:31.802469] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-15T21:45:32.113964] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-15T21:45:32.397408] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T21:45:32.692542] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T21:45:32.914059] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-15T21:45:33.714058] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-15T21:45:34.196857] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T21:45:34.514053] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-15T21:45:35.314070] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-15T21:45:35.496356] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T21:45:35.829361] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T21:45:35.886057] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T21:45:36.114044] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-15T21:45:36.730844] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T21:45:36.914057] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-15T21:45:37.643339] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T21:45:37.714005] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-15T21:45:38.513998] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-15T21:45:38.942147] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T21:45:39.314010] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-15T21:45:40.114057] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-15T21:45:40.159845] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T21:45:40.167345] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T21:45:40.178452] [INFO ] [REMOTE ] SWK: Full fetch complete (75536 records). [2025-10-15T21:45:40.178710] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-15T21:45:40.625856] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-15T21:45:40.625961] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-15T21:45:40.627515] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-15T21:45:40.627739] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-15T21:45:40.629675] [DEBUG] [LOCAL ] SWK: Trimmed 75536 records to 52481 (keeping 200 days of data) [2025-10-15T21:45:40.917785] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-15T21:45:40.966126] [DEBUG] [LOCAL ] SWK: Primary data saved (52481 records). [2025-10-15T21:45:40.966232] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-15T21:45:40.967185] [INFO ] [MAIN ] Update Progress: 2030/2369 symbols completed. SWK took 36.8s. Estimated remaining: 47m 42s. Rate: 7.1 symbols/min [2025-10-15T21:45:41.140675] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:41.181452] [DEBUG] [LOCAL ] SXC: Loaded 41631 existing records from primary storage. [2025-10-15T21:45:41.181768] [INFO ] [MAIN ] SXC: Loaded 41631 existing records. [2025-10-15T21:45:41.291132] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T21:45:41.321504] [INFO ] [REMOTE ] SWX: Full fetch complete (44044 records). [2025-10-15T21:45:41.378492] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-15T21:45:41.378320] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:41.393529] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-15T21:45:41.393663] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-15T21:45:41.413702] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T21:45:41.415048] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-15T21:45:41.420275] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-15T21:45:41.731151] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-15T21:45:42.173900] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-15T21:45:42.178539] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-15T21:45:42.179571] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-15T21:45:42.178455] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:42.179697] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-15T21:45:42.180750] [DEBUG] [LOCAL ] SWX: Trimmed 44044 records to 31034 (keeping 200 days of data) [2025-10-15T21:45:42.391814] [DEBUG] [LOCAL ] SWX: Primary data saved (31034 records). [2025-10-15T21:45:42.391971] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-15T21:45:42.392057] [INFO ] [MAIN ] Update Progress: 2031/2369 symbols completed. SWX took 25.0s. Estimated remaining: 47m 32s. Rate: 7.1 symbols/min [2025-10-15T21:45:42.519086] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-15T21:45:42.579280] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:42.593344] [DEBUG] [LOCAL ] SXI: Loaded 11927 existing records from primary storage. [2025-10-15T21:45:42.593637] [INFO ] [MAIN ] SXI: Loaded 11927 existing records. [2025-10-15T21:45:42.774122] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:42.774333] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-15T21:45:42.774381] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-15T21:45:42.774552] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-15T21:45:42.774590] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-15T21:45:43.138451] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:43.142041] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T21:45:43.313998] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-15T21:45:43.617967] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T21:45:43.939854] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-15T21:45:44.114021] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-15T21:45:44.913977] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-15T21:45:44.925065] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T21:45:45.562308] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-15T21:45:45.714054] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-15T21:45:46.514019] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-15T21:45:46.527278] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T21:45:47.314009] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-15T21:45:48.109270] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T21:45:48.117870] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-15T21:45:48.219400] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T21:45:48.914044] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-15T21:45:49.714065] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-15T21:45:49.862262] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T21:45:50.263829] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T21:45:50.391165] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T21:45:50.513969] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-15T21:45:51.314053] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-15T21:45:51.903755] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T21:45:51.989208] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T21:45:52.113990] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-15T21:45:52.914037] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-15T21:45:53.714020] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-15T21:45:53.750270] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T21:45:53.756707] [INFO ] [REMOTE ] SW: Full fetch complete (77067 records). [2025-10-15T21:45:53.756829] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-15T21:45:54.164710] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-15T21:45:54.164903] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-15T21:45:54.166146] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-15T21:45:54.166273] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-15T21:45:54.167803] [DEBUG] [LOCAL ] SW: Trimmed 77067 records to 53187 (keeping 200 days of data) [2025-10-15T21:45:54.267911] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T21:45:54.272504] [INFO ] [REMOTE ] SWZ: Full fetch complete (8222 records). [2025-10-15T21:45:54.280769] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-15T21:45:54.550598] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-15T21:45:54.792862] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-15T21:45:54.850638] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-15T21:45:54.887192] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-15T21:45:54.886939] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T21:45:54.887895] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-15T21:45:54.921620] [DEBUG] [LOCAL ] SW: Primary data saved (53187 records). [2025-10-15T21:45:54.909023] [DEBUG] [LOCAL ] SWZ: Trimmed 8222 records to 6053 (keeping 200 days of data) [2025-10-15T21:45:54.922474] [INFO ] [MAIN ] SW: Full history saved. [2025-10-15T21:45:54.922863] [INFO ] [MAIN ] Update Progress: 2032/2369 symbols completed. SW took 1m 1s. Estimated remaining: 47m 24s. Rate: 7.1 symbols/min [2025-10-15T21:45:55.064981] [DEBUG] [LOCAL ] SWZ: Primary data saved (6053 records). [2025-10-15T21:45:55.065294] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-15T21:45:55.065464] [INFO ] [MAIN ] Update Progress: 2033/2369 symbols completed. SWZ took 32.8s. Estimated remaining: 47m 15s. Rate: 7.1 symbols/min [2025-10-15T21:45:55.256792] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:55.339668] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:45:55.338512] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-15T21:45:55.370988] [DEBUG] [LOCAL ] SXT: Loaded 29849 existing records from primary storage. [2025-10-15T21:45:55.371361] [INFO ] [MAIN ] SXT: Loaded 29849 existing records. [2025-10-15T21:45:55.606569] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:55.614681] [DEBUG] [LOCAL ] SYF: Loaded 53453 existing records from primary storage. [2025-10-15T21:45:55.615286] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-15T21:45:55.615694] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T21:45:55.615799] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-15T21:45:55.618556] [INFO ] [MAIN ] SYF: Loaded 53453 existing records. [2025-10-15T21:45:55.650850] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-15T21:45:55.650978] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-15T21:45:55.993716] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:45:56.021209] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-15T21:45:56.029876] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-15T21:45:56.079684] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-15T21:45:56.090147] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-15T21:45:56.119113] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-15T21:45:56.304145] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:56.561113] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:45:56.866072] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T21:45:56.906355] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T21:45:56.913980] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-15T21:45:57.714051] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-15T21:45:57.726284] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T21:45:58.514042] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-15T21:45:59.120281] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T21:45:59.313974] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-15T21:45:59.601017] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T21:46:00.113973] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-15T21:46:00.306307] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T21:46:00.913987] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-15T21:46:01.646087] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T21:46:01.713963] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-15T21:46:01.960152] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T21:46:02.514051] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-15T21:46:02.697431] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T21:46:03.313987] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-15T21:46:03.642423] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T21:46:04.113992] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-15T21:46:04.913964] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-15T21:46:05.021699] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T21:46:05.349264] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T21:46:05.706446] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T21:46:05.713938] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-15T21:46:06.513973] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-15T21:46:06.525382] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T21:46:06.527507] [INFO ] [REMOTE ] SXI: Full fetch complete (15508 records). [2025-10-15T21:46:06.527576] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-15T21:46:06.879232] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-15T21:46:06.879308] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-15T21:46:06.879603] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-15T21:46:06.879660] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-15T21:46:06.880156] [DEBUG] [LOCAL ] SXI: Trimmed 15508 records to 11953 (keeping 200 days of data) [2025-10-15T21:46:06.952200] [DEBUG] [LOCAL ] SXI: Primary data saved (11953 records). [2025-10-15T21:46:06.952331] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-15T21:46:06.952410] [INFO ] [MAIN ] Update Progress: 2034/2369 symbols completed. SXI took 24.6s. Estimated remaining: 47m 7s. Rate: 7.1 symbols/min [2025-10-15T21:46:07.117813] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:46:07.164573] [DEBUG] [LOCAL ] SYK: Loaded 46923 existing records from primary storage. [2025-10-15T21:46:07.164918] [INFO ] [MAIN ] SYK: Loaded 46923 existing records. [2025-10-15T21:46:07.334584] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-15T21:46:07.339098] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:46:07.340069] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-15T21:46:07.340123] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-15T21:46:07.340478] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-15T21:46:07.340516] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-15T21:46:07.688021] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:46:07.956229] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T21:46:08.113961] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-15T21:46:08.704624] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T21:46:08.913979] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-15T21:46:09.423813] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T21:46:09.714048] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-15T21:46:10.447255] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T21:46:10.514025] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-15T21:46:10.562504] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T21:46:11.314012] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-15T21:46:12.065533] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T21:46:12.114047] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-15T21:46:12.748524] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T21:46:12.914038] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-15T21:46:13.569174] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T21:46:13.714000] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-15T21:46:14.514012] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-15T21:46:14.554322] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T21:46:15.313994] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-15T21:46:15.367193] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T21:46:15.892247] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T21:46:15.897606] [INFO ] [REMOTE ] SXC: Full fetch complete (61038 records). [2025-10-15T21:46:15.897740] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-15T21:46:16.120129] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-15T21:46:16.304432] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-15T21:46:16.304540] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-15T21:46:16.305678] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-15T21:46:16.305766] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-15T21:46:16.306988] [DEBUG] [LOCAL ] SXC: Trimmed 61038 records to 41635 (keeping 200 days of data) [2025-10-15T21:46:16.553090] [DEBUG] [LOCAL ] SXC: Primary data saved (41635 records). [2025-10-15T21:46:16.553215] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-15T21:46:16.553293] [INFO ] [MAIN ] Update Progress: 2035/2369 symbols completed. SXC took 35.6s. Estimated remaining: 46m 58s. Rate: 7.1 symbols/min [2025-10-15T21:46:16.725122] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:46:16.775421] [DEBUG] [LOCAL ] SYY: Loaded 53229 existing records from primary storage. [2025-10-15T21:46:16.775753] [INFO ] [MAIN ] SYY: Loaded 53229 existing records. [2025-10-15T21:46:16.927183] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-15T21:46:16.971363] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:46:16.971699] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-15T21:46:16.971918] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-15T21:46:16.972445] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-15T21:46:16.972504] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-15T21:46:17.366219] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:46:17.382891] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T21:46:17.713969] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-15T21:46:18.080819] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T21:46:18.296528] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T21:46:18.514033] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-15T21:46:19.079941] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T21:46:19.314043] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-15T21:46:19.802883] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T21:46:20.114031] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-15T21:46:20.913975] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-15T21:46:21.088633] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T21:46:21.714011] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-15T21:46:21.982516] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T21:46:22.391276] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T21:46:22.514007] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-15T21:46:23.313960] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-15T21:46:23.635762] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T21:46:24.114018] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-15T21:46:24.359158] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T21:46:24.645189] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T21:46:24.914101] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-15T21:46:25.714064] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-15T21:46:25.856339] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:46:26.338233] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T21:46:26.513960] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-15T21:46:26.902090] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T21:46:26.906244] [INFO ] [REMOTE ] SXT: Full fetch complete (39414 records). [2025-10-15T21:46:26.906355] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-15T21:46:27.287576] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-15T21:46:27.287677] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-15T21:46:27.288473] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-15T21:46:27.288533] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-15T21:46:27.289461] [DEBUG] [LOCAL ] SXT: Trimmed 39414 records to 29865 (keeping 200 days of data) [2025-10-15T21:46:27.343703] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-15T21:46:27.487694] [DEBUG] [LOCAL ] SXT: Primary data saved (29865 records). [2025-10-15T21:46:27.487859] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-15T21:46:27.487947] [INFO ] [MAIN ] Update Progress: 2036/2369 symbols completed. SXT took 32.6s. Estimated remaining: 46m 50s. Rate: 7.1 symbols/min [2025-10-15T21:46:27.662363] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:46:27.711884] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-15T21:46:27.712198] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-15T21:46:27.888251] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:46:27.888570] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-15T21:46:27.888619] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-15T21:46:27.889201] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-15T21:46:27.889258] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-15T21:46:28.125085] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-15T21:46:28.257472] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:46:28.287457] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T21:46:28.913979] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-15T21:46:29.017908] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T21:46:29.714036] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-15T21:46:30.092479] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-15T21:46:30.514067] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-15T21:46:30.558998] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T21:46:31.314014] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-15T21:46:32.114175] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-15T21:46:32.228996] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-15T21:46:32.399434] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T21:46:32.801447] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T21:46:32.914037] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-15T21:46:33.498968] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T21:46:33.714039] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-15T21:46:34.513973] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-15T21:46:34.845313] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T21:46:35.313980] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-15T21:46:36.052716] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-15T21:46:36.113956] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-15T21:46:36.145075] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T21:46:36.914010] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-15T21:46:37.165891] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T21:46:37.525179] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T21:46:37.531173] [INFO ] [REMOTE ] SYK: Full fetch complete (69125 records). [2025-10-15T21:46:37.531353] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-15T21:46:37.724610] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-15T21:46:37.931120] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-15T21:46:37.931237] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-15T21:46:37.932525] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-15T21:46:37.932716] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-15T21:46:37.934285] [DEBUG] [LOCAL ] SYK: Trimmed 69125 records to 46942 (keeping 200 days of data) [2025-10-15T21:46:38.064546] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T21:46:38.271921] [DEBUG] [LOCAL ] SYK: Primary data saved (46942 records). [2025-10-15T21:46:38.272062] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-15T21:46:38.272207] [INFO ] [MAIN ] Update Progress: 2037/2369 symbols completed. SYK took 31.3s. Estimated remaining: 46m 42s. Rate: 7.1 symbols/min [2025-10-15T21:46:38.513993] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-15T21:46:39.170604] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T21:46:39.176892] [INFO ] [REMOTE ] SYF: Full fetch complete (77530 records). [2025-10-15T21:46:39.177015] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-15T21:46:39.329794] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-15T21:46:39.581468] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-15T21:46:39.581590] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-15T21:46:39.582855] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-15T21:46:39.582988] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-15T21:46:39.613806] [DEBUG] [LOCAL ] SYF: Trimmed 77530 records to 53454 (keeping 200 days of data) [2025-10-15T21:46:39.613664] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T21:46:39.952437] [DEBUG] [LOCAL ] SYF: Primary data saved (53454 records). [2025-10-15T21:46:39.952570] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-15T21:46:39.952688] [INFO ] [MAIN ] Update Progress: 2038/2369 symbols completed. SYF took 44.9s. Estimated remaining: 46m 33s. Rate: 7.1 symbols/min [2025-10-15T21:46:40.114050] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-15T21:46:41.624526] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-15T21:46:41.634883] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-15T21:46:42.022135] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T21:46:42.033461] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-15T21:46:43.789884] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T21:46:43.802161] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-15T21:46:44.110624] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-15T21:46:44.121955] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-15T21:46:45.373611] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T21:46:45.385377] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-15T21:46:46.053432] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:46:46.061293] [INFO ] [REMOTE ] SYY: Full fetch complete (77183 records). [2025-10-15T21:46:46.061503] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-15T21:46:46.496908] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-15T21:46:46.497009] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-15T21:46:46.498339] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-15T21:46:46.498421] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-15T21:46:46.501063] [DEBUG] [LOCAL ] SYY: Trimmed 77183 records to 53219 (keeping 200 days of data) [2025-10-15T21:46:46.746631] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T21:46:46.774192] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-15T21:46:46.870301] [DEBUG] [LOCAL ] SYY: Primary data saved (53219 records). [2025-10-15T21:46:46.870430] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-15T21:46:46.871408] [INFO ] [MAIN ] Update Progress: 2039/2369 symbols completed. SYY took 30.3s. Estimated remaining: 46m 24s. Rate: 7.1 symbols/min [2025-10-15T21:46:49.173535] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T21:46:49.185249] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-15T21:46:51.403875] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-15T21:46:51.414896] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-15T21:46:53.950170] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-15T21:46:53.962597] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-15T21:46:56.343091] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-15T21:46:56.355380] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-15T21:46:58.761890] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-15T21:46:58.773497] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-15T21:46:59.433195] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T21:46:59.439551] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-15T21:46:59.439708] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-15T21:46:59.845142] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-15T21:46:59.845243] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-15T21:46:59.846374] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-15T21:46:59.846440] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-15T21:46:59.847898] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 53798 (keeping 200 days of data) [2025-10-15T21:47:00.181352] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-15T21:47:00.181484] [INFO ] [MAIN ] T: Full history saved. [2025-10-15T21:47:00.181934] [INFO ] [MAIN ] Update Progress: 2040/2369 symbols completed. T took 32.7s. Estimated remaining: 46m 16s. Rate: 7.1 symbols/min [2025-10-15T21:47:00.817810] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:00.849317] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:00.892072] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:00.894130] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:00.969567] [DEBUG] [LOCAL ] TALO: Loaded 50962 existing records from primary storage. [2025-10-15T21:47:00.970081] [INFO ] [MAIN ] TALO: Loaded 50962 existing records. [2025-10-15T21:47:01.107338] [DEBUG] [LOCAL ] TAC: Loaded 43001 existing records from primary storage. [2025-10-15T21:47:01.130230] [DEBUG] [LOCAL ] TAL: Loaded 51795 existing records from primary storage. [2025-10-15T21:47:01.158598] [INFO ] [MAIN ] TAC: Loaded 43001 existing records. [2025-10-15T21:47:01.179918] [INFO ] [MAIN ] TAL: Loaded 51795 existing records. [2025-10-15T21:47:01.277397] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:01.274311] [DEBUG] [LOCAL ] TAK: Loaded 50104 existing records from primary storage. [2025-10-15T21:47:01.368409] [INFO ] [MAIN ] TAK: Loaded 50104 existing records. [2025-10-15T21:47:01.362986] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-15T21:47:01.417549] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-15T21:47:01.534781] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-15T21:47:01.591089] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-15T21:47:01.817039] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:01.854023] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-15T21:47:01.897775] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-15T21:47:01.901266] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:01.962637] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-15T21:47:01.968170] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-15T21:47:02.001148] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-15T21:47:02.010621] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:02.006584] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-15T21:47:02.030887] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-15T21:47:02.089687] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-15T21:47:02.068802] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-15T21:47:02.143429] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-15T21:47:02.260029] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-15T21:47:02.320147] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-15T21:47:02.826911] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:02.882864] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-15T21:47:03.245624] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:03.246064] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-15T21:47:03.385780] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:03.386967] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-15T21:47:03.406529] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:03.406928] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-15T21:47:04.613363] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T21:47:04.623557] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-15T21:47:04.952718] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T21:47:04.962065] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-15T21:47:05.032275] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T21:47:05.042727] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-15T21:47:05.103497] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T21:47:05.113156] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-15T21:47:06.362583] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T21:47:06.372714] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-15T21:47:06.548181] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:47:06.557936] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-15T21:47:06.632039] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T21:47:06.641709] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-15T21:47:06.793775] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T21:47:06.804247] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-15T21:47:07.532528] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T21:47:07.542039] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-15T21:47:08.145591] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T21:47:08.155337] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-15T21:47:08.225457] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:47:08.234351] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-15T21:47:08.576282] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T21:47:08.586156] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-15T21:47:09.220586] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T21:47:09.231301] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-15T21:47:09.380215] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T21:47:09.389752] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-15T21:47:09.731391] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T21:47:09.741732] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-15T21:47:09.947554] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T21:47:09.960084] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-15T21:47:10.964458] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T21:47:10.976237] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-15T21:47:11.084521] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T21:47:11.095348] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-15T21:47:11.379731] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T21:47:11.390196] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-15T21:47:11.571130] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T21:47:11.583115] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-15T21:47:12.174413] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T21:47:12.185573] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-15T21:47:12.700363] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T21:47:12.709240] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-15T21:47:12.921851] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T21:47:12.933486] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-15T21:47:13.034104] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T21:47:13.044767] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-15T21:47:13.550900] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T21:47:13.561564] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-15T21:47:14.235271] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T21:47:14.244476] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-15T21:47:14.634027] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T21:47:14.644626] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-15T21:47:14.676632] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:47:14.687330] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-15T21:47:14.936566] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T21:47:15.314008] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-15T21:47:15.943125] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T21:47:16.101294] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T21:47:16.113971] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-15T21:47:16.326636] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T21:47:16.641172] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T21:47:16.914084] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-15T21:47:17.558864] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T21:47:17.714024] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-15T21:47:18.514039] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-15T21:47:18.686810] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T21:47:19.137334] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T21:47:19.313976] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-15T21:47:19.986509] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T21:47:20.114000] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-15T21:47:20.782382] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T21:47:20.788389] [INFO ] [REMOTE ] TAC: Full fetch complete (64401 records). [2025-10-15T21:47:20.788520] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-15T21:47:20.927307] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-15T21:47:21.175944] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-15T21:47:21.176042] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-15T21:47:21.177087] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-15T21:47:21.177156] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-15T21:47:21.178761] [DEBUG] [LOCAL ] TAC: Trimmed 64401 records to 43086 (keeping 200 days of data) [2025-10-15T21:47:21.433827] [DEBUG] [LOCAL ] TAC: Primary data saved (43086 records). [2025-10-15T21:47:21.433952] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-15T21:47:21.434030] [INFO ] [MAIN ] Update Progress: 2041/2369 symbols completed. TAC took 21.3s. Estimated remaining: 46m 10s. Rate: 7.1 symbols/min [2025-10-15T21:47:21.603105] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:21.652347] [DEBUG] [LOCAL ] TAP: Loaded 52960 existing records from primary storage. [2025-10-15T21:47:21.652676] [INFO ] [MAIN ] TAP: Loaded 52960 existing records. [2025-10-15T21:47:21.715208] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-15T21:47:21.864883] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:21.868008] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-15T21:47:21.867898] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T21:47:21.868175] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-15T21:47:21.880165] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-15T21:47:21.880232] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-15T21:47:22.229948] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:22.513978] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-15T21:47:22.702213] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T21:47:23.314020] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-15T21:47:23.477615] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T21:47:23.817397] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T21:47:23.823386] [INFO ] [REMOTE ] TAL: Full fetch complete (75707 records). [2025-10-15T21:47:23.823506] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-15T21:47:24.119101] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-15T21:47:24.207608] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-15T21:47:24.207709] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-15T21:47:24.208841] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-15T21:47:24.208903] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-15T21:47:24.210302] [DEBUG] [LOCAL ] TAL: Trimmed 75707 records to 51791 (keeping 200 days of data) [2025-10-15T21:47:24.509814] [DEBUG] [LOCAL ] TAL: Primary data saved (51791 records). [2025-10-15T21:47:24.509989] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-15T21:47:24.511327] [INFO ] [MAIN ] Update Progress: 2042/2369 symbols completed. TAL took 24.3s. Estimated remaining: 46m 1s. Rate: 7.1 symbols/min [2025-10-15T21:47:24.677736] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:24.691022] [DEBUG] [LOCAL ] TBB: Loaded 11578 existing records from primary storage. [2025-10-15T21:47:24.691243] [INFO ] [MAIN ] TBB: Loaded 11578 existing records. [2025-10-15T21:47:24.866868] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:24.867080] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-15T21:47:24.867142] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-15T21:47:24.867451] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-15T21:47:24.867563] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-15T21:47:24.929137] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-15T21:47:25.000692] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T21:47:25.048508] [INFO ] [REMOTE ] TALO: Full fetch complete (73467 records). [2025-10-15T21:47:25.050905] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-15T21:47:25.384894] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:25.647861] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-15T21:47:25.647990] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-15T21:47:25.649241] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-15T21:47:25.649397] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-15T21:47:25.651189] [DEBUG] [LOCAL ] TALO: Trimmed 73467 records to 50983 (keeping 200 days of data) [2025-10-15T21:47:25.731507] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-15T21:47:25.776923] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T21:47:25.978046] [DEBUG] [LOCAL ] TALO: Primary data saved (50983 records). [2025-10-15T21:47:25.978197] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-15T21:47:25.978292] [INFO ] [MAIN ] Update Progress: 2043/2369 symbols completed. TALO took 25.8s. Estimated remaining: 45m 51s. Rate: 7.1 symbols/min [2025-10-15T21:47:26.148183] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:26.181802] [DEBUG] [LOCAL ] TBBB: Loaded 35845 existing records from primary storage. [2025-10-15T21:47:26.182096] [INFO ] [MAIN ] TBBB: Loaded 35845 existing records. [2025-10-15T21:47:26.379962] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:26.380718] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-15T21:47:26.381744] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T21:47:26.381836] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-15T21:47:26.388542] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-15T21:47:26.388771] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-15T21:47:26.431666] [INFO ] [REMOTE ] TAK: Full fetch complete (71908 records). [2025-10-15T21:47:26.457446] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-15T21:47:26.519745] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-15T21:47:27.055163] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:27.096301] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T21:47:27.193333] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-15T21:47:27.193419] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-15T21:47:27.194508] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-15T21:47:27.194573] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-15T21:47:27.196010] [DEBUG] [LOCAL ] TAK: Trimmed 71908 records to 50163 (keeping 200 days of data) [2025-10-15T21:47:27.359606] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-15T21:47:27.486475] [DEBUG] [LOCAL ] TAK: Primary data saved (50163 records). [2025-10-15T21:47:27.486615] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-15T21:47:27.486723] [INFO ] [MAIN ] Update Progress: 2044/2369 symbols completed. TAK took 27.3s. Estimated remaining: 45m 42s. Rate: 7.1 symbols/min [2025-10-15T21:47:27.660670] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:27.682447] [DEBUG] [LOCAL ] TBI: Loaded 22516 existing records from primary storage. [2025-10-15T21:47:27.682731] [INFO ] [MAIN ] TBI: Loaded 22516 existing records. [2025-10-15T21:47:27.859984] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:27.860211] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-15T21:47:27.860260] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-15T21:47:27.861074] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-15T21:47:27.861196] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-15T21:47:28.127480] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-15T21:47:28.217405] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:28.246271] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:47:28.759085] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T21:47:28.914018] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-15T21:47:29.060960] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T21:47:29.713990] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-15T21:47:29.998485] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T21:47:30.470304] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T21:47:30.513951] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-15T21:47:31.314032] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-15T21:47:31.338058] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T21:47:32.113995] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-15T21:47:32.913981] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-15T21:47:33.052354] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T21:47:33.482227] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T21:47:33.673148] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T21:47:33.713987] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-15T21:47:34.514000] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-15T21:47:35.204227] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T21:47:35.314035] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-15T21:47:35.622273] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T21:47:36.114010] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-15T21:47:36.206460] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T21:47:36.914021] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-15T21:47:37.466634] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T21:47:37.683211] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T21:47:37.713956] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-15T21:47:38.514011] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-15T21:47:39.125015] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T21:47:39.313998] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-15T21:47:39.561250] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T21:47:40.087615] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T21:47:40.113987] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-15T21:47:40.914046] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-15T21:47:41.000668] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T21:47:41.714084] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-15T21:47:41.921976] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T21:47:42.496575] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T21:47:42.513955] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-15T21:47:43.164523] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T21:47:43.166315] [INFO ] [REMOTE ] TBB: Full fetch complete (16752 records). [2025-10-15T21:47:43.166397] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-15T21:47:43.315983] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-15T21:47:43.523904] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-15T21:47:43.523980] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-15T21:47:43.524337] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-15T21:47:43.524397] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-15T21:47:43.524949] [DEBUG] [LOCAL ] TBB: Trimmed 16752 records to 11523 (keeping 200 days of data) [2025-10-15T21:47:43.594611] [DEBUG] [LOCAL ] TBB: Primary data saved (11523 records). [2025-10-15T21:47:43.594774] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-15T21:47:43.594860] [INFO ] [MAIN ] Update Progress: 2045/2369 symbols completed. TBB took 19.1s. Estimated remaining: 45m 34s. Rate: 7.1 symbols/min [2025-10-15T21:47:43.758341] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:43.758510] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-15T21:47:43.758547] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-15T21:47:43.758709] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-15T21:47:43.758761] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-15T21:47:43.758805] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-15T21:47:43.758837] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-15T21:47:44.099838] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:44.113948] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-15T21:47:44.450029] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-15T21:47:44.697859] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T21:47:44.913980] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-15T21:47:45.714028] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-15T21:47:46.067910] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T21:47:46.514048] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-15T21:47:46.965256] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T21:47:47.314003] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-15T21:47:47.333975] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T21:47:48.113994] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-15T21:47:48.674974] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T21:47:48.914023] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-15T21:47:49.360233] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T21:47:49.714010] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-15T21:47:50.047168] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T21:47:50.289638] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T21:47:50.514029] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-15T21:47:51.314080] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-15T21:47:51.600839] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T21:47:51.644122] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T21:47:52.114003] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-15T21:47:52.462915] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-15T21:47:52.914063] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-15T21:47:53.245623] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T21:47:53.714016] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-15T21:47:54.513985] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-15T21:47:54.843763] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T21:47:55.314019] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-15T21:47:55.420258] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T21:47:55.426371] [INFO ] [REMOTE ] TBBB: Full fetch complete (51949 records). [2025-10-15T21:47:55.426520] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-15T21:47:55.843031] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-15T21:47:55.843148] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-15T21:47:55.844699] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-15T21:47:55.844769] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-15T21:47:55.846413] [DEBUG] [LOCAL ] TBBB: Trimmed 51949 records to 35786 (keeping 200 days of data) [2025-10-15T21:47:56.082934] [DEBUG] [LOCAL ] TBBB: Primary data saved (35786 records). [2025-10-15T21:47:56.083170] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-15T21:47:56.083616] [INFO ] [MAIN ] Update Progress: 2046/2369 symbols completed. TBBB took 30.1s. Estimated remaining: 45m 27s. Rate: 7.1 symbols/min [2025-10-15T21:47:56.119243] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-15T21:47:56.271125] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:47:56.281461] [DEBUG] [LOCAL ] TBN: Loaded 3909 existing records from primary storage. [2025-10-15T21:47:56.281791] [INFO ] [MAIN ] TBN: Loaded 3909 existing records. [2025-10-15T21:47:56.469688] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:47:56.470007] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-15T21:47:56.470057] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-15T21:47:56.470276] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-15T21:47:56.470333] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-15T21:47:56.896852] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:47:56.913966] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-15T21:47:57.238717] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T21:47:57.263049] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T21:47:57.383395] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T21:47:57.714002] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-15T21:47:58.360473] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T21:47:58.514045] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-15T21:47:58.855826] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T21:47:59.314014] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-15T21:48:00.114027] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-15T21:48:00.767454] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T21:48:00.914040] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-15T21:48:01.450327] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T21:48:01.466043] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T21:48:01.714009] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-15T21:48:02.514032] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-15T21:48:03.314043] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-15T21:48:03.505174] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T21:48:03.569513] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-15T21:48:03.581711] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T21:48:04.114062] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-15T21:48:04.562242] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T21:48:04.913999] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-15T21:48:05.714006] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-15T21:48:05.847548] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T21:48:05.850732] [INFO ] [REMOTE ] TBI: Full fetch complete (31747 records). [2025-10-15T21:48:05.850819] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-15T21:48:06.223144] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-15T21:48:06.223253] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-15T21:48:06.223921] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-15T21:48:06.223981] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-15T21:48:06.224876] [DEBUG] [LOCAL ] TBI: Trimmed 31747 records to 22558 (keeping 200 days of data) [2025-10-15T21:48:06.350716] [DEBUG] [LOCAL ] TBI: Primary data saved (22558 records). [2025-10-15T21:48:06.350848] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-15T21:48:06.350926] [INFO ] [MAIN ] Update Progress: 2047/2369 symbols completed. TBI took 38.9s. Estimated remaining: 45m 18s. Rate: 7.1 symbols/min [2025-10-15T21:48:06.516736] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:06.516839] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-15T21:48:06.517433] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-15T21:48:06.517512] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-15T21:48:06.518330] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-15T21:48:06.518387] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-15T21:48:06.518430] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-15T21:48:06.518463] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-15T21:48:06.869739] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:06.941688] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T21:48:07.313977] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-15T21:48:07.578337] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T21:48:07.742194] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T21:48:08.114020] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-15T21:48:08.462602] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-15T21:48:08.913967] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-15T21:48:09.255877] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T21:48:09.714074] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-15T21:48:10.046776] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T21:48:10.047485] [INFO ] [REMOTE ] TBLU: Full fetch complete (1222 records). [2025-10-15T21:48:10.047550] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-15T21:48:10.222743] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T21:48:10.222971] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T21:48:10.223060] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T21:48:10.223129] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-15T21:48:10.223219] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-15T21:48:10.223278] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-15T21:48:10.223335] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-15T21:48:10.223407] [INFO ] [MAIN ] Update Progress: 2048/2369 symbols completed. TBLU took 26.6s. Estimated remaining: 45m 9s. Rate: 7.1 symbols/min [2025-10-15T21:48:10.389566] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:10.400499] [DEBUG] [LOCAL ] TCBX: Loaded 10162 existing records from primary storage. [2025-10-15T21:48:10.400740] [INFO ] [MAIN ] TCBX: Loaded 10162 existing records. [2025-10-15T21:48:10.519159] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-15T21:48:10.586431] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:10.586599] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-15T21:48:10.586697] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-15T21:48:10.586950] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-15T21:48:10.587007] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-15T21:48:10.937871] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:11.314035] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-15T21:48:12.113964] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-15T21:48:12.127212] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T21:48:12.512407] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T21:48:12.568735] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T21:48:12.914043] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-15T21:48:13.112540] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:48:13.112890] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-15T21:48:13.112978] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:48:13.113031] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-15T21:48:13.113090] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:48:13.113160] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-15T21:48:13.113222] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-15T21:48:13.113260] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-15T21:48:13.113297] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-15T21:48:13.113342] [INFO ] [MAIN ] Update Progress: 2049/2369 symbols completed. TCAI took 6.8s. Estimated remaining: 45m 0s. Rate: 7.1 symbols/min [2025-10-15T21:48:13.282702] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:13.282897] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-15T21:48:13.282950] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-15T21:48:13.283069] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-15T21:48:13.283110] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-15T21:48:13.283151] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-15T21:48:13.283190] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-15T21:48:13.629069] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:13.713953] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2024-12. [2025-10-15T21:48:13.917861] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:48:13.918185] [WARN ] [REMOTE ] TCPA: No data returned for month 2024-12 [2025-10-15T21:48:13.918291] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:48:13.918364] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-15T21:48:13.918432] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:48:13.918499] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-15T21:48:13.918563] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-15T21:48:13.918598] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-15T21:48:13.918692] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-15T21:48:13.918762] [INFO ] [MAIN ] Update Progress: 2050/2369 symbols completed. TCPA took 0.8s. Estimated remaining: 44m 50s. Rate: 7.1 symbols/min [2025-10-15T21:48:14.085639] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:14.135292] [DEBUG] [LOCAL ] TD: Loaded 52344 existing records from primary storage. [2025-10-15T21:48:14.135591] [INFO ] [MAIN ] TD: Loaded 52344 existing records. [2025-10-15T21:48:14.312927] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:14.313325] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-15T21:48:14.313378] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-15T21:48:14.314044] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-15T21:48:14.314100] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-15T21:48:14.519221] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-15T21:48:14.675120] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:15.314000] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-15T21:48:15.922598] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T21:48:16.114002] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-15T21:48:16.452348] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T21:48:16.914059] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-15T21:48:17.042347] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T21:48:17.467691] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T21:48:17.714012] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-15T21:48:18.514031] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-15T21:48:19.044989] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T21:48:19.230142] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T21:48:19.313985] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-15T21:48:19.795361] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:48:19.798111] [INFO ] [REMOTE ] TBN: Full fetch complete (5891 records). [2025-10-15T21:48:19.798215] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-15T21:48:20.119062] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-15T21:48:20.182890] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-15T21:48:20.182970] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-15T21:48:20.183139] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-15T21:48:20.183179] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-15T21:48:20.183621] [DEBUG] [LOCAL ] TBN: Trimmed 5891 records to 3962 (keeping 200 days of data) [2025-10-15T21:48:20.206855] [DEBUG] [LOCAL ] TBN: Primary data saved (3962 records). [2025-10-15T21:48:20.206992] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-15T21:48:20.207073] [INFO ] [MAIN ] Update Progress: 2051/2369 symbols completed. TBN took 24.1s. Estimated remaining: 44m 42s. Rate: 7.1 symbols/min [2025-10-15T21:48:20.376796] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:20.418780] [DEBUG] [LOCAL ] TDC: Loaded 46557 existing records from primary storage. [2025-10-15T21:48:20.419078] [INFO ] [MAIN ] TDC: Loaded 46557 existing records. [2025-10-15T21:48:20.590492] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:20.590763] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-15T21:48:20.590837] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-15T21:48:20.591345] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-15T21:48:20.591404] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-15T21:48:20.914955] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-15T21:48:20.946186] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:20.972400] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T21:48:21.714018] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-15T21:48:21.769968] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T21:48:22.513997] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-15T21:48:23.031843] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T21:48:23.313998] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-15T21:48:24.114069] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-15T21:48:24.295700] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T21:48:24.305422] [INFO ] [REMOTE ] TAP: Full fetch complete (76446 records). [2025-10-15T21:48:24.305680] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-15T21:48:24.779101] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-15T21:48:24.779293] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-15T21:48:24.780699] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-15T21:48:24.780845] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-15T21:48:24.782448] [DEBUG] [LOCAL ] TAP: Trimmed 76446 records to 52965 (keeping 200 days of data) [2025-10-15T21:48:24.908054] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T21:48:24.918771] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-15T21:48:25.172015] [DEBUG] [LOCAL ] TAP: Primary data saved (52965 records). [2025-10-15T21:48:25.172155] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-15T21:48:25.172243] [INFO ] [MAIN ] Update Progress: 2052/2369 symbols completed. TAP took 1m 4s. Estimated remaining: 44m 33s. Rate: 7.1 symbols/min [2025-10-15T21:48:25.364948] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:25.375916] [DEBUG] [LOCAL ] TDF: Loaded 6356 existing records from primary storage. [2025-10-15T21:48:25.376352] [INFO ] [MAIN ] TDF: Loaded 6356 existing records. [2025-10-15T21:48:25.583413] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:25.584191] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-15T21:48:25.584266] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-15T21:48:25.599723] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-15T21:48:25.625466] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-15T21:48:25.651375] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T21:48:25.717794] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-15T21:48:26.066197] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:26.386400] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T21:48:26.513999] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-15T21:48:26.562507] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T21:48:27.314006] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-15T21:48:28.113975] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-15T21:48:28.234782] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T21:48:28.368534] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T21:48:28.914054] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-15T21:48:29.479887] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T21:48:29.714055] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-15T21:48:30.480477] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T21:48:30.513953] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-15T21:48:30.753513] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T21:48:30.974816] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T21:48:31.314052] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-15T21:48:32.072700] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T21:48:32.113963] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-15T21:48:32.914022] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-15T21:48:32.958154] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T21:48:33.645368] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T21:48:33.714063] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-15T21:48:34.513993] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-15T21:48:35.208708] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T21:48:35.313992] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-15T21:48:35.551410] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T21:48:36.113983] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-15T21:48:36.734530] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T21:48:36.863485] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T21:48:36.913990] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-15T21:48:37.711639] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T21:48:37.714012] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-15T21:48:38.514041] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-15T21:48:39.313982] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-15T21:48:39.672096] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-15T21:48:40.114042] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-15T21:48:40.145095] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T21:48:40.184159] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T21:48:40.914071] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-15T21:48:41.607243] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T21:48:41.713993] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-15T21:48:41.978743] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T21:48:42.469627] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T21:48:42.514017] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-15T21:48:43.199975] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T21:48:43.201625] [INFO ] [REMOTE ] TCBX: Full fetch complete (15890 records). [2025-10-15T21:48:43.201725] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-15T21:48:43.319138] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-15T21:48:43.571378] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-15T21:48:43.571458] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-15T21:48:43.571877] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-15T21:48:43.571942] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-15T21:48:43.572529] [DEBUG] [LOCAL ] TCBX: Trimmed 15890 records to 10141 (keeping 200 days of data) [2025-10-15T21:48:43.634135] [DEBUG] [LOCAL ] TCBX: Primary data saved (10141 records). [2025-10-15T21:48:43.634277] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-15T21:48:43.634355] [INFO ] [MAIN ] Update Progress: 2053/2369 symbols completed. TCBX took 33.4s. Estimated remaining: 44m 26s. Rate: 7.1 symbols/min [2025-10-15T21:48:43.804904] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:43.826459] [DEBUG] [LOCAL ] TDG: Loaded 22050 existing records from primary storage. [2025-10-15T21:48:43.826726] [INFO ] [MAIN ] TDG: Loaded 22050 existing records. [2025-10-15T21:48:43.999753] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:43.999956] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-15T21:48:44.000003] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-15T21:48:44.000571] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-15T21:48:44.000627] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-15T21:48:44.119088] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-15T21:48:44.356973] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:44.826595] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T21:48:44.913979] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-15T21:48:45.714041] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-15T21:48:45.810706] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T21:48:46.253968] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T21:48:46.514048] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-15T21:48:46.985530] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:48:47.313989] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-15T21:48:48.009104] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T21:48:48.114058] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-15T21:48:48.683490] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T21:48:48.690015] [INFO ] [REMOTE ] TD: Full fetch complete (75943 records). [2025-10-15T21:48:48.690201] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-15T21:48:48.919224] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-15T21:48:49.117713] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-15T21:48:49.117818] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-15T21:48:49.119035] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-15T21:48:49.119109] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-15T21:48:49.120704] [DEBUG] [LOCAL ] TD: Trimmed 75943 records to 52329 (keeping 200 days of data) [2025-10-15T21:48:49.451480] [DEBUG] [LOCAL ] TD: Primary data saved (52329 records). [2025-10-15T21:48:49.451634] [INFO ] [MAIN ] TD: Full history saved. [2025-10-15T21:48:49.451799] [INFO ] [MAIN ] Update Progress: 2054/2369 symbols completed. TD took 35.5s. Estimated remaining: 44m 17s. Rate: 7.1 symbols/min [2025-10-15T21:48:49.625285] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:49.635497] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T21:48:49.680442] [DEBUG] [LOCAL ] TDOC: Loaded 53362 existing records from primary storage. [2025-10-15T21:48:49.680899] [INFO ] [MAIN ] TDOC: Loaded 53362 existing records. [2025-10-15T21:48:49.722444] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-15T21:48:49.892405] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:49.905199] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-15T21:48:49.905327] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-15T21:48:49.906958] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-15T21:48:49.906896] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T21:48:49.907161] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-15T21:48:50.267888] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:50.453287] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T21:48:50.514089] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-15T21:48:51.313975] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-15T21:48:51.657394] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T21:48:52.114076] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-15T21:48:52.914043] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-15T21:48:53.238822] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T21:48:53.312346] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T21:48:53.339999] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T21:48:53.713999] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-15T21:48:54.170625] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T21:48:54.513987] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-15T21:48:55.314036] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-15T21:48:56.102329] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T21:48:56.103791] [INFO ] [REMOTE ] TDF: Full fetch complete (10506 records). [2025-10-15T21:48:56.103859] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-15T21:48:56.123763] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-15T21:48:56.259990] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T21:48:56.511209] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-15T21:48:56.511304] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-15T21:48:56.511580] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-15T21:48:56.511620] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-15T21:48:56.512071] [DEBUG] [LOCAL ] TDF: Trimmed 10506 records to 6346 (keeping 200 days of data) [2025-10-15T21:48:56.552531] [DEBUG] [LOCAL ] TDF: Primary data saved (6346 records). [2025-10-15T21:48:56.552627] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-15T21:48:56.552741] [INFO ] [MAIN ] Update Progress: 2055/2369 symbols completed. TDF took 31.4s. Estimated remaining: 44m 8s. Rate: 7.1 symbols/min [2025-10-15T21:48:56.717067] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:48:56.758974] [DEBUG] [LOCAL ] TDS: Loaded 42481 existing records from primary storage. [2025-10-15T21:48:56.759283] [INFO ] [MAIN ] TDS: Loaded 42481 existing records. [2025-10-15T21:48:56.928010] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-15T21:48:56.932667] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:48:56.933496] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-15T21:48:56.933545] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-15T21:48:56.934087] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-15T21:48:56.934143] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-15T21:48:57.292505] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:48:57.353758] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T21:48:57.713983] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-15T21:48:58.514059] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-15T21:48:58.715967] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T21:48:59.253503] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:48:59.313966] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-15T21:49:00.114025] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-15T21:49:00.250860] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T21:49:00.840885] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T21:49:00.913959] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-15T21:49:01.111317] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T21:49:01.714076] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-15T21:49:02.368324] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T21:49:02.514007] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-15T21:49:03.209972] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T21:49:03.215677] [INFO ] [REMOTE ] TDC: Full fetch complete (67576 records). [2025-10-15T21:49:03.215779] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-15T21:49:03.319139] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-15T21:49:03.597332] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-15T21:49:03.597410] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-15T21:49:03.598448] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-15T21:49:03.598515] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-15T21:49:03.599763] [DEBUG] [LOCAL ] TDC: Trimmed 67576 records to 46556 (keeping 200 days of data) [2025-10-15T21:49:03.865552] [DEBUG] [LOCAL ] TDC: Primary data saved (46556 records). [2025-10-15T21:49:03.865724] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-15T21:49:03.866004] [INFO ] [MAIN ] Update Progress: 2056/2369 symbols completed. TDC took 43.7s. Estimated remaining: 43m 60s. Rate: 7.1 symbols/min [2025-10-15T21:49:04.030445] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:49:04.069098] [DEBUG] [LOCAL ] TDW: Loaded 45073 existing records from primary storage. [2025-10-15T21:49:04.069377] [INFO ] [MAIN ] TDW: Loaded 45073 existing records. [2025-10-15T21:49:04.123255] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-15T21:49:04.254154] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:49:04.254368] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-15T21:49:04.254492] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-15T21:49:04.255380] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-15T21:49:04.255444] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-15T21:49:04.443954] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T21:49:04.636978] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:49:04.666916] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-15T21:49:04.914014] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-15T21:49:05.325473] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T21:49:05.714007] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-15T21:49:06.514003] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-15T21:49:07.102260] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T21:49:07.181626] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:49:07.314043] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-15T21:49:07.609751] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T21:49:08.114025] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-15T21:49:08.913986] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-15T21:49:09.039611] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T21:49:09.226073] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T21:49:09.714005] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-15T21:49:10.513987] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-15T21:49:10.967827] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T21:49:11.314023] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-15T21:49:11.406258] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T21:49:11.611687] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T21:49:12.114018] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-15T21:49:12.914009] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-15T21:49:13.209632] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T21:49:13.624027] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T21:49:13.713978] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-15T21:49:13.794439] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T21:49:14.514011] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-15T21:49:15.314054] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-15T21:49:15.530314] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T21:49:16.114027] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-15T21:49:16.228849] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T21:49:16.520886] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T21:49:16.913988] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-15T21:49:17.714043] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-15T21:49:17.857029] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T21:49:17.922985] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T21:49:18.514008] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-15T21:49:19.314041] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-15T21:49:19.987974] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T21:49:20.000107] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T21:49:20.113985] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-15T21:49:20.914000] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-15T21:49:20.983812] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T21:49:21.397706] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:49:21.401406] [INFO ] [REMOTE ] TDG: Full fetch complete (32007 records). [2025-10-15T21:49:21.401513] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-15T21:49:21.724046] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-15T21:49:21.774876] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-15T21:49:21.775064] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-15T21:49:21.775827] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-15T21:49:21.775937] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-15T21:49:21.777018] [DEBUG] [LOCAL ] TDG: Trimmed 32007 records to 22140 (keeping 200 days of data) [2025-10-15T21:49:21.913848] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T21:49:21.967378] [DEBUG] [LOCAL ] TDG: Primary data saved (22140 records). [2025-10-15T21:49:21.967513] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-15T21:49:21.967596] [INFO ] [MAIN ] Update Progress: 2057/2369 symbols completed. TDG took 38.3s. Estimated remaining: 43m 53s. Rate: 7.1 symbols/min [2025-10-15T21:49:22.140678] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:49:22.161141] [DEBUG] [LOCAL ] TDY: Loaded 22273 existing records from primary storage. [2025-10-15T21:49:22.161415] [INFO ] [MAIN ] TDY: Loaded 22273 existing records. [2025-10-15T21:49:22.335621] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:49:22.335837] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-15T21:49:22.335897] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-15T21:49:22.336366] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-15T21:49:22.336423] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-15T21:49:22.521559] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-15T21:49:22.690885] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:49:23.293946] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T21:49:23.313965] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-15T21:49:24.114010] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-15T21:49:24.641802] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-15T21:49:24.913991] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-15T21:49:25.027403] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T21:49:25.714069] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-15T21:49:25.744167] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T21:49:25.799066] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T21:49:26.514056] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-15T21:49:27.313980] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-15T21:49:27.403906] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T21:49:27.613024] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T21:49:28.114020] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-15T21:49:28.914000] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-15T21:49:29.257864] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-15T21:49:29.264636] [INFO ] [REMOTE ] TDOC: Full fetch complete (77431 records). [2025-10-15T21:49:29.264784] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-15T21:49:29.678714] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-15T21:49:29.678887] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-15T21:49:29.680150] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-15T21:49:29.680229] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-15T21:49:29.705389] [DEBUG] [LOCAL ] TDOC: Trimmed 77431 records to 53365 (keeping 200 days of data) [2025-10-15T21:49:29.708581] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T21:49:29.717684] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-15T21:49:30.028152] [DEBUG] [LOCAL ] TDOC: Primary data saved (53365 records). [2025-10-15T21:49:30.028353] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-15T21:49:30.028447] [INFO ] [MAIN ] Update Progress: 2058/2369 symbols completed. TDOC took 40.6s. Estimated remaining: 43m 44s. Rate: 7.1 symbols/min [2025-10-15T21:49:30.204253] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:49:30.204450] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-15T21:49:30.204609] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-15T21:49:30.204958] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-15T21:49:30.205073] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-15T21:49:30.205240] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-15T21:49:30.205284] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-15T21:49:30.400752] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T21:49:30.521183] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-15T21:49:30.605833] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:49:30.859186] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T21:49:31.314047] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-15T21:49:31.517101] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:49:31.517402] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-15T21:49:31.517498] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:49:31.517547] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-15T21:49:31.517581] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:49:31.517617] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-15T21:49:31.517700] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-15T21:49:31.517750] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-15T21:49:31.517791] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-15T21:49:31.517836] [INFO ] [MAIN ] Update Progress: 2059/2369 symbols completed. TE took 1.5s. Estimated remaining: 43m 35s. Rate: 7.1 symbols/min [2025-10-15T21:49:31.696339] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:49:31.705374] [DEBUG] [LOCAL ] TEAF: Loaded 7317 existing records from primary storage. [2025-10-15T21:49:31.705607] [INFO ] [MAIN ] TEAF: Loaded 7317 existing records. [2025-10-15T21:49:31.910013] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:49:31.910303] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-15T21:49:31.910354] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-15T21:49:31.910626] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-15T21:49:31.910727] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-15T21:49:32.065823] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T21:49:32.119312] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-15T21:49:32.119423] [INFO ] [REMOTE ] TDS: Full fetch complete (61558 records). [2025-10-15T21:49:32.174482] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-15T21:49:32.448924] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:49:32.692746] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-15T21:49:32.692830] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-15T21:49:32.693869] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-15T21:49:32.693932] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-15T21:49:32.695160] [DEBUG] [LOCAL ] TDS: Trimmed 61558 records to 42515 (keeping 200 days of data) [2025-10-15T21:49:32.913994] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-15T21:49:32.958045] [DEBUG] [LOCAL ] TDS: Primary data saved (42515 records). [2025-10-15T21:49:32.958600] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-15T21:49:32.958753] [INFO ] [MAIN ] Update Progress: 2060/2369 symbols completed. TDS took 36.4s. Estimated remaining: 43m 25s. Rate: 7.1 symbols/min [2025-10-15T21:49:33.131875] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:49:33.180129] [DEBUG] [LOCAL ] TECK: Loaded 53437 existing records from primary storage. [2025-10-15T21:49:33.180468] [INFO ] [MAIN ] TECK: Loaded 53437 existing records. [2025-10-15T21:49:33.362825] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:49:33.363149] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-15T21:49:33.363225] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-15T21:49:33.369488] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-15T21:49:33.376989] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-15T21:49:33.421930] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T21:49:33.726025] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-15T21:49:33.730844] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:49:34.345295] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T21:49:34.350544] [INFO ] [REMOTE ] TDW: Full fetch complete (66947 records). [2025-10-15T21:49:34.350671] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-15T21:49:34.504184] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T21:49:34.515775] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-15T21:49:34.741045] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-15T21:49:34.741123] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-15T21:49:34.742201] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-15T21:49:34.742263] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-15T21:49:34.743455] [DEBUG] [LOCAL ] TDW: Trimmed 66947 records to 45036 (keeping 200 days of data) [2025-10-15T21:49:35.008363] [DEBUG] [LOCAL ] TDW: Primary data saved (45036 records). [2025-10-15T21:49:35.008679] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-15T21:49:35.008961] [INFO ] [MAIN ] Update Progress: 2061/2369 symbols completed. TDW took 31.1s. Estimated remaining: 43m 16s. Rate: 7.1 symbols/min [2025-10-15T21:49:35.179621] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:49:35.212466] [DEBUG] [LOCAL ] TEF: Loaded 36985 existing records from primary storage. [2025-10-15T21:49:35.212763] [INFO ] [MAIN ] TEF: Loaded 36985 existing records. [2025-10-15T21:49:35.319063] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-15T21:49:35.323841] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T21:49:35.403281] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:49:35.403484] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-15T21:49:35.403530] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-15T21:49:35.404279] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-15T21:49:35.404338] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-15T21:49:35.767226] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:49:36.114050] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-15T21:49:36.692036] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T21:49:36.913978] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-15T21:49:37.131222] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T21:49:37.321243] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T21:49:37.714037] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-15T21:49:38.513984] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-15T21:49:38.545770] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T21:49:39.313985] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-15T21:49:40.113976] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-15T21:49:40.356386] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T21:49:40.419435] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T21:49:40.914089] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-15T21:49:41.436191] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T21:49:41.714013] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-15T21:49:42.483562] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T21:49:42.514043] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-15T21:49:43.313965] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-15T21:49:43.460933] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T21:49:43.687369] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T21:49:44.114010] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-15T21:49:44.451363] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T21:49:44.913968] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-15T21:49:45.179340] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T21:49:45.714012] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-15T21:49:46.514025] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-15T21:49:46.798582] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:49:47.313739] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T21:49:47.313973] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-15T21:49:47.381626] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T21:49:47.917792] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T21:49:48.113995] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-15T21:49:48.914004] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-15T21:49:49.102584] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T21:49:49.714014] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-15T21:49:50.466516] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T21:49:50.513971] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-15T21:49:51.250323] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T21:49:51.313959] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-15T21:49:52.065416] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T21:49:52.113956] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-15T21:49:52.913986] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-15T21:49:53.169418] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T21:49:53.447847] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T21:49:53.683178] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T21:49:53.713958] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-15T21:49:54.513999] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-15T21:49:55.314020] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-15T21:49:55.458094] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:49:55.972526] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T21:49:55.980488] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T21:49:56.114003] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-15T21:49:56.913995] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-15T21:49:57.531630] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T21:49:57.714031] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-15T21:49:58.514037] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-15T21:49:58.656612] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T21:49:58.722340] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T21:49:59.314015] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-15T21:49:59.661176] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T21:50:00.003209] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T21:50:00.113988] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-15T21:50:00.584951] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T21:50:00.587337] [INFO ] [REMOTE ] TDY: Full fetch complete (31955 records). [2025-10-15T21:50:00.587414] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-15T21:50:00.920981] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-15T21:50:00.969955] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-15T21:50:00.970044] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-15T21:50:00.970703] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-15T21:50:00.970793] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-15T21:50:00.971534] [DEBUG] [LOCAL ] TDY: Trimmed 31955 records to 22260 (keeping 200 days of data) [2025-10-15T21:50:01.108716] [DEBUG] [LOCAL ] TDY: Primary data saved (22260 records). [2025-10-15T21:50:01.108857] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-15T21:50:01.108941] [INFO ] [MAIN ] Update Progress: 2062/2369 symbols completed. TDY took 39.1s. Estimated remaining: 43m 10s. Rate: 7.1 symbols/min [2025-10-15T21:50:01.277424] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:01.296168] [DEBUG] [LOCAL ] TEI: Loaded 21378 existing records from primary storage. [2025-10-15T21:50:01.296392] [INFO ] [MAIN ] TEI: Loaded 21378 existing records. [2025-10-15T21:50:01.471849] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:01.472340] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-15T21:50:01.472398] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-15T21:50:01.472935] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-15T21:50:01.472994] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-15T21:50:01.719187] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-15T21:50:01.865751] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:02.411426] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T21:50:02.416726] [INFO ] [REMOTE ] TEF: Full fetch complete (54824 records). [2025-10-15T21:50:02.416891] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-15T21:50:02.518041] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-15T21:50:02.529695] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T21:50:02.835862] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-15T21:50:02.835937] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-15T21:50:02.836864] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-15T21:50:02.836926] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-15T21:50:02.837942] [DEBUG] [LOCAL ] TEF: Trimmed 54824 records to 36958 (keeping 200 days of data) [2025-10-15T21:50:03.057498] [DEBUG] [LOCAL ] TEF: Primary data saved (36958 records). [2025-10-15T21:50:03.057639] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-15T21:50:03.057930] [INFO ] [MAIN ] Update Progress: 2063/2369 symbols completed. TEF took 28.0s. Estimated remaining: 43m 1s. Rate: 7.1 symbols/min [2025-10-15T21:50:03.226831] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:03.277894] [DEBUG] [LOCAL ] TEL: Loaded 51073 existing records from primary storage. [2025-10-15T21:50:03.278238] [INFO ] [MAIN ] TEL: Loaded 51073 existing records. [2025-10-15T21:50:03.319463] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-15T21:50:03.457853] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:03.458092] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-15T21:50:03.458140] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-15T21:50:03.459285] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-15T21:50:03.459343] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-15T21:50:03.722782] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T21:50:03.835305] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:04.113996] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-15T21:50:04.184826] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T21:50:04.186238] [INFO ] [REMOTE ] TEAF: Full fetch complete (10073 records). [2025-10-15T21:50:04.186306] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-15T21:50:04.544852] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-15T21:50:04.544927] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-15T21:50:04.545164] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-15T21:50:04.545203] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-15T21:50:04.545607] [DEBUG] [LOCAL ] TEAF: Trimmed 10073 records to 7411 (keeping 200 days of data) [2025-10-15T21:50:04.589538] [DEBUG] [LOCAL ] TEAF: Primary data saved (7411 records). [2025-10-15T21:50:04.589689] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-15T21:50:04.589782] [INFO ] [MAIN ] Update Progress: 2064/2369 symbols completed. TEAF took 33.1s. Estimated remaining: 42m 51s. Rate: 7.1 symbols/min [2025-10-15T21:50:04.756289] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:04.784974] [DEBUG] [LOCAL ] TEN: Loaded 30487 existing records from primary storage. [2025-10-15T21:50:04.785248] [INFO ] [MAIN ] TEN: Loaded 30487 existing records. [2025-10-15T21:50:04.921213] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-15T21:50:04.961615] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:04.961834] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-15T21:50:04.961897] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-15T21:50:04.962501] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-15T21:50:04.962576] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-15T21:50:05.316308] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:05.714021] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-15T21:50:05.805002] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:50:06.011302] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T21:50:06.514057] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-15T21:50:07.187811] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:50:07.313960] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-15T21:50:08.114030] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-15T21:50:08.272626] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T21:50:08.672229] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T21:50:08.914017] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-15T21:50:09.697468] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T21:50:09.721336] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-15T21:50:09.724096] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T21:50:10.514014] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-15T21:50:11.313964] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-15T21:50:11.404188] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T21:50:11.692887] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T21:50:12.114001] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-15T21:50:12.913981] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-15T21:50:13.069872] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T21:50:13.431758] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T21:50:13.714072] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-15T21:50:14.370235] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T21:50:14.513962] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-15T21:50:14.730090] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T21:50:15.314054] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-15T21:50:16.113976] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-15T21:50:16.385372] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T21:50:16.913962] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-15T21:50:17.079242] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T21:50:17.085789] [INFO ] [REMOTE ] TECK: Full fetch complete (77517 records). [2025-10-15T21:50:17.085935] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-15T21:50:17.484176] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-15T21:50:17.484500] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-15T21:50:17.486025] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-15T21:50:17.486108] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-15T21:50:17.504424] [DEBUG] [LOCAL ] TECK: Trimmed 77517 records to 53434 (keeping 200 days of data) [2025-10-15T21:50:17.527811] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T21:50:17.738707] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-15T21:50:17.919972] [DEBUG] [LOCAL ] TECK: Primary data saved (53434 records). [2025-10-15T21:50:17.920157] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-15T21:50:17.920259] [INFO ] [MAIN ] Update Progress: 2065/2369 symbols completed. TECK took 45.0s. Estimated remaining: 42m 44s. Rate: 7.1 symbols/min [2025-10-15T21:50:18.164766] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:18.193988] [DEBUG] [LOCAL ] TEO: Loaded 22464 existing records from primary storage. [2025-10-15T21:50:18.194354] [INFO ] [MAIN ] TEO: Loaded 22464 existing records. [2025-10-15T21:50:18.441223] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:18.441621] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-15T21:50:18.441733] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-15T21:50:18.442450] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-15T21:50:18.442527] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-15T21:50:18.522296] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-15T21:50:18.896793] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:18.928822] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T21:50:18.981934] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T21:50:19.235197] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T21:50:19.313963] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-15T21:50:20.114003] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-15T21:50:20.663306] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T21:50:20.898473] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T21:50:20.913945] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-15T21:50:21.713988] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-15T21:50:22.105444] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T21:50:22.514002] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-15T21:50:23.160425] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T21:50:23.313971] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-15T21:50:23.570569] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T21:50:24.114022] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-15T21:50:24.617412] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T21:50:24.913978] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-15T21:50:25.168107] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T21:50:25.714010] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-15T21:50:26.232714] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T21:50:26.514005] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-15T21:50:27.313965] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-15T21:50:27.460475] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T21:50:27.710026] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T21:50:27.715308] [INFO ] [REMOTE ] TEN: Full fetch complete (44194 records). [2025-10-15T21:50:27.715435] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-15T21:50:28.119708] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-15T21:50:28.123174] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-15T21:50:28.123233] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-15T21:50:28.124241] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-15T21:50:28.124409] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-15T21:50:28.125549] [DEBUG] [LOCAL ] TEN: Trimmed 44194 records to 30592 (keeping 200 days of data) [2025-10-15T21:50:28.328002] [DEBUG] [LOCAL ] TEN: Primary data saved (30592 records). [2025-10-15T21:50:28.328203] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-15T21:50:28.328326] [INFO ] [MAIN ] Update Progress: 2066/2369 symbols completed. TEN took 23.7s. Estimated remaining: 42m 35s. Rate: 7.1 symbols/min [2025-10-15T21:50:28.465220] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T21:50:28.512339] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:28.562092] [DEBUG] [LOCAL ] TEVA: Loaded 53627 existing records from primary storage. [2025-10-15T21:50:28.562411] [INFO ] [MAIN ] TEVA: Loaded 53627 existing records. [2025-10-15T21:50:28.739327] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:28.739565] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-15T21:50:28.739615] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-15T21:50:28.740958] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-15T21:50:28.741046] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-15T21:50:28.919317] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-15T21:50:29.098661] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:29.282729] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T21:50:29.713998] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-15T21:50:30.514010] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-15T21:50:30.821031] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T21:50:30.845502] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T21:50:31.313966] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-15T21:50:31.504426] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T21:50:32.114007] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-15T21:50:32.328060] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T21:50:32.913995] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-15T21:50:33.713969] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-15T21:50:33.968049] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T21:50:34.007417] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T21:50:34.514005] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-15T21:50:34.803185] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T21:50:35.314025] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-15T21:50:35.552002] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T21:50:36.034769] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T21:50:36.114006] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-15T21:50:36.913994] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-15T21:50:37.174843] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T21:50:37.714003] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-15T21:50:38.514013] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-15T21:50:38.627381] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T21:50:38.785774] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T21:50:38.789135] [INFO ] [REMOTE ] TEI: Full fetch complete (30827 records). [2025-10-15T21:50:38.789237] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-15T21:50:39.183147] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-15T21:50:39.183466] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-15T21:50:39.184237] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-15T21:50:39.184312] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-15T21:50:39.185292] [DEBUG] [LOCAL ] TEI: Trimmed 30827 records to 21312 (keeping 200 days of data) [2025-10-15T21:50:39.307332] [DEBUG] [LOCAL ] TEI: Primary data saved (21312 records). [2025-10-15T21:50:39.307460] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-15T21:50:39.307542] [INFO ] [MAIN ] Update Progress: 2067/2369 symbols completed. TEI took 38.2s. Estimated remaining: 42m 27s. Rate: 7.1 symbols/min [2025-10-15T21:50:39.319178] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-15T21:50:39.477939] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:39.515923] [DEBUG] [LOCAL ] TEX: Loaded 43886 existing records from primary storage. [2025-10-15T21:50:39.516200] [INFO ] [MAIN ] TEX: Loaded 43886 existing records. [2025-10-15T21:50:39.699437] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:39.699769] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-15T21:50:39.699837] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-15T21:50:39.701051] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-15T21:50:39.701114] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-15T21:50:40.066635] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:40.113976] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-15T21:50:40.372878] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T21:50:40.914005] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-15T21:50:41.096618] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T21:50:41.500163] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T21:50:41.713998] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-15T21:50:42.418430] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T21:50:42.513980] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-15T21:50:42.810858] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T21:50:42.814072] [INFO ] [REMOTE ] TEO: Full fetch complete (32673 records). [2025-10-15T21:50:42.814152] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-15T21:50:43.186720] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-15T21:50:43.186799] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-15T21:50:43.187441] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-15T21:50:43.187481] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-15T21:50:43.188200] [DEBUG] [LOCAL ] TEO: Trimmed 32673 records to 22500 (keeping 200 days of data) [2025-10-15T21:50:43.317909] [DEBUG] [LOCAL ] TEO: Primary data saved (22500 records). [2025-10-15T21:50:43.318017] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-15T21:50:43.318116] [INFO ] [MAIN ] Update Progress: 2068/2369 symbols completed. TEO took 25.4s. Estimated remaining: 42m 18s. Rate: 7.1 symbols/min [2025-10-15T21:50:43.315115] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-15T21:50:43.488073] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:43.535118] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-15T21:50:43.535415] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-15T21:50:43.707878] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:43.708076] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-15T21:50:43.708122] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-15T21:50:43.709289] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-15T21:50:43.709346] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-15T21:50:44.065513] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:44.113952] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-15T21:50:44.236421] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T21:50:44.914072] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-15T21:50:45.515359] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-15T21:50:45.562081] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T21:50:45.596820] [INFO ] [REMOTE ] TEL: Full fetch complete (73644 records). [2025-10-15T21:50:45.597015] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-15T21:50:45.600472] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T21:50:45.722024] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-15T21:50:46.013390] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-15T21:50:46.013472] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-15T21:50:46.014560] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-15T21:50:46.014622] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-15T21:50:46.016000] [DEBUG] [LOCAL ] TEL: Trimmed 73644 records to 51067 (keeping 200 days of data) [2025-10-15T21:50:46.325012] [DEBUG] [LOCAL ] TEL: Primary data saved (51067 records). [2025-10-15T21:50:46.325138] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-15T21:50:46.325537] [INFO ] [MAIN ] Update Progress: 2069/2369 symbols completed. TEL took 43.3s. Estimated remaining: 42m 9s. Rate: 7.1 symbols/min [2025-10-15T21:50:46.488350] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:50:46.514003] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-15T21:50:46.526888] [DEBUG] [LOCAL ] TFII: Loaded 33006 existing records from primary storage. [2025-10-15T21:50:46.527186] [INFO ] [MAIN ] TFII: Loaded 33006 existing records. [2025-10-15T21:50:46.701004] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:50:46.701200] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-15T21:50:46.701246] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-15T21:50:46.701616] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-15T21:50:46.701708] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-15T21:50:47.073732] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:50:47.313975] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-15T21:50:47.507601] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T21:50:48.015852] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T21:50:48.113994] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-15T21:50:48.168078] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T21:50:48.914018] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-15T21:50:49.714012] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-15T21:50:49.752432] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T21:50:50.513989] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-15T21:50:50.598155] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T21:50:50.666905] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T21:50:51.314026] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-15T21:50:52.113966] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-15T21:50:52.569626] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T21:50:52.647477] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T21:50:52.913998] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-15T21:50:53.713989] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-15T21:50:54.041145] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T21:50:54.514021] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-15T21:50:54.592516] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T21:50:55.313980] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-15T21:50:55.396422] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T21:50:56.113969] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-15T21:50:56.392864] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T21:50:56.704859] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T21:50:56.914031] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-15T21:50:57.714048] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-15T21:50:58.033416] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T21:50:58.226601] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T21:50:58.514035] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-15T21:50:59.313996] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-15T21:50:59.574504] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T21:51:00.056872] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T21:51:00.113969] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-15T21:51:00.913987] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-15T21:51:01.174373] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T21:51:01.574580] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T21:51:01.713997] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-15T21:51:02.460696] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T21:51:02.513989] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-15T21:51:03.313996] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-15T21:51:03.794889] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T21:51:04.114008] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-15T21:51:04.515586] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T21:51:04.547448] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T21:51:04.913993] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-15T21:51:05.713975] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-15T21:51:06.261061] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-15T21:51:06.514015] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-15T21:51:06.749420] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T21:51:06.912418] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T21:51:07.314031] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-15T21:51:08.113997] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-15T21:51:08.462713] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T21:51:08.470247] [INFO ] [REMOTE ] TEVA: Full fetch complete (77791 records). [2025-10-15T21:51:08.470428] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-15T21:51:08.882307] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:51:08.929178] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-15T21:51:08.928686] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-15T21:51:08.930267] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-15T21:51:08.931925] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-15T21:51:08.932485] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-15T21:51:08.934364] [DEBUG] [LOCAL ] TEVA: Trimmed 77791 records to 53627 (keeping 200 days of data) [2025-10-15T21:51:09.263133] [DEBUG] [LOCAL ] TEVA: Primary data saved (53627 records). [2025-10-15T21:51:09.263284] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-15T21:51:09.263369] [INFO ] [MAIN ] Update Progress: 2070/2369 symbols completed. TEVA took 40.9s. Estimated remaining: 42m 3s. Rate: 7.1 symbols/min [2025-10-15T21:51:09.427198] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:09.448829] [DEBUG] [LOCAL ] TFIN: Loaded 23531 existing records from primary storage. [2025-10-15T21:51:09.449073] [INFO ] [MAIN ] TFIN: Loaded 23531 existing records. [2025-10-15T21:51:09.625915] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:51:09.626132] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-15T21:51:09.626272] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-15T21:51:09.626844] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-15T21:51:09.626916] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-15T21:51:09.719140] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-15T21:51:10.018604] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T21:51:10.023604] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:10.520220] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-15T21:51:10.537785] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T21:51:10.612818] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T21:51:11.251157] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T21:51:11.258471] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-15T21:51:11.258679] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-15T21:51:11.320142] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-15T21:51:11.720041] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-15T21:51:11.720147] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-15T21:51:11.721734] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-15T21:51:11.721801] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-15T21:51:11.723449] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 53667 (keeping 200 days of data) [2025-10-15T21:51:12.077801] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-15T21:51:12.077938] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-15T21:51:12.078033] [INFO ] [MAIN ] Update Progress: 2071/2369 symbols completed. TFC took 28.8s. Estimated remaining: 41m 53s. Rate: 7.1 symbols/min [2025-10-15T21:51:12.120090] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-15T21:51:12.247566] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:12.256971] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T21:51:12.293304] [DEBUG] [LOCAL ] TFPM: Loaded 39273 existing records from primary storage. [2025-10-15T21:51:12.293615] [INFO ] [MAIN ] TFPM: Loaded 39273 existing records. [2025-10-15T21:51:12.469346] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:51:12.469580] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-15T21:51:12.469662] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-15T21:51:12.470448] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-15T21:51:12.470505] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-15T21:51:12.815371] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:12.913990] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-15T21:51:13.713959] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-15T21:51:13.764750] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T21:51:14.183092] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T21:51:14.375365] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T21:51:14.513997] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-15T21:51:15.314005] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-15T21:51:16.107844] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T21:51:16.116168] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-15T21:51:16.151763] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T21:51:16.914008] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-15T21:51:17.473480] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T21:51:17.713998] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-15T21:51:18.445506] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T21:51:18.513950] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-15T21:51:18.922450] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T21:51:19.314017] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-15T21:51:19.805243] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T21:51:19.810335] [INFO ] [REMOTE ] TEX: Full fetch complete (64522 records). [2025-10-15T21:51:19.810447] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-15T21:51:20.119175] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-15T21:51:20.210932] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-15T21:51:20.211020] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-15T21:51:20.212193] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-15T21:51:20.212296] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-15T21:51:20.213685] [DEBUG] [LOCAL ] TEX: Trimmed 64522 records to 43861 (keeping 200 days of data) [2025-10-15T21:51:20.465300] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T21:51:20.515443] [DEBUG] [LOCAL ] TEX: Primary data saved (43861 records). [2025-10-15T21:51:20.515561] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-15T21:51:20.516329] [INFO ] [MAIN ] Update Progress: 2072/2369 symbols completed. TEX took 41.2s. Estimated remaining: 41m 45s. Rate: 7.1 symbols/min [2025-10-15T21:51:20.680684] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:20.721033] [DEBUG] [LOCAL ] TFX: Loaded 36356 existing records from primary storage. [2025-10-15T21:51:20.721326] [INFO ] [MAIN ] TFX: Loaded 36356 existing records. [2025-10-15T21:51:20.899263] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:51:20.899528] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-15T21:51:20.899603] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-15T21:51:20.908138] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-15T21:51:20.908989] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T21:51:20.908723] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-15T21:51:20.923214] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-15T21:51:20.948923] [INFO ] [REMOTE ] TFII: Full fetch complete (48033 records). [2025-10-15T21:51:20.967205] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-15T21:51:21.607468] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:21.640620] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-15T21:51:21.640833] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-15T21:51:21.641736] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-15T21:51:21.641795] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-15T21:51:21.642723] [DEBUG] [LOCAL ] TFII: Trimmed 48033 records to 32821 (keeping 200 days of data) [2025-10-15T21:51:21.730256] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-15T21:51:21.843125] [DEBUG] [LOCAL ] TFII: Primary data saved (32821 records). [2025-10-15T21:51:21.843269] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-15T21:51:21.843597] [INFO ] [MAIN ] Update Progress: 2073/2369 symbols completed. TFII took 35.5s. Estimated remaining: 41m 36s. Rate: 7.1 symbols/min [2025-10-15T21:51:22.011005] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:22.023516] [DEBUG] [LOCAL ] TG: Loaded 10473 existing records from primary storage. [2025-10-15T21:51:22.023763] [INFO ] [MAIN ] TG: Loaded 10473 existing records. [2025-10-15T21:51:22.210083] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:51:22.210497] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-15T21:51:22.210630] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-15T21:51:22.210905] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-15T21:51:22.210975] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-15T21:51:22.520434] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-15T21:51:22.612742] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:22.606815] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T21:51:23.041617] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T21:51:23.314031] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-15T21:51:23.466248] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T21:51:24.114060] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-15T21:51:24.836014] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T21:51:24.913984] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-15T21:51:24.980610] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T21:51:25.714022] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-15T21:51:26.294797] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T21:51:26.514015] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-15T21:51:26.769329] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T21:51:27.048333] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T21:51:27.314100] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-15T21:51:28.058679] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T21:51:28.114009] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-15T21:51:28.913980] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-15T21:51:28.993836] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T21:51:29.713991] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-15T21:51:29.941559] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T21:51:30.513989] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-15T21:51:31.313975] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-15T21:51:31.500179] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T21:51:31.796435] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T21:51:32.113963] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-15T21:51:32.179125] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T21:51:32.914046] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-15T21:51:33.694148] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T21:51:33.713955] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-15T21:51:34.354693] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T21:51:34.514008] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-15T21:51:35.137840] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T21:51:35.314022] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-15T21:51:35.963066] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T21:51:36.014689] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T21:51:36.114020] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-15T21:51:36.914008] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-15T21:51:37.389679] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T21:51:37.632814] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T21:51:37.713966] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-15T21:51:38.509801] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T21:51:38.513945] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-15T21:51:39.308477] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T21:51:39.313938] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-15T21:51:40.109115] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T21:51:40.113947] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-15T21:51:40.891819] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T21:51:40.893757] [INFO ] [REMOTE ] TG: Full fetch complete (15082 records). [2025-10-15T21:51:40.893826] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-15T21:51:40.922993] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-15T21:51:41.256819] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-15T21:51:41.256919] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-15T21:51:41.257260] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-15T21:51:41.257299] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-15T21:51:41.257810] [DEBUG] [LOCAL ] TG: Trimmed 15082 records to 10520 (keeping 200 days of data) [2025-10-15T21:51:41.315136] [DEBUG] [LOCAL ] TG: Primary data saved (10520 records). [2025-10-15T21:51:41.315256] [INFO ] [MAIN ] TG: Full history saved. [2025-10-15T21:51:41.315332] [INFO ] [MAIN ] Update Progress: 2074/2369 symbols completed. TG took 19.5s. Estimated remaining: 41m 29s. Rate: 7.1 symbols/min [2025-10-15T21:51:41.480296] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:41.480449] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-15T21:51:41.480485] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-15T21:51:41.480590] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-15T21:51:41.480630] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-15T21:51:41.480712] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-15T21:51:41.480753] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-15T21:51:41.719102] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-15T21:51:41.837305] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:42.114968] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T21:51:42.514009] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-15T21:51:43.132292] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T21:51:43.314039] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-15T21:51:43.507336] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:51:43.507700] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-15T21:51:43.507785] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:51:43.507834] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-15T21:51:43.507891] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:51:43.507962] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-15T21:51:43.508024] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-15T21:51:43.508058] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-15T21:51:43.508097] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-15T21:51:43.508143] [INFO ] [MAIN ] Update Progress: 2075/2369 symbols completed. TGE took 2.2s. Estimated remaining: 41m 19s. Rate: 7.1 symbols/min [2025-10-15T21:51:43.685925] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:43.714900] [DEBUG] [LOCAL ] TGLS: Loaded 27617 existing records from primary storage. [2025-10-15T21:51:43.715206] [INFO ] [MAIN ] TGLS: Loaded 27617 existing records. [2025-10-15T21:51:43.904959] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:51:43.905196] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-15T21:51:43.905245] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-15T21:51:43.905538] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-15T21:51:43.905578] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-15T21:51:44.122219] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-15T21:51:44.249674] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T21:51:44.332085] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:44.914022] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-15T21:51:45.714017] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-15T21:51:45.765839] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T21:51:46.072981] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T21:51:46.514012] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-15T21:51:46.874516] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T21:51:47.314026] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-15T21:51:47.679042] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T21:51:48.114056] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-15T21:51:48.593169] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T21:51:48.914051] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-15T21:51:49.713967] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-15T21:51:49.756204] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T21:51:49.981554] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T21:51:50.514083] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-15T21:51:51.035432] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T21:51:51.314054] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-15T21:51:51.625397] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T21:51:52.113999] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-15T21:51:52.284353] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T21:51:52.287494] [INFO ] [REMOTE ] TFIN: Full fetch complete (31933 records). [2025-10-15T21:51:52.287592] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-15T21:51:52.653904] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-15T21:51:52.653985] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-15T21:51:52.654665] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-15T21:51:52.654728] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-15T21:51:52.655568] [DEBUG] [LOCAL ] TFIN: Trimmed 31933 records to 23600 (keeping 200 days of data) [2025-10-15T21:51:52.805802] [DEBUG] [LOCAL ] TFIN: Primary data saved (23600 records). [2025-10-15T21:51:52.805936] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-15T21:51:52.806017] [INFO ] [MAIN ] Update Progress: 2076/2369 symbols completed. TFIN took 43.5s. Estimated remaining: 41m 11s. Rate: 7.1 symbols/min [2025-10-15T21:51:52.919133] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-15T21:51:52.979638] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:51:53.024414] [DEBUG] [LOCAL ] TGNA: Loaded 48637 existing records from primary storage. [2025-10-15T21:51:53.024747] [INFO ] [MAIN ] TGNA: Loaded 48637 existing records. [2025-10-15T21:51:53.206302] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:51:53.206550] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-15T21:51:53.206599] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-15T21:51:53.207074] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-15T21:51:53.207132] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-15T21:51:53.575330] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:51:53.588140] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T21:51:53.713969] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-15T21:51:54.524694] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-15T21:51:54.530026] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T21:51:55.021677] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T21:51:55.314035] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-15T21:51:55.835549] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T21:51:55.840024] [INFO ] [REMOTE ] TFX: Full fetch complete (54628 records). [2025-10-15T21:51:55.840121] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-15T21:51:56.119528] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-15T21:51:56.212877] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-15T21:51:56.212954] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-15T21:51:56.213917] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-15T21:51:56.213981] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-15T21:51:56.215093] [DEBUG] [LOCAL ] TFX: Trimmed 54628 records to 36207 (keeping 200 days of data) [2025-10-15T21:51:56.442249] [DEBUG] [LOCAL ] TFX: Primary data saved (36207 records). [2025-10-15T21:51:56.442369] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-15T21:51:56.442447] [INFO ] [MAIN ] Update Progress: 2077/2369 symbols completed. TFX took 35.9s. Estimated remaining: 41m 2s. Rate: 7.1 symbols/min [2025-10-15T21:51:56.602405] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T21:51:56.608059] [INFO ] [REMOTE ] TFPM: Full fetch complete (52431 records). [2025-10-15T21:51:56.608171] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-15T21:51:56.920875] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-15T21:51:57.023936] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-15T21:51:57.024034] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-15T21:51:57.025036] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-15T21:51:57.025099] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-15T21:51:57.026402] [DEBUG] [LOCAL ] TFPM: Trimmed 52431 records to 39427 (keeping 200 days of data) [2025-10-15T21:51:57.260109] [DEBUG] [LOCAL ] TFPM: Primary data saved (39427 records). [2025-10-15T21:51:57.260233] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-15T21:51:57.260312] [INFO ] [MAIN ] Update Progress: 2078/2369 symbols completed. TFPM took 45.2s. Estimated remaining: 40m 52s. Rate: 7.1 symbols/min [2025-10-15T21:51:57.422593] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T21:51:57.714002] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-15T21:51:58.316369] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T21:51:58.514106] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-15T21:51:59.094307] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T21:51:59.313990] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-15T21:51:59.712314] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T21:52:00.047121] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T21:52:00.114000] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-15T21:52:00.914110] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-15T21:52:01.873166] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T21:52:01.883544] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-15T21:52:02.051553] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T21:52:02.514018] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-15T21:52:03.384210] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T21:52:03.394740] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-15T21:52:03.827202] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T21:52:04.114046] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-15T21:52:05.110404] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T21:52:05.121473] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-15T21:52:05.183314] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T21:52:05.714069] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-15T21:52:06.712036] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T21:52:06.721414] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-15T21:52:06.762434] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T21:52:06.765669] [INFO ] [REMOTE ] TGLS: Full fetch complete (40618 records). [2025-10-15T21:52:06.765759] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-15T21:52:07.140942] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-15T21:52:07.141028] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-15T21:52:07.141832] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-15T21:52:07.141894] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-15T21:52:07.142888] [DEBUG] [LOCAL ] TGLS: Trimmed 40618 records to 27631 (keeping 200 days of data) [2025-10-15T21:52:07.313162] [DEBUG] [LOCAL ] TGLS: Primary data saved (27631 records). [2025-10-15T21:52:07.313305] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-15T21:52:07.313630] [INFO ] [MAIN ] Update Progress: 2079/2369 symbols completed. TGLS took 23.8s. Estimated remaining: 40m 44s. Rate: 7.1 symbols/min [2025-10-15T21:52:08.382072] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T21:52:08.392293] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-15T21:52:10.273123] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T21:52:10.284345] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-15T21:52:11.965370] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T21:52:11.977308] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-15T21:52:13.468214] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T21:52:13.473966] [INFO ] [REMOTE ] TGNA: Full fetch complete (70045 records). [2025-10-15T21:52:13.474079] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-15T21:52:13.849217] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-15T21:52:13.849294] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-15T21:52:13.850349] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-15T21:52:13.850412] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-15T21:52:13.851799] [DEBUG] [LOCAL ] TGNA: Trimmed 70045 records to 48617 (keeping 200 days of data) [2025-10-15T21:52:14.138831] [DEBUG] [LOCAL ] TGNA: Primary data saved (48617 records). [2025-10-15T21:52:14.138976] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-15T21:52:14.139053] [INFO ] [MAIN ] Update Progress: 2080/2369 symbols completed. TGNA took 21.3s. Estimated remaining: 40m 36s. Rate: 7.1 symbols/min [2025-10-15T21:52:14.724627] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:14.760794] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:14.790321] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:14.843178] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:14.894964] [DEBUG] [LOCAL ] TGS: Loaded 33400 existing records from primary storage. [2025-10-15T21:52:14.894380] [DEBUG] [LOCAL ] THG: Loaded 21676 existing records from primary storage. [2025-10-15T21:52:14.895750] [INFO ] [MAIN ] TGS: Loaded 33400 existing records. [2025-10-15T21:52:14.895599] [INFO ] [MAIN ] THG: Loaded 21676 existing records. [2025-10-15T21:52:15.073101] [DEBUG] [LOCAL ] THC: Loaded 47104 existing records from primary storage. [2025-10-15T21:52:15.123582] [INFO ] [MAIN ] THC: Loaded 47104 existing records. [2025-10-15T21:52:15.196767] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-15T21:52:15.228432] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-15T21:52:15.373624] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:15.462775] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-15T21:52:15.468904] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:15.474234] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-15T21:52:15.474467] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-15T21:52:15.488133] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-15T21:52:15.488227] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-15T21:52:15.519199] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-15T21:52:15.535331] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-15T21:52:15.535519] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-15T21:52:15.799598] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:15.796567] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:15.892598] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-15T21:52:15.892525] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-15T21:52:15.893011] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-15T21:52:15.892851] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-15T21:52:15.929902] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-15T21:52:15.953213] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-15T21:52:15.968616] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-15T21:52:15.953164] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-15T21:52:16.956528] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:16.944622] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:16.974853] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-15T21:52:16.994483] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-15T21:52:17.178163] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:17.182792] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:17.183104] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-15T21:52:17.183326] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-15T21:52:18.154031] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T21:52:18.158164] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-15T21:52:18.355599] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T21:52:18.361846] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-15T21:52:18.861573] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T21:52:18.870985] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-15T21:52:18.991693] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T21:52:19.003273] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-15T21:52:19.147975] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T21:52:19.152112] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-15T21:52:19.398384] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T21:52:19.405744] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-15T21:52:20.182744] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T21:52:20.190789] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-15T21:52:20.468853] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T21:52:20.479017] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-15T21:52:20.700389] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T21:52:20.711491] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-15T21:52:20.985440] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T21:52:20.990803] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-15T21:52:21.320926] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-15T21:52:21.331699] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-15T21:52:21.740150] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T21:52:21.751377] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-15T21:52:21.826217] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T21:52:22.347064] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T21:52:22.514053] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-15T21:52:23.108365] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T21:52:23.313976] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-15T21:52:23.406348] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-15T21:52:23.428426] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T21:52:24.114066] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-15T21:52:24.698825] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T21:52:24.914014] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-15T21:52:25.714010] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-15T21:52:25.841791] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T21:52:26.299953] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T21:52:26.514011] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-15T21:52:26.836136] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T21:52:27.313994] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-15T21:52:27.821345] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T21:52:28.114004] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-15T21:52:28.913986] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-15T21:52:29.223887] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T21:52:29.676168] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-15T21:52:29.713959] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-15T21:52:30.319967] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T21:52:30.514014] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-15T21:52:31.313983] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-15T21:52:32.036226] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-15T21:52:32.086935] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T21:52:32.113959] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-15T21:52:32.676430] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T21:52:32.914038] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-15T21:52:33.677403] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T21:52:33.714006] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-15T21:52:34.513974] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-15T21:52:34.810062] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T21:52:35.021065] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T21:52:35.314036] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-15T21:52:36.126381] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-15T21:52:36.129470] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:52:36.620500] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T21:52:36.625526] [INFO ] [REMOTE ] TGS: Full fetch complete (48631 records). [2025-10-15T21:52:36.625620] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-15T21:52:36.919163] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-15T21:52:37.000554] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-15T21:52:37.000632] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-15T21:52:37.001583] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-15T21:52:37.001632] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-15T21:52:37.002768] [DEBUG] [LOCAL ] TGS: Trimmed 48631 records to 33583 (keeping 200 days of data) [2025-10-15T21:52:37.194885] [DEBUG] [LOCAL ] TGS: Primary data saved (33583 records). [2025-10-15T21:52:37.195015] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-15T21:52:37.195092] [INFO ] [MAIN ] Update Progress: 2081/2369 symbols completed. TGS took 23.0s. Estimated remaining: 40m 29s. Rate: 7.1 symbols/min [2025-10-15T21:52:37.358551] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:37.362077] [DEBUG] [LOCAL ] THIR: Loaded 2355 existing records from primary storage. [2025-10-15T21:52:37.362233] [INFO ] [MAIN ] THIR: Loaded 2355 existing records. [2025-10-15T21:52:37.536219] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:37.536441] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-15T21:52:37.536497] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-15T21:52:37.536694] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-15T21:52:37.536754] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-15T21:52:37.740750] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-15T21:52:37.889202] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:37.997021] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T21:52:38.519099] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-15T21:52:38.537306] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T21:52:39.314023] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-15T21:52:39.439431] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T21:52:39.456747] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T21:52:39.459433] [INFO ] [REMOTE ] THG: Full fetch complete (31207 records). [2025-10-15T21:52:39.459526] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-15T21:52:39.820034] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-15T21:52:39.820113] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-15T21:52:39.820815] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-15T21:52:39.820884] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-15T21:52:39.821572] [DEBUG] [LOCAL ] THG: Trimmed 31207 records to 21713 (keeping 200 days of data) [2025-10-15T21:52:39.962070] [DEBUG] [LOCAL ] THG: Primary data saved (21713 records). [2025-10-15T21:52:39.962265] [INFO ] [MAIN ] THG: Full history saved. [2025-10-15T21:52:39.962351] [INFO ] [MAIN ] Update Progress: 2082/2369 symbols completed. THG took 25.8s. Estimated remaining: 40m 20s. Rate: 7.1 symbols/min [2025-10-15T21:52:40.125308] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-15T21:52:40.127894] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:40.131608] [DEBUG] [LOCAL ] THLV: Loaded 1508 existing records from primary storage. [2025-10-15T21:52:40.131901] [INFO ] [MAIN ] THLV: Loaded 1508 existing records. [2025-10-15T21:52:40.305498] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:40.305820] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-15T21:52:40.305881] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-15T21:52:40.306089] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-15T21:52:40.306144] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-15T21:52:40.651445] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:40.914004] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-15T21:52:41.348899] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T21:52:41.520168] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-15T21:52:41.713973] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-15T21:52:41.936907] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T21:52:42.514005] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-15T21:52:43.314008] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-15T21:52:43.638770] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T21:52:43.908993] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-15T21:52:44.095810] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T21:52:44.114009] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-15T21:52:44.537191] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T21:52:44.913999] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-15T21:52:45.242579] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T21:52:45.714013] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-15T21:52:46.137921] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T21:52:46.514004] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-15T21:52:47.183346] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:52:47.189787] [INFO ] [REMOTE ] TGT: Full fetch complete (77956 records). [2025-10-15T21:52:47.189905] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-15T21:52:47.329010] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-15T21:52:47.585725] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-15T21:52:47.585821] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-15T21:52:47.586995] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-15T21:52:47.587059] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-15T21:52:47.588596] [DEBUG] [LOCAL ] TGT: Trimmed 77956 records to 53778 (keeping 200 days of data) [2025-10-15T21:52:47.931669] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-15T21:52:47.931822] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-15T21:52:47.931919] [INFO ] [MAIN ] Update Progress: 2083/2369 symbols completed. TGT took 33.8s. Estimated remaining: 40m 11s. Rate: 7.1 symbols/min [2025-10-15T21:52:48.097083] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:48.105767] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T21:52:48.113949] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-15T21:52:48.143122] [DEBUG] [LOCAL ] THO: Loaded 41591 existing records from primary storage. [2025-10-15T21:52:48.143428] [INFO ] [MAIN ] THO: Loaded 41591 existing records. [2025-10-15T21:52:48.314178] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:48.314416] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-15T21:52:48.314463] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-15T21:52:48.314825] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-15T21:52:48.314882] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-15T21:52:48.591173] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T21:52:48.668984] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:48.914010] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-15T21:52:49.243760] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T21:52:49.714019] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-15T21:52:50.514047] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-15T21:52:50.912580] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-15T21:52:51.251765] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T21:52:51.314027] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-15T21:52:52.114113] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-15T21:52:52.693804] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T21:52:52.708392] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T21:52:52.713920] [INFO ] [REMOTE ] THC: Full fetch complete (68894 records). [2025-10-15T21:52:52.714212] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-15T21:52:52.923928] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-15T21:52:53.136057] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-15T21:52:53.136424] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-15T21:52:53.137953] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-15T21:52:53.138018] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-15T21:52:53.140319] [DEBUG] [LOCAL ] THC: Trimmed 68894 records to 47056 (keeping 200 days of data) [2025-10-15T21:52:53.449681] [DEBUG] [LOCAL ] THC: Primary data saved (47056 records). [2025-10-15T21:52:53.449903] [INFO ] [MAIN ] THC: Full history saved. [2025-10-15T21:52:53.450789] [INFO ] [MAIN ] Update Progress: 2084/2369 symbols completed. THC took 39.3s. Estimated remaining: 40m 3s. Rate: 7.1 symbols/min [2025-10-15T21:52:53.564306] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T21:52:53.646268] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:52:53.672399] [DEBUG] [LOCAL ] THQ: Loaded 25366 existing records from primary storage. [2025-10-15T21:52:53.672687] [INFO ] [MAIN ] THQ: Loaded 25366 existing records. [2025-10-15T21:52:53.723271] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-15T21:52:53.847235] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:52:53.847430] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-15T21:52:53.847479] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-15T21:52:53.847889] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-15T21:52:53.847946] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-15T21:52:54.189611] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:52:54.274818] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T21:52:54.514014] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-15T21:52:55.314056] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-15T21:52:55.863778] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T21:52:55.886890] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:52:56.114006] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-15T21:52:56.913988] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-15T21:52:57.262120] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-15T21:52:57.355628] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T21:52:57.714059] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-15T21:52:58.166997] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T21:52:58.514023] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-15T21:52:59.054760] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T21:52:59.314024] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-15T21:52:59.814146] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-15T21:53:00.114022] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-15T21:53:00.913977] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-15T21:53:01.208120] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T21:53:01.714063] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-15T21:53:01.975830] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T21:53:01.976831] [INFO ] [REMOTE ] THIR: Full fetch complete (2855 records). [2025-10-15T21:53:01.976906] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-15T21:53:02.129593] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T21:53:02.367271] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-15T21:53:02.367348] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-15T21:53:02.367456] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-15T21:53:02.367494] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-15T21:53:02.367867] [DEBUG] [LOCAL ] THIR: Trimmed 2855 records to 2374 (keeping 200 days of data) [2025-10-15T21:53:02.381729] [DEBUG] [LOCAL ] THIR: Primary data saved (2374 records). [2025-10-15T21:53:02.381822] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-15T21:53:02.381900] [INFO ] [MAIN ] Update Progress: 2085/2369 symbols completed. THIR took 25.2s. Estimated remaining: 39m 54s. Rate: 7.1 symbols/min [2025-10-15T21:53:02.519926] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-15T21:53:02.552291] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:02.571726] [DEBUG] [LOCAL ] THR: Loaded 19733 existing records from primary storage. [2025-10-15T21:53:02.571960] [INFO ] [MAIN ] THR: Loaded 19733 existing records. [2025-10-15T21:53:02.745473] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:53:02.745730] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-15T21:53:02.745784] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-15T21:53:02.746056] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-15T21:53:02.746113] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-15T21:53:03.092382] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:03.313969] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-15T21:53:03.545264] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T21:53:04.114012] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-15T21:53:04.329310] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T21:53:04.537858] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T21:53:04.914080] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-15T21:53:05.256240] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T21:53:05.714021] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-15T21:53:06.513961] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-15T21:53:06.894235] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T21:53:07.257280] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T21:53:07.313951] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-15T21:53:08.114025] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-15T21:53:08.465005] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T21:53:08.465810] [INFO ] [REMOTE ] THLV: Full fetch complete (2552 records). [2025-10-15T21:53:08.465878] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-15T21:53:08.757068] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T21:53:08.842447] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-15T21:53:08.842528] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-15T21:53:08.842660] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-15T21:53:08.842732] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-15T21:53:08.843061] [DEBUG] [LOCAL ] THLV: Trimmed 2552 records to 1510 (keeping 200 days of data) [2025-10-15T21:53:08.852104] [DEBUG] [LOCAL ] THLV: Primary data saved (1510 records). [2025-10-15T21:53:08.852161] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-15T21:53:08.852281] [INFO ] [MAIN ] Update Progress: 2086/2369 symbols completed. THLV took 28.9s. Estimated remaining: 39m 46s. Rate: 7.1 symbols/min [2025-10-15T21:53:08.919294] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-15T21:53:09.022470] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:09.059847] [DEBUG] [LOCAL ] THS: Loaded 38604 existing records from primary storage. [2025-10-15T21:53:09.060123] [INFO ] [MAIN ] THS: Loaded 38604 existing records. [2025-10-15T21:53:09.233965] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:53:09.234154] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-15T21:53:09.234199] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-15T21:53:09.234468] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-15T21:53:09.234505] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-15T21:53:09.582520] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:09.713968] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-15T21:53:10.519080] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-15T21:53:10.533754] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T21:53:11.040348] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T21:53:11.313957] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-15T21:53:11.408390] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T21:53:12.114052] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-15T21:53:12.914022] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-15T21:53:13.302845] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T21:53:13.669694] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T21:53:13.713958] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-15T21:53:14.179938] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T21:53:14.513967] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-15T21:53:15.157091] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T21:53:15.313968] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-15T21:53:15.404587] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T21:53:16.114053] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-15T21:53:16.807067] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T21:53:16.914009] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-15T21:53:16.947887] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T21:53:17.713990] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-15T21:53:18.370450] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T21:53:18.513980] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-15T21:53:19.314024] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-15T21:53:19.924056] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-15T21:53:19.959730] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T21:53:20.027316] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T21:53:20.114000] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-15T21:53:20.914005] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-15T21:53:21.713980] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-15T21:53:21.823136] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T21:53:21.899210] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T21:53:22.514007] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-15T21:53:22.904402] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T21:53:23.314039] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-15T21:53:23.635026] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T21:53:24.113996] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-15T21:53:24.914033] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-15T21:53:25.137761] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T21:53:25.546790] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T21:53:25.713985] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-15T21:53:26.100751] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T21:53:26.514003] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-15T21:53:27.297166] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T21:53:27.313950] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-15T21:53:27.844845] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T21:53:28.113989] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-15T21:53:28.914007] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-15T21:53:29.246340] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T21:53:29.612130] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T21:53:29.714012] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-15T21:53:30.275217] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T21:53:30.513995] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-15T21:53:31.215628] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T21:53:31.314067] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-15T21:53:31.428580] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T21:53:31.431029] [INFO ] [REMOTE ] THR: Full fetch complete (28782 records). [2025-10-15T21:53:31.431109] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-15T21:53:31.815298] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-15T21:53:31.815391] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-15T21:53:31.816003] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-15T21:53:31.816065] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-15T21:53:31.816786] [DEBUG] [LOCAL ] THR: Trimmed 28782 records to 19794 (keeping 200 days of data) [2025-10-15T21:53:31.931532] [DEBUG] [LOCAL ] THR: Primary data saved (19794 records). [2025-10-15T21:53:31.931708] [INFO ] [MAIN ] THR: Full history saved. [2025-10-15T21:53:31.931805] [INFO ] [MAIN ] Update Progress: 2087/2369 symbols completed. THR took 29.5s. Estimated remaining: 39m 39s. Rate: 7.1 symbols/min [2025-10-15T21:53:32.101142] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:32.119098] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-15T21:53:32.120602] [DEBUG] [LOCAL ] THW: Loaded 19747 existing records from primary storage. [2025-10-15T21:53:32.120844] [INFO ] [MAIN ] THW: Loaded 19747 existing records. [2025-10-15T21:53:32.301609] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:53:32.301820] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-15T21:53:32.301887] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-15T21:53:32.302070] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-15T21:53:32.302136] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-15T21:53:32.648044] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T21:53:32.693624] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:32.913994] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-15T21:53:33.714017] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-15T21:53:33.762637] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T21:53:34.021057] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T21:53:34.513964] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-15T21:53:34.750381] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T21:53:34.753592] [INFO ] [REMOTE ] THQ: Full fetch complete (34983 records). [2025-10-15T21:53:34.753702] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-15T21:53:35.114863] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-15T21:53:35.114997] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-15T21:53:35.115699] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-15T21:53:35.116142] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-15T21:53:35.116979] [DEBUG] [LOCAL ] THQ: Trimmed 34983 records to 25363 (keeping 200 days of data) [2025-10-15T21:53:35.266929] [DEBUG] [LOCAL ] THQ: Primary data saved (25363 records). [2025-10-15T21:53:35.267052] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-15T21:53:35.267129] [INFO ] [MAIN ] Update Progress: 2088/2369 symbols completed. THQ took 41.8s. Estimated remaining: 39m 30s. Rate: 7.1 symbols/min [2025-10-15T21:53:35.314439] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-15T21:53:35.446800] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:35.446946] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-15T21:53:35.446985] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-15T21:53:35.447119] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-15T21:53:35.447177] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-15T21:53:35.447222] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-15T21:53:35.447256] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-15T21:53:35.654003] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T21:53:35.836124] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:36.113979] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-15T21:53:36.557491] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:53:36.914097] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-15T21:53:37.111608] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:53:37.111954] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-15T21:53:37.112048] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:53:37.112099] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-15T21:53:37.112131] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:53:37.112246] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-15T21:53:37.112318] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-15T21:53:37.112354] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-15T21:53:37.112392] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-15T21:53:37.112437] [INFO ] [MAIN ] Update Progress: 2089/2369 symbols completed. TIC took 1.8s. Estimated remaining: 39m 21s. Rate: 7.1 symbols/min [2025-10-15T21:53:37.286502] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:37.321470] [DEBUG] [LOCAL ] TIMB: Loaded 35322 existing records from primary storage. [2025-10-15T21:53:37.321761] [INFO ] [MAIN ] TIMB: Loaded 35322 existing records. [2025-10-15T21:53:37.506033] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T21:53:37.510323] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:53:37.510507] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-15T21:53:37.514573] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-15T21:53:37.515035] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-15T21:53:37.515110] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-15T21:53:37.515000] [INFO ] [REMOTE ] THO: Full fetch complete (60244 records). [2025-10-15T21:53:37.521567] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-15T21:53:37.734204] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-15T21:53:38.230842] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:38.266918] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-15T21:53:38.266984] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-15T21:53:38.267973] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-15T21:53:38.268035] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-15T21:53:38.269252] [DEBUG] [LOCAL ] THO: Trimmed 60244 records to 41458 (keeping 200 days of data) [2025-10-15T21:53:38.517346] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-15T21:53:38.522074] [DEBUG] [LOCAL ] THO: Primary data saved (41458 records). [2025-10-15T21:53:38.523049] [INFO ] [MAIN ] THO: Full history saved. [2025-10-15T21:53:38.523158] [INFO ] [MAIN ] Update Progress: 2090/2369 symbols completed. THO took 50.6s. Estimated remaining: 39m 11s. Rate: 7.1 symbols/min [2025-10-15T21:53:38.713108] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:38.719454] [DEBUG] [LOCAL ] TISI: Loaded 3343 existing records from primary storage. [2025-10-15T21:53:38.719617] [INFO ] [MAIN ] TISI: Loaded 3343 existing records. [2025-10-15T21:53:38.894575] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:53:38.894783] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-15T21:53:38.894830] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-15T21:53:38.894962] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-15T21:53:38.894999] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-15T21:53:38.995002] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T21:53:39.258781] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:39.313970] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-15T21:53:40.114023] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-15T21:53:40.183553] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T21:53:40.483788] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-15T21:53:40.914015] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-15T21:53:41.005582] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:53:41.713967] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-15T21:53:42.528114] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-15T21:53:42.551019] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T21:53:42.744056] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T21:53:42.968170] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T21:53:43.314002] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-15T21:53:43.860401] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T21:53:44.114009] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-15T21:53:44.788905] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T21:53:44.914001] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-15T21:53:45.651754] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T21:53:45.714000] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-15T21:53:46.415382] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T21:53:46.514018] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-15T21:53:47.313980] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-15T21:53:47.882239] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T21:53:47.887028] [INFO ] [REMOTE ] THS: Full fetch complete (54458 records). [2025-10-15T21:53:47.887124] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-15T21:53:47.969283] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T21:53:48.119122] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-15T21:53:48.276741] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-15T21:53:48.276833] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-15T21:53:48.277784] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-15T21:53:48.277846] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-15T21:53:48.279050] [DEBUG] [LOCAL ] THS: Trimmed 54458 records to 38627 (keeping 200 days of data) [2025-10-15T21:53:48.503454] [DEBUG] [LOCAL ] THS: Primary data saved (38627 records). [2025-10-15T21:53:48.503599] [INFO ] [MAIN ] THS: Full history saved. [2025-10-15T21:53:48.503707] [INFO ] [MAIN ] Update Progress: 2091/2369 symbols completed. THS took 39.7s. Estimated remaining: 39m 3s. Rate: 7.1 symbols/min [2025-10-15T21:53:48.666972] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:53:48.697598] [DEBUG] [LOCAL ] TIXT: Loaded 32339 existing records from primary storage. [2025-10-15T21:53:48.697886] [INFO ] [MAIN ] TIXT: Loaded 32339 existing records. [2025-10-15T21:53:48.868540] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:53:48.868759] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-15T21:53:48.868821] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-15T21:53:48.869188] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-15T21:53:48.869244] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-15T21:53:48.922069] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-15T21:53:49.218110] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:53:49.668762] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T21:53:49.713952] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-15T21:53:50.039838] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T21:53:50.514002] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-15T21:53:51.148531] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T21:53:51.313974] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-15T21:53:51.574041] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T21:53:52.114051] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-15T21:53:52.763496] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T21:53:52.913998] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-15T21:53:53.467079] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T21:53:53.714029] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-15T21:53:54.237175] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T21:53:54.263156] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T21:53:54.514049] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-15T21:53:55.314002] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-15T21:53:55.975107] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T21:53:56.113996] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-15T21:53:56.645093] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T21:53:56.913981] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-15T21:53:57.632727] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T21:53:57.713960] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-15T21:53:58.110877] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T21:53:58.513998] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-15T21:53:58.722025] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T21:53:59.314007] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-15T21:53:59.623178] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T21:54:00.114012] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-15T21:54:00.343936] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T21:54:00.914007] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-15T21:54:01.201909] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T21:54:01.374961] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T21:54:01.714015] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-15T21:54:02.513993] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-15T21:54:02.802543] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T21:54:03.314044] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-15T21:54:03.862191] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T21:54:03.864673] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T21:54:04.114063] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-15T21:54:04.914062] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-15T21:54:05.249412] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T21:54:05.713967] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-15T21:54:06.020837] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T21:54:06.514097] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-15T21:54:06.773483] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:54:07.314045] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-15T21:54:07.617403] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T21:54:07.629577] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-15T21:54:07.630391] [INFO ] [REMOTE ] TISI: Full fetch complete (4910 records). [2025-10-15T21:54:07.630458] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-15T21:54:07.974724] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-15T21:54:07.974802] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-15T21:54:07.974928] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-15T21:54:07.974965] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-15T21:54:07.975299] [DEBUG] [LOCAL ] TISI: Trimmed 4910 records to 3331 (keeping 200 days of data) [2025-10-15T21:54:07.995001] [DEBUG] [LOCAL ] TISI: Primary data saved (3331 records). [2025-10-15T21:54:07.995062] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-15T21:54:07.995127] [INFO ] [MAIN ] Update Progress: 2092/2369 symbols completed. TISI took 29.5s. Estimated remaining: 38m 56s. Rate: 7.1 symbols/min [2025-10-15T21:54:08.119191] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-15T21:54:08.166318] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:08.220736] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-15T21:54:08.221052] [INFO ] [MAIN ] TJX: Loaded 53668 existing records. [2025-10-15T21:54:08.395881] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:08.396099] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-15T21:54:08.396164] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-15T21:54:08.396498] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-15T21:54:08.396552] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-15T21:54:08.741488] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:08.913955] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-15T21:54:09.289827] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T21:54:09.713990] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-15T21:54:10.514015] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-15T21:54:10.694753] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T21:54:10.697793] [INFO ] [REMOTE ] THW: Full fetch complete (29052 records). [2025-10-15T21:54:10.697871] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-15T21:54:11.040046] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T21:54:11.140201] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-15T21:54:11.140290] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-15T21:54:11.140938] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-15T21:54:11.140999] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-15T21:54:11.141831] [DEBUG] [LOCAL ] THW: Trimmed 29052 records to 19728 (keeping 200 days of data) [2025-10-15T21:54:11.260700] [DEBUG] [LOCAL ] THW: Primary data saved (19728 records). [2025-10-15T21:54:11.260835] [INFO ] [MAIN ] THW: Full history saved. [2025-10-15T21:54:11.260913] [INFO ] [MAIN ] Update Progress: 2093/2369 symbols completed. THW took 39.3s. Estimated remaining: 38m 47s. Rate: 7.1 symbols/min [2025-10-15T21:54:11.321523] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-15T21:54:11.451918] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:11.493087] [DEBUG] [LOCAL ] TK: Loaded 39177 existing records from primary storage. [2025-10-15T21:54:11.493397] [INFO ] [MAIN ] TK: Loaded 39177 existing records. [2025-10-15T21:54:11.648302] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T21:54:11.680730] [INFO ] [REMOTE ] TIMB: Full fetch complete (53553 records). [2025-10-15T21:54:11.697810] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-15T21:54:11.721798] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:11.722104] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-15T21:54:11.722232] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-15T21:54:11.754412] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-15T21:54:11.786200] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-15T21:54:12.128393] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-15T21:54:12.552587] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-15T21:54:12.577605] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-15T21:54:12.577526] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:12.579297] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-15T21:54:12.579371] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-15T21:54:12.580427] [DEBUG] [LOCAL ] TIMB: Trimmed 53553 records to 35342 (keeping 200 days of data) [2025-10-15T21:54:12.815804] [DEBUG] [LOCAL ] TIMB: Primary data saved (35342 records). [2025-10-15T21:54:12.815951] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-15T21:54:12.816422] [INFO ] [MAIN ] Update Progress: 2094/2369 symbols completed. TIMB took 35.7s. Estimated remaining: 38m 38s. Rate: 7.1 symbols/min [2025-10-15T21:54:12.916603] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-15T21:54:13.018042] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:13.056886] [DEBUG] [LOCAL ] TKC: Loaded 39400 existing records from primary storage. [2025-10-15T21:54:13.057217] [INFO ] [MAIN ] TKC: Loaded 39400 existing records. [2025-10-15T21:54:13.272118] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:13.272522] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-15T21:54:13.272685] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-15T21:54:13.273087] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-15T21:54:13.273142] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-15T21:54:13.428033] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-15T21:54:13.661590] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T21:54:13.735722] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-15T21:54:13.739591] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:14.201888] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T21:54:14.514050] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-15T21:54:15.219985] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T21:54:15.313992] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-15T21:54:15.868337] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T21:54:16.114030] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-15T21:54:16.914001] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-15T21:54:17.367152] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T21:54:17.402269] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T21:54:17.713992] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-15T21:54:18.171985] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T21:54:18.514001] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-15T21:54:18.741449] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T21:54:18.745900] [INFO ] [REMOTE ] TIXT: Full fetch complete (46295 records). [2025-10-15T21:54:18.745995] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-15T21:54:19.140900] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-15T21:54:19.141014] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-15T21:54:19.141936] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-15T21:54:19.141997] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-15T21:54:19.143040] [DEBUG] [LOCAL ] TIXT: Trimmed 46295 records to 32389 (keeping 200 days of data) [2025-10-15T21:54:19.314108] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-15T21:54:19.326519] [DEBUG] [LOCAL ] TIXT: Primary data saved (32389 records). [2025-10-15T21:54:19.326613] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-15T21:54:19.326721] [INFO ] [MAIN ] Update Progress: 2095/2369 symbols completed. TIXT took 30.8s. Estimated remaining: 38m 29s. Rate: 7.1 symbols/min [2025-10-15T21:54:19.504147] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:19.524019] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T21:54:19.567717] [DEBUG] [LOCAL ] TKO: Loaded 43799 existing records from primary storage. [2025-10-15T21:54:19.568002] [INFO ] [MAIN ] TKO: Loaded 43799 existing records. [2025-10-15T21:54:19.745999] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:19.746229] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-15T21:54:19.746276] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-15T21:54:19.746746] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-15T21:54:19.746810] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-15T21:54:20.112517] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:20.113948] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-15T21:54:20.184355] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T21:54:20.913993] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-15T21:54:21.713981] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-15T21:54:21.959487] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T21:54:22.041726] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T21:54:22.514009] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-15T21:54:23.245150] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T21:54:23.313963] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-15T21:54:24.094181] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T21:54:24.113952] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-15T21:54:24.913986] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-15T21:54:25.006163] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T21:54:25.713974] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-15T21:54:26.001486] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T21:54:26.221187] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T21:54:26.514077] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-15T21:54:27.005079] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T21:54:27.313988] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-15T21:54:28.114021] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-15T21:54:28.229596] [DEBUG] [REMOTE ] TJX: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-15T21:54:28.230069] [WARN ] [REMOTE ] TJX: No data returned for month 2025-06 [2025-10-15T21:54:28.231515] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T21:54:28.231601] [FATAL] [REMOTE ] TJX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:54:28.241573] [FATAL] [MAIN ] TJX: Failed to fetch primary data. [2025-10-15T21:54:28.241952] [WARN ] [MAIN ] TJX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:54:28.242028] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-15T21:54:28.242090] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-10-15T21:54:28.242126] [INFO ] [LOCAL ] TJX: Starting deletion of derivative data. [2025-10-15T21:54:28.242325] [DEBUG] [LOCAL ] TJX: Deleted derivative data file. [2025-10-15T21:54:28.242405] [INFO ] [MAIN ] Update Progress: 2096/2369 symbols completed. TJX took 20.2s. Estimated remaining: 38m 21s. Rate: 7.1 symbols/min [2025-10-15T21:54:28.408760] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:28.445891] [DEBUG] [LOCAL ] TKR: Loaded 39830 existing records from primary storage. [2025-10-15T21:54:28.446205] [INFO ] [MAIN ] TKR: Loaded 39830 existing records. [2025-10-15T21:54:28.623507] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:28.623719] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-15T21:54:28.623776] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-15T21:54:28.624238] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-15T21:54:28.624295] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-15T21:54:28.918955] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-15T21:54:28.951580] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T21:54:29.037591] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:29.714039] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-15T21:54:30.514005] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-15T21:54:30.551215] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T21:54:31.313993] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-15T21:54:31.923053] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T21:54:31.968219] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-15T21:54:32.114065] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-15T21:54:32.313896] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T21:54:32.914021] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-15T21:54:33.653627] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T21:54:33.713976] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-15T21:54:33.978468] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T21:54:34.514034] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-15T21:54:35.134904] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T21:54:35.313978] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-15T21:54:35.653849] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T21:54:36.113990] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-15T21:54:36.700223] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T21:54:36.914003] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-15T21:54:37.637505] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T21:54:37.713975] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-15T21:54:38.479968] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T21:54:38.514018] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-15T21:54:39.231362] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T21:54:39.313963] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-15T21:54:39.750441] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:54:40.114063] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-15T21:54:40.913987] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-15T21:54:40.963146] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T21:54:41.072409] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T21:54:41.714003] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-15T21:54:42.514077] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-15T21:54:42.553395] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T21:54:43.148045] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:54:43.313990] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-15T21:54:43.701729] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T21:54:44.113981] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-15T21:54:44.622426] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T21:54:44.920895] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-15T21:54:44.937970] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T21:54:45.714005] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-15T21:54:46.513981] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-15T21:54:46.559997] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T21:54:47.064365] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T21:54:47.313995] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-15T21:54:48.021037] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T21:54:48.026604] [INFO ] [REMOTE ] TKC: Full fetch complete (53736 records). [2025-10-15T21:54:48.026724] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-15T21:54:48.122973] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-15T21:54:48.426300] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-15T21:54:48.426383] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-15T21:54:48.427372] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-15T21:54:48.427434] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-15T21:54:48.428705] [DEBUG] [LOCAL ] TKC: Trimmed 53736 records to 39494 (keeping 200 days of data) [2025-10-15T21:54:48.657669] [DEBUG] [LOCAL ] TKC: Primary data saved (39494 records). [2025-10-15T21:54:48.657995] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-15T21:54:48.658245] [INFO ] [MAIN ] Update Progress: 2097/2369 symbols completed. TKC took 35.8s. Estimated remaining: 38m 14s. Rate: 7.1 symbols/min [2025-10-15T21:54:48.829005] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:48.853327] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T21:54:48.894978] [DEBUG] [LOCAL ] TLK: Loaded 38631 existing records from primary storage. [2025-10-15T21:54:48.895258] [INFO ] [MAIN ] TLK: Loaded 38631 existing records. [2025-10-15T21:54:48.925925] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-15T21:54:49.071395] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:49.071599] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-15T21:54:49.071668] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-15T21:54:49.071991] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-15T21:54:49.072030] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-15T21:54:49.420712] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:49.692699] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T21:54:49.713964] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-15T21:54:50.384891] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T21:54:50.514012] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-15T21:54:50.755342] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T21:54:51.313988] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-15T21:54:51.755077] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T21:54:52.113996] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-15T21:54:52.817817] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T21:54:52.913965] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-15T21:54:53.315083] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T21:54:53.714001] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-15T21:54:54.267891] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T21:54:54.272303] [INFO ] [REMOTE ] TKR: Full fetch complete (57941 records). [2025-10-15T21:54:54.272421] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-15T21:54:54.520835] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-15T21:54:54.662849] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-15T21:54:54.662921] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-15T21:54:54.663940] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-15T21:54:54.664001] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-15T21:54:54.665145] [DEBUG] [LOCAL ] TKR: Trimmed 57941 records to 39727 (keeping 200 days of data) [2025-10-15T21:54:54.908966] [DEBUG] [LOCAL ] TKR: Primary data saved (39727 records). [2025-10-15T21:54:54.909108] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-15T21:54:54.909190] [INFO ] [MAIN ] Update Progress: 2098/2369 symbols completed. TKR took 26.7s. Estimated remaining: 38m 5s. Rate: 7.1 symbols/min [2025-10-15T21:54:55.105209] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:55.106828] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T21:54:55.130935] [DEBUG] [LOCAL ] TLYS: Loaded 16568 existing records from primary storage. [2025-10-15T21:54:55.131186] [INFO ] [MAIN ] TLYS: Loaded 16568 existing records. [2025-10-15T21:54:55.322199] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-15T21:54:55.352865] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:55.354148] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-15T21:54:55.354415] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-15T21:54:55.357021] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-15T21:54:55.356916] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T21:54:55.357169] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-15T21:54:55.394547] [INFO ] [REMOTE ] TKO: Full fetch complete (65208 records). [2025-10-15T21:54:55.394753] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-15T21:54:56.029227] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:56.120635] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-15T21:54:56.123956] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-15T21:54:56.124397] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-15T21:54:56.126230] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-15T21:54:56.126404] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-15T21:54:56.127879] [DEBUG] [LOCAL ] TKO: Trimmed 65208 records to 43742 (keeping 200 days of data) [2025-10-15T21:54:56.394833] [DEBUG] [LOCAL ] TKO: Primary data saved (43742 records). [2025-10-15T21:54:56.394960] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-15T21:54:56.395042] [INFO ] [MAIN ] Update Progress: 2099/2369 symbols completed. TKO took 37.1s. Estimated remaining: 37m 56s. Rate: 7.1 symbols/min [2025-10-15T21:54:56.559810] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:56.595805] [DEBUG] [LOCAL ] TM: Loaded 36538 existing records from primary storage. [2025-10-15T21:54:56.596075] [INFO ] [MAIN ] TM: Loaded 36538 existing records. [2025-10-15T21:54:56.777845] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:56.778418] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-15T21:54:56.778534] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-15T21:54:56.779067] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-15T21:54:56.779123] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-15T21:54:56.921172] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-15T21:54:57.005209] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T21:54:57.034319] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T21:54:57.184855] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:54:57.713995] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-15T21:54:58.172901] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T21:54:58.181575] [INFO ] [REMOTE ] TK: Full fetch complete (56287 records). [2025-10-15T21:54:58.181776] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-15T21:54:58.516515] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-15T21:54:58.518910] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T21:54:58.615613] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-15T21:54:58.615718] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-15T21:54:58.617074] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-15T21:54:58.617136] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-15T21:54:58.618236] [DEBUG] [LOCAL ] TK: Trimmed 56287 records to 39139 (keeping 200 days of data) [2025-10-15T21:54:58.836967] [DEBUG] [LOCAL ] TK: Primary data saved (39139 records). [2025-10-15T21:54:58.837094] [INFO ] [MAIN ] TK: Full history saved. [2025-10-15T21:54:58.837171] [INFO ] [MAIN ] Update Progress: 2100/2369 symbols completed. TK took 47.6s. Estimated remaining: 37m 47s. Rate: 7.1 symbols/min [2025-10-15T21:54:59.001816] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:54:59.051735] [DEBUG] [LOCAL ] TME: Loaded 53189 existing records from primary storage. [2025-10-15T21:54:59.052031] [INFO ] [MAIN ] TME: Loaded 53189 existing records. [2025-10-15T21:54:59.230186] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:54:59.230394] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-15T21:54:59.230441] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-15T21:54:59.230929] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-15T21:54:59.230985] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-15T21:54:59.322031] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-15T21:54:59.616756] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:00.113978] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-15T21:55:00.283356] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T21:55:00.867578] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T21:55:00.914007] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-15T21:55:01.060721] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T21:55:01.714015] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-15T21:55:01.733498] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T21:55:02.514069] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-15T21:55:03.314005] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-15T21:55:03.376682] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T21:55:04.050145] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T21:55:04.113962] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-15T21:55:04.788495] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:55:04.914012] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-15T21:55:05.717833] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-15T21:55:05.721904] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T21:55:06.513948] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-15T21:55:06.675589] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T21:55:06.722241] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T21:55:07.314033] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-15T21:55:08.078011] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T21:55:08.114037] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-15T21:55:08.914007] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-15T21:55:09.119220] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T21:55:09.679155] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T21:55:09.713972] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-15T21:55:09.941286] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T21:55:10.514063] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-15T21:55:11.072963] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T21:55:11.314041] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-15T21:55:12.113993] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-15T21:55:12.224940] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T21:55:12.914081] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-15T21:55:13.143366] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T21:55:13.243516] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T21:55:13.714004] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-15T21:55:14.277700] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T21:55:14.514000] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-15T21:55:15.238081] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T21:55:15.313966] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-15T21:55:16.119119] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-15T21:55:16.134138] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T21:55:16.914023] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-15T21:55:16.982291] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T21:55:17.295871] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T21:55:17.713994] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-15T21:55:18.514051] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-15T21:55:18.513980] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T21:55:18.649913] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T21:55:19.314018] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-15T21:55:20.114022] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-15T21:55:20.405332] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T21:55:20.480636] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T21:55:20.877636] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T21:55:20.879297] [INFO ] [REMOTE ] TLYS: Full fetch complete (21559 records). [2025-10-15T21:55:20.879375] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-15T21:55:20.919122] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-15T21:55:21.248093] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-15T21:55:21.248190] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-15T21:55:21.248713] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-15T21:55:21.248775] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-15T21:55:21.249445] [DEBUG] [LOCAL ] TLYS: Trimmed 21559 records to 16578 (keeping 200 days of data) [2025-10-15T21:55:21.343408] [DEBUG] [LOCAL ] TLYS: Primary data saved (16578 records). [2025-10-15T21:55:21.343551] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-15T21:55:21.343633] [INFO ] [MAIN ] Update Progress: 2101/2369 symbols completed. TLYS took 26.4s. Estimated remaining: 37m 40s. Rate: 7.1 symbols/min [2025-10-15T21:55:21.533329] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:55:21.574184] [DEBUG] [LOCAL ] TMHC: Loaded 45442 existing records from primary storage. [2025-10-15T21:55:21.574482] [INFO ] [MAIN ] TMHC: Loaded 45442 existing records. [2025-10-15T21:55:21.719119] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-15T21:55:21.759106] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:55:21.759493] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-15T21:55:21.759548] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-15T21:55:21.759995] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-15T21:55:21.760052] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-15T21:55:22.134560] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:22.513975] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-15T21:55:22.592286] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T21:55:23.313969] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-15T21:55:23.805223] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-15T21:55:23.929526] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T21:55:24.113995] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-15T21:55:24.913973] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-15T21:55:25.141228] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T21:55:25.682782] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T21:55:25.713946] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-15T21:55:26.513964] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-15T21:55:26.749954] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T21:55:26.828616] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T21:55:27.314003] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-15T21:55:27.641431] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T21:55:28.114062] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-15T21:55:28.808517] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T21:55:28.914060] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-15T21:55:29.463044] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T21:55:29.468026] [INFO ] [REMOTE ] TLK: Full fetch complete (57329 records). [2025-10-15T21:55:29.468152] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-15T21:55:29.723259] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-15T21:55:29.857485] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-15T21:55:29.857576] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-15T21:55:29.858734] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-15T21:55:29.858799] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-15T21:55:29.859947] [DEBUG] [LOCAL ] TLK: Trimmed 57329 records to 38630 (keeping 200 days of data) [2025-10-15T21:55:30.085591] [DEBUG] [LOCAL ] TLK: Primary data saved (38630 records). [2025-10-15T21:55:30.085757] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-15T21:55:30.086076] [INFO ] [MAIN ] Update Progress: 2102/2369 symbols completed. TLK took 41.4s. Estimated remaining: 37m 32s. Rate: 7.1 symbols/min [2025-10-15T21:55:30.252754] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:55:30.302352] [DEBUG] [LOCAL ] TMO: Loaded 52458 existing records from primary storage. [2025-10-15T21:55:30.302678] [INFO ] [MAIN ] TMO: Loaded 52458 existing records. [2025-10-15T21:55:30.483073] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:55:30.483334] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-15T21:55:30.483407] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-15T21:55:30.484056] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-15T21:55:30.484115] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-15T21:55:30.515367] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-15T21:55:30.803434] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T21:55:30.911490] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:31.213800] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T21:55:31.314050] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-15T21:55:32.114090] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-15T21:55:32.335510] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T21:55:32.914007] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-15T21:55:32.981081] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T21:55:33.713968] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-15T21:55:33.968370] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T21:55:34.513997] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-15T21:55:34.625903] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T21:55:34.632498] [INFO ] [REMOTE ] TME: Full fetch complete (77136 records). [2025-10-15T21:55:34.632680] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-15T21:55:35.037136] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-15T21:55:35.037234] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-15T21:55:35.038401] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-15T21:55:35.038539] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-15T21:55:35.063630] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T21:55:35.062544] [DEBUG] [LOCAL ] TME: Trimmed 77136 records to 53194 (keeping 200 days of data) [2025-10-15T21:55:35.341214] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-15T21:55:35.388469] [DEBUG] [LOCAL ] TME: Primary data saved (53194 records). [2025-10-15T21:55:35.388610] [INFO ] [MAIN ] TME: Full history saved. [2025-10-15T21:55:35.389581] [INFO ] [MAIN ] Update Progress: 2103/2369 symbols completed. TME took 36.6s. Estimated remaining: 37m 23s. Rate: 7.1 symbols/min [2025-10-15T21:55:35.559829] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:55:35.575090] [DEBUG] [LOCAL ] TNC: Loaded 14451 existing records from primary storage. [2025-10-15T21:55:35.575333] [INFO ] [MAIN ] TNC: Loaded 14451 existing records. [2025-10-15T21:55:35.755135] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:55:35.755329] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-15T21:55:35.755377] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-15T21:55:35.755565] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-15T21:55:35.755609] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-15T21:55:36.123944] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:36.119405] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-15T21:55:36.410545] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T21:55:36.727776] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T21:55:36.732061] [INFO ] [REMOTE ] TM: Full fetch complete (52514 records). [2025-10-15T21:55:36.732161] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-15T21:55:36.920799] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-15T21:55:37.110967] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-15T21:55:37.111040] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-15T21:55:37.111984] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-15T21:55:37.112048] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-15T21:55:37.113103] [DEBUG] [LOCAL ] TM: Trimmed 52514 records to 36494 (keeping 200 days of data) [2025-10-15T21:55:37.338500] [DEBUG] [LOCAL ] TM: Primary data saved (36494 records). [2025-10-15T21:55:37.338682] [INFO ] [MAIN ] TM: Full history saved. [2025-10-15T21:55:37.338785] [INFO ] [MAIN ] Update Progress: 2104/2369 symbols completed. TM took 40.9s. Estimated remaining: 37m 13s. Rate: 7.1 symbols/min [2025-10-15T21:55:37.472859] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T21:55:37.546011] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:55:37.574716] [DEBUG] [LOCAL ] TNET: Loaded 28269 existing records from primary storage. [2025-10-15T21:55:37.574999] [INFO ] [MAIN ] TNET: Loaded 28269 existing records. [2025-10-15T21:55:37.719333] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-15T21:55:37.773946] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:55:37.774147] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-15T21:55:37.774193] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-15T21:55:37.774437] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-15T21:55:37.774475] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-15T21:55:38.128351] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:38.514033] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-15T21:55:38.744744] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T21:55:38.800185] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T21:55:39.314042] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-15T21:55:39.425170] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T21:55:40.114064] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-15T21:55:40.913979] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-15T21:55:41.214306] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T21:55:41.239852] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T21:55:41.713998] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-15T21:55:42.476359] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T21:55:42.513962] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-15T21:55:43.313963] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-15T21:55:43.785189] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T21:55:44.062953] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T21:55:44.114018] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-15T21:55:44.152418] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T21:55:44.913995] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-15T21:55:45.649318] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T21:55:45.714031] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-15T21:55:46.514081] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-15T21:55:46.720595] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T21:55:46.963936] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T21:55:47.314042] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-15T21:55:47.975788] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T21:55:48.114040] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-15T21:55:48.914060] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-15T21:55:49.088221] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T21:55:49.261216] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T21:55:49.714046] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-15T21:55:50.315708] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T21:55:50.321311] [INFO ] [REMOTE ] TMHC: Full fetch complete (66245 records). [2025-10-15T21:55:50.321420] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-15T21:55:50.519225] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-15T21:55:50.718020] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-15T21:55:50.718162] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-15T21:55:50.719377] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-15T21:55:50.719442] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-15T21:55:50.720836] [DEBUG] [LOCAL ] TMHC: Trimmed 66245 records to 45461 (keeping 200 days of data) [2025-10-15T21:55:50.942102] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T21:55:51.017762] [DEBUG] [LOCAL ] TMHC: Primary data saved (45461 records). [2025-10-15T21:55:51.017916] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-15T21:55:51.018000] [INFO ] [MAIN ] Update Progress: 2105/2369 symbols completed. TMHC took 29.7s. Estimated remaining: 37m 6s. Rate: 7.1 symbols/min [2025-10-15T21:55:51.181694] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:55:51.181868] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-15T21:55:51.181905] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-15T21:55:51.182012] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-15T21:55:51.182053] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-15T21:55:51.182092] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-15T21:55:51.182123] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-15T21:55:51.319119] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-15T21:55:51.538009] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:51.735585] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T21:55:52.114025] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-15T21:55:52.914061] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-15T21:55:53.109075] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T21:55:53.109387] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-15T21:55:53.109490] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T21:55:53.109570] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-15T21:55:53.109635] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T21:55:53.109736] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-15T21:55:53.109801] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-15T21:55:53.109839] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-15T21:55:53.109880] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-15T21:55:53.109926] [INFO ] [MAIN ] Update Progress: 2106/2369 symbols completed. TNGY took 2.1s. Estimated remaining: 36m 56s. Rate: 7.1 symbols/min [2025-10-15T21:55:53.286984] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:55:53.326554] [DEBUG] [LOCAL ] TNK: Loaded 35389 existing records from primary storage. [2025-10-15T21:55:53.326909] [INFO ] [MAIN ] TNK: Loaded 35389 existing records. [2025-10-15T21:55:53.524456] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:55:53.524963] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-15T21:55:53.525355] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-15T21:55:53.525913] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-15T21:55:53.526109] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-15T21:55:53.709788] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T21:55:53.719097] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-15T21:55:53.957359] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-15T21:55:54.030943] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:55:54.513974] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-15T21:55:54.838188] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T21:55:55.313987] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-15T21:55:55.753972] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T21:55:56.113988] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-15T21:55:56.914018] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-15T21:55:57.293448] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T21:55:57.346843] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T21:55:57.714008] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-15T21:55:57.871462] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T21:55:58.514002] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-15T21:55:58.658959] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T21:55:59.313986] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-15T21:55:59.795961] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T21:56:00.114022] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-15T21:56:00.914078] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-15T21:56:01.575101] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-15T21:56:01.700997] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T21:56:01.713970] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-15T21:56:02.345127] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T21:56:02.513979] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-15T21:56:02.809056] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T21:56:03.313992] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-15T21:56:03.394854] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T21:56:04.113986] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-15T21:56:04.394847] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T21:56:04.914049] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-15T21:56:05.044040] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T21:56:05.577881] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T21:56:05.594014] [INFO ] [REMOTE ] TMO: Full fetch complete (75661 records). [2025-10-15T21:56:05.594211] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-15T21:56:05.719358] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-15T21:56:06.129269] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-15T21:56:06.129367] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-15T21:56:06.130623] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-15T21:56:06.130714] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-15T21:56:06.132296] [DEBUG] [LOCAL ] TMO: Trimmed 75661 records to 52446 (keeping 200 days of data) [2025-10-15T21:56:06.473857] [DEBUG] [LOCAL ] TMO: Primary data saved (52446 records). [2025-10-15T21:56:06.474034] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-15T21:56:06.474391] [INFO ] [MAIN ] Update Progress: 2107/2369 symbols completed. TMO took 36.4s. Estimated remaining: 36m 49s. Rate: 7.1 symbols/min [2025-10-15T21:56:06.518083] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-15T21:56:06.647943] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:06.665596] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T21:56:06.697636] [DEBUG] [LOCAL ] TNL: Loaded 41832 existing records from primary storage. [2025-10-15T21:56:06.697946] [INFO ] [MAIN ] TNL: Loaded 41832 existing records. [2025-10-15T21:56:06.873801] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:06.873998] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-15T21:56:06.874055] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-15T21:56:06.874418] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-15T21:56:06.874458] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-15T21:56:07.258443] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:07.314023] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-15T21:56:08.060767] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T21:56:08.099055] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T21:56:08.113953] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-15T21:56:08.857631] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T21:56:08.859963] [INFO ] [REMOTE ] TNC: Full fetch complete (22360 records). [2025-10-15T21:56:08.860077] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-15T21:56:08.919172] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-15T21:56:09.250616] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-15T21:56:09.250726] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-15T21:56:09.251230] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-15T21:56:09.251270] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-15T21:56:09.251892] [DEBUG] [LOCAL ] TNC: Trimmed 22360 records to 14448 (keeping 200 days of data) [2025-10-15T21:56:09.351451] [DEBUG] [LOCAL ] TNC: Primary data saved (14448 records). [2025-10-15T21:56:09.351611] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-15T21:56:09.351769] [INFO ] [MAIN ] Update Progress: 2108/2369 symbols completed. TNC took 34.0s. Estimated remaining: 36m 40s. Rate: 7.1 symbols/min [2025-10-15T21:56:09.538799] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:09.595612] [DEBUG] [LOCAL ] TOL: Loaded 50688 existing records from primary storage. [2025-10-15T21:56:09.595940] [INFO ] [MAIN ] TOL: Loaded 50688 existing records. [2025-10-15T21:56:09.719083] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-15T21:56:09.785618] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:09.785856] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-15T21:56:09.785906] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-15T21:56:09.786398] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-15T21:56:09.786457] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-15T21:56:10.187596] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T21:56:10.221581] [INFO ] [REMOTE ] TNET: Full fetch complete (41783 records). [2025-10-15T21:56:10.226037] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-15T21:56:10.225885] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:10.518853] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-15T21:56:10.606418] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-15T21:56:10.606489] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-15T21:56:10.607288] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-15T21:56:10.607362] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-15T21:56:10.608287] [DEBUG] [LOCAL ] TNET: Trimmed 41783 records to 28305 (keeping 200 days of data) [2025-10-15T21:56:10.779837] [DEBUG] [LOCAL ] TNET: Primary data saved (28305 records). [2025-10-15T21:56:10.779961] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-15T21:56:10.780039] [INFO ] [MAIN ] Update Progress: 2109/2369 symbols completed. TNET took 33.4s. Estimated remaining: 36m 30s. Rate: 7.1 symbols/min [2025-10-15T21:56:10.950751] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:10.983767] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T21:56:11.024366] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-15T21:56:11.024693] [INFO ] [MAIN ] TOST: Loaded 53690 existing records. [2025-10-15T21:56:11.201013] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:11.201216] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-15T21:56:11.201268] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-15T21:56:11.201735] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-15T21:56:11.201794] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-15T21:56:11.319150] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-15T21:56:11.549631] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:12.009980] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T21:56:12.113989] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-15T21:56:12.852326] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T21:56:12.914006] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-15T21:56:13.713993] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-15T21:56:13.933248] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T21:56:14.513974] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-15T21:56:14.940862] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T21:56:15.111134] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T21:56:15.313992] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-15T21:56:15.991167] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T21:56:16.113997] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-15T21:56:16.913991] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-15T21:56:16.975823] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T21:56:17.699839] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T21:56:17.713950] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-15T21:56:17.774035] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T21:56:18.513990] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-15T21:56:19.314002] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-15T21:56:19.373087] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T21:56:19.485015] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T21:56:20.113988] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-15T21:56:20.914002] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-15T21:56:21.114480] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T21:56:21.724727] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-15T21:56:21.732530] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T21:56:22.514028] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-15T21:56:22.799333] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T21:56:23.057760] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T21:56:23.313989] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-15T21:56:23.430097] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T21:56:24.114053] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-15T21:56:24.913969] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-15T21:56:25.194560] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T21:56:25.714050] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-15T21:56:25.971091] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T21:56:26.419444] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T21:56:26.514088] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-15T21:56:27.314023] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-15T21:56:27.558055] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T21:56:27.787858] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T21:56:27.792763] [INFO ] [REMOTE ] TNK: Full fetch complete (51938 records). [2025-10-15T21:56:27.792986] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-15T21:56:28.119168] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-15T21:56:28.211522] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-15T21:56:28.211699] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-15T21:56:28.213530] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-15T21:56:28.213597] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-15T21:56:28.215252] [DEBUG] [LOCAL ] TNK: Trimmed 51938 records to 35361 (keeping 200 days of data) [2025-10-15T21:56:28.460344] [DEBUG] [LOCAL ] TNK: Primary data saved (35361 records). [2025-10-15T21:56:28.460746] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-15T21:56:28.460865] [INFO ] [MAIN ] Update Progress: 2110/2369 symbols completed. TNK took 35.4s. Estimated remaining: 36m 23s. Rate: 7.1 symbols/min [2025-10-15T21:56:28.679622] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:28.681980] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T21:56:28.722482] [DEBUG] [LOCAL ] TPB: Loaded 26074 existing records from primary storage. [2025-10-15T21:56:28.722875] [INFO ] [MAIN ] TPB: Loaded 26074 existing records. [2025-10-15T21:56:28.912180] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:28.912536] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-15T21:56:28.912590] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-15T21:56:28.913010] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-15T21:56:28.913063] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-15T21:56:28.924387] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-15T21:56:29.285118] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:29.714006] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-15T21:56:29.942331] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T21:56:30.514038] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-15T21:56:30.794549] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T21:56:30.838849] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T21:56:31.313986] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-15T21:56:32.114056] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-15T21:56:32.140714] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T21:56:32.678254] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T21:56:32.913984] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-15T21:56:33.240749] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T21:56:33.714033] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-15T21:56:34.514013] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-15T21:56:34.772967] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T21:56:34.865994] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T21:56:35.313981] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-15T21:56:35.970054] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T21:56:36.113958] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-15T21:56:36.426198] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T21:56:36.913970] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-15T21:56:37.411902] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T21:56:37.416863] [INFO ] [REMOTE ] TNL: Full fetch complete (59466 records). [2025-10-15T21:56:37.416959] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-15T21:56:37.719164] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-15T21:56:37.796925] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-15T21:56:37.796998] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-15T21:56:37.797987] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-15T21:56:37.798050] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-15T21:56:37.799291] [DEBUG] [LOCAL ] TNL: Trimmed 59466 records to 41792 (keeping 200 days of data) [2025-10-15T21:56:38.046466] [DEBUG] [LOCAL ] TNL: Primary data saved (41792 records). [2025-10-15T21:56:38.046590] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-15T21:56:38.046915] [INFO ] [MAIN ] Update Progress: 2111/2369 symbols completed. TNL took 31.6s. Estimated remaining: 36m 15s. Rate: 7.1 symbols/min [2025-10-15T21:56:38.214408] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:38.251757] [DEBUG] [LOCAL ] TPC: Loaded 38979 existing records from primary storage. [2025-10-15T21:56:38.252027] [INFO ] [MAIN ] TPC: Loaded 38979 existing records. [2025-10-15T21:56:38.429957] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:38.430151] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-15T21:56:38.430226] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-15T21:56:38.430557] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-15T21:56:38.430611] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-15T21:56:38.520601] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-15T21:56:38.789892] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:38.832254] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T21:56:38.833207] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T21:56:39.313999] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-15T21:56:40.114020] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-15T21:56:40.627054] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T21:56:40.683327] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T21:56:40.914021] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-15T21:56:41.193814] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T21:56:41.714022] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-15T21:56:42.310950] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T21:56:42.514007] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-15T21:56:43.314013] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-15T21:56:43.815405] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T21:56:43.938092] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-15T21:56:44.114004] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-15T21:56:44.407294] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T21:56:44.914054] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-15T21:56:45.713997] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-15T21:56:46.184534] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-15T21:56:46.385619] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T21:56:46.514040] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-15T21:56:47.023200] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T21:56:47.314049] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-15T21:56:48.114007] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-15T21:56:48.502736] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T21:56:48.914051] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-15T21:56:49.111873] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T21:56:49.203034] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T21:56:49.714075] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-15T21:56:50.519058] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-15T21:56:50.530229] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T21:56:50.537091] [INFO ] [REMOTE ] TOST: Full fetch complete (77851 records). [2025-10-15T21:56:50.537213] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-15T21:56:50.947217] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-15T21:56:50.947292] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-15T21:56:50.948426] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-15T21:56:50.948507] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-15T21:56:50.949906] [DEBUG] [LOCAL ] TOST: Trimmed 77851 records to 53690 (keeping 200 days of data) [2025-10-15T21:56:51.260756] [DEBUG] [LOCAL ] TOST: Primary data saved (53690 records). [2025-10-15T21:56:51.260886] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-15T21:56:51.261008] [INFO ] [MAIN ] Update Progress: 2112/2369 symbols completed. TOST took 40.5s. Estimated remaining: 36m 7s. Rate: 7.1 symbols/min [2025-10-15T21:56:51.324873] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-15T21:56:51.459937] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:51.461078] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T21:56:51.468325] [INFO ] [REMOTE ] TOL: Full fetch complete (73761 records). [2025-10-15T21:56:51.468557] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-15T21:56:51.555855] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T21:56:51.834738] [DEBUG] [LOCAL ] TPH: Loaded 44879 existing records from primary storage. [2025-10-15T21:56:51.837929] [INFO ] [MAIN ] TPH: Loaded 44879 existing records. [2025-10-15T21:56:52.067503] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-15T21:56:52.077852] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-15T21:56:52.091974] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-15T21:56:52.092053] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-15T21:56:52.134818] [DEBUG] [LOCAL ] TOL: Trimmed 73761 records to 50667 (keeping 200 days of data) [2025-10-15T21:56:52.134722] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:52.120861] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-15T21:56:52.136169] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-15T21:56:52.136238] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-15T21:56:52.136743] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-15T21:56:52.136906] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-15T21:56:52.714337] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:52.752334] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T21:56:52.847386] [DEBUG] [LOCAL ] TOL: Primary data saved (50667 records). [2025-10-15T21:56:52.847516] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-15T21:56:52.848545] [INFO ] [MAIN ] Update Progress: 2113/2369 symbols completed. TOL took 43.5s. Estimated remaining: 35m 58s. Rate: 7.1 symbols/min [2025-10-15T21:56:52.922111] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-15T21:56:53.022475] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:53.036361] [DEBUG] [LOCAL ] TPL: Loaded 12351 existing records from primary storage. [2025-10-15T21:56:53.036581] [INFO ] [MAIN ] TPL: Loaded 12351 existing records. [2025-10-15T21:56:53.213504] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:53.213727] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-15T21:56:53.213784] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-15T21:56:53.214005] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-15T21:56:53.214060] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-15T21:56:53.580852] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:53.591053] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T21:56:53.713951] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-15T21:56:54.526983] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-15T21:56:54.529354] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T21:56:54.995788] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T21:56:55.000441] [INFO ] [REMOTE ] TPB: Full fetch complete (35969 records). [2025-10-15T21:56:55.000575] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-15T21:56:55.319212] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-15T21:56:55.420559] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-15T21:56:55.420711] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-15T21:56:55.422010] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-15T21:56:55.422079] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-15T21:56:55.423771] [DEBUG] [LOCAL ] TPB: Trimmed 35969 records to 26115 (keeping 200 days of data) [2025-10-15T21:56:55.622678] [DEBUG] [LOCAL ] TPB: Primary data saved (26115 records). [2025-10-15T21:56:55.637385] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-15T21:56:55.637758] [INFO ] [MAIN ] Update Progress: 2114/2369 symbols completed. TPB took 27.2s. Estimated remaining: 35m 48s. Rate: 7.1 symbols/min [2025-10-15T21:56:55.644444] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T21:56:55.828664] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:56:55.887783] [DEBUG] [LOCAL ] TPR: Loaded 53439 existing records from primary storage. [2025-10-15T21:56:55.888228] [INFO ] [MAIN ] TPR: Loaded 53439 existing records. [2025-10-15T21:56:56.076804] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:56:56.077162] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-15T21:56:56.077235] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-15T21:56:56.078048] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-15T21:56:56.078128] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-15T21:56:56.119204] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-15T21:56:56.467011] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:56:56.826807] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T21:56:56.913981] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-15T21:56:57.187942] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T21:56:57.714573] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-15T21:56:58.448038] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T21:56:58.514010] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-15T21:56:59.149816] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T21:56:59.313964] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-15T21:57:00.071261] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T21:57:00.113999] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-15T21:57:00.829173] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T21:57:00.913998] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-15T21:57:01.635033] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T21:57:01.714007] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-15T21:57:02.505002] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T21:57:02.514423] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-15T21:57:02.572182] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T21:57:03.314027] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-15T21:57:03.972246] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T21:57:04.005716] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T21:57:04.113978] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-15T21:57:04.914046] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-15T21:57:05.713989] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-15T21:57:05.947491] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T21:57:06.037332] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T21:57:06.513991] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-15T21:57:07.311443] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T21:57:07.315033] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-15T21:57:07.495194] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T21:57:08.114050] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-15T21:57:08.914029] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-15T21:57:09.180344] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T21:57:09.607811] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T21:57:09.654995] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T21:57:09.714008] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-15T21:57:10.514007] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-15T21:57:11.314077] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-15T21:57:11.514898] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T21:57:11.537430] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T21:57:12.114001] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-15T21:57:12.621110] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T21:57:12.625883] [INFO ] [REMOTE ] TPC: Full fetch complete (55352 records). [2025-10-15T21:57:12.626038] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-15T21:57:12.919149] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-15T21:57:13.006924] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-15T21:57:13.007029] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-15T21:57:13.008098] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-15T21:57:13.008164] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-15T21:57:13.009399] [DEBUG] [LOCAL ] TPC: Trimmed 55352 records to 39038 (keeping 200 days of data) [2025-10-15T21:57:13.233721] [DEBUG] [LOCAL ] TPC: Primary data saved (39038 records). [2025-10-15T21:57:13.233866] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-15T21:57:13.234102] [INFO ] [MAIN ] Update Progress: 2115/2369 symbols completed. TPC took 35.2s. Estimated remaining: 35m 41s. Rate: 7.1 symbols/min [2025-10-15T21:57:13.400130] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:57:13.426931] [DEBUG] [LOCAL ] TPVG: Loaded 27289 existing records from primary storage. [2025-10-15T21:57:13.427194] [INFO ] [MAIN ] TPVG: Loaded 27289 existing records. [2025-10-15T21:57:13.603266] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:57:13.603574] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-15T21:57:13.603627] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-15T21:57:13.603947] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-15T21:57:13.604005] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-15T21:57:13.719166] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-15T21:57:13.967930] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:57:14.002679] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T21:57:14.067857] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T21:57:14.514052] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-15T21:57:15.265541] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T21:57:15.313991] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-15T21:57:15.979555] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:57:16.113992] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-15T21:57:16.914031] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-15T21:57:17.102280] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T21:57:17.537540] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T21:57:17.647101] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T21:57:17.713968] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-15T21:57:18.514019] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-15T21:57:19.313974] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-15T21:57:19.504499] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T21:57:19.656626] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T21:57:20.113994] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-15T21:57:20.180037] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T21:57:20.702536] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T21:57:20.914000] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-15T21:57:21.714006] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-15T21:57:22.255076] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T21:57:22.257140] [INFO ] [REMOTE ] TPL: Full fetch complete (17696 records). [2025-10-15T21:57:22.257275] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-15T21:57:22.523616] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-15T21:57:22.635638] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-15T21:57:22.635753] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-15T21:57:22.636213] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-15T21:57:22.636256] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-15T21:57:22.636796] [DEBUG] [LOCAL ] TPL: Trimmed 17696 records to 12354 (keeping 200 days of data) [2025-10-15T21:57:22.719539] [DEBUG] [LOCAL ] TPL: Primary data saved (12354 records). [2025-10-15T21:57:22.719723] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-15T21:57:22.719831] [INFO ] [MAIN ] Update Progress: 2116/2369 symbols completed. TPL took 29.9s. Estimated remaining: 35m 33s. Rate: 7.1 symbols/min [2025-10-15T21:57:22.892145] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:57:22.901561] [DEBUG] [LOCAL ] TPYP: Loaded 7955 existing records from primary storage. [2025-10-15T21:57:22.901793] [INFO ] [MAIN ] TPYP: Loaded 7955 existing records. [2025-10-15T21:57:23.050891] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T21:57:23.128031] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:57:23.128234] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-15T21:57:23.128323] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-15T21:57:23.128541] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-15T21:57:23.128599] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-15T21:57:23.323452] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-15T21:57:23.503083] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:57:23.693757] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T21:57:24.114088] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-15T21:57:24.914021] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-15T21:57:25.207543] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T21:57:25.410337] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-15T21:57:25.714005] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-15T21:57:26.292529] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T21:57:26.298080] [INFO ] [REMOTE ] TPH: Full fetch complete (64963 records). [2025-10-15T21:57:26.298192] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-15T21:57:26.521106] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-15T21:57:26.715212] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-15T21:57:26.715286] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-15T21:57:26.716386] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-15T21:57:26.716448] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-15T21:57:26.717682] [DEBUG] [LOCAL ] TPH: Trimmed 64963 records to 44876 (keeping 200 days of data) [2025-10-15T21:57:26.969962] [DEBUG] [LOCAL ] TPH: Primary data saved (44876 records). [2025-10-15T21:57:26.970084] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-15T21:57:26.970160] [INFO ] [MAIN ] Update Progress: 2117/2369 symbols completed. TPH took 35.7s. Estimated remaining: 35m 24s. Rate: 7.1 symbols/min [2025-10-15T21:57:27.075515] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T21:57:27.313961] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-15T21:57:28.114111] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-15T21:57:28.498785] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T21:57:28.671498] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T21:57:28.863109] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T21:57:28.914063] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-15T21:57:29.714059] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-15T21:57:30.048386] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T21:57:30.196845] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-15T21:57:30.514007] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-15T21:57:31.313977] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-15T21:57:31.788780] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T21:57:32.065833] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T21:57:32.113969] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-15T21:57:32.820717] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T21:57:32.913990] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-15T21:57:33.587559] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:57:33.593888] [INFO ] [REMOTE ] TPR: Full fetch complete (77552 records). [2025-10-15T21:57:33.594010] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-15T21:57:33.719181] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-15T21:57:33.978730] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-15T21:57:33.978813] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-15T21:57:33.979986] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-15T21:57:33.980050] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-15T21:57:33.981463] [DEBUG] [LOCAL ] TPR: Trimmed 77552 records to 53434 (keeping 200 days of data) [2025-10-15T21:57:34.312610] [DEBUG] [LOCAL ] TPR: Primary data saved (53434 records). [2025-10-15T21:57:34.312787] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-15T21:57:34.312887] [INFO ] [MAIN ] Update Progress: 2118/2369 symbols completed. TPR took 38.7s. Estimated remaining: 35m 15s. Rate: 7.1 symbols/min [2025-10-15T21:57:34.514050] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-15T21:57:34.932615] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T21:57:35.068517] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T21:57:35.314027] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-15T21:57:36.114034] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-15T21:57:36.525330] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T21:57:36.831788] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T21:57:36.913956] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-15T21:57:37.690457] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T21:57:37.713950] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-15T21:57:38.451267] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T21:57:38.513969] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-15T21:57:39.222683] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T21:57:39.314003] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-15T21:57:40.114056] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-15T21:57:40.590412] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T21:57:40.880886] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T21:57:40.914006] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-15T21:57:41.536617] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T21:57:41.538670] [INFO ] [REMOTE ] TPYP: Full fetch complete (12491 records). [2025-10-15T21:57:41.538815] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-15T21:57:41.717553] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-15T21:57:41.922916] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-15T21:57:41.922994] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-15T21:57:41.923268] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-15T21:57:41.923307] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-15T21:57:41.923884] [DEBUG] [LOCAL ] TPYP: Trimmed 12491 records to 7908 (keeping 200 days of data) [2025-10-15T21:57:41.971293] [DEBUG] [LOCAL ] TPYP: Primary data saved (7908 records). [2025-10-15T21:57:41.971421] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-15T21:57:41.971530] [INFO ] [MAIN ] Update Progress: 2119/2369 symbols completed. TPYP took 19.3s. Estimated remaining: 35m 7s. Rate: 7.1 symbols/min [2025-10-15T21:57:43.075553] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T21:57:43.079568] [INFO ] [REMOTE ] TPVG: Full fetch complete (39573 records). [2025-10-15T21:57:43.079677] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-15T21:57:43.482618] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-15T21:57:43.482717] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-15T21:57:43.483474] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-15T21:57:43.483513] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-15T21:57:43.485889] [DEBUG] [LOCAL ] TPVG: Trimmed 39573 records to 27282 (keeping 200 days of data) [2025-10-15T21:57:43.636327] [DEBUG] [LOCAL ] TPVG: Primary data saved (27282 records). [2025-10-15T21:57:43.636449] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-15T21:57:43.636552] [INFO ] [MAIN ] Update Progress: 2120/2369 symbols completed. TPVG took 30.4s. Estimated remaining: 34m 58s. Rate: 7.1 symbols/min [2025-10-15T21:57:44.238961] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:57:44.286766] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:57:44.318371] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:57:44.340304] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:57:44.351954] [DEBUG] [LOCAL ] TRAK: Loaded 9650 existing records from primary storage. [2025-10-15T21:57:44.356290] [INFO ] [MAIN ] TRAK: Loaded 9650 existing records. [2025-10-15T21:57:44.380954] [DEBUG] [LOCAL ] TPZ: Loaded 4740 existing records from primary storage. [2025-10-15T21:57:44.395011] [INFO ] [MAIN ] TPZ: Loaded 4740 existing records. [2025-10-15T21:57:44.489123] [DEBUG] [LOCAL ] TRC: Loaded 15544 existing records from primary storage. [2025-10-15T21:57:44.507311] [DEBUG] [LOCAL ] TR: Loaded 18940 existing records from primary storage. [2025-10-15T21:57:44.556320] [INFO ] [MAIN ] TR: Loaded 18940 existing records. [2025-10-15T21:57:44.556417] [INFO ] [MAIN ] TRC: Loaded 15544 existing records. [2025-10-15T21:57:44.739526] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:57:44.794160] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-15T21:57:44.831676] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-15T21:57:44.858531] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-15T21:57:44.882428] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-15T21:57:45.047198] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:57:45.073634] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-15T21:57:45.089250] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-15T21:57:45.225457] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:57:45.225588] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-15T21:57:45.260963] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-15T21:57:45.279928] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-15T21:57:45.280021] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-15T21:57:45.260759] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:57:45.304923] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-15T21:57:45.304854] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-15T21:57:45.373188] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-15T21:57:45.346072] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-15T21:57:45.435980] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-15T21:57:45.458767] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-15T21:57:45.924958] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:57:46.046165] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-15T21:57:46.480182] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:57:46.524724] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-15T21:57:46.634860] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:57:46.653820] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-15T21:57:46.657791] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:57:46.658170] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-15T21:57:47.007619] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T21:57:47.010433] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-15T21:57:47.415208] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T21:57:47.417746] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-15T21:57:47.498533] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T21:57:47.501840] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-15T21:57:47.582526] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T21:57:47.762157] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T21:57:48.047915] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T21:57:48.113953] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-15T21:57:48.283791] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T21:57:48.803078] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T21:57:48.914028] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-15T21:57:49.714090] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-15T21:57:49.769515] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T21:57:50.475794] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T21:57:50.514044] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-15T21:57:51.314027] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-15T21:57:51.336427] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T21:57:51.913367] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T21:57:52.114082] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-15T21:57:52.851776] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T21:57:52.914036] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-15T21:57:53.714035] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-15T21:57:53.814735] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T21:57:54.477031] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T21:57:54.513991] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-15T21:57:55.078328] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T21:57:55.314029] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-15T21:57:55.731465] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T21:57:56.114013] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-15T21:57:56.698423] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T21:57:56.913997] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-15T21:57:57.717884] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-15T21:57:57.719470] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T21:57:58.352056] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T21:57:58.513995] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-15T21:57:59.314031] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-15T21:57:59.572700] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T21:57:59.919076] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T21:58:00.114010] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-15T21:58:00.914015] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-15T21:58:01.054219] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T21:58:01.714000] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-15T21:58:01.999860] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T21:58:02.427602] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T21:58:02.514032] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-15T21:58:03.314017] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-15T21:58:03.593615] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T21:58:04.113995] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-15T21:58:04.143570] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T21:58:04.914002] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-15T21:58:05.217068] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T21:58:05.623138] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T21:58:05.625078] [INFO ] [REMOTE ] TRAK: Full fetch complete (13670 records). [2025-10-15T21:58:05.625153] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-15T21:58:05.719182] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-15T21:58:06.001525] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-15T21:58:06.001606] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-15T21:58:06.001978] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-15T21:58:06.002034] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-15T21:58:06.002491] [DEBUG] [LOCAL ] TRAK: Trimmed 13670 records to 9646 (keeping 200 days of data) [2025-10-15T21:58:06.064993] [DEBUG] [LOCAL ] TRAK: Primary data saved (9646 records). [2025-10-15T21:58:06.065144] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-15T21:58:06.065259] [INFO ] [MAIN ] Update Progress: 2121/2369 symbols completed. TRAK took 22.4s. Estimated remaining: 34m 51s. Rate: 7.1 symbols/min [2025-10-15T21:58:06.238321] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:06.286506] [DEBUG] [LOCAL ] TREX: Loaded 49850 existing records from primary storage. [2025-10-15T21:58:06.286829] [INFO ] [MAIN ] TREX: Loaded 49850 existing records. [2025-10-15T21:58:06.467485] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:58:06.467713] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-15T21:58:06.467769] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-15T21:58:06.468095] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-15T21:58:06.468134] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-15T21:58:06.523208] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-15T21:58:06.757040] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T21:58:06.849621] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:07.313983] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-15T21:58:07.576728] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T21:58:08.114001] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-15T21:58:08.914029] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-15T21:58:08.964310] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T21:58:09.106494] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T21:58:09.478517] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T21:58:09.714038] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-15T21:58:10.290507] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T21:58:10.514051] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-15T21:58:11.314081] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-15T21:58:11.668183] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T21:58:11.795411] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T21:58:11.796742] [INFO ] [REMOTE ] TPZ: Full fetch complete (8893 records). [2025-10-15T21:58:11.796822] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-15T21:58:12.119104] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-15T21:58:12.174898] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-15T21:58:12.174980] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-15T21:58:12.175221] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-15T21:58:12.175262] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-15T21:58:12.175690] [DEBUG] [LOCAL ] TPZ: Trimmed 8893 records to 4686 (keeping 200 days of data) [2025-10-15T21:58:12.205979] [DEBUG] [LOCAL ] TPZ: Primary data saved (4686 records). [2025-10-15T21:58:12.206132] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-15T21:58:12.206224] [INFO ] [MAIN ] Update Progress: 2122/2369 symbols completed. TPZ took 28.6s. Estimated remaining: 34m 42s. Rate: 7.1 symbols/min [2025-10-15T21:58:12.375864] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:12.376052] [DEBUG] [LOCAL ] TRGP: No existing data file found in primary storage. [2025-10-15T21:58:12.376107] [WARN ] [MAIN ] TRGP: No existing data found, performing full refresh instead. [2025-10-15T21:58:12.376216] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-15T21:58:12.376273] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-15T21:58:12.376340] [DEBUG] [LOCAL ] TRGP: No primary data file found to delete. [2025-10-15T21:58:12.376374] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-15T21:58:12.717860] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:12.913973] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-15T21:58:13.225063] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T21:58:13.714027] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-15T21:58:14.477995] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T21:58:14.509753] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T21:58:14.512403] [INFO ] [REMOTE ] TR: Full fetch complete (25420 records). [2025-10-15T21:58:14.512503] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-15T21:58:14.523915] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-15T21:58:14.894668] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-15T21:58:14.894765] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-15T21:58:14.895286] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-15T21:58:14.895328] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-15T21:58:14.896471] [DEBUG] [LOCAL ] TR: Trimmed 25420 records to 18949 (keeping 200 days of data) [2025-10-15T21:58:15.016850] [DEBUG] [LOCAL ] TR: Primary data saved (18949 records). [2025-10-15T21:58:15.016998] [INFO ] [MAIN ] TR: Full history saved. [2025-10-15T21:58:15.017079] [INFO ] [MAIN ] Update Progress: 2123/2369 symbols completed. TR took 31.4s. Estimated remaining: 34m 33s. Rate: 7.1 symbols/min [2025-10-15T21:58:15.183012] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:15.222515] [DEBUG] [LOCAL ] TRN: Loaded 36858 existing records from primary storage. [2025-10-15T21:58:15.222816] [INFO ] [MAIN ] TRN: Loaded 36858 existing records. [2025-10-15T21:58:15.322158] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-15T21:58:15.408293] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:58:15.408536] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-15T21:58:15.408594] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-15T21:58:15.408988] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-15T21:58:15.409049] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-15T21:58:15.728250] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T21:58:15.789727] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:16.114025] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-15T21:58:16.923579] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-15T21:58:16.929200] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T21:58:17.172744] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T21:58:17.713983] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-15T21:58:18.276671] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T21:58:18.514000] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-15T21:58:19.313967] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-15T21:58:19.402270] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T21:58:19.758067] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T21:58:20.113989] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-15T21:58:20.656734] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T21:58:20.889212] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T21:58:20.914001] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-15T21:58:21.714025] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-15T21:58:21.916250] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T21:58:22.514045] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-15T21:58:23.314221] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T21:58:23.313984] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-15T21:58:23.317131] [INFO ] [REMOTE ] TRC: Full fetch complete (21856 records). [2025-10-15T21:58:23.317205] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-15T21:58:23.707458] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-15T21:58:23.707673] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-15T21:58:23.708266] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-15T21:58:23.708346] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-15T21:58:23.709274] [DEBUG] [LOCAL ] TRC: Trimmed 21856 records to 15563 (keeping 200 days of data) [2025-10-15T21:58:23.803126] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T21:58:23.839105] [DEBUG] [LOCAL ] TRC: Primary data saved (15563 records). [2025-10-15T21:58:23.839274] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-15T21:58:23.839669] [INFO ] [MAIN ] Update Progress: 2124/2369 symbols completed. TRC took 40.2s. Estimated remaining: 34m 25s. Rate: 7.1 symbols/min [2025-10-15T21:58:24.006315] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:24.047354] [DEBUG] [LOCAL ] TRNO: Loaded 43872 existing records from primary storage. [2025-10-15T21:58:24.047690] [INFO ] [MAIN ] TRNO: Loaded 43872 existing records. [2025-10-15T21:58:24.119639] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-15T21:58:24.225468] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:58:24.225735] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-15T21:58:24.225791] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-15T21:58:24.226442] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-15T21:58:24.226499] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-15T21:58:24.578675] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:24.860474] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T21:58:24.913954] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-15T21:58:25.713976] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-15T21:58:25.828874] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T21:58:26.368702] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T21:58:26.514041] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-15T21:58:27.314024] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-15T21:58:27.523870] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T21:58:28.049725] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T21:58:28.114012] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-15T21:58:28.914069] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-15T21:58:28.965288] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T21:58:29.485292] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T21:58:29.714006] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-15T21:58:30.514023] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-15T21:58:30.594596] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T21:58:31.313985] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-15T21:58:31.435276] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T21:58:32.080885] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T21:58:32.114015] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-15T21:58:32.914077] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-15T21:58:33.166559] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T21:58:33.548523] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T21:58:33.714060] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-15T21:58:34.458108] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T21:58:34.514060] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-15T21:58:34.595848] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T21:58:35.314001] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-15T21:58:36.119113] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-15T21:58:36.133388] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T21:58:36.871919] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T21:58:36.914013] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-15T21:58:37.615148] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T21:58:37.714045] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-15T21:58:38.514065] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-15T21:58:38.737176] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T21:58:38.808424] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T21:58:39.314083] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-15T21:58:39.984232] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T21:58:40.113993] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-15T21:58:40.465464] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T21:58:40.914054] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-15T21:58:41.714061] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-15T21:58:42.097624] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T21:58:42.371968] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T21:58:42.514029] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-15T21:58:42.926724] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T21:58:42.933331] [INFO ] [REMOTE ] TREX: Full fetch complete (71523 records). [2025-10-15T21:58:42.933491] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-15T21:58:43.316502] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-15T21:58:43.340031] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-15T21:58:43.340148] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-15T21:58:43.341502] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-15T21:58:43.341696] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-15T21:58:43.343247] [DEBUG] [LOCAL ] TREX: Trimmed 71523 records to 49839 (keeping 200 days of data) [2025-10-15T21:58:43.646539] [DEBUG] [LOCAL ] TREX: Primary data saved (49839 records). [2025-10-15T21:58:43.646727] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-15T21:58:43.647682] [INFO ] [MAIN ] Update Progress: 2125/2369 symbols completed. TREX took 37.6s. Estimated remaining: 34m 18s. Rate: 7.1 symbols/min [2025-10-15T21:58:43.836325] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:43.893620] [DEBUG] [LOCAL ] TROX: Loaded 52150 existing records from primary storage. [2025-10-15T21:58:43.894021] [INFO ] [MAIN ] TROX: Loaded 52150 existing records. [2025-10-15T21:58:44.073668] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:58:44.074164] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-15T21:58:44.074226] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-15T21:58:44.074632] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-15T21:58:44.074725] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-15T21:58:44.117154] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-15T21:58:44.443853] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:44.461903] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T21:58:44.760566] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T21:58:44.913991] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-15T21:58:45.563803] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T21:58:45.714013] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-15T21:58:46.111622] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T21:58:46.116087] [INFO ] [REMOTE ] TRN: Full fetch complete (52650 records). [2025-10-15T21:58:46.116221] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-15T21:58:46.488416] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-15T21:58:46.488498] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-15T21:58:46.489465] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-15T21:58:46.489527] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-15T21:58:46.490591] [DEBUG] [LOCAL ] TRN: Trimmed 52650 records to 36777 (keeping 200 days of data) [2025-10-15T21:58:46.542050] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-15T21:58:46.713723] [DEBUG] [LOCAL ] TRN: Primary data saved (36777 records). [2025-10-15T21:58:46.713876] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-15T21:58:46.713956] [INFO ] [MAIN ] Update Progress: 2126/2369 symbols completed. TRN took 31.7s. Estimated remaining: 34m 8s. Rate: 7.1 symbols/min [2025-10-15T21:58:46.891152] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:46.943836] [DEBUG] [LOCAL ] TRP: Loaded 52150 existing records from primary storage. [2025-10-15T21:58:46.944186] [INFO ] [MAIN ] TRP: Loaded 52150 existing records. [2025-10-15T21:58:47.136535] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:58:47.136940] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-15T21:58:47.137046] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-15T21:58:47.138019] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-15T21:58:47.138080] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-15T21:58:47.334411] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-15T21:58:47.490097] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T21:58:47.528675] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:48.082606] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T21:58:48.114040] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-15T21:58:48.913982] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-15T21:58:49.157933] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T21:58:49.713975] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-15T21:58:49.791956] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T21:58:50.513982] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-15T21:58:50.564751] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T21:58:51.313986] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-15T21:58:51.561263] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T21:58:52.114002] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-15T21:58:52.228384] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T21:58:52.897692] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T21:58:52.914011] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-15T21:58:53.325984] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T21:58:53.714013] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-15T21:58:54.381226] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T21:58:54.387355] [INFO ] [REMOTE ] TRGP: Full fetch complete (73664 records). [2025-10-15T21:58:54.387465] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-15T21:58:54.523595] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-15T21:58:54.778999] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-15T21:58:54.779084] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-15T21:58:54.780255] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-15T21:58:54.780318] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-15T21:58:54.781991] [DEBUG] [LOCAL ] TRGP: Trimmed 73664 records to 50840 (keeping 200 days of data) [2025-10-15T21:58:54.908479] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T21:58:55.141815] [DEBUG] [LOCAL ] TRGP: Primary data saved (50840 records). [2025-10-15T21:58:55.141960] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-15T21:58:55.142051] [INFO ] [MAIN ] Update Progress: 2127/2369 symbols completed. TRGP took 42.9s. Estimated remaining: 34m 0s. Rate: 7.1 symbols/min [2025-10-15T21:58:55.305968] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:58:55.313998] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-15T21:58:55.340611] [DEBUG] [LOCAL ] TRTX: Loaded 37327 existing records from primary storage. [2025-10-15T21:58:55.340945] [INFO ] [MAIN ] TRTX: Loaded 37327 existing records. [2025-10-15T21:58:55.511929] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:58:55.512152] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-15T21:58:55.512207] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-15T21:58:55.512841] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-15T21:58:55.512898] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-15T21:58:55.889709] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:58:55.923704] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T21:58:56.114034] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-15T21:58:56.913999] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-15T21:58:57.102195] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T21:58:57.179401] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T21:58:57.714077] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-15T21:58:58.514074] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-15T21:58:58.584422] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T21:58:59.303419] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T21:58:59.314016] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-15T21:59:00.114012] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-15T21:59:00.294400] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T21:59:00.914047] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-15T21:59:01.346580] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-15T21:59:01.379988] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T21:59:01.714003] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-15T21:59:02.366466] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T21:59:02.514033] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-15T21:59:02.622271] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T21:59:03.314031] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-15T21:59:04.114026] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-15T21:59:04.171033] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T21:59:04.742513] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T21:59:04.914027] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-15T21:59:05.713980] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-15T21:59:05.975612] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T21:59:06.423575] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T21:59:06.513996] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-15T21:59:07.314042] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-15T21:59:07.368716] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T21:59:08.037606] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T21:59:08.113954] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-15T21:59:08.914025] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-15T21:59:08.916613] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T21:59:09.713970] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-15T21:59:09.843330] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T21:59:10.327958] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T21:59:10.513983] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-15T21:59:10.831941] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T21:59:10.837121] [INFO ] [REMOTE ] TRNO: Full fetch complete (63158 records). [2025-10-15T21:59:10.837272] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-15T21:59:11.212723] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-15T21:59:11.212823] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-15T21:59:11.213917] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-15T21:59:11.213978] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-15T21:59:11.215197] [DEBUG] [LOCAL ] TRNO: Trimmed 63158 records to 43960 (keeping 200 days of data) [2025-10-15T21:59:11.318110] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-15T21:59:11.482614] [DEBUG] [LOCAL ] TRNO: Primary data saved (43960 records). [2025-10-15T21:59:11.482775] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-15T21:59:11.483073] [INFO ] [MAIN ] Update Progress: 2128/2369 symbols completed. TRNO took 47.6s. Estimated remaining: 33m 53s. Rate: 7.1 symbols/min [2025-10-15T21:59:11.647357] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:59:11.694600] [DEBUG] [LOCAL ] TRU: Loaded 51431 existing records from primary storage. [2025-10-15T21:59:11.694924] [INFO ] [MAIN ] TRU: Loaded 51431 existing records. [2025-10-15T21:59:11.874062] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:59:11.874427] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-15T21:59:11.874485] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-15T21:59:11.875299] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-15T21:59:11.875356] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-15T21:59:12.052825] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T21:59:12.122739] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-15T21:59:12.285286] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:59:12.914051] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-15T21:59:13.044447] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T21:59:13.593255] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T21:59:13.713996] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-15T21:59:14.351706] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T21:59:14.514033] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-15T21:59:15.093671] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T21:59:15.103157] [INFO ] [REMOTE ] TRP: Full fetch complete (75697 records). [2025-10-15T21:59:15.103299] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-15T21:59:15.319086] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-15T21:59:15.540262] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-15T21:59:15.540359] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-15T21:59:15.541807] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-15T21:59:15.541884] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-15T21:59:15.543620] [DEBUG] [LOCAL ] TRP: Trimmed 75697 records to 52141 (keeping 200 days of data) [2025-10-15T21:59:15.837899] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T21:59:15.925412] [DEBUG] [LOCAL ] TRP: Primary data saved (52141 records). [2025-10-15T21:59:15.925557] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-15T21:59:15.925660] [INFO ] [MAIN ] Update Progress: 2129/2369 symbols completed. TRP took 29.2s. Estimated remaining: 33m 44s. Rate: 7.1 symbols/min [2025-10-15T21:59:16.099203] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:59:16.121936] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-15T21:59:16.142343] [DEBUG] [LOCAL ] TRV: Loaded 47444 existing records from primary storage. [2025-10-15T21:59:16.142724] [INFO ] [MAIN ] TRV: Loaded 47444 existing records. [2025-10-15T21:59:16.317936] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:59:16.318190] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-15T21:59:16.318238] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-15T21:59:16.319317] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-15T21:59:16.319375] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-15T21:59:16.682165] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:59:16.784091] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T21:59:16.913992] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-15T21:59:17.589719] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T21:59:17.713982] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-15T21:59:18.394098] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T21:59:18.513987] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-15T21:59:19.313998] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-15T21:59:19.568696] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T21:59:20.113981] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-15T21:59:20.388750] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T21:59:20.495453] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T21:59:20.914015] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-15T21:59:21.526016] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T21:59:21.530628] [INFO ] [REMOTE ] TRTX: Full fetch complete (53108 records). [2025-10-15T21:59:21.530740] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-15T21:59:21.719363] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-15T21:59:21.911585] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-15T21:59:21.911685] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-15T21:59:21.912845] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-15T21:59:21.912927] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-15T21:59:21.913992] [DEBUG] [LOCAL ] TRTX: Trimmed 53108 records to 37285 (keeping 200 days of data) [2025-10-15T21:59:22.130826] [DEBUG] [LOCAL ] TRTX: Primary data saved (37285 records). [2025-10-15T21:59:22.130971] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-15T21:59:22.131054] [INFO ] [MAIN ] Update Progress: 2130/2369 symbols completed. TRTX took 27.0s. Estimated remaining: 33m 35s. Rate: 7.1 symbols/min [2025-10-15T21:59:22.299856] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:59:22.346073] [DEBUG] [LOCAL ] TS: Loaded 51676 existing records from primary storage. [2025-10-15T21:59:22.346388] [INFO ] [MAIN ] TS: Loaded 51676 existing records. [2025-10-15T21:59:22.527543] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T21:59:22.515391] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-15T21:59:22.569732] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:59:22.570560] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-15T21:59:22.570611] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-15T21:59:22.571386] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-15T21:59:22.571444] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-15T21:59:22.916577] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:59:23.293376] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T21:59:23.313969] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-15T21:59:24.113991] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-15T21:59:24.393105] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T21:59:24.914047] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-15T21:59:25.022294] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T21:59:25.029480] [INFO ] [REMOTE ] TROX: Full fetch complete (73850 records). [2025-10-15T21:59:25.029721] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-15T21:59:25.444066] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-15T21:59:25.444508] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-15T21:59:25.446342] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-15T21:59:25.446419] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-15T21:59:25.448604] [DEBUG] [LOCAL ] TROX: Trimmed 73850 records to 52169 (keeping 200 days of data) [2025-10-15T21:59:25.601084] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T21:59:25.726729] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-15T21:59:25.825738] [DEBUG] [LOCAL ] TROX: Primary data saved (52169 records). [2025-10-15T21:59:25.825956] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-15T21:59:25.827237] [INFO ] [MAIN ] Update Progress: 2131/2369 symbols completed. TROX took 42.2s. Estimated remaining: 33m 26s. Rate: 7.1 symbols/min [2025-10-15T21:59:26.008742] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:59:26.039848] [DEBUG] [LOCAL ] TSE: Loaded 27791 existing records from primary storage. [2025-10-15T21:59:26.040202] [INFO ] [MAIN ] TSE: Loaded 27791 existing records. [2025-10-15T21:59:26.241294] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:59:26.241773] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-15T21:59:26.241863] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-15T21:59:26.242505] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-15T21:59:26.242565] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-15T21:59:26.515925] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-15T21:59:26.641278] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:59:26.676980] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T21:59:27.314046] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-15T21:59:27.530941] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T21:59:28.114068] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-15T21:59:28.516426] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-15T21:59:28.914009] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-15T21:59:29.122083] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T21:59:29.461338] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T21:59:29.714010] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-15T21:59:29.852603] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T21:59:30.514005] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-15T21:59:31.313980] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-15T21:59:31.481178] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T21:59:32.113971] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-15T21:59:32.391469] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T21:59:32.426774] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T21:59:32.914046] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-15T21:59:33.714016] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-15T21:59:34.009021] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T21:59:34.247534] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T21:59:34.513974] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-15T21:59:34.883859] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T21:59:35.313999] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-15T21:59:36.113967] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-15T21:59:36.141502] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T21:59:36.914028] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-15T21:59:37.113476] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T21:59:37.407989] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T21:59:37.713997] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-15T21:59:38.513983] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-15T21:59:38.712061] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T21:59:39.313970] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-15T21:59:39.468689] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T21:59:39.844992] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T21:59:40.113975] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-15T21:59:40.914052] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-15T21:59:41.038709] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T21:59:41.714023] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-15T21:59:41.941014] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T21:59:41.978627] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T21:59:42.514002] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-15T21:59:43.298590] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T21:59:43.313960] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-15T21:59:44.040097] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T21:59:44.113956] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-15T21:59:44.468335] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T21:59:44.473852] [INFO ] [REMOTE ] TRV: Full fetch complete (69782 records). [2025-10-15T21:59:44.473977] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-15T21:59:44.907025] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-15T21:59:44.907125] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-15T21:59:44.908223] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-15T21:59:44.908319] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-15T21:59:44.910287] [DEBUG] [LOCAL ] TRV: Trimmed 69782 records to 47454 (keeping 200 days of data) [2025-10-15T21:59:44.974575] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-15T21:59:45.032187] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T21:59:45.251025] [DEBUG] [LOCAL ] TRV: Primary data saved (47454 records). [2025-10-15T21:59:45.251213] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-15T21:59:45.251381] [INFO ] [MAIN ] Update Progress: 2132/2369 symbols completed. TRV took 29.3s. Estimated remaining: 33m 19s. Rate: 7.1 symbols/min [2025-10-15T21:59:45.424565] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:59:45.436304] [DEBUG] [LOCAL ] TSI: Loaded 8000 existing records from primary storage. [2025-10-15T21:59:45.436528] [INFO ] [MAIN ] TSI: Loaded 8000 existing records. [2025-10-15T21:59:45.614756] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:59:45.614946] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-15T21:59:45.614991] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-15T21:59:45.615234] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-15T21:59:45.615290] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-15T21:59:45.719104] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-15T21:59:45.973575] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:59:46.413401] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T21:59:46.514000] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-15T21:59:47.219342] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T21:59:47.286214] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T21:59:47.313964] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-15T21:59:48.114007] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-15T21:59:48.595089] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T21:59:48.767393] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T21:59:48.914009] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-15T21:59:49.714046] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-15T21:59:50.189926] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T21:59:50.514083] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-15T21:59:51.314093] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-15T21:59:51.566819] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T21:59:52.116192] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-15T21:59:52.142167] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T21:59:52.268375] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T21:59:52.913994] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-15T21:59:53.714017] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-15T21:59:53.810322] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T21:59:53.818338] [INFO ] [REMOTE ] TS: Full fetch complete (74719 records). [2025-10-15T21:59:53.818509] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-15T21:59:54.207789] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-15T21:59:54.207893] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-15T21:59:54.209381] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-15T21:59:54.209455] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-15T21:59:54.211153] [DEBUG] [LOCAL ] TS: Trimmed 74719 records to 51677 (keeping 200 days of data) [2025-10-15T21:59:54.514194] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-15T21:59:54.536873] [DEBUG] [LOCAL ] TS: Primary data saved (51677 records). [2025-10-15T21:59:54.537027] [INFO ] [MAIN ] TS: Full history saved. [2025-10-15T21:59:54.537108] [INFO ] [MAIN ] Update Progress: 2133/2369 symbols completed. TS took 32.4s. Estimated remaining: 33m 10s. Rate: 7.1 symbols/min [2025-10-15T21:59:54.715756] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T21:59:54.746454] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T21:59:54.775913] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T21:59:54.812243] [DEBUG] [LOCAL ] TSLX: Loaded 35821 existing records from primary storage. [2025-10-15T21:59:54.812550] [INFO ] [MAIN ] TSLX: Loaded 35821 existing records. [2025-10-15T21:59:54.992799] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T21:59:54.993018] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-15T21:59:54.993066] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-15T21:59:54.993734] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-15T21:59:54.993793] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-15T21:59:55.320775] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-15T21:59:55.379890] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T21:59:55.421880] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T21:59:56.114048] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-15T21:59:56.460326] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T21:59:56.913980] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-15T21:59:56.992795] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T21:59:57.713997] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-15T21:59:57.733904] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T21:59:58.514040] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-15T21:59:58.885775] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T21:59:59.314034] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-15T21:59:59.330971] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T21:59:59.334563] [INFO ] [REMOTE ] TSE: Full fetch complete (40738 records). [2025-10-15T21:59:59.334691] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-15T21:59:59.780700] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-15T21:59:59.780852] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-15T21:59:59.782370] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-15T21:59:59.782436] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-15T21:59:59.784002] [DEBUG] [LOCAL ] TSE: Trimmed 40738 records to 27772 (keeping 200 days of data) [2025-10-15T21:59:59.960896] [DEBUG] [LOCAL ] TSE: Primary data saved (27772 records). [2025-10-15T21:59:59.961114] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-15T21:59:59.961239] [INFO ] [MAIN ] Update Progress: 2134/2369 symbols completed. TSE took 34.1s. Estimated remaining: 33m 2s. Rate: 7.1 symbols/min [2025-10-15T22:00:00.117696] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-15T22:00:00.139177] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:00.205529] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-15T22:00:00.206048] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-15T22:00:00.393171] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:00.393469] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-15T22:00:00.393523] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-15T22:00:00.394511] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-15T22:00:00.394570] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-15T22:00:00.740626] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T22:00:00.770701] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:00.913998] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-15T22:00:01.119868] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T22:00:01.126170] [INFO ] [REMOTE ] TRU: Full fetch complete (73980 records). [2025-10-15T22:00:01.126293] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-15T22:00:01.514807] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-15T22:00:01.514893] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-15T22:00:01.516078] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-15T22:00:01.516147] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-15T22:00:01.517634] [DEBUG] [LOCAL ] TRU: Trimmed 73980 records to 51431 (keeping 200 days of data) [2025-10-15T22:00:01.731823] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-15T22:00:01.757204] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T22:00:01.862886] [DEBUG] [LOCAL ] TRU: Primary data saved (51431 records). [2025-10-15T22:00:01.863045] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-15T22:00:01.863335] [INFO ] [MAIN ] Update Progress: 2135/2369 symbols completed. TRU took 50.4s. Estimated remaining: 32m 53s. Rate: 7.1 symbols/min [2025-10-15T22:00:02.036934] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:02.088425] [DEBUG] [LOCAL ] TSN: Loaded 53014 existing records from primary storage. [2025-10-15T22:00:02.088815] [INFO ] [MAIN ] TSN: Loaded 53014 existing records. [2025-10-15T22:00:02.294437] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:02.294716] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-15T22:00:02.294786] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-15T22:00:02.295839] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-15T22:00:02.295897] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-15T22:00:02.519150] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-15T22:00:02.676304] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:03.127012] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T22:00:03.313996] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-15T22:00:04.114005] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-15T22:00:04.811888] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T22:00:04.914003] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-15T22:00:05.001513] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T22:00:05.170440] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-15T22:00:05.714002] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-15T22:00:06.458682] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-15T22:00:06.514017] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-15T22:00:06.596624] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T22:00:07.025939] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T22:00:07.314010] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-15T22:00:08.110969] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T22:00:08.113125] [INFO ] [REMOTE ] TSI: Full fetch complete (13862 records). [2025-10-15T22:00:08.113197] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-15T22:00:08.119103] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-15T22:00:08.511084] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-15T22:00:08.511178] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-15T22:00:08.511572] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-15T22:00:08.511614] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-15T22:00:08.512111] [DEBUG] [LOCAL ] TSI: Trimmed 13862 records to 8053 (keeping 200 days of data) [2025-10-15T22:00:08.558405] [DEBUG] [LOCAL ] TSI: Primary data saved (8053 records). [2025-10-15T22:00:08.558535] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-15T22:00:08.558617] [INFO ] [MAIN ] Update Progress: 2136/2369 symbols completed. TSI took 23.3s. Estimated remaining: 32m 44s. Rate: 7.1 symbols/min [2025-10-15T22:00:08.730944] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:08.742456] [DEBUG] [LOCAL ] TSQ: Loaded 11710 existing records from primary storage. [2025-10-15T22:00:08.742706] [INFO ] [MAIN ] TSQ: Loaded 11710 existing records. [2025-10-15T22:00:08.918615] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-15T22:00:08.918503] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:08.919953] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-15T22:00:08.920012] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-15T22:00:08.920284] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-15T22:00:08.920340] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-15T22:00:09.292221] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:09.714036] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-15T22:00:10.436185] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T22:00:10.514016] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-15T22:00:10.753019] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T22:00:10.936413] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-15T22:00:11.314045] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-15T22:00:11.687505] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T22:00:12.113997] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-15T22:00:12.162053] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T22:00:12.914018] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-15T22:00:13.686790] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T22:00:13.708030] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T22:00:13.713953] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-15T22:00:14.513983] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-15T22:00:15.314034] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-15T22:00:15.510149] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T22:00:16.013201] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T22:00:16.038359] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T22:00:16.113955] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-15T22:00:16.598012] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T22:00:16.913988] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-15T22:00:17.714002] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-15T22:00:18.513974] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-15T22:00:19.314038] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-15T22:00:19.470091] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T22:00:19.512502] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-15T22:00:19.544063] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T22:00:20.114028] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-15T22:00:20.244735] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T22:00:20.914000] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-15T22:00:21.429766] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T22:00:21.714081] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-15T22:00:22.514014] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-15T22:00:22.663605] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T22:00:23.314063] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-15T22:00:23.898340] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T22:00:24.119121] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-15T22:00:24.133494] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-15T22:00:24.876401] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T22:00:24.913988] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-15T22:00:25.194966] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T22:00:25.714079] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-15T22:00:26.514013] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-15T22:00:26.553418] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T22:00:27.314038] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-15T22:00:27.828370] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-15T22:00:28.079393] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T22:00:28.113954] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-15T22:00:28.329365] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T22:00:28.914030] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-15T22:00:28.916997] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T22:00:29.714031] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-15T22:00:30.235918] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T22:00:30.241714] [INFO ] [REMOTE ] TSLX: Full fetch complete (50323 records). [2025-10-15T22:00:30.241870] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-15T22:00:30.520388] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-15T22:00:30.621780] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-15T22:00:30.621880] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-15T22:00:30.622887] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-15T22:00:30.622951] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-15T22:00:30.624191] [DEBUG] [LOCAL ] TSLX: Trimmed 50323 records to 35911 (keeping 200 days of data) [2025-10-15T22:00:30.833667] [DEBUG] [LOCAL ] TSLX: Primary data saved (35911 records). [2025-10-15T22:00:30.833803] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-15T22:00:30.833882] [INFO ] [MAIN ] Update Progress: 2137/2369 symbols completed. TSLX took 36.3s. Estimated remaining: 32m 37s. Rate: 7.1 symbols/min [2025-10-15T22:00:31.002768] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:31.044528] [DEBUG] [LOCAL ] TT: Loaded 47349 existing records from primary storage. [2025-10-15T22:00:31.044854] [INFO ] [MAIN ] TT: Loaded 47349 existing records. [2025-10-15T22:00:31.216094] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:31.216296] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-15T22:00:31.216342] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-15T22:00:31.217109] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-15T22:00:31.217164] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-15T22:00:31.314570] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-15T22:00:31.568115] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:31.796213] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T22:00:32.064055] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T22:00:32.065724] [INFO ] [REMOTE ] TSQ: Full fetch complete (16437 records). [2025-10-15T22:00:32.065801] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-15T22:00:32.119154] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-15T22:00:32.445271] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-15T22:00:32.445358] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-15T22:00:32.445734] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-15T22:00:32.445794] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-15T22:00:32.446311] [DEBUG] [LOCAL ] TSQ: Trimmed 16437 records to 11703 (keeping 200 days of data) [2025-10-15T22:00:32.514996] [DEBUG] [LOCAL ] TSQ: Primary data saved (11703 records). [2025-10-15T22:00:32.515143] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-15T22:00:32.515245] [INFO ] [MAIN ] Update Progress: 2138/2369 symbols completed. TSQ took 24.0s. Estimated remaining: 32m 28s. Rate: 7.1 symbols/min [2025-10-15T22:00:32.683102] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:32.683266] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-15T22:00:32.683305] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-15T22:00:32.683412] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-15T22:00:32.683453] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-15T22:00:32.683494] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-15T22:00:32.683527] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-15T22:00:32.919129] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-15T22:00:33.035116] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:33.348525] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-15T22:00:33.714056] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-15T22:00:33.800688] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T22:00:33.916091] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:00:33.916535] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-15T22:00:33.916637] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:00:33.916738] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-15T22:00:33.916801] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:00:33.916874] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-15T22:00:33.916965] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-15T22:00:33.917025] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-15T22:00:33.917070] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-15T22:00:33.917119] [INFO ] [MAIN ] Update Progress: 2139/2369 symbols completed. TTAM took 1.4s. Estimated remaining: 32m 19s. Rate: 7.1 symbols/min [2025-10-15T22:00:34.090216] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:34.132251] [DEBUG] [LOCAL ] TTC: Loaded 42049 existing records from primary storage. [2025-10-15T22:00:34.132552] [INFO ] [MAIN ] TTC: Loaded 42049 existing records. [2025-10-15T22:00:34.307486] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:34.307745] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-15T22:00:34.307798] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-15T22:00:34.308198] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-15T22:00:34.308285] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-15T22:00:34.514611] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-15T22:00:34.661704] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:34.853509] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T22:00:35.314023] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-15T22:00:36.114048] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-15T22:00:36.167523] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T22:00:36.875162] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-15T22:00:36.913955] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-15T22:00:37.681682] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T22:00:37.713953] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-15T22:00:38.514023] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-15T22:00:39.241126] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T22:00:39.313962] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-15T22:00:39.715474] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-15T22:00:40.110515] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T22:00:40.119724] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-15T22:00:40.914020] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-15T22:00:40.971986] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T22:00:41.713993] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-15T22:00:42.514001] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-15T22:00:42.629164] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T22:00:42.764105] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-15T22:00:43.190892] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T22:00:43.199306] [INFO ] [REMOTE ] TSN: Full fetch complete (76624 records). [2025-10-15T22:00:43.199590] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-15T22:00:43.324348] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-15T22:00:43.722286] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-15T22:00:43.722687] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-15T22:00:43.725811] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-15T22:00:43.727397] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-15T22:00:43.727193] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T22:00:43.739791] [DEBUG] [LOCAL ] TSN: Trimmed 76624 records to 53044 (keeping 200 days of data) [2025-10-15T22:00:44.097367] [DEBUG] [LOCAL ] TSN: Primary data saved (53044 records). [2025-10-15T22:00:44.097572] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-15T22:00:44.097981] [INFO ] [MAIN ] Update Progress: 2140/2369 symbols completed. TSN took 42.2s. Estimated remaining: 32m 10s. Rate: 7.1 symbols/min [2025-10-15T22:00:44.119728] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-15T22:00:44.280947] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:44.339507] [DEBUG] [LOCAL ] TTE: Loaded 51576 existing records from primary storage. [2025-10-15T22:00:44.339959] [INFO ] [MAIN ] TTE: Loaded 51576 existing records. [2025-10-15T22:00:44.523040] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:44.523314] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-15T22:00:44.523367] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-15T22:00:44.523987] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-15T22:00:44.524046] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-15T22:00:44.909021] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:44.913961] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-15T22:00:45.714118] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-15T22:00:45.947273] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T22:00:46.059550] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-15T22:00:46.468610] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T22:00:46.513979] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-15T22:00:47.314044] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-15T22:00:47.570173] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T22:00:47.989595] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T22:00:47.996266] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-15T22:00:47.996446] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-15T22:00:48.119105] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-15T22:00:48.398350] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-15T22:00:48.398537] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-15T22:00:48.399796] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-15T22:00:48.399872] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-15T22:00:48.401543] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-15T22:00:48.521287] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T22:00:48.785027] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-15T22:00:48.785196] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-15T22:00:48.786086] [INFO ] [MAIN ] Update Progress: 2141/2369 symbols completed. TSM took 48.8s. Estimated remaining: 32m 2s. Rate: 7.1 symbols/min [2025-10-15T22:00:48.920849] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-15T22:00:48.952988] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:00:48.996528] [DEBUG] [LOCAL ] TTI: Loaded 46300 existing records from primary storage. [2025-10-15T22:00:48.996900] [INFO ] [MAIN ] TTI: Loaded 46300 existing records. [2025-10-15T22:00:49.169076] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:00:49.169300] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-15T22:00:49.169350] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-15T22:00:49.169754] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-15T22:00:49.169809] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-15T22:00:49.515317] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:00:49.714002] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-15T22:00:50.104836] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T22:00:50.158963] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T22:00:50.514053] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-15T22:00:51.168708] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T22:00:51.314064] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-15T22:00:52.119110] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-15T22:00:52.131615] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T22:00:52.913997] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-15T22:00:53.231576] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T22:00:53.721696] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-15T22:00:53.745069] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T22:00:54.514017] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-15T22:00:54.607496] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T22:00:55.214781] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T22:00:55.313966] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-15T22:00:55.689306] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T22:00:56.114055] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-15T22:00:56.913972] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-15T22:00:57.078966] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T22:00:57.714049] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-15T22:00:57.794043] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T22:00:58.454254] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T22:00:58.513959] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-15T22:00:58.830182] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T22:00:59.314043] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-15T22:01:00.074398] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T22:01:00.113960] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-15T22:01:00.914027] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-15T22:01:01.131084] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T22:01:01.714045] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-15T22:01:01.966802] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-15T22:01:02.413182] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T22:01:02.513960] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-15T22:01:03.074635] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T22:01:03.313993] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-15T22:01:04.037030] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T22:01:04.114001] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-15T22:01:04.543586] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T22:01:04.914012] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-15T22:01:05.478894] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T22:01:05.487349] [INFO ] [REMOTE ] TTC: Full fetch complete (62164 records). [2025-10-15T22:01:05.487573] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-15T22:01:05.714453] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-15T22:01:05.928530] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-15T22:01:05.928614] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-15T22:01:05.929667] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-15T22:01:05.929732] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-15T22:01:05.930923] [DEBUG] [LOCAL ] TTC: Trimmed 62164 records to 41993 (keeping 200 days of data) [2025-10-15T22:01:06.185202] [DEBUG] [LOCAL ] TTC: Primary data saved (41993 records). [2025-10-15T22:01:06.185334] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-15T22:01:06.185412] [INFO ] [MAIN ] Update Progress: 2142/2369 symbols completed. TTC took 32.3s. Estimated remaining: 31m 54s. Rate: 7.1 symbols/min [2025-10-15T22:01:06.354457] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:06.422089] [DEBUG] [LOCAL ] TU: Loaded 49830 existing records from primary storage. [2025-10-15T22:01:06.422492] [INFO ] [MAIN ] TU: Loaded 49830 existing records. [2025-10-15T22:01:06.518132] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-15T22:01:06.620959] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:06.621337] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-15T22:01:06.621442] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-15T22:01:06.622078] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-15T22:01:06.622137] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-15T22:01:06.946873] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-15T22:01:07.040464] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:07.314027] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-15T22:01:07.551957] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T22:01:08.114023] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-15T22:01:08.320712] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T22:01:08.595932] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T22:01:08.913981] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-15T22:01:09.714070] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-15T22:01:09.798289] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:01:10.514019] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-15T22:01:10.790567] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T22:01:11.314033] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-15T22:01:11.597150] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T22:01:12.101554] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T22:01:12.113966] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-15T22:01:12.719077] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T22:01:12.913997] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-15T22:01:13.558996] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T22:01:13.566099] [INFO ] [REMOTE ] TT: Full fetch complete (70013 records). [2025-10-15T22:01:13.566351] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-15T22:01:13.718626] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-15T22:01:13.889910] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T22:01:13.941019] [INFO ] [REMOTE ] TTI: Full fetch complete (66045 records). [2025-10-15T22:01:13.951673] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-15T22:01:14.132514] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-15T22:01:14.140078] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-15T22:01:14.155403] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-15T22:01:14.155507] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-15T22:01:14.187070] [DEBUG] [LOCAL ] TT: Trimmed 70013 records to 47326 (keeping 200 days of data) [2025-10-15T22:01:14.518161] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-15T22:01:14.630794] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-15T22:01:14.632662] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-15T22:01:14.634885] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-15T22:01:14.634969] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-15T22:01:14.640613] [DEBUG] [LOCAL ] TTI: Trimmed 66045 records to 46361 (keeping 200 days of data) [2025-10-15T22:01:15.030354] [DEBUG] [LOCAL ] TT: Primary data saved (47326 records). [2025-10-15T22:01:15.033388] [INFO ] [MAIN ] TT: Full history saved. [2025-10-15T22:01:15.033511] [INFO ] [MAIN ] Update Progress: 2143/2369 symbols completed. TT took 44.2s. Estimated remaining: 31m 46s. Rate: 7.1 symbols/min [2025-10-15T22:01:15.251170] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:15.255348] [DEBUG] [LOCAL ] TTI: Primary data saved (46361 records). [2025-10-15T22:01:15.256048] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-15T22:01:15.257058] [INFO ] [MAIN ] Update Progress: 2144/2369 symbols completed. TTI took 26.5s. Estimated remaining: 31m 36s. Rate: 7.1 symbols/min [2025-10-15T22:01:15.476337] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:15.498112] [DEBUG] [LOCAL ] TUYA: Loaded 45942 existing records from primary storage. [2025-10-15T22:01:15.498574] [INFO ] [MAIN ] TUYA: Loaded 45942 existing records. [2025-10-15T22:01:15.694039] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:15.707612] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-15T22:01:15.708375] [DEBUG] [LOCAL ] TV: Loaded 41720 existing records from primary storage. [2025-10-15T22:01:15.707809] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-15T22:01:15.708714] [INFO ] [MAIN ] TV: Loaded 41720 existing records. [2025-10-15T22:01:15.745059] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-15T22:01:15.745328] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-15T22:01:16.042186] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:16.047674] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-15T22:01:16.047769] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-15T22:01:16.075226] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-15T22:01:16.081202] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-15T22:01:16.328336] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-15T22:01:16.483755] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-15T22:01:16.533212] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:16.612082] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-15T22:01:16.748241] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T22:01:16.751883] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:16.914019] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-15T22:01:17.714070] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-15T22:01:18.148558] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T22:01:18.248732] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T22:01:18.280100] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T22:01:18.286708] [INFO ] [REMOTE ] TTE: Full fetch complete (75127 records). [2025-10-15T22:01:18.286847] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-15T22:01:18.519318] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-15T22:01:18.684889] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-15T22:01:18.684967] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-15T22:01:18.686130] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-15T22:01:18.686193] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-15T22:01:18.687572] [DEBUG] [LOCAL ] TTE: Trimmed 75127 records to 51582 (keeping 200 days of data) [2025-10-15T22:01:19.005319] [DEBUG] [LOCAL ] TTE: Primary data saved (51582 records). [2025-10-15T22:01:19.005603] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-15T22:01:19.006101] [INFO ] [MAIN ] Update Progress: 2145/2369 symbols completed. TTE took 34.9s. Estimated remaining: 31m 27s. Rate: 7.1 symbols/min [2025-10-15T22:01:19.176633] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:19.182924] [DEBUG] [LOCAL ] TVC: Loaded 3241 existing records from primary storage. [2025-10-15T22:01:19.183112] [INFO ] [MAIN ] TVC: Loaded 3241 existing records. [2025-10-15T22:01:19.322998] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-15T22:01:19.371282] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:19.371740] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-15T22:01:19.371918] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-15T22:01:19.381236] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-15T22:01:19.381588] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-15T22:01:19.506334] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T22:01:19.773781] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:19.974739] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T22:01:20.114002] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-15T22:01:20.781074] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T22:01:20.836828] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T22:01:20.914025] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-15T22:01:21.714040] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-15T22:01:22.513990] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-15T22:01:22.597560] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T22:01:23.084723] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T22:01:23.314012] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-15T22:01:23.416148] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T22:01:24.114028] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-15T22:01:24.914111] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-15T22:01:25.089987] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T22:01:25.714031] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-15T22:01:25.839715] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T22:01:26.027041] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T22:01:26.167049] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T22:01:26.513995] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-15T22:01:27.314048] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-15T22:01:28.114025] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-15T22:01:28.292411] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T22:01:28.913983] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-15T22:01:29.001373] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T22:01:29.513945] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T22:01:29.714065] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-15T22:01:29.800363] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T22:01:30.514010] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-15T22:01:31.295835] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T22:01:31.313975] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-15T22:01:32.114028] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-15T22:01:32.195190] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T22:01:32.698144] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T22:01:32.820968] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T22:01:32.914022] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-15T22:01:33.714026] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-15T22:01:34.293933] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T22:01:34.514049] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-15T22:01:34.591743] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:01:35.314081] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-15T22:01:36.113969] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-15T22:01:36.219428] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T22:01:36.759977] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T22:01:36.914006] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-15T22:01:36.949550] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T22:01:37.714009] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-15T22:01:38.369059] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T22:01:38.513984] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-15T22:01:39.313997] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-15T22:01:39.395971] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T22:01:40.021983] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T22:01:40.113991] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-15T22:01:40.920444] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-15T22:01:40.937673] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T22:01:41.643902] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T22:01:41.714051] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-15T22:01:42.452780] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T22:01:42.462268] [INFO ] [REMOTE ] TU: Full fetch complete (72946 records). [2025-10-15T22:01:42.462480] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-15T22:01:42.519284] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-15T22:01:42.892533] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-15T22:01:42.892613] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-15T22:01:42.893890] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-15T22:01:42.893956] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-15T22:01:42.895613] [DEBUG] [LOCAL ] TU: Trimmed 72946 records to 49837 (keeping 200 days of data) [2025-10-15T22:01:43.133462] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T22:01:43.254041] [DEBUG] [LOCAL ] TU: Primary data saved (49837 records). [2025-10-15T22:01:43.254214] [INFO ] [MAIN ] TU: Full history saved. [2025-10-15T22:01:43.254306] [INFO ] [MAIN ] Update Progress: 2146/2369 symbols completed. TU took 37.1s. Estimated remaining: 31m 21s. Rate: 7.1 symbols/min [2025-10-15T22:01:43.319216] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-15T22:01:43.473868] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T22:01:43.477506] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:43.491499] [DEBUG] [LOCAL ] TVE: Loaded 2679 existing records from primary storage. [2025-10-15T22:01:43.491769] [INFO ] [MAIN ] TVE: Loaded 2679 existing records. [2025-10-15T22:01:43.670458] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:43.670730] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-15T22:01:43.670784] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-15T22:01:43.671070] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-15T22:01:43.671129] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-15T22:01:44.026828] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:44.113980] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-15T22:01:44.631757] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T22:01:44.919798] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-15T22:01:44.932083] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T22:01:45.412704] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T22:01:45.714037] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-15T22:01:46.514003] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-15T22:01:46.998098] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T22:01:47.002983] [INFO ] [REMOTE ] TV: Full fetch complete (61329 records). [2025-10-15T22:01:47.003124] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-15T22:01:47.135330] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T22:01:47.319126] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-15T22:01:47.430163] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-15T22:01:47.430251] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-15T22:01:47.431356] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-15T22:01:47.431419] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-15T22:01:47.432774] [DEBUG] [LOCAL ] TV: Trimmed 61329 records to 41583 (keeping 200 days of data) [2025-10-15T22:01:47.676224] [DEBUG] [LOCAL ] TV: Primary data saved (41583 records). [2025-10-15T22:01:47.676357] [INFO ] [MAIN ] TV: Full history saved. [2025-10-15T22:01:47.676460] [INFO ] [MAIN ] Update Progress: 2147/2369 symbols completed. TV took 32.4s. Estimated remaining: 31m 12s. Rate: 7.1 symbols/min [2025-10-15T22:01:47.845415] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:47.883528] [DEBUG] [LOCAL ] TWI: Loaded 33919 existing records from primary storage. [2025-10-15T22:01:47.883880] [INFO ] [MAIN ] TWI: Loaded 33919 existing records. [2025-10-15T22:01:48.059307] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:48.059561] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-15T22:01:48.059611] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-15T22:01:48.059960] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-15T22:01:48.060018] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-15T22:01:48.123287] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-15T22:01:48.419976] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:48.669294] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T22:01:48.670531] [INFO ] [REMOTE ] TVC: Full fetch complete (5297 records). [2025-10-15T22:01:48.670610] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-15T22:01:48.921964] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-15T22:01:49.118840] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T22:01:49.119250] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-15T22:01:49.129197] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-15T22:01:49.130250] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-15T22:01:49.130404] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-15T22:01:49.131844] [DEBUG] [LOCAL ] TVC: Trimmed 5297 records to 3210 (keeping 200 days of data) [2025-10-15T22:01:49.155042] [DEBUG] [LOCAL ] TVC: Primary data saved (3210 records). [2025-10-15T22:01:49.155253] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-15T22:01:49.155402] [INFO ] [MAIN ] Update Progress: 2148/2369 symbols completed. TVC took 30.1s. Estimated remaining: 31m 3s. Rate: 7.1 symbols/min [2025-10-15T22:01:49.338685] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:49.405999] [DEBUG] [LOCAL ] TWLO: Loaded 52819 existing records from primary storage. [2025-10-15T22:01:49.406487] [INFO ] [MAIN ] TWLO: Loaded 52819 existing records. [2025-10-15T22:01:49.566186] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T22:01:49.616497] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:49.617059] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-15T22:01:49.617136] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-15T22:01:49.617819] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-15T22:01:49.617884] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-15T22:01:49.719137] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-15T22:01:50.074011] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:50.308808] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T22:01:50.513991] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-15T22:01:51.163059] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T22:01:51.314004] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-15T22:01:52.114017] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-15T22:01:52.914063] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-15T22:01:52.958304] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T22:01:53.464511] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T22:01:53.714051] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-15T22:01:53.786346] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T22:01:54.514014] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-15T22:01:55.314074] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-15T22:01:55.491394] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T22:01:55.982470] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T22:01:55.988135] [INFO ] [REMOTE ] TUYA: Full fetch complete (66336 records). [2025-10-15T22:01:55.992371] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-15T22:01:56.119226] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-15T22:01:56.390853] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-15T22:01:56.390981] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-15T22:01:56.392592] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-15T22:01:56.392711] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-15T22:01:56.408998] [DEBUG] [LOCAL ] TUYA: Trimmed 66336 records to 45932 (keeping 200 days of data) [2025-10-15T22:01:56.419165] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T22:01:56.684230] [DEBUG] [LOCAL ] TUYA: Primary data saved (45932 records). [2025-10-15T22:01:56.684376] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-15T22:01:56.684458] [INFO ] [MAIN ] Update Progress: 2149/2369 symbols completed. TUYA took 41.7s. Estimated remaining: 30m 54s. Rate: 7.1 symbols/min [2025-10-15T22:01:56.856223] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:01:56.861974] [DEBUG] [LOCAL ] TWN: Loaded 3274 existing records from primary storage. [2025-10-15T22:01:56.862174] [INFO ] [MAIN ] TWN: Loaded 3274 existing records. [2025-10-15T22:01:56.914678] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-15T22:01:57.045538] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:01:57.045779] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-15T22:01:57.045829] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-15T22:01:57.046013] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-15T22:01:57.046081] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-15T22:01:57.417748] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:01:57.713996] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-15T22:01:58.146997] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T22:01:58.241078] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-15T22:01:58.304555] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T22:01:58.514057] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-15T22:01:59.075673] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T22:01:59.314054] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-15T22:02:00.114004] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-15T22:02:00.564729] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T22:02:00.914004] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-15T22:02:01.031272] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T22:02:01.714027] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-15T22:02:02.204894] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T22:02:02.513998] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-15T22:02:02.961411] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T22:02:03.190598] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T22:02:03.313971] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-15T22:02:04.114001] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-15T22:02:04.913989] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-15T22:02:05.394934] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T22:02:05.576791] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-15T22:02:05.689793] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T22:02:05.713948] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-15T22:02:06.514038] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-15T22:02:07.191899] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T22:02:07.314005] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-15T22:02:07.974900] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T22:02:08.114000] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-15T22:02:08.328469] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T22:02:08.520938] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T22:02:08.914015] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-15T22:02:09.714023] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-15T22:02:10.278502] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T22:02:10.307693] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T22:02:10.514026] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-15T22:02:10.910144] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T22:02:11.313995] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-15T22:02:12.113993] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-15T22:02:12.913976] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-15T22:02:13.234063] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T22:02:13.374913] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T22:02:13.530747] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T22:02:13.714044] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-15T22:02:14.161315] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T22:02:14.514055] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-15T22:02:15.095602] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T22:02:15.314051] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-15T22:02:16.114068] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-15T22:02:16.696177] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T22:02:16.697495] [INFO ] [REMOTE ] TWN: Full fetch complete (5253 records). [2025-10-15T22:02:16.697570] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-15T22:02:16.917141] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-15T22:02:17.138783] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-15T22:02:17.138926] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-15T22:02:17.139362] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-15T22:02:17.139446] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-15T22:02:17.140259] [DEBUG] [LOCAL ] TWN: Trimmed 5253 records to 3257 (keeping 200 days of data) [2025-10-15T22:02:17.163280] [DEBUG] [LOCAL ] TWN: Primary data saved (3257 records). [2025-10-15T22:02:17.163476] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-15T22:02:17.163578] [INFO ] [MAIN ] Update Progress: 2150/2369 symbols completed. TWN took 20.5s. Estimated remaining: 30m 47s. Rate: 7.1 symbols/min [2025-10-15T22:02:17.355138] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:02:17.390139] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T22:02:17.453591] [DEBUG] [LOCAL ] TWO: Loaded 48647 existing records from primary storage. [2025-10-15T22:02:17.453970] [INFO ] [MAIN ] TWO: Loaded 48647 existing records. [2025-10-15T22:02:17.641994] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:02:17.642447] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-15T22:02:17.642520] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-15T22:02:17.643023] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-15T22:02:17.643268] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-15T22:02:17.720772] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-15T22:02:18.027083] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:02:18.085921] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T22:02:18.236024] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T22:02:18.514041] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-15T22:02:18.962943] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T22:02:19.314014] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-15T22:02:20.114005] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-15T22:02:20.724975] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T22:02:20.914058] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-15T22:02:21.274059] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-15T22:02:21.275083] [INFO ] [REMOTE ] TVE: Full fetch complete (4290 records). [2025-10-15T22:02:21.275156] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-15T22:02:21.634592] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-15T22:02:21.726550] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-15T22:02:21.736533] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-15T22:02:21.736687] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-15T22:02:21.736980] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-15T22:02:21.737030] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-15T22:02:21.737749] [DEBUG] [LOCAL ] TVE: Trimmed 4290 records to 2634 (keeping 200 days of data) [2025-10-15T22:02:21.759796] [DEBUG] [LOCAL ] TVE: Primary data saved (2634 records). [2025-10-15T22:02:21.760003] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-15T22:02:21.760113] [INFO ] [MAIN ] Update Progress: 2151/2369 symbols completed. TVE took 38.5s. Estimated remaining: 30m 38s. Rate: 7.1 symbols/min [2025-10-15T22:02:21.939610] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:02:21.939881] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-15T22:02:21.939924] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-15T22:02:21.940055] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-15T22:02:21.940098] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-15T22:02:21.940139] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-15T22:02:21.940173] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-15T22:02:22.341193] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:02:22.514124] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-15T22:02:22.721417] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:02:22.721780] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-15T22:02:22.721868] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:02:22.721953] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-15T22:02:22.722032] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:02:22.722126] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-15T22:02:22.722224] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-15T22:02:22.722295] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-15T22:02:22.722386] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-15T22:02:22.722455] [INFO ] [MAIN ] Update Progress: 2152/2369 symbols completed. TWOD took 1.0s. Estimated remaining: 30m 29s. Rate: 7.1 symbols/min [2025-10-15T22:02:22.910980] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:02:22.936463] [DEBUG] [LOCAL ] TX: Loaded 23315 existing records from primary storage. [2025-10-15T22:02:22.936738] [INFO ] [MAIN ] TX: Loaded 23315 existing records. [2025-10-15T22:02:23.115187] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:02:23.115392] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-15T22:02:23.115477] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-15T22:02:23.115776] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-15T22:02:23.115832] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-15T22:02:23.319089] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-15T22:02:23.479150] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:02:23.722493] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T22:02:24.114053] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-15T22:02:24.814193] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T22:02:24.913978] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-15T22:02:25.247301] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T22:02:25.714044] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-15T22:02:26.447917] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T22:02:26.514111] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-15T22:02:26.735467] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-15T22:02:26.745563] [INFO ] [REMOTE ] TWLO: Full fetch complete (76614 records). [2025-10-15T22:02:26.745788] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-15T22:02:27.157862] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-15T22:02:27.157955] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-15T22:02:27.159239] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-15T22:02:27.159307] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-15T22:02:27.160795] [DEBUG] [LOCAL ] TWLO: Trimmed 76614 records to 52830 (keeping 200 days of data) [2025-10-15T22:02:27.345431] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-15T22:02:27.502510] [DEBUG] [LOCAL ] TWLO: Primary data saved (52830 records). [2025-10-15T22:02:27.502705] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-15T22:02:27.503101] [INFO ] [MAIN ] Update Progress: 2153/2369 symbols completed. TWLO took 38.3s. Estimated remaining: 30m 20s. Rate: 7.1 symbols/min [2025-10-15T22:02:27.672990] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:02:27.673178] [DEBUG] [LOCAL ] TXNM: No existing data file found in primary storage. [2025-10-15T22:02:27.673215] [WARN ] [MAIN ] TXNM: No existing data found, performing full refresh instead. [2025-10-15T22:02:27.673323] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-15T22:02:27.673364] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-15T22:02:27.673405] [DEBUG] [LOCAL ] TXNM: No primary data file found to delete. [2025-10-15T22:02:27.673438] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-15T22:02:28.027612] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T22:02:28.065507] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:02:28.114057] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-15T22:02:28.597388] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T22:02:28.914005] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-15T22:02:29.488214] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T22:02:29.714043] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-15T22:02:29.906071] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T22:02:30.513985] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-15T22:02:31.035031] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T22:02:31.040223] [INFO ] [REMOTE ] TWI: Full fetch complete (52191 records). [2025-10-15T22:02:31.040336] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-15T22:02:31.319680] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-15T22:02:31.463279] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-15T22:02:31.463369] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-15T22:02:31.464527] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-15T22:02:31.464594] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-15T22:02:31.465931] [DEBUG] [LOCAL ] TWI: Trimmed 52191 records to 33900 (keeping 200 days of data) [2025-10-15T22:02:31.701600] [DEBUG] [LOCAL ] TWI: Primary data saved (33900 records). [2025-10-15T22:02:31.701794] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-15T22:02:31.701897] [INFO ] [MAIN ] Update Progress: 2154/2369 symbols completed. TWI took 44.0s. Estimated remaining: 30m 11s. Rate: 7.1 symbols/min [2025-10-15T22:02:31.928221] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:02:31.946701] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T22:02:31.972263] [DEBUG] [LOCAL ] TXO: Loaded 19715 existing records from primary storage. [2025-10-15T22:02:31.972546] [INFO ] [MAIN ] TXO: Loaded 19715 existing records. [2025-10-15T22:02:32.119235] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-15T22:02:32.163503] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:02:32.163713] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-15T22:02:32.163770] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-15T22:02:32.164027] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-15T22:02:32.164084] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-15T22:02:32.523979] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:02:32.783422] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T22:02:32.914013] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-15T22:02:33.267328] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T22:02:33.714002] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-15T22:02:34.339244] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T22:02:34.513998] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-15T22:02:34.852363] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T22:02:35.314034] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-15T22:02:36.114010] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-15T22:02:36.180539] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T22:02:36.706423] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T22:02:36.794670] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T22:02:36.914010] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-15T22:02:37.483674] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T22:02:37.714079] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-15T22:02:38.514033] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-15T22:02:39.314010] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-15T22:02:39.448366] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T22:02:40.000538] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T22:02:40.113999] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-15T22:02:40.497805] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T22:02:40.914027] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-15T22:02:41.713975] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-15T22:02:41.795238] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T22:02:41.826846] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T22:02:42.514046] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-15T22:02:42.802315] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T22:02:43.314076] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-15T22:02:44.120119] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-15T22:02:44.135035] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T22:02:44.294260] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T22:02:44.914024] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-15T22:02:45.672689] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T22:02:45.714137] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-15T22:02:45.863304] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T22:02:46.491742] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T22:02:46.513979] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-15T22:02:47.314023] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-15T22:02:47.940806] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T22:02:48.113999] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-15T22:02:48.158691] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T22:02:48.914018] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-15T22:02:49.128778] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T22:02:49.134357] [INFO ] [REMOTE ] TX: Full fetch complete (35770 records). [2025-10-15T22:02:49.134539] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-15T22:02:49.522318] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-15T22:02:49.522450] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-15T22:02:49.523168] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-15T22:02:49.523231] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-15T22:02:49.524742] [DEBUG] [LOCAL ] TX: Trimmed 35770 records to 23315 (keeping 200 days of data) [2025-10-15T22:02:49.663955] [DEBUG] [LOCAL ] TX: Primary data saved (23315 records). [2025-10-15T22:02:49.664077] [INFO ] [MAIN ] TX: Full history saved. [2025-10-15T22:02:49.664165] [INFO ] [MAIN ] Update Progress: 2155/2369 symbols completed. TX took 26.9s. Estimated remaining: 30m 4s. Rate: 7.1 symbols/min [2025-10-15T22:02:49.726563] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-15T22:02:49.835366] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:02:49.881095] [DEBUG] [LOCAL ] TXT: Loaded 49654 existing records from primary storage. [2025-10-15T22:02:49.881387] [INFO ] [MAIN ] TXT: Loaded 49654 existing records. [2025-10-15T22:02:50.080861] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:02:50.081185] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-15T22:02:50.081241] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-15T22:02:50.081734] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-15T22:02:50.081791] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-15T22:02:50.466701] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:02:50.503740] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T22:02:50.514158] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-15T22:02:51.243995] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T22:02:51.314199] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-15T22:02:52.073483] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T22:02:52.114169] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-15T22:02:52.710419] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T22:02:52.914034] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-15T22:02:53.530230] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T22:02:53.714018] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-15T22:02:53.977185] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T22:02:54.514062] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-15T22:02:55.221492] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T22:02:55.314007] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-15T22:02:55.988629] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T22:02:56.114015] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-15T22:02:56.914039] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-15T22:02:57.005873] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T22:02:57.434497] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T22:02:57.713989] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-15T22:02:57.899421] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T22:02:58.513991] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-15T22:02:59.313973] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-15T22:02:59.418120] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T22:02:59.499451] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T22:03:00.113990] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-15T22:03:00.366032] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T22:03:00.371362] [INFO ] [REMOTE ] TXNM: Full fetch complete (63054 records). [2025-10-15T22:03:00.371480] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-15T22:03:00.761898] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-15T22:03:00.761980] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-15T22:03:00.763004] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-15T22:03:00.763065] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-15T22:03:00.764258] [DEBUG] [LOCAL ] TXNM: Trimmed 63054 records to 43447 (keeping 200 days of data) [2025-10-15T22:03:00.946433] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-15T22:03:01.039481] [DEBUG] [LOCAL ] TXNM: Primary data saved (43447 records). [2025-10-15T22:03:01.039614] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-15T22:03:01.039714] [INFO ] [MAIN ] Update Progress: 2156/2369 symbols completed. TXNM took 33.5s. Estimated remaining: 29m 56s. Rate: 7.1 symbols/min [2025-10-15T22:03:01.238196] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:01.249439] [DEBUG] [LOCAL ] TY: Loaded 7589 existing records from primary storage. [2025-10-15T22:03:01.249710] [INFO ] [MAIN ] TY: Loaded 7589 existing records. [2025-10-15T22:03:01.442387] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:01.442708] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-15T22:03:01.442780] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-15T22:03:01.448229] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-15T22:03:01.457969] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-15T22:03:01.518672] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T22:03:01.558181] [INFO ] [REMOTE ] TWO: Full fetch complete (69284 records). [2025-10-15T22:03:01.574801] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-15T22:03:01.714791] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-15T22:03:02.219118] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:02.328404] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-15T22:03:02.328498] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-15T22:03:02.329864] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-15T22:03:02.329932] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-15T22:03:02.331428] [DEBUG] [LOCAL ] TWO: Trimmed 69284 records to 48657 (keeping 200 days of data) [2025-10-15T22:03:02.522285] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-15T22:03:02.662429] [DEBUG] [LOCAL ] TWO: Primary data saved (48657 records). [2025-10-15T22:03:02.662595] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-15T22:03:02.662748] [INFO ] [MAIN ] Update Progress: 2157/2369 symbols completed. TWO took 45.5s. Estimated remaining: 29m 47s. Rate: 7.1 symbols/min [2025-10-15T22:03:02.864682] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T22:03:02.889550] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T22:03:03.201092] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T22:03:03.314017] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-15T22:03:04.006842] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T22:03:04.114055] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-15T22:03:04.914014] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-15T22:03:05.714018] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-15T22:03:05.914400] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T22:03:05.937102] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T22:03:06.455622] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T22:03:06.513965] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-15T22:03:07.314024] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-15T22:03:07.391518] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T22:03:07.394571] [INFO ] [REMOTE ] TXO: Full fetch complete (26915 records). [2025-10-15T22:03:07.394736] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-15T22:03:07.757480] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-15T22:03:07.757554] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-15T22:03:07.758111] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-15T22:03:07.758172] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-15T22:03:07.761847] [DEBUG] [LOCAL ] TXO: Trimmed 26915 records to 19818 (keeping 200 days of data) [2025-10-15T22:03:07.878864] [DEBUG] [LOCAL ] TXO: Primary data saved (19818 records). [2025-10-15T22:03:07.878993] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-15T22:03:07.879069] [INFO ] [MAIN ] Update Progress: 2158/2369 symbols completed. TXO took 36.2s. Estimated remaining: 29m 38s. Rate: 7.1 symbols/min [2025-10-15T22:03:08.094765] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T22:03:08.113959] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-15T22:03:08.914027] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-15T22:03:08.946565] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T22:03:09.713963] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-15T22:03:10.341132] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T22:03:10.452787] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T22:03:10.513998] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-15T22:03:11.115003] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T22:03:11.314076] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-15T22:03:12.057136] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T22:03:12.114015] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-15T22:03:12.698034] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T22:03:12.914009] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-15T22:03:13.460330] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T22:03:13.714047] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-15T22:03:14.514096] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-15T22:03:14.960576] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T22:03:14.991261] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T22:03:14.992732] [INFO ] [REMOTE ] TY: Full fetch complete (11443 records). [2025-10-15T22:03:14.992809] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-15T22:03:15.316122] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-15T22:03:15.354071] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-15T22:03:15.354149] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-15T22:03:15.354429] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-15T22:03:15.354467] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-15T22:03:15.354948] [DEBUG] [LOCAL ] TY: Trimmed 11443 records to 7582 (keeping 200 days of data) [2025-10-15T22:03:15.401549] [DEBUG] [LOCAL ] TY: Primary data saved (7582 records). [2025-10-15T22:03:15.401716] [INFO ] [MAIN ] TY: Full history saved. [2025-10-15T22:03:15.401812] [INFO ] [MAIN ] Update Progress: 2159/2369 symbols completed. TY took 14.4s. Estimated remaining: 29m 29s. Rate: 7.1 symbols/min [2025-10-15T22:03:17.179838] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T22:03:17.190780] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-15T22:03:18.961717] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T22:03:18.972396] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-15T22:03:19.391331] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-15T22:03:19.402804] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-15T22:03:19.839861] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T22:03:19.846849] [INFO ] [REMOTE ] TXT: Full fetch complete (72343 records). [2025-10-15T22:03:19.847084] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-15T22:03:20.253773] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-15T22:03:20.253905] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-15T22:03:20.255049] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-15T22:03:20.255112] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-15T22:03:20.256531] [DEBUG] [LOCAL ] TXT: Trimmed 72343 records to 49610 (keeping 200 days of data) [2025-10-15T22:03:20.557109] [DEBUG] [LOCAL ] TXT: Primary data saved (49610 records). [2025-10-15T22:03:20.557255] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-15T22:03:20.557336] [INFO ] [MAIN ] Update Progress: 2160/2369 symbols completed. TXT took 30.9s. Estimated remaining: 29m 21s. Rate: 7.1 symbols/min [2025-10-15T22:03:21.314419] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:21.255009] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:21.337539] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:21.338812] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:21.355857] [DEBUG] [LOCAL ] TYG: Loaded 13882 existing records from primary storage. [2025-10-15T22:03:21.356125] [INFO ] [MAIN ] TYG: Loaded 13882 existing records. [2025-10-15T22:03:21.479260] [DEBUG] [LOCAL ] TYL: Loaded 22515 existing records from primary storage. [2025-10-15T22:03:21.495717] [INFO ] [MAIN ] TYL: Loaded 22515 existing records. [2025-10-15T22:03:21.660234] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:21.680586] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-15T22:03:21.691271] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-15T22:03:21.698167] [DEBUG] [LOCAL ] UA: Loaded 50470 existing records from primary storage. [2025-10-15T22:03:21.767113] [INFO ] [MAIN ] UA: Loaded 50470 existing records. [2025-10-15T22:03:21.761574] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-15T22:03:21.756216] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-15T22:03:21.795694] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-15T22:03:21.797546] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-15T22:03:21.950197] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:22.044061] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-15T22:03:22.064344] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-15T22:03:22.161458] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-15T22:03:22.224740] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-15T22:03:22.295294] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:22.469186] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-15T22:03:22.557965] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:22.548394] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-15T22:03:22.573736] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-15T22:03:22.584111] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-15T22:03:22.614937] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-15T22:03:22.614999] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-15T22:03:22.622503] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-15T22:03:22.622711] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-15T22:03:22.980566] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:23.009561] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-15T22:03:23.531962] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:23.569287] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-15T22:03:23.621907] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:23.623272] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-15T22:03:23.703949] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:23.704242] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-15T22:03:24.056116] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T22:03:24.059887] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-15T22:03:24.371581] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T22:03:24.376055] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-15T22:03:25.128081] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T22:03:25.134193] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-15T22:03:25.428784] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T22:03:25.439569] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-15T22:03:25.557479] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T22:03:25.562007] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-15T22:03:26.093769] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-15T22:03:26.106035] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-15T22:03:26.119994] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T22:03:26.473573] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T22:03:26.513962] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-15T22:03:27.314051] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-15T22:03:27.350538] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T22:03:27.666813] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T22:03:28.114133] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-15T22:03:28.164081] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T22:03:28.353038] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T22:03:28.914110] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-15T22:03:29.041146] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T22:03:29.714026] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-15T22:03:29.862245] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T22:03:30.513999] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-15T22:03:30.584773] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T22:03:31.313996] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-15T22:03:32.113977] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-15T22:03:32.400880] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T22:03:32.740052] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-15T22:03:32.785248] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T22:03:32.914038] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-15T22:03:33.714013] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-15T22:03:34.337093] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T22:03:34.514079] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-15T22:03:34.852022] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T22:03:35.314251] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-15T22:03:35.524970] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T22:03:36.022999] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T22:03:36.114066] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-15T22:03:36.662587] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T22:03:36.913982] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-15T22:03:37.714000] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-15T22:03:38.514015] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-15T22:03:38.554928] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T22:03:39.283348] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T22:03:39.313953] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-15T22:03:39.600524] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T22:03:40.114009] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-15T22:03:40.430801] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T22:03:40.914018] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-15T22:03:41.645431] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T22:03:41.713987] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-15T22:03:41.743807] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T22:03:42.514022] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-15T22:03:43.089783] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T22:03:43.091565] [INFO ] [REMOTE ] TYG: Full fetch complete (22349 records). [2025-10-15T22:03:43.091634] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-15T22:03:43.317497] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-15T22:03:43.461173] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-15T22:03:43.461245] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-15T22:03:43.461728] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-15T22:03:43.461789] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-15T22:03:43.462347] [DEBUG] [LOCAL ] TYG: Trimmed 22349 records to 13894 (keeping 200 days of data) [2025-10-15T22:03:43.553352] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T22:03:43.587876] [DEBUG] [LOCAL ] TYG: Primary data saved (13894 records). [2025-10-15T22:03:43.587988] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-15T22:03:43.588060] [INFO ] [MAIN ] Update Progress: 2161/2369 symbols completed. TYG took 23.0s. Estimated remaining: 29m 14s. Rate: 7.1 symbols/min [2025-10-15T22:03:43.758298] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:43.806877] [DEBUG] [LOCAL ] UAA: Loaded 53505 existing records from primary storage. [2025-10-15T22:03:43.807213] [INFO ] [MAIN ] UAA: Loaded 53505 existing records. [2025-10-15T22:03:43.979624] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:43.979832] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-15T22:03:43.979878] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-15T22:03:43.980438] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-15T22:03:43.980494] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-15T22:03:44.119194] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-15T22:03:44.334576] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:44.394704] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-15T22:03:44.398107] [INFO ] [REMOTE ] TYL: Full fetch complete (31595 records). [2025-10-15T22:03:44.398278] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-15T22:03:44.764521] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-15T22:03:44.764597] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-15T22:03:44.765234] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-15T22:03:44.765294] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-15T22:03:44.766036] [DEBUG] [LOCAL ] TYL: Trimmed 31595 records to 22414 (keeping 200 days of data) [2025-10-15T22:03:44.907449] [DEBUG] [LOCAL ] TYL: Primary data saved (22414 records). [2025-10-15T22:03:44.907570] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-15T22:03:44.907669] [INFO ] [MAIN ] Update Progress: 2162/2369 symbols completed. TYL took 24.3s. Estimated remaining: 29m 5s. Rate: 7.1 symbols/min [2025-10-15T22:03:44.919107] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-15T22:03:45.077689] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:03:45.083976] [DEBUG] [LOCAL ] UAN: Loaded 5446 existing records from primary storage. [2025-10-15T22:03:45.084146] [INFO ] [MAIN ] UAN: Loaded 5446 existing records. [2025-10-15T22:03:45.258989] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:03:45.259225] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-15T22:03:45.259274] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-15T22:03:45.259439] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-15T22:03:45.259495] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-15T22:03:45.624053] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:03:45.713952] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-15T22:03:45.838810] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T22:03:46.162066] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T22:03:46.513953] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-15T22:03:46.666281] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T22:03:47.314056] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-15T22:03:47.944129] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T22:03:48.114003] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-15T22:03:48.715839] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T22:03:48.836741] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-15T22:03:48.913963] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-15T22:03:49.714036] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-15T22:03:50.270275] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T22:03:50.514012] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-15T22:03:51.026575] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T22:03:51.314024] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-15T22:03:51.489047] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T22:03:51.769238] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T22:03:52.114006] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-15T22:03:52.830670] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T22:03:52.914012] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-15T22:03:53.714004] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-15T22:03:54.513988] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-15T22:03:54.955708] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T22:03:54.972604] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T22:03:55.003989] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T22:03:55.314010] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-15T22:03:55.897269] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T22:03:56.114012] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-15T22:03:56.511488] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T22:03:56.914045] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-15T22:03:57.714018] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-15T22:03:58.397870] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T22:03:58.513977] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-15T22:03:59.088208] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T22:03:59.314002] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-15T22:03:59.681590] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T22:04:00.113992] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-15T22:04:00.914005] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-15T22:04:01.713987] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-15T22:04:01.812215] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T22:04:01.813953] [INFO ] [REMOTE ] UAN: Full fetch complete (7988 records). [2025-10-15T22:04:01.814060] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-15T22:04:01.930355] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T22:04:02.231947] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-15T22:04:02.232054] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-15T22:04:02.232405] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-15T22:04:02.232467] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-15T22:04:02.232913] [DEBUG] [LOCAL ] UAN: Trimmed 7988 records to 5430 (keeping 200 days of data) [2025-10-15T22:04:02.265937] [DEBUG] [LOCAL ] UAN: Primary data saved (5430 records). [2025-10-15T22:04:02.266034] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-15T22:04:02.266142] [INFO ] [MAIN ] Update Progress: 2163/2369 symbols completed. UAN took 17.4s. Estimated remaining: 28m 57s. Rate: 7.1 symbols/min [2025-10-15T22:04:02.437507] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:02.492304] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-15T22:04:02.492626] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-15T22:04:02.523571] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-15T22:04:02.644636] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-15T22:04:02.721008] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:02.721227] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-15T22:04:02.721292] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-15T22:04:02.721793] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-15T22:04:02.721861] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-15T22:04:03.083484] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:03.118801] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T22:04:03.313957] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-15T22:04:04.104537] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T22:04:04.114999] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-15T22:04:04.823055] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T22:04:04.913945] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-15T22:04:05.714036] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-15T22:04:06.258453] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T22:04:06.475525] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T22:04:06.513952] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-15T22:04:07.313982] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-15T22:04:07.421708] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T22:04:07.989194] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T22:04:08.114038] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-15T22:04:08.914074] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-15T22:04:09.351494] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T22:04:09.358058] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-15T22:04:09.358274] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-15T22:04:09.719487] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-15T22:04:09.743378] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-15T22:04:09.743497] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-15T22:04:09.744632] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-15T22:04:09.744713] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-15T22:04:09.746911] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 53799 (keeping 200 days of data) [2025-10-15T22:04:10.062578] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-15T22:04:10.062744] [INFO ] [MAIN ] U: Full history saved. [2025-10-15T22:04:10.063153] [INFO ] [MAIN ] Update Progress: 2164/2369 symbols completed. U took 49.5s. Estimated remaining: 28m 48s. Rate: 7.1 symbols/min [2025-10-15T22:04:10.230119] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:10.280314] [DEBUG] [LOCAL ] UBS: Loaded 52316 existing records from primary storage. [2025-10-15T22:04:10.280603] [INFO ] [MAIN ] UBS: Loaded 52316 existing records. [2025-10-15T22:04:10.459543] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:10.459767] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-15T22:04:10.459819] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-15T22:04:10.460286] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-15T22:04:10.460325] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-15T22:04:10.821691] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:10.836828] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-15T22:04:10.838722] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T22:04:10.845511] [INFO ] [REMOTE ] UA: Full fetch complete (73180 records). [2025-10-15T22:04:10.845630] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-15T22:04:10.984747] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-15T22:04:11.281351] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-15T22:04:11.281449] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-15T22:04:11.282607] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-15T22:04:11.282708] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-15T22:04:11.284293] [DEBUG] [LOCAL ] UA: Trimmed 73180 records to 50489 (keeping 200 days of data) [2025-10-15T22:04:11.333697] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-15T22:04:11.432498] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T22:04:11.648856] [DEBUG] [LOCAL ] UA: Primary data saved (50489 records). [2025-10-15T22:04:11.649025] [INFO ] [MAIN ] UA: Full history saved. [2025-10-15T22:04:11.649133] [INFO ] [MAIN ] Update Progress: 2165/2369 symbols completed. UA took 51.1s. Estimated remaining: 28m 39s. Rate: 7.1 symbols/min [2025-10-15T22:04:11.851856] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:11.893630] [DEBUG] [LOCAL ] UCB: Loaded 37813 existing records from primary storage. [2025-10-15T22:04:11.893989] [INFO ] [MAIN ] UCB: Loaded 37813 existing records. [2025-10-15T22:04:12.076624] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:12.076883] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-15T22:04:12.076934] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-15T22:04:12.077351] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-15T22:04:12.077409] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-15T22:04:12.122742] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-15T22:04:12.473115] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:12.732040] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T22:04:12.913972] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-15T22:04:13.713984] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-15T22:04:13.827885] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-15T22:04:13.930156] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T22:04:14.284375] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T22:04:14.514014] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-15T22:04:15.106905] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T22:04:15.313983] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-15T22:04:16.114011] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-15T22:04:16.462450] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T22:04:16.649842] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T22:04:16.914048] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-15T22:04:17.713996] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-15T22:04:18.228634] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T22:04:18.525590] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-15T22:04:18.531621] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-15T22:04:19.163343] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T22:04:19.313975] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-15T22:04:20.113985] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-15T22:04:20.472025] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T22:04:20.479570] [INFO ] [REMOTE ] UAA: Full fetch complete (77646 records). [2025-10-15T22:04:20.479834] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-15T22:04:20.914050] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-15T22:04:20.914190] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-15T22:04:20.914454] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-15T22:04:20.916814] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-15T22:04:20.917053] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-15T22:04:20.918846] [DEBUG] [LOCAL ] UAA: Trimmed 77646 records to 53502 (keeping 200 days of data) [2025-10-15T22:04:21.148956] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T22:04:21.263699] [DEBUG] [LOCAL ] UAA: Primary data saved (53502 records). [2025-10-15T22:04:21.263839] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-15T22:04:21.263920] [INFO ] [MAIN ] Update Progress: 2166/2369 symbols completed. UAA took 37.7s. Estimated remaining: 28m 31s. Rate: 7.1 symbols/min [2025-10-15T22:04:21.427216] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:21.476021] [DEBUG] [LOCAL ] UDR: Loaded 52034 existing records from primary storage. [2025-10-15T22:04:21.476354] [INFO ] [MAIN ] UDR: Loaded 52034 existing records. [2025-10-15T22:04:21.677236] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:21.677466] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-15T22:04:21.677512] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-15T22:04:21.678028] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-15T22:04:21.678082] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-15T22:04:21.719762] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-15T22:04:22.023532] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:22.491849] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T22:04:22.513947] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-15T22:04:22.579498] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-15T22:04:23.314006] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-15T22:04:23.344426] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T22:04:23.728846] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T22:04:24.114112] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-15T22:04:24.647044] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T22:04:24.914015] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-15T22:04:25.092998] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T22:04:25.714000] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-15T22:04:26.302328] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T22:04:26.514058] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-15T22:04:27.319170] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-15T22:04:27.332073] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T22:04:28.114021] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-15T22:04:28.215705] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T22:04:28.913998] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-15T22:04:29.498500] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-15T22:04:29.565678] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T22:04:29.714059] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-15T22:04:30.091866] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T22:04:30.514142] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-15T22:04:31.314057] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-15T22:04:31.789827] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T22:04:32.114002] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-15T22:04:32.228742] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T22:04:32.820228] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T22:04:32.914009] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-15T22:04:33.714009] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-15T22:04:34.496743] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-15T22:04:34.513956] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-15T22:04:34.584983] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T22:04:34.946760] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T22:04:35.314004] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-15T22:04:36.114001] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-15T22:04:36.794014] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T22:04:36.913986] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-15T22:04:37.112058] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-15T22:04:37.277406] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T22:04:37.713974] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-15T22:04:38.513984] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-15T22:04:38.751336] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T22:04:39.314069] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-15T22:04:40.113966] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-15T22:04:40.169306] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T22:04:40.210194] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-15T22:04:40.598171] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T22:04:40.913997] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-15T22:04:41.192799] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T22:04:41.197798] [INFO ] [REMOTE ] UCB: Full fetch complete (54876 records). [2025-10-15T22:04:41.197901] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-15T22:04:41.587356] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-15T22:04:41.587478] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-15T22:04:41.588540] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-15T22:04:41.588616] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-15T22:04:41.590123] [DEBUG] [LOCAL ] UCB: Trimmed 54876 records to 37854 (keeping 200 days of data) [2025-10-15T22:04:41.756485] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-15T22:04:41.824705] [DEBUG] [LOCAL ] UCB: Primary data saved (37854 records). [2025-10-15T22:04:41.824866] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-15T22:04:41.824955] [INFO ] [MAIN ] Update Progress: 2167/2369 symbols completed. UCB took 30.2s. Estimated remaining: 28m 24s. Rate: 7.1 symbols/min [2025-10-15T22:04:41.992697] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:42.033311] [DEBUG] [LOCAL ] UE: Loaded 42547 existing records from primary storage. [2025-10-15T22:04:42.033588] [INFO ] [MAIN ] UE: Loaded 42547 existing records. [2025-10-15T22:04:42.214118] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:42.214355] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-15T22:04:42.214412] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-15T22:04:42.214888] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-15T22:04:42.214946] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-15T22:04:42.521347] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-15T22:04:42.586369] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:42.735586] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T22:04:42.821016] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-15T22:04:42.828042] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-15T22:04:42.828172] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-15T22:04:43.215317] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-15T22:04:43.215401] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-15T22:04:43.216681] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-15T22:04:43.216747] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-15T22:04:43.218281] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 53806 (keeping 200 days of data) [2025-10-15T22:04:43.314560] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-15T22:04:43.543882] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-15T22:04:43.544038] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-15T22:04:43.544948] [INFO ] [MAIN ] Update Progress: 2168/2369 symbols completed. UBER took 41.3s. Estimated remaining: 28m 15s. Rate: 7.1 symbols/min [2025-10-15T22:04:43.744305] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:43.758697] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T22:04:43.777885] [DEBUG] [LOCAL ] UFI: Loaded 8163 existing records from primary storage. [2025-10-15T22:04:43.778068] [INFO ] [MAIN ] UFI: Loaded 8163 existing records. [2025-10-15T22:04:43.954152] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:43.954394] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-15T22:04:43.954441] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-15T22:04:43.954582] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-15T22:04:43.954620] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-15T22:04:44.126016] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-15T22:04:44.309922] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:44.790144] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T22:04:44.914054] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-15T22:04:45.668009] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T22:04:45.713961] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-15T22:04:45.904446] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T22:04:45.910946] [INFO ] [REMOTE ] UBS: Full fetch complete (75956 records). [2025-10-15T22:04:45.911066] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-15T22:04:46.308860] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-15T22:04:46.308978] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-15T22:04:46.310264] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-15T22:04:46.310329] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-15T22:04:46.311814] [DEBUG] [LOCAL ] UBS: Trimmed 75956 records to 52312 (keeping 200 days of data) [2025-10-15T22:04:46.516522] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-15T22:04:46.628110] [DEBUG] [LOCAL ] UBS: Primary data saved (52312 records). [2025-10-15T22:04:46.628290] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-15T22:04:46.628742] [INFO ] [MAIN ] Update Progress: 2169/2369 symbols completed. UBS took 36.6s. Estimated remaining: 28m 6s. Rate: 7.1 symbols/min [2025-10-15T22:04:46.817475] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:46.889857] [DEBUG] [LOCAL ] UGI: Loaded 50609 existing records from primary storage. [2025-10-15T22:04:46.891302] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T22:04:46.900848] [INFO ] [MAIN ] UGI: Loaded 50609 existing records. [2025-10-15T22:04:47.075612] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:47.075862] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-15T22:04:47.075915] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-15T22:04:47.076526] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-15T22:04:47.076585] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-15T22:04:47.318766] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-15T22:04:47.434459] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:47.465997] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T22:04:48.113995] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-15T22:04:48.865067] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T22:04:48.872466] [INFO ] [REMOTE ] UDR: Full fetch complete (75007 records). [2025-10-15T22:04:48.872689] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-15T22:04:48.919073] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-15T22:04:49.083617] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T22:04:49.314101] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-15T22:04:49.314191] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-15T22:04:49.315381] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-15T22:04:49.315451] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-15T22:04:49.317013] [DEBUG] [LOCAL ] UDR: Trimmed 75007 records to 52059 (keeping 200 days of data) [2025-10-15T22:04:49.637316] [DEBUG] [LOCAL ] UDR: Primary data saved (52059 records). [2025-10-15T22:04:49.637472] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-15T22:04:49.637561] [INFO ] [MAIN ] Update Progress: 2170/2369 symbols completed. UDR took 28.4s. Estimated remaining: 27m 57s. Rate: 7.1 symbols/min [2025-10-15T22:04:49.724841] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-15T22:04:49.749770] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T22:04:49.829847] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:04:49.871297] [DEBUG] [LOCAL ] UGP: Loaded 42920 existing records from primary storage. [2025-10-15T22:04:49.871717] [INFO ] [MAIN ] UGP: Loaded 42920 existing records. [2025-10-15T22:04:50.055474] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:04:50.055874] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-15T22:04:50.055945] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-15T22:04:50.056527] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-15T22:04:50.056587] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-15T22:04:50.424473] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:04:50.514012] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-15T22:04:51.293947] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T22:04:51.313991] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-15T22:04:51.597728] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T22:04:52.067103] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T22:04:52.114010] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-15T22:04:52.913999] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-15T22:04:53.564118] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T22:04:53.713970] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-15T22:04:53.853871] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T22:04:54.513988] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-15T22:04:54.726280] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T22:04:55.314022] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-15T22:04:55.824143] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T22:04:56.114035] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-15T22:04:56.479169] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T22:04:56.913977] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-15T22:04:57.714056] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-15T22:04:57.776087] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T22:04:58.348180] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T22:04:58.451710] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T22:04:58.513999] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-15T22:04:59.314055] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-15T22:04:59.707539] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T22:04:59.784219] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T22:05:00.113993] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-15T22:05:00.600681] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T22:05:00.914007] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-15T22:05:01.714049] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-15T22:05:02.270410] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T22:05:02.514050] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-15T22:05:02.948365] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T22:05:03.314025] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-15T22:05:03.756273] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T22:05:03.783697] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T22:05:04.114017] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-15T22:05:04.605483] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T22:05:04.913973] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-15T22:05:05.714051] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-15T22:05:06.146512] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T22:05:06.514046] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-15T22:05:07.187736] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T22:05:07.189769] [INFO ] [REMOTE ] UFI: Full fetch complete (12357 records). [2025-10-15T22:05:07.189852] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-15T22:05:07.319098] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-15T22:05:07.573563] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-15T22:05:07.573700] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-15T22:05:07.574247] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-15T22:05:07.574332] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-15T22:05:07.575070] [DEBUG] [LOCAL ] UFI: Trimmed 12357 records to 8151 (keeping 200 days of data) [2025-10-15T22:05:07.653880] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T22:05:07.670377] [DEBUG] [LOCAL ] UFI: Primary data saved (8151 records). [2025-10-15T22:05:07.671025] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-15T22:05:07.671118] [INFO ] [MAIN ] Update Progress: 2171/2369 symbols completed. UFI took 24.1s. Estimated remaining: 27m 49s. Rate: 7.1 symbols/min [2025-10-15T22:05:07.842313] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:07.859381] [DEBUG] [LOCAL ] UHAL: Loaded 16876 existing records from primary storage. [2025-10-15T22:05:07.859630] [INFO ] [MAIN ] UHAL: Loaded 16876 existing records. [2025-10-15T22:05:08.040803] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:08.041042] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-15T22:05:08.041092] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-15T22:05:08.041295] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-15T22:05:08.041335] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-15T22:05:08.119201] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-15T22:05:08.391135] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:08.914069] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-15T22:05:09.108945] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T22:05:09.621832] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T22:05:09.713959] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-15T22:05:10.513972] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-15T22:05:10.616486] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T22:05:11.134160] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T22:05:11.314039] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-15T22:05:11.834733] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T22:05:12.114007] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-15T22:05:12.892215] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T22:05:12.914008] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-15T22:05:13.373433] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T22:05:13.552225] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T22:05:13.713994] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-15T22:05:14.513993] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-15T22:05:15.314008] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-15T22:05:15.390547] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T22:05:15.579015] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T22:05:16.114060] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-15T22:05:16.489074] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T22:05:16.914025] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-15T22:05:17.700826] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T22:05:17.713958] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-15T22:05:17.751001] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T22:05:18.513996] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-15T22:05:19.300155] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T22:05:19.313951] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-15T22:05:19.958192] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T22:05:20.114011] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-15T22:05:20.766359] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T22:05:20.831799] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T22:05:20.841930] [INFO ] [REMOTE ] UGP: Full fetch complete (62232 records). [2025-10-15T22:05:20.842151] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-15T22:05:20.919714] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-15T22:05:21.429491] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-15T22:05:21.429606] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-15T22:05:21.430964] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-15T22:05:21.431034] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-15T22:05:21.432508] [DEBUG] [LOCAL ] UGP: Trimmed 62232 records to 42890 (keeping 200 days of data) [2025-10-15T22:05:21.704287] [DEBUG] [LOCAL ] UGP: Primary data saved (42890 records). [2025-10-15T22:05:21.704426] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-15T22:05:21.704562] [INFO ] [MAIN ] Update Progress: 2172/2369 symbols completed. UGP took 32.1s. Estimated remaining: 27m 41s. Rate: 7.1 symbols/min [2025-10-15T22:05:21.719138] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-15T22:05:21.867445] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T22:05:21.931857] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:21.980225] [DEBUG] [LOCAL ] UHS: Loaded 40255 existing records from primary storage. [2025-10-15T22:05:21.980639] [INFO ] [MAIN ] UHS: Loaded 40255 existing records. [2025-10-15T22:05:22.166357] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:22.166595] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-15T22:05:22.166668] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-15T22:05:22.167119] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-15T22:05:22.167158] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-15T22:05:22.507476] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:22.513958] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-15T22:05:23.314054] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-15T22:05:23.535754] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T22:05:23.694388] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T22:05:24.114037] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-15T22:05:24.413428] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T22:05:24.914049] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-15T22:05:25.085253] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T22:05:25.093061] [INFO ] [REMOTE ] UE: Full fetch complete (61112 records). [2025-10-15T22:05:25.093186] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-15T22:05:25.466154] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-15T22:05:25.466246] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-15T22:05:25.467278] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-15T22:05:25.467346] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-15T22:05:25.468744] [DEBUG] [LOCAL ] UE: Trimmed 61112 records to 42581 (keeping 200 days of data) [2025-10-15T22:05:25.717923] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-15T22:05:25.726795] [DEBUG] [LOCAL ] UE: Primary data saved (42581 records). [2025-10-15T22:05:25.726885] [INFO ] [MAIN ] UE: Full history saved. [2025-10-15T22:05:25.726960] [INFO ] [MAIN ] Update Progress: 2173/2369 symbols completed. UE took 43.9s. Estimated remaining: 27m 33s. Rate: 7.1 symbols/min [2025-10-15T22:05:25.896974] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:25.908143] [DEBUG] [LOCAL ] UHT: Loaded 10125 existing records from primary storage. [2025-10-15T22:05:25.908375] [INFO ] [MAIN ] UHT: Loaded 10125 existing records. [2025-10-15T22:05:26.088200] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:26.088400] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-15T22:05:26.088447] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-15T22:05:26.088690] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-15T22:05:26.088757] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-15T22:05:26.457240] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:26.477528] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T22:05:26.513962] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-15T22:05:26.727296] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T22:05:27.209160] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T22:05:27.313981] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-15T22:05:28.114013] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-15T22:05:28.802326] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T22:05:28.914033] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-15T22:05:29.422353] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T22:05:29.480011] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T22:05:29.714047] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-15T22:05:30.514006] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-15T22:05:30.544837] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T22:05:31.314012] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-15T22:05:31.553507] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T22:05:32.113959] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-15T22:05:32.201399] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T22:05:32.914030] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-15T22:05:33.714045] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-15T22:05:33.788199] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T22:05:33.824425] [DEBUG] [REMOTE ] UHT: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-15T22:05:33.824815] [WARN ] [REMOTE ] UHT: No data returned for month 2025-04 [2025-10-15T22:05:33.824912] [FATAL] [REMOTE ] UHT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:05:33.824990] [FATAL] [MAIN ] UHT: Failed to fetch primary data. [2025-10-15T22:05:33.825028] [WARN ] [MAIN ] UHT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:05:33.825124] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-15T22:05:33.825200] [DEBUG] [LOCAL ] UHT: No primary data file found to delete. [2025-10-15T22:05:33.825238] [INFO ] [LOCAL ] UHT: Starting deletion of derivative data. [2025-10-15T22:05:33.825497] [DEBUG] [LOCAL ] UHT: Deleted derivative data file. [2025-10-15T22:05:33.825581] [INFO ] [MAIN ] Update Progress: 2174/2369 symbols completed. UHT took 8.1s. Estimated remaining: 27m 24s. Rate: 7.1 symbols/min [2025-10-15T22:05:34.024491] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:34.040000] [DEBUG] [LOCAL ] UI: Loaded 13864 existing records from primary storage. [2025-10-15T22:05:34.040216] [INFO ] [MAIN ] UI: Loaded 13864 existing records. [2025-10-15T22:05:34.240920] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:34.241201] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-15T22:05:34.241260] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-15T22:05:34.241510] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-15T22:05:34.241567] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-15T22:05:34.515411] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-15T22:05:34.638754] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:34.667440] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T22:05:35.314054] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-15T22:05:35.745308] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T22:05:35.751540] [INFO ] [REMOTE ] UGI: Full fetch complete (73469 records). [2025-10-15T22:05:35.751745] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-15T22:05:36.119164] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-15T22:05:36.142016] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-15T22:05:36.142097] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-15T22:05:36.143221] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-15T22:05:36.143284] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-15T22:05:36.144872] [DEBUG] [LOCAL ] UGI: Trimmed 73469 records to 50621 (keeping 200 days of data) [2025-10-15T22:05:36.461327] [DEBUG] [LOCAL ] UGI: Primary data saved (50621 records). [2025-10-15T22:05:36.461692] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-15T22:05:36.462141] [INFO ] [MAIN ] Update Progress: 2175/2369 symbols completed. UGI took 49.8s. Estimated remaining: 27m 15s. Rate: 7.1 symbols/min [2025-10-15T22:05:36.642323] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:36.678170] [DEBUG] [LOCAL ] UIS: Loaded 36896 existing records from primary storage. [2025-10-15T22:05:36.678495] [INFO ] [MAIN ] UIS: Loaded 36896 existing records. [2025-10-15T22:05:36.882506] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:36.882847] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-15T22:05:36.882954] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-15T22:05:36.883682] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-15T22:05:36.883739] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-15T22:05:36.926717] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-15T22:05:37.275928] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:37.282679] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T22:05:37.311742] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T22:05:37.646485] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T22:05:37.714003] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-15T22:05:38.514017] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-15T22:05:38.909711] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T22:05:39.314066] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-15T22:05:39.838788] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T22:05:40.113996] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-15T22:05:40.384461] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T22:05:40.914010] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-15T22:05:41.359478] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T22:05:41.714066] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-15T22:05:42.493460] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T22:05:42.513963] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-15T22:05:42.689086] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T22:05:42.691764] [INFO ] [REMOTE ] UHAL: Full fetch complete (23271 records). [2025-10-15T22:05:42.691841] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-15T22:05:43.077620] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-15T22:05:43.077741] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-15T22:05:43.078225] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-15T22:05:43.078293] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-15T22:05:43.078920] [DEBUG] [LOCAL ] UHAL: Trimmed 23271 records to 16844 (keeping 200 days of data) [2025-10-15T22:05:43.173033] [DEBUG] [LOCAL ] UHAL: Primary data saved (16844 records). [2025-10-15T22:05:43.173192] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-15T22:05:43.173275] [INFO ] [MAIN ] Update Progress: 2176/2369 symbols completed. UHAL took 35.5s. Estimated remaining: 27m 7s. Rate: 7.1 symbols/min [2025-10-15T22:05:43.325666] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-15T22:05:43.344282] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:43.394787] [DEBUG] [LOCAL ] UL: Loaded 53077 existing records from primary storage. [2025-10-15T22:05:43.395077] [INFO ] [MAIN ] UL: Loaded 53077 existing records. [2025-10-15T22:05:43.569154] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:43.569387] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-15T22:05:43.569435] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-15T22:05:43.569962] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-15T22:05:43.570019] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-15T22:05:43.923914] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:44.002569] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T22:05:44.113956] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-15T22:05:44.193013] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T22:05:44.914016] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-15T22:05:45.713972] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-15T22:05:45.905424] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T22:05:45.941248] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T22:05:46.514064] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-15T22:05:47.291983] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T22:05:47.313956] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-15T22:05:47.618506] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-15T22:05:47.930713] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T22:05:48.114028] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-15T22:05:48.914013] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-15T22:05:49.136148] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-15T22:05:49.140559] [INFO ] [REMOTE ] UHS: Full fetch complete (58323 records). [2025-10-15T22:05:49.140715] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-15T22:05:49.526437] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-15T22:05:49.526543] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-15T22:05:49.527698] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-15T22:05:49.527821] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-15T22:05:49.529104] [DEBUG] [LOCAL ] UHS: Trimmed 58323 records to 40167 (keeping 200 days of data) [2025-10-15T22:05:49.649338] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T22:05:49.737502] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-15T22:05:49.809783] [DEBUG] [LOCAL ] UHS: Primary data saved (40167 records). [2025-10-15T22:05:49.809890] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-15T22:05:49.810000] [INFO ] [MAIN ] Update Progress: 2177/2369 symbols completed. UHS took 28.1s. Estimated remaining: 26m 58s. Rate: 7.1 symbols/min [2025-10-15T22:05:49.975106] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:05:50.011139] [DEBUG] [LOCAL ] ULS: Loaded 38972 existing records from primary storage. [2025-10-15T22:05:50.011408] [INFO ] [MAIN ] ULS: Loaded 38972 existing records. [2025-10-15T22:05:50.187875] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:05:50.188066] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-15T22:05:50.188130] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-15T22:05:50.188625] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-15T22:05:50.188718] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-15T22:05:50.520503] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-15T22:05:50.553244] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:05:51.019177] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T22:05:51.314022] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-15T22:05:52.114111] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-15T22:05:52.414757] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-15T22:05:52.586943] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T22:05:52.913972] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-15T22:05:52.940539] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T22:05:53.713990] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-15T22:05:54.513973] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-15T22:05:54.773761] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T22:05:54.883812] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T22:05:55.115380] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T22:05:55.314005] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-15T22:05:56.114052] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-15T22:05:56.770749] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T22:05:56.913998] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-15T22:05:57.544990] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T22:05:57.714027] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-15T22:05:58.500592] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T22:05:58.514123] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-15T22:05:59.149239] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T22:05:59.313976] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-15T22:05:59.896998] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T22:06:00.113986] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-15T22:06:00.913998] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-15T22:06:01.419900] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T22:06:01.714024] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-15T22:06:01.825351] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T22:06:02.071851] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T22:06:02.514043] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-15T22:06:03.313986] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-15T22:06:03.424734] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T22:06:03.974678] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T22:06:04.113971] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-15T22:06:04.269894] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T22:06:04.913998] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-15T22:06:05.635804] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T22:06:05.714040] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-15T22:06:06.363380] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T22:06:06.513981] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-15T22:06:06.928720] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T22:06:07.314018] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-15T22:06:07.660207] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T22:06:08.113999] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-15T22:06:08.857028] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T22:06:08.914008] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-15T22:06:09.491966] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T22:06:09.714002] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-15T22:06:10.514019] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-15T22:06:10.671504] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T22:06:10.676040] [INFO ] [REMOTE ] UIS: Full fetch complete (52005 records). [2025-10-15T22:06:10.676163] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-15T22:06:11.090249] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T22:06:11.118069] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-15T22:06:11.118317] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-15T22:06:11.119481] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-15T22:06:11.119562] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-15T22:06:11.120602] [DEBUG] [LOCAL ] UIS: Trimmed 52005 records to 36906 (keeping 200 days of data) [2025-10-15T22:06:11.314061] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-15T22:06:11.328501] [DEBUG] [LOCAL ] UIS: Primary data saved (36906 records). [2025-10-15T22:06:11.328620] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-15T22:06:11.329123] [INFO ] [MAIN ] Update Progress: 2178/2369 symbols completed. UIS took 34.9s. Estimated remaining: 26m 51s. Rate: 7.1 symbols/min [2025-10-15T22:06:11.508824] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:11.561401] [DEBUG] [LOCAL ] UMC: Loaded 52685 existing records from primary storage. [2025-10-15T22:06:11.561735] [INFO ] [MAIN ] UMC: Loaded 52685 existing records. [2025-10-15T22:06:11.736885] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:11.737178] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-15T22:06:11.737346] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-15T22:06:11.737836] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-15T22:06:11.737892] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-15T22:06:12.112157] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:12.121474] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-15T22:06:12.137943] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T22:06:12.852560] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T22:06:12.913961] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-15T22:06:13.713964] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-15T22:06:13.930630] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T22:06:14.376752] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T22:06:14.513991] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-15T22:06:15.092243] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T22:06:15.183692] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T22:06:15.189996] [INFO ] [REMOTE ] UL: Full fetch complete (77080 records). [2025-10-15T22:06:15.190113] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-15T22:06:15.326307] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-15T22:06:15.576522] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-15T22:06:15.576606] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-15T22:06:15.577750] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-15T22:06:15.577813] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-15T22:06:15.579453] [DEBUG] [LOCAL ] UL: Trimmed 77080 records to 53078 (keeping 200 days of data) [2025-10-15T22:06:15.894783] [DEBUG] [LOCAL ] UL: Primary data saved (53078 records). [2025-10-15T22:06:15.894910] [INFO ] [MAIN ] UL: Full history saved. [2025-10-15T22:06:15.895773] [INFO ] [MAIN ] Update Progress: 2179/2369 symbols completed. UL took 32.7s. Estimated remaining: 26m 42s. Rate: 7.1 symbols/min [2025-10-15T22:06:16.063609] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:16.097754] [DEBUG] [LOCAL ] UMH: Loaded 34032 existing records from primary storage. [2025-10-15T22:06:16.098016] [INFO ] [MAIN ] UMH: Loaded 34032 existing records. [2025-10-15T22:06:16.119248] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-15T22:06:16.282621] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:16.282885] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-15T22:06:16.282953] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-15T22:06:16.283340] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-15T22:06:16.283395] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-15T22:06:16.462531] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T22:06:16.655188] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:16.914047] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-15T22:06:17.373511] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T22:06:17.378421] [INFO ] [REMOTE ] ULS: Full fetch complete (54159 records). [2025-10-15T22:06:17.378630] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-15T22:06:17.719169] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-15T22:06:17.801792] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-15T22:06:17.801993] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-15T22:06:17.803984] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-15T22:06:17.804079] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-15T22:06:17.805902] [DEBUG] [LOCAL ] ULS: Trimmed 54159 records to 38979 (keeping 200 days of data) [2025-10-15T22:06:18.062290] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T22:06:18.091767] [DEBUG] [LOCAL ] ULS: Primary data saved (38979 records). [2025-10-15T22:06:18.092010] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-15T22:06:18.092125] [INFO ] [MAIN ] Update Progress: 2180/2369 symbols completed. ULS took 28.3s. Estimated remaining: 26m 33s. Rate: 7.1 symbols/min [2025-10-15T22:06:18.264079] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:18.279666] [DEBUG] [LOCAL ] UNF: Loaded 11797 existing records from primary storage. [2025-10-15T22:06:18.279973] [INFO ] [MAIN ] UNF: Loaded 11797 existing records. [2025-10-15T22:06:18.470047] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:18.470372] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-15T22:06:18.470425] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-15T22:06:18.470635] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-15T22:06:18.470726] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-15T22:06:18.519187] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-15T22:06:18.872713] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:18.893246] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T22:06:19.314033] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-15T22:06:20.113988] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-15T22:06:20.515879] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-15T22:06:20.691345] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T22:06:20.897237] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T22:06:20.913952] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-15T22:06:21.714082] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-15T22:06:22.006928] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T22:06:22.514022] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-15T22:06:22.814858] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T22:06:23.314020] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-15T22:06:23.360380] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T22:06:24.114023] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-15T22:06:24.280734] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T22:06:24.283557] [INFO ] [REMOTE ] UI: Full fetch complete (19352 records). [2025-10-15T22:06:24.283686] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-15T22:06:24.637738] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-15T22:06:24.637815] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-15T22:06:24.638155] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-15T22:06:24.638193] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-15T22:06:24.638773] [DEBUG] [LOCAL ] UI: Trimmed 19352 records to 13975 (keeping 200 days of data) [2025-10-15T22:06:24.727435] [DEBUG] [LOCAL ] UI: Primary data saved (13975 records). [2025-10-15T22:06:24.727559] [INFO ] [MAIN ] UI: Full history saved. [2025-10-15T22:06:24.727633] [INFO ] [MAIN ] Update Progress: 2181/2369 symbols completed. UI took 50.9s. Estimated remaining: 26m 24s. Rate: 7.1 symbols/min [2025-10-15T22:06:24.895430] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:24.922077] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-15T22:06:24.939967] [DEBUG] [LOCAL ] UNFI: Loaded 42585 existing records from primary storage. [2025-10-15T22:06:24.940236] [INFO ] [MAIN ] UNFI: Loaded 42585 existing records. [2025-10-15T22:06:25.048600] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T22:06:25.126584] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:25.126785] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-15T22:06:25.126831] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-15T22:06:25.127164] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-15T22:06:25.127201] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-15T22:06:25.472854] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:25.713955] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-15T22:06:26.514020] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-15T22:06:26.685548] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T22:06:26.779548] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T22:06:27.314020] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-15T22:06:27.525379] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T22:06:28.113996] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-15T22:06:28.309110] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T22:06:28.914111] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-15T22:06:29.519908] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T22:06:29.714005] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-15T22:06:30.322990] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T22:06:30.514001] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-15T22:06:30.645238] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T22:06:31.314066] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-15T22:06:31.950469] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T22:06:32.113998] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-15T22:06:32.815618] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T22:06:32.914004] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-15T22:06:33.713999] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-15T22:06:33.982757] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T22:06:34.336984] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T22:06:34.468858] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T22:06:34.513997] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-15T22:06:34.630563] [DEBUG] [REMOTE ] UNF: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-15T22:06:34.630997] [WARN ] [REMOTE ] UNF: No data returned for month 2025-05 [2025-10-15T22:06:34.631086] [FATAL] [REMOTE ] UNF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:06:34.631207] [FATAL] [MAIN ] UNF: Failed to fetch primary data. [2025-10-15T22:06:34.631288] [WARN ] [MAIN ] UNF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:06:34.631377] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-15T22:06:34.631470] [DEBUG] [LOCAL ] UNF: No primary data file found to delete. [2025-10-15T22:06:34.631537] [INFO ] [LOCAL ] UNF: Starting deletion of derivative data. [2025-10-15T22:06:34.631763] [DEBUG] [LOCAL ] UNF: Deleted derivative data file. [2025-10-15T22:06:34.631847] [INFO ] [MAIN ] Update Progress: 2182/2369 symbols completed. UNF took 16.5s. Estimated remaining: 26m 16s. Rate: 7.1 symbols/min [2025-10-15T22:06:34.797464] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:34.847252] [DEBUG] [LOCAL ] UNH: Loaded 53811 existing records from primary storage. [2025-10-15T22:06:34.847566] [INFO ] [MAIN ] UNH: Loaded 53811 existing records. [2025-10-15T22:06:35.027696] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:35.027912] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-15T22:06:35.027960] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-15T22:06:35.028621] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-15T22:06:35.028719] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-15T22:06:35.316292] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-15T22:06:35.400736] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:36.114013] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-15T22:06:36.453361] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T22:06:36.914000] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-15T22:06:37.714002] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-15T22:06:38.414004] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T22:06:38.519047] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-15T22:06:38.536269] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T22:06:39.260205] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T22:06:39.314040] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-15T22:06:39.798800] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T22:06:40.113992] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-15T22:06:40.731485] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T22:06:40.913993] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-15T22:06:41.035679] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T22:06:41.714006] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-15T22:06:42.199957] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T22:06:42.514012] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-15T22:06:42.813286] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T22:06:43.314019] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-15T22:06:43.757954] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T22:06:44.114004] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-15T22:06:44.914004] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-15T22:06:45.274797] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T22:06:45.649044] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T22:06:45.713998] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-15T22:06:46.513988] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-15T22:06:46.697944] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T22:06:46.846983] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T22:06:47.313995] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-15T22:06:48.114026] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-15T22:06:48.615500] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T22:06:48.913976] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-15T22:06:49.172779] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T22:06:49.265012] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T22:06:49.271261] [INFO ] [REMOTE ] UNFI: Full fetch complete (59675 records). [2025-10-15T22:06:49.271374] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-15T22:06:49.655836] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-15T22:06:49.655919] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-15T22:06:49.656950] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-15T22:06:49.657014] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-15T22:06:49.658268] [DEBUG] [LOCAL ] UNFI: Trimmed 59675 records to 42628 (keeping 200 days of data) [2025-10-15T22:06:49.714868] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-15T22:06:49.909442] [DEBUG] [LOCAL ] UNFI: Primary data saved (42628 records). [2025-10-15T22:06:49.909576] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-15T22:06:49.909674] [INFO ] [MAIN ] Update Progress: 2183/2369 symbols completed. UNFI took 25.2s. Estimated remaining: 26m 8s. Rate: 7.1 symbols/min [2025-10-15T22:06:50.077965] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:50.121302] [DEBUG] [LOCAL ] UNM: Loaded 48154 existing records from primary storage. [2025-10-15T22:06:50.121777] [INFO ] [MAIN ] UNM: Loaded 48154 existing records. [2025-10-15T22:06:50.309825] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:50.321458] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-15T22:06:50.322772] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-15T22:06:50.322693] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T22:06:50.329565] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-15T22:06:50.330110] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-15T22:06:50.521568] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-15T22:06:50.714019] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:51.314046] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-15T22:06:51.945568] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-15T22:06:52.113969] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-15T22:06:52.190587] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T22:06:52.196897] [INFO ] [REMOTE ] UMC: Full fetch complete (76675 records). [2025-10-15T22:06:52.197008] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-15T22:06:52.585245] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-15T22:06:52.585341] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-15T22:06:52.586586] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-15T22:06:52.586710] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-15T22:06:52.588227] [DEBUG] [LOCAL ] UMC: Trimmed 76675 records to 52686 (keeping 200 days of data) [2025-10-15T22:06:52.696091] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T22:06:52.916290] [DEBUG] [LOCAL ] UMC: Primary data saved (52686 records). [2025-10-15T22:06:52.916386] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-15T22:06:52.917294] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-15T22:06:52.917561] [INFO ] [MAIN ] Update Progress: 2184/2369 symbols completed. UMC took 41.6s. Estimated remaining: 25m 59s. Rate: 7.1 symbols/min [2025-10-15T22:06:53.083568] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:06:53.090270] [DEBUG] [LOCAL ] UNMA: Loaded 3529 existing records from primary storage. [2025-10-15T22:06:53.090477] [INFO ] [MAIN ] UNMA: Loaded 3529 existing records. [2025-10-15T22:06:53.261502] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:06:53.261685] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-15T22:06:53.261744] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-15T22:06:53.261911] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-15T22:06:53.261965] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-15T22:06:53.605212] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:06:53.713985] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-15T22:06:54.273873] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T22:06:54.363764] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-15T22:06:54.514029] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-15T22:06:54.545110] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T22:06:54.882569] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T22:06:55.314007] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-15T22:06:56.114009] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-15T22:06:56.524010] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T22:06:56.695797] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T22:06:56.914012] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-15T22:06:57.714012] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-15T22:06:58.055151] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T22:06:58.513995] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-15T22:06:59.314022] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-15T22:06:59.626433] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-15T22:06:59.886724] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T22:07:00.114006] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-15T22:07:00.733453] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T22:07:00.914099] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-15T22:07:01.714006] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-15T22:07:02.095814] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T22:07:02.519153] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-15T22:07:02.537679] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T22:07:03.057976] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T22:07:03.071152] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T22:07:03.075778] [INFO ] [REMOTE ] UMH: Full fetch complete (47058 records). [2025-10-15T22:07:03.075858] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-15T22:07:03.319377] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-15T22:07:03.450166] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-15T22:07:03.450249] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-15T22:07:03.451333] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-15T22:07:03.451396] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-15T22:07:03.452406] [DEBUG] [LOCAL ] UMH: Trimmed 47058 records to 34142 (keeping 200 days of data) [2025-10-15T22:07:03.657620] [DEBUG] [LOCAL ] UMH: Primary data saved (34142 records). [2025-10-15T22:07:03.657778] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-15T22:07:03.657862] [INFO ] [MAIN ] Update Progress: 2185/2369 symbols completed. UMH took 47.8s. Estimated remaining: 25m 51s. Rate: 7.1 symbols/min [2025-10-15T22:07:03.826581] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:03.878935] [DEBUG] [LOCAL ] UNP: Loaded 53343 existing records from primary storage. [2025-10-15T22:07:03.879256] [INFO ] [MAIN ] UNP: Loaded 53343 existing records. [2025-10-15T22:07:03.925181] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T22:07:04.072559] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:04.072789] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-15T22:07:04.072840] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-15T22:07:04.073324] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-15T22:07:04.073380] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-15T22:07:04.123877] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-15T22:07:04.442025] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:04.914072] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-15T22:07:05.713981] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-15T22:07:06.514363] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-15T22:07:06.519797] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T22:07:06.746677] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-15T22:07:07.110137] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T22:07:07.314038] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-15T22:07:07.532953] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T22:07:07.828217] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T22:07:08.114035] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-15T22:07:08.914018] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-15T22:07:09.713991] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-15T22:07:10.247959] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T22:07:10.513980] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-15T22:07:10.563564] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-15T22:07:11.057020] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T22:07:11.314035] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-15T22:07:11.569187] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T22:07:12.114011] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-15T22:07:12.914086] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-15T22:07:13.691191] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T22:07:13.713949] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-15T22:07:13.838145] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-15T22:07:14.211410] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T22:07:14.513997] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-15T22:07:14.819983] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-15T22:07:15.259826] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T22:07:15.313975] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-15T22:07:16.114000] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-15T22:07:16.395562] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-15T22:07:16.401990] [INFO ] [REMOTE ] UNH: Full fetch complete (77959 records). [2025-10-15T22:07:16.402123] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-15T22:07:16.806236] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-15T22:07:16.806411] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-15T22:07:16.807750] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-15T22:07:16.807817] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-15T22:07:16.809834] [DEBUG] [LOCAL ] UNH: Trimmed 77959 records to 53818 (keeping 200 days of data) [2025-10-15T22:07:16.914312] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-15T22:07:17.066940] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T22:07:17.194952] [DEBUG] [LOCAL ] UNH: Primary data saved (53818 records). [2025-10-15T22:07:17.195089] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-15T22:07:17.195905] [INFO ] [MAIN ] Update Progress: 2186/2369 symbols completed. UNH took 42.6s. Estimated remaining: 25m 43s. Rate: 7.1 symbols/min [2025-10-15T22:07:17.363349] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:17.407973] [DEBUG] [LOCAL ] UP: Loaded 44064 existing records from primary storage. [2025-10-15T22:07:17.408269] [INFO ] [MAIN ] UP: Loaded 44064 existing records. [2025-10-15T22:07:17.580621] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:17.580830] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-15T22:07:17.580876] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-15T22:07:17.581287] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-15T22:07:17.581342] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-15T22:07:17.719089] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-15T22:07:17.937076] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:18.437059] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T22:07:18.514042] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-15T22:07:19.313982] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-15T22:07:19.539630] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T22:07:20.114024] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-15T22:07:20.168179] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T22:07:20.914007] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-15T22:07:20.980245] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T22:07:21.622080] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T22:07:21.714081] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-15T22:07:22.046690] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T22:07:22.047782] [INFO ] [REMOTE ] UNMA: Full fetch complete (5630 records). [2025-10-15T22:07:22.047864] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-15T22:07:22.331336] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T22:07:22.396556] [INFO ] [REMOTE ] UNM: Full fetch complete (69972 records). [2025-10-15T22:07:22.396801] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-15T22:07:22.528958] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-15T22:07:22.587774] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-15T22:07:22.588344] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-15T22:07:22.594042] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-15T22:07:22.599300] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-15T22:07:22.610306] [DEBUG] [LOCAL ] UNMA: Trimmed 5630 records to 3499 (keeping 200 days of data) [2025-10-15T22:07:22.811073] [DEBUG] [LOCAL ] UNMA: Primary data saved (3499 records). [2025-10-15T22:07:22.826866] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-15T22:07:22.837291] [INFO ] [MAIN ] Update Progress: 2187/2369 symbols completed. UNMA took 29.9s. Estimated remaining: 25m 34s. Rate: 7.1 symbols/min [2025-10-15T22:07:23.010168] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-15T22:07:23.010535] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-15T22:07:23.011699] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-15T22:07:23.011776] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-15T22:07:23.066385] [DEBUG] [LOCAL ] UNM: Trimmed 69972 records to 48146 (keeping 200 days of data) [2025-10-15T22:07:23.084133] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:23.299867] [DEBUG] [LOCAL ] UPS: Loaded 53719 existing records from primary storage. [2025-10-15T22:07:23.325129] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-15T22:07:23.331422] [INFO ] [MAIN ] UPS: Loaded 53719 existing records. [2025-10-15T22:07:23.529589] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:23.534467] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-15T22:07:23.535373] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-15T22:07:23.536308] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-15T22:07:23.536696] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-15T22:07:23.870564] [DEBUG] [LOCAL ] UNM: Primary data saved (48146 records). [2025-10-15T22:07:23.878554] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-15T22:07:23.882232] [INFO ] [MAIN ] Update Progress: 2188/2369 symbols completed. UNM took 34.0s. Estimated remaining: 25m 25s. Rate: 7.1 symbols/min [2025-10-15T22:07:24.062275] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:24.114096] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-15T22:07:24.116055] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T22:07:24.169213] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:24.202000] [DEBUG] [LOCAL ] URI: Loaded 34814 existing records from primary storage. [2025-10-15T22:07:24.202273] [INFO ] [MAIN ] URI: Loaded 34814 existing records. [2025-10-15T22:07:24.379855] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:24.380050] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-15T22:07:24.380099] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-15T22:07:24.380470] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-15T22:07:24.380527] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-15T22:07:24.731243] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:24.913962] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-15T22:07:24.981248] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:07:25.714056] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-15T22:07:26.036165] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T22:07:26.334714] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-15T22:07:26.514016] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-15T22:07:27.294078] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T22:07:27.313970] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-15T22:07:27.617184] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T22:07:28.114040] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-15T22:07:28.913971] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-15T22:07:29.248345] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T22:07:29.714049] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-15T22:07:30.014459] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T22:07:30.043331] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T22:07:30.050202] [INFO ] [REMOTE ] UNP: Full fetch complete (77089 records). [2025-10-15T22:07:30.050366] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-15T22:07:30.446710] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-15T22:07:30.446878] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-15T22:07:30.448076] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-15T22:07:30.448140] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-15T22:07:30.449681] [DEBUG] [LOCAL ] UNP: Trimmed 77089 records to 53328 (keeping 200 days of data) [2025-10-15T22:07:30.538805] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-15T22:07:30.598785] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T22:07:30.826197] [DEBUG] [LOCAL ] UNP: Primary data saved (53328 records). [2025-10-15T22:07:30.826395] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-15T22:07:30.827412] [INFO ] [MAIN ] Update Progress: 2189/2369 symbols completed. UNP took 27.2s. Estimated remaining: 25m 17s. Rate: 7.1 symbols/min [2025-10-15T22:07:31.003578] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:31.041604] [DEBUG] [LOCAL ] USA: Loaded 36330 existing records from primary storage. [2025-10-15T22:07:31.041925] [INFO ] [MAIN ] USA: Loaded 36330 existing records. [2025-10-15T22:07:31.225135] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:31.225382] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-15T22:07:31.225429] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-15T22:07:31.225962] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-15T22:07:31.226022] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-15T22:07:31.321888] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-15T22:07:31.589131] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:32.114017] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-15T22:07:32.152811] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T22:07:32.548683] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T22:07:32.913986] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-15T22:07:33.097144] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T22:07:33.714086] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-15T22:07:34.506921] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T22:07:34.515572] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-15T22:07:34.864575] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T22:07:35.314006] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-15T22:07:36.114024] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-15T22:07:36.342989] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T22:07:36.827892] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T22:07:36.914014] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-15T22:07:37.366930] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T22:07:37.714000] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-15T22:07:38.514007] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-15T22:07:38.769404] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T22:07:39.223955] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T22:07:39.314049] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-15T22:07:39.814363] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T22:07:40.114005] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-15T22:07:40.914013] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-15T22:07:41.609928] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-15T22:07:41.707377] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T22:07:41.714743] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-15T22:07:42.369354] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T22:07:42.514008] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-15T22:07:43.314011] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-15T22:07:43.614616] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T22:07:43.791368] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T22:07:44.114071] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-15T22:07:44.883811] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T22:07:44.913972] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-15T22:07:45.311195] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T22:07:45.713997] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-15T22:07:46.059573] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T22:07:46.514013] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-15T22:07:47.314029] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-15T22:07:47.581324] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T22:07:48.057298] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T22:07:48.113989] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-15T22:07:48.256996] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T22:07:48.914009] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-15T22:07:49.713971] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-15T22:07:49.875683] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T22:07:50.199871] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T22:07:50.514012] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-15T22:07:51.314009] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-15T22:07:51.896834] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T22:07:52.017318] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-15T22:07:52.113961] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-15T22:07:52.913994] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-15T22:07:53.424780] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-15T22:07:53.713992] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-15T22:07:54.213998] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T22:07:54.400418] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T22:07:54.513991] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-15T22:07:55.239593] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T22:07:55.245766] [INFO ] [REMOTE ] UP: Full fetch complete (62934 records). [2025-10-15T22:07:55.245897] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-15T22:07:55.320683] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-15T22:07:55.635967] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-15T22:07:55.636059] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-15T22:07:55.637145] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-15T22:07:55.637213] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-15T22:07:55.638609] [DEBUG] [LOCAL ] UP: Trimmed 62934 records to 44181 (keeping 200 days of data) [2025-10-15T22:07:55.887299] [DEBUG] [LOCAL ] UP: Primary data saved (44181 records). [2025-10-15T22:07:55.887435] [INFO ] [MAIN ] UP: Full history saved. [2025-10-15T22:07:55.887516] [INFO ] [MAIN ] Update Progress: 2190/2369 symbols completed. UP took 38.7s. Estimated remaining: 25m 10s. Rate: 7.1 symbols/min [2025-10-15T22:07:56.055260] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:56.076430] [DEBUG] [LOCAL ] USAC: Loaded 21622 existing records from primary storage. [2025-10-15T22:07:56.076718] [INFO ] [MAIN ] USAC: Loaded 21622 existing records. [2025-10-15T22:07:56.119121] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-15T22:07:56.262021] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:56.262301] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-15T22:07:56.262360] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-15T22:07:56.262693] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-15T22:07:56.262756] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-15T22:07:56.616798] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:56.825219] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T22:07:56.919081] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-15T22:07:56.939897] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-15T22:07:57.085596] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T22:07:57.091604] [INFO ] [REMOTE ] USA: Full fetch complete (52442 records). [2025-10-15T22:07:57.091884] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-15T22:07:57.469397] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-15T22:07:57.469478] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-15T22:07:57.470460] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-15T22:07:57.470544] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-15T22:07:57.471672] [DEBUG] [LOCAL ] USA: Trimmed 52442 records to 36382 (keeping 200 days of data) [2025-10-15T22:07:57.680783] [DEBUG] [LOCAL ] USA: Primary data saved (36382 records). [2025-10-15T22:07:57.680922] [INFO ] [MAIN ] USA: Full history saved. [2025-10-15T22:07:57.681028] [INFO ] [MAIN ] Update Progress: 2191/2369 symbols completed. USA took 26.9s. Estimated remaining: 25m 1s. Rate: 7.1 symbols/min [2025-10-15T22:07:57.719508] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-15T22:07:57.856057] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:07:57.870208] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T22:07:57.926724] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-15T22:07:57.927071] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-15T22:07:58.110254] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:07:58.110505] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-15T22:07:58.110554] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-15T22:07:58.111045] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-15T22:07:58.111101] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-15T22:07:58.450377] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:07:58.514016] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-15T22:07:58.741323] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T22:07:59.313991] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-15T22:08:00.113987] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-15T22:08:00.250599] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T22:08:00.338583] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T22:08:00.914025] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-15T22:08:00.959948] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T22:08:01.714021] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-15T22:08:02.391612] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T22:08:02.395818] [INFO ] [REMOTE ] URI: Full fetch complete (52880 records). [2025-10-15T22:08:02.395946] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-15T22:08:02.516042] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-15T22:08:02.778457] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-15T22:08:02.778569] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-15T22:08:02.779694] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-15T22:08:02.793063] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-15T22:08:02.813012] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T22:08:02.823051] [DEBUG] [LOCAL ] URI: Trimmed 52880 records to 34764 (keeping 200 days of data) [2025-10-15T22:08:03.038044] [DEBUG] [LOCAL ] URI: Primary data saved (34764 records). [2025-10-15T22:08:03.038145] [INFO ] [MAIN ] URI: Full history saved. [2025-10-15T22:08:03.038222] [INFO ] [MAIN ] Update Progress: 2192/2369 symbols completed. URI took 39.2s. Estimated remaining: 24m 52s. Rate: 7.1 symbols/min [2025-10-15T22:08:03.207599] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:08:03.256210] [DEBUG] [LOCAL ] USFD: Loaded 51148 existing records from primary storage. [2025-10-15T22:08:03.256521] [INFO ] [MAIN ] USFD: Loaded 51148 existing records. [2025-10-15T22:08:03.319136] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-15T22:08:03.431079] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:08:03.431269] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-15T22:08:03.431315] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-15T22:08:03.431849] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-15T22:08:03.431912] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-15T22:08:03.781699] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:08:03.977783] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T22:08:04.034629] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T22:08:04.040909] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-15T22:08:04.041021] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-15T22:08:04.119068] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-15T22:08:04.434800] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-15T22:08:04.434925] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-15T22:08:04.436196] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-15T22:08:04.436259] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-15T22:08:04.437843] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 53719 (keeping 200 days of data) [2025-10-15T22:08:04.779934] [DEBUG] [LOCAL ] UPS: Primary data saved (53719 records). [2025-10-15T22:08:04.780083] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-15T22:08:04.780474] [INFO ] [MAIN ] Update Progress: 2193/2369 symbols completed. UPS took 41.9s. Estimated remaining: 24m 43s. Rate: 7.1 symbols/min [2025-10-15T22:08:04.923168] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-15T22:08:04.948208] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:08:04.970636] [DEBUG] [LOCAL ] USNA: Loaded 17888 existing records from primary storage. [2025-10-15T22:08:04.970919] [INFO ] [MAIN ] USNA: Loaded 17888 existing records. [2025-10-15T22:08:05.152410] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:08:05.152779] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-15T22:08:05.152852] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-15T22:08:05.158672] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-15T22:08:05.168363] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-15T22:08:05.200298] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T22:08:05.522699] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:08:05.713971] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-15T22:08:06.514027] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-15T22:08:06.629223] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T22:08:06.736560] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T22:08:07.314056] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-15T22:08:07.695319] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T22:08:08.114037] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-15T22:08:08.880428] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T22:08:08.913996] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-15T22:08:09.175395] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T22:08:09.602340] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T22:08:09.714040] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-15T22:08:10.514048] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-15T22:08:10.876218] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T22:08:11.314053] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-15T22:08:11.836947] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T22:08:12.113974] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-15T22:08:12.510827] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T22:08:12.914017] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-15T22:08:13.714056] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-15T22:08:13.834146] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T22:08:14.230525] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T22:08:14.368751] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T22:08:14.514026] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-15T22:08:15.314024] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-15T22:08:15.432472] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T22:08:16.114036] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-15T22:08:16.896416] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T22:08:16.913950] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-15T22:08:17.147280] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T22:08:17.714055] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-15T22:08:18.514058] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-15T22:08:18.600230] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T22:08:19.313977] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-15T22:08:19.348336] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T22:08:19.473742] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T22:08:20.114032] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-15T22:08:20.696503] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T22:08:20.914009] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-15T22:08:21.125812] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T22:08:21.128484] [INFO ] [REMOTE ] USAC: Full fetch complete (35087 records). [2025-10-15T22:08:21.128562] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-15T22:08:21.508661] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-15T22:08:21.508762] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-15T22:08:21.509475] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-15T22:08:21.509518] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-15T22:08:21.510325] [DEBUG] [LOCAL ] USAC: Trimmed 35087 records to 21665 (keeping 200 days of data) [2025-10-15T22:08:21.654927] [DEBUG] [LOCAL ] USAC: Primary data saved (21665 records). [2025-10-15T22:08:21.655060] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-15T22:08:21.655146] [INFO ] [MAIN ] Update Progress: 2194/2369 symbols completed. USAC took 25.8s. Estimated remaining: 24m 35s. Rate: 7.1 symbols/min [2025-10-15T22:08:21.719177] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-15T22:08:21.831788] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:08:21.850367] [DEBUG] [LOCAL ] USPH: Loaded 17120 existing records from primary storage. [2025-10-15T22:08:21.850625] [INFO ] [MAIN ] USPH: Loaded 17120 existing records. [2025-10-15T22:08:22.026251] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:08:22.026423] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-15T22:08:22.026498] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-15T22:08:22.026775] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-15T22:08:22.026837] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-15T22:08:22.383670] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:08:22.476233] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T22:08:22.513958] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-15T22:08:23.011797] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T22:08:23.314118] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-15T22:08:24.119499] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-15T22:08:24.125567] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T22:08:24.564762] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T22:08:24.914014] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-15T22:08:25.172032] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T22:08:25.714078] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-15T22:08:26.513992] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-15T22:08:26.624035] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T22:08:26.728721] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T22:08:27.313976] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-15T22:08:28.114014] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-15T22:08:28.451093] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T22:08:28.503431] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T22:08:28.914018] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-15T22:08:29.478837] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T22:08:29.681431] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T22:08:29.713983] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-15T22:08:30.386864] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T22:08:30.514003] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-15T22:08:31.175885] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T22:08:31.313998] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-15T22:08:32.113990] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-15T22:08:32.831761] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T22:08:32.837749] [INFO ] [REMOTE ] USFD: Full fetch complete (74209 records). [2025-10-15T22:08:32.837891] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-15T22:08:32.919114] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-15T22:08:33.223623] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-15T22:08:33.223746] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-15T22:08:33.224893] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-15T22:08:33.224955] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-15T22:08:33.226450] [DEBUG] [LOCAL ] USFD: Trimmed 74209 records to 51183 (keeping 200 days of data) [2025-10-15T22:08:33.532914] [DEBUG] [LOCAL ] USFD: Primary data saved (51183 records). [2025-10-15T22:08:33.533052] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-15T22:08:33.533131] [INFO ] [MAIN ] Update Progress: 2195/2369 symbols completed. USFD took 30.5s. Estimated remaining: 24m 27s. Rate: 7.1 symbols/min [2025-10-15T22:08:33.698589] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:08:33.715751] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-15T22:08:33.728887] [DEBUG] [LOCAL ] UTF: Loaded 30753 existing records from primary storage. [2025-10-15T22:08:33.729134] [INFO ] [MAIN ] UTF: Loaded 30753 existing records. [2025-10-15T22:08:33.912980] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:08:33.913315] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-15T22:08:33.913382] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-15T22:08:33.913887] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-15T22:08:33.913977] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-15T22:08:34.346904] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:08:34.347726] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T22:08:34.355570] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-15T22:08:34.513959] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-15T22:08:34.823595] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T22:08:35.313952] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-15T22:08:35.362868] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T22:08:36.114061] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-15T22:08:36.768902] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T22:08:36.801269] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T22:08:36.913951] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-15T22:08:37.193903] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-15T22:08:37.200398] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-15T22:08:37.200553] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-15T22:08:37.589313] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-15T22:08:37.589406] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-15T22:08:37.590560] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-15T22:08:37.590635] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-15T22:08:37.592170] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 53688 (keeping 200 days of data) [2025-10-15T22:08:37.715488] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-15T22:08:37.920825] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-15T22:08:37.920961] [INFO ] [MAIN ] USB: Full history saved. [2025-10-15T22:08:37.922118] [INFO ] [MAIN ] Update Progress: 2196/2369 symbols completed. USB took 40.2s. Estimated remaining: 24m 18s. Rate: 7.1 symbols/min [2025-10-15T22:08:38.086274] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:08:38.126546] [DEBUG] [LOCAL ] UTI: Loaded 40511 existing records from primary storage. [2025-10-15T22:08:38.126901] [INFO ] [MAIN ] UTI: Loaded 40511 existing records. [2025-10-15T22:08:38.309798] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:08:38.310032] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-15T22:08:38.310085] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-15T22:08:38.310765] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-15T22:08:38.310824] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-15T22:08:38.521219] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-15T22:08:38.673014] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:08:38.787976] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T22:08:39.313970] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-15T22:08:39.731693] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T22:08:40.114003] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-15T22:08:40.549101] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T22:08:40.879436] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T22:08:40.913956] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-15T22:08:41.721097] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T22:08:41.720232] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-15T22:08:42.513969] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-15T22:08:42.617489] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T22:08:43.314027] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-15T22:08:43.434112] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T22:08:44.103178] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T22:08:44.113964] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-15T22:08:44.914039] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-15T22:08:45.413806] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T22:08:45.714008] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-15T22:08:45.872004] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T22:08:46.513992] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-15T22:08:46.821074] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T22:08:47.229624] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T22:08:47.313983] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-15T22:08:48.069423] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T22:08:48.072045] [INFO ] [REMOTE ] USPH: Full fetch complete (22927 records). [2025-10-15T22:08:48.072160] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-15T22:08:48.119194] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-15T22:08:48.458758] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-15T22:08:48.458831] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-15T22:08:48.459374] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-15T22:08:48.459417] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-15T22:08:48.460145] [DEBUG] [LOCAL ] USPH: Trimmed 22927 records to 17107 (keeping 200 days of data) [2025-10-15T22:08:48.564468] [DEBUG] [LOCAL ] USPH: Primary data saved (17107 records). [2025-10-15T22:08:48.564608] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-15T22:08:48.564714] [INFO ] [MAIN ] Update Progress: 2197/2369 symbols completed. USPH took 26.9s. Estimated remaining: 24m 10s. Rate: 7.1 symbols/min [2025-10-15T22:08:48.914043] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-15T22:08:49.451670] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T22:08:49.714020] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-15T22:08:50.476177] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T22:08:50.493728] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T22:08:50.496787] [INFO ] [REMOTE ] USNA: Full fetch complete (26871 records). [2025-10-15T22:08:50.496947] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-15T22:08:50.519693] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-15T22:08:50.885179] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-15T22:08:50.885260] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-15T22:08:50.885883] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-15T22:08:50.885945] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-15T22:08:50.886677] [DEBUG] [LOCAL ] USNA: Trimmed 26871 records to 17949 (keeping 200 days of data) [2025-10-15T22:08:50.988499] [DEBUG] [LOCAL ] USNA: Primary data saved (17949 records). [2025-10-15T22:08:50.988639] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-15T22:08:50.988760] [INFO ] [MAIN ] Update Progress: 2198/2369 symbols completed. USNA took 46.2s. Estimated remaining: 24m 1s. Rate: 7.1 symbols/min [2025-10-15T22:08:51.314015] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-15T22:08:52.057362] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T22:08:52.114015] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-15T22:08:52.137435] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T22:08:52.914045] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-15T22:08:53.633040] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T22:08:53.713995] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-15T22:08:53.796376] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T22:08:54.514012] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-15T22:08:54.903288] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T22:08:55.313978] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-15T22:08:55.335013] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T22:08:56.113990] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-15T22:08:56.928181] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T22:08:56.938567] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-15T22:08:57.499776] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T22:08:57.714081] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-15T22:08:58.024038] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T22:08:58.514050] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-15T22:08:59.155116] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T22:08:59.160580] [INFO ] [REMOTE ] UTF: Full fetch complete (43326 records). [2025-10-15T22:08:59.160709] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-15T22:08:59.546256] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-15T22:08:59.546336] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-15T22:08:59.547211] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-15T22:08:59.547272] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-15T22:08:59.548234] [DEBUG] [LOCAL ] UTF: Trimmed 43326 records to 30808 (keeping 200 days of data) [2025-10-15T22:08:59.737373] [DEBUG] [LOCAL ] UTF: Primary data saved (30808 records). [2025-10-15T22:08:59.737515] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-15T22:08:59.737598] [INFO ] [MAIN ] Update Progress: 2199/2369 symbols completed. UTF took 26.2s. Estimated remaining: 23m 53s. Rate: 7.1 symbols/min [2025-10-15T22:09:00.110274] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T22:09:00.118923] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-15T22:09:01.726129] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T22:09:01.736172] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-15T22:09:03.071005] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T22:09:03.080772] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-15T22:09:04.470762] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T22:09:04.475687] [INFO ] [REMOTE ] UTI: Full fetch complete (58582 records). [2025-10-15T22:09:04.475857] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-15T22:09:04.900457] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-15T22:09:04.900545] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-15T22:09:04.901578] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-15T22:09:04.901663] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-15T22:09:04.903023] [DEBUG] [LOCAL ] UTI: Trimmed 58582 records to 40492 (keeping 200 days of data) [2025-10-15T22:09:05.167193] [DEBUG] [LOCAL ] UTI: Primary data saved (40492 records). [2025-10-15T22:09:05.167325] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-15T22:09:05.167424] [INFO ] [MAIN ] Update Progress: 2200/2369 symbols completed. UTI took 27.2s. Estimated remaining: 23m 44s. Rate: 7.1 symbols/min [2025-10-15T22:09:06.083008] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:06.073854] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:06.147073] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:06.170104] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:06.202555] [DEBUG] [LOCAL ] UTL: Loaded 11767 existing records from primary storage. [2025-10-15T22:09:06.203175] [INFO ] [MAIN ] UTL: Loaded 11767 existing records. [2025-10-15T22:09:06.261947] [DEBUG] [LOCAL ] UVE: Loaded 21951 existing records from primary storage. [2025-10-15T22:09:06.262846] [DEBUG] [LOCAL ] UVV: Loaded 22757 existing records from primary storage. [2025-10-15T22:09:06.296103] [INFO ] [MAIN ] UVE: Loaded 21951 existing records. [2025-10-15T22:09:06.327937] [INFO ] [MAIN ] UVV: Loaded 22757 existing records. [2025-10-15T22:09:06.501906] [DEBUG] [LOCAL ] UTZ: Loaded 44663 existing records from primary storage. [2025-10-15T22:09:06.608941] [INFO ] [MAIN ] UTZ: Loaded 44663 existing records. [2025-10-15T22:09:06.999724] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:07.046176] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-15T22:09:07.045838] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:07.046362] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-15T22:09:07.053867] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-15T22:09:07.058057] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:07.063938] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-15T22:09:07.063631] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-15T22:09:07.074504] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-15T22:09:07.134039] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-15T22:09:07.137237] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:07.137506] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-15T22:09:07.133693] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-15T22:09:07.137598] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-15T22:09:07.137800] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-15T22:09:07.143122] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-15T22:09:07.137763] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-15T22:09:07.176860] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-15T22:09:07.177059] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-15T22:09:07.177018] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-15T22:09:08.399223] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:08.465936] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-15T22:09:08.623161] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:08.654733] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:08.658366] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:08.658781] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-15T22:09:08.660216] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-15T22:09:08.659005] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-15T22:09:09.361421] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T22:09:09.363937] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-15T22:09:09.641953] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T22:09:09.645795] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-15T22:09:09.718718] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T22:09:09.722360] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-15T22:09:09.759156] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T22:09:09.766630] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-15T22:09:10.197821] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T22:09:10.200328] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-15T22:09:10.389765] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T22:09:10.393801] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-15T22:09:10.523288] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T22:09:10.527131] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-15T22:09:10.936878] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T22:09:10.940037] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-15T22:09:10.993997] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T22:09:11.143797] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T22:09:11.314000] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-15T22:09:11.444844] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T22:09:11.517602] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T22:09:11.969591] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T22:09:12.113999] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-15T22:09:12.701249] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T22:09:12.914004] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-15T22:09:13.714042] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-15T22:09:13.965926] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T22:09:14.513987] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-15T22:09:14.704570] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T22:09:15.314033] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-15T22:09:15.583637] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T22:09:16.114013] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-15T22:09:16.730318] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T22:09:16.902791] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T22:09:16.913948] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-15T22:09:17.713985] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-15T22:09:17.739509] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T22:09:18.514037] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-15T22:09:18.884923] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T22:09:19.313970] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-15T22:09:19.669203] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T22:09:20.113992] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-15T22:09:20.138183] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T22:09:20.913986] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-15T22:09:21.240229] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T22:09:21.713965] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-15T22:09:21.914412] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T22:09:22.514003] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-15T22:09:23.048092] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T22:09:23.233069] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T22:09:23.314026] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-15T22:09:24.114030] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-15T22:09:24.504564] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T22:09:24.914022] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-15T22:09:25.398984] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T22:09:25.714027] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-15T22:09:26.020712] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T22:09:26.514052] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-15T22:09:27.258710] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T22:09:27.313999] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-15T22:09:27.522270] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T22:09:28.113998] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-15T22:09:28.843512] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T22:09:28.913981] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-15T22:09:29.055614] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T22:09:29.713986] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-15T22:09:29.892557] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T22:09:30.514006] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-15T22:09:31.244686] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T22:09:31.313983] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-15T22:09:31.375722] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T22:09:31.377869] [INFO ] [REMOTE ] UTL: Full fetch complete (15709 records). [2025-10-15T22:09:31.377940] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-15T22:09:31.733024] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-15T22:09:31.733110] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-15T22:09:31.733470] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-15T22:09:31.733509] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-15T22:09:31.734070] [DEBUG] [LOCAL ] UTL: Trimmed 15709 records to 11800 (keeping 200 days of data) [2025-10-15T22:09:31.808068] [DEBUG] [LOCAL ] UTL: Primary data saved (11800 records). [2025-10-15T22:09:31.808217] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-15T22:09:31.808355] [INFO ] [MAIN ] Update Progress: 2201/2369 symbols completed. UTL took 26.6s. Estimated remaining: 23m 37s. Rate: 7.1 symbols/min [2025-10-15T22:09:32.004906] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:32.052275] [DEBUG] [LOCAL ] UWMC: Loaded 52937 existing records from primary storage. [2025-10-15T22:09:32.052606] [INFO ] [MAIN ] UWMC: Loaded 52937 existing records. [2025-10-15T22:09:32.119279] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-15T22:09:32.235956] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:32.236699] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-15T22:09:32.236816] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-15T22:09:32.237898] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-15T22:09:32.237981] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-15T22:09:32.382354] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T22:09:32.626207] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:32.914055] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-15T22:09:33.616362] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T22:09:33.714005] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-15T22:09:34.513987] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-15T22:09:34.673846] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T22:09:34.712138] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T22:09:34.714931] [INFO ] [REMOTE ] UVV: Full fetch complete (30097 records). [2025-10-15T22:09:34.715009] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-15T22:09:35.079186] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-15T22:09:35.079269] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-15T22:09:35.080010] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-15T22:09:35.080073] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-15T22:09:35.080849] [DEBUG] [LOCAL ] UVV: Trimmed 30097 records to 22766 (keeping 200 days of data) [2025-10-15T22:09:35.224230] [DEBUG] [LOCAL ] UVV: Primary data saved (22766 records). [2025-10-15T22:09:35.224571] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-15T22:09:35.224699] [INFO ] [MAIN ] Update Progress: 2202/2369 symbols completed. UVV took 30.1s. Estimated remaining: 23m 28s. Rate: 7.1 symbols/min [2025-10-15T22:09:35.314522] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-15T22:09:35.353427] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T22:09:35.394804] [INFO ] [REMOTE ] UVE: Full fetch complete (30243 records). [2025-10-15T22:09:35.412135] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:35.410575] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-15T22:09:35.530150] [DEBUG] [LOCAL ] UZD: Loaded 6257 existing records from primary storage. [2025-10-15T22:09:35.533814] [INFO ] [MAIN ] UZD: Loaded 6257 existing records. [2025-10-15T22:09:35.922491] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:35.928800] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-15T22:09:35.928866] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-15T22:09:35.939449] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-15T22:09:35.944676] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-15T22:09:36.125438] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-15T22:09:36.150531] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-15T22:09:36.191561] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-15T22:09:36.208865] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-15T22:09:36.217474] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-15T22:09:36.314276] [DEBUG] [LOCAL ] UVE: Trimmed 30243 records to 22014 (keeping 200 days of data) [2025-10-15T22:09:36.486131] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:36.529954] [DEBUG] [LOCAL ] UVE: Primary data saved (22014 records). [2025-10-15T22:09:36.530097] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-15T22:09:36.530182] [INFO ] [MAIN ] Update Progress: 2203/2369 symbols completed. UVE took 31.4s. Estimated remaining: 23m 19s. Rate: 7.1 symbols/min [2025-10-15T22:09:36.702280] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:36.711671] [DEBUG] [LOCAL ] UZE: Loaded 7371 existing records from primary storage. [2025-10-15T22:09:36.711896] [INFO ] [MAIN ] UZE: Loaded 7371 existing records. [2025-10-15T22:09:36.915880] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-15T22:09:36.922772] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:36.927933] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T22:09:36.928219] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-15T22:09:36.928697] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-15T22:09:36.938495] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-15T22:09:36.938890] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-15T22:09:37.304870] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:37.400828] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T22:09:37.713978] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-15T22:09:37.796994] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T22:09:38.514010] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-15T22:09:39.251327] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T22:09:39.276600] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T22:09:39.313975] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-15T22:09:40.114005] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-15T22:09:40.402108] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T22:09:40.407760] [INFO ] [REMOTE ] UTZ: Full fetch complete (64665 records). [2025-10-15T22:09:40.407885] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-15T22:09:40.823846] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-15T22:09:40.823927] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-15T22:09:40.825249] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-15T22:09:40.825315] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-15T22:09:40.826607] [DEBUG] [LOCAL ] UTZ: Trimmed 64665 records to 44602 (keeping 200 days of data) [2025-10-15T22:09:40.896190] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T22:09:40.924273] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-15T22:09:41.109356] [DEBUG] [LOCAL ] UTZ: Primary data saved (44602 records). [2025-10-15T22:09:41.109501] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-15T22:09:41.109594] [INFO ] [MAIN ] Update Progress: 2204/2369 symbols completed. UTZ took 35.9s. Estimated remaining: 23m 11s. Rate: 7.1 symbols/min [2025-10-15T22:09:41.275705] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:09:41.282423] [DEBUG] [LOCAL ] UZF: Loaded 6123 existing records from primary storage. [2025-10-15T22:09:41.282577] [INFO ] [MAIN ] UZF: Loaded 6123 existing records. [2025-10-15T22:09:41.454297] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:09:41.454482] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-15T22:09:41.454742] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-15T22:09:41.455153] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-15T22:09:41.455210] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-15T22:09:41.719169] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-15T22:09:41.801896] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:09:42.191042] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T22:09:42.514021] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-15T22:09:42.548776] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T22:09:43.164674] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T22:09:43.314048] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-15T22:09:44.114025] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-15T22:09:44.716553] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T22:09:44.716346] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T22:09:44.914002] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-15T22:09:45.713985] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-15T22:09:46.303430] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T22:09:46.513993] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-15T22:09:46.632795] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T22:09:46.927596] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T22:09:47.314008] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-15T22:09:47.667183] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T22:09:48.114001] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-15T22:09:48.747441] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T22:09:48.913980] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-15T22:09:49.642324] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T22:09:49.713992] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-15T22:09:50.114546] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-15T22:09:50.514010] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-15T22:09:51.123464] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T22:09:51.314000] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-15T22:09:51.926455] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T22:09:52.114052] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-15T22:09:52.741462] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T22:09:52.914002] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-15T22:09:53.569216] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T22:09:53.714006] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-15T22:09:54.300097] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T22:09:54.513993] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-15T22:09:55.314055] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-15T22:09:55.805563] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T22:09:55.849550] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T22:09:56.114014] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-15T22:09:56.914015] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-15T22:09:57.674356] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T22:09:57.713960] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-15T22:09:57.856408] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T22:09:58.118183] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T22:09:58.513996] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-15T22:09:59.314070] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-15T22:10:00.016603] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T22:10:00.114029] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-15T22:10:00.336623] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T22:10:00.436197] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-15T22:10:00.913985] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-15T22:10:01.314320] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T22:10:01.315259] [INFO ] [REMOTE ] UZD: Full fetch complete (9185 records). [2025-10-15T22:10:01.315347] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-15T22:10:01.672260] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-15T22:10:01.672337] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-15T22:10:01.672562] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-15T22:10:01.672600] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-15T22:10:01.673054] [DEBUG] [LOCAL ] UZD: Trimmed 9185 records to 6128 (keeping 200 days of data) [2025-10-15T22:10:01.710020] [DEBUG] [LOCAL ] UZD: Primary data saved (6128 records). [2025-10-15T22:10:01.710158] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-15T22:10:01.710284] [INFO ] [MAIN ] Update Progress: 2205/2369 symbols completed. UZD took 26.5s. Estimated remaining: 23m 3s. Rate: 7.1 symbols/min [2025-10-15T22:10:01.721477] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-15T22:10:01.884327] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:01.935004] [DEBUG] [LOCAL ] V: Loaded 53753 existing records from primary storage. [2025-10-15T22:10:01.935308] [INFO ] [MAIN ] V: Loaded 53753 existing records. [2025-10-15T22:10:02.115736] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:02.115948] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-15T22:10:02.115995] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-15T22:10:02.116854] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-15T22:10:02.116912] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-15T22:10:02.462534] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:02.513979] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-15T22:10:03.313983] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-15T22:10:03.536338] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T22:10:03.908280] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T22:10:04.114023] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-15T22:10:04.725633] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T22:10:04.726848] [INFO ] [REMOTE ] UZE: Full fetch complete (9994 records). [2025-10-15T22:10:04.726936] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-15T22:10:04.919539] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-15T22:10:04.936371] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T22:10:05.145807] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-15T22:10:05.145890] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-15T22:10:05.146151] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-15T22:10:05.146191] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-15T22:10:05.146637] [DEBUG] [LOCAL ] UZE: Trimmed 9994 records to 7273 (keeping 200 days of data) [2025-10-15T22:10:05.193141] [DEBUG] [LOCAL ] UZE: Primary data saved (7273 records). [2025-10-15T22:10:05.193275] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-15T22:10:05.193358] [INFO ] [MAIN ] Update Progress: 2206/2369 symbols completed. UZE took 28.7s. Estimated remaining: 22m 54s. Rate: 7.1 symbols/min [2025-10-15T22:10:05.367011] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:05.403734] [DEBUG] [LOCAL ] VAC: Loaded 34176 existing records from primary storage. [2025-10-15T22:10:05.404050] [INFO ] [MAIN ] VAC: Loaded 34176 existing records. [2025-10-15T22:10:05.580517] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:05.580750] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-15T22:10:05.580802] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-15T22:10:05.581149] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-15T22:10:05.581204] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-15T22:10:05.719137] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-15T22:10:05.939061] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:06.382423] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T22:10:06.514015] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-15T22:10:06.938196] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T22:10:07.314072] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-15T22:10:07.657483] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T22:10:08.064007] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T22:10:08.114008] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-15T22:10:08.914011] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-15T22:10:09.527349] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T22:10:09.667156] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T22:10:09.673476] [INFO ] [REMOTE ] UWMC: Full fetch complete (75874 records). [2025-10-15T22:10:09.673592] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-15T22:10:09.719124] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-15T22:10:10.077612] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-15T22:10:10.077731] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-15T22:10:10.079074] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-15T22:10:10.079144] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-15T22:10:10.080802] [DEBUG] [LOCAL ] UWMC: Trimmed 75874 records to 52955 (keeping 200 days of data) [2025-10-15T22:10:10.385680] [DEBUG] [LOCAL ] UWMC: Primary data saved (52955 records). [2025-10-15T22:10:10.385828] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-15T22:10:10.385921] [INFO ] [MAIN ] Update Progress: 2207/2369 symbols completed. UWMC took 38.6s. Estimated remaining: 22m 46s. Rate: 7.1 symbols/min [2025-10-15T22:10:10.506822] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T22:10:10.531290] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-15T22:10:10.563619] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:10.613496] [DEBUG] [LOCAL ] VAL: Loaded 50194 existing records from primary storage. [2025-10-15T22:10:10.613845] [INFO ] [MAIN ] VAL: Loaded 50194 existing records. [2025-10-15T22:10:10.787604] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:10.787857] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-15T22:10:10.787903] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-15T22:10:10.788301] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-15T22:10:10.788356] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-15T22:10:11.135408] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:11.314004] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-15T22:10:11.650695] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T22:10:12.114018] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-15T22:10:12.913961] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-15T22:10:12.936720] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T22:10:13.425697] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T22:10:13.429337] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T22:10:13.714020] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-15T22:10:14.514032] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-15T22:10:14.613229] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T22:10:15.235625] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T22:10:15.314070] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-15T22:10:15.676569] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-15T22:10:16.114059] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-15T22:10:16.914005] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-15T22:10:17.414632] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T22:10:17.415615] [INFO ] [REMOTE ] UZF: Full fetch complete (8684 records). [2025-10-15T22:10:17.415721] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-15T22:10:17.626227] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T22:10:17.719200] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-15T22:10:17.815451] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-15T22:10:17.815533] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-15T22:10:17.815782] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-15T22:10:17.815843] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-15T22:10:17.816286] [DEBUG] [LOCAL ] UZF: Trimmed 8684 records to 6082 (keeping 200 days of data) [2025-10-15T22:10:17.852888] [DEBUG] [LOCAL ] UZF: Primary data saved (6082 records). [2025-10-15T22:10:17.853027] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-15T22:10:17.853110] [INFO ] [MAIN ] Update Progress: 2208/2369 symbols completed. UZF took 36.7s. Estimated remaining: 22m 37s. Rate: 7.1 symbols/min [2025-10-15T22:10:18.019910] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:18.079152] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-15T22:10:18.079593] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-15T22:10:18.255732] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:18.255977] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-15T22:10:18.256036] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-15T22:10:18.256509] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-15T22:10:18.256563] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-15T22:10:18.519289] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-15T22:10:18.608386] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:19.291198] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T22:10:19.313976] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-15T22:10:19.640747] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T22:10:20.113989] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-15T22:10:20.914046] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-15T22:10:20.986286] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T22:10:21.714024] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-15T22:10:21.901113] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T22:10:22.513982] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-15T22:10:22.665396] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T22:10:22.875065] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T22:10:23.314046] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-15T22:10:24.114026] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-15T22:10:24.214898] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T22:10:24.914121] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-15T22:10:25.497438] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-15T22:10:25.714033] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-15T22:10:26.038523] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T22:10:26.514099] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-15T22:10:26.594825] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T22:10:27.314062] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-15T22:10:27.751733] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-15T22:10:28.114004] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-15T22:10:28.368235] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T22:10:28.562414] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T22:10:28.913992] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-15T22:10:29.713986] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-15T22:10:30.184283] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T22:10:30.294540] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T22:10:30.514003] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-15T22:10:31.313963] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-15T22:10:31.443762] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T22:10:31.445064] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T22:10:32.114002] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-15T22:10:32.914004] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-15T22:10:33.494630] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-15T22:10:33.533868] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T22:10:33.713958] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-15T22:10:34.310677] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T22:10:34.514043] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-15T22:10:35.063177] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T22:10:35.314062] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-15T22:10:35.751769] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T22:10:35.755738] [INFO ] [REMOTE ] VAC: Full fetch complete (48717 records). [2025-10-15T22:10:35.755828] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-15T22:10:36.122580] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-15T22:10:36.125634] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-15T22:10:36.126439] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-15T22:10:36.127514] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-15T22:10:36.127706] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-15T22:10:36.128889] [DEBUG] [LOCAL ] VAC: Trimmed 48717 records to 34088 (keeping 200 days of data) [2025-10-15T22:10:36.338269] [DEBUG] [LOCAL ] VAC: Primary data saved (34088 records). [2025-10-15T22:10:36.338430] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-15T22:10:36.338516] [INFO ] [MAIN ] Update Progress: 2209/2369 symbols completed. VAC took 31.1s. Estimated remaining: 22m 30s. Rate: 7.1 symbols/min [2025-10-15T22:10:36.508216] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:36.514906] [DEBUG] [LOCAL ] VATE: Loaded 5216 existing records from primary storage. [2025-10-15T22:10:36.515102] [INFO ] [MAIN ] VATE: Loaded 5216 existing records. [2025-10-15T22:10:36.695248] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:36.695485] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-15T22:10:36.695542] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-15T22:10:36.695768] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-15T22:10:36.695826] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-15T22:10:36.926294] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-15T22:10:37.041184] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:37.450126] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T22:10:37.714032] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-15T22:10:38.138994] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T22:10:38.513974] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-15T22:10:38.825044] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T22:10:39.313965] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-15T22:10:39.705486] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T22:10:40.113985] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-15T22:10:40.688096] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T22:10:40.859965] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T22:10:40.913958] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-15T22:10:41.719476] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-15T22:10:41.740334] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T22:10:42.519114] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-15T22:10:42.537988] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T22:10:42.554071] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T22:10:43.313993] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-15T22:10:44.114038] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-15T22:10:44.339226] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T22:10:44.892380] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-15T22:10:44.913956] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-15T22:10:45.385699] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T22:10:45.392346] [INFO ] [REMOTE ] V: Full fetch complete (77928 records). [2025-10-15T22:10:45.392501] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-15T22:10:45.715351] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-15T22:10:45.824283] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-15T22:10:45.824533] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-15T22:10:45.825785] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-15T22:10:45.825866] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-15T22:10:45.827443] [DEBUG] [LOCAL ] V: Trimmed 77928 records to 53753 (keeping 200 days of data) [2025-10-15T22:10:46.163305] [DEBUG] [LOCAL ] V: Primary data saved (53753 records). [2025-10-15T22:10:46.163588] [INFO ] [MAIN ] V: Full history saved. [2025-10-15T22:10:46.164569] [INFO ] [MAIN ] Update Progress: 2210/2369 symbols completed. V took 44.5s. Estimated remaining: 22m 21s. Rate: 7.1 symbols/min [2025-10-15T22:10:46.316229] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-15T22:10:46.385512] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:46.394291] [DEBUG] [LOCAL ] VBF: Loaded 7171 existing records from primary storage. [2025-10-15T22:10:46.394509] [INFO ] [MAIN ] VBF: Loaded 7171 existing records. [2025-10-15T22:10:46.521461] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-15T22:10:46.580424] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:46.580669] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-15T22:10:46.580731] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-15T22:10:46.580977] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-15T22:10:46.581033] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-15T22:10:46.930370] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:46.985999] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T22:10:46.992167] [INFO ] [REMOTE ] VAL: Full fetch complete (73217 records). [2025-10-15T22:10:46.992339] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-15T22:10:47.327004] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-15T22:10:47.391746] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-15T22:10:47.391834] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-15T22:10:47.393200] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-15T22:10:47.393308] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-15T22:10:47.395369] [DEBUG] [LOCAL ] VAL: Trimmed 73217 records to 50174 (keeping 200 days of data) [2025-10-15T22:10:47.708599] [DEBUG] [LOCAL ] VAL: Primary data saved (50174 records). [2025-10-15T22:10:47.708761] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-15T22:10:47.708852] [INFO ] [MAIN ] Update Progress: 2211/2369 symbols completed. VAL took 37.3s. Estimated remaining: 22m 12s. Rate: 7.1 symbols/min [2025-10-15T22:10:47.901996] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:47.917837] [DEBUG] [LOCAL ] VCV: Loaded 13625 existing records from primary storage. [2025-10-15T22:10:47.918125] [INFO ] [MAIN ] VCV: Loaded 13625 existing records. [2025-10-15T22:10:48.114939] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-15T22:10:48.120547] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:48.121904] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-15T22:10:48.122090] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-15T22:10:48.122477] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-15T22:10:48.122534] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-15T22:10:48.413435] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T22:10:48.477516] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-15T22:10:48.552622] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:48.605116] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-15T22:10:48.914020] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-15T22:10:49.714079] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-15T22:10:49.781102] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T22:10:50.513990] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-15T22:10:51.305139] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T22:10:51.313968] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-15T22:10:51.559819] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T22:10:51.773205] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-15T22:10:52.114011] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-15T22:10:52.913990] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-15T22:10:52.970286] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T22:10:53.518388] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T22:10:53.714030] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-15T22:10:54.513979] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-15T22:10:54.746626] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T22:10:55.314009] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-15T22:10:55.816928] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T22:10:56.114067] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-15T22:10:56.142429] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T22:10:56.149061] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-15T22:10:56.149185] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-15T22:10:56.533401] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-15T22:10:56.533480] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-15T22:10:56.534639] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-15T22:10:56.534723] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-15T22:10:56.536164] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-15T22:10:56.869269] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-15T22:10:56.869487] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-15T22:10:56.869804] [INFO ] [MAIN ] Update Progress: 2212/2369 symbols completed. VALE took 39.0s. Estimated remaining: 22m 4s. Rate: 7.1 symbols/min [2025-10-15T22:10:56.924754] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-15T22:10:57.062818] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:10:57.106731] [DEBUG] [LOCAL ] VEEV: Loaded 47276 existing records from primary storage. [2025-10-15T22:10:57.107156] [INFO ] [MAIN ] VEEV: Loaded 47276 existing records. [2025-10-15T22:10:57.250311] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T22:10:57.307873] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:10:57.308092] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-15T22:10:57.308149] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-15T22:10:57.308930] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-15T22:10:57.308987] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-15T22:10:57.424155] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-15T22:10:57.675283] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:10:57.713995] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-15T22:10:58.513976] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-15T22:10:59.218439] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T22:10:59.315417] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T22:10:59.314311] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-15T22:11:00.114019] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-15T22:11:00.895158] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T22:11:00.913948] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-15T22:11:00.943564] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T22:11:01.714011] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-15T22:11:02.427480] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T22:11:02.441588] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T22:11:02.513964] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-15T22:11:03.314018] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-15T22:11:03.896348] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T22:11:04.113986] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-15T22:11:04.228913] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T22:11:04.913988] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-15T22:11:05.063172] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T22:11:05.714043] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-15T22:11:06.143926] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T22:11:06.342314] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T22:11:06.514010] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-15T22:11:07.013629] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-15T22:11:07.314008] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-15T22:11:08.114087] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-15T22:11:08.696759] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T22:11:08.887331] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T22:11:08.914007] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-15T22:11:09.550161] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T22:11:09.714029] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-15T22:11:10.447171] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T22:11:10.514014] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-15T22:11:11.314010] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-15T22:11:11.357309] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T22:11:12.059470] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T22:11:12.114002] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-15T22:11:12.832378] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T22:11:12.833968] [INFO ] [REMOTE ] VCV: Full fetch complete (18541 records). [2025-10-15T22:11:12.834041] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-15T22:11:12.919295] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-15T22:11:13.195984] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-15T22:11:13.196062] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-15T22:11:13.196454] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-15T22:11:13.196493] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-15T22:11:13.197075] [DEBUG] [LOCAL ] VCV: Trimmed 18541 records to 13659 (keeping 200 days of data) [2025-10-15T22:11:13.277171] [DEBUG] [LOCAL ] VCV: Primary data saved (13659 records). [2025-10-15T22:11:13.277306] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-15T22:11:13.277384] [INFO ] [MAIN ] Update Progress: 2213/2369 symbols completed. VCV took 25.6s. Estimated remaining: 21m 56s. Rate: 7.1 symbols/min [2025-10-15T22:11:13.443547] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:13.456031] [DEBUG] [LOCAL ] VEL: Loaded 12210 existing records from primary storage. [2025-10-15T22:11:13.456251] [INFO ] [MAIN ] VEL: Loaded 12210 existing records. [2025-10-15T22:11:13.647449] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:11:13.647731] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-15T22:11:13.647793] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-15T22:11:13.648122] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-15T22:11:13.648196] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-15T22:11:13.723510] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-15T22:11:14.006906] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:14.474836] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T22:11:14.513955] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-15T22:11:14.699055] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T22:11:15.314034] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-15T22:11:15.330015] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T22:11:15.333049] [INFO ] [REMOTE ] VBF: Full fetch complete (10899 records). [2025-10-15T22:11:15.333141] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-15T22:11:15.704029] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-15T22:11:15.704106] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-15T22:11:15.704360] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-15T22:11:15.704399] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-15T22:11:15.704869] [DEBUG] [LOCAL ] VBF: Trimmed 10899 records to 7220 (keeping 200 days of data) [2025-10-15T22:11:15.748293] [DEBUG] [LOCAL ] VBF: Primary data saved (7220 records). [2025-10-15T22:11:15.748419] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-15T22:11:15.748496] [INFO ] [MAIN ] Update Progress: 2214/2369 symbols completed. VBF took 29.6s. Estimated remaining: 21m 47s. Rate: 7.1 symbols/min [2025-10-15T22:11:15.913935] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:15.957550] [DEBUG] [LOCAL ] VET: Loaded 44140 existing records from primary storage. [2025-10-15T22:11:15.957869] [INFO ] [MAIN ] VET: Loaded 44140 existing records. [2025-10-15T22:11:16.062498] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T22:11:16.118617] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-15T22:11:16.147275] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:11:16.147610] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-15T22:11:16.147694] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-15T22:11:16.148103] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-15T22:11:16.148161] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-15T22:11:16.490986] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:16.914033] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-15T22:11:17.453792] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T22:11:17.714011] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-15T22:11:17.967752] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T22:11:18.156009] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T22:11:18.513995] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-15T22:11:18.930231] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T22:11:19.314013] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-15T22:11:20.114091] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-15T22:11:20.914084] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-15T22:11:20.942227] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T22:11:21.703012] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T22:11:21.713945] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-15T22:11:21.793030] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:11:22.514033] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-15T22:11:22.640938] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T22:11:23.314055] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-15T22:11:24.010059] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T22:11:24.114024] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-15T22:11:24.578955] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T22:11:24.914023] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-15T22:11:25.055637] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T22:11:25.714898] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-15T22:11:25.717698] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T22:11:26.514079] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-15T22:11:27.312862] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T22:11:27.315208] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-15T22:11:27.321109] [INFO ] [REMOTE ] VEEV: Full fetch complete (68372 records). [2025-10-15T22:11:27.321364] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-15T22:11:27.728599] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-15T22:11:27.728700] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-15T22:11:27.729789] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-15T22:11:27.729850] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-15T22:11:27.731449] [DEBUG] [LOCAL ] VEEV: Trimmed 68372 records to 47309 (keeping 200 days of data) [2025-10-15T22:11:27.987681] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T22:11:28.045465] [DEBUG] [LOCAL ] VEEV: Primary data saved (47309 records). [2025-10-15T22:11:28.045700] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-15T22:11:28.046023] [INFO ] [MAIN ] Update Progress: 2215/2369 symbols completed. VEEV took 31.2s. Estimated remaining: 21m 39s. Rate: 7.1 symbols/min [2025-10-15T22:11:28.119086] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-15T22:11:28.214239] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:28.267891] [DEBUG] [LOCAL ] VFC: Loaded 53605 existing records from primary storage. [2025-10-15T22:11:28.268419] [INFO ] [MAIN ] VFC: Loaded 53605 existing records. [2025-10-15T22:11:28.339782] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T22:11:28.455174] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:11:28.455379] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-15T22:11:28.455426] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-15T22:11:28.456049] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-15T22:11:28.456107] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-15T22:11:28.813773] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T22:11:28.813507] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:28.914026] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-15T22:11:29.442824] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T22:11:29.443981] [INFO ] [REMOTE ] VATE: Full fetch complete (10567 records). [2025-10-15T22:11:29.444053] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-15T22:11:29.719103] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-15T22:11:29.822429] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-15T22:11:29.822502] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-15T22:11:29.822799] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-15T22:11:29.822860] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-15T22:11:29.823273] [DEBUG] [LOCAL ] VATE: Trimmed 10567 records to 5215 (keeping 200 days of data) [2025-10-15T22:11:29.852143] [DEBUG] [LOCAL ] VATE: Primary data saved (5215 records). [2025-10-15T22:11:29.852259] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-15T22:11:29.852366] [INFO ] [MAIN ] Update Progress: 2216/2369 symbols completed. VATE took 53.5s. Estimated remaining: 21m 30s. Rate: 7.1 symbols/min [2025-10-15T22:11:30.022273] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:30.022434] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-15T22:11:30.022473] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-15T22:11:30.022582] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-15T22:11:30.022626] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-15T22:11:30.022707] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-15T22:11:30.022751] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-15T22:11:30.449282] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:30.513988] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-15T22:11:30.629514] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T22:11:30.716322] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:11:30.716630] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-15T22:11:30.716775] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:11:30.716869] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-15T22:11:30.716953] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:11:30.717048] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-15T22:11:30.717127] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-15T22:11:30.717166] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-15T22:11:30.717207] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-15T22:11:30.717253] [INFO ] [MAIN ] Update Progress: 2217/2369 symbols completed. VG took 0.9s. Estimated remaining: 21m 21s. Rate: 7.1 symbols/min [2025-10-15T22:11:30.889862] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:30.896243] [DEBUG] [LOCAL ] VGI: Loaded 5203 existing records from primary storage. [2025-10-15T22:11:30.896462] [INFO ] [MAIN ] VGI: Loaded 5203 existing records. [2025-10-15T22:11:31.075678] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:11:31.075923] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-15T22:11:31.076030] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-15T22:11:31.076190] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-15T22:11:31.076230] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-15T22:11:31.320811] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-15T22:11:31.440536] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:32.114044] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-15T22:11:32.142993] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T22:11:32.914063] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-15T22:11:33.307424] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-15T22:11:33.714004] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-15T22:11:33.977992] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T22:11:34.372248] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T22:11:34.514004] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-15T22:11:35.073721] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T22:11:35.314002] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-15T22:11:36.114002] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-15T22:11:36.914003] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-15T22:11:37.034164] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T22:11:37.425470] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T22:11:37.616743] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T22:11:37.713976] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-15T22:11:38.414920] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T22:11:38.417008] [INFO ] [REMOTE ] VEL: Full fetch complete (17163 records). [2025-10-15T22:11:38.417107] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-15T22:11:38.519336] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-15T22:11:38.832881] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-15T22:11:38.833016] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-15T22:11:38.833536] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-15T22:11:38.833599] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-15T22:11:38.834209] [DEBUG] [LOCAL ] VEL: Trimmed 17163 records to 12188 (keeping 200 days of data) [2025-10-15T22:11:38.915156] [DEBUG] [LOCAL ] VEL: Primary data saved (12188 records). [2025-10-15T22:11:38.915337] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-15T22:11:38.915447] [INFO ] [MAIN ] Update Progress: 2218/2369 symbols completed. VEL took 25.6s. Estimated remaining: 21m 13s. Rate: 7.1 symbols/min [2025-10-15T22:11:39.105854] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:39.126072] [DEBUG] [LOCAL ] VGM: Loaded 18483 existing records from primary storage. [2025-10-15T22:11:39.126358] [INFO ] [MAIN ] VGM: Loaded 18483 existing records. [2025-10-15T22:11:39.323460] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-15T22:11:39.330445] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:11:39.330797] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-15T22:11:39.331464] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-15T22:11:39.331814] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-15T22:11:39.331873] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-15T22:11:39.726509] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:40.119342] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-15T22:11:40.125411] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T22:11:40.732735] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T22:11:40.913982] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-15T22:11:41.097041] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T22:11:41.586621] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T22:11:41.714002] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-15T22:11:42.309282] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T22:11:42.513999] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-15T22:11:43.314037] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-15T22:11:44.114032] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-15T22:11:44.486387] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T22:11:44.564972] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T22:11:44.914025] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-15T22:11:44.949557] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T22:11:45.713973] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-15T22:11:45.741043] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T22:11:46.514040] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-15T22:11:47.269263] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T22:11:47.313958] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-15T22:11:47.395989] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T22:11:48.113991] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-15T22:11:48.887576] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T22:11:48.913992] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-15T22:11:49.488434] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T22:11:49.714021] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-15T22:11:49.951521] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T22:11:50.318168] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T22:11:50.513994] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-15T22:11:51.314049] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-15T22:11:51.985122] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T22:11:52.113956] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-15T22:11:52.913976] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-15T22:11:53.290097] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T22:11:53.601272] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T22:11:53.714037] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-15T22:11:53.900461] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T22:11:54.074636] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T22:11:54.514044] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-15T22:11:55.118529] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T22:11:55.314001] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-15T22:11:56.114011] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-15T22:11:56.766909] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T22:11:56.913972] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-15T22:11:57.109243] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-15T22:11:57.569905] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T22:11:57.714037] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-15T22:11:58.202830] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T22:11:58.203919] [INFO ] [REMOTE ] VGI: Full fetch complete (7665 records). [2025-10-15T22:11:58.203986] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-15T22:11:58.519143] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-15T22:11:58.555492] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-15T22:11:58.555576] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-15T22:11:58.555795] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-15T22:11:58.555854] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-15T22:11:58.556233] [DEBUG] [LOCAL ] VGI: Trimmed 7665 records to 5204 (keeping 200 days of data) [2025-10-15T22:11:58.585826] [DEBUG] [LOCAL ] VGI: Primary data saved (5204 records). [2025-10-15T22:11:58.585903] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-15T22:11:58.586003] [INFO ] [MAIN ] Update Progress: 2219/2369 symbols completed. VGI took 27.9s. Estimated remaining: 21m 5s. Rate: 7.1 symbols/min [2025-10-15T22:11:58.754591] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:11:58.758911] [DEBUG] [LOCAL ] VHI: Loaded 2770 existing records from primary storage. [2025-10-15T22:11:58.759075] [INFO ] [MAIN ] VHI: Loaded 2770 existing records. [2025-10-15T22:11:58.948284] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:11:58.948493] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-15T22:11:58.948540] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-15T22:11:58.948897] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-15T22:11:58.948953] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-15T22:11:59.304396] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:11:59.313961] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-15T22:11:59.579905] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T22:11:59.585497] [INFO ] [REMOTE ] VET: Full fetch complete (64634 records). [2025-10-15T22:11:59.585620] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-15T22:11:59.976154] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-15T22:11:59.976778] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-15T22:11:59.978329] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-15T22:11:59.976985] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T22:11:59.978496] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-15T22:11:59.981744] [DEBUG] [LOCAL ] VET: Trimmed 64634 records to 44112 (keeping 200 days of data) [2025-10-15T22:12:00.157462] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-15T22:12:00.299751] [DEBUG] [LOCAL ] VET: Primary data saved (44112 records). [2025-10-15T22:12:00.299918] [INFO ] [MAIN ] VET: Full history saved. [2025-10-15T22:12:00.300950] [INFO ] [MAIN ] Update Progress: 2220/2369 symbols completed. VET took 44.6s. Estimated remaining: 20m 56s. Rate: 7.1 symbols/min [2025-10-15T22:12:00.500055] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:00.500240] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-15T22:12:00.500283] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-15T22:12:00.500434] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-15T22:12:00.500503] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-15T22:12:00.500561] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-15T22:12:00.500600] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-15T22:12:00.919234] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-15T22:12:01.036892] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:01.091195] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T22:12:01.714022] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-15T22:12:02.369941] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T22:12:02.490601] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T22:12:02.513967] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-15T22:12:03.314007] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-15T22:12:03.588245] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T22:12:04.114063] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-15T22:12:04.764743] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T22:12:04.893237] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T22:12:04.914006] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-15T22:12:05.288732] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T22:12:05.714021] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-15T22:12:06.514058] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-15T22:12:06.707794] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T22:12:07.314007] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-15T22:12:08.113998] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-15T22:12:08.415975] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:12:08.416355] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-15T22:12:08.416440] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:12:08.416505] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-15T22:12:08.416569] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:12:08.416671] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-15T22:12:08.416886] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-15T22:12:08.416998] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-15T22:12:08.417145] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-15T22:12:08.417283] [INFO ] [MAIN ] Update Progress: 2221/2369 symbols completed. VIA took 8.1s. Estimated remaining: 20m 48s. Rate: 7.1 symbols/min [2025-10-15T22:12:08.598995] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:08.596772] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T22:12:08.638344] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-15T22:12:08.693774] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-15T22:12:08.694094] [INFO ] [MAIN ] VICI: Loaded 53653 existing records. [2025-10-15T22:12:08.876092] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:08.876301] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-15T22:12:08.876349] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-15T22:12:08.876911] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-15T22:12:08.876970] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-15T22:12:08.919138] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-15T22:12:09.252002] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:09.714048] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-15T22:12:10.513981] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-15T22:12:10.561857] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T22:12:10.564421] [INFO ] [REMOTE ] VGM: Full fetch complete (25986 records). [2025-10-15T22:12:10.564491] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-15T22:12:10.799895] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T22:12:10.874524] [INFO ] [REMOTE ] VFC: Full fetch complete (77750 records). [2025-10-15T22:12:10.876868] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-15T22:12:11.102067] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-15T22:12:11.115527] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-15T22:12:11.135988] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-15T22:12:11.151620] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-15T22:12:11.217705] [DEBUG] [LOCAL ] VGM: Trimmed 25986 records to 18563 (keeping 200 days of data) [2025-10-15T22:12:11.326432] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-15T22:12:11.479002] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-15T22:12:11.479100] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-15T22:12:11.482721] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-15T22:12:11.482818] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-15T22:12:11.501228] [DEBUG] [LOCAL ] VGM: Primary data saved (18563 records). [2025-10-15T22:12:11.501700] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-15T22:12:11.501806] [INFO ] [MAIN ] Update Progress: 2222/2369 symbols completed. VGM took 32.6s. Estimated remaining: 20m 39s. Rate: 7.1 symbols/min [2025-10-15T22:12:11.502036] [DEBUG] [LOCAL ] VFC: Trimmed 77750 records to 53605 (keeping 200 days of data) [2025-10-15T22:12:11.776560] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:11.938688] [DEBUG] [LOCAL ] VIK: Loaded 52466 existing records from primary storage. [2025-10-15T22:12:11.939996] [INFO ] [MAIN ] VIK: Loaded 52466 existing records. [2025-10-15T22:12:12.009464] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T22:12:12.132255] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-15T22:12:12.139049] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:12.140122] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-15T22:12:12.140598] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-15T22:12:12.144315] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-15T22:12:12.145416] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-15T22:12:12.599537] [DEBUG] [LOCAL ] VFC: Primary data saved (53605 records). [2025-10-15T22:12:12.630072] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:12.630981] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T22:12:12.631077] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-15T22:12:12.642208] [INFO ] [MAIN ] Update Progress: 2223/2369 symbols completed. VFC took 44.6s. Estimated remaining: 20m 30s. Rate: 7.1 symbols/min [2025-10-15T22:12:12.765275] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T22:12:12.815604] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:12.815796] [DEBUG] [LOCAL ] VIPS: No existing data file found in primary storage. [2025-10-15T22:12:12.815838] [WARN ] [MAIN ] VIPS: No existing data found, performing full refresh instead. [2025-10-15T22:12:12.815909] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-15T22:12:12.815946] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-15T22:12:12.815986] [DEBUG] [LOCAL ] VIPS: No primary data file found to delete. [2025-10-15T22:12:12.816019] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-15T22:12:12.915008] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-15T22:12:13.163827] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:13.714036] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-15T22:12:14.243460] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T22:12:14.514009] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-15T22:12:14.812788] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T22:12:15.314042] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-15T22:12:16.114004] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-15T22:12:16.228446] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T22:12:16.688210] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T22:12:16.776511] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T22:12:16.914020] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-15T22:12:17.714048] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-15T22:12:18.513688] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T22:12:18.523592] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-15T22:12:19.313969] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-15T22:12:19.367724] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T22:12:20.065465] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T22:12:20.113966] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-15T22:12:20.913988] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-15T22:12:21.055809] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T22:12:21.278936] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T22:12:21.609341] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T22:12:21.713966] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-15T22:12:22.513988] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-15T22:12:23.313977] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-15T22:12:23.548373] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T22:12:23.757499] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T22:12:23.772618] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T22:12:24.114042] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-15T22:12:24.913999] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-15T22:12:25.456953] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T22:12:25.713998] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-15T22:12:26.514007] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-15T22:12:26.730210] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T22:12:27.023924] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T22:12:27.184720] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T22:12:27.313973] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-15T22:12:28.114001] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-15T22:12:28.913991] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-15T22:12:29.377754] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T22:12:29.713976] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-15T22:12:29.953723] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T22:12:30.317821] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T22:12:30.514006] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-15T22:12:31.313991] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-15T22:12:31.692085] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T22:12:31.736550] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T22:12:32.113978] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-15T22:12:32.584021] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T22:12:32.584993] [INFO ] [REMOTE ] VHI: Full fetch complete (4362 records). [2025-10-15T22:12:32.585062] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-15T22:12:32.919937] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-15T22:12:32.943135] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-15T22:12:32.943959] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-15T22:12:32.944124] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-15T22:12:32.944197] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-15T22:12:32.944693] [DEBUG] [LOCAL ] VHI: Trimmed 4362 records to 2775 (keeping 200 days of data) [2025-10-15T22:12:32.998537] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T22:12:33.013821] [DEBUG] [LOCAL ] VHI: Primary data saved (2775 records). [2025-10-15T22:12:33.013962] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-15T22:12:33.014072] [INFO ] [MAIN ] Update Progress: 2224/2369 symbols completed. VHI took 34.4s. Estimated remaining: 20m 22s. Rate: 7.1 symbols/min [2025-10-15T22:12:33.190743] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:33.238831] [DEBUG] [LOCAL ] VIRT: Loaded 46659 existing records from primary storage. [2025-10-15T22:12:33.239117] [INFO ] [MAIN ] VIRT: Loaded 46659 existing records. [2025-10-15T22:12:33.410295] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:33.410504] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-15T22:12:33.410550] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-15T22:12:33.411065] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-15T22:12:33.411122] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-15T22:12:33.719160] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-15T22:12:33.756949] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:34.513995] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-15T22:12:34.759456] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T22:12:35.313978] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-15T22:12:35.420610] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T22:12:35.575087] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T22:12:36.114039] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-15T22:12:36.913980] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-15T22:12:37.019735] [DEBUG] [REMOTE ] VIRT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-15T22:12:37.019987] [WARN ] [REMOTE ] VIRT: No data returned for month 2025-01 [2025-10-15T22:12:37.020076] [FATAL] [REMOTE ] VIRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:12:37.020145] [FATAL] [MAIN ] VIRT: Failed to fetch primary data. [2025-10-15T22:12:37.020206] [WARN ] [MAIN ] VIRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:12:37.020277] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-15T22:12:37.020340] [DEBUG] [LOCAL ] VIRT: No primary data file found to delete. [2025-10-15T22:12:37.020374] [INFO ] [LOCAL ] VIRT: Starting deletion of derivative data. [2025-10-15T22:12:37.020585] [DEBUG] [LOCAL ] VIRT: Deleted derivative data file. [2025-10-15T22:12:37.020688] [INFO ] [MAIN ] Update Progress: 2225/2369 symbols completed. VIRT took 4.0s. Estimated remaining: 20m 14s. Rate: 7.1 symbols/min [2025-10-15T22:12:37.193279] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:37.235547] [DEBUG] [LOCAL ] VIST: Loaded 46457 existing records from primary storage. [2025-10-15T22:12:37.235882] [INFO ] [MAIN ] VIST: Loaded 46457 existing records. [2025-10-15T22:12:37.414144] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:37.414348] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-15T22:12:37.414417] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-15T22:12:37.414886] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-15T22:12:37.414941] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-15T22:12:37.770609] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:37.719072] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-15T22:12:37.871613] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T22:12:38.206496] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-15T22:12:38.513977] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-15T22:12:39.258751] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T22:12:39.314037] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-15T22:12:40.082682] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T22:12:40.113963] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-15T22:12:40.913995] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-15T22:12:41.037580] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T22:12:41.714072] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-15T22:12:41.789972] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T22:12:42.513986] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-15T22:12:42.677630] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T22:12:43.313970] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-15T22:12:43.432459] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T22:12:43.934940] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T22:12:44.113999] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-15T22:12:44.913978] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-15T22:12:45.404582] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T22:12:45.612265] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T22:12:45.714003] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-15T22:12:46.193185] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T22:12:46.199354] [INFO ] [REMOTE ] VIPS: Full fetch complete (74833 records). [2025-10-15T22:12:46.199466] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-15T22:12:46.522358] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-15T22:12:46.618870] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-15T22:12:46.618951] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-15T22:12:46.620093] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-15T22:12:46.620155] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-15T22:12:46.621502] [DEBUG] [LOCAL ] VIPS: Trimmed 74833 records to 51304 (keeping 200 days of data) [2025-10-15T22:12:46.925613] [DEBUG] [LOCAL ] VIPS: Primary data saved (51304 records). [2025-10-15T22:12:46.925780] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-15T22:12:46.925873] [INFO ] [MAIN ] Update Progress: 2226/2369 symbols completed. VIPS took 34.3s. Estimated remaining: 20m 5s. Rate: 7.1 symbols/min [2025-10-15T22:12:47.096352] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:47.137111] [DEBUG] [LOCAL ] VIV: Loaded 44865 existing records from primary storage. [2025-10-15T22:12:47.137521] [INFO ] [MAIN ] VIV: Loaded 44865 existing records. [2025-10-15T22:12:47.315767] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-15T22:12:47.320484] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:47.321749] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-15T22:12:47.327706] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-15T22:12:47.339136] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T22:12:47.339254] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-15T22:12:47.345745] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-15T22:12:47.380351] [INFO ] [REMOTE ] VICI: Full fetch complete (77801 records). [2025-10-15T22:12:47.399615] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-15T22:12:47.596358] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T22:12:47.704880] [INFO ] [REMOTE ] VIK: Full fetch complete (76051 records). [2025-10-15T22:12:47.781347] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-15T22:12:48.158573] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:48.179417] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-15T22:12:48.400383] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-15T22:12:48.406266] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-15T22:12:48.412702] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-15T22:12:48.423142] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-15T22:12:48.490457] [DEBUG] [LOCAL ] VICI: Trimmed 77801 records to 53653 (keeping 200 days of data) [2025-10-15T22:12:48.529411] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-15T22:12:48.529480] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-15T22:12:48.530153] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-15T22:12:48.530215] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-15T22:12:48.531597] [DEBUG] [LOCAL ] VIK: Trimmed 76051 records to 52471 (keeping 200 days of data) [2025-10-15T22:12:49.099465] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T22:12:49.097362] [DEBUG] [LOCAL ] VIK: Primary data saved (52471 records). [2025-10-15T22:12:49.111078] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-15T22:12:49.109761] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-15T22:12:49.111292] [INFO ] [MAIN ] Update Progress: 2227/2369 symbols completed. VIK took 37.6s. Estimated remaining: 19m 56s. Rate: 7.1 symbols/min [2025-10-15T22:12:49.353222] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:49.389857] [DEBUG] [LOCAL ] VICI: Primary data saved (53653 records). [2025-10-15T22:12:49.389971] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-15T22:12:49.390915] [INFO ] [MAIN ] Update Progress: 2228/2369 symbols completed. VICI took 41.0s. Estimated remaining: 19m 48s. Rate: 7.1 symbols/min [2025-10-15T22:12:49.388407] [DEBUG] [LOCAL ] VKQ: Loaded 17557 existing records from primary storage. [2025-10-15T22:12:49.454145] [INFO ] [MAIN ] VKQ: Loaded 17557 existing records. [2025-10-15T22:12:49.683103] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:12:49.744526] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:49.744965] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-15T22:12:49.745070] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-15T22:12:49.745390] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-15T22:12:49.745526] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-15T22:12:49.957384] [DEBUG] [LOCAL ] VLN: Loaded 30586 existing records from primary storage. [2025-10-15T22:12:49.985502] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T22:12:50.003019] [INFO ] [MAIN ] VLN: Loaded 30586 existing records. [2025-10-15T22:12:50.071826] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-15T22:12:50.352610] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:50.377624] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:12:50.378477] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-15T22:12:50.378544] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-15T22:12:50.378955] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-15T22:12:50.379027] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-15T22:12:50.519100] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-15T22:12:50.796082] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:12:50.920636] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T22:12:51.314015] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-15T22:12:51.579760] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T22:12:51.764815] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T22:12:52.114013] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-15T22:12:52.921611] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-15T22:12:52.951891] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T22:12:52.988684] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T22:12:53.714069] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-15T22:12:54.491860] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T22:12:54.513966] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-15T22:12:54.734478] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T22:12:55.313995] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-15T22:12:55.580332] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T22:12:56.114029] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-15T22:12:56.700618] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T22:12:56.914017] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-15T22:12:57.390394] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T22:12:57.713990] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-15T22:12:58.513961] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-15T22:12:58.618791] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T22:12:58.770779] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T22:12:59.313974] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-15T22:12:59.863956] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T22:13:00.113964] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-15T22:13:00.428406] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T22:13:00.914024] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-15T22:13:01.457187] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T22:13:01.713995] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-15T22:13:01.951882] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T22:13:02.513995] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-15T22:13:03.163360] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T22:13:03.314045] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-15T22:13:03.878312] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T22:13:04.086399] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T22:13:04.113971] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-15T22:13:04.914061] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-15T22:13:05.036470] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T22:13:05.714044] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-15T22:13:06.245392] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T22:13:06.514053] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-15T22:13:06.727714] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T22:13:07.314016] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-15T22:13:07.849538] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T22:13:08.114055] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-15T22:13:08.914063] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-15T22:13:09.157601] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T22:13:09.714010] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-15T22:13:09.775808] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-15T22:13:09.875854] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T22:13:10.513991] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-15T22:13:10.923049] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T22:13:10.928956] [INFO ] [REMOTE ] VIST: Full fetch complete (67153 records). [2025-10-15T22:13:10.929094] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-15T22:13:11.318717] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-15T22:13:11.362368] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-15T22:13:11.362476] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-15T22:13:11.364063] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-15T22:13:11.364130] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-15T22:13:11.366095] [DEBUG] [LOCAL ] VIST: Trimmed 67153 records to 46546 (keeping 200 days of data) [2025-10-15T22:13:11.669733] [DEBUG] [LOCAL ] VIST: Primary data saved (46546 records). [2025-10-15T22:13:11.669931] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-15T22:13:11.670038] [INFO ] [MAIN ] Update Progress: 2229/2369 symbols completed. VIST took 34.6s. Estimated remaining: 19m 40s. Rate: 7.1 symbols/min [2025-10-15T22:13:11.845283] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T22:13:11.884422] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:11.937172] [DEBUG] [LOCAL ] VLO: Loaded 53039 existing records from primary storage. [2025-10-15T22:13:11.937499] [INFO ] [MAIN ] VLO: Loaded 53039 existing records. [2025-10-15T22:13:12.115252] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-15T22:13:12.118994] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:12.121101] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-15T22:13:12.121256] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-15T22:13:12.122180] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-15T22:13:12.122283] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-15T22:13:12.486457] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T22:13:12.565220] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:12.914017] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-15T22:13:13.714023] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-15T22:13:13.748465] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T22:13:13.803802] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T22:13:14.513986] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-15T22:13:15.314019] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-15T22:13:15.387956] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T22:13:15.765741] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T22:13:16.114001] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-15T22:13:16.493267] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T22:13:16.914046] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-15T22:13:17.634195] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T22:13:17.713998] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-15T22:13:18.513980] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-15T22:13:18.577485] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T22:13:18.616115] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T22:13:18.618921] [INFO ] [REMOTE ] VKQ: Full fetch complete (24481 records). [2025-10-15T22:13:18.619005] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-15T22:13:18.985194] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-15T22:13:18.985273] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-15T22:13:18.985790] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-15T22:13:18.985853] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-15T22:13:18.986459] [DEBUG] [LOCAL ] VKQ: Trimmed 24481 records to 17636 (keeping 200 days of data) [2025-10-15T22:13:19.089118] [DEBUG] [LOCAL ] VKQ: Primary data saved (17636 records). [2025-10-15T22:13:19.089264] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-15T22:13:19.089342] [INFO ] [MAIN ] Update Progress: 2230/2369 symbols completed. VKQ took 30.0s. Estimated remaining: 19m 31s. Rate: 7.1 symbols/min [2025-10-15T22:13:19.251756] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:19.286279] [DEBUG] [LOCAL ] VLRS: Loaded 39894 existing records from primary storage. [2025-10-15T22:13:19.286554] [INFO ] [MAIN ] VLRS: Loaded 39894 existing records. [2025-10-15T22:13:19.319288] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-15T22:13:19.465011] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:19.465235] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-15T22:13:19.465284] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-15T22:13:19.465687] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-15T22:13:19.465744] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-15T22:13:19.749110] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T22:13:19.778836] [INFO ] [REMOTE ] VIV: Full fetch complete (64575 records). [2025-10-15T22:13:19.789585] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-15T22:13:19.965480] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:20.119180] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-15T22:13:20.248416] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-15T22:13:20.248494] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-15T22:13:20.249771] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-15T22:13:20.249835] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-15T22:13:20.251161] [DEBUG] [LOCAL ] VIV: Trimmed 64575 records to 44858 (keeping 200 days of data) [2025-10-15T22:13:20.517359] [DEBUG] [LOCAL ] VIV: Primary data saved (44858 records). [2025-10-15T22:13:20.517537] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-15T22:13:20.517810] [INFO ] [MAIN ] Update Progress: 2231/2369 symbols completed. VIV took 33.6s. Estimated remaining: 19m 23s. Rate: 7.1 symbols/min [2025-10-15T22:13:20.686205] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:20.693713] [DEBUG] [LOCAL ] VLT: Loaded 4433 existing records from primary storage. [2025-10-15T22:13:20.693931] [INFO ] [MAIN ] VLT: Loaded 4433 existing records. [2025-10-15T22:13:20.834433] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T22:13:20.912027] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:20.912238] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-15T22:13:20.912288] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-15T22:13:20.912472] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-15T22:13:20.912529] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-15T22:13:20.924782] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-15T22:13:21.321183] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:21.343123] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T22:13:21.714066] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-15T22:13:22.283607] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T22:13:22.513967] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-15T22:13:22.744108] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T22:13:23.314013] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-15T22:13:23.530576] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T22:13:23.535405] [INFO ] [REMOTE ] VLN: Full fetch complete (43738 records). [2025-10-15T22:13:23.535487] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-15T22:13:23.911509] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-15T22:13:23.911588] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-15T22:13:23.912468] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-15T22:13:23.912530] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-15T22:13:23.913516] [DEBUG] [LOCAL ] VLN: Trimmed 43738 records to 30740 (keeping 200 days of data) [2025-10-15T22:13:24.081182] [DEBUG] [LOCAL ] VLN: Primary data saved (30740 records). [2025-10-15T22:13:24.081309] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-15T22:13:24.081389] [INFO ] [MAIN ] Update Progress: 2232/2369 symbols completed. VLN took 34.7s. Estimated remaining: 19m 14s. Rate: 7.1 symbols/min [2025-10-15T22:13:24.123687] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-15T22:13:24.251547] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:24.298090] [DEBUG] [LOCAL ] VLTO: Loaded 46185 existing records from primary storage. [2025-10-15T22:13:24.298411] [INFO ] [MAIN ] VLTO: Loaded 46185 existing records. [2025-10-15T22:13:24.484973] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:24.485202] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-15T22:13:24.485259] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-15T22:13:24.485720] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-15T22:13:24.485776] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-15T22:13:24.837196] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:24.908828] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T22:13:24.919324] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-15T22:13:25.503249] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T22:13:25.535983] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T22:13:25.714035] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-15T22:13:26.513973] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-15T22:13:26.905942] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T22:13:26.979247] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T22:13:27.314002] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-15T22:13:28.114066] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-15T22:13:28.579255] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T22:13:28.675628] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T22:13:28.914012] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-15T22:13:29.632659] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T22:13:29.714105] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-15T22:13:30.513992] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-15T22:13:31.153374] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T22:13:31.314006] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-15T22:13:32.113972] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-15T22:13:32.429029] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T22:13:32.913975] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-15T22:13:32.997450] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T22:13:33.442177] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T22:13:33.473074] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T22:13:33.714064] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-15T22:13:34.514007] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-15T22:13:35.314063] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-15T22:13:35.627754] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T22:13:35.728532] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T22:13:36.114045] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-15T22:13:36.873111] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T22:13:36.913966] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-15T22:13:37.713967] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-15T22:13:38.097751] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T22:13:38.116883] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T22:13:38.148704] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T22:13:38.513973] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-15T22:13:39.082832] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T22:13:39.314000] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-15T22:13:39.895952] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T22:13:40.114009] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-15T22:13:40.742412] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T22:13:40.914052] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-15T22:13:41.714003] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-15T22:13:42.249215] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T22:13:42.514003] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-15T22:13:43.313988] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-15T22:13:43.585002] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T22:13:44.113961] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-15T22:13:44.220530] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T22:13:44.446052] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-15T22:13:44.447080] [INFO ] [REMOTE ] VLT: Full fetch complete (7513 records). [2025-10-15T22:13:44.447147] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-15T22:13:44.808454] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-15T22:13:44.808779] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-15T22:13:44.809202] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-15T22:13:44.809290] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-15T22:13:44.810450] [DEBUG] [LOCAL ] VLT: Trimmed 7513 records to 4415 (keeping 200 days of data) [2025-10-15T22:13:44.838463] [DEBUG] [LOCAL ] VLT: Primary data saved (4415 records). [2025-10-15T22:13:44.838712] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-15T22:13:44.838895] [INFO ] [MAIN ] Update Progress: 2233/2369 symbols completed. VLT took 24.3s. Estimated remaining: 19m 6s. Rate: 7.1 symbols/min [2025-10-15T22:13:44.917499] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-15T22:13:44.986983] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T22:13:45.067361] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:45.113048] [DEBUG] [LOCAL ] VMC: Loaded 42613 existing records from primary storage. [2025-10-15T22:13:45.113461] [INFO ] [MAIN ] VMC: Loaded 42613 existing records. [2025-10-15T22:13:45.291803] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:45.292104] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-15T22:13:45.292154] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-15T22:13:45.292680] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-15T22:13:45.292738] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-15T22:13:45.658953] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:45.714003] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-15T22:13:46.513989] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-15T22:13:46.588334] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T22:13:47.215095] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T22:13:47.313976] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-15T22:13:48.119169] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-15T22:13:48.132947] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T22:13:48.208041] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T22:13:48.914079] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-15T22:13:49.714702] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-15T22:13:49.714569] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T22:13:50.513970] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-15T22:13:50.703313] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T22:13:50.773100] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-15T22:13:50.780004] [INFO ] [REMOTE ] VLTO: Full fetch complete (67264 records). [2025-10-15T22:13:50.780182] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-15T22:13:51.193962] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-15T22:13:51.194111] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-15T22:13:51.195370] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-15T22:13:51.195458] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-15T22:13:51.196867] [DEBUG] [LOCAL ] VLTO: Trimmed 67264 records to 46190 (keeping 200 days of data) [2025-10-15T22:13:51.316523] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-15T22:13:51.324796] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T22:13:51.519042] [DEBUG] [LOCAL ] VLTO: Primary data saved (46190 records). [2025-10-15T22:13:51.519167] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-15T22:13:51.519243] [INFO ] [MAIN ] Update Progress: 2234/2369 symbols completed. VLTO took 27.4s. Estimated remaining: 18m 58s. Rate: 7.1 symbols/min [2025-10-15T22:13:51.682110] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:51.697905] [DEBUG] [LOCAL ] VMI: Loaded 15080 existing records from primary storage. [2025-10-15T22:13:51.698156] [INFO ] [MAIN ] VMI: Loaded 15080 existing records. [2025-10-15T22:13:51.870992] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:51.871206] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-15T22:13:51.871251] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-15T22:13:51.871541] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-15T22:13:51.871596] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-15T22:13:52.119209] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-15T22:13:52.219129] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:52.751544] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T22:13:52.914020] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-15T22:13:53.679865] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T22:13:53.713962] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-15T22:13:54.117949] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T22:13:54.320025] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T22:13:54.514006] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-15T22:13:54.940857] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T22:13:54.947525] [INFO ] [REMOTE ] VLO: Full fetch complete (76970 records). [2025-10-15T22:13:54.947709] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-15T22:13:55.319275] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-15T22:13:55.353298] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-15T22:13:55.353385] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-15T22:13:55.354611] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-15T22:13:55.354697] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-15T22:13:55.356155] [DEBUG] [LOCAL ] VLO: Trimmed 76970 records to 53027 (keeping 200 days of data) [2025-10-15T22:13:55.699192] [DEBUG] [LOCAL ] VLO: Primary data saved (53027 records). [2025-10-15T22:13:55.699346] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-15T22:13:55.699435] [INFO ] [MAIN ] Update Progress: 2235/2369 symbols completed. VLO took 44.0s. Estimated remaining: 18m 49s. Rate: 7.1 symbols/min [2025-10-15T22:13:55.875785] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:13:55.896088] [DEBUG] [LOCAL ] VMO: Loaded 20806 existing records from primary storage. [2025-10-15T22:13:55.896347] [INFO ] [MAIN ] VMO: Loaded 20806 existing records. [2025-10-15T22:13:56.078382] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:13:56.078618] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-15T22:13:56.078696] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-15T22:13:56.078970] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-15T22:13:56.079025] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-15T22:13:56.122235] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-15T22:13:56.444759] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:13:56.609824] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T22:13:56.743970] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-15T22:13:56.914022] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-15T22:13:57.714064] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-15T22:13:58.514014] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-15T22:13:58.590684] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T22:13:58.715530] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T22:13:59.314031] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-15T22:13:59.585865] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T22:14:00.114008] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-15T22:14:00.405316] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T22:14:00.807037] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T22:14:00.914058] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-15T22:14:01.714021] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-15T22:14:01.878889] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T22:14:02.514051] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-15T22:14:03.314081] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-15T22:14:03.354617] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T22:14:03.382722] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T22:14:03.387340] [INFO ] [REMOTE ] VLRS: Full fetch complete (58453 records). [2025-10-15T22:14:03.387466] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-15T22:14:03.770070] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-15T22:14:03.770153] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-15T22:14:03.771169] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-15T22:14:03.771230] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-15T22:14:03.772463] [DEBUG] [LOCAL ] VLRS: Trimmed 58453 records to 39730 (keeping 200 days of data) [2025-10-15T22:14:03.991480] [DEBUG] [LOCAL ] VLRS: Primary data saved (39730 records). [2025-10-15T22:14:03.991736] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-15T22:14:03.991857] [INFO ] [MAIN ] Update Progress: 2236/2369 symbols completed. VLRS took 44.9s. Estimated remaining: 18m 41s. Rate: 7.1 symbols/min [2025-10-15T22:14:04.131895] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-15T22:14:04.180240] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:04.181762] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T22:14:04.197915] [DEBUG] [LOCAL ] VNCE: Loaded 8930 existing records from primary storage. [2025-10-15T22:14:04.198145] [INFO ] [MAIN ] VNCE: Loaded 8930 existing records. [2025-10-15T22:14:04.371069] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:04.371270] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-15T22:14:04.371317] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-15T22:14:04.371565] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-15T22:14:04.371622] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-15T22:14:04.763599] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:04.914015] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-15T22:14:05.380821] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T22:14:05.713963] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-15T22:14:06.366686] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T22:14:06.514019] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-15T22:14:06.682924] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T22:14:07.314009] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-15T22:14:08.001184] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T22:14:08.114071] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-15T22:14:08.914011] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-15T22:14:09.025359] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T22:14:09.119301] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T22:14:09.674980] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T22:14:09.713957] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-15T22:14:10.513961] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-15T22:14:10.867508] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T22:14:11.130030] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T22:14:11.313990] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-15T22:14:11.937915] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T22:14:12.113982] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-15T22:14:12.914006] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-15T22:14:13.243691] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T22:14:13.714012] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-15T22:14:14.513984] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-15T22:14:14.688430] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T22:14:14.698196] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T22:14:15.174134] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T22:14:15.176088] [INFO ] [REMOTE ] VMI: Full fetch complete (21164 records). [2025-10-15T22:14:15.176175] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-15T22:14:15.320912] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-15T22:14:15.531318] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-15T22:14:15.531390] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-15T22:14:15.531838] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-15T22:14:15.531898] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-15T22:14:15.532446] [DEBUG] [LOCAL ] VMI: Trimmed 21164 records to 15071 (keeping 200 days of data) [2025-10-15T22:14:15.629210] [DEBUG] [LOCAL ] VMI: Primary data saved (15071 records). [2025-10-15T22:14:15.629378] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-15T22:14:15.629524] [INFO ] [MAIN ] Update Progress: 2237/2369 symbols completed. VMI took 24.1s. Estimated remaining: 18m 32s. Rate: 7.1 symbols/min [2025-10-15T22:14:16.114043] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-15T22:14:16.913979] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-15T22:14:17.009070] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T22:14:17.062946] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T22:14:17.427712] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T22:14:17.713995] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-15T22:14:18.513998] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-15T22:14:19.314014] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-15T22:14:19.361418] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T22:14:19.607997] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T22:14:19.915384] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T22:14:20.114012] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-15T22:14:20.751800] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T22:14:20.913986] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-15T22:14:21.525800] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T22:14:21.714053] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-15T22:14:22.513983] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-15T22:14:23.147243] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T22:14:23.151162] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T22:14:23.313977] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-15T22:14:24.113990] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-15T22:14:24.696703] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T22:14:24.913984] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-15T22:14:24.968033] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T22:14:25.301284] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T22:14:25.714063] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-15T22:14:25.993248] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-15T22:14:25.997946] [INFO ] [REMOTE ] VMC: Full fetch complete (62311 records). [2025-10-15T22:14:25.998087] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-15T22:14:26.381071] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-15T22:14:26.381166] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-15T22:14:26.382261] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-15T22:14:26.382324] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-15T22:14:26.383529] [DEBUG] [LOCAL ] VMC: Trimmed 62311 records to 42564 (keeping 200 days of data) [2025-10-15T22:14:26.563312] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-15T22:14:26.650704] [DEBUG] [LOCAL ] VMC: Primary data saved (42564 records). [2025-10-15T22:14:26.650839] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-15T22:14:26.650919] [INFO ] [MAIN ] Update Progress: 2238/2369 symbols completed. VMC took 41.8s. Estimated remaining: 18m 24s. Rate: 7.1 symbols/min [2025-10-15T22:14:27.314036] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-15T22:14:27.823464] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T22:14:27.919305] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T22:14:28.114011] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-15T22:14:28.913999] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-15T22:14:29.297632] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T22:14:29.706941] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T22:14:29.709907] [INFO ] [REMOTE ] VNCE: Full fetch complete (15552 records). [2025-10-15T22:14:29.710008] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-15T22:14:29.742166] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-15T22:14:30.102637] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-15T22:14:30.102755] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-15T22:14:30.103147] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-15T22:14:30.103244] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-15T22:14:30.103768] [DEBUG] [LOCAL ] VNCE: Trimmed 15552 records to 9018 (keeping 200 days of data) [2025-10-15T22:14:30.153869] [DEBUG] [LOCAL ] VNCE: Primary data saved (9018 records). [2025-10-15T22:14:30.154008] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-15T22:14:30.154092] [INFO ] [MAIN ] Update Progress: 2239/2369 symbols completed. VNCE took 26.2s. Estimated remaining: 18m 15s. Rate: 7.1 symbols/min [2025-10-15T22:14:30.761185] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T22:14:30.763933] [INFO ] [REMOTE ] VMO: Full fetch complete (31051 records). [2025-10-15T22:14:30.764029] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-15T22:14:31.133625] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-15T22:14:31.133731] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-15T22:14:31.134353] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-15T22:14:31.134393] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-15T22:14:31.135527] [DEBUG] [LOCAL ] VMO: Trimmed 31051 records to 20777 (keeping 200 days of data) [2025-10-15T22:14:31.272930] [DEBUG] [LOCAL ] VMO: Primary data saved (20777 records). [2025-10-15T22:14:31.273054] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-15T22:14:31.273143] [INFO ] [MAIN ] Update Progress: 2240/2369 symbols completed. VMO took 35.6s. Estimated remaining: 18m 7s. Rate: 7.1 symbols/min [2025-10-15T22:14:31.996869] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:32.004220] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:32.003261] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:32.025672] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:32.035027] [DEBUG] [LOCAL ] VOC: Loaded 9019 existing records from primary storage. [2025-10-15T22:14:32.035402] [INFO ] [MAIN ] VOC: Loaded 9019 existing records. [2025-10-15T22:14:32.279170] [DEBUG] [LOCAL ] VNO: Loaded 48953 existing records from primary storage. [2025-10-15T22:14:32.276367] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:32.278379] [DEBUG] [LOCAL ] VOYA: Loaded 42230 existing records from primary storage. [2025-10-15T22:14:32.279822] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-15T22:14:32.279978] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-15T22:14:32.280370] [INFO ] [MAIN ] VOYA: Loaded 42230 existing records. [2025-10-15T22:14:32.280821] [INFO ] [MAIN ] VNO: Loaded 48953 existing records. [2025-10-15T22:14:32.312264] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-15T22:14:32.352765] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-15T22:14:32.493049] [DEBUG] [LOCAL ] VNT: Loaded 43921 existing records from primary storage. [2025-10-15T22:14:32.549502] [INFO ] [MAIN ] VNT: Loaded 43921 existing records. [2025-10-15T22:14:32.851733] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:32.974381] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:32.979772] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-15T22:14:32.985254] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-15T22:14:32.985931] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-15T22:14:33.001595] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-15T22:14:33.007039] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-15T22:14:33.017410] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-15T22:14:33.022548] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-15T22:14:33.142793] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-15T22:14:33.451036] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:33.506407] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-15T22:14:33.544258] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-15T22:14:33.625502] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-15T22:14:33.707795] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-15T22:14:33.742122] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:33.791331] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-15T22:14:34.218782] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:34.244502] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-15T22:14:34.309131] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:34.328055] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-15T22:14:34.509845] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:34.510189] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-15T22:14:34.702089] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T22:14:34.704545] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-15T22:14:35.286099] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T22:14:35.288902] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-15T22:14:35.506798] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T22:14:35.516686] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-15T22:14:35.883617] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T22:14:35.983237] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T22:14:36.058783] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T22:14:36.113960] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-15T22:14:36.769452] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T22:14:36.890719] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T22:14:36.913956] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-15T22:14:37.713966] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-15T22:14:37.736168] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T22:14:38.513996] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-15T22:14:39.124558] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T22:14:39.268618] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T22:14:39.313983] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-15T22:14:40.114000] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-15T22:14:40.614300] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T22:14:40.914006] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-15T22:14:41.246051] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T22:14:41.714018] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-15T22:14:42.482070] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T22:14:42.513960] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-15T22:14:43.250752] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T22:14:43.313993] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-15T22:14:43.861163] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T22:14:44.075850] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T22:14:44.113976] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-15T22:14:44.914010] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-15T22:14:45.447442] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T22:14:45.714000] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-15T22:14:45.807835] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T22:14:46.513990] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-15T22:14:46.916771] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T22:14:47.314024] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-15T22:14:48.025257] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T22:14:48.098424] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T22:14:48.113961] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-15T22:14:48.913990] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-15T22:14:48.924275] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T22:14:49.713996] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-15T22:14:50.253101] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T22:14:50.254806] [INFO ] [REMOTE ] VOC: Full fetch complete (13194 records). [2025-10-15T22:14:50.254974] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-15T22:14:50.393974] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T22:14:50.519165] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-15T22:14:50.701140] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-15T22:14:50.701226] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-15T22:14:50.701599] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-15T22:14:50.701699] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-15T22:14:50.702309] [DEBUG] [LOCAL ] VOC: Trimmed 13194 records to 9008 (keeping 200 days of data) [2025-10-15T22:14:50.757609] [DEBUG] [LOCAL ] VOC: Primary data saved (9008 records). [2025-10-15T22:14:50.757765] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-15T22:14:50.757852] [INFO ] [MAIN ] Update Progress: 2241/2369 symbols completed. VOC took 19.5s. Estimated remaining: 17m 59s. Rate: 7.1 symbols/min [2025-10-15T22:14:50.949977] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:50.950199] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-15T22:14:50.950256] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-15T22:14:50.950375] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-15T22:14:50.950430] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-15T22:14:50.950512] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-15T22:14:50.950558] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-15T22:14:51.318769] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-15T22:14:51.347493] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:52.121565] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-15T22:14:52.126884] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T22:14:52.670992] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T22:14:52.914062] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-15T22:14:53.641559] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T22:14:53.714064] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-15T22:14:54.243434] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-15T22:14:54.514072] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-15T22:14:55.224118] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T22:14:55.314002] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-15T22:14:55.771365] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T22:14:56.114005] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-15T22:14:56.701597] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T22:14:56.914025] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-15T22:14:57.321526] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T22:14:57.713990] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-15T22:14:57.927361] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:14:57.927611] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-15T22:14:57.927759] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:14:57.927825] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-15T22:14:57.927893] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:14:57.927968] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-15T22:14:57.928030] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-15T22:14:57.928066] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-15T22:14:57.928106] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-15T22:14:57.928152] [INFO ] [MAIN ] Update Progress: 2242/2369 symbols completed. VOYG took 7.2s. Estimated remaining: 17m 50s. Rate: 7.1 symbols/min [2025-10-15T22:14:58.091573] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:58.109844] [DEBUG] [LOCAL ] VPG: Loaded 17069 existing records from primary storage. [2025-10-15T22:14:58.110080] [INFO ] [MAIN ] VPG: Loaded 17069 existing records. [2025-10-15T22:14:58.290134] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:58.290409] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-15T22:14:58.290498] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-15T22:14:58.296063] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-15T22:14:58.304935] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-15T22:14:58.369024] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T22:14:58.410980] [INFO ] [REMOTE ] VNT: Full fetch complete (63971 records). [2025-10-15T22:14:58.416758] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-15T22:14:58.568585] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-15T22:14:58.893386] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:14:59.076810] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-15T22:14:59.076901] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-15T22:14:59.077844] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-15T22:14:59.077904] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-15T22:14:59.079102] [DEBUG] [LOCAL ] VNT: Trimmed 63971 records to 43959 (keeping 200 days of data) [2025-10-15T22:14:59.322936] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-15T22:14:59.337105] [DEBUG] [LOCAL ] VNT: Primary data saved (43959 records). [2025-10-15T22:14:59.337175] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-15T22:14:59.337245] [INFO ] [MAIN ] Update Progress: 2243/2369 symbols completed. VNT took 28.1s. Estimated remaining: 17m 41s. Rate: 7.1 symbols/min [2025-10-15T22:14:59.506129] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:14:59.512281] [DEBUG] [LOCAL ] VPV: Loaded 5452 existing records from primary storage. [2025-10-15T22:14:59.512429] [INFO ] [MAIN ] VPV: Loaded 5452 existing records. [2025-10-15T22:14:59.683960] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:14:59.684153] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-15T22:14:59.684199] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-15T22:14:59.684355] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-15T22:14:59.684409] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-15T22:15:00.029807] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:00.113967] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-15T22:15:00.195209] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T22:15:00.633562] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-15T22:15:00.763786] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T22:15:00.914025] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-15T22:15:01.683619] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T22:15:01.713965] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-15T22:15:02.269860] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T22:15:02.514015] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-15T22:15:02.975958] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T22:15:03.313992] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-15T22:15:04.064057] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T22:15:04.113987] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-15T22:15:04.716446] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T22:15:04.914002] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-15T22:15:05.462909] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T22:15:05.714008] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-15T22:15:06.514022] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-15T22:15:06.671217] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T22:15:07.314000] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-15T22:15:08.012265] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T22:15:08.114016] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-15T22:15:08.760611] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T22:15:08.914022] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-15T22:15:09.401953] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T22:15:09.537722] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T22:15:09.713994] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-15T22:15:10.514053] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-15T22:15:10.557368] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T22:15:11.314052] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-15T22:15:12.114041] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-15T22:15:12.198944] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:15:12.642594] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-15T22:15:12.913958] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-15T22:15:13.017676] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T22:15:13.714140] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-15T22:15:13.733002] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T22:15:14.514045] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-15T22:15:14.951852] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T22:15:15.124863] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T22:15:15.313985] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-15T22:15:16.114029] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-15T22:15:16.397442] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T22:15:16.403369] [INFO ] [REMOTE ] VNO: Full fetch complete (70516 records). [2025-10-15T22:15:16.403518] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-15T22:15:16.795680] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-15T22:15:16.795780] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-15T22:15:16.797058] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-15T22:15:16.797130] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-15T22:15:16.798710] [DEBUG] [LOCAL ] VNO: Trimmed 70516 records to 48956 (keeping 200 days of data) [2025-10-15T22:15:16.905246] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T22:15:16.913964] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-15T22:15:17.096798] [DEBUG] [LOCAL ] VNO: Primary data saved (48956 records). [2025-10-15T22:15:17.096929] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-15T22:15:17.097009] [INFO ] [MAIN ] Update Progress: 2244/2369 symbols completed. VNO took 45.8s. Estimated remaining: 17m 34s. Rate: 7.1 symbols/min [2025-10-15T22:15:17.263533] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:15:17.298480] [DEBUG] [LOCAL ] VRE: Loaded 35222 existing records from primary storage. [2025-10-15T22:15:17.298879] [INFO ] [MAIN ] VRE: Loaded 35222 existing records. [2025-10-15T22:15:17.474224] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:15:17.474453] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-15T22:15:17.474500] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-15T22:15:17.474979] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-15T22:15:17.475035] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-15T22:15:17.722883] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-15T22:15:17.827156] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:18.273231] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T22:15:18.274484] [INFO ] [REMOTE ] VPV: Full fetch complete (9075 records). [2025-10-15T22:15:18.274552] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-15T22:15:18.519176] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-15T22:15:18.564863] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T22:15:18.625897] [INFO ] [REMOTE ] VOYA: Full fetch complete (61842 records). [2025-10-15T22:15:18.642153] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-15T22:15:18.649358] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-15T22:15:18.649527] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-15T22:15:18.649797] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-15T22:15:18.649874] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-15T22:15:18.692669] [DEBUG] [LOCAL ] VPV: Trimmed 9075 records to 5450 (keeping 200 days of data) [2025-10-15T22:15:19.025099] [DEBUG] [LOCAL ] VPV: Primary data saved (5450 records). [2025-10-15T22:15:19.038064] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-15T22:15:19.039451] [INFO ] [MAIN ] Update Progress: 2245/2369 symbols completed. VPV took 19.7s. Estimated remaining: 17m 25s. Rate: 7.1 symbols/min [2025-10-15T22:15:19.152543] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-15T22:15:19.178926] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-15T22:15:19.182443] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-15T22:15:19.188261] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-15T22:15:19.235402] [DEBUG] [LOCAL ] VOYA: Trimmed 61842 records to 42237 (keeping 200 days of data) [2025-10-15T22:15:19.253627] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:15:19.317223] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-15T22:15:19.471446] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-15T22:15:19.499214] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-15T22:15:19.689485] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:15:19.693766] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-15T22:15:19.694060] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-15T22:15:19.695694] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-15T22:15:19.695983] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-15T22:15:20.031596] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T22:15:20.110112] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:20.114461] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-15T22:15:20.119944] [DEBUG] [LOCAL ] VOYA: Primary data saved (42237 records). [2025-10-15T22:15:20.120198] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-15T22:15:20.120303] [INFO ] [MAIN ] Update Progress: 2246/2369 symbols completed. VOYA took 48.8s. Estimated remaining: 17m 16s. Rate: 7.1 symbols/min [2025-10-15T22:15:20.235260] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T22:15:20.309580] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:15:20.321086] [DEBUG] [LOCAL ] VRTS: Loaded 9357 existing records from primary storage. [2025-10-15T22:15:20.321350] [INFO ] [MAIN ] VRTS: Loaded 9357 existing records. [2025-10-15T22:15:20.492005] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:15:20.492217] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-15T22:15:20.492263] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-15T22:15:20.492493] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-15T22:15:20.492549] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-15T22:15:20.836384] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:20.913972] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-15T22:15:20.974881] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T22:15:21.713980] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-15T22:15:22.514027] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-15T22:15:22.747218] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T22:15:23.179739] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T22:15:23.313957] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-15T22:15:23.369450] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-15T22:15:23.997453] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T22:15:24.114027] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-15T22:15:24.914010] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-15T22:15:25.096723] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T22:15:25.713995] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-15T22:15:25.946111] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T22:15:26.513982] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-15T22:15:26.546887] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T22:15:27.313980] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-15T22:15:27.934473] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T22:15:28.004947] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T22:15:28.114010] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-15T22:15:28.772085] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T22:15:28.914001] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-15T22:15:29.669616] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T22:15:29.713962] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-15T22:15:30.359208] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-15T22:15:30.513982] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-15T22:15:31.313970] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-15T22:15:31.430102] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T22:15:31.929995] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T22:15:32.113952] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-15T22:15:32.913990] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-15T22:15:33.067959] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T22:15:33.713990] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-15T22:15:34.165553] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T22:15:34.514004] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-15T22:15:34.548100] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T22:15:34.550444] [INFO ] [REMOTE ] VPG: Full fetch complete (22874 records). [2025-10-15T22:15:34.550572] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-15T22:15:34.965456] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-15T22:15:34.965533] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-15T22:15:34.966069] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-15T22:15:34.966134] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-15T22:15:34.966807] [DEBUG] [LOCAL ] VPG: Trimmed 22874 records to 17178 (keeping 200 days of data) [2025-10-15T22:15:35.072578] [DEBUG] [LOCAL ] VPG: Primary data saved (17178 records). [2025-10-15T22:15:35.072740] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-15T22:15:35.072827] [INFO ] [MAIN ] Update Progress: 2247/2369 symbols completed. VPG took 37.1s. Estimated remaining: 17m 8s. Rate: 7.1 symbols/min [2025-10-15T22:15:35.241786] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:15:35.292427] [DEBUG] [LOCAL ] VSCO: Loaded 52743 existing records from primary storage. [2025-10-15T22:15:35.292806] [INFO ] [MAIN ] VSCO: Loaded 52743 existing records. [2025-10-15T22:15:35.323509] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-15T22:15:35.475891] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:15:35.483832] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-15T22:15:35.484048] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-15T22:15:35.484864] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T22:15:35.485915] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-15T22:15:35.488072] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-15T22:15:35.879629] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:36.114000] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-15T22:15:36.914125] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-15T22:15:37.725888] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-15T22:15:37.731595] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-15T22:15:37.826732] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T22:15:38.215488] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T22:15:38.259161] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-15T22:15:38.514059] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-15T22:15:39.314001] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-15T22:15:40.122059] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-15T22:15:40.141241] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T22:15:40.914012] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-15T22:15:40.938467] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T22:15:41.419743] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-15T22:15:41.714015] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-15T22:15:42.514001] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-15T22:15:42.606903] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T22:15:43.101163] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T22:15:43.313983] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-15T22:15:44.114012] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-15T22:15:44.756791] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T22:15:44.759040] [INFO ] [REMOTE ] VRTS: Full fetch complete (11644 records). [2025-10-15T22:15:44.759141] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-15T22:15:44.919674] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-15T22:15:45.148167] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-15T22:15:45.148694] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-15T22:15:45.149366] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-15T22:15:45.162169] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-15T22:15:45.188351] [DEBUG] [LOCAL ] VRTS: Trimmed 11644 records to 9390 (keeping 200 days of data) [2025-10-15T22:15:45.192196] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-15T22:15:45.286561] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T22:15:45.327565] [DEBUG] [LOCAL ] VRTS: Primary data saved (9390 records). [2025-10-15T22:15:45.327786] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-15T22:15:45.327903] [INFO ] [MAIN ] Update Progress: 2248/2369 symbols completed. VRTS took 25.2s. Estimated remaining: 16m 60s. Rate: 7.1 symbols/min [2025-10-15T22:15:45.500092] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:15:45.545478] [DEBUG] [LOCAL ] VSH: Loaded 48180 existing records from primary storage. [2025-10-15T22:15:45.545802] [INFO ] [MAIN ] VSH: Loaded 48180 existing records. [2025-10-15T22:15:45.716252] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-15T22:15:45.716139] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:15:45.717722] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-15T22:15:45.717807] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-15T22:15:45.718300] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-15T22:15:45.718383] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-15T22:15:46.149476] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:46.376862] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T22:15:46.514101] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-15T22:15:47.313991] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-15T22:15:48.113983] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-15T22:15:48.187171] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T22:15:48.332868] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T22:15:48.913975] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-15T22:15:49.054735] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T22:15:49.370925] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T22:15:49.714012] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-15T22:15:50.514017] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-15T22:15:51.266308] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T22:15:51.313969] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-15T22:15:51.449177] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-15T22:15:51.954308] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T22:15:52.114049] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-15T22:15:52.293134] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T22:15:52.299209] [INFO ] [REMOTE ] VRE: Full fetch complete (48474 records). [2025-10-15T22:15:52.299458] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-15T22:15:52.682432] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-15T22:15:52.682516] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-15T22:15:52.683520] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-15T22:15:52.683583] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-15T22:15:52.684678] [DEBUG] [LOCAL ] VRE: Trimmed 48474 records to 35289 (keeping 200 days of data) [2025-10-15T22:15:52.910253] [DEBUG] [LOCAL ] VRE: Primary data saved (35289 records). [2025-10-15T22:15:52.910583] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-15T22:15:52.910690] [INFO ] [MAIN ] Update Progress: 2249/2369 symbols completed. VRE took 35.8s. Estimated remaining: 16m 51s. Rate: 7.1 symbols/min [2025-10-15T22:15:52.921587] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-15T22:15:53.083616] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:15:53.137408] [DEBUG] [LOCAL ] VST: Loaded 53711 existing records from primary storage. [2025-10-15T22:15:53.137745] [INFO ] [MAIN ] VST: Loaded 53711 existing records. [2025-10-15T22:15:53.310007] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:15:53.310268] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-15T22:15:53.310324] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-15T22:15:53.310920] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-15T22:15:53.310975] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-15T22:15:53.672392] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:15:53.714004] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-15T22:15:53.847139] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T22:15:54.513962] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-15T22:15:54.621361] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T22:15:55.314022] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-15T22:15:55.757141] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-15T22:15:56.114034] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-15T22:15:56.488739] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-15T22:15:56.581002] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T22:15:56.914007] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-15T22:15:57.631340] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T22:15:57.713956] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-15T22:15:58.514012] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-15T22:15:59.095459] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-15T22:15:59.313969] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-15T22:15:59.398427] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:16:00.113991] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-15T22:16:00.864730] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-15T22:16:00.914009] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-15T22:16:01.600414] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-15T22:16:01.668220] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T22:16:01.713984] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-15T22:16:02.513987] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-15T22:16:03.314112] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-15T22:16:03.402830] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-15T22:16:03.760810] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T22:16:04.114020] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-15T22:16:04.387695] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T22:16:04.914007] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-15T22:16:05.010472] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T22:16:05.714057] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-15T22:16:06.182490] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-15T22:16:06.189113] [INFO ] [REMOTE ] VRT: Full fetch complete (77932 records). [2025-10-15T22:16:06.189282] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-15T22:16:06.519107] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-15T22:16:06.597378] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-15T22:16:06.597480] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-15T22:16:06.598726] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-15T22:16:06.598806] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-15T22:16:06.600351] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 53753 (keeping 200 days of data) [2025-10-15T22:16:06.942957] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-15T22:16:06.943098] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-15T22:16:06.943196] [INFO ] [MAIN ] Update Progress: 2250/2369 symbols completed. VRT took 47.9s. Estimated remaining: 16m 43s. Rate: 7.1 symbols/min [2025-10-15T22:16:07.116495] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:07.161031] [DEBUG] [LOCAL ] VSTS: Loaded 48940 existing records from primary storage. [2025-10-15T22:16:07.161346] [INFO ] [MAIN ] VSTS: Loaded 48940 existing records. [2025-10-15T22:16:07.340814] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:07.341677] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-15T22:16:07.341868] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-15T22:16:07.342329] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-15T22:16:07.342386] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-15T22:16:07.407518] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T22:16:07.484121] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-15T22:16:07.751495] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:07.783417] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-15T22:16:08.113999] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-15T22:16:08.219043] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T22:16:08.225411] [INFO ] [REMOTE ] VSCO: Full fetch complete (76417 records). [2025-10-15T22:16:08.225541] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-15T22:16:08.612564] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-15T22:16:08.612910] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-15T22:16:08.614118] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-15T22:16:08.614182] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-15T22:16:08.615684] [DEBUG] [LOCAL ] VSCO: Trimmed 76417 records to 52738 (keeping 200 days of data) [2025-10-15T22:16:08.915739] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-15T22:16:08.925372] [DEBUG] [LOCAL ] VSCO: Primary data saved (52738 records). [2025-10-15T22:16:08.925499] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-15T22:16:08.925766] [INFO ] [MAIN ] Update Progress: 2251/2369 symbols completed. VSCO took 33.9s. Estimated remaining: 16m 34s. Rate: 7.1 symbols/min [2025-10-15T22:16:09.114920] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:09.127630] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T22:16:09.173294] [DEBUG] [LOCAL ] VTEX: Loaded 42979 existing records from primary storage. [2025-10-15T22:16:09.173576] [INFO ] [MAIN ] VTEX: Loaded 42979 existing records. [2025-10-15T22:16:09.355729] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:09.356227] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-15T22:16:09.356491] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-15T22:16:09.357206] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-15T22:16:09.357287] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-15T22:16:09.619770] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T22:16:09.719079] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-15T22:16:09.770273] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:10.514008] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-15T22:16:11.314045] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-15T22:16:11.384184] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T22:16:11.443116] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-15T22:16:12.075059] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T22:16:12.113968] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-15T22:16:12.319368] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T22:16:12.914006] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-15T22:16:13.621084] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T22:16:13.713955] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-15T22:16:14.269222] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T22:16:14.514061] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-15T22:16:14.984718] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T22:16:15.314011] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-15T22:16:15.644687] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T22:16:16.114026] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-15T22:16:16.817260] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T22:16:16.914002] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-15T22:16:17.429050] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T22:16:17.713992] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-15T22:16:18.329735] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T22:16:18.335799] [INFO ] [REMOTE ] VSH: Full fetch complete (70865 records). [2025-10-15T22:16:18.335965] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-15T22:16:18.522459] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-15T22:16:18.758213] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-15T22:16:18.758322] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-15T22:16:18.759475] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-15T22:16:18.759550] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-15T22:16:18.761112] [DEBUG] [LOCAL ] VSH: Trimmed 70865 records to 48215 (keeping 200 days of data) [2025-10-15T22:16:19.063112] [DEBUG] [LOCAL ] VSH: Primary data saved (48215 records). [2025-10-15T22:16:19.063514] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-15T22:16:19.063725] [INFO ] [MAIN ] Update Progress: 2252/2369 symbols completed. VSH took 33.7s. Estimated remaining: 16m 26s. Rate: 7.1 symbols/min [2025-10-15T22:16:19.249381] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:19.300118] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T22:16:19.326291] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-15T22:16:19.350580] [DEBUG] [LOCAL ] VTLE: Loaded 48088 existing records from primary storage. [2025-10-15T22:16:19.350950] [INFO ] [MAIN ] VTLE: Loaded 48088 existing records. [2025-10-15T22:16:19.542353] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:19.542583] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-15T22:16:19.542633] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-15T22:16:19.543030] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-15T22:16:19.543075] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-15T22:16:19.894484] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:20.113986] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-15T22:16:20.808106] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T22:16:20.923684] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-15T22:16:20.936514] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-15T22:16:21.244501] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T22:16:21.714029] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-15T22:16:22.514068] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-15T22:16:22.554844] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T22:16:22.900163] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T22:16:23.314035] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-15T22:16:24.109344] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T22:16:24.118202] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-15T22:16:24.902263] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T22:16:24.913940] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-15T22:16:25.643168] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T22:16:25.713959] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-15T22:16:26.513988] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-15T22:16:26.631294] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T22:16:27.314049] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-15T22:16:27.850978] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-15T22:16:28.114000] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-15T22:16:28.150575] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T22:16:28.819946] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T22:16:28.913999] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-15T22:16:29.714065] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-15T22:16:30.364921] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T22:16:30.370805] [INFO ] [REMOTE ] VSTS: Full fetch complete (69802 records). [2025-10-15T22:16:30.370958] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-15T22:16:30.522927] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-15T22:16:30.792799] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-15T22:16:30.826997] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-15T22:16:30.827302] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-15T22:16:30.828639] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-15T22:16:30.828937] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-15T22:16:30.830986] [DEBUG] [LOCAL ] VSTS: Trimmed 69802 records to 48944 (keeping 200 days of data) [2025-10-15T22:16:31.131874] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T22:16:31.146690] [DEBUG] [LOCAL ] VSTS: Primary data saved (48944 records). [2025-10-15T22:16:31.146848] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-15T22:16:31.146952] [INFO ] [MAIN ] Update Progress: 2253/2369 symbols completed. VSTS took 24.2s. Estimated remaining: 16m 18s. Rate: 7.1 symbols/min [2025-10-15T22:16:31.314357] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-15T22:16:31.314246] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:31.333193] [DEBUG] [LOCAL ] VTMX: Loaded 17622 existing records from primary storage. [2025-10-15T22:16:31.333555] [INFO ] [MAIN ] VTMX: Loaded 17622 existing records. [2025-10-15T22:16:31.514917] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:31.515119] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-15T22:16:31.515166] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-15T22:16:31.515396] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-15T22:16:31.515453] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-15T22:16:31.906349] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:32.036431] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T22:16:32.113994] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-15T22:16:32.919094] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-15T22:16:32.932072] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T22:16:33.164925] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T22:16:33.714017] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-15T22:16:34.514010] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-15T22:16:35.121773] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-15T22:16:35.257184] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T22:16:35.313973] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-15T22:16:35.481316] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T22:16:36.113996] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-15T22:16:36.913974] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-15T22:16:36.987932] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T22:16:37.133077] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T22:16:37.714017] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-15T22:16:38.157926] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T22:16:38.514352] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-15T22:16:39.314010] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-15T22:16:39.474178] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T22:16:40.113978] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-15T22:16:40.179709] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-15T22:16:40.914016] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-15T22:16:40.963921] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T22:16:41.011241] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T22:16:41.578146] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T22:16:41.584554] [INFO ] [REMOTE ] VST: Full fetch complete (77890 records). [2025-10-15T22:16:41.584726] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-15T22:16:41.725883] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-15T22:16:41.983930] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-15T22:16:41.984020] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-15T22:16:41.985221] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-15T22:16:41.985283] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-15T22:16:41.986743] [DEBUG] [LOCAL ] VST: Trimmed 77890 records to 53711 (keeping 200 days of data) [2025-10-15T22:16:42.326303] [DEBUG] [LOCAL ] VST: Primary data saved (53711 records). [2025-10-15T22:16:42.326434] [INFO ] [MAIN ] VST: Full history saved. [2025-10-15T22:16:42.327454] [INFO ] [MAIN ] Update Progress: 2254/2369 symbols completed. VST took 49.4s. Estimated remaining: 16m 9s. Rate: 7.1 symbols/min [2025-10-15T22:16:42.494311] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:42.503984] [DEBUG] [LOCAL ] VTN: Loaded 6973 existing records from primary storage. [2025-10-15T22:16:42.504210] [INFO ] [MAIN ] VTN: Loaded 6973 existing records. [2025-10-15T22:16:42.524670] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-15T22:16:42.686659] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:42.686981] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-15T22:16:42.687039] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-15T22:16:42.687211] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-15T22:16:42.687265] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-15T22:16:43.039568] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:43.313966] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-15T22:16:43.434496] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T22:16:43.501535] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T22:16:44.114051] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-15T22:16:44.235521] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T22:16:44.883688] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T22:16:44.913986] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-15T22:16:45.714037] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-15T22:16:45.995053] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T22:16:46.327282] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T22:16:46.514011] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-15T22:16:47.314055] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-15T22:16:48.113982] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-15T22:16:48.117050] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T22:16:48.528943] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T22:16:48.874166] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T22:16:48.913976] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-15T22:16:49.714031] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-15T22:16:50.506670] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T22:16:50.513946] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-15T22:16:50.654979] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T22:16:51.314036] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-15T22:16:51.440274] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T22:16:52.113995] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-15T22:16:52.756313] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T22:16:52.761933] [INFO ] [REMOTE ] VTEX: Full fetch complete (60759 records). [2025-10-15T22:16:52.762092] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-15T22:16:52.893943] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T22:16:52.918102] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-15T22:16:52.938272] [INFO ] [REMOTE ] VTMX: Full fetch complete (25650 records). [2025-10-15T22:16:52.997723] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-15T22:16:53.469450] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-15T22:16:53.493084] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-15T22:16:53.496799] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-15T22:16:53.496897] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-15T22:16:53.573926] [DEBUG] [LOCAL ] VTEX: Trimmed 60759 records to 42958 (keeping 200 days of data) [2025-10-15T22:16:53.587621] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-15T22:16:53.588040] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-15T22:16:53.588455] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-15T22:16:53.588518] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-15T22:16:53.589274] [DEBUG] [LOCAL ] VTMX: Trimmed 25650 records to 17592 (keeping 200 days of data) [2025-10-15T22:16:53.742895] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-15T22:16:53.788817] [DEBUG] [LOCAL ] VTMX: Primary data saved (17592 records). [2025-10-15T22:16:53.792969] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-15T22:16:53.793381] [INFO ] [MAIN ] Update Progress: 2255/2369 symbols completed. VTMX took 22.6s. Estimated remaining: 16m 1s. Rate: 7.1 symbols/min [2025-10-15T22:16:53.995403] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:54.118032] [DEBUG] [LOCAL ] VTOL: Loaded 19561 existing records from primary storage. [2025-10-15T22:16:54.121701] [INFO ] [MAIN ] VTOL: Loaded 19561 existing records. [2025-10-15T22:16:54.344739] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:54.346985] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-15T22:16:54.347441] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-15T22:16:54.348800] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-15T22:16:54.348923] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-15T22:16:54.491546] [DEBUG] [LOCAL ] VTEX: Primary data saved (42958 records). [2025-10-15T22:16:54.563244] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T22:16:54.563341] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-15T22:16:54.591381] [INFO ] [MAIN ] Update Progress: 2256/2369 symbols completed. VTEX took 45.7s. Estimated remaining: 15m 52s. Rate: 7.1 symbols/min [2025-10-15T22:16:54.601254] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-15T22:16:54.929146] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:54.957814] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:54.960444] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T22:16:55.021248] [DEBUG] [LOCAL ] VTR: Loaded 52778 existing records from primary storage. [2025-10-15T22:16:55.021568] [INFO ] [MAIN ] VTR: Loaded 52778 existing records. [2025-10-15T22:16:55.213888] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:55.214184] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-15T22:16:55.214245] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-15T22:16:55.214891] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-15T22:16:55.214949] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-15T22:16:55.317721] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-15T22:16:55.367066] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T22:16:55.578407] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:56.114025] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-15T22:16:56.777932] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T22:16:56.783271] [INFO ] [REMOTE ] VTLE: Full fetch complete (68735 records). [2025-10-15T22:16:56.783422] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-15T22:16:56.929433] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-15T22:16:57.180238] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-15T22:16:57.180333] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-15T22:16:57.181450] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-15T22:16:57.181522] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-15T22:16:57.182984] [DEBUG] [LOCAL ] VTLE: Trimmed 68735 records to 48028 (keeping 200 days of data) [2025-10-15T22:16:57.484452] [DEBUG] [LOCAL ] VTLE: Primary data saved (48028 records). [2025-10-15T22:16:57.484631] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-15T22:16:57.484755] [INFO ] [MAIN ] Update Progress: 2257/2369 symbols completed. VTLE took 38.4s. Estimated remaining: 15m 43s. Rate: 7.1 symbols/min [2025-10-15T22:16:57.654409] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:16:57.662222] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T22:16:57.690832] [DEBUG] [LOCAL ] VTS: Loaded 29989 existing records from primary storage. [2025-10-15T22:16:57.691110] [INFO ] [MAIN ] VTS: Loaded 29989 existing records. [2025-10-15T22:16:57.713977] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-15T22:16:57.936350] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:16:57.938545] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T22:16:57.938753] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-15T22:16:57.949273] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-15T22:16:57.949686] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-15T22:16:57.949749] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-15T22:16:58.230149] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T22:16:58.314349] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:16:58.514003] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-15T22:16:59.313972] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-15T22:16:59.576119] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T22:17:00.039340] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T22:17:00.113994] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-15T22:17:00.694097] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T22:17:00.913978] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-15T22:17:01.697626] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T22:17:01.713984] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-15T22:17:02.429895] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T22:17:02.514022] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-15T22:17:03.245861] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T22:17:03.314024] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-15T22:17:04.114000] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-15T22:17:04.913962] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-15T22:17:05.090757] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T22:17:05.165155] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T22:17:05.404947] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T22:17:05.714090] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-15T22:17:06.514106] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-15T22:17:06.850488] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T22:17:07.313998] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-15T22:17:07.710016] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T22:17:07.711273] [INFO ] [REMOTE ] VTN: Full fetch complete (10894 records). [2025-10-15T22:17:07.711340] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-15T22:17:08.051168] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T22:17:08.114788] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-15T22:17:08.115855] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-15T22:17:08.115903] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-15T22:17:08.116191] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-15T22:17:08.116229] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-15T22:17:08.116792] [DEBUG] [LOCAL ] VTN: Trimmed 10894 records to 7008 (keeping 200 days of data) [2025-10-15T22:17:08.158695] [DEBUG] [LOCAL ] VTN: Primary data saved (7008 records). [2025-10-15T22:17:08.158848] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-15T22:17:08.158931] [INFO ] [MAIN ] Update Progress: 2258/2369 symbols completed. VTN took 25.8s. Estimated remaining: 15m 35s. Rate: 7.1 symbols/min [2025-10-15T22:17:08.327332] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:17:08.361143] [DEBUG] [LOCAL ] VVR: Loaded 31242 existing records from primary storage. [2025-10-15T22:17:08.361403] [INFO ] [MAIN ] VVR: Loaded 31242 existing records. [2025-10-15T22:17:08.538202] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:17:08.538443] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-15T22:17:08.538490] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-15T22:17:08.538822] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-15T22:17:08.538878] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-15T22:17:08.882075] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:17:08.913952] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-15T22:17:09.721844] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-15T22:17:09.727835] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T22:17:09.952401] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T22:17:10.514022] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-15T22:17:10.746195] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T22:17:11.314009] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-15T22:17:12.095242] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T22:17:12.113950] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-15T22:17:12.729750] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T22:17:12.914015] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-15T22:17:13.714070] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-15T22:17:13.942826] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T22:17:14.288437] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T22:17:14.514079] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-15T22:17:14.814959] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T22:17:15.314018] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-15T22:17:15.448009] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T22:17:16.114024] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-15T22:17:16.757047] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T22:17:16.914111] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-15T22:17:17.714004] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-15T22:17:17.785676] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T22:17:18.359415] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T22:17:18.513967] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-15T22:17:18.845572] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T22:17:19.313981] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-15T22:17:19.778590] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T22:17:20.114049] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-15T22:17:20.687733] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T22:17:20.830510] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T22:17:20.913988] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-15T22:17:21.714055] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-15T22:17:21.971611] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T22:17:22.513997] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-15T22:17:23.006865] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T22:17:23.314025] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-15T22:17:23.519136] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T22:17:24.113957] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-15T22:17:24.434745] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T22:17:24.914017] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-15T22:17:25.398015] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T22:17:25.713967] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-15T22:17:26.123308] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T22:17:26.514026] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-15T22:17:26.808300] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T22:17:27.314062] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-15T22:17:27.809167] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T22:17:28.113976] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-15T22:17:28.125265] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T22:17:28.127638] [INFO ] [REMOTE ] VTOL: Full fetch complete (26117 records). [2025-10-15T22:17:28.127958] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-15T22:17:28.497908] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-15T22:17:28.497983] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-15T22:17:28.498537] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-15T22:17:28.498640] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-15T22:17:28.499311] [DEBUG] [LOCAL ] VTOL: Trimmed 26117 records to 19622 (keeping 200 days of data) [2025-10-15T22:17:28.610921] [DEBUG] [LOCAL ] VTOL: Primary data saved (19622 records). [2025-10-15T22:17:28.611050] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-15T22:17:28.611124] [INFO ] [MAIN ] Update Progress: 2259/2369 symbols completed. VTOL took 34.8s. Estimated remaining: 15m 27s. Rate: 7.1 symbols/min [2025-10-15T22:17:28.778597] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:17:28.822710] [DEBUG] [LOCAL ] VVV: Loaded 50339 existing records from primary storage. [2025-10-15T22:17:28.822999] [INFO ] [MAIN ] VVV: Loaded 50339 existing records. [2025-10-15T22:17:28.919995] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-15T22:17:29.002941] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:17:29.003222] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-15T22:17:29.003327] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-15T22:17:29.004031] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-15T22:17:29.004089] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-15T22:17:29.352605] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:17:29.524935] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T22:17:29.714029] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-15T22:17:29.934297] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T22:17:30.513995] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-15T22:17:31.314006] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-15T22:17:31.523716] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T22:17:31.552677] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T22:17:32.104566] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T22:17:32.108462] [INFO ] [REMOTE ] VTS: Full fetch complete (41541 records). [2025-10-15T22:17:32.108566] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-15T22:17:32.120615] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-15T22:17:32.532624] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-15T22:17:32.532745] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-15T22:17:32.533758] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-15T22:17:32.533829] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-15T22:17:32.535029] [DEBUG] [LOCAL ] VTS: Trimmed 41541 records to 29996 (keeping 200 days of data) [2025-10-15T22:17:32.735749] [DEBUG] [LOCAL ] VTS: Primary data saved (29996 records). [2025-10-15T22:17:32.735888] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-15T22:17:32.735970] [INFO ] [MAIN ] Update Progress: 2260/2369 symbols completed. VTS took 35.3s. Estimated remaining: 15m 19s. Rate: 7.1 symbols/min [2025-10-15T22:17:32.927394] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:17:32.923403] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-15T22:17:32.951403] [DEBUG] [LOCAL ] VVX: Loaded 22906 existing records from primary storage. [2025-10-15T22:17:32.951693] [INFO ] [MAIN ] VVX: Loaded 22906 existing records. [2025-10-15T22:17:33.150693] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:17:33.150979] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-15T22:17:33.151027] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-15T22:17:33.151294] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-15T22:17:33.151356] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-15T22:17:33.555944] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:17:33.714012] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-15T22:17:33.788625] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T22:17:34.514023] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-15T22:17:34.568674] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T22:17:34.947362] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T22:17:35.314045] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-15T22:17:36.113967] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-15T22:17:36.199499] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T22:17:36.293268] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T22:17:36.297835] [INFO ] [REMOTE ] VVR: Full fetch complete (46799 records). [2025-10-15T22:17:36.297915] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-15T22:17:36.660501] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-15T22:17:36.660573] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-15T22:17:36.661467] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-15T22:17:36.661528] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-15T22:17:36.662460] [DEBUG] [LOCAL ] VVR: Trimmed 46799 records to 31167 (keeping 200 days of data) [2025-10-15T22:17:36.835286] [DEBUG] [LOCAL ] VVR: Primary data saved (31167 records). [2025-10-15T22:17:36.835411] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-15T22:17:36.835494] [INFO ] [MAIN ] Update Progress: 2261/2369 symbols completed. VVR took 28.7s. Estimated remaining: 15m 10s. Rate: 7.1 symbols/min [2025-10-15T22:17:36.923914] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-15T22:17:37.001841] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:17:37.045612] [DEBUG] [LOCAL ] VYX: Loaded 48535 existing records from primary storage. [2025-10-15T22:17:37.045920] [INFO ] [MAIN ] VYX: Loaded 48535 existing records. [2025-10-15T22:17:37.219814] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:17:37.220003] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-15T22:17:37.220050] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-15T22:17:37.220455] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-15T22:17:37.220519] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-15T22:17:37.570928] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:17:37.713956] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-15T22:17:37.803189] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T22:17:38.513974] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-15T22:17:38.774254] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T22:17:39.181047] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T22:17:39.313996] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-15T22:17:40.056392] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T22:17:40.114004] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-15T22:17:40.481445] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T22:17:40.914008] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-15T22:17:41.719096] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-15T22:17:41.736539] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T22:17:41.949630] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T22:17:42.331354] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T22:17:42.337909] [INFO ] [REMOTE ] VTR: Full fetch complete (76511 records). [2025-10-15T22:17:42.338117] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-15T22:17:42.517729] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-15T22:17:42.752772] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-15T22:17:42.752893] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-15T22:17:42.754552] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-15T22:17:42.754629] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-15T22:17:42.756637] [DEBUG] [LOCAL ] VTR: Trimmed 76511 records to 52778 (keeping 200 days of data) [2025-10-15T22:17:43.115183] [DEBUG] [LOCAL ] VTR: Primary data saved (52778 records). [2025-10-15T22:17:43.115386] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-15T22:17:43.115487] [INFO ] [MAIN ] Update Progress: 2262/2369 symbols completed. VTR took 48.5s. Estimated remaining: 15m 2s. Rate: 7.1 symbols/min [2025-10-15T22:17:43.287770] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:17:43.323673] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-15T22:17:43.349954] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-15T22:17:43.350455] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-15T22:17:43.533052] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:17:43.533389] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-15T22:17:43.533443] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-15T22:17:43.533975] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-15T22:17:43.534033] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-15T22:17:43.903905] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:17:44.113971] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-15T22:17:44.205622] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T22:17:44.368263] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T22:17:44.914043] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-15T22:17:45.714008] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-15T22:17:46.514024] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-15T22:17:46.598921] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T22:17:46.633856] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-15T22:17:46.908044] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T22:17:47.314080] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-15T22:17:47.815420] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T22:17:48.114043] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-15T22:17:48.913985] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-15T22:17:49.156233] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T22:17:49.341439] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T22:17:49.714028] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-15T22:17:50.295448] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T22:17:50.513959] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-15T22:17:50.876354] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T22:17:51.314014] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-15T22:17:52.114110] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-15T22:17:52.665180] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-15T22:17:52.919828] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-15T22:17:52.939730] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T22:17:53.714007] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-15T22:17:53.881324] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T22:17:54.514077] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-15T22:17:55.035717] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T22:17:55.077004] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T22:17:55.314025] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-15T22:17:55.804077] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T22:17:56.114026] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-15T22:17:56.913977] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-15T22:17:56.956727] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T22:17:57.272880] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T22:17:57.714025] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-15T22:17:58.077084] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T22:17:58.514006] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-15T22:17:59.313964] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-15T22:17:59.704998] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T22:18:00.114055] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-15T22:18:00.243125] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-15T22:18:00.914028] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-15T22:18:01.040891] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T22:18:01.173432] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T22:18:01.714032] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-15T22:18:02.501397] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T22:18:02.513953] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-15T22:18:03.314031] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-15T22:18:03.891497] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-15T22:18:04.022128] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T22:18:04.028230] [INFO ] [REMOTE ] VVV: Full fetch complete (72617 records). [2025-10-15T22:18:04.028398] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-15T22:18:04.123371] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-15T22:18:04.414386] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-15T22:18:04.414470] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-15T22:18:04.415584] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-15T22:18:04.415698] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-15T22:18:04.417134] [DEBUG] [LOCAL ] VVV: Trimmed 72617 records to 50336 (keeping 200 days of data) [2025-10-15T22:18:04.668844] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T22:18:04.747219] [DEBUG] [LOCAL ] VVV: Primary data saved (50336 records). [2025-10-15T22:18:04.747351] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-15T22:18:04.747431] [INFO ] [MAIN ] Update Progress: 2263/2369 symbols completed. VVV took 36.1s. Estimated remaining: 14m 54s. Rate: 7.1 symbols/min [2025-10-15T22:18:04.910962] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:04.913967] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-15T22:18:04.960816] [DEBUG] [LOCAL ] W: Loaded 53441 existing records from primary storage. [2025-10-15T22:18:04.961155] [INFO ] [MAIN ] W: Loaded 53441 existing records. [2025-10-15T22:18:05.132302] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:05.132497] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-15T22:18:05.132543] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-15T22:18:05.133064] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-15T22:18:05.133120] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-15T22:18:05.501150] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:05.714003] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-15T22:18:05.791117] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T22:18:06.472719] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T22:18:06.475444] [INFO ] [REMOTE ] VVX: Full fetch complete (33110 records). [2025-10-15T22:18:06.475516] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-15T22:18:06.519152] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-15T22:18:06.842998] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-15T22:18:06.843072] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-15T22:18:06.843750] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-15T22:18:06.843896] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-15T22:18:06.844780] [DEBUG] [LOCAL ] VVX: Trimmed 33110 records to 22934 (keeping 200 days of data) [2025-10-15T22:18:06.974255] [DEBUG] [LOCAL ] VVX: Primary data saved (22934 records). [2025-10-15T22:18:06.974379] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-15T22:18:06.974455] [INFO ] [MAIN ] Update Progress: 2264/2369 symbols completed. VVX took 34.2s. Estimated remaining: 14m 45s. Rate: 7.1 symbols/min [2025-10-15T22:18:07.146057] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:07.213142] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-15T22:18:07.211698] [DEBUG] [LOCAL ] WAB: Loaded 44007 existing records from primary storage. [2025-10-15T22:18:07.223428] [INFO ] [MAIN ] WAB: Loaded 44007 existing records. [2025-10-15T22:18:07.323785] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-15T22:18:07.406770] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:07.406977] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-15T22:18:07.407040] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-15T22:18:07.407508] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-15T22:18:07.407576] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-15T22:18:07.782456] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:08.114028] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-15T22:18:08.180366] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T22:18:08.913976] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-15T22:18:09.370694] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T22:18:09.713982] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-15T22:18:10.476799] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-15T22:18:10.519719] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-15T22:18:10.533966] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T22:18:11.313984] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-15T22:18:11.434525] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T22:18:12.114067] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-15T22:18:12.919106] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-15T22:18:12.937600] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-15T22:18:12.987028] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T22:18:13.528547] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T22:18:13.714038] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-15T22:18:14.395247] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T22:18:14.401104] [INFO ] [REMOTE ] VYX: Full fetch complete (70257 records). [2025-10-15T22:18:14.401227] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-15T22:18:14.514864] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-15T22:18:14.807588] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-15T22:18:14.807748] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-15T22:18:14.809290] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-15T22:18:14.809407] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-15T22:18:14.810933] [DEBUG] [LOCAL ] VYX: Trimmed 70257 records to 48499 (keeping 200 days of data) [2025-10-15T22:18:15.108367] [DEBUG] [LOCAL ] VYX: Primary data saved (48499 records). [2025-10-15T22:18:15.108542] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-15T22:18:15.109682] [INFO ] [MAIN ] Update Progress: 2265/2369 symbols completed. VYX took 38.3s. Estimated remaining: 14m 37s. Rate: 7.1 symbols/min [2025-10-15T22:18:15.286513] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:15.314041] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-15T22:18:15.335024] [DEBUG] [LOCAL ] WAL: Loaded 45445 existing records from primary storage. [2025-10-15T22:18:15.335404] [INFO ] [MAIN ] WAL: Loaded 45445 existing records. [2025-10-15T22:18:15.515830] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:15.516126] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-15T22:18:15.516230] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-15T22:18:15.516719] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-15T22:18:15.516780] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-15T22:18:15.914804] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:15.987694] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-15T22:18:16.114008] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-15T22:18:16.503692] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T22:18:16.913988] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-15T22:18:17.209185] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T22:18:17.714052] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-15T22:18:17.765895] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T22:18:18.514022] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-15T22:18:18.597253] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T22:18:19.224619] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T22:18:19.231574] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-15T22:18:19.231747] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-15T22:18:19.319147] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-15T22:18:19.658687] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-15T22:18:19.668803] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-15T22:18:19.675391] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-15T22:18:19.687262] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-15T22:18:19.694716] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T22:18:19.705836] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 53791 (keeping 200 days of data) [2025-10-15T22:18:20.039766] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-15T22:18:20.039894] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-15T22:18:20.039970] [INFO ] [MAIN ] Update Progress: 2266/2369 symbols completed. VZ took 36.9s. Estimated remaining: 14m 28s. Rate: 7.1 symbols/min [2025-10-15T22:18:20.119077] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-15T22:18:20.211849] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:20.244957] [DEBUG] [LOCAL ] WAT: Loaded 35781 existing records from primary storage. [2025-10-15T22:18:20.245236] [INFO ] [MAIN ] WAT: Loaded 35781 existing records. [2025-10-15T22:18:20.429798] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:20.430034] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-15T22:18:20.430084] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-15T22:18:20.430371] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-15T22:18:20.430427] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-15T22:18:20.786217] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:20.914044] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-15T22:18:21.498904] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-15T22:18:21.714028] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-15T22:18:21.969362] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T22:18:22.329018] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T22:18:22.514023] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-15T22:18:23.314029] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-15T22:18:23.358126] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T22:18:23.791868] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T22:18:24.114063] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-15T22:18:24.653319] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T22:18:24.914028] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-15T22:18:25.719077] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-15T22:18:25.733081] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T22:18:26.502747] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T22:18:26.513946] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-15T22:18:27.314008] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-15T22:18:27.704244] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T22:18:27.745206] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T22:18:28.114038] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-15T22:18:28.779557] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T22:18:28.913998] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-15T22:18:29.714019] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-15T22:18:29.791164] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T22:18:30.513986] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-15T22:18:30.682158] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T22:18:31.125741] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T22:18:31.313985] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-15T22:18:32.114030] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-15T22:18:32.308114] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T22:18:32.923290] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-15T22:18:32.928969] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T22:18:33.569898] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T22:18:33.713979] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-15T22:18:34.513983] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-15T22:18:34.694619] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T22:18:35.177787] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T22:18:35.313992] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-15T22:18:36.114039] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-15T22:18:36.259275] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T22:18:36.265518] [INFO ] [REMOTE ] W: Full fetch complete (77531 records). [2025-10-15T22:18:36.265678] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-15T22:18:36.658419] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-15T22:18:36.658505] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-15T22:18:36.659666] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-15T22:18:36.659729] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-15T22:18:36.661239] [DEBUG] [LOCAL ] W: Trimmed 77531 records to 53435 (keeping 200 days of data) [2025-10-15T22:18:36.877735] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T22:18:36.913959] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-15T22:18:36.996752] [DEBUG] [LOCAL ] W: Primary data saved (53435 records). [2025-10-15T22:18:36.996862] [INFO ] [MAIN ] W: Full history saved. [2025-10-15T22:18:36.996938] [INFO ] [MAIN ] Update Progress: 2267/2369 symbols completed. W took 32.2s. Estimated remaining: 14m 20s. Rate: 7.1 symbols/min [2025-10-15T22:18:37.164434] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:37.164583] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-15T22:18:37.164633] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-15T22:18:37.164768] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-15T22:18:37.164809] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-15T22:18:37.164850] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-15T22:18:37.164881] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-15T22:18:37.510836] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:37.680237] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T22:18:37.713958] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-15T22:18:37.906008] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:18:37.906218] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-15T22:18:37.906301] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:18:37.906352] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-15T22:18:37.906410] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:18:37.906480] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-15T22:18:37.906539] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-15T22:18:37.906574] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-15T22:18:37.906612] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-15T22:18:37.906680] [INFO ] [MAIN ] Update Progress: 2268/2369 symbols completed. WBI took 0.9s. Estimated remaining: 14m 11s. Rate: 7.1 symbols/min [2025-10-15T22:18:38.072784] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:38.117180] [DEBUG] [LOCAL ] WBS: Loaded 48738 existing records from primary storage. [2025-10-15T22:18:38.117451] [INFO ] [MAIN ] WBS: Loaded 48738 existing records. [2025-10-15T22:18:38.314159] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:38.315458] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T22:18:38.315620] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-15T22:18:38.321797] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-15T22:18:38.322255] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-15T22:18:38.322313] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-15T22:18:38.519156] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-15T22:18:38.690405] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:39.314070] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-15T22:18:40.114002] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-15T22:18:40.270340] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T22:18:40.355106] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-15T22:18:40.360906] [INFO ] [REMOTE ] WAB: Full fetch complete (64297 records). [2025-10-15T22:18:40.361029] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-15T22:18:40.751719] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-15T22:18:40.751816] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-15T22:18:40.753019] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-15T22:18:40.753101] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-15T22:18:40.779964] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T22:18:40.788857] [DEBUG] [LOCAL ] WAB: Trimmed 64297 records to 43966 (keeping 200 days of data) [2025-10-15T22:18:40.915090] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-15T22:18:41.064637] [DEBUG] [LOCAL ] WAB: Primary data saved (43966 records). [2025-10-15T22:18:41.064792] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-15T22:18:41.064886] [INFO ] [MAIN ] Update Progress: 2269/2369 symbols completed. WAB took 34.1s. Estimated remaining: 14m 3s. Rate: 7.1 symbols/min [2025-10-15T22:18:41.240320] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:41.253870] [DEBUG] [LOCAL ] WBX: Loaded 10592 existing records from primary storage. [2025-10-15T22:18:41.254108] [INFO ] [MAIN ] WBX: Loaded 10592 existing records. [2025-10-15T22:18:41.439524] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:41.439821] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-15T22:18:41.439891] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-15T22:18:41.440126] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-15T22:18:41.440199] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-15T22:18:41.719088] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-15T22:18:41.800550] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:42.411403] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T22:18:42.514031] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-15T22:18:43.095681] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T22:18:43.314013] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-15T22:18:43.950872] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T22:18:44.114015] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-15T22:18:44.914029] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-15T22:18:44.980917] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T22:18:45.612503] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T22:18:45.669500] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T22:18:45.714011] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-15T22:18:46.137137] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T22:18:46.143167] [INFO ] [REMOTE ] WAT: Full fetch complete (50447 records). [2025-10-15T22:18:46.143383] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-15T22:18:46.518842] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-15T22:18:46.518505] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-15T22:18:46.519188] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-15T22:18:46.522604] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-15T22:18:46.522868] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-15T22:18:46.524605] [DEBUG] [LOCAL ] WAT: Trimmed 50447 records to 35821 (keeping 200 days of data) [2025-10-15T22:18:46.764133] [DEBUG] [LOCAL ] WAT: Primary data saved (35821 records). [2025-10-15T22:18:46.764338] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-15T22:18:46.764460] [INFO ] [MAIN ] Update Progress: 2270/2369 symbols completed. WAT took 26.7s. Estimated remaining: 13m 54s. Rate: 7.1 symbols/min [2025-10-15T22:18:46.936389] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:18:46.980209] [DEBUG] [LOCAL ] WCC: Loaded 39070 existing records from primary storage. [2025-10-15T22:18:46.980564] [INFO ] [MAIN ] WCC: Loaded 39070 existing records. [2025-10-15T22:18:47.157033] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:18:47.157264] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-15T22:18:47.157313] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-15T22:18:47.157689] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-15T22:18:47.157744] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-15T22:18:47.343226] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-15T22:18:47.564315] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:18:47.805619] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T22:18:48.114071] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-15T22:18:48.719583] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T22:18:48.914016] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-15T22:18:49.240282] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T22:18:49.713979] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-15T22:18:49.779546] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T22:18:50.514005] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-15T22:18:50.836614] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T22:18:51.313994] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-15T22:18:52.114018] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-15T22:18:52.175272] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:18:52.594776] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T22:18:52.913995] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-15T22:18:53.431709] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T22:18:53.713973] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-15T22:18:54.383460] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T22:18:54.514002] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-15T22:18:55.314113] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-15T22:18:55.383974] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T22:18:56.089326] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T22:18:56.113952] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-15T22:18:56.927695] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-15T22:18:56.930538] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T22:18:57.057624] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T22:18:57.714066] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-15T22:18:58.514004] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-15T22:18:58.581876] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T22:18:58.720788] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T22:18:59.314081] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-15T22:18:59.946888] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-15T22:19:00.113996] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-15T22:19:00.115994] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T22:19:00.562884] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T22:19:00.914045] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-15T22:19:01.566997] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T22:19:01.714002] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-15T22:19:02.421253] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T22:19:02.423269] [INFO ] [REMOTE ] WBX: Full fetch complete (23182 records). [2025-10-15T22:19:02.423360] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-15T22:19:02.519230] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-15T22:19:02.826248] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-15T22:19:02.826358] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-15T22:19:02.827144] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-15T22:19:02.827209] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-15T22:19:02.827989] [DEBUG] [LOCAL ] WBX: Trimmed 23182 records to 10429 (keeping 200 days of data) [2025-10-15T22:19:02.888013] [DEBUG] [LOCAL ] WBX: Primary data saved (10429 records). [2025-10-15T22:19:02.888205] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-15T22:19:02.888351] [INFO ] [MAIN ] Update Progress: 2271/2369 symbols completed. WBX took 21.8s. Estimated remaining: 13m 46s. Rate: 7.1 symbols/min [2025-10-15T22:19:03.062025] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:19:03.119542] [DEBUG] [LOCAL ] WCN: Loaded 48017 existing records from primary storage. [2025-10-15T22:19:03.120029] [INFO ] [MAIN ] WCN: Loaded 48017 existing records. [2025-10-15T22:19:03.309960] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:19:03.310276] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-15T22:19:03.310330] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-15T22:19:03.310799] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-15T22:19:03.310859] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-15T22:19:03.322431] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-15T22:19:03.695229] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:19:03.945591] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T22:19:04.114042] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-15T22:19:04.501621] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T22:19:04.508191] [INFO ] [REMOTE ] WAL: Full fetch complete (66973 records). [2025-10-15T22:19:04.508402] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-15T22:19:04.922899] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-15T22:19:04.927634] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-15T22:19:04.927797] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-15T22:19:04.929750] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-15T22:19:04.929937] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-15T22:19:04.932411] [DEBUG] [LOCAL ] WAL: Trimmed 66973 records to 45512 (keeping 200 days of data) [2025-10-15T22:19:05.242107] [DEBUG] [LOCAL ] WAL: Primary data saved (45512 records). [2025-10-15T22:19:05.242322] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-15T22:19:05.243626] [INFO ] [MAIN ] Update Progress: 2272/2369 symbols completed. WAL took 50.1s. Estimated remaining: 13m 37s. Rate: 7.1 symbols/min [2025-10-15T22:19:05.429864] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:19:05.458736] [DEBUG] [LOCAL ] WD: Loaded 23172 existing records from primary storage. [2025-10-15T22:19:05.459219] [INFO ] [MAIN ] WD: Loaded 23172 existing records. [2025-10-15T22:19:05.654461] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:19:05.654873] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-15T22:19:05.654969] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-15T22:19:05.655474] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-15T22:19:05.655538] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-15T22:19:05.721138] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-15T22:19:06.000262] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T22:19:06.103319] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:19:06.514032] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-15T22:19:06.601851] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T22:19:07.174408] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T22:19:07.323214] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-15T22:19:07.330733] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T22:19:08.114031] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-15T22:19:08.503295] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T22:19:08.914001] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-15T22:19:09.612084] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T22:19:09.713979] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-15T22:19:10.107281] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T22:19:10.514097] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-15T22:19:11.258819] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T22:19:11.314041] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-15T22:19:12.113992] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-15T22:19:12.215182] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T22:19:12.789733] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T22:19:12.914001] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-15T22:19:13.295399] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T22:19:13.714005] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-15T22:19:14.453835] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T22:19:14.513999] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-15T22:19:15.060363] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T22:19:15.314018] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-15T22:19:16.114052] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-15T22:19:16.139296] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T22:19:16.921006] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-15T22:19:16.925907] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T22:19:16.935943] [INFO ] [REMOTE ] WBS: Full fetch complete (70089 records). [2025-10-15T22:19:16.936089] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-15T22:19:17.337113] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-15T22:19:17.337296] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-15T22:19:17.338630] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-15T22:19:17.338742] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-15T22:19:17.352760] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T22:19:17.357608] [DEBUG] [LOCAL ] WBS: Trimmed 70089 records to 48740 (keeping 200 days of data) [2025-10-15T22:19:17.646946] [DEBUG] [LOCAL ] WBS: Primary data saved (48740 records). [2025-10-15T22:19:17.647079] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-15T22:19:17.647154] [INFO ] [MAIN ] Update Progress: 2273/2369 symbols completed. WBS took 39.7s. Estimated remaining: 13m 29s. Rate: 7.1 symbols/min [2025-10-15T22:19:17.721805] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-15T22:19:17.824255] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:19:17.841897] [DEBUG] [LOCAL ] WDH: Loaded 18114 existing records from primary storage. [2025-10-15T22:19:17.842134] [INFO ] [MAIN ] WDH: Loaded 18114 existing records. [2025-10-15T22:19:18.018266] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:19:18.018540] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-15T22:19:18.018593] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-15T22:19:18.018837] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-15T22:19:18.018893] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-15T22:19:18.376399] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:19:18.415928] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T22:19:18.513969] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-15T22:19:19.204635] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T22:19:19.313957] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-15T22:19:19.420938] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T22:19:20.114062] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-15T22:19:20.791927] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T22:19:20.913953] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-15T22:19:21.162126] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T22:19:21.714012] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-15T22:19:21.995730] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T22:19:22.000009] [INFO ] [REMOTE ] WCC: Full fetch complete (57498 records). [2025-10-15T22:19:22.000093] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-15T22:19:22.376414] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-15T22:19:22.376488] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-15T22:19:22.377490] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-15T22:19:22.377551] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-15T22:19:22.378710] [DEBUG] [LOCAL ] WCC: Trimmed 57498 records to 39073 (keeping 200 days of data) [2025-10-15T22:19:22.555409] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-15T22:19:22.626301] [DEBUG] [LOCAL ] WCC: Primary data saved (39073 records). [2025-10-15T22:19:22.626421] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-15T22:19:22.627191] [INFO ] [MAIN ] Update Progress: 2274/2369 symbols completed. WCC took 35.9s. Estimated remaining: 13m 20s. Rate: 7.1 symbols/min [2025-10-15T22:19:22.805760] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:19:22.830080] [DEBUG] [LOCAL ] WDI: Loaded 21180 existing records from primary storage. [2025-10-15T22:19:22.830355] [INFO ] [MAIN ] WDI: Loaded 21180 existing records. [2025-10-15T22:19:23.029805] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:19:23.041087] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-15T22:19:23.042325] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T22:19:23.041788] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-15T22:19:23.047936] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-15T22:19:23.048100] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-15T22:19:23.319512] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-15T22:19:23.319447] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T22:19:23.417287] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:19:24.114055] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-15T22:19:24.539433] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T22:19:24.868868] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T22:19:24.914013] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-15T22:19:25.713982] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-15T22:19:25.802670] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T22:19:26.514004] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-15T22:19:26.819901] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T22:19:27.314007] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-15T22:19:27.829380] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T22:19:28.114019] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-15T22:19:28.914078] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-15T22:19:28.960624] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T22:19:29.167297] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T22:19:29.713996] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-15T22:19:29.760199] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T22:19:30.499895] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T22:19:30.513953] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-15T22:19:31.314063] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-15T22:19:31.451062] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T22:19:31.455843] [INFO ] [REMOTE ] WD: Full fetch complete (33263 records). [2025-10-15T22:19:31.456130] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-15T22:19:31.930845] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T22:19:32.058862] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-15T22:19:32.058966] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-15T22:19:32.059869] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-15T22:19:32.059942] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-15T22:19:32.061022] [DEBUG] [LOCAL ] WD: Trimmed 33263 records to 23147 (keeping 200 days of data) [2025-10-15T22:19:32.116566] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-15T22:19:32.225171] [DEBUG] [LOCAL ] WD: Primary data saved (23147 records). [2025-10-15T22:19:32.225464] [INFO ] [MAIN ] WD: Full history saved. [2025-10-15T22:19:32.225573] [INFO ] [MAIN ] Update Progress: 2275/2369 symbols completed. WD took 27.0s. Estimated remaining: 13m 12s. Rate: 7.1 symbols/min [2025-10-15T22:19:32.406231] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:19:32.449197] [DEBUG] [LOCAL ] WDS: Loaded 43136 existing records from primary storage. [2025-10-15T22:19:32.449502] [INFO ] [MAIN ] WDS: Loaded 43136 existing records. [2025-10-15T22:19:32.621103] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:19:32.621311] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-15T22:19:32.621359] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-15T22:19:32.622041] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-15T22:19:32.622101] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-15T22:19:32.919124] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-15T22:19:32.982549] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:19:33.189956] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T22:19:33.714002] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-15T22:19:34.514066] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-15T22:19:34.540485] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T22:19:34.832623] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T22:19:35.226004] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T22:19:35.313959] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-15T22:19:36.113985] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-15T22:19:36.417445] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T22:19:36.914004] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-15T22:19:37.153569] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T22:19:37.714026] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-15T22:19:37.739721] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T22:19:38.513998] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-15T22:19:38.757837] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T22:19:39.314017] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-15T22:19:40.114016] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-15T22:19:40.192529] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T22:19:40.738404] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T22:19:40.914071] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-15T22:19:41.465988] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T22:19:41.714006] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-15T22:19:42.444559] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T22:19:42.513972] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-15T22:19:43.313973] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-15T22:19:43.459316] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T22:19:43.876088] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T22:19:44.113963] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-15T22:19:44.367909] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T22:19:44.914007] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-15T22:19:45.714019] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-15T22:19:45.748792] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T22:19:46.065431] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T22:19:46.068916] [INFO ] [REMOTE ] WDH: Full fetch complete (23844 records). [2025-10-15T22:19:46.068992] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-15T22:19:46.428921] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-15T22:19:46.428992] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-15T22:19:46.429457] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-15T22:19:46.429494] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-15T22:19:46.430096] [DEBUG] [LOCAL ] WDH: Trimmed 23844 records to 18120 (keeping 200 days of data) [2025-10-15T22:19:46.514676] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-15T22:19:46.535187] [DEBUG] [LOCAL ] WDH: Primary data saved (18120 records). [2025-10-15T22:19:46.535278] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-15T22:19:46.535349] [INFO ] [MAIN ] Update Progress: 2276/2369 symbols completed. WDH took 28.9s. Estimated remaining: 13m 4s. Rate: 7.1 symbols/min [2025-10-15T22:19:46.707682] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:19:46.716095] [DEBUG] [LOCAL ] WEA: Loaded 7733 existing records from primary storage. [2025-10-15T22:19:46.716254] [INFO ] [MAIN ] WEA: Loaded 7733 existing records. [2025-10-15T22:19:46.857740] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T22:19:46.917270] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:19:46.917457] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-15T22:19:46.917504] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-15T22:19:46.917738] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-15T22:19:46.917796] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-15T22:19:47.279174] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:19:47.313955] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-15T22:19:47.932918] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T22:19:48.092901] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T22:19:48.113950] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-15T22:19:48.913983] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-15T22:19:49.412319] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T22:19:49.581990] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T22:19:49.714017] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-15T22:19:50.514041] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-15T22:19:51.220302] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T22:19:51.313968] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-15T22:19:51.794494] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T22:19:52.114002] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-15T22:19:52.692971] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T22:19:52.915007] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-15T22:19:52.917817] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T22:19:53.714000] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-15T22:19:54.514051] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-15T22:19:54.595261] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T22:19:54.957336] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T22:19:55.314015] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-15T22:19:55.776036] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T22:19:56.114014] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-15T22:19:56.863044] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T22:19:56.868799] [INFO ] [REMOTE ] WCN: Full fetch complete (69495 records). [2025-10-15T22:19:56.868915] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-15T22:19:56.926043] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-15T22:19:57.258980] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-15T22:19:57.259055] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-15T22:19:57.260167] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-15T22:19:57.260228] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-15T22:19:57.261638] [DEBUG] [LOCAL ] WCN: Trimmed 69495 records to 48049 (keeping 200 days of data) [2025-10-15T22:19:57.579325] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T22:19:57.595877] [DEBUG] [LOCAL ] WCN: Primary data saved (48049 records). [2025-10-15T22:19:57.596003] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-15T22:19:57.596079] [INFO ] [MAIN ] Update Progress: 2277/2369 symbols completed. WCN took 54.7s. Estimated remaining: 12m 55s. Rate: 7.1 symbols/min [2025-10-15T22:19:57.647327] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T22:19:57.714036] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-15T22:19:58.305549] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T22:19:58.514062] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-15T22:19:59.313997] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-15T22:19:59.876760] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T22:19:59.882197] [INFO ] [REMOTE ] WDS: Full fetch complete (64282 records). [2025-10-15T22:19:59.882345] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-15T22:19:59.992863] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T22:20:00.116307] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-15T22:20:00.342961] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-15T22:20:00.343049] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-15T22:20:00.344127] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-15T22:20:00.344198] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-15T22:20:00.345721] [DEBUG] [LOCAL ] WDS: Trimmed 64282 records to 43167 (keeping 200 days of data) [2025-10-15T22:20:00.612119] [DEBUG] [LOCAL ] WDS: Primary data saved (43167 records). [2025-10-15T22:20:00.612251] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-15T22:20:00.613112] [INFO ] [MAIN ] Update Progress: 2278/2369 symbols completed. WDS took 28.4s. Estimated remaining: 12m 47s. Rate: 7.1 symbols/min [2025-10-15T22:20:00.674327] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T22:20:00.914017] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-15T22:20:01.717706] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-15T22:20:01.720339] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T22:20:02.514068] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-15T22:20:02.648600] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T22:20:03.314053] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-15T22:20:03.335472] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T22:20:04.114048] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-15T22:20:04.286319] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T22:20:04.289145] [INFO ] [REMOTE ] WDI: Full fetch complete (30450 records). [2025-10-15T22:20:04.289231] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-15T22:20:04.674815] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-15T22:20:04.674896] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-15T22:20:04.675494] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-15T22:20:04.675537] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-15T22:20:04.676301] [DEBUG] [LOCAL ] WDI: Trimmed 30450 records to 21237 (keeping 200 days of data) [2025-10-15T22:20:04.790961] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T22:20:04.841413] [DEBUG] [LOCAL ] WDI: Primary data saved (21237 records). [2025-10-15T22:20:04.841541] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-15T22:20:04.841618] [INFO ] [MAIN ] Update Progress: 2279/2369 symbols completed. WDI took 42.2s. Estimated remaining: 12m 38s. Rate: 7.1 symbols/min [2025-10-15T22:20:04.914028] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-15T22:20:05.621005] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T22:20:05.714035] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-15T22:20:06.398183] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T22:20:06.400396] [INFO ] [REMOTE ] WEA: Full fetch complete (10007 records). [2025-10-15T22:20:06.400479] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-15T22:20:06.767814] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-15T22:20:06.767912] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-15T22:20:06.768169] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-15T22:20:06.768208] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-15T22:20:06.768702] [DEBUG] [LOCAL ] WEA: Trimmed 10007 records to 7761 (keeping 200 days of data) [2025-10-15T22:20:06.813805] [DEBUG] [LOCAL ] WEA: Primary data saved (7761 records). [2025-10-15T22:20:06.813925] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-15T22:20:06.814001] [INFO ] [MAIN ] Update Progress: 2280/2369 symbols completed. WEA took 20.3s. Estimated remaining: 12m 30s. Rate: 7.1 symbols/min [2025-10-15T22:20:07.451192] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:07.476401] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:07.526437] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:07.525284] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:07.624116] [DEBUG] [LOCAL ] WEAV: Loaded 42250 existing records from primary storage. [2025-10-15T22:20:07.625335] [INFO ] [MAIN ] WEAV: Loaded 42250 existing records. [2025-10-15T22:20:07.669987] [DEBUG] [LOCAL ] WES: Loaded 48500 existing records from primary storage. [2025-10-15T22:20:07.715352] [DEBUG] [LOCAL ] WEC: Loaded 52186 existing records from primary storage. [2025-10-15T22:20:07.713550] [INFO ] [MAIN ] WES: Loaded 48500 existing records. [2025-10-15T22:20:07.740291] [INFO ] [MAIN ] WEC: Loaded 52186 existing records. [2025-10-15T22:20:07.714383] [DEBUG] [LOCAL ] WELL: Loaded 52329 existing records from primary storage. [2025-10-15T22:20:07.810558] [INFO ] [MAIN ] WELL: Loaded 52329 existing records. [2025-10-15T22:20:08.298342] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:08.300797] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-15T22:20:08.300570] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:08.342254] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-15T22:20:08.334220] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-15T22:20:08.347582] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-15T22:20:08.369476] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:08.382900] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-15T22:20:08.405626] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-15T22:20:08.412576] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:08.412923] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-15T22:20:08.413003] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-15T22:20:08.413086] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-15T22:20:08.413243] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-15T22:20:08.429436] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-15T22:20:08.478204] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-15T22:20:08.464068] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-15T22:20:08.483638] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-15T22:20:08.579814] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-15T22:20:08.623404] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-15T22:20:09.737083] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:09.785930] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-15T22:20:09.790910] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:09.794005] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-15T22:20:09.818829] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:09.849243] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-15T22:20:09.883212] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:09.884859] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-15T22:20:11.192685] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T22:20:11.202133] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-15T22:20:11.420627] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T22:20:11.429767] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-15T22:20:11.528316] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T22:20:11.540010] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-15T22:20:11.697888] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T22:20:12.114059] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-15T22:20:12.511147] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T22:20:12.880371] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T22:20:12.914069] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-15T22:20:12.958694] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T22:20:13.720111] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-15T22:20:13.725851] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T22:20:14.435762] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T22:20:14.513978] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-15T22:20:15.166330] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T22:20:15.314027] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-15T22:20:16.114072] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-15T22:20:16.196688] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T22:20:16.502067] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T22:20:16.914054] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-15T22:20:17.692450] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T22:20:17.714005] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-15T22:20:18.444636] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T22:20:18.513999] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-15T22:20:19.313966] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-15T22:20:19.651494] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T22:20:19.943252] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T22:20:20.114067] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-15T22:20:20.850171] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T22:20:20.914028] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-15T22:20:21.396248] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T22:20:21.714093] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-15T22:20:22.514066] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-15T22:20:22.688303] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T22:20:23.297261] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T22:20:23.313957] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-15T22:20:24.114025] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-15T22:20:24.216404] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T22:20:24.793537] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T22:20:24.914027] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-15T22:20:25.650666] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T22:20:25.714027] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-15T22:20:26.101430] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T22:20:26.513999] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-15T22:20:27.314053] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-15T22:20:27.376080] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:20:28.113992] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-15T22:20:28.239168] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T22:20:28.765890] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T22:20:28.914012] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-15T22:20:29.497451] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T22:20:29.714003] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-15T22:20:30.392801] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T22:20:30.513997] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-15T22:20:31.314034] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-15T22:20:31.557335] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T22:20:32.114032] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-15T22:20:32.196454] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:20:32.813190] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T22:20:32.914018] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-15T22:20:33.377960] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T22:20:33.714040] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-15T22:20:34.513970] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-15T22:20:34.836856] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T22:20:35.018368] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T22:20:35.314006] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-15T22:20:36.114094] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-15T22:20:36.157280] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T22:20:36.798819] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T22:20:36.914004] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-15T22:20:37.591837] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T22:20:37.601066] [INFO ] [REMOTE ] WES: Full fetch complete (70427 records). [2025-10-15T22:20:37.601244] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-15T22:20:37.719185] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-15T22:20:37.987209] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-15T22:20:37.987283] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-15T22:20:37.988399] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-15T22:20:37.988461] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-15T22:20:37.990109] [DEBUG] [LOCAL ] WES: Trimmed 70427 records to 48498 (keeping 200 days of data) [2025-10-15T22:20:38.287026] [DEBUG] [LOCAL ] WES: Primary data saved (48498 records). [2025-10-15T22:20:38.287182] [INFO ] [MAIN ] WES: Full history saved. [2025-10-15T22:20:38.287274] [INFO ] [MAIN ] Update Progress: 2281/2369 symbols completed. WES took 31.5s. Estimated remaining: 12m 22s. Rate: 7.1 symbols/min [2025-10-15T22:20:38.479767] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T22:20:38.484201] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:38.490951] [INFO ] [REMOTE ] WEAV: Full fetch complete (61784 records). [2025-10-15T22:20:38.491106] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-15T22:20:38.526346] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-15T22:20:38.781674] [DEBUG] [LOCAL ] WEX: Loaded 33069 existing records from primary storage. [2025-10-15T22:20:38.799460] [INFO ] [MAIN ] WEX: Loaded 33069 existing records. [2025-10-15T22:20:39.064738] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-15T22:20:39.095638] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-15T22:20:39.095390] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:39.097079] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-15T22:20:39.097310] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-15T22:20:39.097474] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-15T22:20:39.097560] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-15T22:20:39.098579] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-15T22:20:39.098740] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-15T22:20:39.131576] [DEBUG] [LOCAL ] WEAV: Trimmed 61784 records to 42273 (keeping 200 days of data) [2025-10-15T22:20:39.528531] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T22:20:39.554071] [INFO ] [REMOTE ] WELL: Full fetch complete (75918 records). [2025-10-15T22:20:39.562418] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-15T22:20:39.752713] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:39.795818] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-15T22:20:40.109708] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-15T22:20:40.183853] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-15T22:20:40.207183] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-15T22:20:40.207564] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-15T22:20:40.209320] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-15T22:20:40.209738] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-15T22:20:40.214541] [DEBUG] [LOCAL ] WELL: Trimmed 75918 records to 52330 (keeping 200 days of data) [2025-10-15T22:20:40.324974] [DEBUG] [LOCAL ] WEAV: Primary data saved (42273 records). [2025-10-15T22:20:40.325731] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-15T22:20:40.326141] [INFO ] [MAIN ] Update Progress: 2282/2369 symbols completed. WEAV took 33.5s. Estimated remaining: 12m 13s. Rate: 7.1 symbols/min [2025-10-15T22:20:40.508337] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:40.524866] [DEBUG] [LOCAL ] WF: Loaded 10980 existing records from primary storage. [2025-10-15T22:20:40.526295] [INFO ] [MAIN ] WF: Loaded 10980 existing records. [2025-10-15T22:20:40.714776] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:40.715639] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-15T22:20:40.715776] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-15T22:20:40.717006] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-15T22:20:40.719047] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-15T22:20:41.213065] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:41.214392] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-15T22:20:41.241945] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T22:20:41.334516] [DEBUG] [LOCAL ] WELL: Primary data saved (52330 records). [2025-10-15T22:20:41.334673] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-15T22:20:41.334773] [INFO ] [MAIN ] Update Progress: 2283/2369 symbols completed. WELL took 34.5s. Estimated remaining: 12m 5s. Rate: 7.1 symbols/min [2025-10-15T22:20:41.506706] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:41.556858] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-15T22:20:41.557180] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-15T22:20:41.718079] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-15T22:20:41.742892] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:41.744354] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-15T22:20:41.744487] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-15T22:20:41.745380] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-15T22:20:41.745440] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-15T22:20:42.127566] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:42.160594] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T22:20:42.230425] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T22:20:42.514002] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-15T22:20:42.877010] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T22:20:43.313982] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-15T22:20:43.377874] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T22:20:44.114006] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-15T22:20:44.913992] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-15T22:20:44.928570] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T22:20:45.066629] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T22:20:45.714003] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-15T22:20:46.514054] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-15T22:20:46.527372] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T22:20:46.709181] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T22:20:47.186099] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T22:20:47.192545] [INFO ] [REMOTE ] WEC: Full fetch complete (75800 records). [2025-10-15T22:20:47.192750] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-15T22:20:47.319160] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-15T22:20:47.633720] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-15T22:20:47.633832] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-15T22:20:47.635252] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-15T22:20:47.635320] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-15T22:20:47.637188] [DEBUG] [LOCAL ] WEC: Trimmed 75800 records to 52174 (keeping 200 days of data) [2025-10-15T22:20:47.976348] [DEBUG] [LOCAL ] WEC: Primary data saved (52174 records). [2025-10-15T22:20:47.976478] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-15T22:20:47.977442] [INFO ] [MAIN ] Update Progress: 2284/2369 symbols completed. WEC took 41.2s. Estimated remaining: 11m 56s. Rate: 7.1 symbols/min [2025-10-15T22:20:48.121234] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-15T22:20:48.153707] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:20:48.180621] [DEBUG] [LOCAL ] WFG: Loaded 24783 existing records from primary storage. [2025-10-15T22:20:48.180915] [INFO ] [MAIN ] WFG: Loaded 24783 existing records. [2025-10-15T22:20:48.378564] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:20:48.388434] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T22:20:48.388529] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-15T22:20:48.391876] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-15T22:20:48.392965] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-15T22:20:48.393037] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-15T22:20:48.767210] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:20:48.914016] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-15T22:20:49.338308] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T22:20:49.714083] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-15T22:20:50.495057] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T22:20:50.514026] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-15T22:20:50.782439] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T22:20:51.314004] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-15T22:20:51.884696] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T22:20:52.114061] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-15T22:20:52.259892] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T22:20:52.914063] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-15T22:20:53.714022] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-15T22:20:54.024143] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T22:20:54.494959] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T22:20:54.513963] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-15T22:20:54.694787] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T22:20:55.314014] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-15T22:20:55.585687] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T22:20:56.114000] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-15T22:20:56.914012] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-15T22:20:57.161804] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T22:20:57.538608] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T22:20:57.566698] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T22:20:57.713997] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-15T22:20:58.514014] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-15T22:20:59.134898] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T22:20:59.313973] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-15T22:20:59.638511] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T22:21:00.113982] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-15T22:21:00.531174] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T22:21:00.913997] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-15T22:21:01.371576] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T22:21:01.713992] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-15T22:21:02.513969] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-15T22:21:02.782871] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T22:21:03.051282] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T22:21:03.314011] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-15T22:21:03.374235] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T22:21:04.114045] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-15T22:21:04.655513] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T22:21:04.845308] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T22:21:04.914003] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-15T22:21:05.713976] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-15T22:21:05.728276] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T22:21:05.730188] [INFO ] [REMOTE ] WF: Full fetch complete (16300 records). [2025-10-15T22:21:05.730261] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-15T22:21:06.092344] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-15T22:21:06.092431] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-15T22:21:06.092824] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-15T22:21:06.092885] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-15T22:21:06.093411] [DEBUG] [LOCAL ] WF: Trimmed 16300 records to 10985 (keeping 200 days of data) [2025-10-15T22:21:06.163102] [DEBUG] [LOCAL ] WF: Primary data saved (10985 records). [2025-10-15T22:21:06.163250] [INFO ] [MAIN ] WF: Full history saved. [2025-10-15T22:21:06.163332] [INFO ] [MAIN ] Update Progress: 2285/2369 symbols completed. WF took 25.8s. Estimated remaining: 11m 48s. Rate: 7.1 symbols/min [2025-10-15T22:21:06.333509] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:21:06.369314] [DEBUG] [LOCAL ] WGO: Loaded 38217 existing records from primary storage. [2025-10-15T22:21:06.369597] [INFO ] [MAIN ] WGO: Loaded 38217 existing records. [2025-10-15T22:21:06.519150] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-15T22:21:06.560965] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:21:06.561191] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-15T22:21:06.561256] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-15T22:21:06.562005] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-15T22:21:06.562061] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-15T22:21:06.971553] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T22:21:06.975983] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:21:07.314010] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-15T22:21:07.875687] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T22:21:08.113985] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-15T22:21:08.508526] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T22:21:08.914027] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-15T22:21:09.337766] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T22:21:09.341423] [INFO ] [REMOTE ] WEX: Full fetch complete (50394 records). [2025-10-15T22:21:09.341532] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-15T22:21:09.719185] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-15T22:21:09.800289] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-15T22:21:09.800376] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-15T22:21:09.801485] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-15T22:21:09.801551] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-15T22:21:09.802721] [DEBUG] [LOCAL ] WEX: Trimmed 50394 records to 32945 (keeping 200 days of data) [2025-10-15T22:21:10.023726] [DEBUG] [LOCAL ] WEX: Primary data saved (32945 records). [2025-10-15T22:21:10.023873] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-15T22:21:10.023959] [INFO ] [MAIN ] Update Progress: 2286/2369 symbols completed. WEX took 31.7s. Estimated remaining: 11m 39s. Rate: 7.1 symbols/min [2025-10-15T22:21:10.217613] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:21:10.260840] [DEBUG] [LOCAL ] WH: Loaded 45249 existing records from primary storage. [2025-10-15T22:21:10.261170] [INFO ] [MAIN ] WH: Loaded 45249 existing records. [2025-10-15T22:21:10.451409] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:21:10.451834] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-15T22:21:10.451955] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-15T22:21:10.452855] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-15T22:21:10.452914] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-15T22:21:10.518769] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-15T22:21:10.844574] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:21:10.849270] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T22:21:11.314017] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-15T22:21:11.466573] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T22:21:11.719282] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T22:21:12.114019] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-15T22:21:12.914040] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-15T22:21:13.017598] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T22:21:13.135290] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T22:21:13.712394] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T22:21:13.718015] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-15T22:21:14.514023] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-15T22:21:15.313977] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-15T22:21:15.384351] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T22:21:16.113976] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-15T22:21:16.411196] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T22:21:16.913978] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-15T22:21:16.959912] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T22:21:17.677842] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T22:21:17.713957] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-15T22:21:17.973557] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T22:21:18.514023] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-15T22:21:19.153543] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T22:21:19.313964] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-15T22:21:19.647934] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T22:21:20.114004] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-15T22:21:20.716934] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T22:21:20.913994] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-15T22:21:21.346454] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T22:21:21.714004] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-15T22:21:22.514005] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-15T22:21:23.246537] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T22:21:23.313963] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-15T22:21:23.710293] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T22:21:24.114028] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-15T22:21:24.884532] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T22:21:24.913997] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-15T22:21:25.101262] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T22:21:25.104593] [INFO ] [REMOTE ] WFG: Full fetch complete (36154 records). [2025-10-15T22:21:25.104775] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-15T22:21:25.494261] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-15T22:21:25.494345] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-15T22:21:25.495372] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-15T22:21:25.495441] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-15T22:21:25.496470] [DEBUG] [LOCAL ] WFG: Trimmed 36154 records to 24781 (keeping 200 days of data) [2025-10-15T22:21:25.656908] [DEBUG] [LOCAL ] WFG: Primary data saved (24781 records). [2025-10-15T22:21:25.657742] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-15T22:21:25.657848] [INFO ] [MAIN ] Update Progress: 2287/2369 symbols completed. WFG took 37.7s. Estimated remaining: 11m 31s. Rate: 7.1 symbols/min [2025-10-15T22:21:25.722228] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-15T22:21:25.840348] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:21:25.879883] [DEBUG] [LOCAL ] WHD: Loaded 40178 existing records from primary storage. [2025-10-15T22:21:25.880288] [INFO ] [MAIN ] WHD: Loaded 40178 existing records. [2025-10-15T22:21:26.085460] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:21:26.085922] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-15T22:21:26.086000] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-15T22:21:26.086759] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-15T22:21:26.086821] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-15T22:21:26.302200] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (5.39 seconds). [2025-10-15T22:21:26.486662] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:21:26.513972] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-15T22:21:26.683152] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T22:21:27.314001] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-15T22:21:27.439352] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T22:21:27.692313] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T22:21:28.113995] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-15T22:21:28.574858] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T22:21:28.914087] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-15T22:21:29.533678] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T22:21:29.714030] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-15T22:21:30.513972] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-15T22:21:30.638142] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T22:21:30.799956] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T22:21:31.314251] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-15T22:21:32.114031] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-15T22:21:32.606262] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T22:21:32.666117] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T22:21:32.914074] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-15T22:21:33.508772] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T22:21:33.604615] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T22:21:33.614803] [INFO ] [REMOTE ] WFC: Full fetch complete (77925 records). [2025-10-15T22:21:33.614996] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-15T22:21:33.722671] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-15T22:21:34.018016] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-15T22:21:34.018100] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-15T22:21:34.019390] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-15T22:21:34.019455] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-15T22:21:34.020923] [DEBUG] [LOCAL ] WFC: Trimmed 77925 records to 53748 (keeping 200 days of data) [2025-10-15T22:21:34.348254] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-15T22:21:34.348423] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-15T22:21:34.348510] [INFO ] [MAIN ] Update Progress: 2288/2369 symbols completed. WFC took 53.0s. Estimated remaining: 11m 23s. Rate: 7.1 symbols/min [2025-10-15T22:21:34.519089] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-15T22:21:34.546905] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:21:34.552929] [DEBUG] [LOCAL ] WHG: Loaded 3169 existing records from primary storage. [2025-10-15T22:21:34.553110] [INFO ] [MAIN ] WHG: Loaded 3169 existing records. [2025-10-15T22:21:34.728544] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:21:34.728843] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-15T22:21:34.728892] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-15T22:21:34.729094] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-15T22:21:34.729150] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-15T22:21:35.077697] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:21:35.217486] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T22:21:35.314008] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-15T22:21:36.114042] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-15T22:21:36.349423] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T22:21:36.739874] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T22:21:36.913992] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-15T22:21:36.983971] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T22:21:37.714017] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-15T22:21:38.171953] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T22:21:38.172068] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T22:21:38.177904] [INFO ] [REMOTE ] WGO: Full fetch complete (57248 records). [2025-10-15T22:21:38.178014] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-15T22:21:38.519073] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-15T22:21:38.566197] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-15T22:21:38.566393] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-15T22:21:38.567559] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-15T22:21:38.567624] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-15T22:21:38.569244] [DEBUG] [LOCAL ] WGO: Trimmed 57248 records to 38130 (keeping 200 days of data) [2025-10-15T22:21:38.816246] [DEBUG] [LOCAL ] WGO: Primary data saved (38130 records). [2025-10-15T22:21:38.816398] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-15T22:21:38.816494] [INFO ] [MAIN ] Update Progress: 2289/2369 symbols completed. WGO took 32.7s. Estimated remaining: 11m 14s. Rate: 7.1 symbols/min [2025-10-15T22:21:38.994939] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:21:39.041046] [DEBUG] [LOCAL ] WHR: Loaded 48789 existing records from primary storage. [2025-10-15T22:21:39.041386] [INFO ] [MAIN ] WHR: Loaded 48789 existing records. [2025-10-15T22:21:39.205992] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T22:21:39.225970] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:21:39.227735] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-15T22:21:39.227790] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-15T22:21:39.228387] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-15T22:21:39.228445] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-15T22:21:39.319146] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-15T22:21:39.606593] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:21:39.931822] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T22:21:40.113994] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-15T22:21:40.914072] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-15T22:21:41.654941] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T22:21:41.714137] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-15T22:21:42.260115] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T22:21:42.265753] [INFO ] [REMOTE ] WH: Full fetch complete (65190 records). [2025-10-15T22:21:42.265909] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-15T22:21:42.519241] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-15T22:21:42.656505] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-15T22:21:42.656594] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-15T22:21:42.657724] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-15T22:21:42.657788] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-15T22:21:42.659161] [DEBUG] [LOCAL ] WH: Trimmed 65190 records to 45259 (keeping 200 days of data) [2025-10-15T22:21:42.935662] [DEBUG] [LOCAL ] WH: Primary data saved (45259 records). [2025-10-15T22:21:42.935810] [INFO ] [MAIN ] WH: Full history saved. [2025-10-15T22:21:42.935893] [INFO ] [MAIN ] Update Progress: 2290/2369 symbols completed. WH took 32.9s. Estimated remaining: 11m 6s. Rate: 7.1 symbols/min [2025-10-15T22:21:43.112480] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:21:43.119449] [DEBUG] [LOCAL ] WIA: Loaded 5004 existing records from primary storage. [2025-10-15T22:21:43.119638] [INFO ] [MAIN ] WIA: Loaded 5004 existing records. [2025-10-15T22:21:43.292334] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T22:21:43.338868] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-15T22:21:43.344698] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:21:43.344935] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-15T22:21:43.345000] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-15T22:21:43.345934] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-15T22:21:43.345989] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-15T22:21:43.704833] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:21:44.065564] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T22:21:44.114005] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-15T22:21:44.173066] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T22:21:44.693725] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T22:21:44.913992] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-15T22:21:45.514081] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T22:21:45.714031] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-15T22:21:46.513999] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-15T22:21:47.323377] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-15T22:21:47.328574] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T22:21:47.720469] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T22:21:47.952847] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T22:21:48.113977] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-15T22:21:48.914049] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-15T22:21:49.585265] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T22:21:49.676620] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T22:21:49.714045] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-15T22:21:50.514004] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-15T22:21:51.100997] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T22:21:51.313967] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-15T22:21:51.435955] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T22:21:51.825672] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T22:21:52.113999] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-15T22:21:52.914034] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-15T22:21:53.713987] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-15T22:21:53.885062] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T22:21:54.327877] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T22:21:54.328561] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T22:21:54.513983] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-15T22:21:55.313991] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-15T22:21:55.852005] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T22:21:55.967413] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T22:21:56.113965] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-15T22:21:56.656909] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T22:21:56.914004] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-15T22:21:57.714028] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-15T22:21:58.324172] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T22:21:58.513969] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-15T22:21:59.036819] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T22:21:59.282129] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T22:21:59.313950] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-15T22:22:00.113993] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-15T22:22:00.607552] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T22:22:00.914001] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-15T22:22:01.355036] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T22:22:01.714041] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-15T22:22:02.098893] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T22:22:02.099833] [INFO ] [REMOTE ] WHG: Full fetch complete (4479 records). [2025-10-15T22:22:02.099907] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-15T22:22:02.481712] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-15T22:22:02.481817] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-15T22:22:02.482018] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-15T22:22:02.482096] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-15T22:22:02.482570] [DEBUG] [LOCAL ] WHG: Trimmed 4479 records to 3153 (keeping 200 days of data) [2025-10-15T22:22:02.506151] [DEBUG] [LOCAL ] WHG: Primary data saved (3153 records). [2025-10-15T22:22:02.506410] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-15T22:22:02.506601] [INFO ] [MAIN ] Update Progress: 2291/2369 symbols completed. WHG took 28.2s. Estimated remaining: 10m 58s. Rate: 7.1 symbols/min [2025-10-15T22:22:02.524089] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-15T22:22:02.694195] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-15T22:22:02.767457] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:22:02.787595] [DEBUG] [LOCAL ] WINN: Loaded 11550 existing records from primary storage. [2025-10-15T22:22:02.788009] [INFO ] [MAIN ] WINN: Loaded 11550 existing records. [2025-10-15T22:22:02.979697] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:22:02.979988] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-15T22:22:02.980042] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-15T22:22:02.980302] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-15T22:22:02.980344] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-15T22:22:03.327803] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-15T22:22:03.373977] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:22:04.114025] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-15T22:22:04.693927] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T22:22:04.914082] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-15T22:22:05.143339] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T22:22:05.527177] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T22:22:05.713974] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-15T22:22:06.324965] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T22:22:06.514034] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-15T22:22:07.019802] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T22:22:07.314054] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-15T22:22:08.114012] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-15T22:22:08.914012] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-15T22:22:08.982789] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T22:22:09.026174] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T22:22:09.188305] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (6.66 seconds). [2025-10-15T22:22:09.193713] [INFO ] [REMOTE ] WHD: Full fetch complete (57822 records). [2025-10-15T22:22:09.193890] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-15T22:22:09.305584] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T22:22:09.310524] [INFO ] [REMOTE ] WIA: Full fetch complete (7218 records). [2025-10-15T22:22:09.311034] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-15T22:22:09.719087] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-15T22:22:09.944294] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-15T22:22:09.949542] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-15T22:22:09.960967] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-15T22:22:09.966225] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-15T22:22:10.027123] [DEBUG] [LOCAL ] WHD: Trimmed 57822 records to 40131 (keeping 200 days of data) [2025-10-15T22:22:10.027789] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-15T22:22:10.028130] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-15T22:22:10.028393] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-15T22:22:10.028470] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-15T22:22:10.028980] [DEBUG] [LOCAL ] WIA: Trimmed 7218 records to 5007 (keeping 200 days of data) [2025-10-15T22:22:10.151431] [DEBUG] [LOCAL ] WIA: Primary data saved (5007 records). [2025-10-15T22:22:10.152365] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-15T22:22:10.152738] [INFO ] [MAIN ] Update Progress: 2292/2369 symbols completed. WIA took 27.2s. Estimated remaining: 10m 49s. Rate: 7.1 symbols/min [2025-10-15T22:22:10.345671] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:22:10.503838] [DEBUG] [LOCAL ] WHD: Primary data saved (40131 records). [2025-10-15T22:22:10.503966] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-15T22:22:10.504047] [INFO ] [MAIN ] Update Progress: 2293/2369 symbols completed. WHD took 44.8s. Estimated remaining: 10m 41s. Rate: 7.1 symbols/min [2025-10-15T22:22:10.515487] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-15T22:22:10.624480] [DEBUG] [LOCAL ] WIT: Loaded 52426 existing records from primary storage. [2025-10-15T22:22:10.636067] [INFO ] [MAIN ] WIT: Loaded 52426 existing records. [2025-10-15T22:22:10.799925] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:22:10.940174] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:22:10.947462] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-15T22:22:10.947320] [DEBUG] [LOCAL ] WIW: Loaded 20330 existing records from primary storage. [2025-10-15T22:22:10.947818] [INFO ] [MAIN ] WIW: Loaded 20330 existing records. [2025-10-15T22:22:10.979379] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-15T22:22:11.033292] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-15T22:22:11.054935] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-15T22:22:11.251519] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:22:11.260550] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-15T22:22:11.265800] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-15T22:22:11.281539] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-15T22:22:11.301612] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-15T22:22:11.581864] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T22:22:11.632697] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-15T22:22:11.832215] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:22:11.856354] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-15T22:22:11.900581] [INFO ] [REMOTE ] WHR: Full fetch complete (69330 records). [2025-10-15T22:22:11.911026] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-15T22:22:12.071233] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:22:12.122093] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-15T22:22:12.376235] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-15T22:22:12.376318] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-15T22:22:12.377443] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-15T22:22:12.377507] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-15T22:22:12.378972] [DEBUG] [LOCAL ] WHR: Trimmed 69330 records to 48799 (keeping 200 days of data) [2025-10-15T22:22:12.619921] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T22:22:12.708104] [DEBUG] [LOCAL ] WHR: Primary data saved (48799 records). [2025-10-15T22:22:12.708274] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-15T22:22:12.708370] [INFO ] [MAIN ] Update Progress: 2294/2369 symbols completed. WHR took 33.9s. Estimated remaining: 10m 32s. Rate: 7.1 symbols/min [2025-10-15T22:22:12.872557] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:22:12.908103] [DEBUG] [LOCAL ] WK: Loaded 37336 existing records from primary storage. [2025-10-15T22:22:12.908391] [INFO ] [MAIN ] WK: Loaded 37336 existing records. [2025-10-15T22:22:12.919306] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-15T22:22:13.091379] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:22:13.091742] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-15T22:22:13.091823] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-15T22:22:13.092430] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-15T22:22:13.092502] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-15T22:22:13.433677] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T22:22:13.467886] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:22:13.713999] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-15T22:22:14.514038] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-15T22:22:14.629040] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T22:22:14.826435] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T22:22:15.314028] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-15T22:22:15.907059] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T22:22:15.925429] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T22:22:16.114009] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-15T22:22:16.914026] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-15T22:22:17.714009] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-15T22:22:17.820454] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T22:22:17.979930] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T22:22:18.513987] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-15T22:22:18.781540] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T22:22:18.979165] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T22:22:19.313989] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-15T22:22:20.114014] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-15T22:22:20.914012] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-15T22:22:20.969108] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T22:22:21.157731] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T22:22:21.369394] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T22:22:21.714053] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-15T22:22:22.514002] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-15T22:22:22.563064] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T22:22:23.313997] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-15T22:22:24.113975] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-15T22:22:24.204533] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T22:22:24.684175] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T22:22:24.901159] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T22:22:24.914018] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-15T22:22:25.714005] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-15T22:22:25.985041] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T22:22:26.467162] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T22:22:26.514028] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-15T22:22:27.314059] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-15T22:22:28.114029] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-15T22:22:28.781830] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T22:22:28.784105] [INFO ] [REMOTE ] WINN: Full fetch complete (17447 records). [2025-10-15T22:22:28.784223] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-15T22:22:28.915165] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-15T22:22:29.007705] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T22:22:29.243003] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-15T22:22:29.243089] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-15T22:22:29.243568] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-15T22:22:29.243608] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-15T22:22:29.244167] [DEBUG] [LOCAL ] WINN: Trimmed 17447 records to 11533 (keeping 200 days of data) [2025-10-15T22:22:29.316413] [DEBUG] [LOCAL ] WINN: Primary data saved (11533 records). [2025-10-15T22:22:29.316583] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-15T22:22:29.316702] [INFO ] [MAIN ] Update Progress: 2295/2369 symbols completed. WINN took 26.8s. Estimated remaining: 10m 24s. Rate: 7.1 symbols/min [2025-10-15T22:22:29.485546] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:22:29.520841] [DEBUG] [LOCAL ] WKC: Loaded 34575 existing records from primary storage. [2025-10-15T22:22:29.521204] [INFO ] [MAIN ] WKC: Loaded 34575 existing records. [2025-10-15T22:22:29.702778] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:22:29.703000] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-15T22:22:29.703047] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-15T22:22:29.703444] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-15T22:22:29.703498] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-15T22:22:29.734866] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-15T22:22:30.070280] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:22:30.514046] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-15T22:22:30.780046] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T22:22:31.234459] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (4.72 seconds). [2025-10-15T22:22:31.314004] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-15T22:22:32.044593] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T22:22:32.103873] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T22:22:32.113966] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-15T22:22:32.914048] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-15T22:22:33.108299] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T22:22:33.714039] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-15T22:22:34.301792] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T22:22:34.457898] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T22:22:34.514052] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-15T22:22:35.314025] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-15T22:22:36.114007] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-15T22:22:36.623255] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T22:22:36.762235] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T22:22:36.914039] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-15T22:22:37.050352] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (7.32 seconds). [2025-10-15T22:22:37.714070] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-15T22:22:38.325396] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T22:22:38.514030] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-15T22:22:39.111389] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T22:22:39.314037] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-15T22:22:40.017936] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (3.90 seconds). [2025-10-15T22:22:40.026628] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T22:22:40.113983] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-15T22:22:40.920483] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-15T22:22:40.943346] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T22:22:41.026196] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T22:22:41.714003] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-15T22:22:42.248190] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T22:22:42.513975] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-15T22:22:43.314005] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-15T22:22:43.482198] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T22:22:43.899089] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T22:22:44.114097] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-15T22:22:44.178051] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T22:22:44.180937] [INFO ] [REMOTE ] WIW: Full fetch complete (29355 records). [2025-10-15T22:22:44.181046] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-15T22:22:44.555404] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-15T22:22:44.555488] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-15T22:22:44.556108] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-15T22:22:44.556169] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-15T22:22:44.557017] [DEBUG] [LOCAL ] WIW: Trimmed 29355 records to 20323 (keeping 200 days of data) [2025-10-15T22:22:44.679098] [DEBUG] [LOCAL ] WIW: Primary data saved (20323 records). [2025-10-15T22:22:44.679230] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-15T22:22:44.679312] [INFO ] [MAIN ] Update Progress: 2296/2369 symbols completed. WIW took 34.2s. Estimated remaining: 10m 16s. Rate: 7.1 symbols/min [2025-10-15T22:22:44.858385] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:22:44.903856] [DEBUG] [LOCAL ] WLK: Loaded 45712 existing records from primary storage. [2025-10-15T22:22:44.904228] [INFO ] [MAIN ] WLK: Loaded 45712 existing records. [2025-10-15T22:22:44.924692] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-15T22:22:45.086270] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:22:45.086510] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-15T22:22:45.086566] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-15T22:22:45.087092] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-15T22:22:45.087151] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-15T22:22:45.452268] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:22:45.713977] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-15T22:22:45.833341] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T22:22:46.507428] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T22:22:46.515574] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-15T22:22:46.947099] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T22:22:47.314003] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-15T22:22:48.059764] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T22:22:48.113970] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-15T22:22:48.804042] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T22:22:48.914187] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-15T22:22:49.705484] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T22:22:49.714569] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-15T22:22:50.371341] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T22:22:50.514001] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-15T22:22:50.864373] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T22:22:51.314011] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-15T22:22:51.973317] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T22:22:52.114002] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-15T22:22:52.914047] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-15T22:22:53.714114] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-15T22:23:05.216551] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (12.30 seconds). [2025-10-15T22:23:05.223182] [INFO ] [REMOTE ] WIT: Full fetch complete (75889 records). [2025-10-15T22:23:05.223358] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-15T22:23:05.618774] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-15T22:23:05.618898] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-15T22:23:05.620764] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-15T22:23:05.620855] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-15T22:23:05.622445] [DEBUG] [LOCAL ] WIT: Trimmed 75889 records to 52494 (keeping 200 days of data) [2025-10-15T22:23:05.747271] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (13.63 seconds). [2025-10-15T22:23:05.768408] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-15T22:23:05.881852] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (14.57 seconds). [2025-10-15T22:23:05.904414] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-15T22:23:06.000187] [DEBUG] [LOCAL ] WIT: Primary data saved (52494 records). [2025-10-15T22:23:06.000330] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-15T22:23:06.000431] [INFO ] [MAIN ] Update Progress: 2297/2369 symbols completed. WIT took 55.8s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-15T22:23:06.172452] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:06.180343] [DEBUG] [LOCAL ] WLKP: Loaded 6971 existing records from primary storage. [2025-10-15T22:23:06.180523] [INFO ] [MAIN ] WLKP: Loaded 6971 existing records. [2025-10-15T22:23:06.352802] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:06.353051] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-15T22:23:06.353104] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-15T22:23:06.353248] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-15T22:23:06.353285] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-15T22:23:06.725876] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:06.726339] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-15T22:23:06.741667] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (13.03 seconds). [2025-10-15T22:23:06.748638] [INFO ] [REMOTE ] WK: Full fetch complete (53124 records). [2025-10-15T22:23:06.748787] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-15T22:23:07.124408] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-15T22:23:07.124494] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-15T22:23:07.125541] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-15T22:23:07.125609] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-15T22:23:07.126817] [DEBUG] [LOCAL ] WK: Trimmed 53124 records to 37276 (keeping 200 days of data) [2025-10-15T22:23:07.348482] [DEBUG] [LOCAL ] WK: Primary data saved (37276 records). [2025-10-15T22:23:07.348628] [INFO ] [MAIN ] WK: Full history saved. [2025-10-15T22:23:07.348747] [INFO ] [MAIN ] Update Progress: 2298/2369 symbols completed. WK took 54.6s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-15T22:23:07.534680] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:07.535557] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-15T22:23:07.541694] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-15T22:23:07.542750] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T22:23:07.542518] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-15T22:23:07.545419] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-15T22:23:07.546215] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-15T22:23:07.546450] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-15T22:23:07.546505] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-15T22:23:07.676953] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T22:23:07.731390] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-15T22:23:07.934077] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T22:23:07.986983] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-15T22:23:08.009569] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:08.009911] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-15T22:23:08.489476] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T22:23:08.490399] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-15T22:23:08.597166] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T22:23:08.599574] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-15T22:23:08.784496] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-15T22:23:08.785717] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-15T22:23:09.015958] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T22:23:09.018463] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-15T22:23:09.120230] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T22:23:09.121236] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-15T22:23:09.148210] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T22:23:09.157250] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-15T22:23:09.203857] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T22:23:09.214540] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-15T22:23:09.403731] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-15T22:23:09.403581] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T22:23:09.405129] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-15T22:23:09.407977] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-15T22:23:09.853683] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T22:23:09.854796] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-15T22:23:10.144385] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T22:23:10.148183] [INFO ] [REMOTE ] WKC: Full fetch complete (50195 records). [2025-10-15T22:23:10.148310] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-15T22:23:10.241409] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-15T22:23:10.242150] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T22:23:10.262263] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-15T22:23:10.261621] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-15T22:23:10.555200] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-15T22:23:10.555367] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-15T22:23:10.556673] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-15T22:23:10.556830] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-15T22:23:10.558459] [DEBUG] [LOCAL ] WKC: Trimmed 50195 records to 34587 (keeping 200 days of data) [2025-10-15T22:23:10.689516] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T22:23:10.691267] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-15T22:23:10.693743] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T22:23:10.707637] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-15T22:23:10.818429] [DEBUG] [LOCAL ] WKC: Primary data saved (34587 records). [2025-10-15T22:23:10.818588] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-15T22:23:10.818705] [INFO ] [MAIN ] Update Progress: 2299/2369 symbols completed. WKC took 41.5s. Estimated remaining: 9m 50s. Rate: 7.1 symbols/min [2025-10-15T22:23:10.995459] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:11.001615] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T22:23:11.007619] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-15T22:23:11.040544] [DEBUG] [LOCAL ] WLY: Loaded 29766 existing records from primary storage. [2025-10-15T22:23:11.040852] [INFO ] [MAIN ] WLY: Loaded 29766 existing records. [2025-10-15T22:23:11.220689] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:11.220921] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-15T22:23:11.220971] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-15T22:23:11.221248] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-15T22:23:11.221305] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-15T22:23:11.321110] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-15T22:23:11.577088] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:11.790204] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T22:23:12.113988] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-15T22:23:12.222269] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T22:23:12.409913] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-15T22:23:12.913974] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-15T22:23:13.713984] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-15T22:23:14.236397] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T22:23:14.248513] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T22:23:14.514091] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-15T22:23:15.123787] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T22:23:15.314023] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-15T22:23:15.661589] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T22:23:15.662375] [INFO ] [REMOTE ] WLTG: Full fetch complete (1674 records). [2025-10-15T22:23:15.662494] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-15T22:23:15.863203] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T22:23:15.863440] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T22:23:15.863526] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T22:23:15.863621] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-15T22:23:15.863740] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-15T22:23:15.863795] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-15T22:23:15.863841] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-15T22:23:15.863903] [INFO ] [MAIN ] Update Progress: 2300/2369 symbols completed. WLTG took 8.5s. Estimated remaining: 9m 42s. Rate: 7.1 symbols/min [2025-10-15T22:23:16.029955] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:16.081211] [DEBUG] [LOCAL ] WM: Loaded 50989 existing records from primary storage. [2025-10-15T22:23:16.081512] [INFO ] [MAIN ] WM: Loaded 50989 existing records. [2025-10-15T22:23:16.119873] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-15T22:23:16.260781] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:16.261044] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-15T22:23:16.261104] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-15T22:23:16.261411] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-15T22:23:16.261467] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-15T22:23:16.607539] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:16.913999] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-15T22:23:17.593324] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T22:23:17.643164] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T22:23:17.714119] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-15T22:23:18.514030] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-15T22:23:18.895453] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T22:23:19.314019] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-15T22:23:20.114040] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-15T22:23:20.131473] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T22:23:20.392306] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T22:23:20.914009] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-15T22:23:21.572337] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T22:23:21.714029] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-15T22:23:22.389358] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T22:23:22.390914] [INFO ] [REMOTE ] WLKP: Full fetch complete (10116 records). [2025-10-15T22:23:22.390987] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-15T22:23:22.518526] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-15T22:23:22.777614] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-15T22:23:22.777840] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-15T22:23:22.778342] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-15T22:23:22.778480] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-15T22:23:22.779281] [DEBUG] [LOCAL ] WLKP: Trimmed 10116 records to 6989 (keeping 200 days of data) [2025-10-15T22:23:22.855798] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T22:23:22.873287] [DEBUG] [LOCAL ] WLKP: Primary data saved (6989 records). [2025-10-15T22:23:22.873483] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-15T22:23:22.873621] [INFO ] [MAIN ] Update Progress: 2301/2369 symbols completed. WLKP took 16.9s. Estimated remaining: 9m 33s. Rate: 7.1 symbols/min [2025-10-15T22:23:23.053213] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:23.116702] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-15T22:23:23.117229] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-15T22:23:23.315062] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:23.315255] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-15T22:23:23.315929] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-15T22:23:23.317281] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-15T22:23:23.318062] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-15T22:23:23.318144] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-15T22:23:23.705847] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:24.104001] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T22:23:24.110901] [INFO ] [REMOTE ] WLK: Full fetch complete (63736 records). [2025-10-15T22:23:24.111131] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-15T22:23:24.124492] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-15T22:23:24.528563] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-15T22:23:24.528758] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-15T22:23:24.530555] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-15T22:23:24.530926] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-15T22:23:24.553727] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T22:23:24.560557] [DEBUG] [LOCAL ] WLK: Trimmed 63736 records to 45746 (keeping 200 days of data) [2025-10-15T22:23:24.878489] [DEBUG] [LOCAL ] WLK: Primary data saved (45746 records). [2025-10-15T22:23:24.878684] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-15T22:23:24.880028] [INFO ] [MAIN ] Update Progress: 2302/2369 symbols completed. WLK took 40.2s. Estimated remaining: 9m 25s. Rate: 7.1 symbols/min [2025-10-15T22:23:24.923252] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-15T22:23:25.062289] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:25.087326] [DEBUG] [LOCAL ] WMK: Loaded 14709 existing records from primary storage. [2025-10-15T22:23:25.087689] [INFO ] [MAIN ] WMK: Loaded 14709 existing records. [2025-10-15T22:23:25.342586] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:25.342917] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-15T22:23:25.342971] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-15T22:23:25.343259] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-15T22:23:25.343319] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-15T22:23:25.718132] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-15T22:23:25.767247] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:26.065073] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T22:23:26.514027] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-15T22:23:26.715852] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T22:23:27.170979] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T22:23:27.185167] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T22:23:27.314024] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-15T22:23:28.111407] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T22:23:28.114746] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-15T22:23:28.914093] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-15T22:23:28.924920] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T22:23:29.714060] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-15T22:23:30.513977] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-15T22:23:30.603352] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T22:23:30.804307] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T22:23:31.314003] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-15T22:23:32.008288] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T22:23:32.113967] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-15T22:23:32.914050] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-15T22:23:33.312826] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T22:23:33.416468] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T22:23:33.713979] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-15T22:23:33.918177] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T22:23:34.514062] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-15T22:23:35.313988] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-15T22:23:35.485797] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T22:23:35.878538] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T22:23:36.114007] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-15T22:23:36.913973] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-15T22:23:37.106347] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T22:23:37.640382] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T22:23:37.714049] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-15T22:23:37.873596] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T22:23:38.514089] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-15T22:23:39.064578] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T22:23:39.314102] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-15T22:23:40.113971] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-15T22:23:40.138419] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T22:23:40.309807] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T22:23:40.913993] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-15T22:23:41.180783] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T22:23:41.714004] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-15T22:23:42.513984] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-15T22:23:42.804821] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T22:23:42.894483] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T22:23:43.313994] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-15T22:23:43.422125] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T22:23:44.114018] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-15T22:23:44.383839] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T22:23:44.913979] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-15T22:23:45.714018] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-15T22:23:45.911086] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T22:23:45.958761] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T22:23:45.962616] [INFO ] [REMOTE ] WLY: Full fetch complete (42917 records). [2025-10-15T22:23:45.962752] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-15T22:23:46.345414] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-15T22:23:46.345512] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-15T22:23:46.346445] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-15T22:23:46.346510] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-15T22:23:46.347598] [DEBUG] [LOCAL ] WLY: Trimmed 42917 records to 29866 (keeping 200 days of data) [2025-10-15T22:23:46.518034] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-15T22:23:46.531406] [DEBUG] [LOCAL ] WLY: Primary data saved (29866 records). [2025-10-15T22:23:46.531832] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-15T22:23:46.532011] [INFO ] [MAIN ] Update Progress: 2303/2369 symbols completed. WLY took 35.7s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-15T22:23:46.698385] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:46.738299] [DEBUG] [LOCAL ] WMS: Loaded 39730 existing records from primary storage. [2025-10-15T22:23:46.738597] [INFO ] [MAIN ] WMS: Loaded 39730 existing records. [2025-10-15T22:23:46.919463] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:46.919756] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-15T22:23:46.919811] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-15T22:23:46.920141] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-15T22:23:46.920181] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-15T22:23:47.289058] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:47.313966] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-15T22:23:47.662318] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T22:23:48.114031] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-15T22:23:48.643533] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-15T22:23:48.718995] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T22:23:48.913988] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-15T22:23:49.058136] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T22:23:49.574780] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T22:23:49.580934] [INFO ] [REMOTE ] WM: Full fetch complete (73914 records). [2025-10-15T22:23:49.581087] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-15T22:23:49.719140] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-15T22:23:49.964812] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-15T22:23:49.964902] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-15T22:23:49.966207] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-15T22:23:49.966271] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-15T22:23:49.967635] [DEBUG] [LOCAL ] WM: Trimmed 73914 records to 51011 (keeping 200 days of data) [2025-10-15T22:23:50.285538] [DEBUG] [LOCAL ] WM: Primary data saved (51011 records). [2025-10-15T22:23:50.285718] [INFO ] [MAIN ] WM: Full history saved. [2025-10-15T22:23:50.285824] [INFO ] [MAIN ] Update Progress: 2304/2369 symbols completed. WM took 34.4s. Estimated remaining: 9m 8s. Rate: 7.1 symbols/min [2025-10-15T22:23:50.453208] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:50.506874] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-15T22:23:50.507453] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-15T22:23:50.519122] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-15T22:23:50.696295] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:50.701313] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-15T22:23:50.701830] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-15T22:23:50.702006] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T22:23:50.704281] [INFO ] [REMOTE ] WMK: Full fetch complete (19978 records). [2025-10-15T22:23:50.704351] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-15T22:23:50.735689] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-15T22:23:50.772740] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-15T22:23:51.341513] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-15T22:23:51.381011] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-15T22:23:51.381419] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-15T22:23:51.402746] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-15T22:23:51.421707] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-15T22:23:51.463222] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:51.463369] [DEBUG] [LOCAL ] WMK: Trimmed 19978 records to 14729 (keeping 200 days of data) [2025-10-15T22:23:51.552235] [DEBUG] [LOCAL ] WMK: Primary data saved (14729 records). [2025-10-15T22:23:51.553121] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-15T22:23:51.553227] [INFO ] [MAIN ] Update Progress: 2305/2369 symbols completed. WMK took 26.7s. Estimated remaining: 8m 59s. Rate: 7.1 symbols/min [2025-10-15T22:23:51.747494] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:23:51.791403] [DEBUG] [LOCAL ] WNC: Loaded 38582 existing records from primary storage. [2025-10-15T22:23:51.791822] [INFO ] [MAIN ] WNC: Loaded 38582 existing records. [2025-10-15T22:23:51.987369] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T22:23:52.029911] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:23:52.030838] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-15T22:23:52.030896] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-15T22:23:52.031357] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-15T22:23:52.031439] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-15T22:23:52.119156] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-15T22:23:52.403035] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:23:52.914018] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-15T22:23:53.310322] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T22:23:53.407009] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T22:23:53.714040] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-15T22:23:53.854834] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T22:23:54.514052] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-15T22:23:55.300724] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T22:23:55.313955] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-15T22:23:56.006058] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T22:23:56.114001] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-15T22:23:56.914023] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-15T22:23:57.164603] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-15T22:23:57.501721] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T22:23:57.714046] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-15T22:23:58.514065] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-15T22:23:59.314066] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-15T22:23:59.396482] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-15T22:23:59.495110] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T22:23:59.971579] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T22:24:00.113997] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-15T22:24:00.459974] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T22:24:00.914032] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-15T22:24:01.714073] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-15T22:24:01.828968] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T22:24:02.514050] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-15T22:24:03.044219] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-15T22:24:03.165297] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T22:24:03.313957] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-15T22:24:03.603531] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T22:24:04.114094] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-15T22:24:04.855752] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T22:24:04.914029] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-15T22:24:05.310911] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T22:24:05.714000] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-15T22:24:06.335127] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T22:24:06.514070] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-15T22:24:07.314020] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-15T22:24:07.991055] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-15T22:24:07.992664] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T22:24:08.010284] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-15T22:24:08.031431] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-15T22:24:08.033355] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T22:24:08.116786] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-15T22:24:08.440678] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-15T22:24:08.440789] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-15T22:24:08.442128] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-15T22:24:08.442208] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-15T22:24:08.443825] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 53672 (keeping 200 days of data) [2025-10-15T22:24:08.770734] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-15T22:24:08.770918] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-15T22:24:08.771038] [INFO ] [MAIN ] Update Progress: 2306/2369 symbols completed. WMB took 45.9s. Estimated remaining: 8m 51s. Rate: 7.1 symbols/min [2025-10-15T22:24:08.923141] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-15T22:24:08.953909] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:24:08.990885] [DEBUG] [LOCAL ] WNS: Loaded 40118 existing records from primary storage. [2025-10-15T22:24:08.991182] [INFO ] [MAIN ] WNS: Loaded 40118 existing records. [2025-10-15T22:24:09.162965] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:24:09.163196] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-15T22:24:09.163245] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-15T22:24:09.163633] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-15T22:24:09.163722] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-15T22:24:09.504777] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:24:09.714001] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-15T22:24:10.514009] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-15T22:24:10.563552] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T22:24:10.860750] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-15T22:24:11.143311] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T22:24:11.313996] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-15T22:24:11.645376] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T22:24:12.114005] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-15T22:24:12.863299] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T22:24:12.913970] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-15T22:24:13.714012] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-15T22:24:14.316145] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T22:24:14.514060] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-15T22:24:14.695224] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-15T22:24:15.051780] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T22:24:15.313997] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-15T22:24:15.724827] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T22:24:15.729464] [INFO ] [REMOTE ] WNC: Full fetch complete (57683 records). [2025-10-15T22:24:15.729608] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-15T22:24:16.118083] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-15T22:24:16.119298] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-15T22:24:16.119356] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-15T22:24:16.120619] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-15T22:24:16.120855] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-15T22:24:16.122196] [DEBUG] [LOCAL ] WNC: Trimmed 57683 records to 38500 (keeping 200 days of data) [2025-10-15T22:24:16.359826] [DEBUG] [LOCAL ] WNC: Primary data saved (38500 records). [2025-10-15T22:24:16.359964] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-15T22:24:16.360048] [INFO ] [MAIN ] Update Progress: 2307/2369 symbols completed. WNC took 24.8s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-15T22:24:16.532400] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:24:16.584205] [DEBUG] [LOCAL ] WOLF: Loaded 53168 existing records from primary storage. [2025-10-15T22:24:16.584515] [INFO ] [MAIN ] WOLF: Loaded 53168 existing records. [2025-10-15T22:24:16.774672] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:24:16.793638] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-15T22:24:16.793798] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-15T22:24:16.794424] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-15T22:24:16.794490] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-15T22:24:16.795142] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T22:24:16.919145] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-15T22:24:17.184418] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:24:17.713968] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-15T22:24:17.772279] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T22:24:18.279590] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T22:24:18.514017] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-15T22:24:19.313975] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-15T22:24:19.846378] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T22:24:20.113969] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-15T22:24:20.138735] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T22:24:20.362988] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T22:24:20.914045] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-15T22:24:21.714036] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-15T22:24:22.514071] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-15T22:24:22.565694] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-15T22:24:23.174805] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-15T22:24:23.198944] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T22:24:23.203754] [INFO ] [REMOTE ] WMS: Full fetch complete (57227 records). [2025-10-15T22:24:23.203876] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-15T22:24:23.319095] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-15T22:24:23.582272] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-15T22:24:23.582364] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-15T22:24:23.583378] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-15T22:24:23.583442] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-15T22:24:23.584721] [DEBUG] [LOCAL ] WMS: Trimmed 57227 records to 39738 (keeping 200 days of data) [2025-10-15T22:24:23.842621] [DEBUG] [LOCAL ] WMS: Primary data saved (39738 records). [2025-10-15T22:24:23.842810] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-15T22:24:23.843638] [INFO ] [MAIN ] Update Progress: 2308/2369 symbols completed. WMS took 37.3s. Estimated remaining: 8m 34s. Rate: 7.1 symbols/min [2025-10-15T22:24:24.017805] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:24:24.067739] [DEBUG] [LOCAL ] WOR: Loaded 24101 existing records from primary storage. [2025-10-15T22:24:24.068509] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T22:24:24.077844] [INFO ] [MAIN ] WOR: Loaded 24101 existing records. [2025-10-15T22:24:24.122488] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-15T22:24:24.265021] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:24:24.265290] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-15T22:24:24.265341] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-15T22:24:24.265612] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-15T22:24:24.265703] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-15T22:24:24.627831] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:24:24.914029] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-15T22:24:25.314286] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T22:24:25.714009] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-15T22:24:26.011295] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T22:24:26.519115] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-15T22:24:26.534874] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-15T22:24:27.314067] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-15T22:24:27.680848] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T22:24:27.854027] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T22:24:28.114025] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-15T22:24:28.914012] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-15T22:24:29.569270] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T22:24:29.713985] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-15T22:24:29.771443] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-15T22:24:30.514059] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-15T22:24:31.096721] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T22:24:31.238607] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T22:24:31.263314] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T22:24:31.313972] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-15T22:24:32.114106] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-15T22:24:32.658411] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T22:24:32.914048] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-15T22:24:33.714064] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-15T22:24:33.772071] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:24:34.513994] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-15T22:24:35.313975] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-15T22:24:35.456792] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-15T22:24:35.923351] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T22:24:36.091790] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-15T22:24:36.113986] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-15T22:24:36.203314] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T22:24:36.914003] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-15T22:24:37.544739] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T22:24:37.714005] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-15T22:24:38.514083] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-15T22:24:39.149298] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-15T22:24:39.314002] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-15T22:24:39.546553] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T22:24:39.886433] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T22:24:39.891862] [INFO ] [REMOTE ] WNS: Full fetch complete (55720 records). [2025-10-15T22:24:39.892035] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-15T22:24:40.125784] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-15T22:24:40.322423] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-15T22:24:40.322520] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-15T22:24:40.323744] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-15T22:24:40.323806] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-15T22:24:40.324898] [DEBUG] [LOCAL ] WNS: Trimmed 55720 records to 40257 (keeping 200 days of data) [2025-10-15T22:24:40.467597] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T22:24:40.596361] [DEBUG] [LOCAL ] WNS: Primary data saved (40257 records). [2025-10-15T22:24:40.596510] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-15T22:24:40.596595] [INFO ] [MAIN ] Update Progress: 2309/2369 symbols completed. WNS took 31.8s. Estimated remaining: 8m 26s. Rate: 7.1 symbols/min [2025-10-15T22:24:40.773045] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:24:40.802154] [DEBUG] [LOCAL ] WOW: Loaded 30915 existing records from primary storage. [2025-10-15T22:24:40.802423] [INFO ] [MAIN ] WOW: Loaded 30915 existing records. [2025-10-15T22:24:40.916852] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-15T22:24:40.919504] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T22:24:40.948076] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-15T22:24:40.985358] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-15T22:24:41.078070] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:24:41.101080] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-15T22:24:41.111387] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-15T22:24:41.122524] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-15T22:24:41.132925] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-15T22:24:41.728965] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-15T22:24:41.721170] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-15T22:24:41.746737] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-15T22:24:41.790815] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-15T22:24:41.819913] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:24:41.813682] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-15T22:24:41.822313] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-15T22:24:42.059944] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T22:24:42.182706] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-15T22:24:42.182852] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-15T22:24:42.182936] [INFO ] [MAIN ] Update Progress: 2310/2369 symbols completed. WMT took 51.9s. Estimated remaining: 8m 17s. Rate: 7.1 symbols/min [2025-10-15T22:24:42.345027] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:24:42.388013] [DEBUG] [LOCAL ] WPC: Loaded 48209 existing records from primary storage. [2025-10-15T22:24:42.388338] [INFO ] [MAIN ] WPC: Loaded 48209 existing records. [2025-10-15T22:24:42.524388] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-15T22:24:42.565936] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:24:42.566187] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-15T22:24:42.566234] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-15T22:24:42.566948] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-15T22:24:42.567006] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-15T22:24:42.912783] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:24:43.314072] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-15T22:24:43.766478] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T22:24:44.114076] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-15T22:24:44.199354] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-15T22:24:44.563114] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T22:24:44.914005] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-15T22:24:45.698814] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T22:24:45.713956] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-15T22:24:46.514077] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-15T22:24:47.097153] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T22:24:47.161470] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T22:24:47.211154] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T22:24:47.313998] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-15T22:24:48.114032] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-15T22:24:48.524428] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T22:24:48.914057] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-15T22:24:49.267273] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T22:24:49.713973] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-15T22:24:49.874928] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T22:24:49.878567] [INFO ] [REMOTE ] WOR: Full fetch complete (36322 records). [2025-10-15T22:24:49.878737] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-15T22:24:50.272169] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-15T22:24:50.272279] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-15T22:24:50.273496] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-15T22:24:50.273564] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-15T22:24:50.274805] [DEBUG] [LOCAL ] WOR: Trimmed 36322 records to 24008 (keeping 200 days of data) [2025-10-15T22:24:50.439504] [DEBUG] [LOCAL ] WOR: Primary data saved (24008 records). [2025-10-15T22:24:50.439734] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-15T22:24:50.439852] [INFO ] [MAIN ] Update Progress: 2311/2369 symbols completed. WOR took 26.6s. Estimated remaining: 8m 9s. Rate: 7.1 symbols/min [2025-10-15T22:24:50.523470] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-15T22:24:50.639147] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:24:50.698836] [DEBUG] [LOCAL ] WPM: Loaded 52772 existing records from primary storage. [2025-10-15T22:24:50.699343] [INFO ] [MAIN ] WPM: Loaded 52772 existing records. [2025-10-15T22:24:50.902267] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:24:50.902798] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-15T22:24:50.902870] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-15T22:24:50.922340] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-15T22:24:50.923257] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-15T22:24:50.924095] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T22:24:51.291138] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:24:51.314001] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-15T22:24:52.114023] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-15T22:24:52.171280] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T22:24:52.914068] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-15T22:24:53.092849] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T22:24:53.316997] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T22:24:53.714041] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-15T22:24:54.514023] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-15T22:24:54.725580] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T22:24:55.042836] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-15T22:24:55.314034] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-15T22:24:55.929129] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T22:24:56.113967] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-15T22:24:56.329232] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T22:24:56.914001] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-15T22:24:57.577692] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T22:24:57.714013] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-15T22:24:58.048990] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T22:24:58.513963] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-15T22:24:59.316886] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-15T22:24:59.322923] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T22:24:59.423473] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T22:25:00.113995] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-15T22:25:00.795055] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T22:25:00.913998] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-15T22:25:01.714038] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-15T22:25:01.950668] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T22:25:02.189148] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T22:25:02.514178] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-15T22:25:03.314023] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-15T22:25:04.114921] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T22:25:04.115138] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-15T22:25:04.156171] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-15T22:25:04.914004] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-15T22:25:05.031244] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T22:25:05.341884] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T22:25:05.713987] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-15T22:25:06.513999] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-15T22:25:06.710733] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T22:25:06.714874] [INFO ] [REMOTE ] WOW: Full fetch complete (42705 records). [2025-10-15T22:25:06.714989] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-15T22:25:07.096146] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-15T22:25:07.096236] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-15T22:25:07.097184] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-15T22:25:07.097256] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-15T22:25:07.098423] [DEBUG] [LOCAL ] WOW: Trimmed 42705 records to 30976 (keeping 200 days of data) [2025-10-15T22:25:07.274111] [DEBUG] [LOCAL ] WOW: Primary data saved (30976 records). [2025-10-15T22:25:07.274253] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-15T22:25:07.274377] [INFO ] [MAIN ] Update Progress: 2312/2369 symbols completed. WOW took 26.7s. Estimated remaining: 8m 1s. Rate: 7.1 symbols/min [2025-10-15T22:25:07.318433] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-15T22:25:07.467713] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:25:07.471215] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-15T22:25:07.477981] [INFO ] [REMOTE ] WOLF: Full fetch complete (77335 records). [2025-10-15T22:25:07.478108] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-15T22:25:07.754470] [DEBUG] [LOCAL ] WPP: Loaded 34428 existing records from primary storage. [2025-10-15T22:25:07.801912] [INFO ] [MAIN ] WPP: Loaded 34428 existing records. [2025-10-15T22:25:08.098529] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-15T22:25:08.098367] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:25:08.098758] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-15T22:25:08.098635] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-15T22:25:08.098880] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-15T22:25:08.100288] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-15T22:25:08.100368] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-15T22:25:08.101025] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-15T22:25:08.101129] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-15T22:25:08.176214] [DEBUG] [LOCAL ] WOLF: Trimmed 77335 records to 53164 (keeping 200 days of data) [2025-10-15T22:25:08.589690] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:25:08.591317] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-15T22:25:08.632750] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-15T22:25:08.843490] [DEBUG] [LOCAL ] WOLF: Primary data saved (53164 records). [2025-10-15T22:25:08.843673] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-15T22:25:08.844667] [INFO ] [MAIN ] Update Progress: 2313/2369 symbols completed. WOLF took 52.5s. Estimated remaining: 7m 52s. Rate: 7.1 symbols/min [2025-10-15T22:25:08.919101] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-15T22:25:09.020598] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:25:09.079214] [DEBUG] [LOCAL ] WRB: Loaded 50785 existing records from primary storage. [2025-10-15T22:25:09.079707] [INFO ] [MAIN ] WRB: Loaded 50785 existing records. [2025-10-15T22:25:09.266061] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:25:09.266327] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-15T22:25:09.266463] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-15T22:25:09.276634] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-15T22:25:09.282715] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-15T22:25:09.365277] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T22:25:09.682639] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:25:09.695360] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T22:25:09.713955] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-15T22:25:10.514042] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-15T22:25:10.675974] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T22:25:11.326489] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-15T22:25:11.329688] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T22:25:11.941497] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T22:25:12.113988] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-15T22:25:12.378995] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T22:25:12.913989] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-15T22:25:13.682952] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T22:25:13.713988] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-15T22:25:13.898524] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T22:25:14.514008] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-15T22:25:15.190022] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T22:25:15.314024] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-15T22:25:15.956337] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T22:25:16.113988] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-15T22:25:16.464140] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T22:25:16.914063] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-15T22:25:17.713966] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-15T22:25:17.828863] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T22:25:18.218506] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T22:25:18.514031] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-15T22:25:19.314067] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-15T22:25:19.593722] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T22:25:20.113991] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-15T22:25:20.185237] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T22:25:20.730905] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T22:25:20.914037] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-15T22:25:21.714042] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-15T22:25:21.770135] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T22:25:22.513984] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-15T22:25:22.569176] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:25:23.241379] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T22:25:23.247268] [INFO ] [REMOTE ] WPC: Full fetch complete (70638 records). [2025-10-15T22:25:23.247410] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-15T22:25:23.319136] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-15T22:25:23.661599] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-15T22:25:23.661767] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-15T22:25:23.662905] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-15T22:25:23.662969] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-15T22:25:23.664424] [DEBUG] [LOCAL ] WPC: Trimmed 70638 records to 48267 (keeping 200 days of data) [2025-10-15T22:25:23.968365] [DEBUG] [LOCAL ] WPC: Primary data saved (48267 records). [2025-10-15T22:25:23.968625] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-15T22:25:23.968779] [INFO ] [MAIN ] Update Progress: 2314/2369 symbols completed. WPC took 41.8s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-15T22:25:24.060854] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T22:25:24.099392] [INFO ] [REMOTE ] WPM: Full fetch complete (76288 records). [2025-10-15T22:25:24.109902] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-15T22:25:24.115140] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-15T22:25:24.203862] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:25:24.593949] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-15T22:25:24.594032] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-15T22:25:24.595248] [DEBUG] [LOCAL ] WRBY: Loaded 50719 existing records from primary storage. [2025-10-15T22:25:24.596623] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-15T22:25:24.596726] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-15T22:25:24.596910] [INFO ] [MAIN ] WRBY: Loaded 50719 existing records. [2025-10-15T22:25:24.704153] [DEBUG] [LOCAL ] WPM: Trimmed 76288 records to 52775 (keeping 200 days of data) [2025-10-15T22:25:24.878629] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:25:24.879356] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-15T22:25:24.879796] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-15T22:25:24.881307] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-15T22:25:24.881384] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-15T22:25:25.346603] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:25:25.374954] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-15T22:25:25.413418] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T22:25:25.449491] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T22:25:25.552800] [DEBUG] [LOCAL ] WPM: Primary data saved (52775 records). [2025-10-15T22:25:25.552936] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-15T22:25:25.553016] [INFO ] [MAIN ] Update Progress: 2315/2369 symbols completed. WPM took 35.1s. Estimated remaining: 7m 35s. Rate: 7.1 symbols/min [2025-10-15T22:25:25.723121] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:25:25.719737] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-15T22:25:25.747298] [DEBUG] [LOCAL ] WS: Loaded 23392 existing records from primary storage. [2025-10-15T22:25:25.747533] [INFO ] [MAIN ] WS: Loaded 23392 existing records. [2025-10-15T22:25:25.919467] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:25:25.919727] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-15T22:25:25.919795] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-15T22:25:25.920086] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-15T22:25:25.920182] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-15T22:25:26.280510] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:25:26.513971] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-15T22:25:27.000688] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T22:25:27.313983] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-15T22:25:27.448963] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T22:25:27.519933] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T22:25:28.114054] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-15T22:25:28.469553] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T22:25:28.914043] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-15T22:25:29.714061] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-15T22:25:29.852405] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T22:25:30.514020] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-15T22:25:30.626543] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T22:25:30.912031] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T22:25:30.916741] [INFO ] [REMOTE ] WPP: Full fetch complete (47070 records). [2025-10-15T22:25:30.916856] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-15T22:25:31.315583] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-15T22:25:31.315859] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-15T22:25:31.315957] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-15T22:25:31.317787] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-15T22:25:31.317950] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-15T22:25:31.319096] [DEBUG] [LOCAL ] WPP: Trimmed 47070 records to 34446 (keeping 200 days of data) [2025-10-15T22:25:31.534267] [DEBUG] [LOCAL ] WPP: Primary data saved (34446 records). [2025-10-15T22:25:31.534402] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-15T22:25:31.534499] [INFO ] [MAIN ] Update Progress: 2316/2369 symbols completed. WPP took 24.3s. Estimated remaining: 7m 27s. Rate: 7.1 symbols/min [2025-10-15T22:25:31.702588] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:25:31.762860] [DEBUG] [LOCAL ] WSM: Loaded 49186 existing records from primary storage. [2025-10-15T22:25:31.763154] [INFO ] [MAIN ] WSM: Loaded 49186 existing records. [2025-10-15T22:25:31.940421] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:25:31.940676] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-15T22:25:31.940748] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-15T22:25:31.941219] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-15T22:25:31.941276] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-15T22:25:32.120038] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-15T22:25:32.296253] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:25:32.324067] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T22:25:32.896240] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T22:25:32.913963] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-15T22:25:33.400371] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T22:25:33.714092] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-15T22:25:34.482542] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T22:25:34.513959] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-15T22:25:34.922482] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T22:25:35.314048] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-15T22:25:36.114012] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-15T22:25:36.253902] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T22:25:36.794837] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T22:25:36.913949] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-15T22:25:37.672610] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T22:25:37.713958] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-15T22:25:38.514007] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-15T22:25:38.665965] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T22:25:39.313975] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-15T22:25:39.445389] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T22:25:39.991188] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T22:25:40.113961] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-15T22:25:40.591796] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T22:25:40.913995] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-15T22:25:41.545488] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T22:25:41.714004] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-15T22:25:42.514068] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-15T22:25:42.544691] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T22:25:43.313971] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-15T22:25:43.644198] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T22:25:43.837541] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T22:25:44.114009] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-15T22:25:44.914071] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-15T22:25:45.044217] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T22:25:45.100081] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T22:25:45.273674] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-15T22:25:45.280067] [INFO ] [REMOTE ] WRB: Full fetch complete (73634 records). [2025-10-15T22:25:45.280224] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-15T22:25:45.671345] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-15T22:25:45.671432] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-15T22:25:45.672842] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-15T22:25:45.672950] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-15T22:25:45.674487] [DEBUG] [LOCAL ] WRB: Trimmed 73634 records to 50783 (keeping 200 days of data) [2025-10-15T22:25:45.730739] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-15T22:25:45.995223] [DEBUG] [LOCAL ] WRB: Primary data saved (50783 records). [2025-10-15T22:25:45.995368] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-15T22:25:45.996331] [INFO ] [MAIN ] Update Progress: 2317/2369 symbols completed. WRB took 37.2s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-15T22:25:46.514004] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-15T22:25:47.313971] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-15T22:25:47.416168] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T22:25:47.613127] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T22:25:48.114015] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-15T22:25:48.914070] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-15T22:25:49.039978] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T22:25:49.445468] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T22:25:49.714078] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-15T22:25:50.201484] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T22:25:50.514059] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-15T22:25:51.314074] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-15T22:25:51.380482] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T22:25:51.387014] [INFO ] [REMOTE ] WRBY: Full fetch complete (73696 records). [2025-10-15T22:25:51.387208] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-15T22:25:51.484845] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T22:25:51.823435] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-15T22:25:51.823537] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-15T22:25:51.824749] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-15T22:25:51.824811] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-15T22:25:51.826260] [DEBUG] [LOCAL ] WRBY: Trimmed 73696 records to 50726 (keeping 200 days of data) [2025-10-15T22:25:52.114751] [DEBUG] [LOCAL ] WRBY: Primary data saved (50726 records). [2025-10-15T22:25:52.114869] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-15T22:25:52.115148] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-15T22:25:52.115508] [INFO ] [MAIN ] Update Progress: 2318/2369 symbols completed. WRBY took 28.1s. Estimated remaining: 7m 10s. Rate: 7.1 symbols/min [2025-10-15T22:25:53.105577] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T22:25:53.116797] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-15T22:25:53.166963] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T22:25:53.714049] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-15T22:25:54.854034] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T22:25:54.864572] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-15T22:25:55.025761] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T22:25:55.314115] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-15T22:25:56.326480] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T22:25:56.331350] [INFO ] [REMOTE ] WS: Full fetch complete (35929 records). [2025-10-15T22:25:56.331557] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-15T22:25:56.645168] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T22:25:56.694115] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-15T22:25:56.775671] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-15T22:25:56.775754] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-15T22:25:56.776444] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-15T22:25:56.776484] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-15T22:25:56.777282] [DEBUG] [LOCAL ] WS: Trimmed 35929 records to 23373 (keeping 200 days of data) [2025-10-15T22:25:56.918606] [DEBUG] [LOCAL ] WS: Primary data saved (23373 records). [2025-10-15T22:25:56.918760] [INFO ] [MAIN ] WS: Full history saved. [2025-10-15T22:25:56.918846] [INFO ] [MAIN ] Update Progress: 2319/2369 symbols completed. WS took 31.4s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-15T22:25:58.535478] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T22:25:58.546350] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-15T22:26:00.186998] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T22:26:00.196829] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-15T22:26:00.719604] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T22:26:00.725146] [INFO ] [REMOTE ] WSM: Full fetch complete (71651 records). [2025-10-15T22:26:00.725286] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-15T22:26:01.111827] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-15T22:26:01.111947] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-15T22:26:01.113127] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-15T22:26:01.113191] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-15T22:26:01.114670] [DEBUG] [LOCAL ] WSM: Trimmed 71651 records to 49101 (keeping 200 days of data) [2025-10-15T22:26:01.415364] [DEBUG] [LOCAL ] WSM: Primary data saved (49101 records). [2025-10-15T22:26:01.415499] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-15T22:26:01.415577] [INFO ] [MAIN ] Update Progress: 2320/2369 symbols completed. WSM took 29.9s. Estimated remaining: 6m 53s. Rate: 7.1 symbols/min [2025-10-15T22:26:02.155154] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:02.281519] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:02.272461] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:02.308474] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:02.346525] [DEBUG] [LOCAL ] WSR: Loaded 22994 existing records from primary storage. [2025-10-15T22:26:02.347675] [INFO ] [MAIN ] WSR: Loaded 22994 existing records. [2025-10-15T22:26:02.399634] [DEBUG] [LOCAL ] WSO: Loaded 25521 existing records from primary storage. [2025-10-15T22:26:02.436392] [INFO ] [MAIN ] WSO: Loaded 25521 existing records. [2025-10-15T22:26:02.576967] [DEBUG] [LOCAL ] WST: Loaded 36760 existing records from primary storage. [2025-10-15T22:26:02.645587] [INFO ] [MAIN ] WST: Loaded 36760 existing records. [2025-10-15T22:26:02.744674] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:02.727425] [DEBUG] [LOCAL ] WT: Loaded 48029 existing records from primary storage. [2025-10-15T22:26:02.746871] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-15T22:26:02.747222] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-15T22:26:02.767743] [INFO ] [MAIN ] WT: Loaded 48029 existing records. [2025-10-15T22:26:02.799598] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-15T22:26:02.854633] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-15T22:26:03.123914] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:03.238207] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-15T22:26:03.340086] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-15T22:26:03.361228] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:03.407794] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-15T22:26:03.441926] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-15T22:26:03.423790] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:03.451148] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-15T22:26:03.456515] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-15T22:26:03.466992] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-15T22:26:03.499711] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-15T22:26:03.483633] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-15T22:26:03.509375] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-15T22:26:03.518980] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-15T22:26:03.539679] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-15T22:26:03.971463] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:04.017769] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-15T22:26:04.637423] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:04.642867] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:04.653623] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-15T22:26:04.654761] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-15T22:26:04.717347] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:04.717788] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-15T22:26:05.042501] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T22:26:05.047392] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-15T22:26:05.511013] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T22:26:05.515093] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-15T22:26:06.199594] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T22:26:06.206598] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-15T22:26:06.300002] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T22:26:06.325535] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-15T22:26:06.328076] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T22:26:06.335046] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-15T22:26:06.670849] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T22:26:06.677065] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-15T22:26:07.260475] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T22:26:07.266874] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-15T22:26:07.400156] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T22:26:07.406728] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-15T22:26:07.549568] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T22:26:07.592455] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T22:26:08.113986] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-15T22:26:08.481214] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T22:26:08.913979] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-15T22:26:09.018449] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T22:26:09.371280] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T22:26:09.713992] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-15T22:26:10.091695] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T22:26:10.513989] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-15T22:26:11.314004] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-15T22:26:11.379718] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T22:26:11.688254] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T22:26:12.114034] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-15T22:26:12.436581] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T22:26:12.914031] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-15T22:26:13.114388] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T22:26:13.714011] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-15T22:26:14.513991] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-15T22:26:14.688319] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T22:26:15.247095] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T22:26:15.314036] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-15T22:26:15.648194] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T22:26:16.114048] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-15T22:26:16.600965] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T22:26:16.914054] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-15T22:26:17.330421] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T22:26:17.714042] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-15T22:26:18.223991] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T22:26:18.514005] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-15T22:26:19.064923] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T22:26:19.314031] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-15T22:26:19.705739] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T22:26:20.113993] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-15T22:26:20.503047] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T22:26:20.913999] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-15T22:26:21.197054] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T22:26:21.714001] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-15T22:26:22.215600] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T22:26:22.514037] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-15T22:26:22.746225] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T22:26:23.314004] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-15T22:26:24.119082] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-15T22:26:24.122188] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T22:26:24.486808] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T22:26:24.913994] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-15T22:26:25.083039] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T22:26:25.085946] [INFO ] [REMOTE ] WSR: Full fetch complete (32716 records). [2025-10-15T22:26:25.086038] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-15T22:26:25.442877] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-15T22:26:25.442969] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-15T22:26:25.443605] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-15T22:26:25.443668] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-15T22:26:25.444598] [DEBUG] [LOCAL ] WSR: Trimmed 32716 records to 22976 (keeping 200 days of data) [2025-10-15T22:26:25.585998] [DEBUG] [LOCAL ] WSR: Primary data saved (22976 records). [2025-10-15T22:26:25.586120] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-15T22:26:25.586196] [INFO ] [MAIN ] Update Progress: 2321/2369 symbols completed. WSR took 24.2s. Estimated remaining: 6m 45s. Rate: 7.1 symbols/min [2025-10-15T22:26:25.721742] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-15T22:26:25.753481] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:25.795632] [DEBUG] [LOCAL ] WTI: Loaded 44501 existing records from primary storage. [2025-10-15T22:26:25.795956] [INFO ] [MAIN ] WTI: Loaded 44501 existing records. [2025-10-15T22:26:25.970682] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:25.970923] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-15T22:26:25.970985] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-15T22:26:25.971360] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-15T22:26:25.971416] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-15T22:26:26.303905] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T22:26:26.390184] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:26.514002] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-15T22:26:27.313976] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-15T22:26:27.403340] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T22:26:28.114038] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-15T22:26:28.209588] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T22:26:28.506022] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T22:26:28.914008] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-15T22:26:29.714070] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-15T22:26:29.842562] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T22:26:30.514054] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-15T22:26:30.546431] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T22:26:30.692116] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T22:26:31.314023] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-15T22:26:31.830446] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T22:26:32.113988] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-15T22:26:32.437874] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T22:26:32.914090] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-15T22:26:33.714013] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-15T22:26:33.803894] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T22:26:34.029367] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T22:26:34.034843] [INFO ] [REMOTE ] WSO: Full fetch complete (35398 records). [2025-10-15T22:26:34.035017] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-15T22:26:34.418073] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-15T22:26:34.418151] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-15T22:26:34.418969] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-15T22:26:34.419034] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-15T22:26:34.419942] [DEBUG] [LOCAL ] WSO: Trimmed 35398 records to 25670 (keeping 200 days of data) [2025-10-15T22:26:34.515544] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-15T22:26:34.580532] [DEBUG] [LOCAL ] WSO: Primary data saved (25670 records). [2025-10-15T22:26:34.580683] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-15T22:26:34.580776] [INFO ] [MAIN ] Update Progress: 2322/2369 symbols completed. WSO took 33.2s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-15T22:26:34.749632] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:34.749816] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-15T22:26:34.749861] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-15T22:26:34.749986] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-15T22:26:34.750035] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-15T22:26:34.750075] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-15T22:26:34.750106] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-15T22:26:35.124829] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T22:26:35.173904] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:35.313977] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-15T22:26:35.683956] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-15T22:26:35.707214] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T22:26:35.713468] [INFO ] [REMOTE ] WT: Full fetch complete (69613 records). [2025-10-15T22:26:35.713595] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-15T22:26:36.112499] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-15T22:26:36.112574] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-15T22:26:36.113708] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-15T22:26:36.113771] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-15T22:26:36.114056] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-15T22:26:36.116258] [DEBUG] [LOCAL ] WT: Trimmed 69613 records to 48092 (keeping 200 days of data) [2025-10-15T22:26:36.396821] [DEBUG] [LOCAL ] WT: Primary data saved (48092 records). [2025-10-15T22:26:36.396949] [INFO ] [MAIN ] WT: Full history saved. [2025-10-15T22:26:36.397031] [INFO ] [MAIN ] Update Progress: 2323/2369 symbols completed. WT took 35.0s. Estimated remaining: 6m 28s. Rate: 7.1 symbols/min [2025-10-15T22:26:36.566970] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:36.569819] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-15T22:26:36.619151] [DEBUG] [LOCAL ] WTRG: Loaded 50985 existing records from primary storage. [2025-10-15T22:26:36.619477] [INFO ] [MAIN ] WTRG: Loaded 50985 existing records. [2025-10-15T22:26:36.792476] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:36.792863] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-15T22:26:36.792920] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-15T22:26:36.793383] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-15T22:26:36.793423] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-15T22:26:36.919144] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-15T22:26:37.146543] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:37.406590] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T22:26:37.714060] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-15T22:26:38.513998] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-15T22:26:39.319109] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-15T22:26:39.333252] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T22:26:39.751174] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T22:26:40.116865] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-15T22:26:40.119263] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T22:26:40.726707] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T22:26:40.731254] [INFO ] [REMOTE ] WST: Full fetch complete (54129 records). [2025-10-15T22:26:40.731356] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-15T22:26:40.927081] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-15T22:26:41.128340] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-15T22:26:41.128417] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-15T22:26:41.129529] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-15T22:26:41.129594] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-15T22:26:41.130740] [DEBUG] [LOCAL ] WST: Trimmed 54129 records to 36740 (keeping 200 days of data) [2025-10-15T22:26:41.363678] [DEBUG] [LOCAL ] WST: Primary data saved (36740 records). [2025-10-15T22:26:41.363826] [INFO ] [MAIN ] WST: Full history saved. [2025-10-15T22:26:41.365142] [INFO ] [MAIN ] Update Progress: 2324/2369 symbols completed. WST took 39.9s. Estimated remaining: 6m 19s. Rate: 7.1 symbols/min [2025-10-15T22:26:41.534740] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:41.554129] [DEBUG] [LOCAL ] WTS: Loaded 17497 existing records from primary storage. [2025-10-15T22:26:41.554353] [INFO ] [MAIN ] WTS: Loaded 17497 existing records. [2025-10-15T22:26:41.717863] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-15T22:26:41.728758] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:41.728992] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-15T22:26:41.729045] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-15T22:26:41.729326] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-15T22:26:41.729382] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-15T22:26:42.086859] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:42.359563] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T22:26:42.513977] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-15T22:26:43.313978] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-15T22:26:43.516352] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T22:26:43.542002] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T22:26:44.113992] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-15T22:26:44.772725] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T22:26:44.914007] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-15T22:26:45.103556] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T22:26:45.230245] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-15T22:26:45.713982] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-15T22:26:46.206261] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-15T22:26:46.514003] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-15T22:26:47.314058] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-15T22:26:48.113983] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-15T22:26:48.206908] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T22:26:48.486961] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-15T22:26:48.913993] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-15T22:26:49.038576] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T22:26:49.662788] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T22:26:49.713987] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-15T22:26:50.514001] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-15T22:26:50.815930] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T22:26:51.314022] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-15T22:26:52.071477] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T22:26:52.113953] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-15T22:26:52.914047] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-15T22:26:53.142288] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T22:26:53.623995] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T22:26:53.682149] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T22:26:53.713958] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-15T22:26:54.514029] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-15T22:26:55.297767] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T22:26:55.306438] [INFO ] [REMOTE ] WTI: Full fetch complete (64204 records). [2025-10-15T22:26:55.306615] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-15T22:26:55.322570] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-15T22:26:55.739499] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-15T22:26:55.739575] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-15T22:26:55.740662] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-15T22:26:55.740723] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-15T22:26:55.741916] [DEBUG] [LOCAL ] WTI: Trimmed 64204 records to 44655 (keeping 200 days of data) [2025-10-15T22:26:55.955186] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T22:26:56.012863] [DEBUG] [LOCAL ] WTI: Primary data saved (44655 records). [2025-10-15T22:26:56.012991] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-15T22:26:56.013068] [INFO ] [MAIN ] Update Progress: 2325/2369 symbols completed. WTI took 30.4s. Estimated remaining: 6m 11s. Rate: 7.1 symbols/min [2025-10-15T22:26:56.119086] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-15T22:26:56.188769] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:26:56.228951] [DEBUG] [LOCAL ] WTTR: Loaded 44560 existing records from primary storage. [2025-10-15T22:26:56.229246] [INFO ] [MAIN ] WTTR: Loaded 44560 existing records. [2025-10-15T22:26:56.407517] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:26:56.407793] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-15T22:26:56.407964] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-15T22:26:56.408407] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-15T22:26:56.408464] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-15T22:26:56.542166] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-15T22:26:56.832107] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:26:56.890779] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T22:26:56.913973] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-15T22:26:57.713973] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-15T22:26:57.867209] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T22:26:58.514018] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-15T22:26:58.859178] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-15T22:26:59.319120] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-15T22:26:59.336096] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T22:27:00.114052] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-15T22:27:00.862199] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T22:27:00.914013] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-15T22:27:01.417898] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-15T22:27:01.713995] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-15T22:27:01.782633] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T22:27:02.513999] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-15T22:27:02.894047] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T22:27:03.313991] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-15T22:27:03.353466] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T22:27:04.114033] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-15T22:27:04.643693] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T22:27:04.914037] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-15T22:27:04.991093] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T22:27:05.494165] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T22:27:05.495457] [INFO ] [REMOTE ] WTM: Full fetch complete (2699 records). [2025-10-15T22:27:05.495547] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-15T22:27:05.705722] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T22:27:05.705915] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T22:27:05.705993] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T22:27:05.706099] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-15T22:27:05.706216] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-15T22:27:05.706290] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-15T22:27:05.706352] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-15T22:27:05.706413] [INFO ] [MAIN ] Update Progress: 2326/2369 symbols completed. WTM took 31.1s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-15T22:27:05.719089] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-15T22:27:05.909261] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:05.960462] [DEBUG] [LOCAL ] WU: Loaded 53481 existing records from primary storage. [2025-10-15T22:27:05.960902] [INFO ] [MAIN ] WU: Loaded 53481 existing records. [2025-10-15T22:27:06.162167] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:06.162397] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-15T22:27:06.162488] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-15T22:27:06.163078] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-15T22:27:06.163138] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-15T22:27:06.521327] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-15T22:27:06.564770] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:06.893524] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T22:27:07.314055] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-15T22:27:07.874695] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T22:27:08.113991] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-15T22:27:08.786064] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T22:27:08.913960] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-15T22:27:09.572424] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T22:27:09.714004] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-15T22:27:09.870914] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T22:27:10.514007] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-15T22:27:11.314018] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-15T22:27:11.369499] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T22:27:12.113982] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-15T22:27:12.212519] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T22:27:12.613745] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T22:27:12.913965] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-15T22:27:13.716188] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-15T22:27:13.718977] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T22:27:14.513966] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-15T22:27:14.588142] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T22:27:15.314026] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-15T22:27:15.375483] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T22:27:15.386251] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T22:27:15.386062] [INFO ] [REMOTE ] WTRG: Full fetch complete (73760 records). [2025-10-15T22:27:15.388269] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-15T22:27:15.388551] [INFO ] [REMOTE ] WTS: Full fetch complete (25673 records). [2025-10-15T22:27:15.388618] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-15T22:27:16.123876] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-15T22:27:16.147840] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-15T22:27:16.147932] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-15T22:27:16.148860] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-15T22:27:16.149127] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-15T22:27:16.149203] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-15T22:27:16.149273] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-15T22:27:16.150090] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-15T22:27:16.150378] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-15T22:27:16.151696] [DEBUG] [LOCAL ] WTS: Trimmed 25673 records to 17424 (keeping 200 days of data) [2025-10-15T22:27:16.152123] [DEBUG] [LOCAL ] WTRG: Trimmed 73760 records to 50972 (keeping 200 days of data) [2025-10-15T22:27:16.502193] [DEBUG] [LOCAL ] WTS: Primary data saved (17424 records). [2025-10-15T22:27:16.548277] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-15T22:27:16.552222] [INFO ] [MAIN ] Update Progress: 2327/2369 symbols completed. WTS took 35.2s. Estimated remaining: 5m 54s. Rate: 7.1 symbols/min [2025-10-15T22:27:16.744331] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:16.747353] [DEBUG] [LOCAL ] WTRG: Primary data saved (50972 records). [2025-10-15T22:27:16.748063] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-15T22:27:16.748170] [INFO ] [MAIN ] Update Progress: 2328/2369 symbols completed. WTRG took 40.4s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-15T22:27:16.859004] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T22:27:16.938320] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-15T22:27:16.964198] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:17.002311] [DEBUG] [LOCAL ] WWW: Loaded 49188 existing records from primary storage. [2025-10-15T22:27:17.002789] [INFO ] [MAIN ] WWW: Loaded 49188 existing records. [2025-10-15T22:27:17.192758] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:17.193229] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-15T22:27:17.193306] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-15T22:27:17.207468] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-15T22:27:17.207574] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-15T22:27:17.270696] [DEBUG] [LOCAL ] WY: Loaded 53199 existing records from primary storage. [2025-10-15T22:27:17.297157] [INFO ] [MAIN ] WY: Loaded 53199 existing records. [2025-10-15T22:27:17.693269] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:17.696092] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-15T22:27:17.696503] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-15T22:27:17.717879] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-15T22:27:17.723123] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-15T22:27:17.819447] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:17.869992] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-15T22:27:18.154311] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:18.210496] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T22:27:18.343276] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T22:27:18.513991] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-15T22:27:18.986537] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T22:27:19.314021] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-15T22:27:19.615675] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T22:27:20.114004] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-15T22:27:20.731511] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T22:27:20.913997] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-15T22:27:21.508859] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T22:27:21.713992] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-15T22:27:22.514034] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-15T22:27:22.557175] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T22:27:23.263090] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T22:27:23.313957] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-15T22:27:23.795358] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T22:27:24.113997] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-15T22:27:24.560707] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T22:27:24.914005] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-15T22:27:25.600751] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T22:27:25.713979] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-15T22:27:26.523405] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-15T22:27:26.528781] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T22:27:27.313970] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-15T22:27:27.501434] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T22:27:28.114045] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-15T22:27:28.337171] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T22:27:28.343119] [INFO ] [REMOTE ] WTTR: Full fetch complete (65563 records). [2025-10-15T22:27:28.343275] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-15T22:27:28.499597] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T22:27:28.784412] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-15T22:27:28.784499] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-15T22:27:28.785581] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-15T22:27:28.785664] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-15T22:27:28.786921] [DEBUG] [LOCAL ] WTTR: Trimmed 65563 records to 44606 (keeping 200 days of data) [2025-10-15T22:27:28.952543] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-15T22:27:29.050670] [DEBUG] [LOCAL ] WTTR: Primary data saved (44606 records). [2025-10-15T22:27:29.050821] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-15T22:27:29.050905] [INFO ] [MAIN ] Update Progress: 2329/2369 symbols completed. WTTR took 33.0s. Estimated remaining: 5m 37s. Rate: 7.1 symbols/min [2025-10-15T22:27:29.215239] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:29.246633] [DEBUG] [LOCAL ] XFLT: Loaded 29906 existing records from primary storage. [2025-10-15T22:27:29.246939] [INFO ] [MAIN ] XFLT: Loaded 29906 existing records. [2025-10-15T22:27:29.420222] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:29.420456] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-15T22:27:29.420512] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-15T22:27:29.420797] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-15T22:27:29.420855] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-15T22:27:29.714705] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-15T22:27:29.778292] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:29.870608] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T22:27:30.514007] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-15T22:27:30.919315] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T22:27:31.289357] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T22:27:31.313954] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-15T22:27:31.932898] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T22:27:32.113975] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-15T22:27:32.914056] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-15T22:27:32.975282] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T22:27:33.512105] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T22:27:33.713977] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-15T22:27:34.484970] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T22:27:34.513974] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-15T22:27:35.314030] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-15T22:27:35.684331] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T22:27:35.840504] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T22:27:36.114015] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-15T22:27:36.914043] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-15T22:27:37.070426] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T22:27:37.076777] [INFO ] [REMOTE ] WU: Full fetch complete (77511 records). [2025-10-15T22:27:37.076902] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-15T22:27:37.455869] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-15T22:27:37.455956] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-15T22:27:37.457152] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-15T22:27:37.457240] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-15T22:27:37.458724] [DEBUG] [LOCAL ] WU: Trimmed 77511 records to 53480 (keeping 200 days of data) [2025-10-15T22:27:37.736772] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-15T22:27:37.787122] [DEBUG] [LOCAL ] WU: Primary data saved (53480 records). [2025-10-15T22:27:37.787242] [INFO ] [MAIN ] WU: Full history saved. [2025-10-15T22:27:37.788286] [INFO ] [MAIN ] Update Progress: 2330/2369 symbols completed. WU took 32.1s. Estimated remaining: 5m 29s. Rate: 7.1 symbols/min [2025-10-15T22:27:37.965142] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:37.999113] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-15T22:27:38.050501] [DEBUG] [LOCAL ] XHR: Loaded 43595 existing records from primary storage. [2025-10-15T22:27:38.050821] [INFO ] [MAIN ] XHR: Loaded 43595 existing records. [2025-10-15T22:27:38.231502] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:38.231805] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-15T22:27:38.232038] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-15T22:27:38.232407] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-15T22:27:38.232598] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-15T22:27:38.358346] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T22:27:38.523845] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-15T22:27:38.617803] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:39.313983] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-15T22:27:39.433296] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T22:27:39.836297] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T22:27:40.114074] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-15T22:27:40.347335] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T22:27:40.914066] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-15T22:27:41.432214] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T22:27:41.713979] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-15T22:27:42.514047] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-15T22:27:42.581698] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T22:27:42.647979] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T22:27:43.313993] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-15T22:27:43.504363] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T22:27:44.113987] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-15T22:27:44.877894] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T22:27:44.913962] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-15T22:27:45.714041] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-15T22:27:45.927295] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T22:27:46.513960] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-15T22:27:46.668269] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T22:27:46.893149] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T22:27:47.314043] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-15T22:27:48.086749] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T22:27:48.113962] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-15T22:27:48.914012] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-15T22:27:49.062601] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T22:27:49.713959] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-15T22:27:50.125131] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-15T22:27:50.226192] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T22:27:50.514018] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-15T22:27:51.313985] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-15T22:27:51.452040] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T22:27:51.688497] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-15T22:27:52.119198] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-15T22:27:52.130605] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T22:27:52.914040] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-15T22:27:53.588192] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T22:27:53.594873] [INFO ] [REMOTE ] WY: Full fetch complete (77036 records). [2025-10-15T22:27:53.594986] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-15T22:27:53.718127] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-15T22:27:53.892888] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T22:27:53.929746] [INFO ] [REMOTE ] WWW: Full fetch complete (70543 records). [2025-10-15T22:27:53.945210] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-15T22:27:54.123409] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-15T22:27:54.123522] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-15T22:27:54.124898] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-15T22:27:54.125278] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-15T22:27:54.183715] [DEBUG] [LOCAL ] WY: Trimmed 77036 records to 53219 (keeping 200 days of data) [2025-10-15T22:27:54.514319] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-15T22:27:54.514577] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-15T22:27:54.515823] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-15T22:27:54.518031] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-15T22:27:54.519045] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-15T22:27:54.527154] [DEBUG] [LOCAL ] WWW: Trimmed 70543 records to 49251 (keeping 200 days of data) [2025-10-15T22:27:54.994771] [DEBUG] [LOCAL ] WY: Primary data saved (53219 records). [2025-10-15T22:27:54.996916] [INFO ] [MAIN ] WY: Full history saved. [2025-10-15T22:27:54.997027] [INFO ] [MAIN ] Update Progress: 2331/2369 symbols completed. WY took 38.2s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-15T22:27:55.220968] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:55.221911] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-15T22:27:55.223184] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-15T22:27:55.224196] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-15T22:27:55.224675] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-15T22:27:55.226106] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-15T22:27:55.227226] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-15T22:27:55.301237] [DEBUG] [LOCAL ] WWW: Primary data saved (49251 records). [2025-10-15T22:27:55.323495] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-15T22:27:55.334984] [INFO ] [MAIN ] Update Progress: 2332/2369 symbols completed. WWW took 38.8s. Estimated remaining: 5m 12s. Rate: 7.1 symbols/min [2025-10-15T22:27:55.647931] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T22:27:55.753362] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-15T22:27:55.881318] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:56.032732] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:56.063852] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T22:27:56.131714] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-15T22:27:56.135981] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-15T22:27:56.137857] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-15T22:27:56.430526] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:56.430812] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-15T22:27:56.430879] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-15T22:27:56.431754] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-15T22:27:56.431830] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-15T22:27:56.822169] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:56.913963] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-15T22:27:57.293516] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:27:57.293841] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-15T22:27:57.293942] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:27:57.294015] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-15T22:27:57.294079] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:27:57.294148] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-15T22:27:57.294210] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-15T22:27:57.294245] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-15T22:27:57.294283] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-15T22:27:57.294327] [INFO ] [MAIN ] Update Progress: 2333/2369 symbols completed. XIFR took 2.3s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-15T22:27:57.488358] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:27:57.490341] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T22:27:57.519127] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T22:27:57.549846] [DEBUG] [LOCAL ] XPER: Loaded 30321 existing records from primary storage. [2025-10-15T22:27:57.550126] [INFO ] [MAIN ] XPER: Loaded 30321 existing records. [2025-10-15T22:27:57.721304] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-15T22:27:57.727853] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:27:57.728190] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-15T22:27:57.728280] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-15T22:27:57.728606] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-15T22:27:57.728684] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-15T22:27:58.069237] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:27:58.514418] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-15T22:27:58.990480] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T22:27:59.313995] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-15T22:28:00.113992] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-15T22:28:00.884198] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T22:28:00.915230] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-15T22:28:00.920743] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-15T22:28:01.501911] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T22:28:01.714037] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-15T22:28:02.081221] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T22:28:02.085187] [INFO ] [REMOTE ] XFLT: Full fetch complete (43814 records). [2025-10-15T22:28:02.085324] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-15T22:28:02.458457] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-15T22:28:02.458551] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-15T22:28:02.459391] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-15T22:28:02.459451] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-15T22:28:02.460395] [DEBUG] [LOCAL ] XFLT: Trimmed 43814 records to 29971 (keeping 200 days of data) [2025-10-15T22:28:02.516841] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-15T22:28:02.632401] [DEBUG] [LOCAL ] XFLT: Primary data saved (29971 records). [2025-10-15T22:28:02.632524] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-15T22:28:02.632604] [INFO ] [MAIN ] Update Progress: 2334/2369 symbols completed. XFLT took 33.6s. Estimated remaining: 4m 55s. Rate: 7.1 symbols/min [2025-10-15T22:28:02.796670] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:28:02.849221] [DEBUG] [LOCAL ] XPEV: Loaded 53631 existing records from primary storage. [2025-10-15T22:28:02.849522] [INFO ] [MAIN ] XPEV: Loaded 53631 existing records. [2025-10-15T22:28:03.022026] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:28:03.022332] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-15T22:28:03.022393] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-15T22:28:03.022776] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-15T22:28:03.022832] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-15T22:28:03.315071] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-15T22:28:03.390770] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:28:03.403562] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T22:28:04.114044] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-15T22:28:04.466745] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T22:28:04.536160] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T22:28:04.913996] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-15T22:28:05.714044] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-15T22:28:06.108870] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T22:28:06.287501] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-15T22:28:06.514011] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-15T22:28:07.314011] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-15T22:28:07.849812] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-15T22:28:08.113982] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-15T22:28:08.399992] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-15T22:28:08.487286] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T22:28:08.913987] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-15T22:28:09.713998] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-15T22:28:10.156206] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T22:28:10.205476] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T22:28:10.514013] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-15T22:28:10.649680] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T22:28:10.655307] [INFO ] [REMOTE ] XHR: Full fetch complete (61906 records). [2025-10-15T22:28:10.655429] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-15T22:28:11.061857] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-15T22:28:11.061944] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-15T22:28:11.063005] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-15T22:28:11.063069] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-15T22:28:11.064502] [DEBUG] [LOCAL ] XHR: Trimmed 61906 records to 43603 (keeping 200 days of data) [2025-10-15T22:28:11.314882] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-15T22:28:11.325940] [DEBUG] [LOCAL ] XHR: Primary data saved (43603 records). [2025-10-15T22:28:11.326011] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-15T22:28:11.326808] [INFO ] [MAIN ] Update Progress: 2335/2369 symbols completed. XHR took 33.5s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-15T22:28:11.491941] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:28:11.538811] [DEBUG] [LOCAL ] XPO: Loaded 47713 existing records from primary storage. [2025-10-15T22:28:11.539104] [INFO ] [MAIN ] XPO: Loaded 47713 existing records. [2025-10-15T22:28:11.709689] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:28:11.709961] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-15T22:28:11.710008] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-15T22:28:11.710384] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-15T22:28:11.710440] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-15T22:28:12.089933] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:28:12.113970] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-15T22:28:12.924251] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-15T22:28:12.944849] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-15T22:28:13.490836] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T22:28:13.651530] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-15T22:28:13.713977] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-15T22:28:13.778038] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T22:28:14.513993] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-15T22:28:15.313989] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-15T22:28:15.736722] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T22:28:16.113967] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-15T22:28:16.268868] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T22:28:16.641231] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T22:28:16.913994] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-15T22:28:17.714039] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-15T22:28:18.518886] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-15T22:28:18.532024] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-15T22:28:18.591049] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T22:28:19.314013] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-15T22:28:19.654429] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T22:28:19.850943] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-15T22:28:20.113993] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-15T22:28:20.914038] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-15T22:28:21.000431] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T22:28:21.713999] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-15T22:28:22.214404] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T22:28:22.514352] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-15T22:28:22.518197] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-15T22:28:23.246216] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T22:28:23.313965] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-15T22:28:24.114004] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-15T22:28:24.847281] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T22:28:24.914003] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-15T22:28:24.983731] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-15T22:28:25.463493] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T22:28:25.714009] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-15T22:28:26.033528] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T22:28:26.514050] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-15T22:28:27.088734] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T22:28:27.313999] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-15T22:28:28.114020] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-15T22:28:28.919097] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-15T22:28:28.941945] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-15T22:28:29.197243] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T22:28:29.348503] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T22:28:29.353526] [INFO ] [REMOTE ] XPER: Full fetch complete (43482 records). [2025-10-15T22:28:29.353810] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-15T22:28:29.717323] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-15T22:28:29.759405] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-15T22:28:29.759492] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-15T22:28:29.760455] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-15T22:28:29.760525] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-15T22:28:29.761606] [DEBUG] [LOCAL ] XPER: Trimmed 43482 records to 30424 (keeping 200 days of data) [2025-10-15T22:28:29.927411] [DEBUG] [LOCAL ] XPER: Primary data saved (30424 records). [2025-10-15T22:28:29.927544] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-15T22:28:29.927666] [INFO ] [MAIN ] Update Progress: 2336/2369 symbols completed. XPER took 32.6s. Estimated remaining: 4m 38s. Rate: 7.1 symbols/min [2025-10-15T22:28:30.092704] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:28:30.126931] [DEBUG] [LOCAL ] XPOF: Loaded 37447 existing records from primary storage. [2025-10-15T22:28:30.127211] [INFO ] [MAIN ] XPOF: Loaded 37447 existing records. [2025-10-15T22:28:30.298291] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:28:30.298518] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-15T22:28:30.298565] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-15T22:28:30.298902] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-15T22:28:30.298986] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-15T22:28:30.524386] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-15T22:28:30.651184] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:28:30.681811] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T22:28:31.314066] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-15T22:28:32.102621] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-15T22:28:32.114047] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-15T22:28:32.689588] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-15T22:28:32.913969] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-15T22:28:32.983805] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T22:28:33.317463] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T22:28:33.396064] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T22:28:33.402543] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-15T22:28:33.402718] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-15T22:28:33.728278] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-15T22:28:33.786134] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-15T22:28:33.786211] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-15T22:28:33.787410] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-15T22:28:33.787474] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-15T22:28:33.789043] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 53793 (keeping 200 days of data) [2025-10-15T22:28:34.122545] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-15T22:28:34.122723] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-15T22:28:34.123841] [INFO ] [MAIN ] Update Progress: 2337/2369 symbols completed. XOM took 38.8s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-15T22:28:34.300160] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:28:34.345631] [DEBUG] [LOCAL ] XPRO: Loaded 45907 existing records from primary storage. [2025-10-15T22:28:34.346025] [INFO ] [MAIN ] XPRO: Loaded 45907 existing records. [2025-10-15T22:28:34.520505] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-15T22:28:34.527791] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:28:34.528037] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-15T22:28:34.528086] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-15T22:28:34.528367] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-15T22:28:34.528422] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-15T22:28:34.875230] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:28:35.313995] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-15T22:28:35.796690] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T22:28:36.119432] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-15T22:28:36.124960] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-15T22:28:36.627901] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T22:28:36.913995] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-15T22:28:37.090316] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T22:28:37.714002] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-15T22:28:38.514092] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-15T22:28:39.178868] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T22:28:39.313998] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-15T22:28:39.358036] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-15T22:28:39.672413] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T22:28:40.114010] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-15T22:28:40.759401] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T22:28:40.914000] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-15T22:28:41.525029] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T22:28:41.714040] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-15T22:28:42.514033] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-15T22:28:43.319140] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-15T22:28:43.333633] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T22:28:43.442607] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-15T22:28:44.080057] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T22:28:44.113950] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-15T22:28:44.805329] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T22:28:44.914002] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-15T22:28:45.597076] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T22:28:45.713987] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-15T22:28:46.373901] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T22:28:46.379905] [INFO ] [REMOTE ] XPO: Full fetch complete (69781 records). [2025-10-15T22:28:46.380071] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-15T22:28:46.519125] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-15T22:28:46.769679] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-15T22:28:46.769767] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-15T22:28:46.771028] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-15T22:28:46.771098] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-15T22:28:46.772726] [DEBUG] [LOCAL ] XPO: Trimmed 69781 records to 47630 (keeping 200 days of data) [2025-10-15T22:28:47.072280] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T22:28:47.090104] [DEBUG] [LOCAL ] XPO: Primary data saved (47630 records). [2025-10-15T22:28:47.090204] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-15T22:28:47.091061] [INFO ] [MAIN ] Update Progress: 2338/2369 symbols completed. XPO took 35.8s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-15T22:28:47.259393] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:28:47.290702] [DEBUG] [LOCAL ] XYF: Loaded 27954 existing records from primary storage. [2025-10-15T22:28:47.290970] [INFO ] [MAIN ] XYF: Loaded 27954 existing records. [2025-10-15T22:28:47.320767] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-15T22:28:47.467602] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:28:47.467912] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-15T22:28:47.467968] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-15T22:28:47.468325] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-15T22:28:47.468381] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-15T22:28:47.836864] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:28:48.113978] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-15T22:28:48.725307] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T22:28:48.790286] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-15T22:28:48.796750] [INFO ] [REMOTE ] XPEV: Full fetch complete (77784 records). [2025-10-15T22:28:48.796909] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-15T22:28:48.919040] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-15T22:28:49.216850] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-15T22:28:49.233431] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-15T22:28:49.234933] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-15T22:28:49.235045] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-15T22:28:49.237916] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T22:28:49.251364] [DEBUG] [LOCAL ] XPEV: Trimmed 77784 records to 53631 (keeping 200 days of data) [2025-10-15T22:28:49.581609] [DEBUG] [LOCAL ] XPEV: Primary data saved (53631 records). [2025-10-15T22:28:49.581963] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-15T22:28:49.582079] [INFO ] [MAIN ] Update Progress: 2339/2369 symbols completed. XPEV took 46.9s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-15T22:28:49.691491] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T22:28:49.714475] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-15T22:28:49.759747] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:28:49.804919] [DEBUG] [LOCAL ] XYL: Loaded 47817 existing records from primary storage. [2025-10-15T22:28:49.805247] [INFO ] [MAIN ] XYL: Loaded 47817 existing records. [2025-10-15T22:28:49.979412] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:28:49.979726] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-15T22:28:49.979782] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-15T22:28:49.980267] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-15T22:28:49.980323] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-15T22:28:50.328801] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:28:50.513961] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-15T22:28:50.548037] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T22:28:51.314005] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-15T22:28:52.114048] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-15T22:28:52.330947] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T22:28:52.542501] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T22:28:52.913990] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-15T22:28:53.659055] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T22:28:53.714007] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-15T22:28:54.141528] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T22:28:54.514057] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-15T22:28:55.181446] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T22:28:55.314054] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-15T22:28:55.641037] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T22:28:56.114067] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-15T22:28:56.913973] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-15T22:28:56.985129] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T22:28:57.597107] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T22:28:57.713970] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-15T22:28:58.339971] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T22:28:58.513985] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-15T22:28:59.314012] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-15T22:28:59.352173] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T22:28:59.754809] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T22:29:00.113972] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-15T22:29:00.485778] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T22:29:00.913999] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-15T22:29:01.717053] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-15T22:29:01.729113] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T22:29:02.000814] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T22:29:02.514066] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-15T22:29:03.179213] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T22:29:03.313975] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-15T22:29:03.903197] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T22:29:04.113994] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-15T22:29:04.675307] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T22:29:04.914007] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-15T22:29:05.118103] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T22:29:05.714065] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-15T22:29:05.891688] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T22:29:05.896137] [INFO ] [REMOTE ] XPOF: Full fetch complete (52887 records). [2025-10-15T22:29:05.896261] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-15T22:29:06.329925] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-15T22:29:06.330037] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-15T22:29:06.331170] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-15T22:29:06.331235] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-15T22:29:06.332378] [DEBUG] [LOCAL ] XPOF: Trimmed 52887 records to 37439 (keeping 200 days of data) [2025-10-15T22:29:06.517683] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-15T22:29:06.537742] [DEBUG] [LOCAL ] XPOF: Primary data saved (37439 records). [2025-10-15T22:29:06.537924] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-15T22:29:06.538018] [INFO ] [MAIN ] Update Progress: 2340/2369 symbols completed. XPOF took 36.6s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-15T22:29:06.704632] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:06.704832] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-15T22:29:06.704874] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-15T22:29:06.704978] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-15T22:29:06.705019] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-15T22:29:06.705060] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-15T22:29:06.705091] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-15T22:29:07.072058] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:07.073405] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T22:29:07.078809] [INFO ] [REMOTE ] XPRO: Full fetch complete (66469 records). [2025-10-15T22:29:07.078891] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-15T22:29:07.319076] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-15T22:29:07.455426] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-15T22:29:07.455511] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-15T22:29:07.456606] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-15T22:29:07.456690] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-15T22:29:07.458027] [DEBUG] [LOCAL ] XPRO: Trimmed 66469 records to 45894 (keeping 200 days of data) [2025-10-15T22:29:07.615547] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T22:29:07.650593] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-15T22:29:07.659887] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:29:07.661341] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-15T22:29:07.663684] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:29:07.678267] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-15T22:29:07.678726] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-15T22:29:07.678813] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-15T22:29:07.679207] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-15T22:29:07.679688] [INFO ] [MAIN ] Update Progress: 2341/2369 symbols completed. XYZ took 1.1s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-15T22:29:07.846860] [DEBUG] [LOCAL ] XPRO: Primary data saved (45894 records). [2025-10-15T22:29:07.871193] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-15T22:29:07.871405] [INFO ] [MAIN ] Update Progress: 2342/2369 symbols completed. XPRO took 33.7s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-15T22:29:07.932622] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:08.066877] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:08.086772] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T22:29:08.118093] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-15T22:29:08.120685] [DEBUG] [LOCAL ] YALA: Loaded 36892 existing records from primary storage. [2025-10-15T22:29:08.121069] [INFO ] [MAIN ] YALA: Loaded 36892 existing records. [2025-10-15T22:29:08.346590] [DEBUG] [LOCAL ] YELP: Loaded 45451 existing records from primary storage. [2025-10-15T22:29:08.351516] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:08.351961] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-15T22:29:08.351901] [INFO ] [MAIN ] YELP: Loaded 45451 existing records. [2025-10-15T22:29:08.352073] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-15T22:29:08.421822] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-15T22:29:08.435759] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-15T22:29:08.675204] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:08.695132] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-15T22:29:08.709727] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-15T22:29:08.776913] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-15T22:29:08.788388] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-15T22:29:08.941799] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-15T22:29:09.022891] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:09.260623] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:09.273242] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T22:29:09.713993] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-15T22:29:10.513928] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-15T22:29:10.604939] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T22:29:10.670379] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T22:29:10.673482] [INFO ] [REMOTE ] XYF: Full fetch complete (33184 records). [2025-10-15T22:29:10.673580] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-15T22:29:11.042991] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-15T22:29:11.043067] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-15T22:29:11.043785] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-15T22:29:11.043846] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-15T22:29:11.044691] [DEBUG] [LOCAL ] XYF: Trimmed 33184 records to 27851 (keeping 200 days of data) [2025-10-15T22:29:11.213568] [DEBUG] [LOCAL ] XYF: Primary data saved (27851 records). [2025-10-15T22:29:11.213725] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-15T22:29:11.213867] [INFO ] [MAIN ] Update Progress: 2343/2369 symbols completed. XYF took 24.1s. Estimated remaining: 3m 39s. Rate: 7.1 symbols/min [2025-10-15T22:29:11.314395] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-15T22:29:11.406376] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:11.404725] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T22:29:11.460835] [DEBUG] [LOCAL ] YETI: Loaded 52490 existing records from primary storage. [2025-10-15T22:29:11.461151] [INFO ] [MAIN ] YETI: Loaded 52490 existing records. [2025-10-15T22:29:11.634031] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:11.634249] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-15T22:29:11.634338] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-15T22:29:11.634707] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-15T22:29:11.634774] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-15T22:29:11.980084] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:12.114016] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-15T22:29:12.913992] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-15T22:29:12.972560] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:29:13.615465] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T22:29:13.714008] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-15T22:29:14.523388] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-15T22:29:14.543886] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T22:29:14.756891] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T22:29:15.314072] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-15T22:29:16.114010] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-15T22:29:16.193408] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T22:29:16.852615] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T22:29:16.914005] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-15T22:29:17.474637] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T22:29:17.714020] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-15T22:29:17.889697] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T22:29:18.514038] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-15T22:29:19.313963] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-15T22:29:19.350233] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T22:29:19.423933] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T22:29:20.114056] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-15T22:29:20.649182] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T22:29:20.914009] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-15T22:29:21.715589] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-15T22:29:21.722130] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T22:29:22.004275] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-15T22:29:22.010057] [INFO ] [REMOTE ] XYL: Full fetch complete (69914 records). [2025-10-15T22:29:22.010171] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-15T22:29:22.392638] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T22:29:22.415002] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-15T22:29:22.421410] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-15T22:29:22.422718] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-15T22:29:22.422796] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-15T22:29:22.424450] [DEBUG] [LOCAL ] XYL: Trimmed 69914 records to 47784 (keeping 200 days of data) [2025-10-15T22:29:22.521074] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-15T22:29:22.723703] [DEBUG] [LOCAL ] XYL: Primary data saved (47784 records). [2025-10-15T22:29:22.723843] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-15T22:29:22.723938] [INFO ] [MAIN ] Update Progress: 2344/2369 symbols completed. XYL took 33.1s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-15T22:29:22.893351] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:22.935465] [DEBUG] [LOCAL ] YEXT: Loaded 43121 existing records from primary storage. [2025-10-15T22:29:22.935809] [INFO ] [MAIN ] YEXT: Loaded 43121 existing records. [2025-10-15T22:29:23.108626] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:23.108878] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-15T22:29:23.108935] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-15T22:29:23.109263] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-15T22:29:23.109319] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-15T22:29:23.322614] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-15T22:29:23.457089] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:23.918181] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T22:29:24.114045] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-15T22:29:24.914009] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-15T22:29:24.993139] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T22:29:25.311602] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T22:29:25.714002] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-15T22:29:26.519303] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-15T22:29:26.549454] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T22:29:26.905343] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T22:29:27.314022] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-15T22:29:28.113983] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-15T22:29:28.143774] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T22:29:28.913977] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-15T22:29:29.304622] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T22:29:29.713993] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-15T22:29:29.968351] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T22:29:30.513951] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-15T22:29:30.558942] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T22:29:30.633787] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T22:29:31.314036] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-15T22:29:32.114886] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-15T22:29:32.117282] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T22:29:32.914022] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-15T22:29:32.995723] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T22:29:33.471768] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T22:29:33.714016] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-15T22:29:34.432628] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T22:29:34.513951] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-15T22:29:35.314063] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-15T22:29:35.519556] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T22:29:35.973443] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T22:29:36.113995] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-15T22:29:36.612867] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T22:29:36.914000] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-15T22:29:37.589929] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T22:29:37.713992] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-15T22:29:38.513979] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-15T22:29:38.562329] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T22:29:39.313959] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-15T22:29:39.561584] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T22:29:40.048168] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T22:29:40.113987] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-15T22:29:40.591809] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T22:29:40.914018] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-15T22:29:41.515266] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T22:29:41.714033] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-15T22:29:42.276051] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T22:29:42.513980] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-15T22:29:43.239207] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T22:29:43.313976] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-15T22:29:44.054829] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T22:29:44.114030] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-15T22:29:44.914025] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-15T22:29:45.061881] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T22:29:45.216251] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T22:29:45.221969] [INFO ] [REMOTE ] YELP: Full fetch complete (64862 records). [2025-10-15T22:29:45.222077] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-15T22:29:45.603492] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-15T22:29:45.603562] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-15T22:29:45.604622] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-15T22:29:45.604705] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-15T22:29:45.605941] [DEBUG] [LOCAL ] YELP: Trimmed 64862 records to 45489 (keeping 200 days of data) [2025-10-15T22:29:45.714164] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-15T22:29:45.870115] [DEBUG] [LOCAL ] YELP: Primary data saved (45489 records). [2025-10-15T22:29:45.870249] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-15T22:29:45.870341] [INFO ] [MAIN ] Update Progress: 2345/2369 symbols completed. YELP took 38.0s. Estimated remaining: 3m 22s. Rate: 7.1 symbols/min [2025-10-15T22:29:46.035013] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:46.045140] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T22:29:46.049852] [INFO ] [REMOTE ] YALA: Full fetch complete (47062 records). [2025-10-15T22:29:46.050034] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-15T22:29:46.406728] [DEBUG] [LOCAL ] YMM: Loaded 52601 existing records from primary storage. [2025-10-15T22:29:46.437265] [INFO ] [MAIN ] YMM: Loaded 52601 existing records. [2025-10-15T22:29:46.560048] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-15T22:29:46.549156] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-15T22:29:46.568925] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-15T22:29:46.573021] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-15T22:29:46.573110] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-15T22:29:46.633142] [DEBUG] [LOCAL ] YALA: Trimmed 47062 records to 36820 (keeping 200 days of data) [2025-10-15T22:29:46.652960] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:46.653320] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-15T22:29:46.653377] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-15T22:29:46.653753] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-15T22:29:46.653810] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-15T22:29:47.175443] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:47.228871] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T22:29:47.243020] [INFO ] [REMOTE ] YETI: Full fetch complete (75568 records). [2025-10-15T22:29:47.246541] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-15T22:29:47.252376] [DEBUG] [LOCAL ] YALA: Primary data saved (36820 records). [2025-10-15T22:29:47.252604] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-15T22:29:47.252762] [INFO ] [MAIN ] Update Progress: 2346/2369 symbols completed. YALA took 39.6s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-15T22:29:47.321006] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-15T22:29:47.639130] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:47.848837] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-15T22:29:47.848926] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-15T22:29:47.850121] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-15T22:29:47.850234] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-15T22:29:47.851774] [DEBUG] [LOCAL ] YETI: Trimmed 75568 records to 52503 (keeping 200 days of data) [2025-10-15T22:29:47.989279] [DEBUG] [LOCAL ] YOU: Loaded 49635 existing records from primary storage. [2025-10-15T22:29:47.990380] [INFO ] [MAIN ] YOU: Loaded 49635 existing records. [2025-10-15T22:29:48.183829] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:48.185228] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-15T22:29:48.185938] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-15T22:29:48.189666] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-15T22:29:48.189772] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-15T22:29:48.370073] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T22:29:48.436067] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-15T22:29:48.733263] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:48.842999] [DEBUG] [LOCAL ] YETI: Primary data saved (52503 records). [2025-10-15T22:29:48.843176] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-15T22:29:48.844122] [INFO ] [MAIN ] Update Progress: 2347/2369 symbols completed. YETI took 37.6s. Estimated remaining: 3m 5s. Rate: 7.1 symbols/min [2025-10-15T22:29:48.923414] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-15T22:29:49.016710] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:49.066512] [DEBUG] [LOCAL ] YPF: Loaded 50641 existing records from primary storage. [2025-10-15T22:29:49.066904] [INFO ] [MAIN ] YPF: Loaded 50641 existing records. [2025-10-15T22:29:49.255400] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T22:29:49.293332] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:49.293543] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-15T22:29:49.293591] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-15T22:29:49.293925] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-15T22:29:49.293983] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-15T22:29:49.651721] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:49.677945] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T22:29:49.713962] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-15T22:29:50.513967] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-15T22:29:50.614007] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T22:29:51.017934] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T22:29:51.023321] [INFO ] [REMOTE ] YEXT: Full fetch complete (63319 records). [2025-10-15T22:29:51.023424] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-15T22:29:51.319792] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-15T22:29:51.412979] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-15T22:29:51.413053] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-15T22:29:51.414165] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-15T22:29:51.414229] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-15T22:29:51.415415] [DEBUG] [LOCAL ] YEXT: Trimmed 63319 records to 43180 (keeping 200 days of data) [2025-10-15T22:29:51.659612] [DEBUG] [LOCAL ] YEXT: Primary data saved (43180 records). [2025-10-15T22:29:51.659753] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-15T22:29:51.659834] [INFO ] [MAIN ] Update Progress: 2348/2369 symbols completed. YEXT took 28.9s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-15T22:29:51.833167] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:29:51.846059] [DEBUG] [LOCAL ] YRD: Loaded 11665 existing records from primary storage. [2025-10-15T22:29:51.846281] [INFO ] [MAIN ] YRD: Loaded 11665 existing records. [2025-10-15T22:29:52.026096] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:29:52.026296] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-15T22:29:52.026344] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-15T22:29:52.026592] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-15T22:29:52.026692] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-15T22:29:52.120955] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-15T22:29:52.422825] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:29:52.452765] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T22:29:52.914006] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-15T22:29:53.133495] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T22:29:53.714031] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-15T22:29:54.401083] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-15T22:29:54.520622] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-15T22:29:54.541041] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T22:29:55.107168] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T22:29:55.313995] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-15T22:29:55.390511] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T22:29:56.114002] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-15T22:29:56.913999] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-15T22:29:56.995976] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T22:29:57.664012] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T22:29:57.714069] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-15T22:29:58.514040] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-15T22:29:58.689476] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T22:29:59.270181] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T22:29:59.313959] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-15T22:29:59.945284] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-15T22:30:00.113990] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-15T22:30:00.914047] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-15T22:30:01.169420] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T22:30:01.603978] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-15T22:30:01.713988] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-15T22:30:02.064967] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T22:30:02.514021] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-15T22:30:02.863465] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T22:30:03.314022] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-15T22:30:03.951149] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T22:30:04.113967] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-15T22:30:04.352843] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T22:30:04.914000] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-15T22:30:05.713972] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-15T22:30:05.829004] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T22:30:06.380052] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T22:30:06.514679] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-15T22:30:06.516473] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T22:30:07.314006] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-15T22:30:08.113975] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-15T22:30:08.381314] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T22:30:08.616576] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T22:30:08.913988] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-15T22:30:09.713985] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-15T22:30:09.796864] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T22:30:10.513974] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-15T22:30:10.529820] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T22:30:10.694043] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T22:30:11.314017] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-15T22:30:12.114008] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-15T22:30:12.260163] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T22:30:12.784050] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T22:30:12.902924] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T22:30:12.913955] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-15T22:30:13.713976] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-15T22:30:13.790829] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T22:30:14.514036] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-15T22:30:15.279410] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T22:30:15.314001] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-15T22:30:15.391434] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T22:30:16.048752] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T22:30:16.050622] [INFO ] [REMOTE ] YRD: Full fetch complete (19032 records). [2025-10-15T22:30:16.050715] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-15T22:30:16.119145] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-15T22:30:16.409266] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-15T22:30:16.409338] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-15T22:30:16.409764] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-15T22:30:16.409823] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-15T22:30:16.410325] [DEBUG] [LOCAL ] YRD: Trimmed 19032 records to 11484 (keeping 200 days of data) [2025-10-15T22:30:16.474201] [DEBUG] [LOCAL ] YRD: Primary data saved (11484 records). [2025-10-15T22:30:16.474322] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-15T22:30:16.474401] [INFO ] [MAIN ] Update Progress: 2349/2369 symbols completed. YRD took 24.8s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-15T22:30:16.638274] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:30:16.663502] [DEBUG] [LOCAL ] YSG: Loaded 25500 existing records from primary storage. [2025-10-15T22:30:16.663764] [INFO ] [MAIN ] YSG: Loaded 25500 existing records. [2025-10-15T22:30:16.840946] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:30:16.841193] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-15T22:30:16.841247] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-15T22:30:16.841554] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-15T22:30:16.841611] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-15T22:30:16.919125] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-15T22:30:17.188946] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:30:17.713993] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-15T22:30:17.949584] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T22:30:18.423408] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T22:30:18.513971] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-15T22:30:18.875949] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T22:30:19.314000] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-15T22:30:20.069206] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T22:30:20.075942] [INFO ] [REMOTE ] YMM: Full fetch complete (76494 records). [2025-10-15T22:30:20.076071] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-15T22:30:20.122427] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-15T22:30:20.479958] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-15T22:30:20.480038] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-15T22:30:20.481306] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-15T22:30:20.481371] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-15T22:30:20.482738] [DEBUG] [LOCAL ] YMM: Trimmed 76494 records to 52607 (keeping 200 days of data) [2025-10-15T22:30:20.811671] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T22:30:20.836560] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T22:30:20.858210] [DEBUG] [LOCAL ] YMM: Primary data saved (52607 records). [2025-10-15T22:30:20.858378] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-15T22:30:20.858463] [INFO ] [MAIN ] Update Progress: 2350/2369 symbols completed. YMM took 35.0s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-15T22:30:20.919124] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-15T22:30:21.044412] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:30:21.097626] [DEBUG] [LOCAL ] YUM: Loaded 51156 existing records from primary storage. [2025-10-15T22:30:21.098002] [INFO ] [MAIN ] YUM: Loaded 51156 existing records. [2025-10-15T22:30:21.272159] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:30:21.272454] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-15T22:30:21.272507] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-15T22:30:21.272948] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-15T22:30:21.273006] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-15T22:30:21.616499] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:30:21.713978] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-15T22:30:22.519316] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-15T22:30:22.525528] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T22:30:23.075622] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T22:30:23.276134] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T22:30:23.313949] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-15T22:30:24.114004] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-15T22:30:24.426212] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T22:30:24.913995] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-15T22:30:25.719086] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-15T22:30:25.743718] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T22:30:26.475672] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T22:30:26.515076] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-15T22:30:26.519277] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T22:30:27.314004] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-15T22:30:28.113979] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-15T22:30:28.330015] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T22:30:28.336299] [INFO ] [REMOTE ] YOU: Full fetch complete (72321 records). [2025-10-15T22:30:28.336431] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-15T22:30:28.753787] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-15T22:30:28.753934] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-15T22:30:28.755311] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-15T22:30:28.755621] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-15T22:30:28.757227] [DEBUG] [LOCAL ] YOU: Trimmed 72321 records to 49670 (keeping 200 days of data) [2025-10-15T22:30:28.970091] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-15T22:30:29.008587] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T22:30:29.078969] [DEBUG] [LOCAL ] YOU: Primary data saved (49670 records). [2025-10-15T22:30:29.079138] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-15T22:30:29.079253] [INFO ] [MAIN ] Update Progress: 2351/2369 symbols completed. YOU took 41.8s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-15T22:30:29.221922] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T22:30:29.292257] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:30:29.341579] [DEBUG] [LOCAL ] YUMC: Loaded 52590 existing records from primary storage. [2025-10-15T22:30:29.341918] [INFO ] [MAIN ] YUMC: Loaded 52590 existing records. [2025-10-15T22:30:29.516144] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:30:29.516377] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-15T22:30:29.516425] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-15T22:30:29.517009] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-15T22:30:29.517064] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-15T22:30:29.720170] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-15T22:30:29.869287] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:30:30.514002] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-15T22:30:30.720447] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T22:30:31.313995] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-15T22:30:31.574222] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T22:30:32.114049] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-15T22:30:32.683589] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-15T22:30:32.712037] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T22:30:32.913976] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-15T22:30:33.719555] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-15T22:30:33.732982] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T22:30:34.513987] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-15T22:30:34.639543] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T22:30:35.097217] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T22:30:35.314030] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-15T22:30:36.113990] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-15T22:30:36.335212] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-15T22:30:36.341418] [INFO ] [REMOTE ] YPF: Full fetch complete (73739 records). [2025-10-15T22:30:36.341560] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-15T22:30:36.737782] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-15T22:30:36.737921] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-15T22:30:36.739256] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-15T22:30:36.739319] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-15T22:30:36.740749] [DEBUG] [LOCAL ] YPF: Trimmed 73739 records to 50678 (keeping 200 days of data) [2025-10-15T22:30:36.915814] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-15T22:30:37.051896] [DEBUG] [LOCAL ] YPF: Primary data saved (50678 records). [2025-10-15T22:30:37.052148] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-15T22:30:37.053118] [INFO ] [MAIN ] Update Progress: 2352/2369 symbols completed. YPF took 48.2s. Estimated remaining: 2m 23s. Rate: 7.1 symbols/min [2025-10-15T22:30:37.227248] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:30:37.273635] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T22:30:37.281557] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T22:30:37.341783] [DEBUG] [LOCAL ] ZBH: Loaded 50789 existing records from primary storage. [2025-10-15T22:30:37.342099] [INFO ] [MAIN ] ZBH: Loaded 50789 existing records. [2025-10-15T22:30:37.520282] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:30:37.520514] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-15T22:30:37.520626] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-15T22:30:37.521061] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-15T22:30:37.521116] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-15T22:30:37.719132] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-15T22:30:37.876906] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:30:38.513969] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-15T22:30:38.924221] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T22:30:39.314047] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-15T22:30:39.979531] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-15T22:30:40.044980] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T22:30:40.113966] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-15T22:30:40.913965] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-15T22:30:41.103109] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T22:30:41.713962] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-15T22:30:41.887078] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T22:30:42.052598] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T22:30:42.514071] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-15T22:30:43.323944] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-15T22:30:43.329228] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T22:30:44.007029] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T22:30:44.114010] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-15T22:30:44.914032] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-15T22:30:45.202511] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T22:30:45.206193] [INFO ] [REMOTE ] YSG: Full fetch complete (32425 records). [2025-10-15T22:30:45.206273] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-15T22:30:45.597337] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-15T22:30:45.612684] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-15T22:30:45.621027] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-15T22:30:45.622179] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-15T22:30:45.622260] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-15T22:30:45.623255] [DEBUG] [LOCAL ] YSG: Trimmed 32425 records to 25514 (keeping 200 days of data) [2025-10-15T22:30:45.714098] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-15T22:30:45.765569] [DEBUG] [LOCAL ] YSG: Primary data saved (25514 records). [2025-10-15T22:30:45.765723] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-15T22:30:45.765808] [INFO ] [MAIN ] Update Progress: 2353/2369 symbols completed. YSG took 29.3s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-15T22:30:45.959378] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:30:45.959513] [DEBUG] [LOCAL ] ZEPP: No existing data file found in primary storage. [2025-10-15T22:30:45.959549] [WARN ] [MAIN ] ZEPP: No existing data found, performing full refresh instead. [2025-10-15T22:30:45.959677] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-15T22:30:45.959731] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-15T22:30:45.959774] [DEBUG] [LOCAL ] ZEPP: No primary data file found to delete. [2025-10-15T22:30:45.959806] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-15T22:30:46.307836] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:30:46.513969] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-15T22:30:46.779519] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T22:30:46.980250] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T22:30:47.161116] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T22:30:47.314067] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-15T22:30:48.114031] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-15T22:30:48.914037] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-15T22:30:49.054245] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T22:30:49.392787] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-15T22:30:49.564892] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T22:30:49.714006] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-15T22:30:50.489713] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T22:30:50.497901] [INFO ] [REMOTE ] YUM: Full fetch complete (74638 records). [2025-10-15T22:30:50.498035] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-15T22:30:50.519128] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-15T22:30:50.890668] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-15T22:30:50.890759] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-15T22:30:50.892066] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-15T22:30:50.892131] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-15T22:30:50.893744] [DEBUG] [LOCAL ] YUM: Trimmed 74638 records to 51170 (keeping 200 days of data) [2025-10-15T22:30:51.214031] [DEBUG] [LOCAL ] YUM: Primary data saved (51170 records). [2025-10-15T22:30:51.214159] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-15T22:30:51.215084] [INFO ] [MAIN ] Update Progress: 2354/2369 symbols completed. YUM took 30.4s. Estimated remaining: 2m 6s. Rate: 7.1 symbols/min [2025-10-15T22:30:51.313988] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-15T22:30:51.384802] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:30:51.438092] [DEBUG] [LOCAL ] ZETA: Loaded 53617 existing records from primary storage. [2025-10-15T22:30:51.438475] [INFO ] [MAIN ] ZETA: Loaded 53617 existing records. [2025-10-15T22:30:51.612278] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:30:51.612474] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-15T22:30:51.612521] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-15T22:30:51.612840] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-15T22:30:51.612895] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-15T22:30:51.964999] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:30:52.113986] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-15T22:30:52.332362] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T22:30:52.608210] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T22:30:52.914095] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-15T22:30:53.714062] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-15T22:30:54.514027] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-15T22:30:54.649254] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-15T22:30:54.721267] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T22:30:54.843128] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T22:30:55.314023] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-15T22:30:55.446099] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T22:30:56.114062] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-15T22:30:56.914039] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-15T22:30:57.053737] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T22:30:57.714004] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-15T22:30:57.983846] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T22:30:58.514061] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-15T22:30:58.620866] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T22:30:59.102694] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T22:30:59.314015] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-15T22:30:59.726486] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T22:31:00.113993] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-15T22:31:00.754926] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T22:31:00.913978] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-15T22:31:01.001468] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T22:31:01.713995] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-15T22:31:02.513996] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-15T22:31:03.106366] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T22:31:03.313983] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-15T22:31:03.490743] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T22:31:03.758455] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T22:31:04.113996] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-15T22:31:04.503851] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-15T22:31:04.913949] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-15T22:31:05.177607] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T22:31:05.257536] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T22:31:05.714042] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-15T22:31:06.514009] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-15T22:31:07.313993] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-15T22:31:07.708487] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T22:31:08.079174] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T22:31:08.113962] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-15T22:31:08.914031] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-15T22:31:09.166755] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T22:31:09.696098] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T22:31:09.719097] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-15T22:31:09.731252] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T22:31:10.514049] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-15T22:31:11.123226] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T22:31:11.129230] [INFO ] [REMOTE ] ZBH: Full fetch complete (73864 records). [2025-10-15T22:31:11.129377] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-15T22:31:11.317167] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-15T22:31:11.534200] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-15T22:31:11.534277] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-15T22:31:11.535463] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-15T22:31:11.535742] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-15T22:31:11.537340] [DEBUG] [LOCAL ] ZBH: Trimmed 73864 records to 50834 (keeping 200 days of data) [2025-10-15T22:31:11.876090] [DEBUG] [LOCAL ] ZBH: Primary data saved (50834 records). [2025-10-15T22:31:11.876219] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-15T22:31:11.877071] [INFO ] [MAIN ] Update Progress: 2355/2369 symbols completed. ZBH took 34.8s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-15T22:31:12.075563] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:12.107268] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-15T22:31:12.117527] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-15T22:31:12.165805] [DEBUG] [LOCAL ] ZGN: Loaded 40886 existing records from primary storage. [2025-10-15T22:31:12.166090] [INFO ] [MAIN ] ZGN: Loaded 40886 existing records. [2025-10-15T22:31:12.349315] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:12.349555] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-15T22:31:12.349603] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-15T22:31:12.350099] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-15T22:31:12.350162] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-15T22:31:12.708252] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:12.881154] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T22:31:12.913950] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-15T22:31:13.721275] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-15T22:31:13.725413] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T22:31:13.731985] [INFO ] [REMOTE ] YUMC: Full fetch complete (76361 records). [2025-10-15T22:31:13.732113] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-15T22:31:14.131721] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-15T22:31:14.131909] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-15T22:31:14.141264] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-15T22:31:14.141909] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-15T22:31:14.142239] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T22:31:14.146243] [INFO ] [REMOTE ] ZEPP: Full fetch complete (20665 records). [2025-10-15T22:31:14.146426] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-15T22:31:14.178681] [DEBUG] [LOCAL ] YUMC: Trimmed 76361 records to 52590 (keeping 200 days of data) [2025-10-15T22:31:14.516612] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-15T22:31:14.661116] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-15T22:31:14.662036] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-15T22:31:14.663325] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-15T22:31:14.666173] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-15T22:31:14.670950] [DEBUG] [LOCAL ] ZEPP: Trimmed 20665 records to 19046 (keeping 200 days of data) [2025-10-15T22:31:14.925602] [DEBUG] [LOCAL ] ZEPP: Primary data saved (19046 records). [2025-10-15T22:31:14.930319] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-15T22:31:14.932837] [INFO ] [MAIN ] Update Progress: 2356/2369 symbols completed. ZEPP took 29.2s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-15T22:31:15.101821] [DEBUG] [LOCAL ] YUMC: Primary data saved (52590 records). [2025-10-15T22:31:15.112811] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-15T22:31:15.113507] [INFO ] [MAIN ] Update Progress: 2357/2369 symbols completed. YUMC took 46.0s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-15T22:31:15.184393] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:15.208330] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T22:31:15.238596] [DEBUG] [LOCAL ] ZH: Loaded 25441 existing records from primary storage. [2025-10-15T22:31:15.238981] [INFO ] [MAIN ] ZH: Loaded 25441 existing records. [2025-10-15T22:31:15.320823] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-15T22:31:15.444586] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:15.444835] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-15T22:31:15.444884] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-15T22:31:15.445221] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-15T22:31:15.445279] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-15T22:31:15.845365] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:16.114075] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-15T22:31:16.786522] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T22:31:16.851119] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T22:31:16.913952] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-15T22:31:17.112588] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-15T22:31:17.714002] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-15T22:31:17.895297] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T22:31:18.514065] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-15T22:31:19.314067] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-15T22:31:19.909688] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T22:31:20.114029] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-15T22:31:20.200850] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-15T22:31:20.902263] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T22:31:20.913954] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-15T22:31:21.359604] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T22:31:21.714070] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-15T22:31:22.396159] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T22:31:22.513995] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-15T22:31:23.269568] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T22:31:23.313951] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-15T22:31:23.793220] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T22:31:24.114036] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-15T22:31:24.762438] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T22:31:24.914042] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-15T22:31:25.714044] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-15T22:31:26.372862] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T22:31:26.514047] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-15T22:31:26.618082] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-15T22:31:26.709313] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T22:31:27.314058] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-15T22:31:27.971142] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T22:31:28.113986] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-15T22:31:28.413366] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T22:31:28.913994] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-15T22:31:29.574261] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T22:31:29.713997] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-15T22:31:30.195916] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T22:31:30.514058] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-15T22:31:31.212998] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T22:31:31.313995] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-15T22:31:32.114076] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-15T22:31:32.624792] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T22:31:32.630590] [INFO ] [REMOTE ] ZGN: Full fetch complete (58471 records). [2025-10-15T22:31:32.630809] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-15T22:31:32.991251] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-15T22:31:33.031962] [INFO ] [REMOTE ] ZETA: Full fetch complete (77734 records). [2025-10-15T22:31:33.085762] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-15T22:31:33.086355] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-15T22:31:33.086449] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-15T22:31:33.087531] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-15T22:31:33.107200] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-15T22:31:33.207506] [DEBUG] [LOCAL ] ZGN: Trimmed 58471 records to 40869 (keeping 200 days of data) [2025-10-15T22:31:33.417263] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T22:31:33.466734] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-15T22:31:33.643126] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-15T22:31:33.643788] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-15T22:31:33.645694] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-15T22:31:33.646213] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-15T22:31:33.651101] [DEBUG] [LOCAL ] ZETA: Trimmed 77734 records to 53617 (keeping 200 days of data) [2025-10-15T22:31:34.017543] [DEBUG] [LOCAL ] ZGN: Primary data saved (40869 records). [2025-10-15T22:31:34.023129] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-15T22:31:34.025691] [INFO ] [MAIN ] Update Progress: 2358/2369 symbols completed. ZGN took 22.1s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-15T22:31:34.105665] [DEBUG] [LOCAL ] ZETA: Primary data saved (53617 records). [2025-10-15T22:31:34.105803] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-15T22:31:34.105883] [INFO ] [MAIN ] Update Progress: 2359/2369 symbols completed. ZETA took 42.9s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-15T22:31:34.769929] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T22:31:34.776607] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-15T22:31:35.749466] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T22:31:35.752344] [INFO ] [REMOTE ] ZH: Full fetch complete (39942 records). [2025-10-15T22:31:35.752445] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-15T22:31:36.129317] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-15T22:31:36.129425] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-15T22:31:36.130234] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-15T22:31:36.130296] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-15T22:31:36.131390] [DEBUG] [LOCAL ] ZH: Trimmed 39942 records to 25337 (keeping 200 days of data) [2025-10-15T22:31:36.274305] [DEBUG] [LOCAL ] ZH: Primary data saved (25337 records). [2025-10-15T22:31:36.274431] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-15T22:31:36.274537] [INFO ] [MAIN ] Update Progress: 2360/2369 symbols completed. ZH took 21.3s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-15T22:31:37.004272] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:37.034304] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:37.075503] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:37.077382] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:37.094769] [DEBUG] [LOCAL ] ZKH: Loaded 7520 existing records from primary storage. [2025-10-15T22:31:37.095099] [INFO ] [MAIN ] ZKH: Loaded 7520 existing records. [2025-10-15T22:31:37.347614] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:37.348922] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-15T22:31:37.348591] [DEBUG] [LOCAL ] ZK: Loaded 39048 existing records from primary storage. [2025-10-15T22:31:37.350431] [DEBUG] [LOCAL ] ZIP: Loaded 43727 existing records from primary storage. [2025-10-15T22:31:37.351148] [INFO ] [MAIN ] ZK: Loaded 39048 existing records. [2025-10-15T22:31:37.351394] [INFO ] [MAIN ] ZIP: Loaded 43727 existing records. [2025-10-15T22:31:37.349273] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-15T22:31:37.441950] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-15T22:31:37.442160] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-15T22:31:37.545025] [DEBUG] [LOCAL ] ZIM: Loaded 53497 existing records from primary storage. [2025-10-15T22:31:37.574930] [INFO ] [MAIN ] ZIM: Loaded 53497 existing records. [2025-10-15T22:31:37.967440] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:37.964254] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:38.031405] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-15T22:31:38.056413] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-15T22:31:38.072282] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-15T22:31:38.142235] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-15T22:31:38.156196] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-15T22:31:38.208967] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:38.202697] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-15T22:31:38.212698] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-15T22:31:38.213145] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-15T22:31:38.213293] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-15T22:31:38.240133] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-15T22:31:38.318557] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-15T22:31:38.389272] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-15T22:31:38.555709] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:38.598760] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-15T22:31:39.264504] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:39.280828] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-15T22:31:39.405591] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:39.422441] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-15T22:31:39.451006] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T22:31:39.456787] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:39.457196] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-15T22:31:39.459082] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-15T22:31:40.164208] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T22:31:40.166609] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-15T22:31:40.611968] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T22:31:40.618859] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-15T22:31:40.852174] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T22:31:40.861203] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-15T22:31:40.956948] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T22:31:40.961626] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-15T22:31:41.543919] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-15T22:31:41.700243] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T22:31:41.713946] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-15T22:31:41.810508] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T22:31:41.882765] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T22:31:42.514000] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-15T22:31:43.313972] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-15T22:31:43.712091] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-15T22:31:43.856698] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T22:31:43.905272] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T22:31:44.114039] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-15T22:31:44.914080] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-15T22:31:45.493410] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T22:31:45.713999] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-15T22:31:45.772532] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T22:31:46.514178] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-15T22:31:46.991793] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T22:31:47.314032] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-15T22:31:47.741306] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T22:31:47.938831] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T22:31:48.114016] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-15T22:31:48.914012] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-15T22:31:49.714001] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-15T22:31:49.794598] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T22:31:50.513960] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-15T22:31:50.644038] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T22:31:50.693182] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T22:31:51.314039] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-15T22:31:51.839344] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T22:31:52.114004] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-15T22:31:52.846028] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T22:31:52.913996] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-15T22:31:53.641672] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T22:31:53.644374] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-15T22:31:53.713957] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-15T22:31:54.217471] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T22:31:54.218981] [INFO ] [REMOTE ] ZKH: Full fetch complete (11914 records). [2025-10-15T22:31:54.219053] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-15T22:31:54.519080] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-15T22:31:54.660025] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-15T22:31:54.660101] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-15T22:31:54.660379] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-15T22:31:54.660421] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-15T22:31:54.660904] [DEBUG] [LOCAL ] ZKH: Trimmed 11914 records to 7471 (keeping 200 days of data) [2025-10-15T22:31:54.707376] [DEBUG] [LOCAL ] ZKH: Primary data saved (7471 records). [2025-10-15T22:31:54.707513] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-15T22:31:54.707857] [INFO ] [MAIN ] Update Progress: 2361/2369 symbols completed. ZKH took 18.4s. Estimated remaining: 1m 7s. Rate: 7.1 symbols/min [2025-10-15T22:31:54.886730] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:31:54.935405] [DEBUG] [LOCAL ] ZTO: Loaded 49503 existing records from primary storage. [2025-10-15T22:31:54.935730] [INFO ] [MAIN ] ZTO: Loaded 49503 existing records. [2025-10-15T22:31:55.110708] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:31:55.110952] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-15T22:31:55.111010] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-15T22:31:55.111444] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-15T22:31:55.111501] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-15T22:31:55.319188] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-15T22:31:55.459703] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:31:56.113985] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-15T22:31:56.734783] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T22:31:56.869194] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-15T22:31:56.913993] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-15T22:31:57.647898] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T22:31:57.713998] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-15T22:31:57.997507] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T22:31:58.513999] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-15T22:31:59.270119] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T22:31:59.313976] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-15T22:32:00.114045] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-15T22:32:00.547240] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-15T22:32:00.914020] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-15T22:32:01.316623] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T22:32:01.385723] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T22:32:01.713982] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-15T22:32:02.514003] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-15T22:32:02.998296] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T22:32:03.314084] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-15T22:32:03.355580] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T22:32:03.971500] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T22:32:04.113985] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-15T22:32:04.914159] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-15T22:32:05.584526] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-15T22:32:05.713977] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-15T22:32:05.880472] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T22:32:06.375319] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T22:32:06.513994] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-15T22:32:07.314142] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-15T22:32:08.034498] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-15T22:32:08.114125] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-15T22:32:08.465434] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T22:32:08.501485] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T22:32:08.914051] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-15T22:32:09.668421] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T22:32:09.713967] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-15T22:32:10.514004] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-15T22:32:10.582102] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T22:32:11.314013] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-15T22:32:11.827823] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-15T22:32:11.990133] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T22:32:12.114000] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-15T22:32:12.913957] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-15T22:32:13.188638] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T22:32:13.713977] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-15T22:32:14.232717] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T22:32:14.239449] [INFO ] [REMOTE ] ZIM: Full fetch complete (77599 records). [2025-10-15T22:32:14.239592] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-15T22:32:14.318687] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T22:32:14.361605] [INFO ] [REMOTE ] ZK: Full fetch complete (57016 records). [2025-10-15T22:32:14.367341] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-15T22:32:14.542314] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-15T22:32:14.990114] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-15T22:32:14.990402] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-15T22:32:14.991678] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-15T22:32:14.991759] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-15T22:32:15.082713] [DEBUG] [LOCAL ] ZIM: Trimmed 77599 records to 53493 (keeping 200 days of data) [2025-10-15T22:32:15.085922] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-15T22:32:15.086470] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-15T22:32:15.087016] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-15T22:32:15.087098] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-15T22:32:15.088428] [DEBUG] [LOCAL ] ZK: Trimmed 57016 records to 39127 (keeping 200 days of data) [2025-10-15T22:32:15.455186] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T22:32:15.560838] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-15T22:32:15.575599] [DEBUG] [LOCAL ] ZK: Primary data saved (39127 records). [2025-10-15T22:32:15.576617] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-15T22:32:15.577012] [INFO ] [MAIN ] Update Progress: 2362/2369 symbols completed. ZK took 39.3s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-15T22:32:15.763183] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:32:15.861161] [DEBUG] [LOCAL ] ZTR: Loaded 16762 existing records from primary storage. [2025-10-15T22:32:15.862816] [INFO ] [MAIN ] ZTR: Loaded 16762 existing records. [2025-10-15T22:32:16.058864] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:32:16.062186] [DEBUG] [LOCAL ] ZIM: Primary data saved (53493 records). [2025-10-15T22:32:16.062310] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-15T22:32:16.062508] [INFO ] [MAIN ] Update Progress: 2363/2369 symbols completed. ZIM took 39.8s. Estimated remaining: 50.6s. Rate: 7.1 symbols/min [2025-10-15T22:32:16.062562] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-15T22:32:16.062689] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-15T22:32:16.084102] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-15T22:32:16.085815] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-15T22:32:16.163802] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T22:32:16.296511] [INFO ] [REMOTE ] ZIP: Full fetch complete (60319 records). [2025-10-15T22:32:16.312882] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-15T22:32:16.492679] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:32:16.909769] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:32:16.933950] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-15T22:32:17.047835] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-15T22:32:17.047913] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-15T22:32:17.049105] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-15T22:32:17.049172] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-15T22:32:17.050525] [DEBUG] [LOCAL ] ZIP: Trimmed 60319 records to 43691 (keeping 200 days of data) [2025-10-15T22:32:17.157318] [DEBUG] [LOCAL ] ZTS: Loaded 53127 existing records from primary storage. [2025-10-15T22:32:17.158980] [INFO ] [MAIN ] ZTS: Loaded 53127 existing records. [2025-10-15T22:32:17.357325] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:32:17.357627] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-15T22:32:17.358046] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-15T22:32:17.361212] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-15T22:32:17.361579] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-15T22:32:17.775603] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T22:32:17.797577] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T22:32:17.813695] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-15T22:32:17.845074] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-15T22:32:17.885452] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:32:17.931003] [DEBUG] [LOCAL ] ZIP: Primary data saved (43691 records). [2025-10-15T22:32:17.931128] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-15T22:32:17.931205] [INFO ] [MAIN ] Update Progress: 2364/2369 symbols completed. ZIP took 41.7s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-15T22:32:18.096027] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:32:18.131860] [DEBUG] [LOCAL ] ZVIA: Loaded 35749 existing records from primary storage. [2025-10-15T22:32:18.132167] [INFO ] [MAIN ] ZVIA: Loaded 35749 existing records. [2025-10-15T22:32:18.326749] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:32:18.326995] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-15T22:32:18.327045] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-15T22:32:18.327359] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-15T22:32:18.327399] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-15T22:32:18.527938] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-15T22:32:18.675970] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:32:18.834979] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T22:32:19.313979] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-15T22:32:19.644663] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T22:32:20.113987] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-15T22:32:20.152089] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T22:32:20.854633] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T22:32:20.913967] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-15T22:32:21.218291] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T22:32:21.714032] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-15T22:32:22.520191] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-15T22:32:22.535879] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T22:32:23.313976] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-15T22:32:23.480849] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T22:32:24.113983] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-15T22:32:24.300929] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T22:32:24.332951] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T22:32:24.914001] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-15T22:32:25.714064] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-15T22:32:25.896624] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T22:32:25.959707] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-15T22:32:26.514021] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-15T22:32:27.058289] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T22:32:27.064227] [INFO ] [REMOTE ] ZTO: Full fetch complete (72860 records). [2025-10-15T22:32:27.064338] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-15T22:32:27.323113] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-15T22:32:27.399954] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T22:32:27.491839] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-15T22:32:27.491946] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-15T22:32:27.493232] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-15T22:32:27.493328] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-15T22:32:27.494744] [DEBUG] [LOCAL ] ZTO: Trimmed 72860 records to 49488 (keeping 200 days of data) [2025-10-15T22:32:27.804048] [DEBUG] [LOCAL ] ZTO: Primary data saved (49488 records). [2025-10-15T22:32:27.804176] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-15T22:32:27.804255] [INFO ] [MAIN ] Update Progress: 2365/2369 symbols completed. ZTO took 33.1s. Estimated remaining: 33.7s. Rate: 7.1 symbols/min [2025-10-15T22:32:27.971825] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T22:32:28.010476] [DEBUG] [LOCAL ] ZWS: Loaded 42346 existing records from primary storage. [2025-10-15T22:32:28.010775] [INFO ] [MAIN ] ZWS: Loaded 42346 existing records. [2025-10-15T22:32:28.119126] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-15T22:32:28.188602] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T22:32:28.188924] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-15T22:32:28.188973] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-15T22:32:28.189320] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-15T22:32:28.189357] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-15T22:32:28.538965] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T22:32:28.913999] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-15T22:32:29.147188] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T22:32:29.603503] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T22:32:29.620198] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T22:32:29.714028] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-15T22:32:30.514007] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-15T22:32:31.175844] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T22:32:31.314044] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-15T22:32:31.577284] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T22:32:32.114058] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-15T22:32:32.621766] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T22:32:32.914042] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-15T22:32:33.714008] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-15T22:32:33.975928] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T22:32:34.014213] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T22:32:34.514033] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-15T22:32:35.221473] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T22:32:35.274988] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T22:32:35.314012] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-15T22:32:36.114032] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-15T22:32:36.163561] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T22:32:36.167215] [INFO ] [REMOTE ] ZTR: Full fetch complete (26942 records). [2025-10-15T22:32:36.167296] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-15T22:32:36.557569] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-15T22:32:36.557687] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-15T22:32:36.558342] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-15T22:32:36.558404] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-15T22:32:36.559203] [DEBUG] [LOCAL ] ZTR: Trimmed 26942 records to 16698 (keeping 200 days of data) [2025-10-15T22:32:36.669110] [DEBUG] [LOCAL ] ZTR: Primary data saved (16698 records). [2025-10-15T22:32:36.669301] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-15T22:32:36.669403] [INFO ] [MAIN ] Update Progress: 2366/2369 symbols completed. ZTR took 21.1s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-15T22:32:36.914039] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-15T22:32:37.479490] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T22:32:37.713973] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-15T22:32:38.217403] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T22:32:38.514053] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-15T22:32:39.313993] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-15T22:32:39.879417] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-15T22:32:39.917680] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T22:32:40.113994] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-15T22:32:40.767041] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T22:32:40.913996] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-15T22:32:41.401075] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T22:32:41.714075] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-15T22:32:42.264920] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T22:32:42.514059] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-15T22:32:43.224420] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T22:32:43.313990] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-15T22:32:43.928077] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T22:32:44.113996] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-15T22:32:44.652344] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T22:32:44.914034] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-15T22:32:45.642284] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T22:32:45.713954] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-15T22:32:46.514032] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-15T22:32:46.822147] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T22:32:47.114554] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T22:32:47.314020] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-15T22:32:48.114077] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-15T22:32:48.169237] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T22:32:48.228342] [DEBUG] [REMOTE ] ZVIA: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-15T22:32:48.228719] [WARN ] [REMOTE ] ZVIA: No data returned for month 2025-10 [2025-10-15T22:32:48.228822] [FATAL] [REMOTE ] ZVIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T22:32:48.228900] [FATAL] [MAIN ] ZVIA: Failed to fetch primary data. [2025-10-15T22:32:48.228963] [WARN ] [MAIN ] ZVIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T22:32:48.229030] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-15T22:32:48.229093] [DEBUG] [LOCAL ] ZVIA: No primary data file found to delete. [2025-10-15T22:32:48.229128] [INFO ] [LOCAL ] ZVIA: Starting deletion of derivative data. [2025-10-15T22:32:48.229318] [DEBUG] [LOCAL ] ZVIA: Deleted derivative data file. [2025-10-15T22:32:48.229512] [INFO ] [MAIN ] Update Progress: 2367/2369 symbols completed. ZVIA took 30.3s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-15T22:32:48.913995] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-15T22:32:49.317752] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T22:32:49.714017] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-15T22:32:50.463639] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T22:32:50.513972] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-15T22:32:51.411666] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T22:32:51.423154] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-15T22:32:52.028845] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T22:32:52.113953] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-15T22:32:53.153280] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T22:32:53.168267] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-15T22:32:53.188475] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T22:32:53.195394] [INFO ] [REMOTE ] ZWS: Full fetch complete (62073 records). [2025-10-15T22:32:53.195582] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-15T22:32:53.801341] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-15T22:32:53.801582] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-15T22:32:53.803534] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-15T22:32:53.803803] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-15T22:32:53.805789] [DEBUG] [LOCAL ] ZWS: Trimmed 62073 records to 42402 (keeping 200 days of data) [2025-10-15T22:32:53.932745] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T22:32:53.944143] [INFO ] [REMOTE ] ZTS: Full fetch complete (76885 records). [2025-10-15T22:32:53.945050] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-15T22:32:54.381011] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-15T22:32:54.381124] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-15T22:32:54.382532] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-15T22:32:54.430680] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-15T22:32:54.467940] [DEBUG] [LOCAL ] ZTS: Trimmed 76885 records to 53149 (keeping 200 days of data) [2025-10-15T22:32:54.636210] [DEBUG] [LOCAL ] ZWS: Primary data saved (42402 records). [2025-10-15T22:32:54.642610] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-15T22:32:54.642778] [INFO ] [MAIN ] Update Progress: 2368/2369 symbols completed. ZWS took 26.8s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-15T22:32:54.859682] [DEBUG] [LOCAL ] ZTS: Primary data saved (53149 records). [2025-10-15T22:32:54.859838] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-15T22:32:54.859918] [INFO ] [MAIN ] Update Progress: 2369/2369 symbols completed. ZTS took 38.8s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-15T22:32:54.861249] [INFO ] [MAIN ] Parallel update completed in 5h 32m 50s [2025-10-15T22:32:54.861346] [WARN ] [MAIN ] Failed symbols (566): AAMI, AAM, AAUC, AA, AB, ABBV, ABM, ACHR, AD, ADCT... [2025-10-15T22:32:54.861423] [INFO ] [MAIN ] Update success rate: 76.1% (1803/2369 symbols) [2025-10-15T22:32:55.485792] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1803/2369 @ 76.11%)' [2025-10-15T22:32:55.486219] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-15T22:32:55.486267] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-15T22:32:55.486299] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-15T22:32:55.486385] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-15T22:32:55.486420] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-15T22:32:56.975543] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-15T22:32:56.975770] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-15T22:32:56.975977] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-15T22:32:56.976486] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-15T22:32:56.976542] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-15T22:32:56.976574] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-15T22:32:56.976629] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-15T22:32:56.976699] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-15T22:32:56.976768] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-15T22:32:56.977129] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-15T22:32:56.977163] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-15T22:32:56.977335] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-15T22:32:56.977367] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-15T22:32:56.977398] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-15T22:32:56.977427] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-15T22:32:56.999662] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-15T22:32:57.021215] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-15T22:32:57.021309] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-15T22:32:57.021345] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-15T22:32:57.021373] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-15T22:32:57.021425] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-15T22:32:57.021458] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-15T22:32:57.021492] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-15T22:32:57.022529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-15T22:32:57.022681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-15T22:32:57.022795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-15T22:32:57.022907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-15T22:32:57.023000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-15T22:32:57.023093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-15T22:32:57.023224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-15T22:32:57.023374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-15T22:32:57.023467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-15T22:32:57.023551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-15T22:32:57.023669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-15T22:32:57.023763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-15T22:32:57.023850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-15T22:32:57.023950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-15T22:32:57.024044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-15T22:32:57.024153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-15T22:32:57.024259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-15T22:32:57.024375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-15T22:32:57.024480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-15T22:32:57.024584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-15T22:32:57.024718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-15T22:32:57.024827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-15T22:32:57.024918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-15T22:32:57.025000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-15T22:32:57.025113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-15T22:32:57.025219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-15T22:32:57.025304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-15T22:32:57.025391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-15T22:32:57.025478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-15T22:32:57.025583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-15T22:32:57.025698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-15T22:32:57.025787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-15T22:32:57.025868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-15T22:32:57.025957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-15T22:32:57.026070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-15T22:32:57.026143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-15T22:32:57.026226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-15T22:32:57.026318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-15T22:32:57.026392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-15T22:32:57.026479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-15T22:32:57.026573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-15T22:32:57.026736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-15T22:32:57.026841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-15T22:32:57.026930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-15T22:32:57.026996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-15T22:32:57.027076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-15T22:32:57.027167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-15T22:32:57.027248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-15T22:32:57.027350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-15T22:32:57.027454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-15T22:32:57.027557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-15T22:32:57.027663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-15T22:32:57.027755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-15T22:32:57.027827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-15T22:32:57.027908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-15T22:32:57.027998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-15T22:32:57.028077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-15T22:32:57.028165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-15T22:32:57.028260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-15T22:32:57.028417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-15T22:32:57.028507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-15T22:32:57.028573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-15T22:32:57.028689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-15T22:32:57.028791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-15T22:32:57.028891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-15T22:32:57.029001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-15T22:32:57.029115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-15T22:32:57.029202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-15T22:32:57.029281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-15T22:32:57.029383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-15T22:32:57.029485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-15T22:32:57.029565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-15T22:32:57.029684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-15T22:32:57.029787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-15T22:32:57.029933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-15T22:32:57.030035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-15T22:32:57.030130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-15T22:32:57.030213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-15T22:32:57.030301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-15T22:32:57.030399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-15T22:32:57.030466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-15T22:32:57.030528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-15T22:32:57.030611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-15T22:32:57.030740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-15T22:32:57.030814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-15T22:32:57.030904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-15T22:32:57.030966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-15T22:32:57.031027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-15T22:32:57.031114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-15T22:32:57.031225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-15T22:32:57.031357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-15T22:32:57.031445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-15T22:32:57.031509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-15T22:32:57.031573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-15T22:32:57.031636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-15T22:32:57.031753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-15T22:32:57.031828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-15T22:32:57.031891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-15T22:32:57.031955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-15T22:32:57.032018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-15T22:32:57.032131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-15T22:32:57.032267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-15T22:32:57.032360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-15T22:32:57.032426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-15T22:32:57.032547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-15T22:32:57.032692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-15T22:32:57.032782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-15T22:32:57.032849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-15T22:32:57.032913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-15T22:32:57.033007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-15T22:32:57.033074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-15T22:32:57.033156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-15T22:32:57.033271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-15T22:32:57.033396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-15T22:32:57.033495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-15T22:32:57.033577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-15T22:32:57.033665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-15T22:32:57.033760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-15T22:32:57.033845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-15T22:32:57.033937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-15T22:32:57.034021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-15T22:32:57.034108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-15T22:32:57.034189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-15T22:32:57.034277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-15T22:32:57.034357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-15T22:32:57.034444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-15T22:32:57.034510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-15T22:32:57.034594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-15T22:32:57.034771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-15T22:32:57.034866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-15T22:32:57.034947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-15T22:32:57.035034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-15T22:32:57.035130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-15T22:32:57.035220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-15T22:32:57.035308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-15T22:32:57.035375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-15T22:32:57.035451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-15T22:32:57.035547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-15T22:32:57.035611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-15T22:32:57.035703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-15T22:32:57.035792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-15T22:32:57.035860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-15T22:32:57.035922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-15T22:32:57.035984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-15T22:32:57.036064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-15T22:32:57.036168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-15T22:32:57.036255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-15T22:32:57.036320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-15T22:32:57.036399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-15T22:32:57.036486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-15T22:32:57.036595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-15T22:32:57.036719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-15T22:32:57.036845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-15T22:32:57.036988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-15T22:32:57.037082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-15T22:32:57.037149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-15T22:32:57.037210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-15T22:32:57.037271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-15T22:32:57.037334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-15T22:32:57.037396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-15T22:32:57.037458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-15T22:32:57.037520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-15T22:32:57.037583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-15T22:32:57.037672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-15T22:32:57.037763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-15T22:32:57.037827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-15T22:32:57.037890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-15T22:32:57.037955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-15T22:32:57.038066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-15T22:32:57.038153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-15T22:32:57.038218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-15T22:32:57.038348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-15T22:32:57.038482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-15T22:32:57.038583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-15T22:32:57.038704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-15T22:32:57.038833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-15T22:32:57.038957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-15T22:32:57.039043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-15T22:32:57.039131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-15T22:32:57.039196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-15T22:32:57.039258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-15T22:32:57.039336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-15T22:32:57.039423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-15T22:32:57.039487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-15T22:32:57.039548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-15T22:32:57.039609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-15T22:32:57.039737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-15T22:32:57.039825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-15T22:32:57.039889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-15T22:32:57.039949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-15T22:32:57.040030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-15T22:32:57.040130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-15T22:32:57.040199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-15T22:32:57.040267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-15T22:32:57.040371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-15T22:32:57.040444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-15T22:32:57.040524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-15T22:32:57.040613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-15T22:32:57.040714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-15T22:32:57.040816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-15T22:32:57.040905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-15T22:32:57.040974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-15T22:32:57.041054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-15T22:32:57.041143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-15T22:32:57.041224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-15T22:32:57.041322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-15T22:32:57.041392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-15T22:32:57.041461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-15T22:32:57.041525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-15T22:32:57.041591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-15T22:32:57.041681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-15T22:32:57.041775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-15T22:32:57.041848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-15T22:32:57.041914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-15T22:32:57.041980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-15T22:32:57.042046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-15T22:32:57.042106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-15T22:32:57.042185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-15T22:32:57.042275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-15T22:32:57.042340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-15T22:32:57.042447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-15T22:32:57.042535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-15T22:32:57.042607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-15T22:32:57.042720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-15T22:32:57.042807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-15T22:32:57.042875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-15T22:32:57.042937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-15T22:32:57.043001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-15T22:32:57.043079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-15T22:32:57.043219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-15T22:32:57.043330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-15T22:32:57.043437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-15T22:32:57.043574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-15T22:32:57.043692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-15T22:32:57.043781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-15T22:32:57.043866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-15T22:32:57.043960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-15T22:32:57.044030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-15T22:32:57.044092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-15T22:32:57.044161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-15T22:32:57.044227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-15T22:32:57.044353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-15T22:32:57.044417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-15T22:32:57.044480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-15T22:32:57.044546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-15T22:32:57.044681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-15T22:32:57.044775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-15T22:32:57.044886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-15T22:32:57.044961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-15T22:32:57.045030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-15T22:32:57.045102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-15T22:32:57.045169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-15T22:32:57.045232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-15T22:32:57.045298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-15T22:32:57.045364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-15T22:32:57.045430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-15T22:32:57.045494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-15T22:32:57.045560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-15T22:32:57.045634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-15T22:32:57.045750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-15T22:32:57.045819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-15T22:32:57.045945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-15T22:32:57.046037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-15T22:32:57.046134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-15T22:32:57.046201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-15T22:32:57.046324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-15T22:32:57.046435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-15T22:32:57.046545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-15T22:32:57.046636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-15T22:32:57.046755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-15T22:32:57.046826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-15T22:32:57.046890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-15T22:32:57.047014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-15T22:32:57.047108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-15T22:32:57.047175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-15T22:32:57.047238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-15T22:32:57.047376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-15T22:32:57.047470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-15T22:32:57.047535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-15T22:32:57.047597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-15T22:32:57.047746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-15T22:32:57.047835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-15T22:32:57.047903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-15T22:32:57.047965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-15T22:32:57.048030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-15T22:32:57.048095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-15T22:32:57.048173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-15T22:32:57.048301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-15T22:32:57.048390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-15T22:32:57.048455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-15T22:32:57.048521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-15T22:32:57.048602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-15T22:32:57.048855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-15T22:32:57.048936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-15T22:32:57.049002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-15T22:32:57.049066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-15T22:32:57.049128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-15T22:32:57.049191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-15T22:32:57.049270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-15T22:32:57.049357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-15T22:32:57.049439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-15T22:32:57.049526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-15T22:32:57.049592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-15T22:32:57.049688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-15T22:32:57.049779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-15T22:32:57.049843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-15T22:32:57.049917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-15T22:32:57.049982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-15T22:32:57.050047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-15T22:32:57.050111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-15T22:32:57.050172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-15T22:32:57.050232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-15T22:32:57.050294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-15T22:32:57.050355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-15T22:32:57.050417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-15T22:32:57.050478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-15T22:32:57.050570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-15T22:32:57.050634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-15T22:32:57.050776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-15T22:32:57.050848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-15T22:32:57.050910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-15T22:32:57.050974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-15T22:32:57.051044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-15T22:32:57.051107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-15T22:32:57.051171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-15T22:32:57.051233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-15T22:32:57.051295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-15T22:32:57.051357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-15T22:32:57.051418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-15T22:32:57.051481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-15T22:32:57.051540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-15T22:32:57.051603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-15T22:32:57.051694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-15T22:32:57.051783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-15T22:32:57.051876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-15T22:32:57.051941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-15T22:32:57.052003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-15T22:32:57.052065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-15T22:32:57.052126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-15T22:32:57.052266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-15T22:32:57.052328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-15T22:32:57.052389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-15T22:32:57.052522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-15T22:32:57.052602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-15T22:32:57.052723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-15T22:32:57.052811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-15T22:32:57.052880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-15T22:32:57.052942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-15T22:32:57.053004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-15T22:32:57.053066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-15T22:32:57.053126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-15T22:32:57.053187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-15T22:32:57.053248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-15T22:32:57.053309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-15T22:32:57.053370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-15T22:32:57.053466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-15T22:32:57.053557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-15T22:32:57.053621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-15T22:32:57.053726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-15T22:32:57.053803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-15T22:32:57.053872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-15T22:32:57.053934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-15T22:32:57.053995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-15T22:32:57.054055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-15T22:32:57.054117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-15T22:32:57.054177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-15T22:32:57.054237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-15T22:32:57.054299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-15T22:32:57.054359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-15T22:32:57.054436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-15T22:32:57.054522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-15T22:32:57.054585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-15T22:32:57.054683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-15T22:32:57.054773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-15T22:32:57.054837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-15T22:32:57.054898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-15T22:32:57.054959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-15T22:32:57.055204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-15T22:32:57.055263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-15T22:32:57.055327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-15T22:32:57.055390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-15T22:32:57.055450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-15T22:32:57.055546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-10-15T22:32:57.055627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-15T22:32:57.055896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-15T22:32:57.055974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-15T22:32:57.056039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-15T22:32:57.056255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-15T22:32:57.056321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-15T22:32:57.056435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-15T22:32:57.056509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-15T22:32:57.056577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-15T22:32:57.056640] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-15T22:32:57.056803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-15T22:32:57.056898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-15T22:32:57.056967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-15T22:32:57.057043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-15T22:32:57.057132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-15T22:32:57.057201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-15T22:32:57.057269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-15T22:32:57.057349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-15T22:32:57.057437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-15T22:32:57.057502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-15T22:32:57.057564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-15T22:32:57.057628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-15T22:32:57.057734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-15T22:32:57.057811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-15T22:32:57.057926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-15T22:32:57.058016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-15T22:32:57.058085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-15T22:32:57.058165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-15T22:32:57.058278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-15T22:32:57.058366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-15T22:32:57.058429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-15T22:32:57.058490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-15T22:32:57.058570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-15T22:32:57.058636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-15T22:32:57.058758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-15T22:32:57.058828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-15T22:32:57.058895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-15T22:32:57.058988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-15T22:32:57.059069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-15T22:32:57.059136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-15T22:32:57.059198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-15T22:32:57.059259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-15T22:32:57.059325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-15T22:32:57.059389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-15T22:32:57.059453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-15T22:32:57.059515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-15T22:32:57.059579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-15T22:32:57.059669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-15T22:32:57.059762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-15T22:32:57.059827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-15T22:32:57.059888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-15T22:32:57.059950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-15T22:32:57.060012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-15T22:32:57.060072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-15T22:32:57.060132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-15T22:32:57.060193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-15T22:32:57.060252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-15T22:32:57.060307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-15T22:32:57.060368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-15T22:32:57.060430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-15T22:32:57.060497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-15T22:32:57.060575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-15T22:32:57.060686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-15T22:32:57.060776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-15T22:32:57.060840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-15T22:32:57.060901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-15T22:32:57.060962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-15T22:32:57.061022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-15T22:32:57.061085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-15T22:32:57.061145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-15T22:32:57.061210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-15T22:32:57.061274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-15T22:32:57.061336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-15T22:32:57.061397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-15T22:32:57.061458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-15T22:32:57.061564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-15T22:32:57.061681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-15T22:32:57.061839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-15T22:32:57.061912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-15T22:32:57.061978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-15T22:32:57.062055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-15T22:32:57.062142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-15T22:32:57.062207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-15T22:32:57.062269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-15T22:32:57.062332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-15T22:32:57.062392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-15T22:32:57.062454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-15T22:32:57.062518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-15T22:32:57.062582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-15T22:32:57.062671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-15T22:32:57.062764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-15T22:32:57.062830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-15T22:32:57.062892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-15T22:32:57.062953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-15T22:32:57.063014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-15T22:32:57.063074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-15T22:32:57.063135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-15T22:32:57.063196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-15T22:32:57.063255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-15T22:32:57.063317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-15T22:32:57.063378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-15T22:32:57.063455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-15T22:32:57.063578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-15T22:32:57.063854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-15T22:32:57.063948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-15T22:32:57.064011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-15T22:32:57.064073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-15T22:32:57.064135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-15T22:32:57.064200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-15T22:32:57.064279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-15T22:32:57.064369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-15T22:32:57.064464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-15T22:32:57.064529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-15T22:32:57.064590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-15T22:32:57.064718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-15T22:32:57.064805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-15T22:32:57.064869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-15T22:32:57.064930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-15T22:32:57.065023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-15T22:32:57.065090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-15T22:32:57.065154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-15T22:32:57.065216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-15T22:32:57.065277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-15T22:32:57.065342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-15T22:32:57.065408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-15T22:32:57.065471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-15T22:32:57.065534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-15T22:32:57.065594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-15T22:32:57.065684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-15T22:32:57.065773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-15T22:32:57.065856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-15T22:32:57.065972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-15T22:32:57.066039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-15T22:32:57.066104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-15T22:32:57.066167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-15T22:32:57.066231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-15T22:32:57.066293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-15T22:32:57.066427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-15T22:32:57.066518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-15T22:32:57.066586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-15T22:32:57.066680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-15T22:32:57.066779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-15T22:32:57.066848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-15T22:32:57.066913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-15T22:32:57.066975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-15T22:32:57.067039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-15T22:32:57.067101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-15T22:32:57.067165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-15T22:32:57.067269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-15T22:32:57.067349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-15T22:32:57.067445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-15T22:32:57.067524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-15T22:32:57.067620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-15T22:32:57.067726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-15T22:32:57.067803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-15T22:32:57.067867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-15T22:32:57.067930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-15T22:32:57.067994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-15T22:32:57.068058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-15T22:32:57.068119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-15T22:32:57.068182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-15T22:32:57.068272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-15T22:32:57.068362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-15T22:32:57.068426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-15T22:32:57.068491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-15T22:32:57.068552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-15T22:32:57.068615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-15T22:32:57.068712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-15T22:32:57.068798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-15T22:32:57.068863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-15T22:32:57.068932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-15T22:32:57.069153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-15T22:32:57.069217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-15T22:32:57.069279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-15T22:32:57.069341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-15T22:32:57.069403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-15T22:32:57.069465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-15T22:32:57.069527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-15T22:32:57.069589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-15T22:32:57.069674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-15T22:32:57.069764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-15T22:32:57.069829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-15T22:32:57.069891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-15T22:32:57.070134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-15T22:32:57.070252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-15T22:32:57.070342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-15T22:32:57.070407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-15T22:32:57.070469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-15T22:32:57.070531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-15T22:32:57.070592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-15T22:32:57.070708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-15T22:32:57.070843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-15T22:32:57.070933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-15T22:32:57.070998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-15T22:32:57.071061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-15T22:32:57.071121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-15T22:32:57.071184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-15T22:32:57.071262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-15T22:32:57.071348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-15T22:32:57.071411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-15T22:32:57.071473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-15T22:32:57.071533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-15T22:32:57.071593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-15T22:32:57.071782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-15T22:32:57.071872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-15T22:32:57.071936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-15T22:32:57.071997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-15T22:32:57.072058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-15T22:32:57.072118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-15T22:32:57.072187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-15T22:32:57.072248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-15T22:32:57.072308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-15T22:32:57.072369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-15T22:32:57.072437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-15T22:32:57.072498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-15T22:32:57.072558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-15T22:32:57.072618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-15T22:32:57.072715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-15T22:32:57.072826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-15T22:32:57.072938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-15T22:32:57.073008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-15T22:32:57.073070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-15T22:32:57.073132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-15T22:32:57.073226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-15T22:32:57.073290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-15T22:32:57.073350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-15T22:32:57.073410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-15T22:32:57.073471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-15T22:32:57.073562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-15T22:32:57.073691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-15T22:32:57.073777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-15T22:32:57.073867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-15T22:32:57.073957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-15T22:32:57.074024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-15T22:32:57.074104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-15T22:32:57.074193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-15T22:32:57.074261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-15T22:32:57.074327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-15T22:32:57.074390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-15T22:32:57.074453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-15T22:32:57.074518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-15T22:32:57.074580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-15T22:32:57.074712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-15T22:32:57.074843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-15T22:32:57.074910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-15T22:32:57.075009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-15T22:32:57.075072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-15T22:32:57.075134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-15T22:32:57.075255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-15T22:32:57.075332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-15T22:32:57.075398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-15T22:32:57.075460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-15T22:32:57.075525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-15T22:32:57.075587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-15T22:32:57.075681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-15T22:32:57.075771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-15T22:32:57.075836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-15T22:32:57.075899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-15T22:32:57.075961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-15T22:32:57.076024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-15T22:32:57.076087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-15T22:32:57.076150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-15T22:32:57.076212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-15T22:32:57.076276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-15T22:32:57.076351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-15T22:32:57.076439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-15T22:32:57.076514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-15T22:32:57.076579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-15T22:32:57.076668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-15T22:32:57.076761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-15T22:32:57.076829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-15T22:32:57.076894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-15T22:32:57.076957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-15T22:32:57.077037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-15T22:32:57.077146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-15T22:32:57.077264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-15T22:32:57.077331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-15T22:32:57.077397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-15T22:32:57.077462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-15T22:32:57.077525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-15T22:32:57.077589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-15T22:32:57.077681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-15T22:32:57.077771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-15T22:32:57.077841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-15T22:32:57.077906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-15T22:32:57.077970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-15T22:32:57.078032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-15T22:32:57.078092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-15T22:32:57.078155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-15T22:32:57.078216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-15T22:32:57.078354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-15T22:32:57.078426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-15T22:32:57.078490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-15T22:32:57.078553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-15T22:32:57.078615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-15T22:32:57.078723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-15T22:32:57.078804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-15T22:32:57.078872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-15T22:32:57.078934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-15T22:32:57.078996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-15T22:32:57.079057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-15T22:32:57.079118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-15T22:32:57.079199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-15T22:32:57.079287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-15T22:32:57.079383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-15T22:32:57.079455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-15T22:32:57.079520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-15T22:32:57.079581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-15T22:32:57.079801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-15T22:32:57.079894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-15T22:32:57.079992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-15T22:32:57.080058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-15T22:32:57.080120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-15T22:32:57.080181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-15T22:32:57.080242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-15T22:32:57.080303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-15T22:32:57.080362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-15T22:32:57.080442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-15T22:32:57.080530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-15T22:32:57.080594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-15T22:32:57.080692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-15T22:32:57.080778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-15T22:32:57.080842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-15T22:32:57.080979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-15T22:32:57.081108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-15T22:32:57.081196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-15T22:32:57.081260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-15T22:32:57.081321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-15T22:32:57.081383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-15T22:32:57.081444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-15T22:32:57.081505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-15T22:32:57.081565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-15T22:32:57.081625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-15T22:32:57.081726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-15T22:32:57.081798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-15T22:32:57.081892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-15T22:32:57.081956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-15T22:32:57.082016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-15T22:32:57.082131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-15T22:32:57.082193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-15T22:32:57.082258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-15T22:32:57.082320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-15T22:32:57.082381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-15T22:32:57.082480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-15T22:32:57.082544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-15T22:32:57.082610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-15T22:32:57.082714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-15T22:32:57.082804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-15T22:32:57.082871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-15T22:32:57.082934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-15T22:32:57.082996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-15T22:32:57.083057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-15T22:32:57.083172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-15T22:32:57.083261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-15T22:32:57.083326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-15T22:32:57.083392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-15T22:32:57.083454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-15T22:32:57.083517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-15T22:32:57.083578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-15T22:32:57.083661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-15T22:32:57.083776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-15T22:32:57.083900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-15T22:32:57.083987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-15T22:32:57.084089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-15T22:32:57.084177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-15T22:32:57.084245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-15T22:32:57.084311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-15T22:32:57.084372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-15T22:32:57.084433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-15T22:32:57.084493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-15T22:32:57.084558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-15T22:32:57.084622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-15T22:32:57.084725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-15T22:32:57.084804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-15T22:32:57.084873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-15T22:32:57.084935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-15T22:32:57.085033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-15T22:32:57.085146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-15T22:32:57.085235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-15T22:32:57.085300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-15T22:32:57.085365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-15T22:32:57.085501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-15T22:32:57.085584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-15T22:32:57.085674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-15T22:32:57.085765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-15T22:32:57.085861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-15T22:32:57.085927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-15T22:32:57.085992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-15T22:32:57.086054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-15T22:32:57.086116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-15T22:32:57.086177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-15T22:32:57.086239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-15T22:32:57.086302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-15T22:32:57.086363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-15T22:32:57.086425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-15T22:32:57.086486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-15T22:32:57.086552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-15T22:32:57.086616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-15T22:32:57.086761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-15T22:32:57.086844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-15T22:32:57.086910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-15T22:32:57.086972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-15T22:32:57.087035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-15T22:32:57.087099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-15T22:32:57.087162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-15T22:32:57.087267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-15T22:32:57.087331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-15T22:32:57.087394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-15T22:32:57.087455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-15T22:32:57.087516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-15T22:32:57.087576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-15T22:32:57.087636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-15T22:32:57.087872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-15T22:32:57.087943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-15T22:32:57.088006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-15T22:32:57.088069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-15T22:32:57.088131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-15T22:32:57.088193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-15T22:32:57.088295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-15T22:32:57.088386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-15T22:32:57.088455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-15T22:32:57.088561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-15T22:32:57.088677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-15T22:32:57.088768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-15T22:32:57.088834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-15T22:32:57.088902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-15T22:32:57.088964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-15T22:32:57.089027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-15T22:32:57.089090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-15T22:32:57.089154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-15T22:32:57.089219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-15T22:32:57.089281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-15T22:32:57.089388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-15T22:32:57.089460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-15T22:32:57.089524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-15T22:32:57.089590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-15T22:32:57.089681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-15T22:32:57.089770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-15T22:32:57.089838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-15T22:32:57.089901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-15T22:32:57.089966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-15T22:32:57.090029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-15T22:32:57.090091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-15T22:32:57.090155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-15T22:32:57.090218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-15T22:32:57.090313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-15T22:32:57.090378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-15T22:32:57.090442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-15T22:32:57.090515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-15T22:32:57.090578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-15T22:32:57.090670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-15T22:32:57.090764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-15T22:32:57.090834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-15T22:32:57.090900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-15T22:32:57.091014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-15T22:32:57.091100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-15T22:32:57.091166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-15T22:32:57.091237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-15T22:32:57.091307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-15T22:32:57.091373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-15T22:32:57.091475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-15T22:32:57.091543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-15T22:32:57.091606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-15T22:32:57.091709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-15T22:32:57.091800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-15T22:32:57.091869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-15T22:32:57.091936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-15T22:32:57.092002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-15T22:32:57.092068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-10-15T22:32:57.092133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-15T22:32:57.092198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-15T22:32:57.092322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-15T22:32:57.092415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-15T22:32:57.092484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-15T22:32:57.092548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-15T22:32:57.092614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-15T22:32:57.092714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-15T22:32:57.092797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-15T22:32:57.092864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-15T22:32:57.092928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-15T22:32:57.092992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-15T22:32:57.093055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-15T22:32:57.093121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-15T22:32:57.093186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-15T22:32:57.093248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-15T22:32:57.093310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-15T22:32:57.093376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-15T22:32:57.093439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-15T22:32:57.093503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-15T22:32:57.093569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-15T22:32:57.093707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-15T22:32:57.093815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-15T22:32:57.093918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-15T22:32:57.093989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-15T22:32:57.094054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-15T22:32:57.094120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-15T22:32:57.094190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-15T22:32:57.094256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-15T22:32:57.094319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-15T22:32:57.094383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-15T22:32:57.094446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-15T22:32:57.094516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-15T22:32:57.094587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-15T22:32:57.094739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-15T22:32:57.094818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-15T22:32:57.094884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-15T22:32:57.094948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-15T22:32:57.095013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-15T22:32:57.095076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-15T22:32:57.095142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-15T22:32:57.095205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-15T22:32:57.095273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-15T22:32:57.095338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-15T22:32:57.095403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-15T22:32:57.095467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-15T22:32:57.095530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-15T22:32:57.095592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-15T22:32:57.095797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-15T22:32:57.095895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-15T22:32:57.095963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-15T22:32:57.096027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-15T22:32:57.096092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-15T22:32:57.096155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-15T22:32:57.096217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-15T22:32:57.096306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-15T22:32:57.096372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-15T22:32:57.096437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-15T22:32:57.096501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-15T22:32:57.096564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-15T22:32:57.096626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-15T22:32:57.096733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-15T22:32:57.096813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-15T22:32:57.096878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-15T22:32:57.096942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-15T22:32:57.097038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-15T22:32:57.097120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-15T22:32:57.097185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-15T22:32:57.097254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-15T22:32:57.097325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-15T22:32:57.097390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-15T22:32:57.097457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-15T22:32:57.097523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-15T22:32:57.097586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-15T22:32:57.097682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-15T22:32:57.097773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-15T22:32:57.097840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-15T22:32:57.097903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-15T22:32:57.097966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-15T22:32:57.098028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-15T22:32:57.098092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-15T22:32:57.098154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-15T22:32:57.098216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-15T22:32:57.098331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-15T22:32:57.098432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-15T22:32:57.098499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-15T22:32:57.098561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-15T22:32:57.098624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-15T22:32:57.098774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-15T22:32:57.098864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-15T22:32:57.098930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-15T22:32:57.098992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-15T22:32:57.099069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-15T22:32:57.099157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-15T22:32:57.099222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-15T22:32:57.099284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-15T22:32:57.099349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-15T22:32:57.099412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-15T22:32:57.099477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-15T22:32:57.099544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-15T22:32:57.099664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-15T22:32:57.099830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-15T22:32:57.099922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-15T22:32:57.099997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-15T22:32:57.100062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-15T22:32:57.100172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-15T22:32:57.100246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-15T22:32:57.100361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-15T22:32:57.100452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-15T22:32:57.100520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-15T22:32:57.100587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-15T22:32:57.100713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-15T22:32:57.100807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-15T22:32:57.100876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-15T22:32:57.100942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-15T22:32:57.101005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-15T22:32:57.101125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-15T22:32:57.101194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-15T22:32:57.101257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-15T22:32:57.101321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-15T22:32:57.101384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-15T22:32:57.101445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-15T22:32:57.101510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-15T22:32:57.101572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-15T22:32:57.101635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-15T22:32:57.101747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-15T22:32:57.101819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-15T22:32:57.101888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-15T22:32:57.101954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-15T22:32:57.102017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-15T22:32:57.102082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-15T22:32:57.102146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-15T22:32:57.102210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-15T22:32:57.102277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-15T22:32:57.102343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-15T22:32:57.102408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-15T22:32:57.102473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-15T22:32:57.102536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-15T22:32:57.102602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-15T22:32:57.102711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-15T22:32:57.102807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-15T22:32:57.102882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-15T22:32:57.102951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-15T22:32:57.103019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-15T22:32:57.103086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-15T22:32:57.103151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-15T22:32:57.103215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-15T22:32:57.103279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-15T22:32:57.103343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-15T22:32:57.103407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-15T22:32:57.103471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-15T22:32:57.103534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-15T22:32:57.103596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-15T22:32:57.103808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-15T22:32:57.103923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-15T22:32:57.104014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-15T22:32:57.104083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-15T22:32:57.104149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-15T22:32:57.104213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-15T22:32:57.104277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-15T22:32:57.104344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-15T22:32:57.104441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-15T22:32:57.104507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-15T22:32:57.104570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-15T22:32:57.104635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-15T22:32:57.104752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-15T22:32:57.104848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-15T22:32:57.104939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-15T22:32:57.105005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-15T22:32:57.105070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-15T22:32:57.105135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-15T22:32:57.105198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-15T22:32:57.105261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-15T22:32:57.105325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-15T22:32:57.105387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-15T22:32:57.105450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-15T22:32:57.105556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-15T22:32:57.105627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-15T22:32:57.105767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-15T22:32:57.105845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-15T22:32:57.105918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-15T22:32:57.105982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-15T22:32:57.106045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-15T22:32:57.106108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-15T22:32:57.106170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-15T22:32:57.106233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-15T22:32:57.106300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-15T22:32:57.106369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-15T22:32:57.106435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-15T22:32:57.106498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-15T22:32:57.106561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-15T22:32:57.106624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-15T22:32:57.106738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-15T22:32:57.106814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-15T22:32:57.106879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-15T22:32:57.106942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-15T22:32:57.107006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-15T22:32:57.107112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-15T22:32:57.107203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-15T22:32:57.107269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-15T22:32:57.107332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-15T22:32:57.107394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-15T22:32:57.107456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-15T22:32:57.107519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-15T22:32:57.107609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-15T22:32:57.107814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-15T22:32:57.107899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-15T22:32:57.107966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-15T22:32:57.108030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-15T22:32:57.108092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-15T22:32:57.108154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-15T22:32:57.108218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-15T22:32:57.108333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-15T22:32:57.108403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-15T22:32:57.108470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-15T22:32:57.108535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-15T22:32:57.108599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-15T22:32:57.108697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-15T22:32:57.108797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-15T22:32:57.108870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-15T22:32:57.108940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-15T22:32:57.109004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-15T22:32:57.109114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-15T22:32:57.109180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-15T22:32:57.109247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-15T22:32:57.109311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-15T22:32:57.109376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-15T22:32:57.109440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-15T22:32:57.109506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-15T22:32:57.109572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-15T22:32:57.109636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-15T22:32:57.109797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-15T22:32:57.109870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-15T22:32:57.109936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-15T22:32:57.110004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-15T22:32:57.110069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-15T22:32:57.110136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-15T22:32:57.110200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-15T22:32:57.110266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-15T22:32:57.110329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-15T22:32:57.110407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-15T22:32:57.110473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-15T22:32:57.110537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-15T22:32:57.110602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-15T22:32:57.110702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-15T22:32:57.110792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-15T22:32:57.110865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-15T22:32:57.110974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-15T22:32:57.111048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-15T22:32:57.111115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-15T22:32:57.111182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-15T22:32:57.111245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-15T22:32:57.111310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-15T22:32:57.111374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-15T22:32:57.111439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-15T22:32:57.111503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-15T22:32:57.111600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-15T22:32:57.111715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-15T22:32:57.111798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-15T22:32:57.111866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-15T22:32:57.111932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-15T22:32:57.111999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-15T22:32:57.112068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-15T22:32:57.112131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-15T22:32:57.112195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-15T22:32:57.112258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-15T22:32:57.112320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-15T22:32:57.112384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-15T22:32:57.112476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-15T22:32:57.112568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-15T22:32:57.112635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-15T22:32:57.112748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-15T22:32:57.112821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-15T22:32:57.112886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-15T22:32:57.112951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-15T22:32:57.113013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-15T22:32:57.113082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-15T22:32:57.113150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-15T22:32:57.113214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-15T22:32:57.113281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-15T22:32:57.113347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-15T22:32:57.113411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-15T22:32:57.113480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-15T22:32:57.113545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-15T22:32:57.113608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-15T22:32:57.113709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-15T22:32:57.113794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-15T22:32:57.113862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-15T22:32:57.113926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-15T22:32:57.114020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-15T22:32:57.114108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-15T22:32:57.114175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-15T22:32:57.114238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-15T22:32:57.114312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-15T22:32:57.114411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-15T22:32:57.114493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-15T22:32:57.114559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-15T22:32:57.114622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-15T22:32:57.114737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-15T22:32:57.114818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-15T22:32:57.114906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-15T22:32:57.115034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-15T22:32:57.115119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-15T22:32:57.115207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-15T22:32:57.115273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-15T22:32:57.115336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-15T22:32:57.115399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-15T22:32:57.115467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-15T22:32:57.115532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-15T22:32:57.115596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-15T22:32:57.115804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-15T22:32:57.115899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-15T22:32:57.115965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-15T22:32:57.116029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-15T22:32:57.116092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-15T22:32:57.116156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-15T22:32:57.116250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-15T22:32:57.116314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-15T22:32:57.116429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-15T22:32:57.116501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-15T22:32:57.116566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-15T22:32:57.116701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-15T22:32:57.116793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-15T22:32:57.116865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-15T22:32:57.116932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-15T22:32:57.116999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-15T22:32:57.117061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-15T22:32:57.117123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-15T22:32:57.117186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-15T22:32:57.117249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-15T22:32:57.117344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-15T22:32:57.117409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-15T22:32:57.117506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-15T22:32:57.117587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-15T22:32:57.117676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-15T22:32:57.117765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-15T22:32:57.117838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-15T22:32:57.117907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-15T22:32:57.117976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-15T22:32:57.118044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-15T22:32:57.118147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-15T22:32:57.118261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-15T22:32:57.118352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-15T22:32:57.118458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-15T22:32:57.118599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-15T22:32:57.118711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-15T22:32:57.118808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-15T22:32:57.118894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-15T22:32:57.118983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-15T22:32:57.119051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-15T22:32:57.119119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-15T22:32:57.119185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-15T22:32:57.119249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-15T22:32:57.119316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-15T22:32:57.119382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-15T22:32:57.119482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-15T22:32:57.119549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-15T22:32:57.119614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-15T22:32:57.119728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-15T22:32:57.119839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-15T22:32:57.119919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-15T22:32:57.119988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-15T22:32:57.120056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-15T22:32:57.120122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-15T22:32:57.120187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-15T22:32:57.120256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-15T22:32:57.120324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-15T22:32:57.120391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-15T22:32:57.120456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-15T22:32:57.120522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-15T22:32:57.120662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-15T22:32:57.120777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-15T22:32:57.120846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-15T22:32:57.120915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-15T22:32:57.121034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-15T22:32:57.121123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-15T22:32:57.121191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-15T22:32:57.121256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-15T22:32:57.121323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-15T22:32:57.121421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-15T22:32:57.121487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-15T22:32:57.121552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-15T22:32:57.121618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-15T22:32:57.121736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-15T22:32:57.121827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-15T22:32:57.121927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-15T22:32:57.122039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-15T22:32:57.122130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-15T22:32:57.122198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-15T22:32:57.122309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-15T22:32:57.122382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-15T22:32:57.122448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-15T22:32:57.122513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-15T22:32:57.122578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-15T22:32:57.122672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-15T22:32:57.122766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-15T22:32:57.122835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-15T22:32:57.122903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-15T22:32:57.122967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-15T22:32:57.123032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-15T22:32:57.123097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-15T22:32:57.123160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-15T22:32:57.123224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-15T22:32:57.123289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-15T22:32:57.123352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-15T22:32:57.123420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-15T22:32:57.123487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-15T22:32:57.123551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-15T22:32:57.123613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-15T22:32:57.123821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-15T22:32:57.123929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-15T22:32:57.124017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-15T22:32:57.124112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-15T22:32:57.124204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-15T22:32:57.124272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-15T22:32:57.124336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-15T22:32:57.124400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-15T22:32:57.124464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-15T22:32:57.124529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-15T22:32:57.124593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-15T22:32:57.124695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-15T22:32:57.124784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-15T22:32:57.124851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-15T22:32:57.124916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-15T22:32:57.124978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-15T22:32:57.125041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-15T22:32:57.125104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-15T22:32:57.125169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-15T22:32:57.125282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-15T22:32:57.125425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-15T22:32:57.125492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-15T22:32:57.125557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-15T22:32:57.125620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-15T22:32:57.125723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-15T22:32:57.125806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-15T22:32:57.125870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-15T22:32:57.125935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-15T22:32:57.126016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-15T22:32:57.126137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-15T22:32:57.126209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-15T22:32:57.126276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-15T22:32:57.126354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-15T22:32:57.126474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-15T22:32:57.126550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-15T22:32:57.126615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-15T22:32:57.126723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-15T22:32:57.126851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-15T22:32:57.126948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-15T22:32:57.127015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-15T22:32:57.127080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-15T22:32:57.127143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-15T22:32:57.127205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-15T22:32:57.127268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-15T22:32:57.127330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-15T22:32:57.127395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-15T22:32:57.127488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-15T22:32:57.127556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-15T22:32:57.127621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-15T22:32:57.127758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-15T22:32:57.127841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-15T22:32:57.127952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-15T22:32:57.128026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-15T22:32:57.128092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-15T22:32:57.128161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-15T22:32:57.128248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-15T22:32:57.128350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-15T22:32:57.128418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-15T22:32:57.128486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-15T22:32:57.128551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-15T22:32:57.128613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-15T22:32:57.128712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-15T22:32:57.128831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-15T22:32:57.128900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-15T22:32:57.128962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-15T22:32:57.129026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-15T22:32:57.129090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-15T22:32:57.129154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-15T22:32:57.129217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-15T22:32:57.129303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-15T22:32:57.129393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-15T22:32:57.129459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-15T22:32:57.129521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-15T22:32:57.129585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-15T22:32:57.129671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-15T22:32:57.129765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-15T22:32:57.129847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-15T22:32:57.129915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-15T22:32:57.129976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-15T22:32:57.130038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-15T22:32:57.130100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-15T22:32:57.130164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-15T22:32:57.130226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-15T22:32:57.130289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-15T22:32:57.130355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-15T22:32:57.130421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-15T22:32:57.130486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-15T22:32:57.130565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-15T22:32:57.130696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-15T22:32:57.130791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-15T22:32:57.130860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-15T22:32:57.130923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-15T22:32:57.130985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-15T22:32:57.131082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-15T22:32:57.131195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-15T22:32:57.131286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-15T22:32:57.131376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-15T22:32:57.131490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-15T22:32:57.131572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-15T22:32:57.131639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-15T22:32:57.131914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-15T22:32:57.131982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-15T22:32:57.132048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-15T22:32:57.132109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-15T22:32:57.132171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-15T22:32:57.132234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-15T22:32:57.132299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-15T22:32:57.132362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-15T22:32:57.132425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-15T22:32:57.132487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-15T22:32:57.132550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-15T22:32:57.132614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-15T22:32:57.132745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-15T22:32:57.132827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-15T22:32:57.132901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-15T22:32:57.132968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-15T22:32:57.133031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-15T22:32:57.133094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-15T22:32:57.133157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-15T22:32:57.133221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-15T22:32:57.133285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-15T22:32:57.133348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-15T22:32:57.133454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-15T22:32:57.133526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-15T22:32:57.133625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-15T22:32:57.133734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-15T22:32:57.133808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-15T22:32:57.133873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-15T22:32:57.133967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-15T22:32:57.134033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-15T22:32:57.134097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-15T22:32:57.134175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-15T22:32:57.134276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-15T22:32:57.134367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-15T22:32:57.134470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-15T22:32:57.134564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-15T22:32:57.134639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-15T22:32:57.134763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-15T22:32:57.134831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-15T22:32:57.134896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-15T22:32:57.134983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-15T22:32:57.135071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-15T22:32:57.135138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-15T22:32:57.135207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-15T22:32:57.135271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-15T22:32:57.135419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-15T22:32:57.135511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-15T22:32:57.135582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-15T22:32:57.135688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-15T22:32:57.135800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-15T22:32:57.135890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-15T22:32:57.135972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-15T22:32:57.136054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-15T22:32:57.136163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-15T22:32:57.136265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-15T22:32:57.136336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-15T22:32:57.136400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-15T22:32:57.136466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-15T22:32:57.136530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-15T22:32:57.136594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-15T22:32:57.136695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-15T22:32:57.136787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-15T22:32:57.136856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-15T22:32:57.136921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-15T22:32:57.136988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-15T22:32:57.137052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-15T22:32:57.137118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-15T22:32:57.137182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-15T22:32:57.137245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-15T22:32:57.137310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-15T22:32:57.137375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-15T22:32:57.137438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-15T22:32:57.137502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-15T22:32:57.137565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-15T22:32:57.137628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-15T22:32:57.137735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-15T22:32:57.137811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-15T22:32:57.137874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-15T22:32:57.137939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-15T22:32:57.138000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-15T22:32:57.138100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-15T22:32:57.138166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-15T22:32:57.138253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-15T22:32:57.138345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-15T22:32:57.138413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-15T22:32:57.138477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-15T22:32:57.138541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-15T22:32:57.138604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-15T22:32:57.138703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-15T22:32:57.138793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-15T22:32:57.138861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-15T22:32:57.138935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-15T22:32:57.138998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-15T22:32:57.139141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-15T22:32:57.139220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-15T22:32:57.139286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-15T22:32:57.139350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-15T22:32:57.139414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-15T22:32:57.139478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-15T22:32:57.139541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-15T22:32:57.139603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-15T22:32:57.139850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-15T22:32:57.139941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-15T22:32:57.140008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-15T22:32:57.140071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-15T22:32:57.140134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-15T22:32:57.140198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-15T22:32:57.140262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-15T22:32:57.140325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-15T22:32:57.140390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-15T22:32:57.140479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-15T22:32:57.140546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-15T22:32:57.140666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-15T22:32:57.140761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-15T22:32:57.140833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-15T22:32:57.140898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-15T22:32:57.140963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-15T22:32:57.141027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-15T22:32:57.141090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-15T22:32:57.141154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-15T22:32:57.141216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-15T22:32:57.141337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-15T22:32:57.141454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-15T22:32:57.141544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-15T22:32:57.141612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-15T22:32:57.141710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-15T22:32:57.141792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-15T22:32:57.141858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-15T22:32:57.141921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-15T22:32:57.141991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-15T22:32:57.142056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-15T22:32:57.142120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-15T22:32:57.142181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-15T22:32:57.142244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-15T22:32:57.142318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-15T22:32:57.142386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-15T22:32:57.142449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-15T22:32:57.142512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-15T22:32:57.142575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-15T22:32:57.142638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-15T22:32:57.142782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-15T22:32:57.142852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-15T22:32:57.142915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-15T22:32:57.142978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-15T22:32:57.143041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-15T22:32:57.143104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-15T22:32:57.143168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-15T22:32:57.143247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-15T22:32:57.143335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-15T22:32:57.143481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-15T22:32:57.143590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-15T22:32:57.143699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-15T22:32:57.143789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-15T22:32:57.143856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-15T22:32:57.143972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-15T22:32:57.144076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-15T22:32:57.144146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-15T22:32:57.144213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-15T22:32:57.144318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-15T22:32:57.144412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-15T22:32:57.144487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-15T22:32:57.144582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-15T22:32:57.144671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-15T22:32:57.144764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-15T22:32:57.144877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-15T22:32:57.144978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-15T22:32:57.145045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-15T22:32:57.145141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-15T22:32:57.145223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-15T22:32:57.145287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-15T22:32:57.145351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-15T22:32:57.145413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-15T22:32:57.145475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-15T22:32:57.145537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-10-15T22:32:57.145599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-15T22:32:57.145689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-15T22:32:57.145777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-15T22:32:57.145848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-15T22:32:57.145911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-15T22:32:57.145973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-15T22:32:57.146037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-15T22:32:57.146117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-15T22:32:57.146207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-15T22:32:57.146272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-15T22:32:57.146334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-15T22:32:57.146396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-15T22:32:57.146459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-15T22:32:57.146521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-15T22:32:57.146595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-15T22:32:57.146694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-15T22:32:57.146787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-15T22:32:57.146854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-15T22:32:57.146917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-15T22:32:57.146978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-15T22:32:57.147042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-15T22:32:57.147103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-15T22:32:57.147165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-15T22:32:57.147226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-15T22:32:57.147286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-15T22:32:57.147365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-15T22:32:57.147452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-15T22:32:57.147518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-15T22:32:57.147580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-15T22:32:57.147805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-15T22:32:57.147898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-15T22:32:57.147970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-15T22:32:57.148034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-15T22:32:57.148102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-15T22:32:57.148167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-15T22:32:57.148261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-15T22:32:57.148353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-15T22:32:57.148423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-15T22:32:57.148490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-15T22:32:57.148553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-15T22:32:57.148619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-15T22:32:57.148720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-15T22:32:57.148868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-15T22:32:57.148961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-15T22:32:57.149028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-15T22:32:57.149091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-15T22:32:57.149154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-15T22:32:57.149217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-15T22:32:57.149303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-15T22:32:57.149367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-15T22:32:57.149431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-15T22:32:57.149497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-15T22:32:57.149567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-15T22:32:57.149631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-15T22:32:57.149755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-15T22:32:57.149845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-15T22:32:57.149911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-15T22:32:57.149973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-15T22:32:57.150035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-15T22:32:57.150097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-15T22:32:57.150157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-15T22:32:57.150261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-15T22:32:57.150378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-15T22:32:57.150445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-15T22:32:57.150508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-15T22:32:57.150574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-15T22:32:57.150637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-15T22:32:57.150759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-15T22:32:57.150831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-15T22:32:57.150926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-15T22:32:57.151010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-15T22:32:57.151076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-15T22:32:57.151140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-15T22:32:57.151201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-15T22:32:57.151262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-15T22:32:57.151325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-15T22:32:57.151391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-15T22:32:57.151478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-15T22:32:57.151567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-15T22:32:57.151632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-15T22:32:57.151744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-15T22:32:57.151822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-15T22:32:57.151888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-15T22:32:57.151953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-15T22:32:57.152016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-15T22:32:57.152079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-15T22:32:57.152140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-15T22:32:57.152227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-15T22:32:57.152319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-15T22:32:57.152387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-15T22:32:57.152450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-15T22:32:57.152513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-15T22:32:57.152577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-15T22:32:57.152665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-15T22:32:57.152788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-15T22:32:57.152856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-15T22:32:57.152922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-15T22:32:57.152986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-15T22:32:57.153052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-15T22:32:57.153117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-15T22:32:57.153179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-15T22:32:57.153243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-15T22:32:57.153307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-15T22:32:57.153375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-15T22:32:57.153439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-15T22:32:57.153503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-15T22:32:57.153615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-15T22:32:57.153742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-15T22:32:57.153850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-15T22:32:57.153933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-15T22:32:57.153999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-15T22:32:57.154063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-15T22:32:57.154127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-15T22:32:57.154192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-15T22:32:57.154256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-15T22:32:57.154379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-15T22:32:57.154478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-15T22:32:57.154546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-15T22:32:57.154707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-15T22:32:57.154834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-15T22:32:57.154902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-15T22:32:57.154966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-15T22:32:57.155030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-15T22:32:57.155093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-15T22:32:57.155158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-15T22:32:57.155223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-15T22:32:57.155286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-15T22:32:57.155427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-15T22:32:57.155518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-15T22:32:57.155619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-15T22:32:57.155858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-15T22:32:57.155936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-15T22:32:57.156074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-15T22:32:57.156152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-15T22:32:57.156251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-15T22:32:57.156318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-15T22:32:57.156383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-15T22:32:57.156444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-15T22:32:57.156507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-15T22:32:57.156571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-15T22:32:57.156632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-15T22:32:57.156742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-15T22:32:57.156816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-15T22:32:57.156880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-15T22:32:57.156966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-15T22:32:57.157056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-15T22:32:57.157129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-15T22:32:57.157196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-15T22:32:57.157261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-15T22:32:57.157323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-15T22:32:57.157418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-15T22:32:57.157527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-15T22:32:57.157614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-15T22:32:57.157716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-15T22:32:57.157808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-15T22:32:57.157874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-15T22:32:57.157937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-15T22:32:57.158000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-15T22:32:57.158063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-15T22:32:57.158126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-15T22:32:57.158188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-15T22:32:57.158281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-15T22:32:57.158417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-15T22:32:57.158506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-15T22:32:57.158572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-15T22:32:57.158635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-15T22:32:57.158757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-15T22:32:57.158826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-15T22:32:57.158889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-15T22:32:57.158952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-15T22:32:57.159046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-15T22:32:57.159112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-15T22:32:57.159173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-15T22:32:57.159236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-15T22:32:57.159300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-15T22:32:57.159372] [INFO ] [LOCAL ] Deleted 1710 derivative data files. [2025-10-15T22:32:57.159407] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-15T22:32:57.161237] [INFO ] [LOCAL ] Found 1803 symbols with primary data. [2025-10-15T22:32:57.161467] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1803 symbols [2025-10-15T22:32:57.161961] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:57.162300] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:57.163446] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:57.219437] [DEBUG] [LOCAL ] AAT: Loaded 30450 existing records from primary storage. [2025-10-15T22:32:57.219678] [INFO ] [MAIN ] AAT: Loaded 30450 primary data records. [2025-10-15T22:32:57.347370] [DEBUG] [LOCAL ] AAP: Loaded 51846 existing records from primary storage. [2025-10-15T22:32:57.355988] [INFO ] [MAIN ] AAP: Loaded 51846 primary data records. [2025-10-15T22:32:57.377583] [DEBUG] [LOCAL ] A: Loaded 50779 existing records from primary storage. [2025-10-15T22:32:57.417266] [INFO ] [MAIN ] A: Loaded 50779 primary data records. [2025-10-15T22:32:58.200609] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:32:58.202498] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30450 primary records. [2025-10-15T22:32:58.203723] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-15T22:32:58.230417] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:32:58.233471] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51846 primary records. [2025-10-15T22:32:58.233927] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-15T22:32:58.259053] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-10-15T22:32:58.262374] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:32:58.259384] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-15T22:32:58.264503] [INFO ] [MAIN ] Derivative Progress: 1/1803 symbols completed. AAT took 1.1s. Estimated remaining: 33m 8s. Rate: 54.4 symbols/min [2025-10-15T22:32:58.266445] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50779 primary records. [2025-10-15T22:32:58.264978] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:58.267035] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-15T22:32:58.271286] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-15T22:32:58.271614] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-15T22:32:58.281149] [INFO ] [MAIN ] Derivative Progress: 2/1803 symbols completed. AAP took 1.1s. Estimated remaining: 16m 48s. Rate: 107.2 symbols/min [2025-10-15T22:32:58.282743] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:58.290914] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-15T22:32:58.291146] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-15T22:32:58.294242] [INFO ] [MAIN ] Derivative Progress: 3/1803 symbols completed. A took 1.1s. Estimated remaining: 11m 20s. Rate: 158.9 symbols/min [2025-10-15T22:32:58.294593] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:58.345018] [DEBUG] [LOCAL ] ABCB: Loaded 30489 existing records from primary storage. [2025-10-15T22:32:58.345606] [DEBUG] [LOCAL ] ABG: Loaded 18383 existing records from primary storage. [2025-10-15T22:32:58.345860] [INFO ] [MAIN ] ABCB: Loaded 30489 primary data records. [2025-10-15T22:32:58.346072] [INFO ] [MAIN ] ABG: Loaded 18383 primary data records. [2025-10-15T22:32:58.542623] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-15T22:32:58.568372] [INFO ] [MAIN ] ABEV: Loaded 53278 primary data records. [2025-10-15T22:32:59.359856] [DEBUG] [MAIN ] ABCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:32:59.361510] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30489 primary records. [2025-10-15T22:32:59.362443] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-15T22:32:59.392559] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-15T22:32:59.393169] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:32:59.394397] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-15T22:32:59.394147] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18383 primary records. [2025-10-15T22:32:59.396286] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-15T22:32:59.396178] [INFO ] [MAIN ] Derivative Progress: 4/1803 symbols completed. ABCB took 1.1s. Estimated remaining: 16m 45s. Rate: 107.4 symbols/min [2025-10-15T22:32:59.397515] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:59.433961] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-15T22:32:59.432885] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:32:59.434878] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53278 primary records. [2025-10-15T22:32:59.434969] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-15T22:32:59.436985] [INFO ] [MAIN ] Derivative Progress: 5/1803 symbols completed. ABG took 1.1s. Estimated remaining: 13m 38s. Rate: 131.8 symbols/min [2025-10-15T22:32:59.437275] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:59.437115] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-15T22:32:59.455565] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-15T22:32:59.455715] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-15T22:32:59.458026] [INFO ] [MAIN ] Derivative Progress: 6/1803 symbols completed. ABEV took 1.2s. Estimated remaining: 11m 28s. Rate: 156.7 symbols/min [2025-10-15T22:32:59.458254] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:32:59.501871] [DEBUG] [LOCAL ] ABR: Loaded 51966 existing records from primary storage. [2025-10-15T22:32:59.502194] [INFO ] [MAIN ] ABR: Loaded 51966 primary data records. [2025-10-15T22:32:59.617927] [DEBUG] [LOCAL ] ACA: Loaded 22955 existing records from primary storage. [2025-10-15T22:32:59.629138] [INFO ] [MAIN ] ACA: Loaded 22955 primary data records. [2025-10-15T22:32:59.813170] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-10-15T22:32:59.958511] [INFO ] [MAIN ] ABT: Loaded 53621 primary data records. [2025-10-15T22:33:00.561113] [DEBUG] [MAIN ] ABR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:00.560968] [DEBUG] [MAIN ] ACA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:00.562158] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 22955 primary records. [2025-10-15T22:33:00.562940] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-15T22:33:00.562782] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51966 primary records. [2025-10-15T22:33:00.563828] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-15T22:33:00.590417] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-15T22:33:00.590600] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-15T22:33:00.596027] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-10-15T22:33:00.598521] [INFO ] [MAIN ] Derivative Progress: 7/1803 symbols completed. ABR took 1.2s. Estimated remaining: 14m 42s. Rate: 122.2 symbols/min [2025-10-15T22:33:00.598740] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-15T22:33:00.598857] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:00.600810] [INFO ] [MAIN ] Derivative Progress: 8/1803 symbols completed. ACA took 1.1s. Estimated remaining: 12m 52s. Rate: 139.6 symbols/min [2025-10-15T22:33:00.613916] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:00.614972] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:00.615724] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53621 primary records. [2025-10-15T22:33:00.615896] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-15T22:33:00.632722] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-10-15T22:33:00.632867] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-15T22:33:00.635571] [INFO ] [MAIN ] Derivative Progress: 9/1803 symbols completed. ABT took 1.2s. Estimated remaining: 11m 33s. Rate: 155.4 symbols/min [2025-10-15T22:33:00.635771] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:00.674273] [DEBUG] [LOCAL ] ACEL: Loaded 26736 existing records from primary storage. [2025-10-15T22:33:00.675321] [INFO ] [MAIN ] ACEL: Loaded 26736 primary data records. [2025-10-15T22:33:00.687701] [DEBUG] [LOCAL ] ACCO: Loaded 37070 existing records from primary storage. [2025-10-15T22:33:00.707438] [INFO ] [MAIN ] ACCO: Loaded 37070 primary data records. [2025-10-15T22:33:01.143587] [DEBUG] [LOCAL ] ACI: Loaded 53282 existing records from primary storage. [2025-10-15T22:33:01.181542] [INFO ] [MAIN ] ACI: Loaded 53282 primary data records. [2025-10-15T22:33:01.717978] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:01.720115] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 26736 primary records. [2025-10-15T22:33:01.722570] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-15T22:33:01.750201] [DEBUG] [MAIN ] ACCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:01.756586] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-10-15T22:33:01.755237] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37070 primary records. [2025-10-15T22:33:01.756973] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-15T22:33:01.757183] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-15T22:33:01.759266] [INFO ] [MAIN ] Derivative Progress: 10/1803 symbols completed. ACEL took 1.1s. Estimated remaining: 13m 44s. Rate: 130.5 symbols/min [2025-10-15T22:33:01.761027] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:01.789170] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-10-15T22:33:01.789543] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-15T22:33:01.799985] [INFO ] [MAIN ] Derivative Progress: 11/1803 symbols completed. ACCO took 1.2s. Estimated remaining: 12m 36s. Rate: 142.3 symbols/min [2025-10-15T22:33:01.805545] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:01.806437] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:01.807936] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53282 primary records. [2025-10-15T22:33:01.808069] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-15T22:33:01.836272] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-15T22:33:01.836424] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-15T22:33:01.839306] [INFO ] [MAIN ] Derivative Progress: 12/1803 symbols completed. ACI took 1.2s. Estimated remaining: 11m 38s. Rate: 153.9 symbols/min [2025-10-15T22:33:01.839766] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:01.857163] [DEBUG] [LOCAL ] ACM: Loaded 42993 existing records from primary storage. [2025-10-15T22:33:01.857426] [INFO ] [MAIN ] ACM: Loaded 42993 primary data records. [2025-10-15T22:33:02.010158] [DEBUG] [LOCAL ] ACP: Loaded 30939 existing records from primary storage. [2025-10-15T22:33:02.010395] [INFO ] [MAIN ] ACP: Loaded 30939 primary data records. [2025-10-15T22:33:02.326458] [DEBUG] [LOCAL ] ACN: Loaded 53439 existing records from primary storage. [2025-10-15T22:33:02.332212] [INFO ] [MAIN ] ACN: Loaded 53439 primary data records. [2025-10-15T22:33:02.851983] [DEBUG] [MAIN ] ACM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:02.854531] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 42993 primary records. [2025-10-15T22:33:02.856201] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-15T22:33:02.885367] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-15T22:33:02.885688] [DEBUG] [MAIN ] ACP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:02.885847] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-15T22:33:02.887851] [INFO ] [MAIN ] Derivative Progress: 13/1803 symbols completed. ACM took 1.1s. Estimated remaining: 13m 9s. Rate: 136.2 symbols/min [2025-10-15T22:33:02.888754] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 30939 primary records. [2025-10-15T22:33:02.888940] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-15T22:33:02.906808] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-15T22:33:02.906991] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-15T22:33:02.909078] [INFO ] [MAIN ] Derivative Progress: 14/1803 symbols completed. ACP took 1.1s. Estimated remaining: 12m 14s. Rate: 146.1 symbols/min [2025-10-15T22:33:02.921677] [DEBUG] [MAIN ] ACN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:02.922236] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53439 primary records. [2025-10-15T22:33:02.922296] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-15T22:33:02.937603] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-10-15T22:33:02.937700] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-15T22:33:02.940728] [INFO ] [MAIN ] Derivative Progress: 15/1803 symbols completed. ACN took 1.1s. Estimated remaining: 11m 29s. Rate: 155.7 symbols/min [2025-10-15T22:33:02.941119] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:02.941170] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:02.941457] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:02.950032] [DEBUG] [LOCAL ] ACR: Loaded 5445 existing records from primary storage. [2025-10-15T22:33:02.950316] [INFO ] [MAIN ] ACR: Loaded 5445 primary data records. [2025-10-15T22:33:03.035178] [DEBUG] [LOCAL ] ACV: Loaded 7659 existing records from primary storage. [2025-10-15T22:33:03.041968] [INFO ] [MAIN ] ACV: Loaded 7659 primary data records. [2025-10-15T22:33:03.198094] [DEBUG] [LOCAL ] ACRE: Loaded 33640 existing records from primary storage. [2025-10-15T22:33:03.244415] [INFO ] [MAIN ] ACRE: Loaded 33640 primary data records. [2025-10-15T22:33:03.950985] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:03.953161] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5445 primary records. [2025-10-15T22:33:03.954470] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-15T22:33:03.952101] [DEBUG] [MAIN ] ACV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:03.955675] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7659 primary records. [2025-10-15T22:33:03.957247] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-15T22:33:03.981427] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-15T22:33:03.990455] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-15T22:33:03.990203] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-10-15T22:33:03.993332] [INFO ] [MAIN ] Derivative Progress: 16/1803 symbols completed. ACR took 1.1s. Estimated remaining: 12m 43s. Rate: 140.5 symbols/min [2025-10-15T22:33:03.993968] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:03.993799] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-15T22:33:03.996529] [INFO ] [MAIN ] Derivative Progress: 17/1803 symbols completed. ACV took 1.1s. Estimated remaining: 11m 58s. Rate: 149.2 symbols/min [2025-10-15T22:33:03.997681] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:04.016605] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:04.017503] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33640 primary records. [2025-10-15T22:33:04.017733] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-15T22:33:04.034173] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-15T22:33:04.034529] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-15T22:33:04.037807] [INFO ] [MAIN ] Derivative Progress: 18/1803 symbols completed. ACRE took 1.1s. Estimated remaining: 11m 22s. Rate: 157.1 symbols/min [2025-10-15T22:33:04.038267] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:04.081943] [DEBUG] [LOCAL ] ADC: Loaded 46389 existing records from primary storage. [2025-10-15T22:33:04.082394] [INFO ] [MAIN ] ADC: Loaded 46389 primary data records. [2025-10-15T22:33:04.212300] [DEBUG] [LOCAL ] ACVA: Loaded 49299 existing records from primary storage. [2025-10-15T22:33:04.216850] [INFO ] [MAIN ] ACVA: Loaded 49299 primary data records. [2025-10-15T22:33:04.546264] [DEBUG] [LOCAL ] ADM: Loaded 53398 existing records from primary storage. [2025-10-15T22:33:04.547366] [INFO ] [MAIN ] ADM: Loaded 53398 primary data records. [2025-10-15T22:33:05.133168] [DEBUG] [MAIN ] ADC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:05.134426] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46389 primary records. [2025-10-15T22:33:05.134684] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-15T22:33:05.153313] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-10-15T22:33:05.153731] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-15T22:33:05.156264] [INFO ] [MAIN ] Derivative Progress: 19/1803 symbols completed. ADC took 1.2s. Estimated remaining: 12m 31s. Rate: 142.6 symbols/min [2025-10-15T22:33:05.156725] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:05.174779] [DEBUG] [MAIN ] ACVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:05.175983] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49299 primary records. [2025-10-15T22:33:05.176297] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-15T22:33:05.195792] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-10-15T22:33:05.196255] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-15T22:33:05.198199] [INFO ] [MAIN ] Derivative Progress: 20/1803 symbols completed. ACVA took 1.2s. Estimated remaining: 11m 56s. Rate: 149.3 symbols/min [2025-10-15T22:33:05.198529] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:05.213551] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:05.214747] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53398 primary records. [2025-10-15T22:33:05.214957] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-15T22:33:05.232221] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-15T22:33:05.232504] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-15T22:33:05.235000] [INFO ] [MAIN ] Derivative Progress: 21/1803 symbols completed. ADM took 1.2s. Estimated remaining: 11m 25s. Rate: 156.1 symbols/min [2025-10-15T22:33:05.245979] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:05.294667] [DEBUG] [LOCAL ] ADNT: Loaded 46787 existing records from primary storage. [2025-10-15T22:33:05.294824] [INFO ] [MAIN ] ADNT: Loaded 46787 primary data records. [2025-10-15T22:33:05.358915] [DEBUG] [LOCAL ] ADX: Loaded 27657 existing records from primary storage. [2025-10-15T22:33:05.379552] [INFO ] [MAIN ] ADX: Loaded 27657 primary data records. [2025-10-15T22:33:05.399603] [DEBUG] [LOCAL ] ADT: Loaded 53443 existing records from primary storage. [2025-10-15T22:33:05.419880] [INFO ] [MAIN ] ADT: Loaded 53443 primary data records. [2025-10-15T22:33:06.308491] [DEBUG] [MAIN ] ADNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:06.317794] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 46787 primary records. [2025-10-15T22:33:06.323680] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-15T22:33:06.325788] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:06.326968] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53443 primary records. [2025-10-15T22:33:06.327224] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-15T22:33:06.355817] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:06.373747] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-10-15T22:33:06.375908] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-15T22:33:06.376166] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-15T22:33:06.376076] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-15T22:33:06.378091] [INFO ] [MAIN ] Derivative Progress: 22/1803 symbols completed. ADNT took 1.2s. Estimated remaining: 12m 26s. Rate: 143.2 symbols/min [2025-10-15T22:33:06.380259] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:06.380338] [INFO ] [MAIN ] Derivative Progress: 23/1803 symbols completed. ADT took 1.2s. Estimated remaining: 11m 53s. Rate: 149.7 symbols/min [2025-10-15T22:33:06.374892] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27657 primary records. [2025-10-15T22:33:06.380633] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-15T22:33:06.380789] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:06.397673] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-15T22:33:06.397880] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-15T22:33:06.400031] [INFO ] [MAIN ] Derivative Progress: 24/1803 symbols completed. ADX took 1.2s. Estimated remaining: 11m 25s. Rate: 155.9 symbols/min [2025-10-15T22:33:06.400273] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:06.479771] [DEBUG] [LOCAL ] AEE: Loaded 50164 existing records from primary storage. [2025-10-15T22:33:06.480461] [DEBUG] [LOCAL ] AEG: Loaded 49572 existing records from primary storage. [2025-10-15T22:33:06.480681] [INFO ] [MAIN ] AEE: Loaded 50164 primary data records. [2025-10-15T22:33:06.480581] [INFO ] [MAIN ] AEG: Loaded 49572 primary data records. [2025-10-15T22:33:06.696548] [DEBUG] [LOCAL ] AEM: Loaded 53478 existing records from primary storage. [2025-10-15T22:33:06.712530] [INFO ] [MAIN ] AEM: Loaded 53478 primary data records. [2025-10-15T22:33:07.459930] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:07.460957] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49572 primary records. [2025-10-15T22:33:07.468738] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-15T22:33:07.474825] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:07.475717] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50164 primary records. [2025-10-15T22:33:07.491400] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-10-15T22:33:07.487260] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-15T22:33:07.491527] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-15T22:33:07.495659] [INFO ] [MAIN ] Derivative Progress: 25/1803 symbols completed. AEG took 1.1s. Estimated remaining: 12m 15s. Rate: 145.1 symbols/min [2025-10-15T22:33:07.496146] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:07.525850] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:07.528366] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53478 primary records. [2025-10-15T22:33:07.528538] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-15T22:33:07.531782] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-15T22:33:07.532473] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-15T22:33:07.534533] [INFO ] [MAIN ] Derivative Progress: 26/1803 symbols completed. AEE took 1.2s. Estimated remaining: 11m 49s. Rate: 150.4 symbols/min [2025-10-15T22:33:07.542202] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:07.551494] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-15T22:33:07.551697] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-15T22:33:07.554924] [INFO ] [MAIN ] Derivative Progress: 27/1803 symbols completed. AEM took 1.2s. Estimated remaining: 11m 24s. Rate: 155.9 symbols/min [2025-10-15T22:33:07.555436] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:07.610206] [DEBUG] [LOCAL ] AER: Loaded 48137 existing records from primary storage. [2025-10-15T22:33:07.610782] [INFO ] [MAIN ] AER: Loaded 48137 primary data records. [2025-10-15T22:33:07.765565] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-15T22:33:07.786954] [INFO ] [MAIN ] AES: Loaded 53669 primary data records. [2025-10-15T22:33:07.871998] [DEBUG] [LOCAL ] AESI: Loaded 49739 existing records from primary storage. [2025-10-15T22:33:07.982192] [INFO ] [MAIN ] AESI: Loaded 49739 primary data records. [2025-10-15T22:33:08.627688] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:08.630012] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48137 primary records. [2025-10-15T22:33:08.630150] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-15T22:33:08.649634] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-15T22:33:08.650095] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-15T22:33:08.652352] [INFO ] [MAIN ] Derivative Progress: 28/1803 symbols completed. AER took 1.2s. Estimated remaining: 12m 8s. Rate: 146.2 symbols/min [2025-10-15T22:33:08.672739] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:08.673498] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53669 primary records. [2025-10-15T22:33:08.673637] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-15T22:33:08.703915] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:08.703626] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-15T22:33:08.704594] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49739 primary records. [2025-10-15T22:33:08.704694] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-15T22:33:08.705272] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-15T22:33:08.708325] [INFO ] [MAIN ] Derivative Progress: 29/1803 symbols completed. AES took 1.2s. Estimated remaining: 11m 46s. Rate: 150.7 symbols/min [2025-10-15T22:33:08.723106] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-15T22:33:08.723169] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-15T22:33:08.725440] [INFO ] [MAIN ] Derivative Progress: 30/1803 symbols completed. AESI took 1.2s. Estimated remaining: 11m 23s. Rate: 155.7 symbols/min [2025-10-15T22:33:08.726013] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:08.726262] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:08.726171] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:08.730919] [DEBUG] [LOCAL ] AFGD: Loaded 1772 existing records from primary storage. [2025-10-15T22:33:08.731727] [INFO ] [MAIN ] AFGD: Loaded 1772 primary data records. [2025-10-15T22:33:08.787288] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-15T22:33:08.807489] [INFO ] [MAIN ] AFGC: Loaded 2561 primary data records. [2025-10-15T22:33:09.025760] [DEBUG] [LOCAL ] AFG: Loaded 32218 existing records from primary storage. [2025-10-15T22:33:09.132217] [INFO ] [MAIN ] AFG: Loaded 32218 primary data records. [2025-10-15T22:33:09.706310] [DEBUG] [MAIN ] AFGD: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-15T22:33:09.707573] [INFO ] [MAIN ] AFGD: Generated 1791 derivative records from 1772 primary records. [2025-10-15T22:33:09.719717] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-15T22:33:09.720784] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:33:09.721682] [INFO ] [MAIN ] AFGC: Generated 1793 derivative records from 2561 primary records. [2025-10-15T22:33:09.732081] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-15T22:33:09.736084] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1791 records). [2025-10-15T22:33:09.736518] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-15T22:33:09.738561] [INFO ] [MAIN ] Derivative Progress: 31/1803 symbols completed. AFGD took 1.0s. Estimated remaining: 11m 59s. Rate: 147.9 symbols/min [2025-10-15T22:33:09.745228] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:09.752556] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1793 records). [2025-10-15T22:33:09.752684] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-15T22:33:09.755326] [INFO ] [MAIN ] Derivative Progress: 32/1803 symbols completed. AFGC took 1.0s. Estimated remaining: 11m 37s. Rate: 152.5 symbols/min [2025-10-15T22:33:09.755673] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:09.760216] [DEBUG] [LOCAL ] AFGE: Loaded 2374 existing records from primary storage. [2025-10-15T22:33:09.760571] [INFO ] [MAIN ] AFGE: Loaded 2374 primary data records. [2025-10-15T22:33:09.907836] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:09.956978] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32218 primary records. [2025-10-15T22:33:09.959219] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-15T22:33:10.107919] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-15T22:33:10.108373] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-15T22:33:10.110621] [INFO ] [MAIN ] Derivative Progress: 33/1803 symbols completed. AFG took 1.4s. Estimated remaining: 11m 35s. Rate: 152.9 symbols/min [2025-10-15T22:33:10.110991] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:10.133674] [DEBUG] [LOCAL ] AFL: Loaded 53190 existing records from primary storage. [2025-10-15T22:33:10.134063] [INFO ] [MAIN ] AFL: Loaded 53190 primary data records. [2025-10-15T22:33:10.286081] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:10.336514] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2374 primary records. [2025-10-15T22:33:10.337198] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-15T22:33:10.469680] [DEBUG] [LOCAL ] AGCO: Loaded 42395 existing records from primary storage. [2025-10-15T22:33:10.469999] [INFO ] [MAIN ] AGCO: Loaded 42395 primary data records. [2025-10-15T22:33:10.531685] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-10-15T22:33:10.558167] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-15T22:33:10.578357] [INFO ] [MAIN ] Derivative Progress: 34/1803 symbols completed. AFGE took 0.8s. Estimated remaining: 11m 38s. Rate: 152.0 symbols/min [2025-10-15T22:33:10.591396] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:10.806032] [DEBUG] [LOCAL ] AGD: Loaded 19317 existing records from primary storage. [2025-10-15T22:33:10.806535] [INFO ] [MAIN ] AGD: Loaded 19317 primary data records. [2025-10-15T22:33:10.953618] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:10.981078] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53190 primary records. [2025-10-15T22:33:10.981292] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-15T22:33:11.182671] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-15T22:33:11.182942] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-15T22:33:11.185853] [INFO ] [MAIN ] Derivative Progress: 35/1803 symbols completed. AFL took 1.4s. Estimated remaining: 11m 48s. Rate: 149.7 symbols/min [2025-10-15T22:33:11.186040] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:11.201715] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:11.203554] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42395 primary records. [2025-10-15T22:33:11.204050] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-15T22:33:11.221665] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-15T22:33:11.222278] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-15T22:33:11.224370] [INFO ] [MAIN ] Derivative Progress: 36/1803 symbols completed. AGCO took 1.1s. Estimated remaining: 11m 30s. Rate: 153.6 symbols/min [2025-10-15T22:33:11.224632] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:11.258964] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:11.259786] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 19317 primary records. [2025-10-15T22:33:11.259915] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-15T22:33:11.276092] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-15T22:33:11.276298] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-15T22:33:11.291428] [INFO ] [MAIN ] Derivative Progress: 37/1803 symbols completed. AGD took 0.7s. Estimated remaining: 11m 14s. Rate: 157.1 symbols/min [2025-10-15T22:33:11.294947] [DEBUG] [LOCAL ] AGI: Loaded 53424 existing records from primary storage. [2025-10-15T22:33:11.295174] [INFO ] [MAIN ] AGI: Loaded 53424 primary data records. [2025-10-15T22:33:11.295066] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:11.440694] [DEBUG] [LOCAL ] AGM: Loaded 10719 existing records from primary storage. [2025-10-15T22:33:11.441528] [DEBUG] [LOCAL ] AGL: Loaded 52580 existing records from primary storage. [2025-10-15T22:33:11.462666] [INFO ] [MAIN ] AGL: Loaded 52580 primary data records. [2025-10-15T22:33:11.457486] [INFO ] [MAIN ] AGM: Loaded 10719 primary data records. [2025-10-15T22:33:12.273687] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:12.274809] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53424 primary records. [2025-10-15T22:33:12.275168] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-15T22:33:12.293678] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-15T22:33:12.295426] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-15T22:33:12.297479] [INFO ] [MAIN ] Derivative Progress: 38/1803 symbols completed. AGI took 1.1s. Estimated remaining: 11m 43s. Rate: 150.6 symbols/min [2025-10-15T22:33:12.297719] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:12.314359] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:12.327283] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52580 primary records. [2025-10-15T22:33:12.327934] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:12.327676] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-15T22:33:12.329054] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10719 primary records. [2025-10-15T22:33:12.329554] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-15T22:33:12.344920] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-15T22:33:12.345083] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-15T22:33:12.347117] [INFO ] [MAIN ] Derivative Progress: 39/1803 symbols completed. AGL took 1.1s. Estimated remaining: 11m 27s. Rate: 154.1 symbols/min [2025-10-15T22:33:12.347519] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:12.372123] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-15T22:33:12.372400] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-15T22:33:12.374981] [INFO ] [MAIN ] Derivative Progress: 40/1803 symbols completed. AGM took 1.1s. Estimated remaining: 11m 11s. Rate: 157.8 symbols/min [2025-10-15T22:33:12.375182] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:12.385800] [DEBUG] [LOCAL ] AGO: Loaded 27929 existing records from primary storage. [2025-10-15T22:33:12.386084] [INFO ] [MAIN ] AGO: Loaded 27929 primary data records. [2025-10-15T22:33:12.536822] [DEBUG] [LOCAL ] AGRO: Loaded 33087 existing records from primary storage. [2025-10-15T22:33:12.591475] [INFO ] [MAIN ] AGRO: Loaded 33087 primary data records. [2025-10-15T22:33:12.833022] [DEBUG] [LOCAL ] AGX: Loaded 32884 existing records from primary storage. [2025-10-15T22:33:12.837410] [INFO ] [MAIN ] AGX: Loaded 32884 primary data records. [2025-10-15T22:33:13.386005] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:13.389804] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27929 primary records. [2025-10-15T22:33:13.390018] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-15T22:33:13.407566] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-10-15T22:33:13.407687] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-15T22:33:13.409775] [INFO ] [MAIN ] Derivative Progress: 41/1803 symbols completed. AGO took 1.1s. Estimated remaining: 11m 38s. Rate: 151.4 symbols/min [2025-10-15T22:33:13.410316] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:13.428531] [DEBUG] [MAIN ] AGRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:13.429346] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33087 primary records. [2025-10-15T22:33:13.429544] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-15T22:33:13.447471] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-15T22:33:13.448044] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-15T22:33:13.450113] [INFO ] [MAIN ] Derivative Progress: 42/1803 symbols completed. AGRO took 1.1s. Estimated remaining: 11m 23s. Rate: 154.7 symbols/min [2025-10-15T22:33:13.462299] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:13.463257] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:33:13.463935] [INFO ] [MAIN ] AGX: Generated 1793 derivative records from 32884 primary records. [2025-10-15T22:33:13.464197] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-15T22:33:13.490053] [DEBUG] [LOCAL ] AGX: Derivative data saved (1793 records). [2025-10-15T22:33:13.490329] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-15T22:33:13.504528] [INFO ] [MAIN ] Derivative Progress: 43/1803 symbols completed. AGX took 1.1s. Estimated remaining: 11m 9s. Rate: 157.9 symbols/min [2025-10-15T22:33:13.506157] [DEBUG] [LOCAL ] AHH: Loaded 40527 existing records from primary storage. [2025-10-15T22:33:13.506256] [INFO ] [MAIN ] AHH: Loaded 40527 primary data records. [2025-10-15T22:33:13.706256] [DEBUG] [LOCAL ] AHR: Loaded 49077 existing records from primary storage. [2025-10-15T22:33:13.809019] [INFO ] [MAIN ] AHR: Loaded 49077 primary data records. [2025-10-15T22:33:14.151587] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:14.152370] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40527 primary records. [2025-10-15T22:33:14.152869] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-15T22:33:14.169165] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-15T22:33:14.169372] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-15T22:33:14.171435] [INFO ] [MAIN ] Derivative Progress: 44/1803 symbols completed. AHH took 0.8s. Estimated remaining: 11m 20s. Rate: 155.2 symbols/min [2025-10-15T22:33:14.189051] [DEBUG] [MAIN ] AHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:14.189639] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49077 primary records. [2025-10-15T22:33:14.189724] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-15T22:33:14.204338] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-15T22:33:14.204394] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-15T22:33:14.206338] [INFO ] [MAIN ] Derivative Progress: 45/1803 symbols completed. AHR took 0.7s. Estimated remaining: 11m 6s. Rate: 158.4 symbols/min [2025-10-15T22:33:14.206769] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:14.206857] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:14.207132] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:14.215189] [DEBUG] [LOCAL ] AHT: Loaded 6362 existing records from primary storage. [2025-10-15T22:33:14.215377] [INFO ] [MAIN ] AHT: Loaded 6362 primary data records. [2025-10-15T22:33:14.585237] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-15T22:33:14.585418] [INFO ] [MAIN ] AI: Loaded 53765 primary data records. [2025-10-15T22:33:14.606596] [DEBUG] [LOCAL ] AIG: Loaded 53470 existing records from primary storage. [2025-10-15T22:33:14.642786] [INFO ] [MAIN ] AIG: Loaded 53470 primary data records. [2025-10-15T22:33:15.236957] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:15.245355] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6362 primary records. [2025-10-15T22:33:15.245932] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-15T22:33:15.262919] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-15T22:33:15.263206] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-15T22:33:15.266047] [INFO ] [MAIN ] Derivative Progress: 46/1803 symbols completed. AHT took 1.1s. Estimated remaining: 11m 32s. Rate: 152.4 symbols/min [2025-10-15T22:33:15.266359] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:15.304510] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:15.307033] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53765 primary records. [2025-10-15T22:33:15.306216] [DEBUG] [LOCAL ] AIN: Loaded 24434 existing records from primary storage. [2025-10-15T22:33:15.307373] [INFO ] [MAIN ] AIN: Loaded 24434 primary data records. [2025-10-15T22:33:15.307659] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-15T22:33:15.356776] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:15.398210] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53470 primary records. [2025-10-15T22:33:15.420848] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-15T22:33:15.427757] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-15T22:33:15.446629] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-15T22:33:15.454389] [INFO ] [MAIN ] Derivative Progress: 47/1803 symbols completed. AI took 1.2s. Estimated remaining: 11m 23s. Rate: 154.2 symbols/min [2025-10-15T22:33:15.496189] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-15T22:33:15.473563] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:15.505624] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-15T22:33:15.651782] [INFO ] [MAIN ] Derivative Progress: 48/1803 symbols completed. AIG took 1.4s. Estimated remaining: 11m 16s. Rate: 155.8 symbols/min [2025-10-15T22:33:15.652149] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:15.663727] [DEBUG] [LOCAL ] AIO: Loaded 13371 existing records from primary storage. [2025-10-15T22:33:15.665228] [INFO ] [MAIN ] AIO: Loaded 13371 primary data records. [2025-10-15T22:33:15.804365] [DEBUG] [LOCAL ] AIR: Loaded 28874 existing records from primary storage. [2025-10-15T22:33:15.815075] [INFO ] [MAIN ] AIR: Loaded 28874 primary data records. [2025-10-15T22:33:16.175337] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:16.298980] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24434 primary records. [2025-10-15T22:33:16.299379] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-15T22:33:16.316983] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-15T22:33:16.317204] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-15T22:33:16.320860] [INFO ] [MAIN ] Derivative Progress: 49/1803 symbols completed. AIN took 1.1s. Estimated remaining: 11m 26s. Rate: 153.4 symbols/min [2025-10-15T22:33:16.321879] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:16.340549] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:16.341304] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13371 primary records. [2025-10-15T22:33:16.341514] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-15T22:33:16.364923] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-15T22:33:16.365269] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-15T22:33:16.367385] [INFO ] [MAIN ] Derivative Progress: 50/1803 symbols completed. AIO took 0.9s. Estimated remaining: 11m 13s. Rate: 156.2 symbols/min [2025-10-15T22:33:16.367603] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:16.382278] [DEBUG] [LOCAL ] AIT: Loaded 26971 existing records from primary storage. [2025-10-15T22:33:16.382755] [INFO ] [MAIN ] AIT: Loaded 26971 primary data records. [2025-10-15T22:33:16.451900] [DEBUG] [MAIN ] AIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:16.478980] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 28874 primary records. [2025-10-15T22:33:16.500269] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-15T22:33:16.573887] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-10-15T22:33:16.731611] [DEBUG] [LOCAL ] AIV: Loaded 41436 existing records from primary storage. [2025-10-15T22:33:16.732095] [INFO ] [MAIN ] AIV: Loaded 41436 primary data records. [2025-10-15T22:33:16.731931] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-15T22:33:16.734288] [INFO ] [MAIN ] Derivative Progress: 51/1803 symbols completed. AIR took 1.1s. Estimated remaining: 11m 12s. Rate: 156.3 symbols/min [2025-10-15T22:33:16.734598] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:17.095499] [DEBUG] [LOCAL ] AIZ: Loaded 29532 existing records from primary storage. [2025-10-15T22:33:17.095879] [INFO ] [MAIN ] AIZ: Loaded 29532 primary data records. [2025-10-15T22:33:17.217787] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:17.235065] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 26971 primary records. [2025-10-15T22:33:17.258668] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-15T22:33:17.431745] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-15T22:33:17.432823] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-15T22:33:17.435241] [INFO ] [MAIN ] Derivative Progress: 52/1803 symbols completed. AIT took 1.1s. Estimated remaining: 11m 23s. Rate: 153.9 symbols/min [2025-10-15T22:33:17.435876] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:17.443922] [DEBUG] [LOCAL ] AIZN: Loaded 3961 existing records from primary storage. [2025-10-15T22:33:17.445063] [INFO ] [MAIN ] AIZN: Loaded 3961 primary data records. [2025-10-15T22:33:17.544801] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:17.565838] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 41436 primary records. [2025-10-15T22:33:17.573296] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-15T22:33:17.653721] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-15T22:33:17.668609] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-15T22:33:17.677129] [INFO ] [MAIN ] Derivative Progress: 53/1803 symbols completed. AIV took 1.3s. Estimated remaining: 11m 17s. Rate: 155.0 symbols/min [2025-10-15T22:33:17.789113] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:17.803569] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:17.804534] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29532 primary records. [2025-10-15T22:33:17.804695] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-15T22:33:17.824069] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-15T22:33:17.824341] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-15T22:33:17.826521] [INFO ] [MAIN ] Derivative Progress: 54/1803 symbols completed. AIZ took 1.1s. Estimated remaining: 11m 9s. Rate: 156.8 symbols/min [2025-10-15T22:33:17.826812] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:17.865539] [DEBUG] [MAIN ] AIZN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:17.879432] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3961 primary records. [2025-10-15T22:33:17.879677] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-15T22:33:17.881041] [DEBUG] [LOCAL ] AJG: Loaded 46536 existing records from primary storage. [2025-10-15T22:33:17.887560] [INFO ] [MAIN ] AJG: Loaded 46536 primary data records. [2025-10-15T22:33:18.028146] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-15T22:33:18.063565] [DEBUG] [LOCAL ] AKR: Loaded 46096 existing records from primary storage. [2025-10-15T22:33:18.100616] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-15T22:33:18.202568] [INFO ] [MAIN ] Derivative Progress: 55/1803 symbols completed. AIZN took 0.8s. Estimated remaining: 11m 9s. Rate: 156.8 symbols/min [2025-10-15T22:33:18.199934] [INFO ] [MAIN ] AKR: Loaded 46096 primary data records. [2025-10-15T22:33:18.202959] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:18.547851] [DEBUG] [LOCAL ] AL: Loaded 44699 existing records from primary storage. [2025-10-15T22:33:18.548242] [INFO ] [MAIN ] AL: Loaded 44699 primary data records. [2025-10-15T22:33:18.746512] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:18.904284] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46536 primary records. [2025-10-15T22:33:18.912335] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-15T22:33:18.936403] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-15T22:33:18.937469] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-15T22:33:18.940344] [INFO ] [MAIN ] Derivative Progress: 56/1803 symbols completed. AJG took 1.2s. Estimated remaining: 11m 19s. Rate: 154.3 symbols/min [2025-10-15T22:33:18.940804] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:18.968114] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:18.969201] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 46096 primary records. [2025-10-15T22:33:18.969384] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-15T22:33:18.989141] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-15T22:33:18.989545] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-15T22:33:18.991812] [INFO ] [MAIN ] Derivative Progress: 57/1803 symbols completed. AKR took 1.2s. Estimated remaining: 11m 9s. Rate: 156.7 symbols/min [2025-10-15T22:33:18.992105] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:19.019586] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:19.020471] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44699 primary records. [2025-10-15T22:33:19.020585] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-15T22:33:19.037507] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-15T22:33:19.037685] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-15T22:33:19.040152] [INFO ] [MAIN ] Derivative Progress: 58/1803 symbols completed. AL took 0.8s. Estimated remaining: 10m 58s. Rate: 159.1 symbols/min [2025-10-15T22:33:19.060129] [DEBUG] [LOCAL ] ALB: Loaded 53343 existing records from primary storage. [2025-10-15T22:33:19.060339] [INFO ] [MAIN ] ALB: Loaded 53343 primary data records. [2025-10-15T22:33:19.372336] [DEBUG] [LOCAL ] ALC: Loaded 51181 existing records from primary storage. [2025-10-15T22:33:19.380612] [INFO ] [MAIN ] ALC: Loaded 51181 primary data records. [2025-10-15T22:33:19.735356] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:19.736991] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53343 primary records. [2025-10-15T22:33:19.737116] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-15T22:33:19.755854] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-15T22:33:19.756069] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-15T22:33:19.759512] [INFO ] [MAIN ] Derivative Progress: 59/1803 symbols completed. ALB took 0.8s. Estimated remaining: 11m 8s. Rate: 156.6 symbols/min [2025-10-15T22:33:19.777192] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:19.777858] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 51181 primary records. [2025-10-15T22:33:19.777921] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-15T22:33:19.793766] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-15T22:33:19.793830] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-15T22:33:19.796027] [INFO ] [MAIN ] Derivative Progress: 60/1803 symbols completed. ALC took 0.8s. Estimated remaining: 10m 58s. Rate: 159.0 symbols/min [2025-10-15T22:33:19.796507] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:19.796740] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:19.796881] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:19.810617] [DEBUG] [LOCAL ] ALG: Loaded 9756 existing records from primary storage. [2025-10-15T22:33:19.810919] [INFO ] [MAIN ] ALG: Loaded 9756 primary data records. [2025-10-15T22:33:19.963428] [DEBUG] [LOCAL ] ALE: Loaded 31952 existing records from primary storage. [2025-10-15T22:33:19.964063] [DEBUG] [LOCAL ] ALEX: Loaded 31156 existing records from primary storage. [2025-10-15T22:33:19.964500] [INFO ] [MAIN ] ALE: Loaded 31952 primary data records. [2025-10-15T22:33:19.969858] [INFO ] [MAIN ] ALEX: Loaded 31156 primary data records. [2025-10-15T22:33:20.870529] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:20.873222] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9756 primary records. [2025-10-15T22:33:20.873435] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-15T22:33:20.901817] [DEBUG] [MAIN ] ALEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:20.903568] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31156 primary records. [2025-10-15T22:33:20.906512] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-15T22:33:20.909009] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-15T22:33:20.910152] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-15T22:33:20.921319] [INFO ] [MAIN ] Derivative Progress: 61/1803 symbols completed. ALG took 1.1s. Estimated remaining: 11m 19s. Rate: 154.0 symbols/min [2025-10-15T22:33:20.924662] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:20.942990] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-15T22:33:20.943472] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-15T22:33:20.943333] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:20.945684] [INFO ] [MAIN ] Derivative Progress: 62/1803 symbols completed. ALEX took 1.1s. Estimated remaining: 11m 8s. Rate: 156.4 symbols/min [2025-10-15T22:33:20.946751] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 31952 primary records. [2025-10-15T22:33:20.946894] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:20.947035] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-15T22:33:20.964880] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-15T22:33:20.965113] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-15T22:33:20.967460] [INFO ] [MAIN ] Derivative Progress: 63/1803 symbols completed. ALE took 1.2s. Estimated remaining: 10m 58s. Rate: 158.8 symbols/min [2025-10-15T22:33:20.967672] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:21.026693] [DEBUG] [LOCAL ] ALIT: Loaded 52788 existing records from primary storage. [2025-10-15T22:33:21.038344] [INFO ] [MAIN ] ALIT: Loaded 52788 primary data records. [2025-10-15T22:33:21.183722] [DEBUG] [LOCAL ] ALK: Loaded 53081 existing records from primary storage. [2025-10-15T22:33:21.189482] [INFO ] [MAIN ] ALK: Loaded 53081 primary data records. [2025-10-15T22:33:21.200640] [DEBUG] [LOCAL ] ALL: Loaded 49786 existing records from primary storage. [2025-10-15T22:33:21.275198] [INFO ] [MAIN ] ALL: Loaded 49786 primary data records. [2025-10-15T22:33:22.102724] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:22.103599] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52788 primary records. [2025-10-15T22:33:22.103881] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-15T22:33:22.121585] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-15T22:33:22.124064] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-15T22:33:22.126978] [INFO ] [MAIN ] Derivative Progress: 64/1803 symbols completed. ALIT took 1.2s. Estimated remaining: 11m 18s. Rate: 153.8 symbols/min [2025-10-15T22:33:22.128047] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:22.144019] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:22.144873] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53081 primary records. [2025-10-15T22:33:22.158329] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:22.157946] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-15T22:33:22.159154] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49786 primary records. [2025-10-15T22:33:22.159317] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-15T22:33:22.190614] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-15T22:33:22.191612] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-15T22:33:22.192097] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-15T22:33:22.195846] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-15T22:33:22.195501] [INFO ] [MAIN ] Derivative Progress: 65/1803 symbols completed. ALL took 1.2s. Estimated remaining: 11m 9s. Rate: 155.8 symbols/min [2025-10-15T22:33:22.198396] [INFO ] [MAIN ] Derivative Progress: 66/1803 symbols completed. ALK took 1.3s. Estimated remaining: 10m 59s. Rate: 158.2 symbols/min [2025-10-15T22:33:22.198326] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:22.198741] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:22.252719] [DEBUG] [LOCAL ] ALLE: Loaded 44203 existing records from primary storage. [2025-10-15T22:33:22.252973] [INFO ] [MAIN ] ALLE: Loaded 44203 primary data records. [2025-10-15T22:33:22.386523] [DEBUG] [LOCAL ] ALSN: Loaded 43474 existing records from primary storage. [2025-10-15T22:33:22.387508] [INFO ] [MAIN ] ALSN: Loaded 43474 primary data records. [2025-10-15T22:33:22.505712] [DEBUG] [LOCAL ] ALLY: Loaded 53221 existing records from primary storage. [2025-10-15T22:33:22.514817] [INFO ] [MAIN ] ALLY: Loaded 53221 primary data records. [2025-10-15T22:33:23.303061] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:23.304174] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44203 primary records. [2025-10-15T22:33:23.304378] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-15T22:33:23.333887] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-15T22:33:23.351740] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-15T22:33:23.352288] [DEBUG] [MAIN ] ALSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:23.354431] [INFO ] [MAIN ] Derivative Progress: 67/1803 symbols completed. ALLE took 1.2s. Estimated remaining: 11m 19s. Rate: 153.5 symbols/min [2025-10-15T22:33:23.354888] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:23.355695] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43474 primary records. [2025-10-15T22:33:23.355861] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:23.356929] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53221 primary records. [2025-10-15T22:33:23.356019] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-15T22:33:23.357309] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-15T22:33:23.397936] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-15T22:33:23.399920] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-15T22:33:23.399987] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-15T22:33:23.400679] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-15T22:33:23.403271] [INFO ] [MAIN ] Derivative Progress: 68/1803 symbols completed. ALLY took 1.2s. Estimated remaining: 11m 10s. Rate: 155.5 symbols/min [2025-10-15T22:33:23.412973] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:23.413183] [INFO ] [MAIN ] Derivative Progress: 69/1803 symbols completed. ALSN took 1.2s. Estimated remaining: 10m 60s. Rate: 157.7 symbols/min [2025-10-15T22:33:23.413377] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:23.413756] [DEBUG] [LOCAL ] ALTG: Loaded 23330 existing records from primary storage. [2025-10-15T22:33:23.414751] [INFO ] [MAIN ] ALTG: Loaded 23330 primary data records. [2025-10-15T22:33:23.507753] [DEBUG] [LOCAL ] ALUR: Loaded 9544 existing records from primary storage. [2025-10-15T22:33:23.529873] [INFO ] [MAIN ] ALUR: Loaded 9544 primary data records. [2025-10-15T22:33:23.878327] [DEBUG] [LOCAL ] ALV: Loaded 42121 existing records from primary storage. [2025-10-15T22:33:23.889300] [INFO ] [MAIN ] ALV: Loaded 42121 primary data records. [2025-10-15T22:33:24.397111] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:24.398484] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23330 primary records. [2025-10-15T22:33:24.398958] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-15T22:33:24.415865] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-15T22:33:24.417279] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-15T22:33:24.420231] [INFO ] [MAIN ] Derivative Progress: 70/1803 symbols completed. ALTG took 1.1s. Estimated remaining: 11m 15s. Rate: 154.1 symbols/min [2025-10-15T22:33:24.421389] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:24.436788] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:24.440020] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 9544 primary records. [2025-10-15T22:33:24.440121] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-15T22:33:24.457438] [DEBUG] [LOCAL ] ALX: Loaded 6965 existing records from primary storage. [2025-10-15T22:33:24.457914] [INFO ] [MAIN ] ALX: Loaded 6965 primary data records. [2025-10-15T22:33:24.480599] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-15T22:33:24.517436] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-15T22:33:24.532330] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:24.533085] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42121 primary records. [2025-10-15T22:33:24.553903] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-15T22:33:24.532090] [INFO ] [MAIN ] Derivative Progress: 71/1803 symbols completed. ALUR took 1.1s. Estimated remaining: 11m 8s. Rate: 155.6 symbols/min [2025-10-15T22:33:24.581499] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:24.788684] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-15T22:33:24.789029] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-15T22:33:24.791597] [INFO ] [MAIN ] Derivative Progress: 72/1803 symbols completed. ALV took 1.4s. Estimated remaining: 11m 4s. Rate: 156.4 symbols/min [2025-10-15T22:33:24.792439] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:24.830333] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:24.831225] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6965 primary records. [2025-10-15T22:33:24.838752] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-15T22:33:24.853751] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-15T22:33:24.853872] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-15T22:33:24.856050] [INFO ] [MAIN ] Derivative Progress: 73/1803 symbols completed. ALX took 0.4s. Estimated remaining: 10m 56s. Rate: 158.2 symbols/min [2025-10-15T22:33:24.884076] [DEBUG] [LOCAL ] AM: Loaded 51939 existing records from primary storage. [2025-10-15T22:33:24.884239] [INFO ] [MAIN ] AM: Loaded 51939 primary data records. [2025-10-15T22:33:24.917212] [DEBUG] [LOCAL ] AMBC: Loaded 36270 existing records from primary storage. [2025-10-15T22:33:24.956017] [INFO ] [MAIN ] AMBC: Loaded 36270 primary data records. [2025-10-15T22:33:25.535912] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:25.536624] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 51939 primary records. [2025-10-15T22:33:25.536817] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-15T22:33:25.553836] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-15T22:33:25.554695] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-15T22:33:25.557279] [INFO ] [MAIN ] Derivative Progress: 74/1803 symbols completed. AM took 1.0s. Estimated remaining: 11m 3s. Rate: 156.4 symbols/min [2025-10-15T22:33:25.570481] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:25.571052] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36270 primary records. [2025-10-15T22:33:25.571112] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-15T22:33:25.585658] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-15T22:33:25.585727] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-15T22:33:25.588201] [INFO ] [MAIN ] Derivative Progress: 75/1803 symbols completed. AMBC took 0.8s. Estimated remaining: 10m 55s. Rate: 158.3 symbols/min [2025-10-15T22:33:25.588688] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:25.588614] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:25.588793] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:25.655937] [DEBUG] [LOCAL ] AMBP: Loaded 44639 existing records from primary storage. [2025-10-15T22:33:25.656092] [INFO ] [MAIN ] AMBP: Loaded 44639 primary data records. [2025-10-15T22:33:25.746050] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-15T22:33:25.786675] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-15T22:33:25.793302] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-15T22:33:25.818334] [INFO ] [MAIN ] AMC: Loaded 53762 primary data records. [2025-10-15T22:33:26.622845] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:26.627954] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:26.629126] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44639 primary records. [2025-10-15T22:33:26.629312] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-15T22:33:26.630170] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-15T22:33:26.630899] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-15T22:33:26.663972] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-15T22:33:26.672283] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-15T22:33:26.681025] [INFO ] [MAIN ] Derivative Progress: 76/1803 symbols completed. AMCR took 1.1s. Estimated remaining: 11m 11s. Rate: 154.5 symbols/min [2025-10-15T22:33:26.681414] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:26.682212] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53762 primary records. [2025-10-15T22:33:26.682345] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:26.682471] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-15T22:33:26.673038] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-15T22:33:26.683733] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-15T22:33:26.685398] [INFO ] [MAIN ] Derivative Progress: 77/1803 symbols completed. AMBP took 1.1s. Estimated remaining: 11m 2s. Rate: 156.5 symbols/min [2025-10-15T22:33:26.685905] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:26.702250] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-15T22:33:26.702436] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-15T22:33:26.704885] [INFO ] [MAIN ] Derivative Progress: 78/1803 symbols completed. AMC took 1.1s. Estimated remaining: 10m 53s. Rate: 158.4 symbols/min [2025-10-15T22:33:26.705143] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:26.722523] [DEBUG] [LOCAL ] AMG: Loaded 20143 existing records from primary storage. [2025-10-15T22:33:26.733560] [INFO ] [MAIN ] AMG: Loaded 20143 primary data records. [2025-10-15T22:33:26.848794] [DEBUG] [LOCAL ] AME: Loaded 48691 existing records from primary storage. [2025-10-15T22:33:26.901727] [INFO ] [MAIN ] AME: Loaded 48691 primary data records. [2025-10-15T22:33:27.152205] [DEBUG] [LOCAL ] AMH: Loaded 51831 existing records from primary storage. [2025-10-15T22:33:27.171171] [INFO ] [MAIN ] AMH: Loaded 51831 primary data records. [2025-10-15T22:33:27.725189] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:27.726138] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20143 primary records. [2025-10-15T22:33:27.726348] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-15T22:33:27.746585] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-15T22:33:27.746775] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-15T22:33:27.748597] [INFO ] [MAIN ] Derivative Progress: 79/1803 symbols completed. AMG took 1.1s. Estimated remaining: 11m 7s. Rate: 155.0 symbols/min [2025-10-15T22:33:27.749234] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:27.768395] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:27.769365] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48691 primary records. [2025-10-15T22:33:27.769627] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-15T22:33:27.797630] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:27.802769] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-15T22:33:27.801613] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51831 primary records. [2025-10-15T22:33:27.803000] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-15T22:33:27.803062] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-15T22:33:27.805873] [INFO ] [MAIN ] Derivative Progress: 80/1803 symbols completed. AME took 1.1s. Estimated remaining: 11m 0s. Rate: 156.6 symbols/min [2025-10-15T22:33:27.806931] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:27.833364] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-15T22:33:27.833494] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-15T22:33:27.836156] [INFO ] [MAIN ] Derivative Progress: 81/1803 symbols completed. AMH took 1.1s. Estimated remaining: 10m 52s. Rate: 158.4 symbols/min [2025-10-15T22:33:27.836463] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:27.858764] [DEBUG] [LOCAL ] AMN: Loaded 41839 existing records from primary storage. [2025-10-15T22:33:27.858959] [INFO ] [MAIN ] AMN: Loaded 41839 primary data records. [2025-10-15T22:33:27.970612] [DEBUG] [LOCAL ] AMP: Loaded 32020 existing records from primary storage. [2025-10-15T22:33:27.976434] [INFO ] [MAIN ] AMP: Loaded 32020 primary data records. [2025-10-15T22:33:28.311594] [DEBUG] [LOCAL ] AMPX: Loaded 52338 existing records from primary storage. [2025-10-15T22:33:28.357914] [INFO ] [MAIN ] AMPX: Loaded 52338 primary data records. [2025-10-15T22:33:28.828552] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:28.829869] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41839 primary records. [2025-10-15T22:33:28.830481] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-15T22:33:28.847668] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-15T22:33:28.847850] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-15T22:33:28.850081] [INFO ] [MAIN ] Derivative Progress: 82/1803 symbols completed. AMN took 1.1s. Estimated remaining: 11m 5s. Rate: 155.3 symbols/min [2025-10-15T22:33:28.850696] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:28.869065] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:33:28.870480] [INFO ] [MAIN ] AMP: Generated 1793 derivative records from 32020 primary records. [2025-10-15T22:33:28.871036] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-15T22:33:28.902231] [DEBUG] [LOCAL ] AMP: Derivative data saved (1793 records). [2025-10-15T22:33:28.912118] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-15T22:33:28.914301] [INFO ] [MAIN ] Derivative Progress: 83/1803 symbols completed. AMP took 1.1s. Estimated remaining: 10m 58s. Rate: 156.8 symbols/min [2025-10-15T22:33:28.912065] [DEBUG] [MAIN ] AMPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:28.915528] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:28.915402] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52338 primary records. [2025-10-15T22:33:28.915758] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-15T22:33:28.943910] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-15T22:33:28.944146] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-15T22:33:28.946582] [INFO ] [MAIN ] Derivative Progress: 84/1803 symbols completed. AMPX took 1.1s. Estimated remaining: 10m 50s. Rate: 158.6 symbols/min [2025-10-15T22:33:28.946795] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:28.947989] [DEBUG] [LOCAL ] AMPY: Loaded 39159 existing records from primary storage. [2025-10-15T22:33:28.948211] [INFO ] [MAIN ] AMPY: Loaded 39159 primary data records. [2025-10-15T22:33:29.118579] [DEBUG] [LOCAL ] AMR: Loaded 28956 existing records from primary storage. [2025-10-15T22:33:29.130998] [INFO ] [MAIN ] AMR: Loaded 28956 primary data records. [2025-10-15T22:33:29.360830] [DEBUG] [LOCAL ] AMRC: Loaded 38459 existing records from primary storage. [2025-10-15T22:33:29.382578] [INFO ] [MAIN ] AMRC: Loaded 38459 primary data records. [2025-10-15T22:33:29.951939] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:29.954209] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 39159 primary records. [2025-10-15T22:33:29.954530] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-15T22:33:29.974367] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-15T22:33:29.975240] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-15T22:33:29.977591] [INFO ] [MAIN ] Derivative Progress: 85/1803 symbols completed. AMPY took 1.1s. Estimated remaining: 11m 3s. Rate: 155.4 symbols/min [2025-10-15T22:33:29.978123] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:29.992205] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:29.992952] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38459 primary records. [2025-10-15T22:33:29.993082] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-15T22:33:30.012597] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-15T22:33:30.012865] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-15T22:33:30.015336] [INFO ] [MAIN ] Derivative Progress: 86/1803 symbols completed. AMRC took 1.1s. Estimated remaining: 10m 56s. Rate: 157.1 symbols/min [2025-10-15T22:33:30.028147] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:30.029044] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:30.029881] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28956 primary records. [2025-10-15T22:33:30.029951] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-15T22:33:30.047096] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-15T22:33:30.047328] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-15T22:33:30.050345] [INFO ] [MAIN ] Derivative Progress: 87/1803 symbols completed. AMR took 1.1s. Estimated remaining: 10m 49s. Rate: 158.7 symbols/min [2025-10-15T22:33:30.050724] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:30.074462] [DEBUG] [LOCAL ] AMTD: Loaded 3789 existing records from primary storage. [2025-10-15T22:33:30.074695] [INFO ] [MAIN ] AMTD: Loaded 3789 primary data records. [2025-10-15T22:33:30.150227] [DEBUG] [LOCAL ] AMTB: Loaded 20526 existing records from primary storage. [2025-10-15T22:33:30.206329] [INFO ] [MAIN ] AMTB: Loaded 20526 primary data records. [2025-10-15T22:33:30.206187] [DEBUG] [LOCAL ] AMT: Loaded 52475 existing records from primary storage. [2025-10-15T22:33:30.212189] [INFO ] [MAIN ] AMT: Loaded 52475 primary data records. [2025-10-15T22:33:31.086622] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:31.087470] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3789 primary records. [2025-10-15T22:33:31.087661] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-15T22:33:31.105680] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-15T22:33:31.117998] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-15T22:33:31.120424] [INFO ] [MAIN ] Derivative Progress: 88/1803 symbols completed. AMTD took 1.1s. Estimated remaining: 11m 2s. Rate: 155.5 symbols/min [2025-10-15T22:33:31.118522] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:31.121435] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20526 primary records. [2025-10-15T22:33:31.121603] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-15T22:33:31.134385] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:31.135156] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52475 primary records. [2025-10-15T22:33:31.135381] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-15T22:33:31.165004] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-15T22:33:31.164797] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-15T22:33:31.165124] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-15T22:33:31.165197] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-15T22:33:31.167351] [INFO ] [MAIN ] Derivative Progress: 89/1803 symbols completed. AMTB took 1.1s. Estimated remaining: 10m 55s. Rate: 157.0 symbols/min [2025-10-15T22:33:31.169942] [INFO ] [MAIN ] Derivative Progress: 90/1803 symbols completed. AMT took 1.2s. Estimated remaining: 10m 47s. Rate: 158.8 symbols/min [2025-10-15T22:33:31.170372] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:31.170541] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:31.170474] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:31.183711] [DEBUG] [LOCAL ] AMWL: Loaded 9542 existing records from primary storage. [2025-10-15T22:33:31.183834] [INFO ] [MAIN ] AMWL: Loaded 9542 primary data records. [2025-10-15T22:33:31.542688] [DEBUG] [LOCAL ] AMTM: Loaded 50564 existing records from primary storage. [2025-10-15T22:33:31.542948] [INFO ] [MAIN ] AMTM: Loaded 50564 primary data records. [2025-10-15T22:33:31.555033] [DEBUG] [LOCAL ] AMX: Loaded 49144 existing records from primary storage. [2025-10-15T22:33:31.555238] [INFO ] [MAIN ] AMX: Loaded 49144 primary data records. [2025-10-15T22:33:32.164717] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:32.165562] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9542 primary records. [2025-10-15T22:33:32.165794] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-15T22:33:32.182490] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-15T22:33:32.183048] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-15T22:33:32.185394] [INFO ] [MAIN ] Derivative Progress: 91/1803 symbols completed. AMWL took 1.0s. Estimated remaining: 10m 59s. Rate: 155.9 symbols/min [2025-10-15T22:33:32.185571] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:32.204698] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:32.205508] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50564 primary records. [2025-10-15T22:33:32.205673] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-15T22:33:32.219074] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:32.228136] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49144 primary records. [2025-10-15T22:33:32.228347] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-15T22:33:32.235721] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-15T22:33:32.235807] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-15T22:33:32.239032] [INFO ] [MAIN ] Derivative Progress: 92/1803 symbols completed. AMTM took 1.1s. Estimated remaining: 10m 52s. Rate: 157.4 symbols/min [2025-10-15T22:33:32.239212] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:32.265603] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-15T22:33:32.265773] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-15T22:33:32.268700] [INFO ] [MAIN ] Derivative Progress: 93/1803 symbols completed. AMX took 1.1s. Estimated remaining: 10m 46s. Rate: 158.9 symbols/min [2025-10-15T22:33:32.269541] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:32.280627] [DEBUG] [LOCAL ] AN: Loaded 31439 existing records from primary storage. [2025-10-15T22:33:32.280875] [INFO ] [MAIN ] AN: Loaded 31439 primary data records. [2025-10-15T22:33:32.633914] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-15T22:33:32.634155] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-15T22:33:32.792782] [DEBUG] [LOCAL ] ANF: Loaded 52079 existing records from primary storage. [2025-10-15T22:33:32.932041] [INFO ] [MAIN ] ANF: Loaded 52079 primary data records. [2025-10-15T22:33:33.304796] [DEBUG] [MAIN ] AN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:33.306245] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 31439 primary records. [2025-10-15T22:33:33.306519] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-15T22:33:33.324139] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-15T22:33:33.324708] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-15T22:33:33.327102] [INFO ] [MAIN ] Derivative Progress: 94/1803 symbols completed. AN took 1.1s. Estimated remaining: 10m 58s. Rate: 155.9 symbols/min [2025-10-15T22:33:33.328092] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:33.346774] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:33.347808] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-15T22:33:33.348058] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-15T22:33:33.369851] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-15T22:33:33.370036] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-15T22:33:33.372631] [INFO ] [MAIN ] Derivative Progress: 95/1803 symbols completed. ANET took 1.1s. Estimated remaining: 10m 51s. Rate: 157.4 symbols/min [2025-10-15T22:33:33.373294] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:33.385029] [DEBUG] [LOCAL ] ANVS: Loaded 23750 existing records from primary storage. [2025-10-15T22:33:33.385376] [INFO ] [MAIN ] ANVS: Loaded 23750 primary data records. [2025-10-15T22:33:33.468404] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:33.511367] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52079 primary records. [2025-10-15T22:33:33.522517] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-15T22:33:33.722213] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-15T22:33:33.722465] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-15T22:33:33.725374] [INFO ] [MAIN ] Derivative Progress: 96/1803 symbols completed. ANF took 1.5s. Estimated remaining: 10m 50s. Rate: 157.5 symbols/min [2025-10-15T22:33:33.725681] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:33.738048] [DEBUG] [LOCAL ] AOD: Loaded 30814 existing records from primary storage. [2025-10-15T22:33:33.738138] [INFO ] [MAIN ] AOD: Loaded 30814 primary data records. [2025-10-15T22:33:33.868356] [DEBUG] [LOCAL ] AOMR: Loaded 16461 existing records from primary storage. [2025-10-15T22:33:33.896972] [INFO ] [MAIN ] AOMR: Loaded 16461 primary data records. [2025-10-15T22:33:34.360554] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:34.362529] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23750 primary records. [2025-10-15T22:33:34.363220] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-15T22:33:34.381092] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-15T22:33:34.382255] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-15T22:33:34.384409] [INFO ] [MAIN ] Derivative Progress: 97/1803 symbols completed. ANVS took 1.1s. Estimated remaining: 10m 55s. Rate: 156.4 symbols/min [2025-10-15T22:33:34.385101] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:34.403176] [DEBUG] [MAIN ] AOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:34.404056] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30814 primary records. [2025-10-15T22:33:34.404262] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-15T22:33:34.439104] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-15T22:33:34.439936] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:34.440007] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-15T22:33:34.440740] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16461 primary records. [2025-10-15T22:33:34.443103] [INFO ] [MAIN ] Derivative Progress: 98/1803 symbols completed. AOD took 1.1s. Estimated remaining: 10m 49s. Rate: 157.7 symbols/min [2025-10-15T22:33:34.443260] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-15T22:33:34.443469] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:34.469916] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-15T22:33:34.470104] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-15T22:33:34.472546] [INFO ] [MAIN ] Derivative Progress: 99/1803 symbols completed. AOMR took 0.7s. Estimated remaining: 10m 42s. Rate: 159.2 symbols/min [2025-10-15T22:33:34.472956] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:34.489472] [DEBUG] [LOCAL ] AON: Loaded 45133 existing records from primary storage. [2025-10-15T22:33:34.489856] [INFO ] [MAIN ] AON: Loaded 45133 primary data records. [2025-10-15T22:33:34.612421] [DEBUG] [LOCAL ] AORT: Loaded 29190 existing records from primary storage. [2025-10-15T22:33:34.640847] [INFO ] [MAIN ] AORT: Loaded 29190 primary data records. [2025-10-15T22:33:34.941058] [DEBUG] [LOCAL ] AOS: Loaded 48761 existing records from primary storage. [2025-10-15T22:33:34.941888] [INFO ] [MAIN ] AOS: Loaded 48761 primary data records. [2025-10-15T22:33:35.519736] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:35.521841] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45133 primary records. [2025-10-15T22:33:35.522283] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-15T22:33:35.541834] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-15T22:33:35.542042] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-15T22:33:35.544501] [INFO ] [MAIN ] Derivative Progress: 100/1803 symbols completed. AON took 1.2s. Estimated remaining: 10m 54s. Rate: 156.3 symbols/min [2025-10-15T22:33:35.545410] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:35.564672] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:35.567617] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29190 primary records. [2025-10-15T22:33:35.567865] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-15T22:33:35.585029] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-15T22:33:35.589105] [DEBUG] [LOCAL ] AP: Loaded 7352 existing records from primary storage. [2025-10-15T22:33:35.589771] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-15T22:33:35.592118] [INFO ] [MAIN ] Derivative Progress: 101/1803 symbols completed. AORT took 1.1s. Estimated remaining: 10m 48s. Rate: 157.7 symbols/min [2025-10-15T22:33:35.589845] [INFO ] [MAIN ] AP: Loaded 7352 primary data records. [2025-10-15T22:33:35.603708] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:35.705238] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:35.709824] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48761 primary records. [2025-10-15T22:33:35.715616] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-15T22:33:35.934554] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-15T22:33:35.935311] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-15T22:33:35.937912] [INFO ] [MAIN ] Derivative Progress: 102/1803 symbols completed. AOS took 1.5s. Estimated remaining: 10m 47s. Rate: 157.8 symbols/min [2025-10-15T22:33:35.938735] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:35.953982] [DEBUG] [LOCAL ] APD: Loaded 45470 existing records from primary storage. [2025-10-15T22:33:35.954198] [INFO ] [MAIN ] APD: Loaded 45470 primary data records. [2025-10-15T22:33:36.297097] [DEBUG] [LOCAL ] APG: Loaded 50584 existing records from primary storage. [2025-10-15T22:33:36.298214] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:36.298604] [INFO ] [MAIN ] APG: Loaded 50584 primary data records. [2025-10-15T22:33:36.300431] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7352 primary records. [2025-10-15T22:33:36.300715] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-15T22:33:36.432936] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-15T22:33:36.443828] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-15T22:33:36.499990] [INFO ] [MAIN ] Derivative Progress: 103/1803 symbols completed. AP took 1.0s. Estimated remaining: 10m 49s. Rate: 157.1 symbols/min [2025-10-15T22:33:36.635323] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:36.636590] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45470 primary records. [2025-10-15T22:33:36.636862] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-15T22:33:36.656139] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-15T22:33:36.656258] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-15T22:33:36.659829] [INFO ] [MAIN ] Derivative Progress: 104/1803 symbols completed. APD took 1.1s. Estimated remaining: 10m 45s. Rate: 158.0 symbols/min [2025-10-15T22:33:36.677252] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:36.677841] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50584 primary records. [2025-10-15T22:33:36.677901] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-15T22:33:36.692681] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-15T22:33:36.692740] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-15T22:33:36.694761] [INFO ] [MAIN ] Derivative Progress: 105/1803 symbols completed. APG took 0.8s. Estimated remaining: 10m 39s. Rate: 159.4 symbols/min [2025-10-15T22:33:36.695483] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:36.695592] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:36.695367] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:36.707293] [DEBUG] [LOCAL ] APOS: Loaded 7314 existing records from primary storage. [2025-10-15T22:33:36.707420] [INFO ] [MAIN ] APOS: Loaded 7314 primary data records. [2025-10-15T22:33:37.096764] [DEBUG] [LOCAL ] APO: Loaded 53389 existing records from primary storage. [2025-10-15T22:33:37.095621] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-15T22:33:37.097153] [INFO ] [MAIN ] APO: Loaded 53389 primary data records. [2025-10-15T22:33:37.097351] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-15T22:33:37.706091] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:37.707109] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7314 primary records. [2025-10-15T22:33:37.707528] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-15T22:33:37.726685] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-10-15T22:33:37.727041] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-15T22:33:37.729619] [INFO ] [MAIN ] Derivative Progress: 106/1803 symbols completed. APOS took 1.0s. Estimated remaining: 10m 49s. Rate: 156.8 symbols/min [2025-10-15T22:33:37.730081] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:37.743706] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:37.746318] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-15T22:33:37.748146] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-15T22:33:37.751602] [DEBUG] [LOCAL ] AQNB: Loaded 4069 existing records from primary storage. [2025-10-15T22:33:37.751967] [INFO ] [MAIN ] AQNB: Loaded 4069 primary data records. [2025-10-15T22:33:37.789764] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-15T22:33:37.799052] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-15T22:33:37.800890] [INFO ] [MAIN ] Derivative Progress: 107/1803 symbols completed. APH took 1.1s. Estimated remaining: 10m 44s. Rate: 158.0 symbols/min [2025-10-15T22:33:37.801265] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:37.804718] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:37.817619] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53389 primary records. [2025-10-15T22:33:37.824416] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-15T22:33:37.899865] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-15T22:33:37.920774] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-15T22:33:37.974243] [INFO ] [MAIN ] Derivative Progress: 108/1803 symbols completed. APO took 1.3s. Estimated remaining: 10m 41s. Rate: 158.8 symbols/min [2025-10-15T22:33:37.980244] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:38.117413] [DEBUG] [LOCAL ] ARDC: Loaded 15318 existing records from primary storage. [2025-10-15T22:33:38.117864] [INFO ] [MAIN ] ARDC: Loaded 15318 primary data records. [2025-10-15T22:33:38.204468] [DEBUG] [LOCAL ] ARCO: Loaded 44501 existing records from primary storage. [2025-10-15T22:33:38.215157] [INFO ] [MAIN ] ARCO: Loaded 44501 primary data records. [2025-10-15T22:33:38.545116] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:38.562063] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4069 primary records. [2025-10-15T22:33:38.584799] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-15T22:33:38.743922] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-15T22:33:38.744341] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-15T22:33:38.746888] [INFO ] [MAIN ] Derivative Progress: 109/1803 symbols completed. AQNB took 1.0s. Estimated remaining: 10m 46s. Rate: 157.3 symbols/min [2025-10-15T22:33:38.748124] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:38.801521] [DEBUG] [MAIN ] ARDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:38.802758] [DEBUG] [MAIN ] ARCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:38.803460] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 15318 primary records. [2025-10-15T22:33:38.804086] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44501 primary records. [2025-10-15T22:33:38.804202] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-15T22:33:38.805132] [DEBUG] [LOCAL ] ARDT: Loaded 27721 existing records from primary storage. [2025-10-15T22:33:38.804303] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-15T22:33:38.806039] [INFO ] [MAIN ] ARDT: Loaded 27721 primary data records. [2025-10-15T22:33:38.892337] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-15T22:33:38.914859] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-15T22:33:38.927950] [INFO ] [MAIN ] Derivative Progress: 110/1803 symbols completed. ARDC took 0.9s. Estimated remaining: 10m 43s. Rate: 158.0 symbols/min [2025-10-15T22:33:38.928400] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:38.929789] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-10-15T22:33:38.936584] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-15T22:33:38.946866] [INFO ] [MAIN ] Derivative Progress: 111/1803 symbols completed. ARCO took 1.1s. Estimated remaining: 10m 37s. Rate: 159.4 symbols/min [2025-10-15T22:33:38.950800] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:39.216138] [DEBUG] [LOCAL ] ARE: Loaded 50973 existing records from primary storage. [2025-10-15T22:33:39.217365] [INFO ] [MAIN ] ARE: Loaded 50973 primary data records. [2025-10-15T22:33:39.279706] [DEBUG] [LOCAL ] ARI: Loaded 43733 existing records from primary storage. [2025-10-15T22:33:39.287529] [INFO ] [MAIN ] ARI: Loaded 43733 primary data records. [2025-10-15T22:33:39.524937] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:39.655216] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27721 primary records. [2025-10-15T22:33:39.660972] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-15T22:33:39.870008] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-15T22:33:39.870883] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-15T22:33:39.872849] [INFO ] [MAIN ] Derivative Progress: 112/1803 symbols completed. ARDT took 1.1s. Estimated remaining: 10m 45s. Rate: 157.3 symbols/min [2025-10-15T22:33:39.873283] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:39.893833] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:39.894558] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50973 primary records. [2025-10-15T22:33:39.894756] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-15T22:33:39.925330] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-15T22:33:39.925739] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-15T22:33:39.927913] [INFO ] [MAIN ] Derivative Progress: 113/1803 symbols completed. ARE took 1.0s. Estimated remaining: 10m 40s. Rate: 158.5 symbols/min [2025-10-15T22:33:39.925918] [DEBUG] [MAIN ] ARI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:39.928801] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43733 primary records. [2025-10-15T22:33:39.928903] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-15T22:33:39.938893] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:39.954998] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-10-15T22:33:39.955246] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-15T22:33:39.957575] [INFO ] [MAIN ] Derivative Progress: 114/1803 symbols completed. ARI took 1.0s. Estimated remaining: 10m 34s. Rate: 159.8 symbols/min [2025-10-15T22:33:39.957793] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:39.973430] [DEBUG] [LOCAL ] ARLO: Loaded 43803 existing records from primary storage. [2025-10-15T22:33:39.973799] [INFO ] [MAIN ] ARLO: Loaded 43803 primary data records. [2025-10-15T22:33:40.307326] [DEBUG] [LOCAL ] AROC: Loaded 49062 existing records from primary storage. [2025-10-15T22:33:40.308547] [INFO ] [MAIN ] AROC: Loaded 49062 primary data records. [2025-10-15T22:33:40.421081] [DEBUG] [LOCAL ] ARR: Loaded 52115 existing records from primary storage. [2025-10-15T22:33:40.433465] [INFO ] [MAIN ] ARR: Loaded 52115 primary data records. [2025-10-15T22:33:40.993307] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:40.994880] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43803 primary records. [2025-10-15T22:33:40.995150] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-15T22:33:41.013027] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-15T22:33:41.013361] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-15T22:33:41.015200] [INFO ] [MAIN ] Derivative Progress: 115/1803 symbols completed. ARLO took 1.1s. Estimated remaining: 10m 44s. Rate: 157.3 symbols/min [2025-10-15T22:33:41.015544] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:41.032787] [DEBUG] [MAIN ] AROC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:41.034113] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 49062 primary records. [2025-10-15T22:33:41.034208] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-15T22:33:41.051538] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-15T22:33:41.051747] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-15T22:33:41.053711] [INFO ] [MAIN ] Derivative Progress: 116/1803 symbols completed. AROC took 1.1s. Estimated remaining: 10m 38s. Rate: 158.6 symbols/min [2025-10-15T22:33:41.053862] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:41.067166] [DEBUG] [MAIN ] ARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:41.067895] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52115 primary records. [2025-10-15T22:33:41.067957] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-15T22:33:41.092106] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-15T22:33:41.092188] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-15T22:33:41.094250] [INFO ] [MAIN ] Derivative Progress: 117/1803 symbols completed. ARR took 1.1s. Estimated remaining: 10m 33s. Rate: 159.8 symbols/min [2025-10-15T22:33:41.094563] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:41.108694] [DEBUG] [LOCAL ] ARW: Loaded 33090 existing records from primary storage. [2025-10-15T22:33:41.108953] [INFO ] [MAIN ] ARW: Loaded 33090 primary data records. [2025-10-15T22:33:41.234860] [DEBUG] [LOCAL ] ASA: Loaded 15215 existing records from primary storage. [2025-10-15T22:33:41.235394] [INFO ] [MAIN ] ASA: Loaded 15215 primary data records. [2025-10-15T22:33:41.539413] [DEBUG] [LOCAL ] AS: Loaded 53174 existing records from primary storage. [2025-10-15T22:33:41.542781] [INFO ] [MAIN ] AS: Loaded 53174 primary data records. [2025-10-15T22:33:42.087388] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:42.089121] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33090 primary records. [2025-10-15T22:33:42.089513] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-15T22:33:42.115960] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:42.117621] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 15215 primary records. [2025-10-15T22:33:42.117739] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-15T22:33:42.119539] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-15T22:33:42.119758] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-15T22:33:42.122848] [INFO ] [MAIN ] Derivative Progress: 118/1803 symbols completed. ARW took 1.1s. Estimated remaining: 10m 42s. Rate: 157.5 symbols/min [2025-10-15T22:33:42.140928] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-15T22:33:42.155082] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-15T22:33:42.157074] [INFO ] [MAIN ] Derivative Progress: 119/1803 symbols completed. ASA took 1.1s. Estimated remaining: 10m 37s. Rate: 158.7 symbols/min [2025-10-15T22:33:42.154993] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:42.158055] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53174 primary records. [2025-10-15T22:33:42.158301] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-15T22:33:42.175103] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-10-15T22:33:42.175221] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-15T22:33:42.177800] [INFO ] [MAIN ] Derivative Progress: 120/1803 symbols completed. AS took 1.1s. Estimated remaining: 10m 31s. Rate: 159.9 symbols/min [2025-10-15T22:33:42.178209] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:42.178372] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:42.178430] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:42.185510] [DEBUG] [LOCAL ] ASBA: Loaded 3459 existing records from primary storage. [2025-10-15T22:33:42.185695] [INFO ] [MAIN ] ASBA: Loaded 3459 primary data records. [2025-10-15T22:33:42.535951] [DEBUG] [LOCAL ] ASAN: Loaded 52733 existing records from primary storage. [2025-10-15T22:33:42.537672] [INFO ] [MAIN ] ASAN: Loaded 52733 primary data records. [2025-10-15T22:33:42.537342] [DEBUG] [LOCAL ] ASB: Loaded 49632 existing records from primary storage. [2025-10-15T22:33:42.538098] [INFO ] [MAIN ] ASB: Loaded 49632 primary data records. [2025-10-15T22:33:43.233135] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:43.235069] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3459 primary records. [2025-10-15T22:33:43.235390] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-15T22:33:43.251338] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-15T22:33:43.251551] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-15T22:33:43.253792] [INFO ] [MAIN ] Derivative Progress: 121/1803 symbols completed. ASBA took 1.1s. Estimated remaining: 10m 41s. Rate: 157.5 symbols/min [2025-10-15T22:33:43.255869] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:43.281952] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:43.295738] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49632 primary records. [2025-10-15T22:33:43.304595] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-15T22:33:43.305717] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:43.307324] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52733 primary records. [2025-10-15T22:33:43.315589] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-15T22:33:43.349451] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-15T22:33:43.345387] [DEBUG] [LOCAL ] ASC: Loaded 37348 existing records from primary storage. [2025-10-15T22:33:43.349605] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-15T22:33:43.352736] [INFO ] [MAIN ] Derivative Progress: 122/1803 symbols completed. ASAN took 1.2s. Estimated remaining: 10m 36s. Rate: 158.5 symbols/min [2025-10-15T22:33:43.350534] [INFO ] [MAIN ] ASC: Loaded 37348 primary data records. [2025-10-15T22:33:43.352954] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:43.376110] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-15T22:33:43.386629] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-15T22:33:43.394723] [INFO ] [MAIN ] Derivative Progress: 123/1803 symbols completed. ASB took 1.2s. Estimated remaining: 10m 31s. Rate: 159.6 symbols/min [2025-10-15T22:33:43.413496] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:43.533708] [DEBUG] [LOCAL ] ASG: Loaded 19561 existing records from primary storage. [2025-10-15T22:33:43.565018] [INFO ] [MAIN ] ASG: Loaded 19561 primary data records. [2025-10-15T22:33:43.692146] [DEBUG] [LOCAL ] ASGI: Loaded 22951 existing records from primary storage. [2025-10-15T22:33:43.704101] [INFO ] [MAIN ] ASGI: Loaded 22951 primary data records. [2025-10-15T22:33:44.348728] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:44.349888] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37348 primary records. [2025-10-15T22:33:44.350088] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-15T22:33:44.371545] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-15T22:33:44.371871] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-15T22:33:44.374271] [INFO ] [MAIN ] Derivative Progress: 124/1803 symbols completed. ASC took 1.1s. Estimated remaining: 10m 39s. Rate: 157.6 symbols/min [2025-10-15T22:33:44.374473] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:44.409042] [DEBUG] [MAIN ] ASG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:44.409375] [DEBUG] [MAIN ] ASGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:44.410261] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19561 primary records. [2025-10-15T22:33:44.410424] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-15T22:33:44.411508] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22951 primary records. [2025-10-15T22:33:44.412105] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-15T22:33:44.448790] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-15T22:33:44.449669] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-15T22:33:44.452036] [INFO ] [MAIN ] Derivative Progress: 125/1803 symbols completed. ASG took 1.1s. Estimated remaining: 10m 35s. Rate: 158.6 symbols/min [2025-10-15T22:33:44.452536] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:44.466891] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-15T22:33:44.467197] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-15T22:33:44.467690] [DEBUG] [LOCAL ] ASGN: Loaded 36578 existing records from primary storage. [2025-10-15T22:33:44.470439] [INFO ] [MAIN ] Derivative Progress: 126/1803 symbols completed. ASGI took 1.1s. Estimated remaining: 10m 30s. Rate: 159.8 symbols/min [2025-10-15T22:33:44.467775] [INFO ] [MAIN ] ASGN: Loaded 36578 primary data records. [2025-10-15T22:33:44.470695] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:44.646152] [DEBUG] [LOCAL ] ASIX: Loaded 23077 existing records from primary storage. [2025-10-15T22:33:44.686552] [INFO ] [MAIN ] ASIX: Loaded 23077 primary data records. [2025-10-15T22:33:44.821398] [DEBUG] [LOCAL ] ASH: Loaded 37552 existing records from primary storage. [2025-10-15T22:33:44.840602] [INFO ] [MAIN ] ASH: Loaded 37552 primary data records. [2025-10-15T22:33:45.474057] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:45.476192] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36578 primary records. [2025-10-15T22:33:45.477885] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-15T22:33:45.514171] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:45.516503] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 23077 primary records. [2025-10-15T22:33:45.516962] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-15T22:33:45.517812] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-15T22:33:45.518390] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-15T22:33:45.521417] [INFO ] [MAIN ] Derivative Progress: 127/1803 symbols completed. ASGN took 1.1s. Estimated remaining: 10m 38s. Rate: 157.6 symbols/min [2025-10-15T22:33:45.522080] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:45.546625] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-15T22:33:45.546961] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-15T22:33:45.549422] [INFO ] [MAIN ] Derivative Progress: 128/1803 symbols completed. ASIX took 1.1s. Estimated remaining: 10m 33s. Rate: 158.7 symbols/min [2025-10-15T22:33:45.549952] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:45.566586] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:45.567368] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37552 primary records. [2025-10-15T22:33:45.567518] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-15T22:33:45.590142] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-15T22:33:45.590390] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-15T22:33:45.593571] [INFO ] [MAIN ] Derivative Progress: 129/1803 symbols completed. ASH took 1.1s. Estimated remaining: 10m 28s. Rate: 159.8 symbols/min [2025-10-15T22:33:45.594221] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:45.600162] [DEBUG] [LOCAL ] ASR: Loaded 9379 existing records from primary storage. [2025-10-15T22:33:45.600422] [INFO ] [MAIN ] ASR: Loaded 9379 primary data records. [2025-10-15T22:33:45.801371] [DEBUG] [LOCAL ] ASPN: Loaded 49893 existing records from primary storage. [2025-10-15T22:33:45.824857] [INFO ] [MAIN ] ASPN: Loaded 49893 primary data records. [2025-10-15T22:33:46.172566] [DEBUG] [LOCAL ] ASX: Loaded 52874 existing records from primary storage. [2025-10-15T22:33:46.185962] [INFO ] [MAIN ] ASX: Loaded 52874 primary data records. [2025-10-15T22:33:46.800536] [DEBUG] [MAIN ] ASR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:46.803105] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9379 primary records. [2025-10-15T22:33:46.803214] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-15T22:33:46.823813] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-15T22:33:46.824218] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-15T22:33:46.827107] [INFO ] [MAIN ] Derivative Progress: 130/1803 symbols completed. ASR took 1.3s. Estimated remaining: 10m 39s. Rate: 157.0 symbols/min [2025-10-15T22:33:46.827551] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:46.842080] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:46.842934] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49893 primary records. [2025-10-15T22:33:46.843148] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-15T22:33:46.871692] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-15T22:33:46.877491] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:46.877593] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-15T22:33:46.880389] [INFO ] [MAIN ] Derivative Progress: 131/1803 symbols completed. ASPN took 1.4s. Estimated remaining: 10m 35s. Rate: 158.1 symbols/min [2025-10-15T22:33:46.881923] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:46.881388] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52874 primary records. [2025-10-15T22:33:46.882607] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-15T22:33:46.910562] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-15T22:33:46.910868] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-15T22:33:46.913416] [INFO ] [MAIN ] Derivative Progress: 132/1803 symbols completed. ASX took 1.3s. Estimated remaining: 10m 30s. Rate: 159.2 symbols/min [2025-10-15T22:33:46.913684] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:46.943142] [DEBUG] [LOCAL ] ATEN: Loaded 38334 existing records from primary storage. [2025-10-15T22:33:46.943477] [INFO ] [MAIN ] ATEN: Loaded 38334 primary data records. [2025-10-15T22:33:47.125751] [DEBUG] [LOCAL ] ATHM: Loaded 31512 existing records from primary storage. [2025-10-15T22:33:47.123992] [DEBUG] [LOCAL ] ATGE: Loaded 31064 existing records from primary storage. [2025-10-15T22:33:47.166815] [INFO ] [MAIN ] ATGE: Loaded 31064 primary data records. [2025-10-15T22:33:47.166972] [INFO ] [MAIN ] ATHM: Loaded 31512 primary data records. [2025-10-15T22:33:48.013514] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:48.015494] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 38334 primary records. [2025-10-15T22:33:48.015607] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-15T22:33:48.036506] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-15T22:33:48.038608] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-15T22:33:48.042739] [INFO ] [MAIN ] Derivative Progress: 133/1803 symbols completed. ATEN took 1.2s. Estimated remaining: 10m 39s. Rate: 156.8 symbols/min [2025-10-15T22:33:48.058303] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:48.059567] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 31512 primary records. [2025-10-15T22:33:48.059878] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-15T22:33:48.079970] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-15T22:33:48.080152] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-15T22:33:48.082495] [INFO ] [MAIN ] Derivative Progress: 134/1803 symbols completed. ATHM took 1.2s. Estimated remaining: 10m 34s. Rate: 157.9 symbols/min [2025-10-15T22:33:48.096835] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:48.097665] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31064 primary records. [2025-10-15T22:33:48.097741] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-15T22:33:48.115280] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-15T22:33:48.115479] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-15T22:33:48.119086] [INFO ] [MAIN ] Derivative Progress: 135/1803 symbols completed. ATGE took 1.2s. Estimated remaining: 10m 30s. Rate: 159.0 symbols/min [2025-10-15T22:33:48.119563] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:48.119618] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:48.120199] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:48.131753] [DEBUG] [LOCAL ] ATHS: Loaded 6640 existing records from primary storage. [2025-10-15T22:33:48.132064] [INFO ] [MAIN ] ATHS: Loaded 6640 primary data records. [2025-10-15T22:33:48.361540] [DEBUG] [LOCAL ] ATKR: Loaded 35206 existing records from primary storage. [2025-10-15T22:33:48.499947] [INFO ] [MAIN ] ATKR: Loaded 35206 primary data records. [2025-10-15T22:33:48.525252] [DEBUG] [LOCAL ] ATO: Loaded 41759 existing records from primary storage. [2025-10-15T22:33:48.566702] [INFO ] [MAIN ] ATO: Loaded 41759 primary data records. [2025-10-15T22:33:49.214798] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:49.216344] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6640 primary records. [2025-10-15T22:33:49.217048] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-15T22:33:49.236388] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-15T22:33:49.236590] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-15T22:33:49.238787] [INFO ] [MAIN ] Derivative Progress: 136/1803 symbols completed. ATHS took 1.1s. Estimated remaining: 10m 38s. Rate: 156.7 symbols/min [2025-10-15T22:33:49.239365] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:49.260263] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:49.262288] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35206 primary records. [2025-10-15T22:33:49.264013] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-15T22:33:49.297339] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:49.301856] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-15T22:33:49.301973] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-15T22:33:49.302788] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41759 primary records. [2025-10-15T22:33:49.302902] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-15T22:33:49.305439] [INFO ] [MAIN ] Derivative Progress: 137/1803 symbols completed. ATKR took 1.2s. Estimated remaining: 10m 34s. Rate: 157.6 symbols/min [2025-10-15T22:33:49.305837] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:49.331209] [DEBUG] [LOCAL ] ATR: Loaded 30562 existing records from primary storage. [2025-10-15T22:33:49.332528] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-15T22:33:49.332801] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-15T22:33:49.332612] [INFO ] [MAIN ] ATR: Loaded 30562 primary data records. [2025-10-15T22:33:49.335147] [INFO ] [MAIN ] Derivative Progress: 138/1803 symbols completed. ATO took 1.2s. Estimated remaining: 10m 29s. Rate: 158.7 symbols/min [2025-10-15T22:33:49.335488] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:49.683270] [DEBUG] [LOCAL ] ATUS: Loaded 49869 existing records from primary storage. [2025-10-15T22:33:49.684693] [INFO ] [MAIN ] ATUS: Loaded 49869 primary data records. [2025-10-15T22:33:49.803839] [DEBUG] [LOCAL ] AU: Loaded 53079 existing records from primary storage. [2025-10-15T22:33:49.805787] [INFO ] [MAIN ] AU: Loaded 53079 primary data records. [2025-10-15T22:33:50.210985] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:50.324934] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30562 primary records. [2025-10-15T22:33:50.334055] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-15T22:33:50.351545] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-15T22:33:50.352195] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-15T22:33:50.354613] [INFO ] [MAIN ] Derivative Progress: 139/1803 symbols completed. ATR took 1.1s. Estimated remaining: 10m 37s. Rate: 156.8 symbols/min [2025-10-15T22:33:50.355611] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:50.374687] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:50.375432] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49869 primary records. [2025-10-15T22:33:50.375670] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-15T22:33:50.393100] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-15T22:33:50.394357] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-15T22:33:50.397220] [INFO ] [MAIN ] Derivative Progress: 140/1803 symbols completed. ATUS took 1.1s. Estimated remaining: 10m 32s. Rate: 157.8 symbols/min [2025-10-15T22:33:50.398080] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:50.421693] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:50.422696] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 53079 primary records. [2025-10-15T22:33:50.422900] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-15T22:33:50.442225] [DEBUG] [LOCAL ] AUNA: Loaded 5131 existing records from primary storage. [2025-10-15T22:33:50.453853] [INFO ] [MAIN ] AUNA: Loaded 5131 primary data records. [2025-10-15T22:33:50.492607] [DEBUG] [LOCAL ] AUB: Loaded 46010 existing records from primary storage. [2025-10-15T22:33:50.512664] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-15T22:33:50.512339] [INFO ] [MAIN ] AUB: Loaded 46010 primary data records. [2025-10-15T22:33:50.521535] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-15T22:33:50.524100] [INFO ] [MAIN ] Derivative Progress: 141/1803 symbols completed. AU took 1.2s. Estimated remaining: 10m 29s. Rate: 158.5 symbols/min [2025-10-15T22:33:50.536050] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:51.155476] [DEBUG] [LOCAL ] AVA: Loaded 38779 existing records from primary storage. [2025-10-15T22:33:51.156572] [INFO ] [MAIN ] AVA: Loaded 38779 primary data records. [2025-10-15T22:33:51.479085] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:33:51.480629] [INFO ] [MAIN ] AUNA: Generated 1793 derivative records from 5131 primary records. [2025-10-15T22:33:51.481013] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-15T22:33:51.501237] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1793 records). [2025-10-15T22:33:51.501785] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-15T22:33:51.517124] [INFO ] [MAIN ] Derivative Progress: 142/1803 symbols completed. AUNA took 1.1s. Estimated remaining: 10m 36s. Rate: 156.7 symbols/min [2025-10-15T22:33:51.517789] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:51.517610] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:51.519001] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46010 primary records. [2025-10-15T22:33:51.519071] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-15T22:33:51.535948] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-15T22:33:51.538729] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-15T22:33:51.541803] [INFO ] [MAIN ] Derivative Progress: 143/1803 symbols completed. AUB took 1.2s. Estimated remaining: 10m 31s. Rate: 157.8 symbols/min [2025-10-15T22:33:51.541946] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:51.547846] [DEBUG] [LOCAL ] AVAL: Loaded 8592 existing records from primary storage. [2025-10-15T22:33:51.548418] [INFO ] [MAIN ] AVAL: Loaded 8592 primary data records. [2025-10-15T22:33:51.682796] [DEBUG] [LOCAL ] AVD: Loaded 21808 existing records from primary storage. [2025-10-15T22:33:51.688802] [INFO ] [MAIN ] AVD: Loaded 21808 primary data records. [2025-10-15T22:33:51.803080] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:51.843511] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 38779 primary records. [2025-10-15T22:33:51.863888] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-15T22:33:52.219753] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-15T22:33:52.219896] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-15T22:33:52.222189] [INFO ] [MAIN ] Derivative Progress: 144/1803 symbols completed. AVA took 1.7s. Estimated remaining: 10m 34s. Rate: 156.9 symbols/min [2025-10-15T22:33:52.222516] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:52.259039] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:52.259477] [DEBUG] [LOCAL ] AVK: Loaded 18628 existing records from primary storage. [2025-10-15T22:33:52.260775] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8592 primary records. [2025-10-15T22:33:52.259976] [INFO ] [MAIN ] AVK: Loaded 18628 primary data records. [2025-10-15T22:33:52.261033] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-15T22:33:52.395341] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:52.407231] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 21808 primary records. [2025-10-15T22:33:52.418315] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-10-15T22:33:52.413063] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-15T22:33:52.436694] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-15T22:33:52.455218] [INFO ] [MAIN ] Derivative Progress: 145/1803 symbols completed. AVAL took 0.9s. Estimated remaining: 10m 32s. Rate: 157.3 symbols/min [2025-10-15T22:33:52.459315] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:52.610675] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-15T22:33:52.611472] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-15T22:33:52.613936] [INFO ] [MAIN ] Derivative Progress: 146/1803 symbols completed. AVD took 1.1s. Estimated remaining: 10m 29s. Rate: 158.0 symbols/min [2025-10-15T22:33:52.614220] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:52.646810] [DEBUG] [LOCAL ] AVNS: Loaded 33666 existing records from primary storage. [2025-10-15T22:33:52.647045] [INFO ] [MAIN ] AVNS: Loaded 33666 primary data records. [2025-10-15T22:33:52.668051] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:52.689520] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18628 primary records. [2025-10-15T22:33:52.737705] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-15T22:33:52.783327] [DEBUG] [LOCAL ] AVNT: Loaded 39045 existing records from primary storage. [2025-10-15T22:33:52.801121] [INFO ] [MAIN ] AVNT: Loaded 39045 primary data records. [2025-10-15T22:33:53.093973] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-15T22:33:53.094282] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-15T22:33:53.103062] [INFO ] [MAIN ] Derivative Progress: 147/1803 symbols completed. AVK took 0.9s. Estimated remaining: 10m 30s. Rate: 157.7 symbols/min [2025-10-15T22:33:53.124398] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:53.369550] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:53.370696] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33666 primary records. [2025-10-15T22:33:53.371078] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-15T22:33:53.390495] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-15T22:33:53.393241] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-15T22:33:53.395712] [INFO ] [MAIN ] Derivative Progress: 148/1803 symbols completed. AVNS took 0.9s. Estimated remaining: 10m 29s. Rate: 157.9 symbols/min [2025-10-15T22:33:53.424369] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-15T22:33:53.423448] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:53.425109] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39045 primary records. [2025-10-15T22:33:53.425193] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-15T22:33:53.425509] [INFO ] [MAIN ] AVTR: Loaded 53572 primary data records. [2025-10-15T22:33:53.582453] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-15T22:33:53.595699] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-15T22:33:53.598207] [INFO ] [MAIN ] Derivative Progress: 149/1803 symbols completed. AVNT took 1.0s. Estimated remaining: 10m 26s. Rate: 158.4 symbols/min [2025-10-15T22:33:53.755721] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:53.756338] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53572 primary records. [2025-10-15T22:33:53.756400] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-15T22:33:53.771737] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-15T22:33:53.771799] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-15T22:33:53.774252] [INFO ] [MAIN ] Derivative Progress: 150/1803 symbols completed. AVTR took 0.6s. Estimated remaining: 10m 24s. Rate: 159.0 symbols/min [2025-10-15T22:33:53.774634] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:53.774757] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:53.774715] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:53.801340] [DEBUG] [LOCAL ] AWP: Loaded 21616 existing records from primary storage. [2025-10-15T22:33:53.801562] [INFO ] [MAIN ] AWP: Loaded 21616 primary data records. [2025-10-15T22:33:53.913049] [DEBUG] [LOCAL ] AWR: Loaded 22839 existing records from primary storage. [2025-10-15T22:33:53.934254] [INFO ] [MAIN ] AWR: Loaded 22839 primary data records. [2025-10-15T22:33:54.247601] [DEBUG] [LOCAL ] AWK: Loaded 48557 existing records from primary storage. [2025-10-15T22:33:54.259748] [INFO ] [MAIN ] AWK: Loaded 48557 primary data records. [2025-10-15T22:33:54.808010] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:54.810321] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21616 primary records. [2025-10-15T22:33:54.810503] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-15T22:33:54.829678] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-15T22:33:54.830010] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-15T22:33:54.833790] [INFO ] [MAIN ] Derivative Progress: 151/1803 symbols completed. AWP took 1.1s. Estimated remaining: 10m 31s. Rate: 157.1 symbols/min [2025-10-15T22:33:54.834945] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:54.853416] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:54.854451] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22839 primary records. [2025-10-15T22:33:54.854581] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-15T22:33:54.871912] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-15T22:33:54.873028] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-15T22:33:54.886358] [INFO ] [MAIN ] Derivative Progress: 152/1803 symbols completed. AWR took 1.1s. Estimated remaining: 10m 27s. Rate: 158.0 symbols/min [2025-10-15T22:33:54.886736] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:54.901094] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:54.901914] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48557 primary records. [2025-10-15T22:33:54.902010] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-15T22:33:54.914424] [DEBUG] [LOCAL ] AX: Loaded 28036 existing records from primary storage. [2025-10-15T22:33:54.926746] [INFO ] [MAIN ] AX: Loaded 28036 primary data records. [2025-10-15T22:33:55.015495] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-15T22:33:55.025598] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-15T22:33:55.039471] [INFO ] [MAIN ] Derivative Progress: 153/1803 symbols completed. AWK took 1.3s. Estimated remaining: 10m 24s. Rate: 158.6 symbols/min [2025-10-15T22:33:55.039748] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:55.338694] [DEBUG] [LOCAL ] AXL: Loaded 50565 existing records from primary storage. [2025-10-15T22:33:55.339321] [INFO ] [MAIN ] AXL: Loaded 50565 primary data records. [2025-10-15T22:33:55.693411] [DEBUG] [LOCAL ] AXP: Loaded 53166 existing records from primary storage. [2025-10-15T22:33:55.693855] [INFO ] [MAIN ] AXP: Loaded 53166 primary data records. [2025-10-15T22:33:55.895577] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:55.996537] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28036 primary records. [2025-10-15T22:33:56.010634] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-15T22:33:56.028293] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-15T22:33:56.028513] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-15T22:33:56.030872] [INFO ] [MAIN ] Derivative Progress: 154/1803 symbols completed. AX took 1.2s. Estimated remaining: 10m 30s. Rate: 157.0 symbols/min [2025-10-15T22:33:56.031511] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:56.054899] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:56.056360] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50565 primary records. [2025-10-15T22:33:56.056775] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-15T22:33:56.101135] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:56.102249] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-15T22:33:56.103102] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53166 primary records. [2025-10-15T22:33:56.103325] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-15T22:33:56.107036] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-15T22:33:56.106336] [INFO ] [MAIN ] Derivative Progress: 155/1803 symbols completed. AXL took 1.2s. Estimated remaining: 10m 27s. Rate: 157.8 symbols/min [2025-10-15T22:33:56.107299] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:56.120361] [DEBUG] [LOCAL ] AXS: Loaded 38593 existing records from primary storage. [2025-10-15T22:33:56.128152] [INFO ] [MAIN ] AXS: Loaded 38593 primary data records. [2025-10-15T22:33:56.135767] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-15T22:33:56.147136] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-15T22:33:56.169612] [INFO ] [MAIN ] Derivative Progress: 156/1803 symbols completed. AXP took 1.1s. Estimated remaining: 10m 23s. Rate: 158.6 symbols/min [2025-10-15T22:33:56.174992] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:56.464761] [DEBUG] [LOCAL ] AYI: Loaded 24967 existing records from primary storage. [2025-10-15T22:33:56.466035] [INFO ] [MAIN ] AYI: Loaded 24967 primary data records. [2025-10-15T22:33:56.580447] [DEBUG] [LOCAL ] AXTA: Loaded 52253 existing records from primary storage. [2025-10-15T22:33:56.592691] [INFO ] [MAIN ] AXTA: Loaded 52253 primary data records. [2025-10-15T22:33:57.002445] [DEBUG] [MAIN ] AXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:57.010345] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38593 primary records. [2025-10-15T22:33:57.011064] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-15T22:33:57.248191] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-15T22:33:57.248691] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-15T22:33:57.250882] [INFO ] [MAIN ] Derivative Progress: 157/1803 symbols completed. AXS took 1.2s. Estimated remaining: 10m 30s. Rate: 156.8 symbols/min [2025-10-15T22:33:57.251965] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:57.279700] [DEBUG] [MAIN ] AYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:57.280757] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 24967 primary records. [2025-10-15T22:33:57.280856] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-15T22:33:57.285690] [DEBUG] [LOCAL ] AZO: Loaded 11036 existing records from primary storage. [2025-10-15T22:33:57.286418] [INFO ] [MAIN ] AZO: Loaded 11036 primary data records. [2025-10-15T22:33:57.382586] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-10-15T22:33:57.387933] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-15T22:33:57.396329] [INFO ] [MAIN ] Derivative Progress: 158/1803 symbols completed. AYI took 1.2s. Estimated remaining: 10m 27s. Rate: 157.4 symbols/min [2025-10-15T22:33:57.396566] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:57.479050] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:57.503429] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52253 primary records. [2025-10-15T22:33:57.623990] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-15T22:33:57.645809] [DEBUG] [LOCAL ] AZZ: Loaded 22700 existing records from primary storage. [2025-10-15T22:33:57.650253] [INFO ] [MAIN ] AZZ: Loaded 22700 primary data records. [2025-10-15T22:33:57.650003] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-15T22:33:57.650688] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-15T22:33:57.664472] [INFO ] [MAIN ] Derivative Progress: 159/1803 symbols completed. AXTA took 1.6s. Estimated remaining: 10m 26s. Rate: 157.7 symbols/min [2025-10-15T22:33:57.684002] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:58.013672] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:58.015943] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11036 primary records. [2025-10-15T22:33:58.031455] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-15T22:33:58.033867] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-15T22:33:58.041349] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-15T22:33:58.072809] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-15T22:33:58.088710] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-15T22:33:58.097345] [INFO ] [MAIN ] Derivative Progress: 160/1803 symbols completed. AZO took 0.8s. Estimated remaining: 10m 26s. Rate: 157.5 symbols/min [2025-10-15T22:33:58.123362] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:58.367368] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:58.369245] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22700 primary records. [2025-10-15T22:33:58.369434] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-15T22:33:58.388061] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-15T22:33:58.388475] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-15T22:33:58.390564] [INFO ] [MAIN ] Derivative Progress: 161/1803 symbols completed. AZZ took 1.0s. Estimated remaining: 10m 24s. Rate: 157.8 symbols/min [2025-10-15T22:33:58.392094] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:58.426341] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:58.427335] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-15T22:33:58.427664] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-15T22:33:58.452551] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-15T22:33:58.456503] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-15T22:33:58.540262] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-15T22:33:58.550791] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-15T22:33:58.566734] [INFO ] [MAIN ] Derivative Progress: 162/1803 symbols completed. BA took 0.9s. Estimated remaining: 10m 22s. Rate: 158.3 symbols/min [2025-10-15T22:33:58.584564] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:58.795862] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-15T22:33:58.796196] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-15T22:33:59.127249] [DEBUG] [LOCAL ] BAH: Loaded 51719 existing records from primary storage. [2025-10-15T22:33:59.127793] [INFO ] [MAIN ] BAH: Loaded 51719 primary data records. [2025-10-15T22:33:59.294160] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:59.317800] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-15T22:33:59.353813] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-15T22:33:59.549494] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-15T22:33:59.550677] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-15T22:33:59.553383] [INFO ] [MAIN ] Derivative Progress: 163/1803 symbols completed. BABA took 1.4s. Estimated remaining: 10m 28s. Rate: 156.8 symbols/min [2025-10-15T22:33:59.571679] [DEBUG] [MAIN ] BAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:59.572495] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-15T22:33:59.572575] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-15T22:33:59.590310] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-15T22:33:59.590388] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-15T22:33:59.592381] [INFO ] [MAIN ] Derivative Progress: 164/1803 symbols completed. BAC took 1.2s. Estimated remaining: 10m 24s. Rate: 157.6 symbols/min [2025-10-15T22:33:59.609186] [DEBUG] [MAIN ] BAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:33:59.609756] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51719 primary records. [2025-10-15T22:33:59.609816] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-15T22:33:59.625169] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-10-15T22:33:59.625232] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-15T22:33:59.628130] [INFO ] [MAIN ] Derivative Progress: 165/1803 symbols completed. BAH took 1.0s. Estimated remaining: 10m 20s. Rate: 158.5 symbols/min [2025-10-15T22:33:59.628626] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:59.628758] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:59.629166] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:33:59.681254] [DEBUG] [LOCAL ] BAK: Loaded 39305 existing records from primary storage. [2025-10-15T22:33:59.681566] [INFO ] [MAIN ] BAK: Loaded 39305 primary data records. [2025-10-15T22:33:59.851462] [DEBUG] [LOCAL ] BALL: Loaded 51888 existing records from primary storage. [2025-10-15T22:33:59.867237] [INFO ] [MAIN ] BALL: Loaded 51888 primary data records. [2025-10-15T22:33:59.873674] [DEBUG] [LOCAL ] BAM: Loaded 52107 existing records from primary storage. [2025-10-15T22:33:59.897774] [INFO ] [MAIN ] BAM: Loaded 52107 primary data records. [2025-10-15T22:34:00.721800] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:00.723278] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39305 primary records. [2025-10-15T22:34:00.723496] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-15T22:34:00.742278] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-15T22:34:00.742865] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-15T22:34:00.745329] [INFO ] [MAIN ] Derivative Progress: 166/1803 symbols completed. BAK took 1.1s. Estimated remaining: 10m 27s. Rate: 156.6 symbols/min [2025-10-15T22:34:00.745678] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:00.766607] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:00.775941] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51888 primary records. [2025-10-15T22:34:00.776061] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-15T22:34:00.782636] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:00.798391] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-15T22:34:00.798632] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-15T22:34:00.794366] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52107 primary records. [2025-10-15T22:34:00.800948] [INFO ] [MAIN ] Derivative Progress: 167/1803 symbols completed. BALL took 1.2s. Estimated remaining: 10m 23s. Rate: 157.4 symbols/min [2025-10-15T22:34:00.808764] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-15T22:34:00.809923] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:00.828196] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-15T22:34:00.828428] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-15T22:34:00.838739] [INFO ] [MAIN ] Derivative Progress: 168/1803 symbols completed. BAM took 1.2s. Estimated remaining: 10m 20s. Rate: 158.3 symbols/min [2025-10-15T22:34:00.840280] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:00.841234] [DEBUG] [LOCAL ] BAP: Loaded 25781 existing records from primary storage. [2025-10-15T22:34:00.841358] [INFO ] [MAIN ] BAP: Loaded 25781 primary data records. [2025-10-15T22:34:01.182213] [DEBUG] [LOCAL ] BARK: Loaded 38160 existing records from primary storage. [2025-10-15T22:34:01.206471] [INFO ] [MAIN ] BARK: Loaded 38160 primary data records. [2025-10-15T22:34:01.348183] [DEBUG] [LOCAL ] BAX: Loaded 53529 existing records from primary storage. [2025-10-15T22:34:01.348848] [INFO ] [MAIN ] BAX: Loaded 53529 primary data records. [2025-10-15T22:34:01.955928] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:01.957786] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 25781 primary records. [2025-10-15T22:34:01.958694] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-15T22:34:01.977894] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-15T22:34:01.978561] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-15T22:34:01.981162] [INFO ] [MAIN ] Derivative Progress: 169/1803 symbols completed. BAP took 1.2s. Estimated remaining: 10m 27s. Rate: 156.4 symbols/min [2025-10-15T22:34:01.981548] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:02.001819] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:02.002992] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38160 primary records. [2025-10-15T22:34:02.003333] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-15T22:34:02.021270] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-15T22:34:02.021430] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-15T22:34:02.024038] [INFO ] [MAIN ] Derivative Progress: 170/1803 symbols completed. BARK took 1.2s. Estimated remaining: 10m 23s. Rate: 157.3 symbols/min [2025-10-15T22:34:02.024266] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:02.057623] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:02.058697] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53529 primary records. [2025-10-15T22:34:02.058885] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-15T22:34:02.077185] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-15T22:34:02.077558] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-15T22:34:02.094574] [INFO ] [MAIN ] Derivative Progress: 171/1803 symbols completed. BAX took 1.3s. Estimated remaining: 10m 20s. Rate: 158.0 symbols/min [2025-10-15T22:34:02.094944] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:02.096924] [DEBUG] [LOCAL ] BB: Loaded 52914 existing records from primary storage. [2025-10-15T22:34:02.097172] [INFO ] [MAIN ] BB: Loaded 52914 primary data records. [2025-10-15T22:34:02.430149] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-15T22:34:02.469725] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-15T22:34:02.593811] [DEBUG] [LOCAL ] BBAR: Loaded 42354 existing records from primary storage. [2025-10-15T22:34:02.597818] [INFO ] [MAIN ] BBAR: Loaded 42354 primary data records. [2025-10-15T22:34:03.136399] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:03.137581] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52914 primary records. [2025-10-15T22:34:03.137949] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-15T22:34:03.157121] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-15T22:34:03.158428] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-15T22:34:03.162593] [INFO ] [MAIN ] Derivative Progress: 172/1803 symbols completed. BB took 1.2s. Estimated remaining: 10m 26s. Rate: 156.4 symbols/min [2025-10-15T22:34:03.163610] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:03.178958] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:03.180034] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-15T22:34:03.180436] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-15T22:34:03.198880] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-15T22:34:03.200409] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-15T22:34:03.202689] [INFO ] [MAIN ] Derivative Progress: 173/1803 symbols completed. BBAI took 1.2s. Estimated remaining: 10m 22s. Rate: 157.2 symbols/min [2025-10-15T22:34:03.204760] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:03.219496] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:03.220498] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 42354 primary records. [2025-10-15T22:34:03.220768] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-15T22:34:03.237593] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-15T22:34:03.251739] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-15T22:34:03.254637] [INFO ] [MAIN ] Derivative Progress: 174/1803 symbols completed. BBAR took 1.2s. Estimated remaining: 10m 19s. Rate: 158.0 symbols/min [2025-10-15T22:34:03.255079] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:03.298188] [DEBUG] [LOCAL ] BBD: Loaded 53260 existing records from primary storage. [2025-10-15T22:34:03.296778] [DEBUG] [LOCAL ] BBDO: Loaded 5027 existing records from primary storage. [2025-10-15T22:34:03.299141] [INFO ] [MAIN ] BBDO: Loaded 5027 primary data records. [2025-10-15T22:34:03.298870] [DEBUG] [LOCAL ] BBDC: Loaded 33095 existing records from primary storage. [2025-10-15T22:34:03.298986] [INFO ] [MAIN ] BBD: Loaded 53260 primary data records. [2025-10-15T22:34:03.299315] [INFO ] [MAIN ] BBDC: Loaded 33095 primary data records. [2025-10-15T22:34:04.305578] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:04.311779] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5027 primary records. [2025-10-15T22:34:04.314543] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-15T22:34:04.314467] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:04.316233] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33095 primary records. [2025-10-15T22:34:04.322605] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-15T22:34:04.339920] [DEBUG] [MAIN ] BBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:04.349021] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53260 primary records. [2025-10-15T22:34:04.349908] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-15T22:34:04.357692] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-15T22:34:04.358022] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-15T22:34:04.360475] [INFO ] [MAIN ] Derivative Progress: 175/1803 symbols completed. BBDC took 1.2s. Estimated remaining: 10m 25s. Rate: 156.3 symbols/min [2025-10-15T22:34:04.364188] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-15T22:34:04.371666] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-15T22:34:04.363465] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:04.374304] [INFO ] [MAIN ] Derivative Progress: 176/1803 symbols completed. BBDO took 1.1s. Estimated remaining: 10m 21s. Rate: 157.1 symbols/min [2025-10-15T22:34:04.382667] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:04.382554] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-15T22:34:04.383206] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-15T22:34:04.385725] [INFO ] [MAIN ] Derivative Progress: 177/1803 symbols completed. BBD took 1.2s. Estimated remaining: 10m 18s. Rate: 158.0 symbols/min [2025-10-15T22:34:04.386101] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:04.461156] [DEBUG] [LOCAL ] BBVA: Loaded 49092 existing records from primary storage. [2025-10-15T22:34:04.461998] [INFO ] [MAIN ] BBVA: Loaded 49092 primary data records. [2025-10-15T22:34:04.559452] [DEBUG] [LOCAL ] BBY: Loaded 53445 existing records from primary storage. [2025-10-15T22:34:04.548469] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-15T22:34:04.582802] [INFO ] [MAIN ] BBWI: Loaded 53584 primary data records. [2025-10-15T22:34:04.582596] [INFO ] [MAIN ] BBY: Loaded 53445 primary data records. [2025-10-15T22:34:05.441062] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:05.441883] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49092 primary records. [2025-10-15T22:34:05.442278] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-15T22:34:05.460902] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-15T22:34:05.462547] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-15T22:34:05.466061] [INFO ] [MAIN ] Derivative Progress: 178/1803 symbols completed. BBVA took 1.1s. Estimated remaining: 10m 24s. Rate: 156.4 symbols/min [2025-10-15T22:34:05.479084] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:05.493604] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:05.493242] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53584 primary records. [2025-10-15T22:34:05.493788] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-15T22:34:05.494608] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53445 primary records. [2025-10-15T22:34:05.495417] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-15T22:34:05.525539] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-15T22:34:05.525893] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-15T22:34:05.528546] [INFO ] [MAIN ] Derivative Progress: 179/1803 symbols completed. BBY took 1.1s. Estimated remaining: 10m 20s. Rate: 157.1 symbols/min [2025-10-15T22:34:05.531376] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-15T22:34:05.531453] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-15T22:34:05.533718] [INFO ] [MAIN ] Derivative Progress: 180/1803 symbols completed. BBWI took 1.2s. Estimated remaining: 10m 16s. Rate: 158.0 symbols/min [2025-10-15T22:34:05.534420] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:05.534491] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:05.534331] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:05.589109] [DEBUG] [LOCAL ] BCC: Loaded 28504 existing records from primary storage. [2025-10-15T22:34:05.599279] [INFO ] [MAIN ] BCC: Loaded 28504 primary data records. [2025-10-15T22:34:05.643074] [DEBUG] [LOCAL ] BCAT: Loaded 34198 existing records from primary storage. [2025-10-15T22:34:05.669226] [INFO ] [MAIN ] BCAT: Loaded 34198 primary data records. [2025-10-15T22:34:05.799230] [DEBUG] [LOCAL ] BC: Loaded 44083 existing records from primary storage. [2025-10-15T22:34:05.846019] [INFO ] [MAIN ] BC: Loaded 44083 primary data records. [2025-10-15T22:34:06.575114] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:06.588357] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28504 primary records. [2025-10-15T22:34:06.588457] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-15T22:34:06.587687] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:06.589852] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34198 primary records. [2025-10-15T22:34:06.590116] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-15T22:34:06.606058] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-10-15T22:34:06.606371] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-15T22:34:06.618488] [INFO ] [MAIN ] Derivative Progress: 181/1803 symbols completed. BCC took 1.1s. Estimated remaining: 10m 22s. Rate: 156.4 symbols/min [2025-10-15T22:34:06.622855] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-15T22:34:06.623104] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-15T22:34:06.621818] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:06.625448] [INFO ] [MAIN ] Derivative Progress: 182/1803 symbols completed. BCAT took 1.1s. Estimated remaining: 10m 19s. Rate: 157.2 symbols/min [2025-10-15T22:34:06.625940] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:06.644135] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:06.644803] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44083 primary records. [2025-10-15T22:34:06.644960] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-15T22:34:06.667884] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-15T22:34:06.668062] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-15T22:34:06.670408] [INFO ] [MAIN ] Derivative Progress: 183/1803 symbols completed. BC took 1.1s. Estimated remaining: 10m 15s. Rate: 158.0 symbols/min [2025-10-15T22:34:06.670734] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:06.679303] [DEBUG] [LOCAL ] BCO: Loaded 25461 existing records from primary storage. [2025-10-15T22:34:06.679496] [INFO ] [MAIN ] BCO: Loaded 25461 primary data records. [2025-10-15T22:34:06.857127] [DEBUG] [LOCAL ] BCE: Loaded 52247 existing records from primary storage. [2025-10-15T22:34:06.880722] [INFO ] [MAIN ] BCE: Loaded 52247 primary data records. [2025-10-15T22:34:07.154421] [DEBUG] [LOCAL ] BCS: Loaded 53442 existing records from primary storage. [2025-10-15T22:34:07.206947] [INFO ] [MAIN ] BCS: Loaded 53442 primary data records. [2025-10-15T22:34:07.680128] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:07.682191] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 25461 primary records. [2025-10-15T22:34:07.682603] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-15T22:34:07.701146] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-15T22:34:07.702277] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-15T22:34:07.704173] [INFO ] [MAIN ] Derivative Progress: 184/1803 symbols completed. BCO took 1.1s. Estimated remaining: 10m 21s. Rate: 156.5 symbols/min [2025-10-15T22:34:07.704551] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:07.717597] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:07.718459] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52247 primary records. [2025-10-15T22:34:07.718622] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-15T22:34:07.736004] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-15T22:34:07.737507] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-15T22:34:07.740750] [INFO ] [MAIN ] Derivative Progress: 185/1803 symbols completed. BCE took 1.1s. Estimated remaining: 10m 17s. Rate: 157.3 symbols/min [2025-10-15T22:34:07.741102] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:07.762179] [DEBUG] [MAIN ] BCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:07.762982] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53442 primary records. [2025-10-15T22:34:07.763145] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-15T22:34:07.792501] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-15T22:34:07.793599] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-15T22:34:07.793454] [DEBUG] [LOCAL ] BCSF: Loaded 28156 existing records from primary storage. [2025-10-15T22:34:07.795887] [INFO ] [MAIN ] Derivative Progress: 186/1803 symbols completed. BCS took 1.1s. Estimated remaining: 10m 14s. Rate: 158.0 symbols/min [2025-10-15T22:34:07.793743] [INFO ] [MAIN ] BCSF: Loaded 28156 primary data records. [2025-10-15T22:34:07.796135] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:07.900692] [DEBUG] [LOCAL ] BCX: Loaded 22028 existing records from primary storage. [2025-10-15T22:34:07.914865] [INFO ] [MAIN ] BCX: Loaded 22028 primary data records. [2025-10-15T22:34:08.217280] [DEBUG] [LOCAL ] BDJ: Loaded 29470 existing records from primary storage. [2025-10-15T22:34:08.227913] [INFO ] [MAIN ] BDJ: Loaded 29470 primary data records. [2025-10-15T22:34:08.726345] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:08.728153] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 28156 primary records. [2025-10-15T22:34:08.732431] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-15T22:34:08.751495] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-15T22:34:08.752041] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-15T22:34:08.754527] [INFO ] [MAIN ] Derivative Progress: 187/1803 symbols completed. BCSF took 1.0s. Estimated remaining: 10m 19s. Rate: 156.7 symbols/min [2025-10-15T22:34:08.755688] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:08.783969] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:08.784855] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 22028 primary records. [2025-10-15T22:34:08.784940] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-15T22:34:08.818297] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:08.821423] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29470 primary records. [2025-10-15T22:34:08.821632] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-15T22:34:08.820620] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-15T22:34:08.821786] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-15T22:34:08.824056] [INFO ] [MAIN ] Derivative Progress: 188/1803 symbols completed. BCX took 1.1s. Estimated remaining: 10m 16s. Rate: 157.4 symbols/min [2025-10-15T22:34:08.835706] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:08.853908] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-15T22:34:08.854181] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-15T22:34:08.857470] [INFO ] [MAIN ] Derivative Progress: 189/1803 symbols completed. BDJ took 1.1s. Estimated remaining: 10m 12s. Rate: 158.2 symbols/min [2025-10-15T22:34:08.857858] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:08.874757] [DEBUG] [LOCAL ] BDN: Loaded 47666 existing records from primary storage. [2025-10-15T22:34:08.874990] [INFO ] [MAIN ] BDN: Loaded 47666 primary data records. [2025-10-15T22:34:09.213702] [DEBUG] [LOCAL ] BDX: Loaded 52176 existing records from primary storage. [2025-10-15T22:34:09.214699] [INFO ] [MAIN ] BDX: Loaded 52176 primary data records. [2025-10-15T22:34:09.299923] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-15T22:34:09.318731] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-15T22:34:09.881199] [DEBUG] [MAIN ] BDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:09.883541] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47666 primary records. [2025-10-15T22:34:09.884153] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-15T22:34:09.905673] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-15T22:34:09.906856] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-15T22:34:09.909059] [INFO ] [MAIN ] Derivative Progress: 190/1803 symbols completed. BDN took 1.2s. Estimated remaining: 10m 18s. Rate: 156.7 symbols/min [2025-10-15T22:34:09.909425] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:09.925242] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:09.926222] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52176 primary records. [2025-10-15T22:34:09.926465] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-15T22:34:09.954442] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-15T22:34:09.959693] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:09.960403] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53661 primary records. [2025-10-15T22:34:09.959763] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-15T22:34:09.960507] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-15T22:34:09.964191] [INFO ] [MAIN ] Derivative Progress: 191/1803 symbols completed. BDX took 1.1s. Estimated remaining: 10m 14s. Rate: 157.4 symbols/min [2025-10-15T22:34:09.965417] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:09.981197] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-15T22:34:09.981342] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-15T22:34:09.985072] [INFO ] [MAIN ] Derivative Progress: 192/1803 symbols completed. BE took 1.1s. Estimated remaining: 10m 11s. Rate: 158.2 symbols/min [2025-10-15T22:34:09.985301] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:10.030011] [DEBUG] [LOCAL ] BEN: Loaded 53122 existing records from primary storage. [2025-10-15T22:34:10.046790] [INFO ] [MAIN ] BEN: Loaded 53122 primary data records. [2025-10-15T22:34:10.176411] [DEBUG] [LOCAL ] BEPC: Loaded 46488 existing records from primary storage. [2025-10-15T22:34:10.183060] [DEBUG] [LOCAL ] BEP: Loaded 38951 existing records from primary storage. [2025-10-15T22:34:10.188290] [INFO ] [MAIN ] BEPC: Loaded 46488 primary data records. [2025-10-15T22:34:10.198631] [INFO ] [MAIN ] BEP: Loaded 38951 primary data records. [2025-10-15T22:34:10.989554] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:10.990393] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53122 primary records. [2025-10-15T22:34:10.990570] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-15T22:34:11.009522] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-15T22:34:11.019224] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-15T22:34:11.025961] [INFO ] [MAIN ] Derivative Progress: 193/1803 symbols completed. BEN took 1.1s. Estimated remaining: 10m 16s. Rate: 156.8 symbols/min [2025-10-15T22:34:11.027123] [DEBUG] [MAIN ] BEPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:11.027848] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46488 primary records. [2025-10-15T22:34:11.027999] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-15T22:34:11.040826] [DEBUG] [MAIN ] BEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:11.041538] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38951 primary records. [2025-10-15T22:34:11.052070] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-15T22:34:11.056435] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-15T22:34:11.056637] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-15T22:34:11.065940] [INFO ] [MAIN ] Derivative Progress: 194/1803 symbols completed. BEPC took 1.1s. Estimated remaining: 10m 13s. Rate: 157.5 symbols/min [2025-10-15T22:34:11.073177] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-15T22:34:11.073237] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-15T22:34:11.075399] [INFO ] [MAIN ] Derivative Progress: 195/1803 symbols completed. BEP took 1.1s. Estimated remaining: 10m 10s. Rate: 158.3 symbols/min [2025-10-15T22:34:11.075947] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:11.076037] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:11.075894] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:11.082550] [DEBUG] [LOCAL ] BEPJ: Loaded 3112 existing records from primary storage. [2025-10-15T22:34:11.083596] [INFO ] [MAIN ] BEPJ: Loaded 3112 primary data records. [2025-10-15T22:34:11.148329] [DEBUG] [LOCAL ] BEPI: Loaded 3616 existing records from primary storage. [2025-10-15T22:34:11.170550] [INFO ] [MAIN ] BEPI: Loaded 3616 primary data records. [2025-10-15T22:34:11.466404] [DEBUG] [LOCAL ] BFH: Loaded 41564 existing records from primary storage. [2025-10-15T22:34:11.710074] [INFO ] [MAIN ] BFH: Loaded 41564 primary data records. [2025-10-15T22:34:12.053441] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:12.056428] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3616 primary records. [2025-10-15T22:34:12.057215] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-15T22:34:12.071206] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:12.077772] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3112 primary records. [2025-10-15T22:34:12.081900] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-15T22:34:12.086072] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-15T22:34:12.092926] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-15T22:34:12.098266] [INFO ] [MAIN ] Derivative Progress: 196/1803 symbols completed. BEPI took 1.0s. Estimated remaining: 10m 14s. Rate: 156.9 symbols/min [2025-10-15T22:34:12.101769] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:12.102409] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-10-15T22:34:12.102671] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-15T22:34:12.104927] [INFO ] [MAIN ] Derivative Progress: 197/1803 symbols completed. BEPJ took 1.0s. Estimated remaining: 10m 11s. Rate: 157.7 symbols/min [2025-10-15T22:34:12.105216] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:12.133667] [DEBUG] [LOCAL ] BFK: Loaded 13505 existing records from primary storage. [2025-10-15T22:34:12.133312] [DEBUG] [MAIN ] BFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:12.134332] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41564 primary records. [2025-10-15T22:34:12.134465] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-15T22:34:12.134410] [INFO ] [MAIN ] BFK: Loaded 13505 primary data records. [2025-10-15T22:34:12.262349] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-10-15T22:34:12.262800] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-15T22:34:12.270865] [INFO ] [MAIN ] Derivative Progress: 198/1803 symbols completed. BFH took 1.2s. Estimated remaining: 10m 9s. Rate: 158.2 symbols/min [2025-10-15T22:34:12.286488] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:12.468949] [DEBUG] [LOCAL ] BFLY: Loaded 51836 existing records from primary storage. [2025-10-15T22:34:12.471891] [INFO ] [MAIN ] BFLY: Loaded 51836 primary data records. [2025-10-15T22:34:12.512685] [DEBUG] [LOCAL ] BFS: Loaded 9589 existing records from primary storage. [2025-10-15T22:34:12.557743] [INFO ] [MAIN ] BFS: Loaded 9589 primary data records. [2025-10-15T22:34:13.094622] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:13.096300] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13505 primary records. [2025-10-15T22:34:13.097307] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-15T22:34:13.115903] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-15T22:34:13.116219] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-15T22:34:13.118322] [INFO ] [MAIN ] Derivative Progress: 199/1803 symbols completed. BFK took 1.0s. Estimated remaining: 10m 12s. Rate: 157.2 symbols/min [2025-10-15T22:34:13.118750] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:13.137156] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:13.138301] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51836 primary records. [2025-10-15T22:34:13.138698] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-15T22:34:13.159723] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-15T22:34:13.164577] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-15T22:34:13.167178] [INFO ] [MAIN ] Derivative Progress: 200/1803 symbols completed. BFLY took 1.1s. Estimated remaining: 10m 9s. Rate: 157.9 symbols/min [2025-10-15T22:34:13.165028] [DEBUG] [LOCAL ] BFZ: Loaded 11947 existing records from primary storage. [2025-10-15T22:34:13.167417] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:13.167327] [INFO ] [MAIN ] BFZ: Loaded 11947 primary data records. [2025-10-15T22:34:13.241813] [DEBUG] [MAIN ] BFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:13.284151] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9589 primary records. [2025-10-15T22:34:13.313875] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-15T22:34:13.591825] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-15T22:34:13.606057] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-15T22:34:13.608565] [INFO ] [MAIN ] Derivative Progress: 201/1803 symbols completed. BFS took 1.3s. Estimated remaining: 10m 9s. Rate: 157.8 symbols/min [2025-10-15T22:34:13.609562] [DEBUG] [LOCAL ] BG: Loaded 50524 existing records from primary storage. [2025-10-15T22:34:13.610022] [INFO ] [MAIN ] BG: Loaded 50524 primary data records. [2025-10-15T22:34:13.609849] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:13.799850] [DEBUG] [LOCAL ] BGB: Loaded 17952 existing records from primary storage. [2025-10-15T22:34:13.904968] [INFO ] [MAIN ] BGB: Loaded 17952 primary data records. [2025-10-15T22:34:14.235336] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:14.246040] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11947 primary records. [2025-10-15T22:34:14.246302] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-15T22:34:14.264672] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-15T22:34:14.265276] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-15T22:34:14.270534] [INFO ] [MAIN ] Derivative Progress: 202/1803 symbols completed. BFZ took 1.2s. Estimated remaining: 10m 11s. Rate: 157.2 symbols/min [2025-10-15T22:34:14.271401] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:14.287196] [DEBUG] [MAIN ] BG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:14.288003] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50524 primary records. [2025-10-15T22:34:14.288410] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-15T22:34:14.320432] [DEBUG] [LOCAL ] BGH: Loaded 17264 existing records from primary storage. [2025-10-15T22:34:14.319919] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-15T22:34:14.333309] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-15T22:34:14.335997] [INFO ] [MAIN ] Derivative Progress: 203/1803 symbols completed. BG took 1.2s. Estimated remaining: 10m 8s. Rate: 157.8 symbols/min [2025-10-15T22:34:14.333365] [INFO ] [MAIN ] BGH: Loaded 17264 primary data records. [2025-10-15T22:34:14.333823] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:14.336213] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:14.343112] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17952 primary records. [2025-10-15T22:34:14.378173] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-15T22:34:14.554915] [DEBUG] [LOCAL ] BGR: Loaded 13605 existing records from primary storage. [2025-10-15T22:34:14.555060] [INFO ] [MAIN ] BGR: Loaded 13605 primary data records. [2025-10-15T22:34:14.690891] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-15T22:34:14.712698] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-15T22:34:14.727481] [INFO ] [MAIN ] Derivative Progress: 204/1803 symbols completed. BGB took 1.1s. Estimated remaining: 10m 8s. Rate: 157.8 symbols/min [2025-10-15T22:34:14.748887] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:15.009916] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:15.025734] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17264 primary records. [2025-10-15T22:34:15.026412] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-15T22:34:15.027333] [DEBUG] [LOCAL ] BGS: Loaded 50534 existing records from primary storage. [2025-10-15T22:34:15.028799] [INFO ] [MAIN ] BGS: Loaded 50534 primary data records. [2025-10-15T22:34:15.109257] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-15T22:34:15.122839] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-15T22:34:15.141128] [INFO ] [MAIN ] Derivative Progress: 205/1803 symbols completed. BGH took 0.9s. Estimated remaining: 10m 8s. Rate: 157.7 symbols/min [2025-10-15T22:34:15.148740] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:15.171597] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:15.188737] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13605 primary records. [2025-10-15T22:34:15.206512] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-15T22:34:15.399765] [DEBUG] [LOCAL ] BGSF: Loaded 7984 existing records from primary storage. [2025-10-15T22:34:15.400434] [INFO ] [MAIN ] BGSF: Loaded 7984 primary data records. [2025-10-15T22:34:15.519302] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-15T22:34:15.519455] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-15T22:34:15.521610] [INFO ] [MAIN ] Derivative Progress: 206/1803 symbols completed. BGR took 1.2s. Estimated remaining: 10m 7s. Rate: 157.7 symbols/min [2025-10-15T22:34:15.524893] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:15.727549] [DEBUG] [LOCAL ] BGT: Loaded 16412 existing records from primary storage. [2025-10-15T22:34:15.728637] [INFO ] [MAIN ] BGT: Loaded 16412 primary data records. [2025-10-15T22:34:15.855988] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:15.877851] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50534 primary records. [2025-10-15T22:34:15.902145] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-15T22:34:16.064782] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-15T22:34:16.065911] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-15T22:34:16.068926] [INFO ] [MAIN ] Derivative Progress: 207/1803 symbols completed. BGS took 1.3s. Estimated remaining: 10m 8s. Rate: 157.4 symbols/min [2025-10-15T22:34:16.069161] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:16.086234] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:16.087073] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 7984 primary records. [2025-10-15T22:34:16.087997] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-15T22:34:16.111826] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-15T22:34:16.111954] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-15T22:34:16.111039] [DEBUG] [LOCAL ] BGX: Loaded 11151 existing records from primary storage. [2025-10-15T22:34:16.112150] [INFO ] [MAIN ] BGX: Loaded 11151 primary data records. [2025-10-15T22:34:16.125581] [INFO ] [MAIN ] Derivative Progress: 208/1803 symbols completed. BGSF took 1.0s. Estimated remaining: 10m 6s. Rate: 158.0 symbols/min [2025-10-15T22:34:16.230939] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:16.242335] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16412 primary records. [2025-10-15T22:34:16.252744] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-15T22:34:16.322445] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-15T22:34:16.329703] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-15T22:34:16.431751] [INFO ] [MAIN ] Derivative Progress: 209/1803 symbols completed. BGT took 0.9s. Estimated remaining: 10m 5s. Rate: 158.2 symbols/min [2025-10-15T22:34:16.469522] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:16.470235] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11151 primary records. [2025-10-15T22:34:16.470298] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-15T22:34:16.485282] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-15T22:34:16.485349] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-15T22:34:16.487339] [INFO ] [MAIN ] Derivative Progress: 210/1803 symbols completed. BGX took 0.4s. Estimated remaining: 10m 2s. Rate: 158.8 symbols/min [2025-10-15T22:34:16.487980] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:16.488089] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:16.488189] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:16.514016] [DEBUG] [LOCAL ] BH: Loaded 16248 existing records from primary storage. [2025-10-15T22:34:16.514559] [INFO ] [MAIN ] BH: Loaded 16248 primary data records. [2025-10-15T22:34:16.602346] [DEBUG] [LOCAL ] BGY: Loaded 21983 existing records from primary storage. [2025-10-15T22:34:16.634193] [INFO ] [MAIN ] BGY: Loaded 21983 primary data records. [2025-10-15T22:34:16.738892] [DEBUG] [LOCAL ] BHC: Loaded 46689 existing records from primary storage. [2025-10-15T22:34:16.790852] [INFO ] [MAIN ] BHC: Loaded 46689 primary data records. [2025-10-15T22:34:17.551719] [DEBUG] [MAIN ] BH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:17.552811] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 16248 primary records. [2025-10-15T22:34:17.552994] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-15T22:34:17.567020] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:17.567922] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 21983 primary records. [2025-10-15T22:34:17.568833] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-15T22:34:17.595837] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-15T22:34:17.600378] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-15T22:34:17.600628] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-15T22:34:17.602859] [INFO ] [MAIN ] Derivative Progress: 211/1803 symbols completed. BH took 1.1s. Estimated remaining: 10m 7s. Rate: 157.4 symbols/min [2025-10-15T22:34:17.603113] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-15T22:34:17.606067] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:17.606155] [INFO ] [MAIN ] Derivative Progress: 212/1803 symbols completed. BGY took 1.1s. Estimated remaining: 10m 4s. Rate: 158.1 symbols/min [2025-10-15T22:34:17.607067] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:17.625365] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:17.626340] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46689 primary records. [2025-10-15T22:34:17.626535] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-15T22:34:17.678178] [DEBUG] [LOCAL ] BHK: Loaded 23743 existing records from primary storage. [2025-10-15T22:34:17.677299] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-15T22:34:17.678670] [DEBUG] [LOCAL ] BHE: Loaded 23842 existing records from primary storage. [2025-10-15T22:34:17.678944] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-15T22:34:17.678877] [INFO ] [MAIN ] BHE: Loaded 23842 primary data records. [2025-10-15T22:34:17.682678] [INFO ] [MAIN ] Derivative Progress: 213/1803 symbols completed. BHC took 1.2s. Estimated remaining: 10m 1s. Rate: 158.7 symbols/min [2025-10-15T22:34:17.683045] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:17.678810] [INFO ] [MAIN ] BHK: Loaded 23743 primary data records. [2025-10-15T22:34:18.319128] [DEBUG] [LOCAL ] BHP: Loaded 53372 existing records from primary storage. [2025-10-15T22:34:18.319691] [INFO ] [MAIN ] BHP: Loaded 53372 primary data records. [2025-10-15T22:34:18.641845] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:18.644408] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 23842 primary records. [2025-10-15T22:34:18.645288] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-15T22:34:18.667345] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:18.677310] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23743 primary records. [2025-10-15T22:34:18.677566] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-15T22:34:18.676146] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-15T22:34:18.677839] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-15T22:34:18.681044] [INFO ] [MAIN ] Derivative Progress: 214/1803 symbols completed. BHE took 1.1s. Estimated remaining: 10m 5s. Rate: 157.5 symbols/min [2025-10-15T22:34:18.682496] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:18.699847] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-15T22:34:18.700011] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-15T22:34:18.702534] [INFO ] [MAIN ] Derivative Progress: 215/1803 symbols completed. BHK took 1.1s. Estimated remaining: 10m 2s. Rate: 158.2 symbols/min [2025-10-15T22:34:18.702858] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:18.727625] [DEBUG] [MAIN ] BHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:18.728525] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53372 primary records. [2025-10-15T22:34:18.729037] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-15T22:34:18.740166] [DEBUG] [LOCAL ] BHR: Loaded 22093 existing records from primary storage. [2025-10-15T22:34:18.747444] [INFO ] [MAIN ] BHR: Loaded 22093 primary data records. [2025-10-15T22:34:18.858205] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-15T22:34:18.874884] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-15T22:34:18.878119] [INFO ] [MAIN ] Derivative Progress: 216/1803 symbols completed. BHP took 1.2s. Estimated remaining: 10m 0s. Rate: 158.6 symbols/min [2025-10-15T22:34:18.917980] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:19.087837] [DEBUG] [LOCAL ] BHVN: Loaded 50605 existing records from primary storage. [2025-10-15T22:34:19.088087] [INFO ] [MAIN ] BHVN: Loaded 50605 primary data records. [2025-10-15T22:34:19.469845] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:19.470751] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 22093 primary records. [2025-10-15T22:34:19.471720] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-15T22:34:19.471483] [DEBUG] [LOCAL ] BILL: Loaded 52497 existing records from primary storage. [2025-10-15T22:34:19.473258] [INFO ] [MAIN ] BILL: Loaded 52497 primary data records. [2025-10-15T22:34:19.592538] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-15T22:34:19.596914] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-15T22:34:19.599196] [INFO ] [MAIN ] Derivative Progress: 217/1803 symbols completed. BHR took 0.9s. Estimated remaining: 10m 3s. Rate: 157.9 symbols/min [2025-10-15T22:34:19.615532] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:19.820099] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:19.821484] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50605 primary records. [2025-10-15T22:34:19.821937] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-15T22:34:19.854213] [DEBUG] [LOCAL ] BIO: Loaded 24027 existing records from primary storage. [2025-10-15T22:34:19.855173] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-15T22:34:19.855710] [INFO ] [MAIN ] BIO: Loaded 24027 primary data records. [2025-10-15T22:34:19.855803] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-15T22:34:19.858180] [INFO ] [MAIN ] Derivative Progress: 218/1803 symbols completed. BHVN took 1.2s. Estimated remaining: 10m 1s. Rate: 158.2 symbols/min [2025-10-15T22:34:19.869838] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:20.167843] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:20.183251] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52497 primary records. [2025-10-15T22:34:20.195115] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-15T22:34:20.196700] [DEBUG] [LOCAL ] BIP: Loaded 39192 existing records from primary storage. [2025-10-15T22:34:20.197125] [INFO ] [MAIN ] BIP: Loaded 39192 primary data records. [2025-10-15T22:34:20.299223] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-15T22:34:20.305064] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-15T22:34:20.315697] [INFO ] [MAIN ] Derivative Progress: 219/1803 symbols completed. BILL took 1.4s. Estimated remaining: 10m 1s. Rate: 158.0 symbols/min [2025-10-15T22:34:20.316021] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:20.555268] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:20.556356] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24027 primary records. [2025-10-15T22:34:20.556530] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-15T22:34:20.586452] [DEBUG] [LOCAL ] BIPC: Loaded 41257 existing records from primary storage. [2025-10-15T22:34:20.586896] [INFO ] [MAIN ] BIPC: Loaded 41257 primary data records. [2025-10-15T22:34:20.586632] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-15T22:34:20.587058] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-15T22:34:20.633472] [INFO ] [MAIN ] Derivative Progress: 220/1803 symbols completed. BIO took 1.0s. Estimated remaining: 10m 1s. Rate: 158.1 symbols/min [2025-10-15T22:34:20.660288] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:20.700157] [DEBUG] [LOCAL ] BIPH: Loaded 2518 existing records from primary storage. [2025-10-15T22:34:20.700803] [INFO ] [MAIN ] BIPH: Loaded 2518 primary data records. [2025-10-15T22:34:20.980105] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:21.017745] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39192 primary records. [2025-10-15T22:34:21.034934] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-15T22:34:21.279504] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-15T22:34:21.280211] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-15T22:34:21.283453] [INFO ] [MAIN ] Derivative Progress: 221/1803 symbols completed. BIP took 1.4s. Estimated remaining: 10m 2s. Rate: 157.6 symbols/min [2025-10-15T22:34:21.284165] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:21.292007] [DEBUG] [LOCAL ] BIPI: Loaded 2999 existing records from primary storage. [2025-10-15T22:34:21.292683] [INFO ] [MAIN ] BIPI: Loaded 2999 primary data records. [2025-10-15T22:34:21.456853] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:21.470439] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41257 primary records. [2025-10-15T22:34:21.622365] [DEBUG] [MAIN ] BIPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:21.623498] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2518 primary records. [2025-10-15T22:34:21.622760] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-15T22:34:21.625303] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-15T22:34:21.653804] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-15T22:34:21.654714] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-15T22:34:21.657226] [INFO ] [MAIN ] Derivative Progress: 222/1803 symbols completed. BIPH took 1.0s. Estimated remaining: 10m 2s. Rate: 157.6 symbols/min [2025-10-15T22:34:21.658110] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:21.664722] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-15T22:34:21.664954] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-15T22:34:21.669572] [INFO ] [MAIN ] Derivative Progress: 223/1803 symbols completed. BIPC took 1.4s. Estimated remaining: 9m 59s. Rate: 158.3 symbols/min [2025-10-15T22:34:21.669866] [DEBUG] [LOCAL ] BIPJ: Loaded 3164 existing records from primary storage. [2025-10-15T22:34:21.670406] [INFO ] [MAIN ] BIPJ: Loaded 3164 primary data records. [2025-10-15T22:34:21.967848] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:21.976434] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 2999 primary records. [2025-10-15T22:34:21.976499] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-15T22:34:21.993112] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-15T22:34:21.993209] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-15T22:34:21.995483] [INFO ] [MAIN ] Derivative Progress: 224/1803 symbols completed. BIPI took 0.7s. Estimated remaining: 9m 58s. Rate: 158.4 symbols/min [2025-10-15T22:34:22.014837] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:22.015425] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3164 primary records. [2025-10-15T22:34:22.015485] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-15T22:34:22.029201] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-15T22:34:22.029259] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-15T22:34:22.031698] [INFO ] [MAIN ] Derivative Progress: 225/1803 symbols completed. BIPJ took 0.4s. Estimated remaining: 9m 55s. Rate: 159.1 symbols/min [2025-10-15T22:34:22.032567] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:22.032444] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:22.033117] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:22.063513] [DEBUG] [LOCAL ] BIT: Loaded 23665 existing records from primary storage. [2025-10-15T22:34:22.063740] [INFO ] [MAIN ] BIT: Loaded 23665 primary data records. [2025-10-15T22:34:22.403479] [DEBUG] [LOCAL ] BJ: Loaded 51595 existing records from primary storage. [2025-10-15T22:34:22.424338] [INFO ] [MAIN ] BJ: Loaded 51595 primary data records. [2025-10-15T22:34:22.462216] [DEBUG] [LOCAL ] BIRK: Loaded 51107 existing records from primary storage. [2025-10-15T22:34:22.489331] [INFO ] [MAIN ] BIRK: Loaded 51107 primary data records. [2025-10-15T22:34:23.123471] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:23.124942] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23665 primary records. [2025-10-15T22:34:23.125077] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-15T22:34:23.146332] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-15T22:34:23.146547] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-15T22:34:23.156721] [INFO ] [MAIN ] Derivative Progress: 226/1803 symbols completed. BIT took 1.1s. Estimated remaining: 10m 0s. Rate: 157.7 symbols/min [2025-10-15T22:34:23.162145] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:23.162026] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:23.163637] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51595 primary records. [2025-10-15T22:34:23.163956] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-15T22:34:23.182712] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-15T22:34:23.182797] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-15T22:34:23.184798] [INFO ] [MAIN ] Derivative Progress: 227/1803 symbols completed. BJ took 1.2s. Estimated remaining: 9m 57s. Rate: 158.3 symbols/min [2025-10-15T22:34:23.185054] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:23.198458] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:23.199203] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 51107 primary records. [2025-10-15T22:34:23.199338] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-15T22:34:23.216283] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-15T22:34:23.216571] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-15T22:34:23.219792] [INFO ] [MAIN ] Derivative Progress: 228/1803 symbols completed. BIRK took 1.2s. Estimated remaining: 9m 54s. Rate: 159.0 symbols/min [2025-10-15T22:34:23.220250] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:23.267936] [DEBUG] [LOCAL ] BK: Loaded 53543 existing records from primary storage. [2025-10-15T22:34:23.282072] [INFO ] [MAIN ] BK: Loaded 53543 primary data records. [2025-10-15T22:34:23.294359] [DEBUG] [LOCAL ] BKD: Loaded 50474 existing records from primary storage. [2025-10-15T22:34:23.314995] [INFO ] [MAIN ] BKD: Loaded 50474 primary data records. [2025-10-15T22:34:23.533399] [DEBUG] [LOCAL ] BKE: Loaded 33979 existing records from primary storage. [2025-10-15T22:34:23.565117] [INFO ] [MAIN ] BKE: Loaded 33979 primary data records. [2025-10-15T22:34:24.301500] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:24.302751] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53543 primary records. [2025-10-15T22:34:24.315727] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:24.316244] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-15T22:34:24.319469] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50474 primary records. [2025-10-15T22:34:24.320167] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-15T22:34:24.345814] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-15T22:34:24.350688] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-15T22:34:24.357133] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-15T22:34:24.353424] [INFO ] [MAIN ] Derivative Progress: 229/1803 symbols completed. BK took 1.2s. Estimated remaining: 9m 59s. Rate: 157.6 symbols/min [2025-10-15T22:34:24.357481] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:24.357591] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-15T22:34:24.361432] [INFO ] [MAIN ] Derivative Progress: 230/1803 symbols completed. BKD took 1.2s. Estimated remaining: 9m 56s. Rate: 158.3 symbols/min [2025-10-15T22:34:24.361704] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:24.378812] [DEBUG] [MAIN ] BKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:24.383109] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 33979 primary records. [2025-10-15T22:34:24.383295] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-15T22:34:24.400989] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-15T22:34:24.401185] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-15T22:34:24.404394] [INFO ] [MAIN ] Derivative Progress: 231/1803 symbols completed. BKE took 1.2s. Estimated remaining: 9m 54s. Rate: 158.9 symbols/min [2025-10-15T22:34:24.404760] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:24.441937] [DEBUG] [LOCAL ] BKN: Loaded 7312 existing records from primary storage. [2025-10-15T22:34:24.442116] [INFO ] [MAIN ] BKN: Loaded 7312 primary data records. [2025-10-15T22:34:24.442740] [DEBUG] [LOCAL ] BKH: Loaded 37090 existing records from primary storage. [2025-10-15T22:34:24.476096] [INFO ] [MAIN ] BKH: Loaded 37090 primary data records. [2025-10-15T22:34:24.591305] [DEBUG] [LOCAL ] BKKT: Loaded 36603 existing records from primary storage. [2025-10-15T22:34:24.599547] [INFO ] [MAIN ] BKKT: Loaded 36603 primary data records. [2025-10-15T22:34:25.480807] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:25.482113] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7312 primary records. [2025-10-15T22:34:25.482495] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-15T22:34:25.502117] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-15T22:34:25.502917] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-15T22:34:25.505621] [INFO ] [MAIN ] Derivative Progress: 232/1803 symbols completed. BKN took 1.1s. Estimated remaining: 9m 58s. Rate: 157.6 symbols/min [2025-10-15T22:34:25.506726] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:25.521073] [DEBUG] [MAIN ] BKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:25.522132] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 37090 primary records. [2025-10-15T22:34:25.522438] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-15T22:34:25.544939] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:25.551361] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 36603 primary records. [2025-10-15T22:34:25.551534] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-15T22:34:25.554579] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-15T22:34:25.563191] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-15T22:34:25.572804] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-15T22:34:25.572975] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-15T22:34:25.569207] [INFO ] [MAIN ] Derivative Progress: 233/1803 symbols completed. BKH took 1.2s. Estimated remaining: 9m 56s. Rate: 158.1 symbols/min [2025-10-15T22:34:25.575864] [INFO ] [MAIN ] Derivative Progress: 234/1803 symbols completed. BKKT took 1.2s. Estimated remaining: 9m 53s. Rate: 158.8 symbols/min [2025-10-15T22:34:25.575791] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:25.576067] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:25.602386] [DEBUG] [LOCAL ] BKT: Loaded 12457 existing records from primary storage. [2025-10-15T22:34:25.602528] [INFO ] [MAIN ] BKT: Loaded 12457 primary data records. [2025-10-15T22:34:25.737787] [DEBUG] [LOCAL ] BKSY: Loaded 48700 existing records from primary storage. [2025-10-15T22:34:25.742596] [INFO ] [MAIN ] BKSY: Loaded 48700 primary data records. [2025-10-15T22:34:25.947271] [DEBUG] [LOCAL ] BKU: Loaded 42161 existing records from primary storage. [2025-10-15T22:34:25.960484] [INFO ] [MAIN ] BKU: Loaded 42161 primary data records. [2025-10-15T22:34:26.705033] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:26.706143] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 12457 primary records. [2025-10-15T22:34:26.706470] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-15T22:34:26.725021] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-15T22:34:26.725233] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-15T22:34:26.727225] [INFO ] [MAIN ] Derivative Progress: 235/1803 symbols completed. BKT took 1.2s. Estimated remaining: 9m 58s. Rate: 157.4 symbols/min [2025-10-15T22:34:26.727716] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:26.750718] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:26.751665] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48700 primary records. [2025-10-15T22:34:26.765541] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-15T22:34:26.766504] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:26.767445] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42161 primary records. [2025-10-15T22:34:26.767560] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-15T22:34:26.808762] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-15T22:34:26.810925] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-15T22:34:26.810999] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-15T22:34:26.821849] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-15T22:34:26.821744] [INFO ] [MAIN ] Derivative Progress: 236/1803 symbols completed. BKU took 1.2s. Estimated remaining: 9m 55s. Rate: 157.9 symbols/min [2025-10-15T22:34:26.826981] [INFO ] [MAIN ] Derivative Progress: 237/1803 symbols completed. BKSY took 1.3s. Estimated remaining: 9m 52s. Rate: 158.6 symbols/min [2025-10-15T22:34:26.827212] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:26.828067] [DEBUG] [LOCAL ] BKV: Loaded 29596 existing records from primary storage. [2025-10-15T22:34:26.826885] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:26.828377] [INFO ] [MAIN ] BKV: Loaded 29596 primary data records. [2025-10-15T22:34:27.065554] [DEBUG] [LOCAL ] BLCO: Loaded 35230 existing records from primary storage. [2025-10-15T22:34:27.065792] [INFO ] [MAIN ] BLCO: Loaded 35230 primary data records. [2025-10-15T22:34:27.066305] [DEBUG] [LOCAL ] BLD: Loaded 27482 existing records from primary storage. [2025-10-15T22:34:27.216164] [INFO ] [MAIN ] BLD: Loaded 27482 primary data records. [2025-10-15T22:34:27.899039] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:27.900818] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29596 primary records. [2025-10-15T22:34:27.901465] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-15T22:34:27.919789] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-15T22:34:27.919947] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-15T22:34:27.921916] [INFO ] [MAIN ] Derivative Progress: 238/1803 symbols completed. BKV took 1.2s. Estimated remaining: 9m 57s. Rate: 157.3 symbols/min [2025-10-15T22:34:27.944721] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:27.958190] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35230 primary records. [2025-10-15T22:34:27.958541] [DEBUG] [MAIN ] BLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:27.958712] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-15T22:34:27.960295] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 27482 primary records. [2025-10-15T22:34:27.960602] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-15T22:34:27.989828] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-15T22:34:27.992737] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-15T22:34:27.992629] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-10-15T22:34:27.995462] [INFO ] [MAIN ] Derivative Progress: 239/1803 symbols completed. BLCO took 1.2s. Estimated remaining: 9m 54s. Rate: 157.9 symbols/min [2025-10-15T22:34:27.995698] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-15T22:34:27.998335] [INFO ] [MAIN ] Derivative Progress: 240/1803 symbols completed. BLD took 1.2s. Estimated remaining: 9m 52s. Rate: 158.5 symbols/min [2025-10-15T22:34:27.998989] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:27.998928] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:27.999124] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:28.018197] [DEBUG] [LOCAL ] BLE: Loaded 13810 existing records from primary storage. [2025-10-15T22:34:28.018743] [INFO ] [MAIN ] BLE: Loaded 13810 primary data records. [2025-10-15T22:34:28.176143] [DEBUG] [LOCAL ] BLK: Loaded 34301 existing records from primary storage. [2025-10-15T22:34:28.208262] [INFO ] [MAIN ] BLK: Loaded 34301 primary data records. [2025-10-15T22:34:28.450279] [DEBUG] [LOCAL ] BLDR: Loaded 51906 existing records from primary storage. [2025-10-15T22:34:28.492744] [INFO ] [MAIN ] BLDR: Loaded 51906 primary data records. [2025-10-15T22:34:29.094114] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:29.095128] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 13810 primary records. [2025-10-15T22:34:29.095345] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-15T22:34:29.115015] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-15T22:34:29.116110] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-15T22:34:29.118531] [INFO ] [MAIN ] Derivative Progress: 241/1803 symbols completed. BLE took 1.1s. Estimated remaining: 9m 56s. Rate: 157.2 symbols/min [2025-10-15T22:34:29.118804] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:29.132824] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:29.133454] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34301 primary records. [2025-10-15T22:34:29.133600] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-15T22:34:29.150978] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-15T22:34:29.152004] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-15T22:34:29.155000] [INFO ] [MAIN ] Derivative Progress: 242/1803 symbols completed. BLK took 1.2s. Estimated remaining: 9m 53s. Rate: 157.8 symbols/min [2025-10-15T22:34:29.156098] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:29.169473] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:29.170307] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51906 primary records. [2025-10-15T22:34:29.170603] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-15T22:34:29.202638] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-15T22:34:29.208157] [DEBUG] [LOCAL ] BLW: Loaded 13190 existing records from primary storage. [2025-10-15T22:34:29.208319] [INFO ] [MAIN ] BLW: Loaded 13190 primary data records. [2025-10-15T22:34:29.208396] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-15T22:34:29.222748] [INFO ] [MAIN ] Derivative Progress: 243/1803 symbols completed. BLDR took 1.2s. Estimated remaining: 9m 51s. Rate: 158.4 symbols/min [2025-10-15T22:34:29.253556] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:29.354295] [DEBUG] [LOCAL ] BLND: Loaded 49281 existing records from primary storage. [2025-10-15T22:34:29.364718] [INFO ] [MAIN ] BLND: Loaded 49281 primary data records. [2025-10-15T22:34:29.681854] [DEBUG] [LOCAL ] BLX: Loaded 15583 existing records from primary storage. [2025-10-15T22:34:29.704224] [INFO ] [MAIN ] BLX: Loaded 15583 primary data records. [2025-10-15T22:34:30.271627] [DEBUG] [MAIN ] BLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:30.272951] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13190 primary records. [2025-10-15T22:34:30.273152] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-15T22:34:30.291439] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-15T22:34:30.291749] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-15T22:34:30.294149] [INFO ] [MAIN ] Derivative Progress: 244/1803 symbols completed. BLW took 1.1s. Estimated remaining: 9m 55s. Rate: 157.2 symbols/min [2025-10-15T22:34:30.294451] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:30.311196] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:30.311967] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49281 primary records. [2025-10-15T22:34:30.312325] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-15T22:34:30.330514] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-15T22:34:30.330710] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-15T22:34:30.333482] [INFO ] [MAIN ] Derivative Progress: 245/1803 symbols completed. BLND took 1.2s. Estimated remaining: 9m 52s. Rate: 157.8 symbols/min [2025-10-15T22:34:30.333992] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:30.347870] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:30.348588] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15583 primary records. [2025-10-15T22:34:30.348812] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-15T22:34:30.374526] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-15T22:34:30.374813] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-15T22:34:30.377529] [INFO ] [MAIN ] Derivative Progress: 246/1803 symbols completed. BLX took 1.1s. Estimated remaining: 9m 50s. Rate: 158.3 symbols/min [2025-10-15T22:34:30.377754] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:30.387405] [DEBUG] [LOCAL ] BME: Loaded 11286 existing records from primary storage. [2025-10-15T22:34:30.399006] [INFO ] [MAIN ] BME: Loaded 11286 primary data records. [2025-10-15T22:34:30.412387] [DEBUG] [LOCAL ] BMA: Loaded 36165 existing records from primary storage. [2025-10-15T22:34:30.422628] [INFO ] [MAIN ] BMA: Loaded 36165 primary data records. [2025-10-15T22:34:30.632113] [DEBUG] [LOCAL ] BMEZ: Loaded 25911 existing records from primary storage. [2025-10-15T22:34:30.673225] [INFO ] [MAIN ] BMEZ: Loaded 25911 primary data records. [2025-10-15T22:34:31.396771] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:31.398254] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 36165 primary records. [2025-10-15T22:34:31.398403] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-15T22:34:31.397236] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:31.412771] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11286 primary records. [2025-10-15T22:34:31.413511] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:31.413614] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-15T22:34:31.421346] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 25911 primary records. [2025-10-15T22:34:31.423201] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-15T22:34:31.459859] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-15T22:34:31.461435] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-15T22:34:31.464373] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-15T22:34:31.464278] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-15T22:34:31.464157] [INFO ] [MAIN ] Derivative Progress: 247/1803 symbols completed. BME took 1.1s. Estimated remaining: 9m 54s. Rate: 157.2 symbols/min [2025-10-15T22:34:31.464669] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-15T22:34:31.467919] [INFO ] [MAIN ] Derivative Progress: 248/1803 symbols completed. BMA took 1.2s. Estimated remaining: 9m 51s. Rate: 157.8 symbols/min [2025-10-15T22:34:31.467833] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:31.464569] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-15T22:34:31.468192] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:31.471926] [INFO ] [MAIN ] Derivative Progress: 249/1803 symbols completed. BMEZ took 1.1s. Estimated remaining: 9m 49s. Rate: 158.4 symbols/min [2025-10-15T22:34:31.472272] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:31.476695] [DEBUG] [LOCAL ] BMN: Loaded 2596 existing records from primary storage. [2025-10-15T22:34:31.477024] [INFO ] [MAIN ] BMN: Loaded 2596 primary data records. [2025-10-15T22:34:31.649987] [DEBUG] [LOCAL ] BMI: Loaded 24500 existing records from primary storage. [2025-10-15T22:34:31.710593] [INFO ] [MAIN ] BMI: Loaded 24500 primary data records. [2025-10-15T22:34:31.942690] [DEBUG] [LOCAL ] BMO: Loaded 41237 existing records from primary storage. [2025-10-15T22:34:31.960114] [INFO ] [MAIN ] BMO: Loaded 41237 primary data records. [2025-10-15T22:34:32.494780] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7728 incomplete bins [2025-10-15T22:34:32.496893] [INFO ] [MAIN ] BMN: Generated 1790 derivative records from 2596 primary records. [2025-10-15T22:34:32.497149] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-15T22:34:32.513759] [DEBUG] [LOCAL ] BMN: Derivative data saved (1790 records). [2025-10-15T22:34:32.514173] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-15T22:34:32.516444] [INFO ] [MAIN ] Derivative Progress: 250/1803 symbols completed. BMN took 1.0s. Estimated remaining: 9m 52s. Rate: 157.3 symbols/min [2025-10-15T22:34:32.516668] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:32.534471] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:32.535312] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24500 primary records. [2025-10-15T22:34:32.535562] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-15T22:34:32.554740] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-15T22:34:32.554816] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-15T22:34:32.565330] [INFO ] [MAIN ] Derivative Progress: 251/1803 symbols completed. BMI took 1.1s. Estimated remaining: 9m 50s. Rate: 157.9 symbols/min [2025-10-15T22:34:32.570577] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:32.572359] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:32.573280] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41237 primary records. [2025-10-15T22:34:32.573472] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-15T22:34:32.603153] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-15T22:34:32.603406] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-15T22:34:32.606006] [INFO ] [MAIN ] Derivative Progress: 252/1803 symbols completed. BMO took 1.1s. Estimated remaining: 9m 47s. Rate: 158.4 symbols/min [2025-10-15T22:34:32.606323] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:32.624628] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-15T22:34:32.625007] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-15T22:34:32.822968] [DEBUG] [LOCAL ] BNED: Loaded 28621 existing records from primary storage. [2025-10-15T22:34:32.840860] [INFO ] [MAIN ] BNED: Loaded 28621 primary data records. [2025-10-15T22:34:32.980761] [DEBUG] [LOCAL ] BN: Loaded 52988 existing records from primary storage. [2025-10-15T22:34:33.002951] [INFO ] [MAIN ] BN: Loaded 52988 primary data records. [2025-10-15T22:34:33.629546] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:33.631544] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-15T22:34:33.631879] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-15T22:34:33.649904] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-15T22:34:33.650161] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-15T22:34:33.652548] [INFO ] [MAIN ] Derivative Progress: 253/1803 symbols completed. BMY took 1.1s. Estimated remaining: 9m 51s. Rate: 157.3 symbols/min [2025-10-15T22:34:33.668748] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:33.669582] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52988 primary records. [2025-10-15T22:34:33.670546] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-15T22:34:33.697602] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:33.698763] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 28621 primary records. [2025-10-15T22:34:33.699063] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-15T22:34:33.710310] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-15T22:34:33.713022] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-15T22:34:33.717013] [INFO ] [MAIN ] Derivative Progress: 254/1803 symbols completed. BN took 1.1s. Estimated remaining: 9m 49s. Rate: 157.8 symbols/min [2025-10-15T22:34:33.719532] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-15T22:34:33.719605] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-15T22:34:33.722105] [INFO ] [MAIN ] Derivative Progress: 255/1803 symbols completed. BNED took 1.1s. Estimated remaining: 9m 46s. Rate: 158.4 symbols/min [2025-10-15T22:34:33.722483] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:33.722989] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:33.722945] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:33.729206] [DEBUG] [LOCAL ] BNJ: Loaded 2607 existing records from primary storage. [2025-10-15T22:34:33.729460] [INFO ] [MAIN ] BNJ: Loaded 2607 primary data records. [2025-10-15T22:34:34.111812] [DEBUG] [LOCAL ] BNL: Loaded 47279 existing records from primary storage. [2025-10-15T22:34:34.112038] [INFO ] [MAIN ] BNL: Loaded 47279 primary data records. [2025-10-15T22:34:34.112887] [DEBUG] [LOCAL ] BNS: Loaded 51484 existing records from primary storage. [2025-10-15T22:34:34.150702] [INFO ] [MAIN ] BNS: Loaded 51484 primary data records. [2025-10-15T22:34:34.660024] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:34.733085] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2607 primary records. [2025-10-15T22:34:34.733853] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-15T22:34:34.753830] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-15T22:34:34.754628] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-15T22:34:34.757031] [INFO ] [MAIN ] Derivative Progress: 256/1803 symbols completed. BNJ took 1.0s. Estimated remaining: 9m 50s. Rate: 157.4 symbols/min [2025-10-15T22:34:34.757234] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:34.767638] [DEBUG] [LOCAL ] BNT: Loaded 3485 existing records from primary storage. [2025-10-15T22:34:34.780604] [INFO ] [MAIN ] BNT: Loaded 3485 primary data records. [2025-10-15T22:34:34.780895] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:34.802472] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47279 primary records. [2025-10-15T22:34:34.818628] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-15T22:34:34.899292] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-15T22:34:34.903444] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-15T22:34:34.906145] [INFO ] [MAIN ] Derivative Progress: 257/1803 symbols completed. BNL took 1.2s. Estimated remaining: 9m 48s. Rate: 157.8 symbols/min [2025-10-15T22:34:34.917699] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:35.000368] [DEBUG] [MAIN ] BNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:35.101200] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51484 primary records. [2025-10-15T22:34:35.114474] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-15T22:34:35.118925] [DEBUG] [LOCAL ] BNY: Loaded 7182 existing records from primary storage. [2025-10-15T22:34:35.119227] [INFO ] [MAIN ] BNY: Loaded 7182 primary data records. [2025-10-15T22:34:35.185847] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-15T22:34:35.211017] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-15T22:34:35.218758] [INFO ] [MAIN ] Derivative Progress: 258/1803 symbols completed. BNS took 1.5s. Estimated remaining: 9m 47s. Rate: 157.9 symbols/min [2025-10-15T22:34:35.231067] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:35.488580] [DEBUG] [LOCAL ] BOC: Loaded 18587 existing records from primary storage. [2025-10-15T22:34:35.489382] [INFO ] [MAIN ] BOC: Loaded 18587 primary data records. [2025-10-15T22:34:35.590833] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:35.608258] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3485 primary records. [2025-10-15T22:34:35.608626] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-15T22:34:35.836969] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-10-15T22:34:35.838164] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-15T22:34:35.841279] [INFO ] [MAIN ] Derivative Progress: 259/1803 symbols completed. BNT took 1.1s. Estimated remaining: 9m 48s. Rate: 157.5 symbols/min [2025-10-15T22:34:35.843990] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:35.858021] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:35.858932] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7182 primary records. [2025-10-15T22:34:35.859088] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-15T22:34:35.881564] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-15T22:34:35.887507] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-15T22:34:35.890804] [INFO ] [MAIN ] Derivative Progress: 260/1803 symbols completed. BNY took 1.0s. Estimated remaining: 9m 46s. Rate: 158.0 symbols/min [2025-10-15T22:34:35.891287] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:35.892374] [DEBUG] [LOCAL ] BOE: Loaded 18229 existing records from primary storage. [2025-10-15T22:34:35.892636] [INFO ] [MAIN ] BOE: Loaded 18229 primary data records. [2025-10-15T22:34:36.033290] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:36.064596] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18587 primary records. [2025-10-15T22:34:36.076334] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-15T22:34:36.116596] [DEBUG] [LOCAL ] BOH: Loaded 30544 existing records from primary storage. [2025-10-15T22:34:36.240220] [INFO ] [MAIN ] BOH: Loaded 30544 primary data records. [2025-10-15T22:34:36.321194] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-15T22:34:36.337325] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-15T22:34:36.350480] [INFO ] [MAIN ] Derivative Progress: 261/1803 symbols completed. BOC took 1.1s. Estimated remaining: 9m 46s. Rate: 157.9 symbols/min [2025-10-15T22:34:36.351050] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:36.572809] [DEBUG] [LOCAL ] BOND: Loaded 32426 existing records from primary storage. [2025-10-15T22:34:36.573344] [INFO ] [MAIN ] BOND: Loaded 32426 primary data records. [2025-10-15T22:34:36.587764] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:36.609522] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 18229 primary records. [2025-10-15T22:34:36.619580] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-15T22:34:36.690978] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-15T22:34:36.696557] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-15T22:34:36.709710] [INFO ] [MAIN ] Derivative Progress: 262/1803 symbols completed. BOE took 0.9s. Estimated remaining: 9m 46s. Rate: 157.9 symbols/min [2025-10-15T22:34:36.716005] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:36.925266] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:36.927364] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30544 primary records. [2025-10-15T22:34:36.927941] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-15T22:34:36.947219] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-15T22:34:36.957074] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-15T22:34:36.959569] [INFO ] [MAIN ] Derivative Progress: 263/1803 symbols completed. BOH took 1.1s. Estimated remaining: 9m 44s. Rate: 158.1 symbols/min [2025-10-15T22:34:36.960171] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:36.978843] [DEBUG] [LOCAL ] BOOT: Loaded 39827 existing records from primary storage. [2025-10-15T22:34:36.979183] [INFO ] [MAIN ] BOOT: Loaded 39827 primary data records. [2025-10-15T22:34:37.023346] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:37.054011] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32426 primary records. [2025-10-15T22:34:37.068406] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-15T22:34:37.118359] [DEBUG] [LOCAL ] BOW: Loaded 23268 existing records from primary storage. [2025-10-15T22:34:37.118949] [INFO ] [MAIN ] BOW: Loaded 23268 primary data records. [2025-10-15T22:34:37.288180] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-10-15T22:34:37.472022] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-15T22:34:37.474840] [INFO ] [MAIN ] Derivative Progress: 264/1803 symbols completed. BOND took 1.1s. Estimated remaining: 9m 45s. Rate: 157.9 symbols/min [2025-10-15T22:34:37.476121] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:37.768199] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:37.769594] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 39827 primary records. [2025-10-15T22:34:37.769886] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-15T22:34:37.800740] [DEBUG] [LOCAL ] BOX: Loaded 50190 existing records from primary storage. [2025-10-15T22:34:37.806811] [INFO ] [MAIN ] BOX: Loaded 50190 primary data records. [2025-10-15T22:34:37.891303] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:37.911133] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23268 primary records. [2025-10-15T22:34:37.918083] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-15T22:34:37.918214] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-15T22:34:37.917105] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-15T22:34:37.928800] [INFO ] [MAIN ] Derivative Progress: 265/1803 symbols completed. BOOT took 1.2s. Estimated remaining: 9m 45s. Rate: 157.8 symbols/min [2025-10-15T22:34:37.942155] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:38.058597] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-15T22:34:38.112146] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-15T22:34:38.118696] [INFO ] [MAIN ] Derivative Progress: 266/1803 symbols completed. BOW took 1.2s. Estimated remaining: 9m 43s. Rate: 158.1 symbols/min [2025-10-15T22:34:38.119179] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:38.288951] [DEBUG] [LOCAL ] BR: Loaded 34787 existing records from primary storage. [2025-10-15T22:34:38.289683] [INFO ] [MAIN ] BR: Loaded 34787 primary data records. [2025-10-15T22:34:38.517865] [DEBUG] [LOCAL ] BRBR: Loaded 51693 existing records from primary storage. [2025-10-15T22:34:38.546668] [INFO ] [MAIN ] BRBR: Loaded 51693 primary data records. [2025-10-15T22:34:38.770547] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:38.790300] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50190 primary records. [2025-10-15T22:34:38.829349] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-15T22:34:38.963669] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-15T22:34:38.964614] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-15T22:34:38.967463] [INFO ] [MAIN ] Derivative Progress: 267/1803 symbols completed. BOX took 1.5s. Estimated remaining: 9m 46s. Rate: 157.4 symbols/min [2025-10-15T22:34:39.069454] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:39.111464] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:39.112885] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34787 primary records. [2025-10-15T22:34:39.113099] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-15T22:34:39.121722] [DEBUG] [LOCAL ] BRC: Loaded 18601 existing records from primary storage. [2025-10-15T22:34:39.122194] [INFO ] [MAIN ] BRC: Loaded 18601 primary data records. [2025-10-15T22:34:39.210791] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-15T22:34:39.228042] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-15T22:34:39.230685] [INFO ] [MAIN ] Derivative Progress: 268/1803 symbols completed. BR took 1.3s. Estimated remaining: 9m 45s. Rate: 157.5 symbols/min [2025-10-15T22:34:39.308796] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:39.322751] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51693 primary records. [2025-10-15T22:34:39.344731] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-15T22:34:39.493174] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-15T22:34:39.494075] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-15T22:34:39.496674] [INFO ] [MAIN ] Derivative Progress: 269/1803 symbols completed. BRBR took 1.4s. Estimated remaining: 9m 44s. Rate: 157.7 symbols/min [2025-10-15T22:34:39.519943] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:39.520818] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18601 primary records. [2025-10-15T22:34:39.520884] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-15T22:34:39.536972] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-15T22:34:39.537076] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-15T22:34:39.539345] [INFO ] [MAIN ] Derivative Progress: 270/1803 symbols completed. BRC took 0.5s. Estimated remaining: 9m 41s. Rate: 158.2 symbols/min [2025-10-15T22:34:39.539791] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:39.539912] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:39.540003] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:39.603234] [DEBUG] [LOCAL ] BRO: Loaded 52061 existing records from primary storage. [2025-10-15T22:34:39.611420] [INFO ] [MAIN ] BRO: Loaded 52061 primary data records. [2025-10-15T22:34:39.750273] [DEBUG] [LOCAL ] BRCC: Loaded 40208 existing records from primary storage. [2025-10-15T22:34:39.784619] [INFO ] [MAIN ] BRCC: Loaded 40208 primary data records. [2025-10-15T22:34:39.813301] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-15T22:34:40.002871] [INFO ] [MAIN ] BROS: Loaded 53300 primary data records. [2025-10-15T22:34:40.581571] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:40.582504] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 52061 primary records. [2025-10-15T22:34:40.582720] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-15T22:34:40.602922] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-15T22:34:40.603323] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-15T22:34:40.605827] [INFO ] [MAIN ] Derivative Progress: 271/1803 symbols completed. BRO took 1.1s. Estimated remaining: 9m 45s. Rate: 157.2 symbols/min [2025-10-15T22:34:40.606017] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:40.636489] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:40.636748] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:40.638160] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53300 primary records. [2025-10-15T22:34:40.637532] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40208 primary records. [2025-10-15T22:34:40.638338] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-15T22:34:40.638292] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-15T22:34:40.668928] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-15T22:34:40.669996] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-15T22:34:40.672277] [INFO ] [MAIN ] Derivative Progress: 272/1803 symbols completed. BROS took 1.1s. Estimated remaining: 9m 43s. Rate: 157.7 symbols/min [2025-10-15T22:34:40.669890] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-15T22:34:40.672463] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:40.681168] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-15T22:34:40.683571] [INFO ] [MAIN ] Derivative Progress: 273/1803 symbols completed. BRCC took 1.1s. Estimated remaining: 9m 40s. Rate: 158.2 symbols/min [2025-10-15T22:34:40.683939] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:40.689715] [DEBUG] [LOCAL ] BRT: Loaded 5222 existing records from primary storage. [2025-10-15T22:34:40.700462] [INFO ] [MAIN ] BRT: Loaded 5222 primary data records. [2025-10-15T22:34:40.712299] [DEBUG] [LOCAL ] BRSP: Loaded 36808 existing records from primary storage. [2025-10-15T22:34:40.712416] [INFO ] [MAIN ] BRSP: Loaded 36808 primary data records. [2025-10-15T22:34:40.930359] [DEBUG] [LOCAL ] BRW: Loaded 20981 existing records from primary storage. [2025-10-15T22:34:40.951241] [INFO ] [MAIN ] BRW: Loaded 20981 primary data records. [2025-10-15T22:34:41.668514] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:41.669091] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:41.670523] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36808 primary records. [2025-10-15T22:34:41.670609] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-15T22:34:41.669950] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 5222 primary records. [2025-10-15T22:34:41.672232] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-15T22:34:41.699957] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-15T22:34:41.712116] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-15T22:34:41.713744] [DEBUG] [MAIN ] BRW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:41.717349] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 20981 primary records. [2025-10-15T22:34:41.718469] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-15T22:34:41.718572] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-15T22:34:41.716575] [INFO ] [MAIN ] Derivative Progress: 274/1803 symbols completed. BRT took 1.0s. Estimated remaining: 9m 43s. Rate: 157.2 symbols/min [2025-10-15T22:34:41.718707] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-15T22:34:41.722250] [INFO ] [MAIN ] Derivative Progress: 275/1803 symbols completed. BRSP took 1.1s. Estimated remaining: 9m 41s. Rate: 157.8 symbols/min [2025-10-15T22:34:41.722413] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:41.722170] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:41.738194] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-10-15T22:34:41.738465] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-15T22:34:41.740617] [INFO ] [MAIN ] Derivative Progress: 276/1803 symbols completed. BRW took 1.1s. Estimated remaining: 9m 39s. Rate: 158.3 symbols/min [2025-10-15T22:34:41.740909] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:41.758750] [DEBUG] [LOCAL ] BSL: Loaded 8231 existing records from primary storage. [2025-10-15T22:34:41.758959] [INFO ] [MAIN ] BSL: Loaded 8231 primary data records. [2025-10-15T22:34:41.868204] [DEBUG] [LOCAL ] BSBR: Loaded 35665 existing records from primary storage. [2025-10-15T22:34:41.886116] [INFO ] [MAIN ] BSBR: Loaded 35665 primary data records. [2025-10-15T22:34:42.186570] [DEBUG] [LOCAL ] BRX: Loaded 51797 existing records from primary storage. [2025-10-15T22:34:42.191876] [INFO ] [MAIN ] BRX: Loaded 51797 primary data records. [2025-10-15T22:34:42.713194] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:42.714026] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8231 primary records. [2025-10-15T22:34:42.714302] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-15T22:34:42.727498] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:42.728279] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35665 primary records. [2025-10-15T22:34:42.728719] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-15T22:34:42.743492] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-15T22:34:42.743776] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-15T22:34:42.746194] [INFO ] [MAIN ] Derivative Progress: 277/1803 symbols completed. BSL took 1.0s. Estimated remaining: 9m 42s. Rate: 157.4 symbols/min [2025-10-15T22:34:42.753004] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:42.764226] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-15T22:34:42.764592] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-15T22:34:42.766706] [INFO ] [MAIN ] Derivative Progress: 278/1803 symbols completed. BSBR took 1.0s. Estimated remaining: 9m 39s. Rate: 157.9 symbols/min [2025-10-15T22:34:42.774582] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:42.780062] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:42.785306] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51797 primary records. [2025-10-15T22:34:42.785480] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-15T22:34:42.805797] [DEBUG] [LOCAL ] BST: Loaded 18867 existing records from primary storage. [2025-10-15T22:34:42.806911] [INFO ] [MAIN ] BST: Loaded 18867 primary data records. [2025-10-15T22:34:42.867857] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-15T22:34:42.882305] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-15T22:34:42.885163] [INFO ] [MAIN ] Derivative Progress: 279/1803 symbols completed. BRX took 1.2s. Estimated remaining: 9m 38s. Rate: 158.3 symbols/min [2025-10-15T22:34:42.891260] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:42.915351] [DEBUG] [LOCAL ] BSTZ: Loaded 24906 existing records from primary storage. [2025-10-15T22:34:42.915477] [INFO ] [MAIN ] BSTZ: Loaded 24906 primary data records. [2025-10-15T22:34:43.484526] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-15T22:34:43.485685] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-15T22:34:43.799142] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:43.800217] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18867 primary records. [2025-10-15T22:34:43.800446] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-15T22:34:43.820398] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-15T22:34:43.820526] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-15T22:34:43.822793] [INFO ] [MAIN ] Derivative Progress: 280/1803 symbols completed. BST took 1.1s. Estimated remaining: 9m 40s. Rate: 157.5 symbols/min [2025-10-15T22:34:43.823014] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:43.839290] [DEBUG] [MAIN ] BSTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:43.840569] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24906 primary records. [2025-10-15T22:34:43.840790] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-15T22:34:43.844492] [DEBUG] [LOCAL ] BTA: Loaded 5669 existing records from primary storage. [2025-10-15T22:34:43.844804] [INFO ] [MAIN ] BTA: Loaded 5669 primary data records. [2025-10-15T22:34:43.899036] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-15T22:34:43.905835] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-15T22:34:43.920448] [INFO ] [MAIN ] Derivative Progress: 281/1803 symbols completed. BSTZ took 1.1s. Estimated remaining: 9m 38s. Rate: 157.9 symbols/min [2025-10-15T22:34:43.929163] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:44.064718] [DEBUG] [MAIN ] BSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:44.185480] [DEBUG] [LOCAL ] BTCM: Loaded 16911 existing records from primary storage. [2025-10-15T22:34:44.185194] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-10-15T22:34:44.185719] [INFO ] [MAIN ] BTCM: Loaded 16911 primary data records. [2025-10-15T22:34:44.185855] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-15T22:34:44.291528] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-10-15T22:34:44.309997] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-15T22:34:44.335238] [INFO ] [MAIN ] Derivative Progress: 282/1803 symbols completed. BSX took 1.4s. Estimated remaining: 9m 38s. Rate: 157.9 symbols/min [2025-10-15T22:34:44.373938] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:44.527843] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:44.528665] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5669 primary records. [2025-10-15T22:34:44.528941] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-15T22:34:44.544022] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-15T22:34:44.544226] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-15T22:34:44.546558] [INFO ] [MAIN ] Derivative Progress: 283/1803 symbols completed. BTA took 0.7s. Estimated remaining: 9m 37s. Rate: 158.1 symbols/min [2025-10-15T22:34:44.575997] [DEBUG] [MAIN ] BTCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:44.576527] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 16911 primary records. [2025-10-15T22:34:44.576585] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-15T22:34:44.591905] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-10-15T22:34:44.592103] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-15T22:34:44.607547] [INFO ] [MAIN ] Derivative Progress: 284/1803 symbols completed. BTCM took 0.7s. Estimated remaining: 9m 35s. Rate: 158.6 symbols/min [2025-10-15T22:34:44.609681] [DEBUG] [LOCAL ] BTE: Loaded 52736 existing records from primary storage. [2025-10-15T22:34:44.609832] [INFO ] [MAIN ] BTE: Loaded 52736 primary data records. [2025-10-15T22:34:44.912573] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:44.913484] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52736 primary records. [2025-10-15T22:34:44.913561] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-15T22:34:44.928661] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-15T22:34:44.928726] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-15T22:34:44.930671] [INFO ] [MAIN ] Derivative Progress: 285/1803 symbols completed. BTE took 0.6s. Estimated remaining: 9m 34s. Rate: 158.7 symbols/min [2025-10-15T22:34:44.931452] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:44.931332] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:44.931580] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:44.947385] [DEBUG] [LOCAL ] BTO: Loaded 8850 existing records from primary storage. [2025-10-15T22:34:44.947682] [INFO ] [MAIN ] BTO: Loaded 8850 primary data records. [2025-10-15T22:34:45.017252] [DEBUG] [LOCAL ] BTT: Loaded 15721 existing records from primary storage. [2025-10-15T22:34:45.040446] [INFO ] [MAIN ] BTT: Loaded 15721 primary data records. [2025-10-15T22:34:45.464934] [DEBUG] [LOCAL ] BTI: Loaded 53596 existing records from primary storage. [2025-10-15T22:34:45.508148] [INFO ] [MAIN ] BTI: Loaded 53596 primary data records. [2025-10-15T22:34:45.983975] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:45.984414] [DEBUG] [MAIN ] BTT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:45.986678] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8850 primary records. [2025-10-15T22:34:45.985731] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15721 primary records. [2025-10-15T22:34:45.986938] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-15T22:34:45.986883] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-15T22:34:46.020410] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-15T22:34:46.020558] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-15T22:34:46.023219] [INFO ] [MAIN ] Derivative Progress: 286/1803 symbols completed. BTO took 1.1s. Estimated remaining: 9m 37s. Rate: 157.6 symbols/min [2025-10-15T22:34:46.024317] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-15T22:34:46.024424] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-15T22:34:46.024571] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:46.027047] [INFO ] [MAIN ] Derivative Progress: 287/1803 symbols completed. BTT took 1.1s. Estimated remaining: 9m 35s. Rate: 158.2 symbols/min [2025-10-15T22:34:46.027438] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:46.045480] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:46.046299] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53596 primary records. [2025-10-15T22:34:46.046485] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-15T22:34:46.077155] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-15T22:34:46.077064] [DEBUG] [LOCAL ] BTZ: Loaded 22588 existing records from primary storage. [2025-10-15T22:34:46.089217] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-15T22:34:46.091788] [INFO ] [MAIN ] Derivative Progress: 288/1803 symbols completed. BTI took 1.2s. Estimated remaining: 9m 33s. Rate: 158.6 symbols/min [2025-10-15T22:34:46.091975] [INFO ] [MAIN ] BTZ: Loaded 22588 primary data records. [2025-10-15T22:34:46.092188] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:46.224707] [DEBUG] [LOCAL ] BUD: Loaded 52596 existing records from primary storage. [2025-10-15T22:34:46.224932] [DEBUG] [LOCAL ] BUI: Loaded 11893 existing records from primary storage. [2025-10-15T22:34:46.235790] [INFO ] [MAIN ] BUD: Loaded 52596 primary data records. [2025-10-15T22:34:46.235721] [INFO ] [MAIN ] BUI: Loaded 11893 primary data records. [2025-10-15T22:34:47.055881] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:47.056691] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22588 primary records. [2025-10-15T22:34:47.056969] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-15T22:34:47.075925] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-15T22:34:47.079297] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-15T22:34:47.081968] [INFO ] [MAIN ] Derivative Progress: 289/1803 symbols completed. BTZ took 1.1s. Estimated remaining: 9m 36s. Rate: 157.8 symbols/min [2025-10-15T22:34:47.089842] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:47.107625] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:47.109054] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52596 primary records. [2025-10-15T22:34:47.109264] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-15T22:34:47.109933] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:47.110896] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11893 primary records. [2025-10-15T22:34:47.111215] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-15T22:34:47.135380] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-15T22:34:47.135523] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-15T22:34:47.138740] [INFO ] [MAIN ] Derivative Progress: 290/1803 symbols completed. BUD took 1.1s. Estimated remaining: 9m 34s. Rate: 158.2 symbols/min [2025-10-15T22:34:47.143085] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:47.148523] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-15T22:34:47.148729] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-15T22:34:47.151492] [INFO ] [MAIN ] Derivative Progress: 291/1803 symbols completed. BUI took 1.1s. Estimated remaining: 9m 31s. Rate: 158.7 symbols/min [2025-10-15T22:34:47.151749] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:47.197575] [DEBUG] [LOCAL ] BUR: Loaded 45344 existing records from primary storage. [2025-10-15T22:34:47.206870] [INFO ] [MAIN ] BUR: Loaded 45344 primary data records. [2025-10-15T22:34:47.343988] [DEBUG] [LOCAL ] BURL: Loaded 45707 existing records from primary storage. [2025-10-15T22:34:47.337881] [DEBUG] [LOCAL ] BVN: Loaded 44301 existing records from primary storage. [2025-10-15T22:34:47.354458] [INFO ] [MAIN ] BVN: Loaded 44301 primary data records. [2025-10-15T22:34:47.359725] [INFO ] [MAIN ] BURL: Loaded 45707 primary data records. [2025-10-15T22:34:48.195952] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:48.197387] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45344 primary records. [2025-10-15T22:34:48.197789] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-15T22:34:48.216825] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-15T22:34:48.217750] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-15T22:34:48.221966] [INFO ] [MAIN ] Derivative Progress: 292/1803 symbols completed. BUR took 1.1s. Estimated remaining: 9m 35s. Rate: 157.8 symbols/min [2025-10-15T22:34:48.235154] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:48.236582] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:48.250881] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45707 primary records. [2025-10-15T22:34:48.251499] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-15T22:34:48.251257] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:48.252873] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44301 primary records. [2025-10-15T22:34:48.253493] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-15T22:34:48.286326] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-15T22:34:48.282241] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-15T22:34:48.286753] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-15T22:34:48.286864] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-15T22:34:48.289362] [INFO ] [MAIN ] Derivative Progress: 293/1803 symbols completed. BVN took 1.1s. Estimated remaining: 9m 33s. Rate: 158.2 symbols/min [2025-10-15T22:34:48.292587] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:48.292698] [INFO ] [MAIN ] Derivative Progress: 294/1803 symbols completed. BURL took 1.1s. Estimated remaining: 9m 30s. Rate: 158.7 symbols/min [2025-10-15T22:34:48.293851] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:48.318420] [DEBUG] [LOCAL ] BWG: Loaded 12586 existing records from primary storage. [2025-10-15T22:34:48.318628] [INFO ] [MAIN ] BWG: Loaded 12586 primary data records. [2025-10-15T22:34:48.446528] [DEBUG] [LOCAL ] BW: Loaded 40513 existing records from primary storage. [2025-10-15T22:34:48.447065] [INFO ] [MAIN ] BW: Loaded 40513 primary data records. [2025-10-15T22:34:48.776043] [DEBUG] [LOCAL ] BWA: Loaded 52138 existing records from primary storage. [2025-10-15T22:34:48.786723] [INFO ] [MAIN ] BWA: Loaded 52138 primary data records. [2025-10-15T22:34:49.349891] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:49.351233] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12586 primary records. [2025-10-15T22:34:49.351449] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-15T22:34:49.384984] [DEBUG] [MAIN ] BW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:49.386323] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-15T22:34:49.387547] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-15T22:34:49.387337] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 40513 primary records. [2025-10-15T22:34:49.390322] [INFO ] [MAIN ] Derivative Progress: 295/1803 symbols completed. BWG took 1.1s. Estimated remaining: 9m 34s. Rate: 157.7 symbols/min [2025-10-15T22:34:49.387861] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-15T22:34:49.391238] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:49.424807] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-15T22:34:49.424957] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-15T22:34:49.427093] [INFO ] [MAIN ] Derivative Progress: 296/1803 symbols completed. BW took 1.2s. Estimated remaining: 9m 32s. Rate: 158.2 symbols/min [2025-10-15T22:34:49.424730] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:49.431248] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52138 primary records. [2025-10-15T22:34:49.431343] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:49.431574] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-15T22:34:49.456369] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-15T22:34:49.456550] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-15T22:34:49.458949] [INFO ] [MAIN ] Derivative Progress: 297/1803 symbols completed. BWA took 1.2s. Estimated remaining: 9m 29s. Rate: 158.7 symbols/min [2025-10-15T22:34:49.461331] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:49.467118] [DEBUG] [LOCAL ] BWMX: Loaded 7781 existing records from primary storage. [2025-10-15T22:34:49.478405] [INFO ] [MAIN ] BWMX: Loaded 7781 primary data records. [2025-10-15T22:34:49.479148] [DEBUG] [LOCAL ] BWLP: Loaded 32251 existing records from primary storage. [2025-10-15T22:34:49.513677] [DEBUG] [LOCAL ] BWNB: Loaded 4206 existing records from primary storage. [2025-10-15T22:34:49.510928] [INFO ] [MAIN ] BWLP: Loaded 32251 primary data records. [2025-10-15T22:34:49.538126] [INFO ] [MAIN ] BWNB: Loaded 4206 primary data records. [2025-10-15T22:34:50.443270] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:50.443015] [DEBUG] [MAIN ] BWMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:50.456908] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32251 primary records. [2025-10-15T22:34:50.458260] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7781 primary records. [2025-10-15T22:34:50.457350] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-15T22:34:50.457279] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:50.459167] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4206 primary records. [2025-10-15T22:34:50.459691] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-15T22:34:50.459587] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-15T22:34:50.500434] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-15T22:34:50.501092] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-15T22:34:50.504039] [INFO ] [MAIN ] Derivative Progress: 298/1803 symbols completed. BWNB took 1.0s. Estimated remaining: 9m 32s. Rate: 157.8 symbols/min [2025-10-15T22:34:50.507531] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-15T22:34:50.508389] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-15T22:34:50.508497] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-15T22:34:50.508568] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-15T22:34:50.510629] [INFO ] [MAIN ] Derivative Progress: 299/1803 symbols completed. BWLP took 1.1s. Estimated remaining: 9m 30s. Rate: 158.3 symbols/min [2025-10-15T22:34:50.513456] [INFO ] [MAIN ] Derivative Progress: 300/1803 symbols completed. BWMX took 1.1s. Estimated remaining: 9m 28s. Rate: 158.8 symbols/min [2025-10-15T22:34:50.513980] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:50.514096] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:50.513903] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:50.525360] [DEBUG] [LOCAL ] BWSN: Loaded 5154 existing records from primary storage. [2025-10-15T22:34:50.525541] [INFO ] [MAIN ] BWSN: Loaded 5154 primary data records. [2025-10-15T22:34:50.885469] [DEBUG] [LOCAL ] BWXT: Loaded 47121 existing records from primary storage. [2025-10-15T22:34:50.885778] [INFO ] [MAIN ] BWXT: Loaded 47121 primary data records. [2025-10-15T22:34:50.992272] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-15T22:34:51.005593] [INFO ] [MAIN ] BX: Loaded 53483 primary data records. [2025-10-15T22:34:51.572894] [DEBUG] [MAIN ] BWSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:51.574236] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5154 primary records. [2025-10-15T22:34:51.574455] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-15T22:34:51.590669] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-15T22:34:51.590878] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-15T22:34:51.593141] [INFO ] [MAIN ] Derivative Progress: 301/1803 symbols completed. BWSN took 1.1s. Estimated remaining: 9m 31s. Rate: 157.8 symbols/min [2025-10-15T22:34:51.593302] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:51.610869] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:51.611525] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 47121 primary records. [2025-10-15T22:34:51.611724] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-15T22:34:51.642934] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-15T22:34:51.643242] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-15T22:34:51.641753] [DEBUG] [LOCAL ] BXC: Loaded 13669 existing records from primary storage. [2025-10-15T22:34:51.645789] [INFO ] [MAIN ] Derivative Progress: 302/1803 symbols completed. BWXT took 1.1s. Estimated remaining: 9m 29s. Rate: 158.3 symbols/min [2025-10-15T22:34:51.645959] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:51.647499] [INFO ] [MAIN ] BXC: Loaded 13669 primary data records. [2025-10-15T22:34:51.765009] [DEBUG] [MAIN ] BX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:51.771562] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53483 primary records. [2025-10-15T22:34:51.781963] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-15T22:34:51.984766] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-15T22:34:51.998675] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-15T22:34:52.001032] [INFO ] [MAIN ] Derivative Progress: 303/1803 symbols completed. BX took 1.5s. Estimated remaining: 9m 29s. Rate: 158.3 symbols/min [2025-10-15T22:34:52.001198] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:52.003884] [DEBUG] [LOCAL ] BXMT: Loaded 47317 existing records from primary storage. [2025-10-15T22:34:52.004546] [INFO ] [MAIN ] BXMT: Loaded 47317 primary data records. [2025-10-15T22:34:52.192910] [DEBUG] [LOCAL ] BXMX: Loaded 19492 existing records from primary storage. [2025-10-15T22:34:52.301044] [INFO ] [MAIN ] BXMX: Loaded 19492 primary data records. [2025-10-15T22:34:52.446606] [DEBUG] [MAIN ] BXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:52.496094] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13669 primary records. [2025-10-15T22:34:52.516951] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-15T22:34:52.652830] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-15T22:34:52.653371] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-15T22:34:52.655694] [INFO ] [MAIN ] Derivative Progress: 304/1803 symbols completed. BXC took 1.1s. Estimated remaining: 9m 29s. Rate: 157.9 symbols/min [2025-10-15T22:34:52.656922] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:52.671757] [DEBUG] [MAIN ] BXMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:52.673515] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47317 primary records. [2025-10-15T22:34:52.673604] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-15T22:34:52.692221] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-15T22:34:52.693319] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-15T22:34:52.696509] [INFO ] [MAIN ] Derivative Progress: 305/1803 symbols completed. BXMT took 1.1s. Estimated remaining: 9m 27s. Rate: 158.4 symbols/min [2025-10-15T22:34:52.697676] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:52.711222] [DEBUG] [MAIN ] BXMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:52.712002] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19492 primary records. [2025-10-15T22:34:52.712111] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-15T22:34:52.738310] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-15T22:34:52.738382] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-15T22:34:52.740865] [INFO ] [MAIN ] Derivative Progress: 306/1803 symbols completed. BXMX took 0.7s. Estimated remaining: 9m 25s. Rate: 158.9 symbols/min [2025-10-15T22:34:52.741209] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:52.763917] [DEBUG] [LOCAL ] BXP: Loaded 49889 existing records from primary storage. [2025-10-15T22:34:52.768411] [INFO ] [MAIN ] BXP: Loaded 49889 primary data records. [2025-10-15T22:34:52.875612] [DEBUG] [LOCAL ] BY: Loaded 21823 existing records from primary storage. [2025-10-15T22:34:52.890829] [INFO ] [MAIN ] BY: Loaded 21823 primary data records. [2025-10-15T22:34:53.085276] [DEBUG] [LOCAL ] BXSL: Loaded 48119 existing records from primary storage. [2025-10-15T22:34:53.085685] [INFO ] [MAIN ] BXSL: Loaded 48119 primary data records. [2025-10-15T22:34:53.783787] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:53.785296] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49889 primary records. [2025-10-15T22:34:53.786469] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-15T22:34:53.819100] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:53.822986] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-15T22:34:53.821765] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21823 primary records. [2025-10-15T22:34:53.823246] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-15T22:34:53.823168] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-15T22:34:53.826476] [INFO ] [MAIN ] Derivative Progress: 307/1803 symbols completed. BXP took 1.2s. Estimated remaining: 9m 29s. Rate: 157.9 symbols/min [2025-10-15T22:34:53.827323] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:53.847007] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-15T22:34:53.847289] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-15T22:34:53.861801] [INFO ] [MAIN ] Derivative Progress: 308/1803 symbols completed. BY took 1.1s. Estimated remaining: 9m 26s. Rate: 158.4 symbols/min [2025-10-15T22:34:53.862871] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:53.862767] [DEBUG] [MAIN ] BXSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:53.864158] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 48119 primary records. [2025-10-15T22:34:53.864326] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-15T22:34:53.883915] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-15T22:34:53.883985] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-15T22:34:53.887220] [INFO ] [MAIN ] Derivative Progress: 309/1803 symbols completed. BXSL took 1.2s. Estimated remaining: 9m 24s. Rate: 158.8 symbols/min [2025-10-15T22:34:53.887465] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:53.893529] [DEBUG] [LOCAL ] BYM: Loaded 11722 existing records from primary storage. [2025-10-15T22:34:53.893875] [INFO ] [MAIN ] BYM: Loaded 11722 primary data records. [2025-10-15T22:34:54.043142] [DEBUG] [LOCAL ] BYD: Loaded 44894 existing records from primary storage. [2025-10-15T22:34:54.043491] [INFO ] [MAIN ] BYD: Loaded 44894 primary data records. [2025-10-15T22:34:54.369820] [DEBUG] [LOCAL ] BZH: Loaded 32426 existing records from primary storage. [2025-10-15T22:34:54.388554] [INFO ] [MAIN ] BZH: Loaded 32426 primary data records. [2025-10-15T22:34:54.934978] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:54.935882] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11722 primary records. [2025-10-15T22:34:54.936097] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-15T22:34:54.955839] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-15T22:34:54.957065] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-15T22:34:54.959696] [INFO ] [MAIN ] Derivative Progress: 310/1803 symbols completed. BYM took 1.1s. Estimated remaining: 9m 27s. Rate: 157.9 symbols/min [2025-10-15T22:34:54.960083] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:54.973928] [DEBUG] [MAIN ] BYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:54.975249] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44894 primary records. [2025-10-15T22:34:54.975664] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-15T22:34:54.993110] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-15T22:34:54.994232] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-15T22:34:54.998523] [INFO ] [MAIN ] Derivative Progress: 311/1803 symbols completed. BYD took 1.2s. Estimated remaining: 9m 25s. Rate: 158.4 symbols/min [2025-10-15T22:34:54.999195] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:55.013547] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:55.014448] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32426 primary records. [2025-10-15T22:34:55.014584] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-15T22:34:55.032198] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-15T22:34:55.032408] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-15T22:34:55.035430] [INFO ] [MAIN ] Derivative Progress: 312/1803 symbols completed. BZH took 1.1s. Estimated remaining: 9m 23s. Rate: 158.8 symbols/min [2025-10-15T22:34:55.035693] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:55.065404] [DEBUG] [LOCAL ] CAAP: Loaded 19831 existing records from primary storage. [2025-10-15T22:34:55.065615] [INFO ] [MAIN ] CAAP: Loaded 19831 primary data records. [2025-10-15T22:34:55.187046] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-15T22:34:55.190892] [INFO ] [MAIN ] C: Loaded 53740 primary data records. [2025-10-15T22:34:55.285929] [DEBUG] [LOCAL ] CACI: Loaded 23152 existing records from primary storage. [2025-10-15T22:34:55.347784] [INFO ] [MAIN ] CACI: Loaded 23152 primary data records. [2025-10-15T22:34:56.108283] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:56.109476] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19831 primary records. [2025-10-15T22:34:56.110081] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-15T22:34:56.127803] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-15T22:34:56.128129] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-15T22:34:56.130375] [INFO ] [MAIN ] Derivative Progress: 313/1803 symbols completed. CAAP took 1.1s. Estimated remaining: 9m 26s. Rate: 157.9 symbols/min [2025-10-15T22:34:56.147327] [DEBUG] [MAIN ] C: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:56.148191] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53740 primary records. [2025-10-15T22:34:56.148301] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-15T22:34:56.177791] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:56.179412] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 23152 primary records. [2025-10-15T22:34:56.179998] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-15T22:34:56.182246] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-15T22:34:56.182547] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-15T22:34:56.192453] [INFO ] [MAIN ] Derivative Progress: 314/1803 symbols completed. C took 1.2s. Estimated remaining: 9m 24s. Rate: 158.3 symbols/min [2025-10-15T22:34:56.200042] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-15T22:34:56.200108] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-15T22:34:56.202937] [INFO ] [MAIN ] Derivative Progress: 315/1803 symbols completed. CACI took 1.2s. Estimated remaining: 9m 22s. Rate: 158.8 symbols/min [2025-10-15T22:34:56.203542] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:56.203465] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:56.204139] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:56.211917] [DEBUG] [LOCAL ] CAF: Loaded 3465 existing records from primary storage. [2025-10-15T22:34:56.212056] [INFO ] [MAIN ] CAF: Loaded 3465 primary data records. [2025-10-15T22:34:56.542122] [DEBUG] [LOCAL ] CAE: Loaded 39206 existing records from primary storage. [2025-10-15T22:34:56.556722] [INFO ] [MAIN ] CAE: Loaded 39206 primary data records. [2025-10-15T22:34:56.568925] [DEBUG] [LOCAL ] CADE: Loaded 49483 existing records from primary storage. [2025-10-15T22:34:56.569691] [INFO ] [MAIN ] CADE: Loaded 49483 primary data records. [2025-10-15T22:34:57.194519] [DEBUG] [MAIN ] CAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:57.196552] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3465 primary records. [2025-10-15T22:34:57.196840] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-15T22:34:57.214205] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-15T22:34:57.214528] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-15T22:34:57.217781] [INFO ] [MAIN ] Derivative Progress: 316/1803 symbols completed. CAF took 1.0s. Estimated remaining: 9m 25s. Rate: 157.9 symbols/min [2025-10-15T22:34:57.218615] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:57.256210] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:57.255883] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:57.257234] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49483 primary records. [2025-10-15T22:34:57.257916] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39206 primary records. [2025-10-15T22:34:57.258074] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-15T22:34:57.258010] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-15T22:34:57.292776] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-15T22:34:57.305933] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-15T22:34:57.306834] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-15T22:34:57.310091] [INFO ] [MAIN ] Derivative Progress: 317/1803 symbols completed. CADE took 1.1s. Estimated remaining: 9m 23s. Rate: 158.3 symbols/min [2025-10-15T22:34:57.307080] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-15T22:34:57.312799] [INFO ] [MAIN ] Derivative Progress: 318/1803 symbols completed. CAE took 1.1s. Estimated remaining: 9m 21s. Rate: 158.8 symbols/min [2025-10-15T22:34:57.312710] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:57.313482] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:57.333504] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-15T22:34:57.333831] [INFO ] [MAIN ] CAG: Loaded 53665 primary data records. [2025-10-15T22:34:57.677532] [DEBUG] [LOCAL ] CALX: Loaded 37642 existing records from primary storage. [2025-10-15T22:34:57.677805] [INFO ] [MAIN ] CALX: Loaded 37642 primary data records. [2025-10-15T22:34:57.799722] [DEBUG] [LOCAL ] CAH: Loaded 51461 existing records from primary storage. [2025-10-15T22:34:57.826451] [INFO ] [MAIN ] CAH: Loaded 51461 primary data records. [2025-10-15T22:34:58.307580] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:58.308426] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53665 primary records. [2025-10-15T22:34:58.308718] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-15T22:34:58.327352] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-15T22:34:58.327531] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-15T22:34:58.329873] [INFO ] [MAIN ] Derivative Progress: 319/1803 symbols completed. CAG took 1.1s. Estimated remaining: 9m 24s. Rate: 158.0 symbols/min [2025-10-15T22:34:58.330062] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:58.347341] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:58.348369] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37642 primary records. [2025-10-15T22:34:58.348557] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-15T22:34:58.372182] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-15T22:34:58.372374] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-15T22:34:58.374692] [INFO ] [MAIN ] Derivative Progress: 320/1803 symbols completed. CALX took 1.1s. Estimated remaining: 9m 22s. Rate: 158.4 symbols/min [2025-10-15T22:34:58.374947] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:58.387142] [DEBUG] [LOCAL ] CANG: Loaded 26919 existing records from primary storage. [2025-10-15T22:34:58.387376] [INFO ] [MAIN ] CANG: Loaded 26919 primary data records. [2025-10-15T22:34:58.444892] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:58.468497] [DEBUG] [LOCAL ] CAPL: Loaded 5642 existing records from primary storage. [2025-10-15T22:34:58.459796] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51461 primary records. [2025-10-15T22:34:58.480288] [INFO ] [MAIN ] CAPL: Loaded 5642 primary data records. [2025-10-15T22:34:58.485457] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-15T22:34:59.003724] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-15T22:34:59.012317] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-15T22:34:59.014690] [INFO ] [MAIN ] Derivative Progress: 321/1803 symbols completed. CAH took 1.7s. Estimated remaining: 9m 23s. Rate: 158.1 symbols/min [2025-10-15T22:34:59.015590] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:59.047495] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:59.061243] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5642 primary records. [2025-10-15T22:34:59.061321] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-15T22:34:59.060563] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:34:59.062379] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26919 primary records. [2025-10-15T22:34:59.062864] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-15T22:34:59.104952] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-15T22:34:59.106555] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-15T22:34:59.108900] [INFO ] [MAIN ] Derivative Progress: 322/1803 symbols completed. CAPL took 0.7s. Estimated remaining: 9m 21s. Rate: 158.4 symbols/min [2025-10-15T22:34:59.110078] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:59.110318] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-15T22:34:59.110737] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-15T22:34:59.112837] [INFO ] [MAIN ] Derivative Progress: 323/1803 symbols completed. CANG took 0.8s. Estimated remaining: 9m 19s. Rate: 158.9 symbols/min [2025-10-15T22:34:59.113169] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:34:59.133243] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-15T22:34:59.133516] [INFO ] [MAIN ] CARR: Loaded 53602 primary data records. [2025-10-15T22:34:59.502170] [DEBUG] [LOCAL ] CARS: Loaded 39797 existing records from primary storage. [2025-10-15T22:34:59.511084] [INFO ] [MAIN ] CARS: Loaded 39797 primary data records. [2025-10-15T22:34:59.664297] [DEBUG] [LOCAL ] CAT: Loaded 52958 existing records from primary storage. [2025-10-15T22:34:59.692226] [INFO ] [MAIN ] CAT: Loaded 52958 primary data records. [2025-10-15T22:35:00.149882] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:00.150795] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53602 primary records. [2025-10-15T22:35:00.151040] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-15T22:35:00.173812] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-15T22:35:00.174581] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-15T22:35:00.176795] [INFO ] [MAIN ] Derivative Progress: 324/1803 symbols completed. CARR took 1.2s. Estimated remaining: 9m 22s. Rate: 158.0 symbols/min [2025-10-15T22:35:00.177256] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:00.191957] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:00.192810] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39797 primary records. [2025-10-15T22:35:00.193257] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-15T22:35:00.211251] [DEBUG] [LOCAL ] CATO: Loaded 6687 existing records from primary storage. [2025-10-15T22:35:00.211370] [INFO ] [MAIN ] CATO: Loaded 6687 primary data records. [2025-10-15T22:35:00.318285] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-15T22:35:00.318544] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-15T22:35:00.342974] [INFO ] [MAIN ] Derivative Progress: 325/1803 symbols completed. CARS took 1.2s. Estimated remaining: 9m 20s. Rate: 158.3 symbols/min [2025-10-15T22:35:00.353936] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:00.359880] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52958 primary records. [2025-10-15T22:35:00.360111] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:00.360002] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-15T22:35:00.545750] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-15T22:35:00.546532] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-15T22:35:00.549668] [INFO ] [MAIN ] Derivative Progress: 326/1803 symbols completed. CAT took 1.4s. Estimated remaining: 9m 19s. Rate: 158.5 symbols/min [2025-10-15T22:35:00.550241] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:00.588301] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:00.589127] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 6687 primary records. [2025-10-15T22:35:00.589265] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-15T22:35:00.628930] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-15T22:35:00.630201] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-15T22:35:00.632213] [INFO ] [MAIN ] Derivative Progress: 327/1803 symbols completed. CATO took 0.5s. Estimated remaining: 9m 17s. Rate: 158.9 symbols/min [2025-10-15T22:35:00.630121] [DEBUG] [LOCAL ] CAVA: Loaded 53567 existing records from primary storage. [2025-10-15T22:35:00.632458] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:00.632581] [INFO ] [MAIN ] CAVA: Loaded 53567 primary data records. [2025-10-15T22:35:00.729425] [DEBUG] [LOCAL ] CB: Loaded 49940 existing records from primary storage. [2025-10-15T22:35:00.735089] [INFO ] [MAIN ] CB: Loaded 49940 primary data records. [2025-10-15T22:35:00.793423] [DEBUG] [LOCAL ] CBAN: Loaded 10503 existing records from primary storage. [2025-10-15T22:35:00.848514] [INFO ] [MAIN ] CBAN: Loaded 10503 primary data records. [2025-10-15T22:35:01.650517] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:01.652964] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53567 primary records. [2025-10-15T22:35:01.653269] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-15T22:35:01.677322] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:01.682691] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49940 primary records. [2025-10-15T22:35:01.685344] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-15T22:35:01.688294] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-15T22:35:01.689499] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-15T22:35:01.699800] [INFO ] [MAIN ] Derivative Progress: 328/1803 symbols completed. CAVA took 1.3s. Estimated remaining: 9m 20s. Rate: 158.0 symbols/min [2025-10-15T22:35:01.724228] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-15T22:35:01.724570] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:01.725559] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10503 primary records. [2025-10-15T22:35:01.725673] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-15T22:35:01.727837] [INFO ] [MAIN ] Derivative Progress: 329/1803 symbols completed. CB took 1.2s. Estimated remaining: 9m 18s. Rate: 158.5 symbols/min [2025-10-15T22:35:01.728019] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-15T22:35:01.744191] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-15T22:35:01.744334] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-15T22:35:01.746892] [INFO ] [MAIN ] Derivative Progress: 330/1803 symbols completed. CBAN took 1.1s. Estimated remaining: 9m 16s. Rate: 158.9 symbols/min [2025-10-15T22:35:01.747409] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:01.747363] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:01.747471] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:01.755182] [DEBUG] [LOCAL ] CBNA: Loaded 2920 existing records from primary storage. [2025-10-15T22:35:01.755363] [INFO ] [MAIN ] CBNA: Loaded 2920 primary data records. [2025-10-15T22:35:01.880931] [DEBUG] [LOCAL ] CBL: Loaded 16293 existing records from primary storage. [2025-10-15T22:35:01.905411] [INFO ] [MAIN ] CBL: Loaded 16293 primary data records. [2025-10-15T22:35:02.230066] [DEBUG] [LOCAL ] CBRE: Loaded 50361 existing records from primary storage. [2025-10-15T22:35:02.236574] [INFO ] [MAIN ] CBRE: Loaded 50361 primary data records. [2025-10-15T22:35:02.788007] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:02.788927] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2920 primary records. [2025-10-15T22:35:02.789781] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-15T22:35:02.807685] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-15T22:35:02.807914] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-15T22:35:02.810187] [INFO ] [MAIN ] Derivative Progress: 331/1803 symbols completed. CBNA took 1.1s. Estimated remaining: 9m 19s. Rate: 158.1 symbols/min [2025-10-15T22:35:02.810422] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:02.825459] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:02.826621] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16293 primary records. [2025-10-15T22:35:02.827201] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-15T22:35:02.849464] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-15T22:35:02.849790] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-15T22:35:02.851696] [INFO ] [MAIN ] Derivative Progress: 332/1803 symbols completed. CBL took 1.1s. Estimated remaining: 9m 17s. Rate: 158.5 symbols/min [2025-10-15T22:35:02.851970] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:02.865351] [DEBUG] [LOCAL ] CBU: Loaded 22717 existing records from primary storage. [2025-10-15T22:35:02.865771] [INFO ] [MAIN ] CBU: Loaded 22717 primary data records. [2025-10-15T22:35:02.884255] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:02.910220] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50361 primary records. [2025-10-15T22:35:02.932905] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-15T22:35:03.224187] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-15T22:35:03.349672] [DEBUG] [LOCAL ] CC: Loaded 53013 existing records from primary storage. [2025-10-15T22:35:03.348532] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-15T22:35:03.350462] [INFO ] [MAIN ] CC: Loaded 53013 primary data records. [2025-10-15T22:35:03.352965] [INFO ] [MAIN ] Derivative Progress: 333/1803 symbols completed. CBRE took 1.6s. Estimated remaining: 9m 17s. Rate: 158.3 symbols/min [2025-10-15T22:35:03.353228] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:03.700761] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:03.716750] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22717 primary records. [2025-10-15T22:35:03.717854] [DEBUG] [LOCAL ] CCI: Loaded 53117 existing records from primary storage. [2025-10-15T22:35:03.716921] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-15T22:35:03.718078] [INFO ] [MAIN ] CCI: Loaded 53117 primary data records. [2025-10-15T22:35:03.835977] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-15T22:35:03.841844] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-15T22:35:03.843747] [INFO ] [MAIN ] Derivative Progress: 334/1803 symbols completed. CBU took 1.0s. Estimated remaining: 9m 17s. Rate: 158.2 symbols/min [2025-10-15T22:35:03.843896] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:04.045844] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:04.047206] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53013 primary records. [2025-10-15T22:35:04.047331] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-15T22:35:04.053584] [DEBUG] [LOCAL ] CCIF: Loaded 15528 existing records from primary storage. [2025-10-15T22:35:04.053924] [INFO ] [MAIN ] CCIF: Loaded 15528 primary data records. [2025-10-15T22:35:04.203113] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-15T22:35:04.203453] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-15T22:35:04.262165] [INFO ] [MAIN ] Derivative Progress: 335/1803 symbols completed. CC took 1.4s. Estimated remaining: 9m 17s. Rate: 158.1 symbols/min [2025-10-15T22:35:04.377723] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:04.403773] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:04.404986] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53117 primary records. [2025-10-15T22:35:04.406596] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-15T22:35:04.425751] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-15T22:35:04.425914] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-15T22:35:04.428701] [INFO ] [MAIN ] Derivative Progress: 336/1803 symbols completed. CCI took 1.1s. Estimated remaining: 9m 16s. Rate: 158.4 symbols/min [2025-10-15T22:35:04.429033] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:04.461804] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:04.462563] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15528 primary records. [2025-10-15T22:35:04.462695] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-15T22:35:04.499262] [DEBUG] [LOCAL ] CCJ: Loaded 53688 existing records from primary storage. [2025-10-15T22:35:04.499464] [INFO ] [MAIN ] CCJ: Loaded 53688 primary data records. [2025-10-15T22:35:04.532229] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-15T22:35:04.563912] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-15T22:35:04.592764] [INFO ] [MAIN ] Derivative Progress: 337/1803 symbols completed. CCIF took 0.7s. Estimated remaining: 9m 14s. Rate: 158.7 symbols/min [2025-10-15T22:35:04.614749] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:04.821098] [DEBUG] [LOCAL ] CCK: Loaded 46451 existing records from primary storage. [2025-10-15T22:35:04.821448] [INFO ] [MAIN ] CCK: Loaded 46451 primary data records. [2025-10-15T22:35:05.156564] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-15T22:35:05.157537] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-15T22:35:05.341001] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:05.519010] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53688 primary records. [2025-10-15T22:35:05.519437] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-15T22:35:05.537297] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-15T22:35:05.538279] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-15T22:35:05.540261] [INFO ] [MAIN ] Derivative Progress: 338/1803 symbols completed. CCJ took 1.2s. Estimated remaining: 9m 16s. Rate: 158.0 symbols/min [2025-10-15T22:35:05.540415] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:05.557895] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:05.558571] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46451 primary records. [2025-10-15T22:35:05.558784] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-15T22:35:05.577758] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-15T22:35:05.578836] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-15T22:35:05.582932] [INFO ] [MAIN ] Derivative Progress: 339/1803 symbols completed. CCK took 1.2s. Estimated remaining: 9m 15s. Rate: 158.4 symbols/min [2025-10-15T22:35:05.583424] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:05.596620] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:05.597497] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-15T22:35:05.597628] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-15T22:35:05.628434] [DEBUG] [LOCAL ] CCRD: Loaded 9504 existing records from primary storage. [2025-10-15T22:35:05.629228] [INFO ] [MAIN ] CCRD: Loaded 9504 primary data records. [2025-10-15T22:35:05.629944] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-15T22:35:05.635231] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-15T22:35:05.700852] [INFO ] [MAIN ] Derivative Progress: 340/1803 symbols completed. CCL took 1.1s. Estimated remaining: 9m 13s. Rate: 158.7 symbols/min [2025-10-15T22:35:05.714955] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:05.728074] [DEBUG] [LOCAL ] CCO: Loaded 48392 existing records from primary storage. [2025-10-15T22:35:05.728309] [INFO ] [MAIN ] CCO: Loaded 48392 primary data records. [2025-10-15T22:35:06.240129] [DEBUG] [LOCAL ] CCS: Loaded 30343 existing records from primary storage. [2025-10-15T22:35:06.257014] [INFO ] [MAIN ] CCS: Loaded 30343 primary data records. [2025-10-15T22:35:06.593256] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:06.608523] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9504 primary records. [2025-10-15T22:35:06.608990] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:06.610075] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48392 primary records. [2025-10-15T22:35:06.610246] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-15T22:35:06.610345] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-15T22:35:06.643022] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-15T22:35:06.642570] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-15T22:35:06.643138] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-15T22:35:06.643199] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-15T22:35:06.645309] [INFO ] [MAIN ] Derivative Progress: 341/1803 symbols completed. CCO took 1.1s. Estimated remaining: 9m 15s. Rate: 158.0 symbols/min [2025-10-15T22:35:06.647790] [INFO ] [MAIN ] Derivative Progress: 342/1803 symbols completed. CCRD took 1.1s. Estimated remaining: 9m 13s. Rate: 158.5 symbols/min [2025-10-15T22:35:06.648314] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:06.645697] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:06.667341] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:06.668125] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30343 primary records. [2025-10-15T22:35:06.668397] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-15T22:35:06.697734] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-15T22:35:06.709622] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-15T22:35:06.712902] [DEBUG] [LOCAL ] CCU: Loaded 22294 existing records from primary storage. [2025-10-15T22:35:06.712050] [INFO ] [MAIN ] Derivative Progress: 343/1803 symbols completed. CCS took 1.0s. Estimated remaining: 9m 11s. Rate: 158.9 symbols/min [2025-10-15T22:35:06.713242] [INFO ] [MAIN ] CCU: Loaded 22294 primary data records. [2025-10-15T22:35:06.827918] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-15T22:35:06.838575] [INFO ] [MAIN ] CDE: Loaded 53643 primary data records. [2025-10-15T22:35:07.361512] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:07.362289] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 22294 primary records. [2025-10-15T22:35:07.362439] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-15T22:35:07.380415] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-15T22:35:07.392270] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-15T22:35:07.394468] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:07.394160] [INFO ] [MAIN ] Derivative Progress: 344/1803 symbols completed. CCU took 0.7s. Estimated remaining: 9m 12s. Rate: 158.5 symbols/min [2025-10-15T22:35:07.395206] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53643 primary records. [2025-10-15T22:35:07.395392] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-15T22:35:07.410489] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-15T22:35:07.410550] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-15T22:35:07.413714] [INFO ] [MAIN ] Derivative Progress: 345/1803 symbols completed. CDE took 0.8s. Estimated remaining: 9m 10s. Rate: 158.9 symbols/min [2025-10-15T22:35:07.414324] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:07.414434] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:07.414273] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:07.428006] [DEBUG] [LOCAL ] CDLR: Loaded 10075 existing records from primary storage. [2025-10-15T22:35:07.428346] [INFO ] [MAIN ] CDLR: Loaded 10075 primary data records. [2025-10-15T22:35:07.665671] [DEBUG] [LOCAL ] CDP: Loaded 42531 existing records from primary storage. [2025-10-15T22:35:07.664730] [DEBUG] [LOCAL ] CDRE: Loaded 24933 existing records from primary storage. [2025-10-15T22:35:07.665902] [INFO ] [MAIN ] CDP: Loaded 42531 primary data records. [2025-10-15T22:35:07.665993] [INFO ] [MAIN ] CDRE: Loaded 24933 primary data records. [2025-10-15T22:35:08.426016] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:08.427070] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 10075 primary records. [2025-10-15T22:35:08.427744] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-15T22:35:08.446996] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-15T22:35:08.447305] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-15T22:35:08.450673] [INFO ] [MAIN ] Derivative Progress: 346/1803 symbols completed. CDLR took 1.0s. Estimated remaining: 9m 13s. Rate: 158.1 symbols/min [2025-10-15T22:35:08.451783] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:08.467986] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:08.469206] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24933 primary records. [2025-10-15T22:35:08.469502] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-15T22:35:08.503464] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-15T22:35:08.504294] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-15T22:35:08.507693] [INFO ] [MAIN ] Derivative Progress: 347/1803 symbols completed. CDRE took 1.1s. Estimated remaining: 9m 11s. Rate: 158.5 symbols/min [2025-10-15T22:35:08.508030] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:08.504731] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:08.509488] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42531 primary records. [2025-10-15T22:35:08.509945] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-15T22:35:08.548251] [DEBUG] [LOCAL ] CEE: Loaded 5365 existing records from primary storage. [2025-10-15T22:35:08.547949] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-15T22:35:08.548597] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-15T22:35:08.548700] [INFO ] [MAIN ] CEE: Loaded 5365 primary data records. [2025-10-15T22:35:08.551518] [INFO ] [MAIN ] Derivative Progress: 348/1803 symbols completed. CDP took 1.1s. Estimated remaining: 9m 9s. Rate: 158.9 symbols/min [2025-10-15T22:35:08.619870] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:08.679298] [DEBUG] [LOCAL ] CE: Loaded 51344 existing records from primary storage. [2025-10-15T22:35:08.706855] [INFO ] [MAIN ] CE: Loaded 51344 primary data records. [2025-10-15T22:35:08.981829] [DEBUG] [LOCAL ] CEPU: Loaded 26707 existing records from primary storage. [2025-10-15T22:35:08.993327] [INFO ] [MAIN ] CEPU: Loaded 26707 primary data records. [2025-10-15T22:35:09.561375] [DEBUG] [MAIN ] CEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:09.562936] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5365 primary records. [2025-10-15T22:35:09.563762] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-15T22:35:09.582118] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-15T22:35:09.582733] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-15T22:35:09.592410] [INFO ] [MAIN ] Derivative Progress: 349/1803 symbols completed. CEE took 1.1s. Estimated remaining: 9m 12s. Rate: 158.1 symbols/min [2025-10-15T22:35:09.598294] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:09.598133] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:09.599418] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51344 primary records. [2025-10-15T22:35:09.599635] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-15T22:35:09.632989] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-15T22:35:09.633523] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-15T22:35:09.633841] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:09.636504] [INFO ] [MAIN ] Derivative Progress: 350/1803 symbols completed. CE took 1.2s. Estimated remaining: 9m 10s. Rate: 158.5 symbols/min [2025-10-15T22:35:09.637322] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 26707 primary records. [2025-10-15T22:35:09.637630] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:09.637715] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-15T22:35:09.655057] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-15T22:35:09.655330] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-15T22:35:09.657728] [INFO ] [MAIN ] Derivative Progress: 351/1803 symbols completed. CEPU took 1.0s. Estimated remaining: 9m 8s. Rate: 158.9 symbols/min [2025-10-15T22:35:09.657920] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:09.708678] [DEBUG] [LOCAL ] CF: Loaded 52155 existing records from primary storage. [2025-10-15T22:35:09.708988] [INFO ] [MAIN ] CF: Loaded 52155 primary data records. [2025-10-15T22:35:09.808027] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-15T22:35:09.814150] [INFO ] [MAIN ] CFG: Loaded 53623 primary data records. [2025-10-15T22:35:09.920796] [DEBUG] [LOCAL ] CFR: Loaded 32574 existing records from primary storage. [2025-10-15T22:35:09.963775] [INFO ] [MAIN ] CFR: Loaded 32574 primary data records. [2025-10-15T22:35:10.735802] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:10.736836] [DEBUG] [MAIN ] CF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:10.738505] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53623 primary records. [2025-10-15T22:35:10.737810] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52155 primary records. [2025-10-15T22:35:10.738818] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-15T22:35:10.739285] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-15T22:35:10.769325] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-15T22:35:10.770208] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-15T22:35:10.773523] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-15T22:35:10.776334] [INFO ] [MAIN ] Derivative Progress: 352/1803 symbols completed. CFG took 1.1s. Estimated remaining: 9m 11s. Rate: 158.1 symbols/min [2025-10-15T22:35:10.776800] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-15T22:35:10.779327] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:10.780596] [INFO ] [MAIN ] Derivative Progress: 353/1803 symbols completed. CF took 1.2s. Estimated remaining: 9m 9s. Rate: 158.5 symbols/min [2025-10-15T22:35:10.780741] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:10.798201] [DEBUG] [MAIN ] CFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:10.802042] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 32574 primary records. [2025-10-15T22:35:10.800990] [DEBUG] [LOCAL ] CGV: Loaded 1398 existing records from primary storage. [2025-10-15T22:35:10.802503] [INFO ] [MAIN ] CGV: Loaded 1398 primary data records. [2025-10-15T22:35:10.802242] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-15T22:35:10.921068] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-15T22:35:10.954211] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-15T22:35:10.997620] [INFO ] [MAIN ] Derivative Progress: 354/1803 symbols completed. CFR took 1.3s. Estimated remaining: 9m 8s. Rate: 158.7 symbols/min [2025-10-15T22:35:11.030787] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:11.163304] [DEBUG] [LOCAL ] CGAU: Loaded 43550 existing records from primary storage. [2025-10-15T22:35:11.163518] [INFO ] [MAIN ] CGAU: Loaded 43550 primary data records. [2025-10-15T22:35:11.341897] [DEBUG] [LOCAL ] CHCT: Loaded 24209 existing records from primary storage. [2025-10-15T22:35:11.364519] [INFO ] [MAIN ] CHCT: Loaded 24209 primary data records. [2025-10-15T22:35:11.676573] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:35:11.699778] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1398 primary records. [2025-10-15T22:35:11.730566] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-15T22:35:11.870265] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-15T22:35:11.871504] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-15T22:35:11.873557] [INFO ] [MAIN ] Derivative Progress: 355/1803 symbols completed. CGV took 1.1s. Estimated remaining: 9m 9s. Rate: 158.1 symbols/min [2025-10-15T22:35:11.874599] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:11.890112] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:11.891028] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 43550 primary records. [2025-10-15T22:35:11.891283] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-15T22:35:11.908778] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-15T22:35:11.909110] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-15T22:35:11.911576] [INFO ] [MAIN ] Derivative Progress: 356/1803 symbols completed. CGAU took 1.1s. Estimated remaining: 9m 8s. Rate: 158.5 symbols/min [2025-10-15T22:35:11.911997] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:11.931457] [DEBUG] [MAIN ] CHCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:11.932189] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24209 primary records. [2025-10-15T22:35:11.932352] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-15T22:35:11.969774] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-15T22:35:11.970156] [DEBUG] [LOCAL ] CHE: Loaded 15315 existing records from primary storage. [2025-10-15T22:35:11.970252] [INFO ] [MAIN ] CHE: Loaded 15315 primary data records. [2025-10-15T22:35:11.970320] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-15T22:35:11.994461] [INFO ] [MAIN ] Derivative Progress: 357/1803 symbols completed. CHCT took 1.0s. Estimated remaining: 9m 6s. Rate: 158.9 symbols/min [2025-10-15T22:35:12.002898] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:12.098712] [DEBUG] [LOCAL ] CHD: Loaded 52319 existing records from primary storage. [2025-10-15T22:35:12.101917] [INFO ] [MAIN ] CHD: Loaded 52319 primary data records. [2025-10-15T22:35:12.633363] [DEBUG] [LOCAL ] CHGG: Loaded 47763 existing records from primary storage. [2025-10-15T22:35:12.634185] [INFO ] [MAIN ] CHGG: Loaded 47763 primary data records. [2025-10-15T22:35:12.963586] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:12.965243] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15315 primary records. [2025-10-15T22:35:12.965608] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-15T22:35:12.999762] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-15T22:35:12.999904] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-15T22:35:13.000133] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:13.002312] [INFO ] [MAIN ] Derivative Progress: 358/1803 symbols completed. CHE took 1.1s. Estimated remaining: 9m 8s. Rate: 158.1 symbols/min [2025-10-15T22:35:13.003173] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52319 primary records. [2025-10-15T22:35:13.003501] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-15T22:35:13.021303] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-15T22:35:13.021426] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-15T22:35:13.024314] [INFO ] [MAIN ] Derivative Progress: 359/1803 symbols completed. CHD took 1.1s. Estimated remaining: 9m 6s. Rate: 158.5 symbols/min [2025-10-15T22:35:13.041851] [DEBUG] [MAIN ] CHGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:13.042609] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47763 primary records. [2025-10-15T22:35:13.042711] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-15T22:35:13.058314] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-15T22:35:13.058380] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-15T22:35:13.060777] [INFO ] [MAIN ] Derivative Progress: 360/1803 symbols completed. CHGG took 1.1s. Estimated remaining: 9m 5s. Rate: 158.9 symbols/min [2025-10-15T22:35:13.061222] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:13.061844] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:13.061762] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:13.118927] [DEBUG] [LOCAL ] CHH: Loaded 32425 existing records from primary storage. [2025-10-15T22:35:13.119136] [INFO ] [MAIN ] CHH: Loaded 32425 primary data records. [2025-10-15T22:35:13.249700] [DEBUG] [LOCAL ] CHPT: Loaded 47661 existing records from primary storage. [2025-10-15T22:35:13.256152] [INFO ] [MAIN ] CHPT: Loaded 47661 primary data records. [2025-10-15T22:35:13.256029] [DEBUG] [LOCAL ] CHWY: Loaded 53655 existing records from primary storage. [2025-10-15T22:35:13.256334] [INFO ] [MAIN ] CHWY: Loaded 53655 primary data records. [2025-10-15T22:35:14.118098] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:14.119626] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32425 primary records. [2025-10-15T22:35:14.119747] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-15T22:35:14.137369] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-15T22:35:14.139346] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-15T22:35:14.141449] [INFO ] [MAIN ] Derivative Progress: 361/1803 symbols completed. CHH took 1.1s. Estimated remaining: 9m 7s. Rate: 158.1 symbols/min [2025-10-15T22:35:14.142631] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:14.158915] [DEBUG] [MAIN ] CHWY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:14.159874] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53655 primary records. [2025-10-15T22:35:14.160178] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-15T22:35:14.179990] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-15T22:35:14.180268] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-15T22:35:14.182764] [INFO ] [MAIN ] Derivative Progress: 362/1803 symbols completed. CHWY took 1.1s. Estimated remaining: 9m 5s. Rate: 158.5 symbols/min [2025-10-15T22:35:14.183065] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:14.198828] [DEBUG] [MAIN ] CHPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:14.199740] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 47661 primary records. [2025-10-15T22:35:14.199889] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-15T22:35:14.235108] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-15T22:35:14.235249] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-15T22:35:14.237763] [INFO ] [MAIN ] Derivative Progress: 363/1803 symbols completed. CHPT took 1.2s. Estimated remaining: 9m 4s. Rate: 158.9 symbols/min [2025-10-15T22:35:14.238018] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:14.265758] [DEBUG] [LOCAL ] CIB: Loaded 30426 existing records from primary storage. [2025-10-15T22:35:14.266030] [INFO ] [MAIN ] CIB: Loaded 30426 primary data records. [2025-10-15T22:35:14.278903] [DEBUG] [LOCAL ] CI: Loaded 49737 existing records from primary storage. [2025-10-15T22:35:14.306633] [INFO ] [MAIN ] CI: Loaded 49737 primary data records. [2025-10-15T22:35:14.802454] [DEBUG] [LOCAL ] CIEN: Loaded 52151 existing records from primary storage. [2025-10-15T22:35:14.928790] [INFO ] [MAIN ] CIEN: Loaded 52151 primary data records. [2025-10-15T22:35:15.310201] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:15.311029] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30426 primary records. [2025-10-15T22:35:15.311126] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-15T22:35:15.333904] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-15T22:35:15.335579] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-15T22:35:15.337937] [INFO ] [MAIN ] Derivative Progress: 364/1803 symbols completed. CIB took 1.2s. Estimated remaining: 9m 6s. Rate: 158.1 symbols/min [2025-10-15T22:35:15.339240] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:15.353250] [DEBUG] [MAIN ] CI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:15.354222] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49737 primary records. [2025-10-15T22:35:15.354594] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-15T22:35:15.375956] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-15T22:35:15.376291] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-15T22:35:15.376193] [DEBUG] [LOCAL ] CIF: Loaded 4024 existing records from primary storage. [2025-10-15T22:35:15.379856] [INFO ] [MAIN ] Derivative Progress: 365/1803 symbols completed. CI took 1.2s. Estimated remaining: 9m 5s. Rate: 158.4 symbols/min [2025-10-15T22:35:15.381030] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:15.382093] [INFO ] [MAIN ] CIF: Loaded 4024 primary data records. [2025-10-15T22:35:15.469043] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:15.494452] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52151 primary records. [2025-10-15T22:35:15.494683] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-15T22:35:15.762236] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-15T22:35:15.762621] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-15T22:35:15.765967] [INFO ] [MAIN ] Derivative Progress: 366/1803 symbols completed. CIEN took 1.5s. Estimated remaining: 9m 4s. Rate: 158.4 symbols/min [2025-10-15T22:35:15.766303] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:15.783689] [DEBUG] [LOCAL ] CIG: Loaded 44317 existing records from primary storage. [2025-10-15T22:35:15.784470] [INFO ] [MAIN ] CIG: Loaded 44317 primary data records. [2025-10-15T22:35:15.896236] [DEBUG] [LOCAL ] CII: Loaded 15321 existing records from primary storage. [2025-10-15T22:35:15.900070] [INFO ] [MAIN ] CII: Loaded 15321 primary data records. [2025-10-15T22:35:16.263208] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:16.272804] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4024 primary records. [2025-10-15T22:35:16.295208] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-15T22:35:16.430987] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-15T22:35:16.431323] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-15T22:35:16.433422] [INFO ] [MAIN ] Derivative Progress: 367/1803 symbols completed. CIF took 1.1s. Estimated remaining: 9m 5s. Rate: 158.1 symbols/min [2025-10-15T22:35:16.433717] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:16.456721] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:16.457415] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 44317 primary records. [2025-10-15T22:35:16.457484] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-15T22:35:16.473848] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-15T22:35:16.473999] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-15T22:35:16.476411] [INFO ] [MAIN ] Derivative Progress: 368/1803 symbols completed. CIG took 1.1s. Estimated remaining: 9m 3s. Rate: 158.5 symbols/min [2025-10-15T22:35:16.476936] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:16.507148] [DEBUG] [LOCAL ] CIMN: Loaded 2756 existing records from primary storage. [2025-10-15T22:35:16.506974] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:16.507323] [INFO ] [MAIN ] CIMN: Loaded 2756 primary data records. [2025-10-15T22:35:16.508072] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15321 primary records. [2025-10-15T22:35:16.555991] [DEBUG] [LOCAL ] CIM: Loaded 37688 existing records from primary storage. [2025-10-15T22:35:16.561360] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-15T22:35:16.583821] [INFO ] [MAIN ] CIM: Loaded 37688 primary data records. [2025-10-15T22:35:16.717668] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-15T22:35:16.739990] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-15T22:35:16.742991] [INFO ] [MAIN ] Derivative Progress: 369/1803 symbols completed. CII took 1.0s. Estimated remaining: 9m 2s. Rate: 158.6 symbols/min [2025-10-15T22:35:16.753698] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:17.221555] [DEBUG] [LOCAL ] CIVI: Loaded 52699 existing records from primary storage. [2025-10-15T22:35:17.222891] [INFO ] [MAIN ] CIVI: Loaded 52699 primary data records. [2025-10-15T22:35:17.436044] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:17.588065] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2756 primary records. [2025-10-15T22:35:17.615070] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-15T22:35:17.614867] [DEBUG] [MAIN ] CIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:17.616561] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37688 primary records. [2025-10-15T22:35:17.616714] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-15T22:35:17.645396] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-10-15T22:35:17.646606] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-15T22:35:17.651167] [INFO ] [MAIN ] Derivative Progress: 370/1803 symbols completed. CIMN took 1.2s. Estimated remaining: 9m 4s. Rate: 158.0 symbols/min [2025-10-15T22:35:17.652673] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:17.657556] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-15T22:35:17.657713] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-15T22:35:17.659741] [INFO ] [MAIN ] Derivative Progress: 371/1803 symbols completed. CIM took 1.2s. Estimated remaining: 9m 2s. Rate: 158.4 symbols/min [2025-10-15T22:35:17.660259] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:17.696281] [DEBUG] [LOCAL ] CLCO: Loaded 13176 existing records from primary storage. [2025-10-15T22:35:17.696742] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:17.697490] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52699 primary records. [2025-10-15T22:35:17.697547] [INFO ] [MAIN ] CLCO: Loaded 13176 primary data records. [2025-10-15T22:35:17.717780] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-15T22:35:17.817226] [DEBUG] [LOCAL ] CLB: Loaded 33430 existing records from primary storage. [2025-10-15T22:35:17.837262] [INFO ] [MAIN ] CLB: Loaded 33430 primary data records. [2025-10-15T22:35:17.841761] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-15T22:35:17.852255] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-15T22:35:17.901287] [INFO ] [MAIN ] Derivative Progress: 372/1803 symbols completed. CIVI took 1.1s. Estimated remaining: 9m 1s. Rate: 158.6 symbols/min [2025-10-15T22:35:17.994264] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:18.352918] [DEBUG] [LOCAL ] CLDT: Loaded 25429 existing records from primary storage. [2025-10-15T22:35:18.353589] [INFO ] [MAIN ] CLDT: Loaded 25429 primary data records. [2025-10-15T22:35:18.481509] [DEBUG] [MAIN ] CLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:18.508889] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 13176 primary records. [2025-10-15T22:35:18.526739] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-15T22:35:18.578687] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:18.719150] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33430 primary records. [2025-10-15T22:35:18.722556] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-15T22:35:18.734927] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-15T22:35:18.735665] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-15T22:35:18.744179] [INFO ] [MAIN ] Derivative Progress: 373/1803 symbols completed. CLCO took 1.1s. Estimated remaining: 9m 3s. Rate: 158.1 symbols/min [2025-10-15T22:35:18.747041] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-15T22:35:18.747699] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-15T22:35:18.749861] [INFO ] [MAIN ] Derivative Progress: 374/1803 symbols completed. CLB took 1.1s. Estimated remaining: 9m 1s. Rate: 158.5 symbols/min [2025-10-15T22:35:18.769662] [DEBUG] [MAIN ] CLDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:18.770248] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25429 primary records. [2025-10-15T22:35:18.770311] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-15T22:35:18.784902] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-15T22:35:18.784964] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-15T22:35:18.787378] [INFO ] [MAIN ] Derivative Progress: 375/1803 symbols completed. CLDT took 0.8s. Estimated remaining: 8m 59s. Rate: 158.9 symbols/min [2025-10-15T22:35:18.787896] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:18.787821] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:18.787991] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:18.817450] [DEBUG] [LOCAL ] CLH: Loaded 27821 existing records from primary storage. [2025-10-15T22:35:18.817753] [INFO ] [MAIN ] CLH: Loaded 27821 primary data records. [2025-10-15T22:35:19.165078] [DEBUG] [LOCAL ] CLS: Loaded 53583 existing records from primary storage. [2025-10-15T22:35:19.165404] [INFO ] [MAIN ] CLS: Loaded 53583 primary data records. [2025-10-15T22:35:19.165995] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-15T22:35:19.166204] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-15T22:35:19.849037] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:19.850290] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27821 primary records. [2025-10-15T22:35:19.850723] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-15T22:35:19.868510] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-15T22:35:19.868938] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-15T22:35:19.872478] [INFO ] [MAIN ] Derivative Progress: 376/1803 symbols completed. CLH took 1.1s. Estimated remaining: 9m 2s. Rate: 158.1 symbols/min [2025-10-15T22:35:19.874860] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:19.890463] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:19.891541] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53583 primary records. [2025-10-15T22:35:19.899355] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-15T22:35:19.905398] [DEBUG] [MAIN ] CLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:19.914144] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-15T22:35:19.918113] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-15T22:35:19.951318] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-15T22:35:19.952050] [DEBUG] [LOCAL ] CLW: Loaded 21508 existing records from primary storage. [2025-10-15T22:35:19.952210] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-15T22:35:19.952277] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-15T22:35:19.952620] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-15T22:35:19.952464] [INFO ] [MAIN ] CLW: Loaded 21508 primary data records. [2025-10-15T22:35:19.955309] [INFO ] [MAIN ] Derivative Progress: 377/1803 symbols completed. CLS took 1.2s. Estimated remaining: 9m 0s. Rate: 158.4 symbols/min [2025-10-15T22:35:19.958066] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:19.958377] [INFO ] [MAIN ] Derivative Progress: 378/1803 symbols completed. CLF took 1.2s. Estimated remaining: 8m 58s. Rate: 158.8 symbols/min [2025-10-15T22:35:19.970686] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:20.342256] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:20.343193] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21508 primary records. [2025-10-15T22:35:20.343283] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-15T22:35:20.344384] [DEBUG] [LOCAL ] CLX: Loaded 51677 existing records from primary storage. [2025-10-15T22:35:20.345099] [DEBUG] [LOCAL ] CM: Loaded 48739 existing records from primary storage. [2025-10-15T22:35:20.346191] [INFO ] [MAIN ] CM: Loaded 48739 primary data records. [2025-10-15T22:35:20.346120] [INFO ] [MAIN ] CLX: Loaded 51677 primary data records. [2025-10-15T22:35:20.611259] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-15T22:35:20.621881] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-15T22:35:20.624001] [INFO ] [MAIN ] Derivative Progress: 379/1803 symbols completed. CLW took 0.7s. Estimated remaining: 8m 59s. Rate: 158.5 symbols/min [2025-10-15T22:35:20.634461] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:21.040229] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:21.042328] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51677 primary records. [2025-10-15T22:35:21.044046] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-15T22:35:21.083101] [DEBUG] [LOCAL ] CMA: Loaded 50122 existing records from primary storage. [2025-10-15T22:35:21.086878] [INFO ] [MAIN ] CMA: Loaded 50122 primary data records. [2025-10-15T22:35:21.086630] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-15T22:35:21.087181] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-15T22:35:21.087598] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:21.121835] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48739 primary records. [2025-10-15T22:35:21.089448] [INFO ] [MAIN ] Derivative Progress: 380/1803 symbols completed. CLX took 1.1s. Estimated remaining: 8m 59s. Rate: 158.4 symbols/min [2025-10-15T22:35:21.134257] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:21.139533] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-15T22:35:21.213139] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-15T22:35:21.219881] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-15T22:35:21.222262] [INFO ] [MAIN ] Derivative Progress: 381/1803 symbols completed. CM took 1.3s. Estimated remaining: 8m 58s. Rate: 158.7 symbols/min [2025-10-15T22:35:21.232933] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:21.311253] [DEBUG] [LOCAL ] CMBT: Loaded 26155 existing records from primary storage. [2025-10-15T22:35:21.311396] [INFO ] [MAIN ] CMBT: Loaded 26155 primary data records. [2025-10-15T22:35:21.686163] [DEBUG] [LOCAL ] CMC: Loaded 45483 existing records from primary storage. [2025-10-15T22:35:21.686392] [INFO ] [MAIN ] CMC: Loaded 45483 primary data records. [2025-10-15T22:35:22.120825] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:22.122363] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50122 primary records. [2025-10-15T22:35:22.122827] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-15T22:35:22.140146] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-15T22:35:22.140533] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-15T22:35:22.142863] [INFO ] [MAIN ] Derivative Progress: 382/1803 symbols completed. CMA took 1.5s. Estimated remaining: 8m 59s. Rate: 158.1 symbols/min [2025-10-15T22:35:22.143332] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:22.163456] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:22.164217] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 26155 primary records. [2025-10-15T22:35:22.167076] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-15T22:35:22.167249] [DEBUG] [LOCAL ] CMCM: Loaded 4788 existing records from primary storage. [2025-10-15T22:35:22.168085] [INFO ] [MAIN ] CMCM: Loaded 4788 primary data records. [2025-10-15T22:35:22.250006] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-15T22:35:22.271970] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-15T22:35:22.273804] [INFO ] [MAIN ] Derivative Progress: 383/1803 symbols completed. CMBT took 1.1s. Estimated remaining: 8m 58s. Rate: 158.4 symbols/min [2025-10-15T22:35:22.281378] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:22.382720] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:22.467601] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45483 primary records. [2025-10-15T22:35:22.495842] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-15T22:35:22.537259] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-15T22:35:22.537424] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-15T22:35:22.540611] [INFO ] [MAIN ] Derivative Progress: 384/1803 symbols completed. CMC took 1.3s. Estimated remaining: 8m 57s. Rate: 158.5 symbols/min [2025-10-15T22:35:22.541118] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:22.577232] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:22.578129] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-15T22:35:22.579276] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4788 primary records. [2025-10-15T22:35:22.578271] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-10-15T22:35:22.579477] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-15T22:35:22.672994] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-15T22:35:22.690754] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-15T22:35:22.695713] [INFO ] [MAIN ] Derivative Progress: 385/1803 symbols completed. CMCM took 0.6s. Estimated remaining: 8m 56s. Rate: 158.7 symbols/min [2025-10-15T22:35:22.705041] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:22.898323] [DEBUG] [LOCAL ] CMI: Loaded 41687 existing records from primary storage. [2025-10-15T22:35:22.906624] [INFO ] [MAIN ] CMI: Loaded 41687 primary data records. [2025-10-15T22:35:23.034347] [DEBUG] [LOCAL ] CMP: Loaded 35832 existing records from primary storage. [2025-10-15T22:35:23.091006] [INFO ] [MAIN ] CMP: Loaded 35832 primary data records. [2025-10-15T22:35:23.611101] [DEBUG] [MAIN ] CMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:23.612111] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-10-15T22:35:23.612358] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-15T22:35:23.630069] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-10-15T22:35:23.631143] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-15T22:35:23.634308] [INFO ] [MAIN ] Derivative Progress: 386/1803 symbols completed. CMG took 1.4s. Estimated remaining: 8m 58s. Rate: 158.1 symbols/min [2025-10-15T22:35:23.637464] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:23.652617] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:23.653457] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41687 primary records. [2025-10-15T22:35:23.653698] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-15T22:35:23.670862] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-15T22:35:23.671233] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-15T22:35:23.673382] [INFO ] [MAIN ] Derivative Progress: 387/1803 symbols completed. CMI took 1.1s. Estimated remaining: 8m 56s. Rate: 158.5 symbols/min [2025-10-15T22:35:23.673637] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:23.690184] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:23.691052] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 35832 primary records. [2025-10-15T22:35:23.691208] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-15T22:35:23.718273] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-15T22:35:23.718511] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-15T22:35:23.720991] [INFO ] [MAIN ] Derivative Progress: 388/1803 symbols completed. CMP took 1.0s. Estimated remaining: 8m 54s. Rate: 158.8 symbols/min [2025-10-15T22:35:23.737587] [DEBUG] [LOCAL ] CMPO: Loaded 38834 existing records from primary storage. [2025-10-15T22:35:23.745551] [INFO ] [MAIN ] CMPO: Loaded 38834 primary data records. [2025-10-15T22:35:23.886146] [DEBUG] [LOCAL ] CMRE: Loaded 35851 existing records from primary storage. [2025-10-15T22:35:23.908074] [INFO ] [MAIN ] CMRE: Loaded 35851 primary data records. [2025-10-15T22:35:24.366386] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:24.367333] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 38834 primary records. [2025-10-15T22:35:24.367415] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-15T22:35:24.386719] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-15T22:35:24.387529] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-15T22:35:24.390209] [INFO ] [MAIN ] Derivative Progress: 389/1803 symbols completed. CMPO took 0.8s. Estimated remaining: 8m 55s. Rate: 158.5 symbols/min [2025-10-15T22:35:24.403197] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:24.403851] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35851 primary records. [2025-10-15T22:35:24.403913] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-15T22:35:24.418823] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-15T22:35:24.418892] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-15T22:35:24.420869] [INFO ] [MAIN ] Derivative Progress: 390/1803 symbols completed. CMRE took 0.7s. Estimated remaining: 8m 54s. Rate: 158.9 symbols/min [2025-10-15T22:35:24.421224] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:24.421289] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:24.421419] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:24.435375] [DEBUG] [LOCAL ] CMSD: Loaded 7835 existing records from primary storage. [2025-10-15T22:35:24.431976] [DEBUG] [LOCAL ] CMSC: Loaded 4881 existing records from primary storage. [2025-10-15T22:35:24.435494] [INFO ] [MAIN ] CMSC: Loaded 4881 primary data records. [2025-10-15T22:35:24.435569] [INFO ] [MAIN ] CMSD: Loaded 7835 primary data records. [2025-10-15T22:35:25.043468] [DEBUG] [LOCAL ] CMS: Loaded 52615 existing records from primary storage. [2025-10-15T22:35:25.043782] [INFO ] [MAIN ] CMS: Loaded 52615 primary data records. [2025-10-15T22:35:25.408822] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:25.422478] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 4881 primary records. [2025-10-15T22:35:25.423052] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:25.422836] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-15T22:35:25.424864] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 7835 primary records. [2025-10-15T22:35:25.432915] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-15T22:35:25.448743] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-15T22:35:25.451901] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-15T22:35:25.454092] [INFO ] [MAIN ] Derivative Progress: 391/1803 symbols completed. CMSC took 1.0s. Estimated remaining: 8m 56s. Rate: 158.2 symbols/min [2025-10-15T22:35:25.454683] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:25.475803] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:25.475506] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-15T22:35:25.476469] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52615 primary records. [2025-10-15T22:35:25.476571] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-15T22:35:25.476686] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-15T22:35:25.478952] [INFO ] [MAIN ] Derivative Progress: 392/1803 symbols completed. CMSD took 1.1s. Estimated remaining: 8m 54s. Rate: 158.6 symbols/min [2025-10-15T22:35:25.479538] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:25.495869] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-15T22:35:25.496148] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-15T22:35:25.498379] [INFO ] [MAIN ] Derivative Progress: 393/1803 symbols completed. CMS took 1.1s. Estimated remaining: 8m 52s. Rate: 159.0 symbols/min [2025-10-15T22:35:25.500636] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:25.513373] [DEBUG] [LOCAL ] CMU: Loaded 6330 existing records from primary storage. [2025-10-15T22:35:25.513602] [INFO ] [MAIN ] CMU: Loaded 6330 primary data records. [2025-10-15T22:35:25.617481] [DEBUG] [LOCAL ] CMTG: Loaded 35854 existing records from primary storage. [2025-10-15T22:35:25.628024] [INFO ] [MAIN ] CMTG: Loaded 35854 primary data records. [2025-10-15T22:35:26.013158] [DEBUG] [LOCAL ] CNA: Loaded 32932 existing records from primary storage. [2025-10-15T22:35:26.049706] [INFO ] [MAIN ] CNA: Loaded 32932 primary data records. [2025-10-15T22:35:26.446002] [DEBUG] [MAIN ] CMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:26.447353] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6330 primary records. [2025-10-15T22:35:26.447523] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-15T22:35:26.465768] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-15T22:35:26.477874] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-15T22:35:26.480453] [INFO ] [MAIN ] Derivative Progress: 394/1803 symbols completed. CMU took 1.0s. Estimated remaining: 8m 54s. Rate: 158.3 symbols/min [2025-10-15T22:35:26.480967] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:26.481114] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:26.482220] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 35854 primary records. [2025-10-15T22:35:26.482482] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-15T22:35:26.499468] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-15T22:35:26.500518] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-15T22:35:26.504070] [INFO ] [MAIN ] Derivative Progress: 395/1803 symbols completed. CMTG took 1.0s. Estimated remaining: 8m 52s. Rate: 158.7 symbols/min [2025-10-15T22:35:26.504420] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:26.517734] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:26.518714] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32932 primary records. [2025-10-15T22:35:26.518879] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-15T22:35:26.549013] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-15T22:35:26.549213] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-15T22:35:26.551449] [INFO ] [MAIN ] Derivative Progress: 396/1803 symbols completed. CNA took 1.1s. Estimated remaining: 8m 51s. Rate: 159.0 symbols/min [2025-10-15T22:35:26.551864] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:26.572334] [DEBUG] [LOCAL ] CNC: Loaded 53770 existing records from primary storage. [2025-10-15T22:35:26.585221] [INFO ] [MAIN ] CNC: Loaded 53770 primary data records. [2025-10-15T22:35:26.723659] [DEBUG] [LOCAL ] CNH: Loaded 53552 existing records from primary storage. [2025-10-15T22:35:26.735830] [INFO ] [MAIN ] CNH: Loaded 53552 primary data records. [2025-10-15T22:35:27.039445] [DEBUG] [LOCAL ] CNI: Loaded 51698 existing records from primary storage. [2025-10-15T22:35:27.045305] [INFO ] [MAIN ] CNI: Loaded 51698 primary data records. [2025-10-15T22:35:27.621181] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:35:27.622789] [INFO ] [MAIN ] CNC: Generated 1793 derivative records from 53770 primary records. [2025-10-15T22:35:27.623094] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-15T22:35:27.642260] [DEBUG] [LOCAL ] CNC: Derivative data saved (1793 records). [2025-10-15T22:35:27.643480] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-15T22:35:27.646312] [INFO ] [MAIN ] Derivative Progress: 397/1803 symbols completed. CNC took 1.2s. Estimated remaining: 8m 53s. Rate: 158.3 symbols/min [2025-10-15T22:35:27.647574] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:27.662719] [DEBUG] [MAIN ] CNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:27.663500] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53552 primary records. [2025-10-15T22:35:27.663832] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-15T22:35:27.681564] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-15T22:35:27.681808] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-15T22:35:27.685660] [INFO ] [MAIN ] Derivative Progress: 398/1803 symbols completed. CNH took 1.2s. Estimated remaining: 8m 51s. Rate: 158.6 symbols/min [2025-10-15T22:35:27.685962] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:27.700582] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:27.701485] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51698 primary records. [2025-10-15T22:35:27.701602] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-15T22:35:27.722161] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-15T22:35:27.736452] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-15T22:35:27.739597] [INFO ] [MAIN ] Derivative Progress: 399/1803 symbols completed. CNI took 1.2s. Estimated remaining: 8m 50s. Rate: 159.0 symbols/min [2025-10-15T22:35:27.746709] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:27.763429] [DEBUG] [LOCAL ] CNMD: Loaded 32127 existing records from primary storage. [2025-10-15T22:35:27.763755] [INFO ] [MAIN ] CNMD: Loaded 32127 primary data records. [2025-10-15T22:35:27.833053] [DEBUG] [LOCAL ] CNM: Loaded 51035 existing records from primary storage. [2025-10-15T22:35:27.854733] [INFO ] [MAIN ] CNM: Loaded 51035 primary data records. [2025-10-15T22:35:28.047389] [DEBUG] [LOCAL ] CNNE: Loaded 35946 existing records from primary storage. [2025-10-15T22:35:28.058421] [INFO ] [MAIN ] CNNE: Loaded 35946 primary data records. [2025-10-15T22:35:28.720689] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:28.729504] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32127 primary records. [2025-10-15T22:35:28.729739] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-15T22:35:28.735615] [DEBUG] [MAIN ] CNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:28.736316] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 51035 primary records. [2025-10-15T22:35:28.737147] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-15T22:35:28.770099] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-15T22:35:28.769132] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-15T22:35:28.782513] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-15T22:35:28.782415] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-15T22:35:28.787246] [DEBUG] [MAIN ] CNNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:28.785062] [INFO ] [MAIN ] Derivative Progress: 400/1803 symbols completed. CNM took 1.1s. Estimated remaining: 8m 52s. Rate: 158.3 symbols/min [2025-10-15T22:35:28.788251] [INFO ] [MAIN ] Derivative Progress: 401/1803 symbols completed. CNMD took 1.1s. Estimated remaining: 8m 50s. Rate: 158.7 symbols/min [2025-10-15T22:35:28.788174] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:28.788692] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:28.788083] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 35946 primary records. [2025-10-15T22:35:28.789100] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-15T22:35:28.805801] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-15T22:35:28.806161] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-15T22:35:28.808629] [INFO ] [MAIN ] Derivative Progress: 402/1803 symbols completed. CNNE took 1.1s. Estimated remaining: 8m 49s. Rate: 159.1 symbols/min [2025-10-15T22:35:28.809013] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:28.886765] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-15T22:35:28.887445] [DEBUG] [LOCAL ] CNO: Loaded 40648 existing records from primary storage. [2025-10-15T22:35:28.887536] [INFO ] [MAIN ] CNP: Loaded 53480 primary data records. [2025-10-15T22:35:28.887746] [INFO ] [MAIN ] CNO: Loaded 40648 primary data records. [2025-10-15T22:35:29.098639] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-15T22:35:29.109080] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-10-15T22:35:29.875010] [DEBUG] [MAIN ] CNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:29.875910] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40648 primary records. [2025-10-15T22:35:29.876007] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-15T22:35:29.897902] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:29.901608] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53480 primary records. [2025-10-15T22:35:29.904745] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-15T22:35:29.932148] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-15T22:35:29.933277] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-15T22:35:29.935406] [INFO ] [MAIN ] Derivative Progress: 403/1803 symbols completed. CNO took 1.1s. Estimated remaining: 8m 51s. Rate: 158.3 symbols/min [2025-10-15T22:35:29.936194] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:29.937550] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53582 primary records. [2025-10-15T22:35:29.938667] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-15T22:35:29.948993] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-15T22:35:29.951542] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-15T22:35:29.956051] [INFO ] [MAIN ] Derivative Progress: 404/1803 symbols completed. CNP took 1.2s. Estimated remaining: 8m 49s. Rate: 158.6 symbols/min [2025-10-15T22:35:29.957448] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-15T22:35:29.957519] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-15T22:35:29.960205] [INFO ] [MAIN ] Derivative Progress: 405/1803 symbols completed. CNQ took 1.2s. Estimated remaining: 8m 47s. Rate: 159.0 symbols/min [2025-10-15T22:35:29.960601] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:29.960715] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:29.960767] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:29.983756] [DEBUG] [LOCAL ] CNS: Loaded 21154 existing records from primary storage. [2025-10-15T22:35:29.983912] [INFO ] [MAIN ] CNS: Loaded 21154 primary data records. [2025-10-15T22:35:30.178560] [DEBUG] [LOCAL ] CODI: Loaded 41441 existing records from primary storage. [2025-10-15T22:35:30.196916] [INFO ] [MAIN ] CODI: Loaded 41441 primary data records. [2025-10-15T22:35:30.370463] [DEBUG] [LOCAL ] CNX: Loaded 51367 existing records from primary storage. [2025-10-15T22:35:30.410913] [INFO ] [MAIN ] CNX: Loaded 51367 primary data records. [2025-10-15T22:35:31.236914] [DEBUG] [MAIN ] CNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:31.240073] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 21154 primary records. [2025-10-15T22:35:31.240216] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-15T22:35:31.263144] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-10-15T22:35:31.264616] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-15T22:35:31.267281] [INFO ] [MAIN ] Derivative Progress: 406/1803 symbols completed. CNS took 1.3s. Estimated remaining: 8m 50s. Rate: 158.1 symbols/min [2025-10-15T22:35:31.267593] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:31.299124] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:31.302835] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 41441 primary records. [2025-10-15T22:35:31.303389] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-15T22:35:31.338975] [DEBUG] [MAIN ] CNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:31.342375] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51367 primary records. [2025-10-15T22:35:31.343287] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-15T22:35:31.347469] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-15T22:35:31.348692] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-15T22:35:31.352253] [INFO ] [MAIN ] Derivative Progress: 407/1803 symbols completed. CODI took 1.4s. Estimated remaining: 8m 49s. Rate: 158.4 symbols/min [2025-10-15T22:35:31.352993] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:31.387576] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-15T22:35:31.387879] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-15T22:35:31.391513] [INFO ] [MAIN ] Derivative Progress: 408/1803 symbols completed. CNX took 1.4s. Estimated remaining: 8m 47s. Rate: 158.7 symbols/min [2025-10-15T22:35:31.392068] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:31.414401] [DEBUG] [LOCAL ] COF: Loaded 53622 existing records from primary storage. [2025-10-15T22:35:31.433343] [INFO ] [MAIN ] COF: Loaded 53622 primary data records. [2025-10-15T22:35:31.587147] [DEBUG] [LOCAL ] COHR: Loaded 53381 existing records from primary storage. [2025-10-15T22:35:31.662150] [INFO ] [MAIN ] COHR: Loaded 53381 primary data records. [2025-10-15T22:35:31.949506] [DEBUG] [LOCAL ] COLD: Loaded 52391 existing records from primary storage. [2025-10-15T22:35:31.979914] [INFO ] [MAIN ] COLD: Loaded 52391 primary data records. [2025-10-15T22:35:32.550195] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:32.551845] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53622 primary records. [2025-10-15T22:35:32.552056] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-15T22:35:32.569937] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-15T22:35:32.570372] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-15T22:35:32.572582] [INFO ] [MAIN ] Derivative Progress: 409/1803 symbols completed. COF took 1.3s. Estimated remaining: 8m 50s. Rate: 157.9 symbols/min [2025-10-15T22:35:32.573104] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:32.590717] [DEBUG] [MAIN ] COHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:32.591606] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53381 primary records. [2025-10-15T22:35:32.591798] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-15T22:35:32.608967] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-10-15T22:35:32.610188] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-15T22:35:32.613918] [INFO ] [MAIN ] Derivative Progress: 410/1803 symbols completed. COHR took 1.3s. Estimated remaining: 8m 48s. Rate: 158.2 symbols/min [2025-10-15T22:35:32.614856] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:32.632196] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:32.632950] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52391 primary records. [2025-10-15T22:35:32.633087] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-15T22:35:32.662348] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-15T22:35:32.662591] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-15T22:35:32.664835] [INFO ] [MAIN ] Derivative Progress: 411/1803 symbols completed. COLD took 1.3s. Estimated remaining: 8m 47s. Rate: 158.6 symbols/min [2025-10-15T22:35:32.665124] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:32.692214] [DEBUG] [LOCAL ] COMP: Loaded 53406 existing records from primary storage. [2025-10-15T22:35:32.692534] [INFO ] [MAIN ] COMP: Loaded 53406 primary data records. [2025-10-15T22:35:32.803819] [DEBUG] [LOCAL ] COOK: Loaded 24994 existing records from primary storage. [2025-10-15T22:35:32.820493] [INFO ] [MAIN ] COOK: Loaded 24994 primary data records. [2025-10-15T22:35:32.821174] [DEBUG] [LOCAL ] CON: Loaded 38935 existing records from primary storage. [2025-10-15T22:35:32.852546] [INFO ] [MAIN ] CON: Loaded 38935 primary data records. [2025-10-15T22:35:33.723466] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:33.724329] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53406 primary records. [2025-10-15T22:35:33.724497] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-15T22:35:33.758838] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-15T22:35:33.759229] [DEBUG] [MAIN ] CON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:33.771025] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-15T22:35:33.772280] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38935 primary records. [2025-10-15T22:35:33.772372] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-15T22:35:33.773080] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:33.775051] [INFO ] [MAIN ] Derivative Progress: 412/1803 symbols completed. COMP took 1.2s. Estimated remaining: 8m 49s. Rate: 157.8 symbols/min [2025-10-15T22:35:33.775912] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24994 primary records. [2025-10-15T22:35:33.776249] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-15T22:35:33.776127] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:33.803702] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-10-15T22:35:33.805919] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-15T22:35:33.810559] [INFO ] [MAIN ] Derivative Progress: 413/1803 symbols completed. CON took 1.2s. Estimated remaining: 8m 47s. Rate: 158.2 symbols/min [2025-10-15T22:35:33.810836] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:33.812482] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-15T22:35:33.812814] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-15T22:35:33.815539] [INFO ] [MAIN ] Derivative Progress: 414/1803 symbols completed. COOK took 1.2s. Estimated remaining: 8m 46s. Rate: 158.6 symbols/min [2025-10-15T22:35:33.816042] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:33.871289] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-15T22:35:33.871619] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-15T22:35:33.920887] [DEBUG] [LOCAL ] COR: Loaded 46611 existing records from primary storage. [2025-10-15T22:35:33.975696] [INFO ] [MAIN ] COR: Loaded 46611 primary data records. [2025-10-15T22:35:34.116103] [DEBUG] [LOCAL ] COTY: Loaded 53271 existing records from primary storage. [2025-10-15T22:35:34.145053] [INFO ] [MAIN ] COTY: Loaded 53271 primary data records. [2025-10-15T22:35:34.847632] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:34.848680] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-15T22:35:34.848865] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-15T22:35:34.882752] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-15T22:35:34.882953] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-15T22:35:34.898947] [INFO ] [MAIN ] Derivative Progress: 415/1803 symbols completed. COP took 1.1s. Estimated remaining: 8m 48s. Rate: 157.9 symbols/min [2025-10-15T22:35:34.896965] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:34.900471] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 46611 primary records. [2025-10-15T22:35:34.899364] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:34.900594] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-15T22:35:34.900873] [DEBUG] [MAIN ] COTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:34.902141] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53271 primary records. [2025-10-15T22:35:34.902344] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-15T22:35:34.932532] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-15T22:35:34.933022] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-15T22:35:34.935932] [INFO ] [MAIN ] Derivative Progress: 416/1803 symbols completed. COR took 1.1s. Estimated remaining: 8m 46s. Rate: 158.2 symbols/min [2025-10-15T22:35:34.937345] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:34.937553] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-10-15T22:35:34.938006] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-15T22:35:34.940291] [INFO ] [MAIN ] Derivative Progress: 417/1803 symbols completed. COTY took 1.1s. Estimated remaining: 8m 44s. Rate: 158.6 symbols/min [2025-10-15T22:35:34.940752] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:34.975038] [DEBUG] [LOCAL ] COUR: Loaded 49310 existing records from primary storage. [2025-10-15T22:35:34.982079] [INFO ] [MAIN ] COUR: Loaded 49310 primary data records. [2025-10-15T22:35:35.178513] [DEBUG] [LOCAL ] CPA: Loaded 28423 existing records from primary storage. [2025-10-15T22:35:35.198685] [DEBUG] [LOCAL ] CP: Loaded 53238 existing records from primary storage. [2025-10-15T22:35:35.197939] [INFO ] [MAIN ] CPA: Loaded 28423 primary data records. [2025-10-15T22:35:35.297138] [INFO ] [MAIN ] CP: Loaded 53238 primary data records. [2025-10-15T22:35:35.994408] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:35.995164] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 49310 primary records. [2025-10-15T22:35:35.995412] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-15T22:35:36.013314] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-15T22:35:36.013572] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-15T22:35:36.015838] [INFO ] [MAIN ] Derivative Progress: 418/1803 symbols completed. COUR took 1.1s. Estimated remaining: 8m 46s. Rate: 157.9 symbols/min [2025-10-15T22:35:36.033038] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:36.045576] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53238 primary records. [2025-10-15T22:35:36.045831] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:36.046481] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-15T22:35:36.046423] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28423 primary records. [2025-10-15T22:35:36.046582] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-15T22:35:36.075171] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-15T22:35:36.075877] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-15T22:35:36.078745] [INFO ] [MAIN ] Derivative Progress: 419/1803 symbols completed. CPA took 1.1s. Estimated remaining: 8m 45s. Rate: 158.2 symbols/min [2025-10-15T22:35:36.079731] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-15T22:35:36.079794] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-15T22:35:36.082360] [INFO ] [MAIN ] Derivative Progress: 420/1803 symbols completed. CP took 1.1s. Estimated remaining: 8m 43s. Rate: 158.6 symbols/min [2025-10-15T22:35:36.082709] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:36.082808] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:36.082929] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:36.102781] [DEBUG] [LOCAL ] CPF: Loaded 15271 existing records from primary storage. [2025-10-15T22:35:36.107724] [DEBUG] [LOCAL ] CPK: Loaded 13940 existing records from primary storage. [2025-10-15T22:35:36.107474] [INFO ] [MAIN ] CPF: Loaded 15271 primary data records. [2025-10-15T22:35:36.108005] [INFO ] [MAIN ] CPK: Loaded 13940 primary data records. [2025-10-15T22:35:36.342475] [DEBUG] [LOCAL ] CPAY: Loaded 30434 existing records from primary storage. [2025-10-15T22:35:36.373611] [INFO ] [MAIN ] CPAY: Loaded 30434 primary data records. [2025-10-15T22:35:37.038364] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:37.039405] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13940 primary records. [2025-10-15T22:35:37.039689] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-15T22:35:37.053087] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:37.064683] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15271 primary records. [2025-10-15T22:35:37.064949] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-15T22:35:37.086442] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-15T22:35:37.086804] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-15T22:35:37.089429] [INFO ] [MAIN ] Derivative Progress: 421/1803 symbols completed. CPF took 1.0s. Estimated remaining: 8m 45s. Rate: 157.9 symbols/min [2025-10-15T22:35:37.090006] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-15T22:35:37.089576] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:37.097575] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-15T22:35:37.104799] [INFO ] [MAIN ] Derivative Progress: 422/1803 symbols completed. CPK took 1.0s. Estimated remaining: 8m 43s. Rate: 158.3 symbols/min [2025-10-15T22:35:37.105403] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:37.105618] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:37.106366] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30434 primary records. [2025-10-15T22:35:37.106870] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-15T22:35:37.122953] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-15T22:35:37.123129] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-15T22:35:37.125428] [INFO ] [MAIN ] Derivative Progress: 423/1803 symbols completed. CPAY took 1.0s. Estimated remaining: 8m 42s. Rate: 158.7 symbols/min [2025-10-15T22:35:37.125669] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:37.173195] [DEBUG] [LOCAL ] CPS: Loaded 25220 existing records from primary storage. [2025-10-15T22:35:37.173387] [INFO ] [MAIN ] CPS: Loaded 25220 primary data records. [2025-10-15T22:35:37.304465] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-15T22:35:37.303431] [DEBUG] [LOCAL ] CPRI: Loaded 52475 existing records from primary storage. [2025-10-15T22:35:37.330380] [INFO ] [MAIN ] CPRI: Loaded 52475 primary data records. [2025-10-15T22:35:37.325209] [INFO ] [MAIN ] CPNG: Loaded 53679 primary data records. [2025-10-15T22:35:38.151964] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:38.152827] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25220 primary records. [2025-10-15T22:35:38.152928] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-15T22:35:38.170978] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-15T22:35:38.171115] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-15T22:35:38.173093] [INFO ] [MAIN ] Derivative Progress: 424/1803 symbols completed. CPS took 1.0s. Estimated remaining: 8m 44s. Rate: 158.0 symbols/min [2025-10-15T22:35:38.173723] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:38.199753] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:38.200897] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52475 primary records. [2025-10-15T22:35:38.213248] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-15T22:35:38.214827] [DEBUG] [MAIN ] CPNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:38.220972] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53679 primary records. [2025-10-15T22:35:38.229111] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-15T22:35:38.233038] [DEBUG] [LOCAL ] CQP: Loaded 18825 existing records from primary storage. [2025-10-15T22:35:38.233146] [INFO ] [MAIN ] CQP: Loaded 18825 primary data records. [2025-10-15T22:35:38.269262] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-15T22:35:38.304089] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-15T22:35:38.313667] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-15T22:35:38.343519] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-15T22:35:38.343420] [INFO ] [MAIN ] Derivative Progress: 425/1803 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 43s. Rate: 158.2 symbols/min [2025-10-15T22:35:38.363849] [INFO ] [MAIN ] Derivative Progress: 426/1803 symbols completed. CPNG took 1.3s. Estimated remaining: 8m 41s. Rate: 158.6 symbols/min [2025-10-15T22:35:38.363707] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:38.383150] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:38.599672] [DEBUG] [LOCAL ] CRBD: Loaded 8927 existing records from primary storage. [2025-10-15T22:35:38.599861] [INFO ] [MAIN ] CRBD: Loaded 8927 primary data records. [2025-10-15T22:35:38.687772] [DEBUG] [LOCAL ] CR: Loaded 24087 existing records from primary storage. [2025-10-15T22:35:38.704043] [INFO ] [MAIN ] CR: Loaded 24087 primary data records. [2025-10-15T22:35:39.249023] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:39.251262] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 18825 primary records. [2025-10-15T22:35:39.251770] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-15T22:35:39.277434] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-15T22:35:39.278544] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-15T22:35:39.281903] [INFO ] [MAIN ] Derivative Progress: 427/1803 symbols completed. CQP took 1.1s. Estimated remaining: 8m 42s. Rate: 158.0 symbols/min [2025-10-15T22:35:39.282638] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:39.300538] [DEBUG] [MAIN ] CRBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:39.301564] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8927 primary records. [2025-10-15T22:35:39.301794] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-15T22:35:39.318696] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-15T22:35:39.319156] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-15T22:35:39.322712] [INFO ] [MAIN ] Derivative Progress: 428/1803 symbols completed. CRBD took 0.9s. Estimated remaining: 8m 41s. Rate: 158.4 symbols/min [2025-10-15T22:35:39.322992] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:39.340187] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:39.341102] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24087 primary records. [2025-10-15T22:35:39.341260] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-15T22:35:39.374383] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-15T22:35:39.374687] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-15T22:35:39.378684] [INFO ] [MAIN ] Derivative Progress: 429/1803 symbols completed. CR took 1.0s. Estimated remaining: 8m 40s. Rate: 158.7 symbols/min [2025-10-15T22:35:39.379223] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:39.395796] [DEBUG] [LOCAL ] CRBG: Loaded 52586 existing records from primary storage. [2025-10-15T22:35:39.396145] [INFO ] [MAIN ] CRBG: Loaded 52586 primary data records. [2025-10-15T22:35:39.529479] [DEBUG] [LOCAL ] CRC: Loaded 44068 existing records from primary storage. [2025-10-15T22:35:39.533139] [INFO ] [MAIN ] CRC: Loaded 44068 primary data records. [2025-10-15T22:35:39.894821] [DEBUG] [LOCAL ] CRGY: Loaded 52507 existing records from primary storage. [2025-10-15T22:35:39.911589] [INFO ] [MAIN ] CRGY: Loaded 52507 primary data records. [2025-10-15T22:35:40.411276] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:40.412906] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52586 primary records. [2025-10-15T22:35:40.413110] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-15T22:35:40.431628] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-15T22:35:40.432072] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-15T22:35:40.434155] [INFO ] [MAIN ] Derivative Progress: 430/1803 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 41s. Rate: 158.0 symbols/min [2025-10-15T22:35:40.437076] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:40.453871] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:40.455145] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44068 primary records. [2025-10-15T22:35:40.455482] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-15T22:35:40.485629] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-15T22:35:40.490706] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-15T22:35:40.493094] [INFO ] [MAIN ] Derivative Progress: 431/1803 symbols completed. CRC took 1.2s. Estimated remaining: 8m 40s. Rate: 158.3 symbols/min [2025-10-15T22:35:40.493426] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:40.494474] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52507 primary records. [2025-10-15T22:35:40.494719] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-15T22:35:40.493737] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:40.523718] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-15T22:35:40.523846] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-15T22:35:40.526419] [INFO ] [MAIN ] Derivative Progress: 432/1803 symbols completed. CRGY took 1.1s. Estimated remaining: 8m 38s. Rate: 158.7 symbols/min [2025-10-15T22:35:40.526682] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:40.545826] [DEBUG] [LOCAL ] CRI: Loaded 49669 existing records from primary storage. [2025-10-15T22:35:40.546036] [INFO ] [MAIN ] CRI: Loaded 49669 primary data records. [2025-10-15T22:35:40.891293] [DEBUG] [LOCAL ] CRK: Loaded 52246 existing records from primary storage. [2025-10-15T22:35:40.892002] [INFO ] [MAIN ] CRK: Loaded 52246 primary data records. [2025-10-15T22:35:40.955065] [DEBUG] [LOCAL ] CRL: Loaded 42812 existing records from primary storage. [2025-10-15T22:35:40.972518] [INFO ] [MAIN ] CRL: Loaded 42812 primary data records. [2025-10-15T22:35:41.584868] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:41.586762] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49669 primary records. [2025-10-15T22:35:41.587026] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-15T22:35:41.604349] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-15T22:35:41.604508] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-15T22:35:41.606839] [INFO ] [MAIN ] Derivative Progress: 433/1803 symbols completed. CRI took 1.2s. Estimated remaining: 8m 40s. Rate: 158.0 symbols/min [2025-10-15T22:35:41.624688] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:41.625441] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52246 primary records. [2025-10-15T22:35:41.625619] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-15T22:35:41.641866] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-15T22:35:41.642361] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-15T22:35:41.645615] [INFO ] [MAIN ] Derivative Progress: 434/1803 symbols completed. CRK took 1.2s. Estimated remaining: 8m 39s. Rate: 158.3 symbols/min [2025-10-15T22:35:41.658792] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:41.659405] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42812 primary records. [2025-10-15T22:35:41.659465] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-15T22:35:41.674548] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-15T22:35:41.674631] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-15T22:35:41.677260] [INFO ] [MAIN ] Derivative Progress: 435/1803 symbols completed. CRL took 1.2s. Estimated remaining: 8m 37s. Rate: 158.6 symbols/min [2025-10-15T22:35:41.677766] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:41.677675] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:41.678183] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:41.685598] [DEBUG] [LOCAL ] CRT: Loaded 4885 existing records from primary storage. [2025-10-15T22:35:41.685907] [INFO ] [MAIN ] CRT: Loaded 4885 primary data records. [2025-10-15T22:35:42.028356] [DEBUG] [LOCAL ] CSAN: Loaded 42170 existing records from primary storage. [2025-10-15T22:35:42.029124] [DEBUG] [LOCAL ] CRS: Loaded 43214 existing records from primary storage. [2025-10-15T22:35:42.029477] [INFO ] [MAIN ] CSAN: Loaded 42170 primary data records. [2025-10-15T22:35:42.029738] [INFO ] [MAIN ] CRS: Loaded 43214 primary data records. [2025-10-15T22:35:42.718480] [DEBUG] [MAIN ] CRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:42.720435] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4885 primary records. [2025-10-15T22:35:42.720622] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-15T22:35:42.739363] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-15T22:35:42.741194] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-15T22:35:42.743438] [INFO ] [MAIN ] Derivative Progress: 436/1803 symbols completed. CRT took 1.1s. Estimated remaining: 8m 39s. Rate: 158.0 symbols/min [2025-10-15T22:35:42.744229] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:42.762384] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:42.763291] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42170 primary records. [2025-10-15T22:35:42.763561] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-15T22:35:42.781541] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-15T22:35:42.781796] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-15T22:35:42.784540] [INFO ] [MAIN ] Derivative Progress: 437/1803 symbols completed. CSAN took 1.1s. Estimated remaining: 8m 38s. Rate: 158.3 symbols/min [2025-10-15T22:35:42.784901] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:42.807702] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:42.808600] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43214 primary records. [2025-10-15T22:35:42.808843] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-15T22:35:42.827775] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-15T22:35:42.827936] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-15T22:35:42.831130] [INFO ] [MAIN ] Derivative Progress: 438/1803 symbols completed. CRS took 1.2s. Estimated remaining: 8m 36s. Rate: 158.6 symbols/min [2025-10-15T22:35:42.840554] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:42.846085] [DEBUG] [LOCAL ] CSR: Loaded 13403 existing records from primary storage. [2025-10-15T22:35:42.846928] [DEBUG] [LOCAL ] CSL: Loaded 31478 existing records from primary storage. [2025-10-15T22:35:42.847256] [INFO ] [MAIN ] CSR: Loaded 13403 primary data records. [2025-10-15T22:35:42.858513] [INFO ] [MAIN ] CSL: Loaded 31478 primary data records. [2025-10-15T22:35:43.489060] [DEBUG] [LOCAL ] CSTM: Loaded 47572 existing records from primary storage. [2025-10-15T22:35:43.490356] [INFO ] [MAIN ] CSTM: Loaded 47572 primary data records. [2025-10-15T22:35:43.896318] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:43.896043] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:43.897317] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 13403 primary records. [2025-10-15T22:35:43.898053] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-15T22:35:43.897951] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31478 primary records. [2025-10-15T22:35:43.898913] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-15T22:35:43.928262] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-15T22:35:43.929075] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-15T22:35:43.932807] [INFO ] [MAIN ] Derivative Progress: 439/1803 symbols completed. CSR took 1.1s. Estimated remaining: 8m 38s. Rate: 157.9 symbols/min [2025-10-15T22:35:43.933929] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:43.936301] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-10-15T22:35:43.936618] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-15T22:35:43.939123] [INFO ] [MAIN ] Derivative Progress: 440/1803 symbols completed. CSL took 1.2s. Estimated remaining: 8m 37s. Rate: 158.3 symbols/min [2025-10-15T22:35:43.939516] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:43.966379] [DEBUG] [LOCAL ] CTBB: Loaded 6784 existing records from primary storage. [2025-10-15T22:35:43.966114] [DEBUG] [MAIN ] CSTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:43.971517] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47572 primary records. [2025-10-15T22:35:43.971826] [DEBUG] [LOCAL ] CSV: Loaded 12707 existing records from primary storage. [2025-10-15T22:35:43.971948] [INFO ] [MAIN ] CTBB: Loaded 6784 primary data records. [2025-10-15T22:35:43.972085] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-15T22:35:43.972243] [INFO ] [MAIN ] CSV: Loaded 12707 primary data records. [2025-10-15T22:35:44.226209] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-15T22:35:44.266817] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-15T22:35:44.332912] [INFO ] [MAIN ] Derivative Progress: 441/1803 symbols completed. CSTM took 1.5s. Estimated remaining: 8m 36s. Rate: 158.3 symbols/min [2025-10-15T22:35:44.476709] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:44.603829] [DEBUG] [LOCAL ] CTDD: Loaded 5471 existing records from primary storage. [2025-10-15T22:35:44.604413] [INFO ] [MAIN ] CTDD: Loaded 5471 primary data records. [2025-10-15T22:35:44.930923] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:44.939364] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12707 primary records. [2025-10-15T22:35:44.944080] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-15T22:35:44.945112] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:44.955378] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 6784 primary records. [2025-10-15T22:35:44.958776] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-15T22:35:44.977277] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-15T22:35:44.978214] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-15T22:35:44.980694] [INFO ] [MAIN ] Derivative Progress: 442/1803 symbols completed. CTBB took 1.0s. Estimated remaining: 8m 37s. Rate: 158.0 symbols/min [2025-10-15T22:35:44.981464] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:44.984421] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-15T22:35:44.984866] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-15T22:35:44.987834] [INFO ] [MAIN ] Derivative Progress: 443/1803 symbols completed. CSV took 1.1s. Estimated remaining: 8m 35s. Rate: 158.4 symbols/min [2025-10-15T22:35:44.988969] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:45.003517] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:35:45.004318] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5471 primary records. [2025-10-15T22:35:45.004456] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-15T22:35:45.027596] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-10-15T22:35:45.027793] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-15T22:35:45.031250] [INFO ] [MAIN ] Derivative Progress: 444/1803 symbols completed. CTDD took 0.6s. Estimated remaining: 8m 34s. Rate: 158.7 symbols/min [2025-10-15T22:35:45.031510] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:45.049793] [DEBUG] [LOCAL ] CTO: Loaded 27682 existing records from primary storage. [2025-10-15T22:35:45.049923] [INFO ] [MAIN ] CTO: Loaded 27682 primary data records. [2025-10-15T22:35:45.130495] [DEBUG] [LOCAL ] CTOS: Loaded 37188 existing records from primary storage. [2025-10-15T22:35:45.152790] [INFO ] [MAIN ] CTOS: Loaded 37188 primary data records. [2025-10-15T22:35:45.646211] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-15T22:35:45.729167] [INFO ] [MAIN ] CTRA: Loaded 53648 primary data records. [2025-10-15T22:35:46.060136] [DEBUG] [MAIN ] CTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:46.062695] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27682 primary records. [2025-10-15T22:35:46.063000] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-15T22:35:46.090280] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:46.093437] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-15T22:35:46.094317] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 37188 primary records. [2025-10-15T22:35:46.094604] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-15T22:35:46.094712] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-15T22:35:46.097163] [INFO ] [MAIN ] Derivative Progress: 445/1803 symbols completed. CTO took 1.1s. Estimated remaining: 8m 36s. Rate: 158.0 symbols/min [2025-10-15T22:35:46.097878] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:46.114144] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-15T22:35:46.114425] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-15T22:35:46.116840] [INFO ] [MAIN ] Derivative Progress: 446/1803 symbols completed. CTOS took 1.1s. Estimated remaining: 8m 34s. Rate: 158.4 symbols/min [2025-10-15T22:35:46.117963] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:46.133914] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:46.134759] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53648 primary records. [2025-10-15T22:35:46.134920] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-15T22:35:46.156111] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-15T22:35:46.156335] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-15T22:35:46.158863] [INFO ] [MAIN ] Derivative Progress: 447/1803 symbols completed. CTRA took 1.1s. Estimated remaining: 8m 33s. Rate: 158.7 symbols/min [2025-10-15T22:35:46.159031] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:46.177606] [DEBUG] [LOCAL ] CTS: Loaded 19649 existing records from primary storage. [2025-10-15T22:35:46.177816] [INFO ] [MAIN ] CTS: Loaded 19649 primary data records. [2025-10-15T22:35:46.329058] [DEBUG] [LOCAL ] CTRE: Loaded 49482 existing records from primary storage. [2025-10-15T22:35:46.334828] [INFO ] [MAIN ] CTRE: Loaded 49482 primary data records. [2025-10-15T22:35:46.680570] [DEBUG] [LOCAL ] CTVA: Loaded 53298 existing records from primary storage. [2025-10-15T22:35:46.701881] [INFO ] [MAIN ] CTVA: Loaded 53298 primary data records. [2025-10-15T22:35:47.176368] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:47.179371] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19649 primary records. [2025-10-15T22:35:47.180106] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-15T22:35:47.197928] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-15T22:35:47.198418] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-15T22:35:47.200715] [INFO ] [MAIN ] Derivative Progress: 448/1803 symbols completed. CTS took 1.1s. Estimated remaining: 8m 34s. Rate: 158.1 symbols/min [2025-10-15T22:35:47.215125] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:47.216904] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49482 primary records. [2025-10-15T22:35:47.216985] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-15T22:35:47.246809] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:47.247291] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-15T22:35:47.248178] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53298 primary records. [2025-10-15T22:35:47.248282] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-15T22:35:47.250825] [INFO ] [MAIN ] Derivative Progress: 449/1803 symbols completed. CTRE took 1.2s. Estimated remaining: 8m 33s. Rate: 158.4 symbols/min [2025-10-15T22:35:47.248426] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-15T22:35:47.266835] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-15T22:35:47.266901] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-15T22:35:47.270659] [INFO ] [MAIN ] Derivative Progress: 450/1803 symbols completed. CTVA took 1.1s. Estimated remaining: 8m 31s. Rate: 158.7 symbols/min [2025-10-15T22:35:47.271421] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:47.271349] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:47.271265] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:47.298869] [DEBUG] [LOCAL ] CUBI: Loaded 27163 existing records from primary storage. [2025-10-15T22:35:47.299028] [INFO ] [MAIN ] CUBI: Loaded 27163 primary data records. [2025-10-15T22:35:47.681627] [DEBUG] [LOCAL ] CUK: Loaded 51046 existing records from primary storage. [2025-10-15T22:35:47.682602] [DEBUG] [LOCAL ] CUBE: Loaded 50909 existing records from primary storage. [2025-10-15T22:35:47.682786] [INFO ] [MAIN ] CUK: Loaded 51046 primary data records. [2025-10-15T22:35:47.683050] [INFO ] [MAIN ] CUBE: Loaded 50909 primary data records. [2025-10-15T22:35:48.297053] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:48.298304] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27163 primary records. [2025-10-15T22:35:48.298456] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-15T22:35:48.316293] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-15T22:35:48.316674] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-15T22:35:48.319143] [INFO ] [MAIN ] Derivative Progress: 451/1803 symbols completed. CUBI took 1.0s. Estimated remaining: 8m 33s. Rate: 158.1 symbols/min [2025-10-15T22:35:48.319383] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:48.355253] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:48.356412] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50909 primary records. [2025-10-15T22:35:48.356800] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-15T22:35:48.356706] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:48.358220] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51046 primary records. [2025-10-15T22:35:48.358737] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-15T22:35:48.400609] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-15T22:35:48.402463] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-15T22:35:48.413507] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-15T22:35:48.417519] [DEBUG] [LOCAL ] CURB: Loaded 32854 existing records from primary storage. [2025-10-15T22:35:48.416473] [INFO ] [MAIN ] Derivative Progress: 452/1803 symbols completed. CUBE took 1.1s. Estimated remaining: 8m 32s. Rate: 158.4 symbols/min [2025-10-15T22:35:48.416750] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-15T22:35:48.417871] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:48.418802] [INFO ] [MAIN ] CURB: Loaded 32854 primary data records. [2025-10-15T22:35:48.421625] [INFO ] [MAIN ] Derivative Progress: 453/1803 symbols completed. CUK took 1.2s. Estimated remaining: 8m 30s. Rate: 158.7 symbols/min [2025-10-15T22:35:48.422008] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:48.557854] [DEBUG] [LOCAL ] CURV: Loaded 26989 existing records from primary storage. [2025-10-15T22:35:48.563342] [INFO ] [MAIN ] CURV: Loaded 26989 primary data records. [2025-10-15T22:35:48.919424] [DEBUG] [LOCAL ] CUZ: Loaded 49639 existing records from primary storage. [2025-10-15T22:35:48.928441] [INFO ] [MAIN ] CUZ: Loaded 49639 primary data records. [2025-10-15T22:35:49.452114] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:49.454289] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32854 primary records. [2025-10-15T22:35:49.454558] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-15T22:35:49.475492] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:49.480072] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26989 primary records. [2025-10-15T22:35:49.480965] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-15T22:35:49.485098] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-15T22:35:49.485360] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-15T22:35:49.487306] [INFO ] [MAIN ] Derivative Progress: 454/1803 symbols completed. CURB took 1.2s. Estimated remaining: 8m 32s. Rate: 158.1 symbols/min [2025-10-15T22:35:49.487685] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:49.503409] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-15T22:35:49.504348] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-15T22:35:49.507618] [INFO ] [MAIN ] Derivative Progress: 455/1803 symbols completed. CURV took 1.1s. Estimated remaining: 8m 31s. Rate: 158.4 symbols/min [2025-10-15T22:35:49.508031] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:49.521727] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:49.522509] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49639 primary records. [2025-10-15T22:35:49.526455] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-15T22:35:49.547377] [DEBUG] [LOCAL ] CVEO: Loaded 15382 existing records from primary storage. [2025-10-15T22:35:49.548760] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-15T22:35:49.548845] [INFO ] [MAIN ] CVEO: Loaded 15382 primary data records. [2025-10-15T22:35:49.548982] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-15T22:35:49.551508] [INFO ] [MAIN ] Derivative Progress: 456/1803 symbols completed. CUZ took 1.1s. Estimated remaining: 8m 29s. Rate: 158.7 symbols/min [2025-10-15T22:35:49.551756] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:49.890710] [DEBUG] [LOCAL ] CVI: Loaded 46660 existing records from primary storage. [2025-10-15T22:35:49.904950] [INFO ] [MAIN ] CVI: Loaded 46660 primary data records. [2025-10-15T22:35:50.023718] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-15T22:35:50.040090] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-15T22:35:50.529626] [DEBUG] [MAIN ] CVEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:50.530872] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15382 primary records. [2025-10-15T22:35:50.531067] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-15T22:35:50.548204] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-10-15T22:35:50.548460] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-15T22:35:50.550732] [INFO ] [MAIN ] Derivative Progress: 457/1803 symbols completed. CVEO took 1.1s. Estimated remaining: 8m 31s. Rate: 158.1 symbols/min [2025-10-15T22:35:50.550887] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:50.569380] [DEBUG] [MAIN ] CVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:50.570082] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46660 primary records. [2025-10-15T22:35:50.570348] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-15T22:35:50.586860] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-10-15T22:35:50.588756] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-15T22:35:50.590914] [INFO ] [MAIN ] Derivative Progress: 458/1803 symbols completed. CVI took 1.1s. Estimated remaining: 8m 29s. Rate: 158.5 symbols/min [2025-10-15T22:35:50.591144] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:50.605426] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:50.606115] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53694 primary records. [2025-10-15T22:35:50.606249] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-15T22:35:50.622290] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-15T22:35:50.635419] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-15T22:35:50.638483] [INFO ] [MAIN ] Derivative Progress: 459/1803 symbols completed. CVS took 1.1s. Estimated remaining: 8m 28s. Rate: 158.8 symbols/min [2025-10-15T22:35:50.643251] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:50.653438] [DEBUG] [LOCAL ] CW: Loaded 22100 existing records from primary storage. [2025-10-15T22:35:50.653567] [INFO ] [MAIN ] CW: Loaded 22100 primary data records. [2025-10-15T22:35:50.768179] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-15T22:35:50.779942] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-15T22:35:51.125634] [DEBUG] [LOCAL ] CWAN: Loaded 52616 existing records from primary storage. [2025-10-15T22:35:51.137159] [INFO ] [MAIN ] CWAN: Loaded 52616 primary data records. [2025-10-15T22:35:51.711217] [DEBUG] [MAIN ] CW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:51.713147] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22100 primary records. [2025-10-15T22:35:51.713690] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-15T22:35:51.743100] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:51.747815] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-10-15T22:35:51.748080] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-15T22:35:51.761971] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-10-15T22:35:51.767182] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-15T22:35:51.770967] [INFO ] [MAIN ] Derivative Progress: 460/1803 symbols completed. CW took 1.2s. Estimated remaining: 8m 30s. Rate: 158.1 symbols/min [2025-10-15T22:35:51.771257] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:51.775218] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-15T22:35:51.775951] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-15T22:35:51.779880] [INFO ] [MAIN ] Derivative Progress: 461/1803 symbols completed. CVX took 1.2s. Estimated remaining: 8m 28s. Rate: 158.4 symbols/min [2025-10-15T22:35:51.780516] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:51.796964] [DEBUG] [MAIN ] CWAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:51.797741] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52616 primary records. [2025-10-15T22:35:51.797860] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-15T22:35:51.815272] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-15T22:35:51.815602] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-15T22:35:51.817918] [INFO ] [MAIN ] Derivative Progress: 462/1803 symbols completed. CWAN took 1.2s. Estimated remaining: 8m 27s. Rate: 158.7 symbols/min [2025-10-15T22:35:51.818223] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:51.850882] [DEBUG] [LOCAL ] CWEN: Loaded 45322 existing records from primary storage. [2025-10-15T22:35:51.851142] [INFO ] [MAIN ] CWEN: Loaded 45322 primary data records. [2025-10-15T22:35:52.075830] [DEBUG] [LOCAL ] CWK: Loaded 49628 existing records from primary storage. [2025-10-15T22:35:52.069940] [DEBUG] [LOCAL ] CWH: Loaded 51349 existing records from primary storage. [2025-10-15T22:35:52.081320] [INFO ] [MAIN ] CWK: Loaded 49628 primary data records. [2025-10-15T22:35:52.123180] [INFO ] [MAIN ] CWH: Loaded 51349 primary data records. [2025-10-15T22:35:52.925452] [DEBUG] [MAIN ] CWEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:52.927183] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45322 primary records. [2025-10-15T22:35:52.927973] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-15T22:35:52.946511] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-15T22:35:52.947003] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-15T22:35:52.949330] [INFO ] [MAIN ] Derivative Progress: 463/1803 symbols completed. CWEN took 1.2s. Estimated remaining: 8m 29s. Rate: 158.0 symbols/min [2025-10-15T22:35:52.974453] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:52.975263] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51349 primary records. [2025-10-15T22:35:52.975465] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-15T22:35:53.008334] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-15T22:35:53.008520] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-15T22:35:53.006517] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:53.010915] [INFO ] [MAIN ] Derivative Progress: 464/1803 symbols completed. CWH took 1.2s. Estimated remaining: 8m 27s. Rate: 158.3 symbols/min [2025-10-15T22:35:53.011823] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49628 primary records. [2025-10-15T22:35:53.012135] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-15T22:35:53.028209] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-15T22:35:53.028375] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-15T22:35:53.031224] [INFO ] [MAIN ] Derivative Progress: 465/1803 symbols completed. CWK took 1.2s. Estimated remaining: 8m 26s. Rate: 158.6 symbols/min [2025-10-15T22:35:53.031923] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:53.031877] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:53.032277] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:53.043080] [DEBUG] [LOCAL ] CXH: Loaded 4432 existing records from primary storage. [2025-10-15T22:35:53.043467] [INFO ] [MAIN ] CXH: Loaded 4432 primary data records. [2025-10-15T22:35:53.091532] [DEBUG] [LOCAL ] CXE: Loaded 6145 existing records from primary storage. [2025-10-15T22:35:53.114251] [INFO ] [MAIN ] CXE: Loaded 6145 primary data records. [2025-10-15T22:35:53.242744] [DEBUG] [LOCAL ] CWT: Loaded 28121 existing records from primary storage. [2025-10-15T22:35:53.254758] [INFO ] [MAIN ] CWT: Loaded 28121 primary data records. [2025-10-15T22:35:54.108501] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:54.109992] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4432 primary records. [2025-10-15T22:35:54.108985] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:54.112412] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6145 primary records. [2025-10-15T22:35:54.110992] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-15T22:35:54.112529] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-15T22:35:54.133964] [DEBUG] [MAIN ] CWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:54.141299] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 28121 primary records. [2025-10-15T22:35:54.141403] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-15T22:35:54.155389] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-10-15T22:35:54.175030] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-15T22:35:54.175198] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-15T22:35:54.174045] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-15T22:35:54.169385] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-15T22:35:54.175408] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-15T22:35:54.177601] [INFO ] [MAIN ] Derivative Progress: 466/1803 symbols completed. CXH took 1.1s. Estimated remaining: 8m 28s. Rate: 158.0 symbols/min [2025-10-15T22:35:54.181020] [INFO ] [MAIN ] Derivative Progress: 467/1803 symbols completed. CWT took 1.1s. Estimated remaining: 8m 26s. Rate: 158.3 symbols/min [2025-10-15T22:35:54.184388] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:54.180908] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:54.184667] [INFO ] [MAIN ] Derivative Progress: 468/1803 symbols completed. CXE took 1.2s. Estimated remaining: 8m 25s. Rate: 158.6 symbols/min [2025-10-15T22:35:54.185557] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:54.232030] [DEBUG] [LOCAL ] CXT: Loaded 31065 existing records from primary storage. [2025-10-15T22:35:54.232187] [INFO ] [MAIN ] CXT: Loaded 31065 primary data records. [2025-10-15T22:35:54.354345] [DEBUG] [LOCAL ] CXM: Loaded 47569 existing records from primary storage. [2025-10-15T22:35:54.362001] [INFO ] [MAIN ] CXM: Loaded 47569 primary data records. [2025-10-15T22:35:54.427498] [DEBUG] [LOCAL ] CXW: Loaded 43921 existing records from primary storage. [2025-10-15T22:35:54.457980] [INFO ] [MAIN ] CXW: Loaded 43921 primary data records. [2025-10-15T22:35:55.243133] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:55.244117] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 31065 primary records. [2025-10-15T22:35:55.244304] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-15T22:35:55.263469] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-15T22:35:55.264445] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-15T22:35:55.282428] [INFO ] [MAIN ] Derivative Progress: 469/1803 symbols completed. CXT took 1.1s. Estimated remaining: 8m 27s. Rate: 158.0 symbols/min [2025-10-15T22:35:55.283054] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:55.283973] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47569 primary records. [2025-10-15T22:35:55.284347] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-15T22:35:55.284153] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:55.307534] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:55.311228] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43921 primary records. [2025-10-15T22:35:55.315754] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-15T22:35:55.314688] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-15T22:35:55.315930] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-15T22:35:55.318638] [INFO ] [MAIN ] Derivative Progress: 470/1803 symbols completed. CXM took 1.1s. Estimated remaining: 8m 25s. Rate: 158.3 symbols/min [2025-10-15T22:35:55.318937] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:55.345484] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-15T22:35:55.345757] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-15T22:35:55.348685] [INFO ] [MAIN ] Derivative Progress: 471/1803 symbols completed. CXW took 1.2s. Estimated remaining: 8m 24s. Rate: 158.6 symbols/min [2025-10-15T22:35:55.348992] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:55.358922] [DEBUG] [LOCAL ] CYD: Loaded 26842 existing records from primary storage. [2025-10-15T22:35:55.359196] [INFO ] [MAIN ] CYD: Loaded 26842 primary data records. [2025-10-15T22:35:55.769215] [DEBUG] [LOCAL ] CYH: Loaded 47734 existing records from primary storage. [2025-10-15T22:35:55.769987] [INFO ] [MAIN ] CYH: Loaded 47734 primary data records. [2025-10-15T22:35:55.889504] [DEBUG] [LOCAL ] D: Loaded 53646 existing records from primary storage. [2025-10-15T22:35:55.889773] [INFO ] [MAIN ] D: Loaded 53646 primary data records. [2025-10-15T22:35:56.406898] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:56.407954] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26842 primary records. [2025-10-15T22:35:56.408064] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-15T22:35:56.428437] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-15T22:35:56.428722] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-15T22:35:56.431337] [INFO ] [MAIN ] Derivative Progress: 472/1803 symbols completed. CYD took 1.1s. Estimated remaining: 8m 26s. Rate: 158.0 symbols/min [2025-10-15T22:35:56.431750] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:56.451787] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:56.452510] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47734 primary records. [2025-10-15T22:35:56.455588] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-15T22:35:56.473431] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-15T22:35:56.474334] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-15T22:35:56.481540] [INFO ] [MAIN ] Derivative Progress: 473/1803 symbols completed. CYH took 1.2s. Estimated remaining: 8m 24s. Rate: 158.3 symbols/min [2025-10-15T22:35:56.481996] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:56.482484] [DEBUG] [LOCAL ] DAC: Loaded 12616 existing records from primary storage. [2025-10-15T22:35:56.483026] [INFO ] [MAIN ] DAC: Loaded 12616 primary data records. [2025-10-15T22:35:56.540524] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:56.553834] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53646 primary records. [2025-10-15T22:35:56.580673] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-15T22:35:56.820044] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-15T22:35:56.834535] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-15T22:35:56.837381] [INFO ] [MAIN ] Derivative Progress: 474/1803 symbols completed. D took 1.5s. Estimated remaining: 8m 24s. Rate: 158.3 symbols/min [2025-10-15T22:35:56.838413] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:56.861360] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-15T22:35:56.867097] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-15T22:35:56.992848] [DEBUG] [LOCAL ] DAO: Loaded 19797 existing records from primary storage. [2025-10-15T22:35:56.993591] [INFO ] [MAIN ] DAO: Loaded 19797 primary data records. [2025-10-15T22:35:57.066880] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:57.159591] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12616 primary records. [2025-10-15T22:35:57.287028] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-15T22:35:57.388870] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-15T22:35:57.393270] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-15T22:35:57.395886] [INFO ] [MAIN ] Derivative Progress: 475/1803 symbols completed. DAC took 1.0s. Estimated remaining: 8m 24s. Rate: 158.1 symbols/min [2025-10-15T22:35:57.498316] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:57.537849] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:57.539262] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-15T22:35:57.539529] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-15T22:35:57.556013] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-15T22:35:57.556214] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-15T22:35:57.559149] [INFO ] [MAIN ] Derivative Progress: 476/1803 symbols completed. DAL took 1.1s. Estimated remaining: 8m 23s. Rate: 158.3 symbols/min [2025-10-15T22:35:57.560415] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:57.589580] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:57.590244] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 19797 primary records. [2025-10-15T22:35:57.590373] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-15T22:35:57.626410] [DEBUG] [LOCAL ] DAR: Loaded 51991 existing records from primary storage. [2025-10-15T22:35:57.627228] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-15T22:35:57.627585] [INFO ] [MAIN ] DAR: Loaded 51991 primary data records. [2025-10-15T22:35:57.627422] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-15T22:35:57.630088] [INFO ] [MAIN ] Derivative Progress: 477/1803 symbols completed. DAO took 0.8s. Estimated remaining: 8m 22s. Rate: 158.6 symbols/min [2025-10-15T22:35:57.635540] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:57.772703] [DEBUG] [LOCAL ] DAVA: Loaded 41847 existing records from primary storage. [2025-10-15T22:35:57.794865] [INFO ] [MAIN ] DAVA: Loaded 41847 primary data records. [2025-10-15T22:35:58.167447] [DEBUG] [LOCAL ] DB: Loaded 52503 existing records from primary storage. [2025-10-15T22:35:58.293202] [INFO ] [MAIN ] DB: Loaded 52503 primary data records. [2025-10-15T22:35:58.625515] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:58.627438] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51991 primary records. [2025-10-15T22:35:58.627857] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-15T22:35:58.646122] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-15T22:35:58.647060] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-15T22:35:58.649427] [INFO ] [MAIN ] Derivative Progress: 478/1803 symbols completed. DAR took 1.2s. Estimated remaining: 8m 23s. Rate: 158.0 symbols/min [2025-10-15T22:35:58.674224] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:58.675288] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41847 primary records. [2025-10-15T22:35:58.675566] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-15T22:35:58.697243] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-15T22:35:58.710255] [DEBUG] [MAIN ] DB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:58.711211] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52503 primary records. [2025-10-15T22:35:58.711326] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-15T22:35:58.713388] [INFO ] [MAIN ] Derivative Progress: 479/1803 symbols completed. DAVA took 1.2s. Estimated remaining: 8m 22s. Rate: 158.3 symbols/min [2025-10-15T22:35:58.713520] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-15T22:35:58.729462] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-15T22:35:58.729592] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-15T22:35:58.732575] [INFO ] [MAIN ] Derivative Progress: 480/1803 symbols completed. DB took 1.1s. Estimated remaining: 8m 20s. Rate: 158.6 symbols/min [2025-10-15T22:35:58.733023] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:58.733139] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:58.733214] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:58.778816] [DEBUG] [LOCAL ] DBI: Loaded 43916 existing records from primary storage. [2025-10-15T22:35:58.789180] [INFO ] [MAIN ] DBI: Loaded 43916 primary data records. [2025-10-15T22:35:58.954698] [DEBUG] [LOCAL ] DBRG: Loaded 49905 existing records from primary storage. [2025-10-15T22:35:58.955308] [DEBUG] [LOCAL ] DCI: Loaded 37027 existing records from primary storage. [2025-10-15T22:35:59.006098] [INFO ] [MAIN ] DBRG: Loaded 49905 primary data records. [2025-10-15T22:35:59.006240] [INFO ] [MAIN ] DCI: Loaded 37027 primary data records. [2025-10-15T22:35:59.789370] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:59.790434] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 43916 primary records. [2025-10-15T22:35:59.790862] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-15T22:35:59.809624] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-15T22:35:59.809861] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-15T22:35:59.811978] [INFO ] [MAIN ] Derivative Progress: 481/1803 symbols completed. DBI took 1.1s. Estimated remaining: 8m 22s. Rate: 158.0 symbols/min [2025-10-15T22:35:59.812234] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:59.842293] [DEBUG] [MAIN ] DCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:59.842679] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:35:59.843329] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37027 primary records. [2025-10-15T22:35:59.843467] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-15T22:35:59.844091] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49905 primary records. [2025-10-15T22:35:59.848467] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-15T22:35:59.879513] [DEBUG] [LOCAL ] DCO: Loaded 14597 existing records from primary storage. [2025-10-15T22:35:59.880815] [INFO ] [MAIN ] DCO: Loaded 14597 primary data records. [2025-10-15T22:35:59.926298] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-15T22:35:59.952789] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-15T22:35:59.952854] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-15T22:35:59.952999] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-15T22:35:59.955398] [INFO ] [MAIN ] Derivative Progress: 482/1803 symbols completed. DBRG took 1.2s. Estimated remaining: 8m 21s. Rate: 158.2 symbols/min [2025-10-15T22:35:59.955582] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:35:59.963220] [INFO ] [MAIN ] Derivative Progress: 483/1803 symbols completed. DCI took 1.2s. Estimated remaining: 8m 20s. Rate: 158.5 symbols/min [2025-10-15T22:35:59.974476] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:00.228994] [DEBUG] [LOCAL ] DD: Loaded 52926 existing records from primary storage. [2025-10-15T22:36:00.230092] [INFO ] [MAIN ] DD: Loaded 52926 primary data records. [2025-10-15T22:36:00.307529] [DEBUG] [LOCAL ] DDD: Loaded 50928 existing records from primary storage. [2025-10-15T22:36:00.342141] [INFO ] [MAIN ] DDD: Loaded 50928 primary data records. [2025-10-15T22:36:00.521488] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:00.658338] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 14597 primary records. [2025-10-15T22:36:00.658432] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-15T22:36:00.714390] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-15T22:36:00.747146] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-15T22:36:00.753855] [INFO ] [MAIN ] Derivative Progress: 484/1803 symbols completed. DCO took 0.9s. Estimated remaining: 8m 20s. Rate: 158.2 symbols/min [2025-10-15T22:36:00.864168] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:00.890982] [DEBUG] [MAIN ] DD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:36:00.892106] [INFO ] [MAIN ] DD: Generated 1793 derivative records from 52926 primary records. [2025-10-15T22:36:00.892383] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-15T22:36:00.933048] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:00.933942] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50928 primary records. [2025-10-15T22:36:00.934608] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-15T22:36:00.954709] [DEBUG] [LOCAL ] DD: Derivative data saved (1793 records). [2025-10-15T22:36:00.957993] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-15T22:36:00.955450] [DEBUG] [LOCAL ] DDL: Loaded 36922 existing records from primary storage. [2025-10-15T22:36:00.958590] [INFO ] [MAIN ] DDL: Loaded 36922 primary data records. [2025-10-15T22:36:00.962413] [INFO ] [MAIN ] Derivative Progress: 485/1803 symbols completed. DD took 1.0s. Estimated remaining: 8m 19s. Rate: 158.3 symbols/min [2025-10-15T22:36:00.963166] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:00.965307] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-15T22:36:00.965380] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-15T22:36:00.967527] [INFO ] [MAIN ] Derivative Progress: 486/1803 symbols completed. DDD took 1.0s. Estimated remaining: 8m 18s. Rate: 158.6 symbols/min [2025-10-15T22:36:00.989242] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:01.311704] [DEBUG] [LOCAL ] DEA: Loaded 40436 existing records from primary storage. [2025-10-15T22:36:01.313306] [INFO ] [MAIN ] DEA: Loaded 40436 primary data records. [2025-10-15T22:36:01.430598] [DEBUG] [LOCAL ] DE: Loaded 47661 existing records from primary storage. [2025-10-15T22:36:01.431125] [INFO ] [MAIN ] DE: Loaded 47661 primary data records. [2025-10-15T22:36:01.966068] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:01.967403] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36922 primary records. [2025-10-15T22:36:01.967503] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-15T22:36:01.985275] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-15T22:36:01.986420] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-15T22:36:01.988793] [INFO ] [MAIN ] Derivative Progress: 487/1803 symbols completed. DDL took 1.1s. Estimated remaining: 8m 19s. Rate: 158.1 symbols/min [2025-10-15T22:36:01.989170] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:02.006568] [DEBUG] [MAIN ] DEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:02.007376] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40436 primary records. [2025-10-15T22:36:02.007554] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-15T22:36:02.037985] [DEBUG] [MAIN ] DE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:02.039589] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47661 primary records. [2025-10-15T22:36:02.040132] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-10-15T22:36:02.040339] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-15T22:36:02.042371] [INFO ] [MAIN ] Derivative Progress: 488/1803 symbols completed. DEA took 1.1s. Estimated remaining: 8m 18s. Rate: 158.4 symbols/min [2025-10-15T22:36:02.040404] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-15T22:36:02.050008] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:02.075995] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-15T22:36:02.076753] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-15T22:36:02.076574] [DEBUG] [LOCAL ] DEC: Loaded 30346 existing records from primary storage. [2025-10-15T22:36:02.076843] [INFO ] [MAIN ] DEC: Loaded 30346 primary data records. [2025-10-15T22:36:02.079335] [INFO ] [MAIN ] Derivative Progress: 489/1803 symbols completed. DE took 1.1s. Estimated remaining: 8m 17s. Rate: 158.7 symbols/min [2025-10-15T22:36:02.079629] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:02.405851] [DEBUG] [LOCAL ] DECK: Loaded 53297 existing records from primary storage. [2025-10-15T22:36:02.406143] [INFO ] [MAIN ] DECK: Loaded 53297 primary data records. [2025-10-15T22:36:02.598851] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-15T22:36:02.655859] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-15T22:36:03.053541] [DEBUG] [MAIN ] DEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:03.054632] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30346 primary records. [2025-10-15T22:36:03.055102] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-15T22:36:03.074733] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-10-15T22:36:03.076063] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-15T22:36:03.079479] [INFO ] [MAIN ] Derivative Progress: 490/1803 symbols completed. DEC took 1.1s. Estimated remaining: 8m 18s. Rate: 158.1 symbols/min [2025-10-15T22:36:03.080567] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:03.097085] [DEBUG] [MAIN ] DECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:03.097881] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53297 primary records. [2025-10-15T22:36:03.098009] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-15T22:36:03.119532] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-15T22:36:03.120915] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-15T22:36:03.123855] [INFO ] [MAIN ] Derivative Progress: 491/1803 symbols completed. DECK took 1.1s. Estimated remaining: 8m 17s. Rate: 158.4 symbols/min [2025-10-15T22:36:03.124020] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:03.137898] [DEBUG] [MAIN ] DELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:03.138800] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-10-15T22:36:03.149819] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-15T22:36:03.166253] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-15T22:36:03.166516] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-15T22:36:03.169683] [INFO ] [MAIN ] Derivative Progress: 492/1803 symbols completed. DELL took 1.1s. Estimated remaining: 8m 16s. Rate: 158.7 symbols/min [2025-10-15T22:36:03.177029] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:03.192435] [DEBUG] [LOCAL ] DEO: Loaded 49216 existing records from primary storage. [2025-10-15T22:36:03.192751] [INFO ] [MAIN ] DEO: Loaded 49216 primary data records. [2025-10-15T22:36:03.311511] [DEBUG] [LOCAL ] DFH: Loaded 32196 existing records from primary storage. [2025-10-15T22:36:03.311747] [INFO ] [MAIN ] DFH: Loaded 32196 primary data records. [2025-10-15T22:36:03.413464] [DEBUG] [LOCAL ] DFIN: Loaded 22637 existing records from primary storage. [2025-10-15T22:36:03.475462] [INFO ] [MAIN ] DFIN: Loaded 22637 primary data records. [2025-10-15T22:36:04.161564] [DEBUG] [MAIN ] DEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:04.163912] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49216 primary records. [2025-10-15T22:36:04.164101] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-15T22:36:04.184953] [DEBUG] [MAIN ] DFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:04.185611] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32196 primary records. [2025-10-15T22:36:04.185898] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-15T22:36:04.212314] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-15T22:36:04.213226] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-10-15T22:36:04.213412] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-15T22:36:04.221267] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-15T22:36:04.227852] [INFO ] [MAIN ] Derivative Progress: 493/1803 symbols completed. DEO took 1.1s. Estimated remaining: 8m 17s. Rate: 158.1 symbols/min [2025-10-15T22:36:04.230852] [DEBUG] [MAIN ] DFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:04.231680] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 22637 primary records. [2025-10-15T22:36:04.231731] [INFO ] [MAIN ] Derivative Progress: 494/1803 symbols completed. DFH took 1.1s. Estimated remaining: 8m 16s. Rate: 158.4 symbols/min [2025-10-15T22:36:04.231939] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-15T22:36:04.246874] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-15T22:36:04.246932] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-15T22:36:04.249850] [INFO ] [MAIN ] Derivative Progress: 495/1803 symbols completed. DFIN took 1.1s. Estimated remaining: 8m 14s. Rate: 158.7 symbols/min [2025-10-15T22:36:04.250404] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:04.250799] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:04.250499] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:04.264570] [DEBUG] [LOCAL ] DFP: Loaded 11194 existing records from primary storage. [2025-10-15T22:36:04.269402] [INFO ] [MAIN ] DFP: Loaded 11194 primary data records. [2025-10-15T22:36:04.345384] [DEBUG] [LOCAL ] DHF: Loaded 21070 existing records from primary storage. [2025-10-15T22:36:04.377696] [INFO ] [MAIN ] DHF: Loaded 21070 primary data records. [2025-10-15T22:36:04.722529] [DEBUG] [LOCAL ] DGX: Loaded 44657 existing records from primary storage. [2025-10-15T22:36:04.738399] [INFO ] [MAIN ] DGX: Loaded 44657 primary data records. [2025-10-15T22:36:05.241398] [DEBUG] [MAIN ] DFP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:05.242591] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11194 primary records. [2025-10-15T22:36:05.244112] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-15T22:36:05.276133] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-15T22:36:05.276503] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-15T22:36:05.279039] [INFO ] [MAIN ] Derivative Progress: 496/1803 symbols completed. DFP took 1.0s. Estimated remaining: 8m 16s. Rate: 158.2 symbols/min [2025-10-15T22:36:05.279298] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:05.276897] [DEBUG] [MAIN ] DHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:05.280734] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 21070 primary records. [2025-10-15T22:36:05.280835] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-15T22:36:05.297718] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-10-15T22:36:05.299109] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-15T22:36:05.303123] [INFO ] [MAIN ] Derivative Progress: 497/1803 symbols completed. DHF took 1.1s. Estimated remaining: 8m 14s. Rate: 158.5 symbols/min [2025-10-15T22:36:05.303707] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:05.317751] [DEBUG] [MAIN ] DGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:05.318597] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44657 primary records. [2025-10-15T22:36:05.318771] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-15T22:36:05.335254] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-15T22:36:05.335490] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-15T22:36:05.338824] [INFO ] [MAIN ] Derivative Progress: 498/1803 symbols completed. DGX took 1.1s. Estimated remaining: 8m 13s. Rate: 158.8 symbols/min [2025-10-15T22:36:05.352475] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:05.387142] [DEBUG] [LOCAL ] DHR: Loaded 53378 existing records from primary storage. [2025-10-15T22:36:05.387400] [INFO ] [MAIN ] DHR: Loaded 53378 primary data records. [2025-10-15T22:36:05.465589] [DEBUG] [LOCAL ] DHX: Loaded 13388 existing records from primary storage. [2025-10-15T22:36:05.497323] [DEBUG] [LOCAL ] DHT: Loaded 47932 existing records from primary storage. [2025-10-15T22:36:05.491358] [INFO ] [MAIN ] DHX: Loaded 13388 primary data records. [2025-10-15T22:36:05.515507] [INFO ] [MAIN ] DHT: Loaded 47932 primary data records. [2025-10-15T22:36:06.383030] [DEBUG] [MAIN ] DHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:06.384370] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53378 primary records. [2025-10-15T22:36:06.384772] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-15T22:36:06.401790] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-10-15T22:36:06.402801] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-15T22:36:06.405874] [INFO ] [MAIN ] Derivative Progress: 499/1803 symbols completed. DHR took 1.1s. Estimated remaining: 8m 15s. Rate: 158.2 symbols/min [2025-10-15T22:36:06.407562] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:06.422220] [DEBUG] [MAIN ] DHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:06.434495] [DEBUG] [MAIN ] DHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:06.436267] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13388 primary records. [2025-10-15T22:36:06.436922] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47932 primary records. [2025-10-15T22:36:06.437017] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-15T22:36:06.437135] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-15T22:36:06.469919] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-15T22:36:06.471743] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-15T22:36:06.471797] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-15T22:36:06.474214] [INFO ] [MAIN ] Derivative Progress: 500/1803 symbols completed. DHX took 1.1s. Estimated remaining: 8m 13s. Rate: 158.5 symbols/min [2025-10-15T22:36:06.474514] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-15T22:36:06.474415] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:06.476826] [INFO ] [MAIN ] Derivative Progress: 501/1803 symbols completed. DHT took 1.2s. Estimated remaining: 8m 12s. Rate: 158.8 symbols/min [2025-10-15T22:36:06.482517] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:06.483719] [DEBUG] [LOCAL ] DIAX: Loaded 13028 existing records from primary storage. [2025-10-15T22:36:06.484026] [INFO ] [MAIN ] DIAX: Loaded 13028 primary data records. [2025-10-15T22:36:06.811183] [DEBUG] [LOCAL ] DIN: Loaded 37272 existing records from primary storage. [2025-10-15T22:36:06.811504] [INFO ] [MAIN ] DIN: Loaded 37272 primary data records. [2025-10-15T22:36:06.928810] [DEBUG] [LOCAL ] DINO: Loaded 52842 existing records from primary storage. [2025-10-15T22:36:06.934978] [INFO ] [MAIN ] DINO: Loaded 52842 primary data records. [2025-10-15T22:36:07.500949] [DEBUG] [MAIN ] DIAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:07.502499] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 13028 primary records. [2025-10-15T22:36:07.503260] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-15T22:36:07.521499] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-15T22:36:07.522273] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-15T22:36:07.525754] [INFO ] [MAIN ] Derivative Progress: 502/1803 symbols completed. DIAX took 1.1s. Estimated remaining: 8m 13s. Rate: 158.2 symbols/min [2025-10-15T22:36:07.527595] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:07.542904] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:07.544212] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37272 primary records. [2025-10-15T22:36:07.544583] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-15T22:36:07.562503] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-15T22:36:07.565320] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-15T22:36:07.567731] [INFO ] [MAIN ] Derivative Progress: 503/1803 symbols completed. DIN took 1.1s. Estimated remaining: 8m 12s. Rate: 158.5 symbols/min [2025-10-15T22:36:07.568262] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:07.581340] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:07.582109] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52842 primary records. [2025-10-15T22:36:07.582251] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-15T22:36:07.599411] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-15T22:36:07.616009] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-15T22:36:07.620506] [INFO ] [MAIN ] Derivative Progress: 504/1803 symbols completed. DINO took 1.1s. Estimated remaining: 8m 11s. Rate: 158.8 symbols/min [2025-10-15T22:36:07.621002] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:07.649685] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-15T22:36:07.654837] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-15T22:36:07.753024] [DEBUG] [LOCAL ] DKL: Loaded 17546 existing records from primary storage. [2025-10-15T22:36:07.774338] [INFO ] [MAIN ] DKL: Loaded 17546 primary data records. [2025-10-15T22:36:07.814995] [DEBUG] [LOCAL ] DK: Loaded 49447 existing records from primary storage. [2025-10-15T22:36:07.880461] [INFO ] [MAIN ] DK: Loaded 49447 primary data records. [2025-10-15T22:36:08.594916] [DEBUG] [MAIN ] DIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:08.596273] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-15T22:36:08.596392] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-15T22:36:08.617403] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-15T22:36:08.617970] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-15T22:36:08.620146] [INFO ] [MAIN ] Derivative Progress: 505/1803 symbols completed. DIS took 1.1s. Estimated remaining: 8m 12s. Rate: 158.3 symbols/min [2025-10-15T22:36:08.620608] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:08.654687] [DEBUG] [MAIN ] DKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:08.654989] [DEBUG] [MAIN ] DK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:08.655964] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49447 primary records. [2025-10-15T22:36:08.656127] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-15T22:36:08.656820] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 17546 primary records. [2025-10-15T22:36:08.657271] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-15T22:36:08.692034] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-15T22:36:08.692126] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-15T22:36:08.692467] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-15T22:36:08.692395] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-15T22:36:08.695179] [INFO ] [MAIN ] Derivative Progress: 506/1803 symbols completed. DKL took 1.1s. Estimated remaining: 8m 11s. Rate: 158.5 symbols/min [2025-10-15T22:36:08.695413] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:08.698341] [INFO ] [MAIN ] Derivative Progress: 507/1803 symbols completed. DK took 1.1s. Estimated remaining: 8m 10s. Rate: 158.8 symbols/min [2025-10-15T22:36:08.698985] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:08.718732] [DEBUG] [LOCAL ] DLNG: Loaded 6188 existing records from primary storage. [2025-10-15T22:36:08.718875] [INFO ] [MAIN ] DLNG: Loaded 6188 primary data records. [2025-10-15T22:36:08.858381] [DEBUG] [LOCAL ] DLB: Loaded 32247 existing records from primary storage. [2025-10-15T22:36:08.875408] [DEBUG] [LOCAL ] DKS: Loaded 49719 existing records from primary storage. [2025-10-15T22:36:08.880719] [INFO ] [MAIN ] DKS: Loaded 49719 primary data records. [2025-10-15T22:36:08.925021] [INFO ] [MAIN ] DLB: Loaded 32247 primary data records. [2025-10-15T22:36:09.723203] [DEBUG] [MAIN ] DLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:09.724179] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6188 primary records. [2025-10-15T22:36:09.724401] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-15T22:36:09.741307] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-10-15T22:36:09.743918] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-15T22:36:09.746300] [INFO ] [MAIN ] Derivative Progress: 508/1803 symbols completed. DLNG took 1.0s. Estimated remaining: 8m 11s. Rate: 158.3 symbols/min [2025-10-15T22:36:09.759970] [DEBUG] [MAIN ] DKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:09.760686] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49719 primary records. [2025-10-15T22:36:09.760873] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-15T22:36:09.779410] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-15T22:36:09.779511] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-15T22:36:09.782721] [INFO ] [MAIN ] Derivative Progress: 509/1803 symbols completed. DKS took 1.2s. Estimated remaining: 8m 10s. Rate: 158.5 symbols/min [2025-10-15T22:36:09.796132] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:09.796743] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32247 primary records. [2025-10-15T22:36:09.796804] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-15T22:36:09.811887] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-15T22:36:09.811952] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-15T22:36:09.814921] [INFO ] [MAIN ] Derivative Progress: 510/1803 symbols completed. DLB took 1.1s. Estimated remaining: 8m 8s. Rate: 158.8 symbols/min [2025-10-15T22:36:09.815389] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:09.815483] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:09.815326] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:09.832049] [DEBUG] [LOCAL ] DMO: Loaded 9967 existing records from primary storage. [2025-10-15T22:36:09.836117] [DEBUG] [LOCAL ] DMB: Loaded 10304 existing records from primary storage. [2025-10-15T22:36:09.836436] [INFO ] [MAIN ] DMB: Loaded 10304 primary data records. [2025-10-15T22:36:09.836509] [INFO ] [MAIN ] DMO: Loaded 9967 primary data records. [2025-10-15T22:36:10.121485] [DEBUG] [LOCAL ] DLX: Loaded 28382 existing records from primary storage. [2025-10-15T22:36:10.181323] [INFO ] [MAIN ] DLX: Loaded 28382 primary data records. [2025-10-15T22:36:10.798433] [DEBUG] [MAIN ] DMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:10.799523] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9967 primary records. [2025-10-15T22:36:10.807224] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-15T22:36:10.813019] [DEBUG] [MAIN ] DMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:10.813827] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10304 primary records. [2025-10-15T22:36:10.814292] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-15T22:36:10.845301] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-10-15T22:36:10.843349] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-10-15T22:36:10.845471] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-15T22:36:10.845545] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-15T22:36:10.847621] [INFO ] [MAIN ] Derivative Progress: 511/1803 symbols completed. DMB took 1.0s. Estimated remaining: 8m 10s. Rate: 158.3 symbols/min [2025-10-15T22:36:10.850307] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:10.850614] [INFO ] [MAIN ] Derivative Progress: 512/1803 symbols completed. DMO took 1.0s. Estimated remaining: 8m 8s. Rate: 158.6 symbols/min [2025-10-15T22:36:10.851172] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:10.867317] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:10.868030] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28382 primary records. [2025-10-15T22:36:10.868177] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-15T22:36:10.884355] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-15T22:36:10.884549] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-15T22:36:10.886944] [INFO ] [MAIN ] Derivative Progress: 513/1803 symbols completed. DLX took 1.1s. Estimated remaining: 8m 7s. Rate: 158.9 symbols/min [2025-10-15T22:36:10.887267] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:10.918025] [DEBUG] [LOCAL ] DNP: Loaded 33232 existing records from primary storage. [2025-10-15T22:36:10.918183] [INFO ] [MAIN ] DNP: Loaded 33232 primary data records. [2025-10-15T22:36:11.027669] [DEBUG] [LOCAL ] DNOW: Loaded 43750 existing records from primary storage. [2025-10-15T22:36:11.038545] [INFO ] [MAIN ] DNOW: Loaded 43750 primary data records. [2025-10-15T22:36:11.405667] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-15T22:36:11.421405] [INFO ] [MAIN ] DOC: Loaded 53554 primary data records. [2025-10-15T22:36:11.946278] [DEBUG] [MAIN ] DNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:11.947818] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33232 primary records. [2025-10-15T22:36:11.948287] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-15T22:36:11.965816] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-15T22:36:11.966205] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-15T22:36:11.968677] [INFO ] [MAIN ] Derivative Progress: 514/1803 symbols completed. DNP took 1.1s. Estimated remaining: 8m 9s. Rate: 158.3 symbols/min [2025-10-15T22:36:11.971910] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:11.987630] [DEBUG] [MAIN ] DNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:11.988765] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43750 primary records. [2025-10-15T22:36:11.989039] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-15T22:36:12.031213] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-15T22:36:12.032154] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-15T22:36:12.032082] [DEBUG] [MAIN ] DOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:12.035252] [INFO ] [MAIN ] Derivative Progress: 515/1803 symbols completed. DNOW took 1.2s. Estimated remaining: 8m 7s. Rate: 158.6 symbols/min [2025-10-15T22:36:12.032928] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53554 primary records. [2025-10-15T22:36:12.035542] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-15T22:36:12.035631] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:12.067326] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-15T22:36:12.067470] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-15T22:36:12.070831] [INFO ] [MAIN ] Derivative Progress: 516/1803 symbols completed. DOC took 1.2s. Estimated remaining: 8m 6s. Rate: 158.8 symbols/min [2025-10-15T22:36:12.071165] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:12.093927] [DEBUG] [LOCAL ] DOCS: Loaded 50742 existing records from primary storage. [2025-10-15T22:36:12.094252] [INFO ] [MAIN ] DOCS: Loaded 50742 primary data records. [2025-10-15T22:36:12.313328] [DEBUG] [LOCAL ] DOLE: Loaded 39209 existing records from primary storage. [2025-10-15T22:36:12.420912] [INFO ] [MAIN ] DOLE: Loaded 39209 primary data records. [2025-10-15T22:36:12.421622] [DEBUG] [LOCAL ] DOUG: Loaded 34244 existing records from primary storage. [2025-10-15T22:36:12.426990] [INFO ] [MAIN ] DOUG: Loaded 34244 primary data records. [2025-10-15T22:36:13.071134] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:13.072882] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 50742 primary records. [2025-10-15T22:36:13.073167] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-15T22:36:13.093010] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-15T22:36:13.094084] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-15T22:36:13.096371] [INFO ] [MAIN ] Derivative Progress: 517/1803 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 7s. Rate: 158.3 symbols/min [2025-10-15T22:36:13.096852] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:13.112367] [DEBUG] [MAIN ] DOLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:13.113105] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 39209 primary records. [2025-10-15T22:36:13.113192] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-15T22:36:13.131829] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-15T22:36:13.144884] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-15T22:36:13.147795] [INFO ] [MAIN ] Derivative Progress: 518/1803 symbols completed. DOLE took 1.1s. Estimated remaining: 8m 6s. Rate: 158.6 symbols/min [2025-10-15T22:36:13.147982] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:13.145389] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:13.149162] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34244 primary records. [2025-10-15T22:36:13.149318] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-15T22:36:13.176408] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-10-15T22:36:13.176575] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-15T22:36:13.178956] [INFO ] [MAIN ] Derivative Progress: 519/1803 symbols completed. DOUG took 1.1s. Estimated remaining: 8m 5s. Rate: 158.9 symbols/min [2025-10-15T22:36:13.179202] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:13.194420] [DEBUG] [LOCAL ] DOV: Loaded 45611 existing records from primary storage. [2025-10-15T22:36:13.194616] [INFO ] [MAIN ] DOV: Loaded 45611 primary data records. [2025-10-15T22:36:13.310922] [DEBUG] [LOCAL ] DPG: Loaded 13576 existing records from primary storage. [2025-10-15T22:36:13.323922] [INFO ] [MAIN ] DPG: Loaded 13576 primary data records. [2025-10-15T22:36:13.655263] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-15T22:36:13.669184] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-15T22:36:14.208118] [DEBUG] [MAIN ] DOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:14.209567] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45611 primary records. [2025-10-15T22:36:14.208599] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:14.209959] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-15T22:36:14.210764] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13576 primary records. [2025-10-15T22:36:14.211846] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-15T22:36:14.228562] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-15T22:36:14.235706] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-15T22:36:14.238898] [INFO ] [MAIN ] Derivative Progress: 520/1803 symbols completed. DOV took 1.1s. Estimated remaining: 8m 6s. Rate: 158.3 symbols/min [2025-10-15T22:36:14.239245] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:14.249841] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-15T22:36:14.262671] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-15T22:36:14.265099] [DEBUG] [MAIN ] DOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:14.264740] [INFO ] [MAIN ] Derivative Progress: 521/1803 symbols completed. DPG took 1.1s. Estimated remaining: 8m 5s. Rate: 158.6 symbols/min [2025-10-15T22:36:14.265273] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:14.266214] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-15T22:36:14.266612] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-15T22:36:14.286329] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-15T22:36:14.286517] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-15T22:36:14.290031] [INFO ] [MAIN ] Derivative Progress: 522/1803 symbols completed. DOW took 1.1s. Estimated remaining: 8m 4s. Rate: 158.9 symbols/min [2025-10-15T22:36:14.290298] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:14.333179] [DEBUG] [LOCAL ] DRD: Loaded 37717 existing records from primary storage. [2025-10-15T22:36:14.333509] [INFO ] [MAIN ] DRD: Loaded 37717 primary data records. [2025-10-15T22:36:14.413174] [DEBUG] [LOCAL ] DQ: Loaded 43738 existing records from primary storage. [2025-10-15T22:36:14.425502] [INFO ] [MAIN ] DQ: Loaded 43738 primary data records. [2025-10-15T22:36:14.844371] [DEBUG] [LOCAL ] DRH: Loaded 50410 existing records from primary storage. [2025-10-15T22:36:14.961277] [INFO ] [MAIN ] DRH: Loaded 50410 primary data records. [2025-10-15T22:36:15.284006] [DEBUG] [MAIN ] DQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:15.297002] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43738 primary records. [2025-10-15T22:36:15.297315] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-15T22:36:15.297719] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:15.299906] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37717 primary records. [2025-10-15T22:36:15.300571] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-15T22:36:15.331168] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-15T22:36:15.331974] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-15T22:36:15.334681] [INFO ] [MAIN ] Derivative Progress: 523/1803 symbols completed. DRD took 1.1s. Estimated remaining: 8m 5s. Rate: 158.3 symbols/min [2025-10-15T22:36:15.335268] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-15T22:36:15.335801] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-15T22:36:15.339096] [INFO ] [MAIN ] Derivative Progress: 524/1803 symbols completed. DQ took 1.1s. Estimated remaining: 8m 4s. Rate: 158.6 symbols/min [2025-10-15T22:36:15.354432] [DEBUG] [MAIN ] DRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:15.355007] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50410 primary records. [2025-10-15T22:36:15.355068] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-15T22:36:15.369815] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-15T22:36:15.369875] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-15T22:36:15.372553] [INFO ] [MAIN ] Derivative Progress: 525/1803 symbols completed. DRH took 1.1s. Estimated remaining: 8m 3s. Rate: 158.9 symbols/min [2025-10-15T22:36:15.372994] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:15.373109] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:15.373352] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:15.386309] [DEBUG] [LOCAL ] DRLL: Loaded 9148 existing records from primary storage. [2025-10-15T22:36:15.386569] [INFO ] [MAIN ] DRLL: Loaded 9148 primary data records. [2025-10-15T22:36:15.528822] [DEBUG] [LOCAL ] DSL: Loaded 28822 existing records from primary storage. [2025-10-15T22:36:15.568537] [INFO ] [MAIN ] DSL: Loaded 28822 primary data records. [2025-10-15T22:36:15.842699] [DEBUG] [LOCAL ] DRI: Loaded 47693 existing records from primary storage. [2025-10-15T22:36:15.864840] [INFO ] [MAIN ] DRI: Loaded 47693 primary data records. [2025-10-15T22:36:16.360855] [DEBUG] [MAIN ] DRLL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:36:16.362055] [INFO ] [MAIN ] DRLL: Generated 1793 derivative records from 9148 primary records. [2025-10-15T22:36:16.362157] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-15T22:36:16.378844] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1793 records). [2025-10-15T22:36:16.379861] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-15T22:36:16.382126] [INFO ] [MAIN ] Derivative Progress: 526/1803 symbols completed. DRLL took 1.0s. Estimated remaining: 8m 4s. Rate: 158.4 symbols/min [2025-10-15T22:36:16.382704] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:16.398997] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:16.400148] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28822 primary records. [2025-10-15T22:36:16.400549] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-15T22:36:16.422789] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-15T22:36:16.422938] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-15T22:36:16.426635] [INFO ] [MAIN ] Derivative Progress: 527/1803 symbols completed. DSL took 1.1s. Estimated remaining: 8m 2s. Rate: 158.7 symbols/min [2025-10-15T22:36:16.431776] [DEBUG] [LOCAL ] DSM: Loaded 14125 existing records from primary storage. [2025-10-15T22:36:16.433385] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:16.433470] [INFO ] [MAIN ] DSM: Loaded 14125 primary data records. [2025-10-15T22:36:16.522316] [DEBUG] [MAIN ] DRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:16.524413] [DEBUG] [LOCAL ] DSMC: Loaded 1837 existing records from primary storage. [2025-10-15T22:36:16.541136] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47693 primary records. [2025-10-15T22:36:16.551549] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-15T22:36:16.552031] [INFO ] [MAIN ] DSMC: Loaded 1837 primary data records. [2025-10-15T22:36:16.850819] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-10-15T22:36:16.880433] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-15T22:36:16.895034] [INFO ] [MAIN ] Derivative Progress: 528/1803 symbols completed. DRI took 1.5s. Estimated remaining: 8m 2s. Rate: 158.6 symbols/min [2025-10-15T22:36:16.917376] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:17.105069] [DEBUG] [MAIN ] DSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:17.106264] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14125 primary records. [2025-10-15T22:36:17.107083] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-15T22:36:17.106894] [DEBUG] [LOCAL ] DSU: Loaded 23007 existing records from primary storage. [2025-10-15T22:36:17.107685] [INFO ] [MAIN ] DSU: Loaded 23007 primary data records. [2025-10-15T22:36:17.178541] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-15T22:36:17.210091] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-15T22:36:17.218567] [INFO ] [MAIN ] Derivative Progress: 529/1803 symbols completed. DSM took 0.8s. Estimated remaining: 8m 2s. Rate: 158.7 symbols/min [2025-10-15T22:36:17.229463] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:17.263828] [DEBUG] [MAIN ] DSMC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:36:17.290697] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1837 primary records. [2025-10-15T22:36:17.297870] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-15T22:36:17.489565] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-10-15T22:36:17.489720] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-15T22:36:17.492064] [INFO ] [MAIN ] Derivative Progress: 530/1803 symbols completed. DSMC took 1.1s. Estimated remaining: 8m 1s. Rate: 158.7 symbols/min [2025-10-15T22:36:17.492254] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:17.503819] [DEBUG] [LOCAL ] DSX: Loaded 23924 existing records from primary storage. [2025-10-15T22:36:17.506364] [INFO ] [MAIN ] DSX: Loaded 23924 primary data records. [2025-10-15T22:36:17.588637] [DEBUG] [LOCAL ] DTB: Loaded 5012 existing records from primary storage. [2025-10-15T22:36:17.600081] [INFO ] [MAIN ] DTB: Loaded 5012 primary data records. [2025-10-15T22:36:18.137298] [DEBUG] [MAIN ] DSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:18.140389] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 23007 primary records. [2025-10-15T22:36:18.141029] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-15T22:36:18.163953] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-15T22:36:18.164433] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-15T22:36:18.167160] [INFO ] [MAIN ] Derivative Progress: 531/1803 symbols completed. DSU took 1.2s. Estimated remaining: 8m 2s. Rate: 158.5 symbols/min [2025-10-15T22:36:18.167552] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:18.184551] [DEBUG] [LOCAL ] DTG: Loaded 5805 existing records from primary storage. [2025-10-15T22:36:18.198310] [INFO ] [MAIN ] DTG: Loaded 5805 primary data records. [2025-10-15T22:36:18.211917] [DEBUG] [MAIN ] DTB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:36:18.217924] [INFO ] [MAIN ] DTB: Generated 1793 derivative records from 5012 primary records. [2025-10-15T22:36:18.261770] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-15T22:36:18.211633] [DEBUG] [MAIN ] DSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:18.276663] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 23924 primary records. [2025-10-15T22:36:18.303818] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-15T22:36:18.337402] [DEBUG] [LOCAL ] DTB: Derivative data saved (1793 records). [2025-10-15T22:36:18.337568] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-15T22:36:18.340344] [INFO ] [MAIN ] Derivative Progress: 532/1803 symbols completed. DTB took 0.8s. Estimated remaining: 8m 1s. Rate: 158.7 symbols/min [2025-10-15T22:36:18.340541] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:18.433451] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-10-15T22:36:18.433740] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-15T22:36:18.547754] [INFO ] [MAIN ] Derivative Progress: 533/1803 symbols completed. DSX took 1.3s. Estimated remaining: 7m 60s. Rate: 158.8 symbols/min [2025-10-15T22:36:18.548603] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:18.556940] [DEBUG] [LOCAL ] DTW: Loaded 4821 existing records from primary storage. [2025-10-15T22:36:18.557662] [INFO ] [MAIN ] DTW: Loaded 4821 primary data records. [2025-10-15T22:36:18.775582] [DEBUG] [LOCAL ] DTM: Loaded 43930 existing records from primary storage. [2025-10-15T22:36:18.896169] [INFO ] [MAIN ] DTM: Loaded 43930 primary data records. [2025-10-15T22:36:19.102746] [DEBUG] [MAIN ] DTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:19.268391] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5805 primary records. [2025-10-15T22:36:19.269116] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-15T22:36:19.290675] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-15T22:36:19.292341] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-15T22:36:19.294827] [INFO ] [MAIN ] Derivative Progress: 534/1803 symbols completed. DTG took 1.1s. Estimated remaining: 8m 0s. Rate: 158.5 symbols/min [2025-10-15T22:36:19.295258] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:19.309897] [DEBUG] [MAIN ] DTW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:36:19.310741] [INFO ] [MAIN ] DTW: Generated 1793 derivative records from 4821 primary records. [2025-10-15T22:36:19.311102] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-15T22:36:19.329688] [DEBUG] [LOCAL ] DTW: Derivative data saved (1793 records). [2025-10-15T22:36:19.330013] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-15T22:36:19.334580] [INFO ] [MAIN ] Derivative Progress: 535/1803 symbols completed. DTW took 0.8s. Estimated remaining: 7m 59s. Rate: 158.8 symbols/min [2025-10-15T22:36:19.335529] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:19.350431] [DEBUG] [MAIN ] DTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:19.351240] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 43930 primary records. [2025-10-15T22:36:19.351364] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-15T22:36:19.382524] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-10-15T22:36:19.382823] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-15T22:36:19.385765] [INFO ] [MAIN ] Derivative Progress: 536/1803 symbols completed. DTM took 1.0s. Estimated remaining: 7m 58s. Rate: 159.0 symbols/min [2025-10-15T22:36:19.386089] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:19.416348] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-15T22:36:19.416844] [INFO ] [MAIN ] DUK: Loaded 53437 primary data records. [2025-10-15T22:36:19.665083] [DEBUG] [LOCAL ] DVA: Loaded 41059 existing records from primary storage. [2025-10-15T22:36:19.783722] [INFO ] [MAIN ] DVA: Loaded 41059 primary data records. [2025-10-15T22:36:19.785146] [DEBUG] [LOCAL ] DV: Loaded 51301 existing records from primary storage. [2025-10-15T22:36:19.806497] [INFO ] [MAIN ] DV: Loaded 51301 primary data records. [2025-10-15T22:36:20.406236] [DEBUG] [MAIN ] DUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:20.407488] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53437 primary records. [2025-10-15T22:36:20.407633] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-15T22:36:20.426835] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-10-15T22:36:20.427487] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-15T22:36:20.429897] [INFO ] [MAIN ] Derivative Progress: 537/1803 symbols completed. DUK took 1.1s. Estimated remaining: 7m 59s. Rate: 158.5 symbols/min [2025-10-15T22:36:20.430275] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:20.449038] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:20.451416] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41059 primary records. [2025-10-15T22:36:20.451613] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-15T22:36:20.478800] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:20.480199] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51301 primary records. [2025-10-15T22:36:20.481064] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-15T22:36:20.499274] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-15T22:36:20.501794] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-15T22:36:20.506662] [INFO ] [MAIN ] Derivative Progress: 538/1803 symbols completed. DVA took 1.1s. Estimated remaining: 7m 58s. Rate: 158.7 symbols/min [2025-10-15T22:36:20.509428] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-15T22:36:20.509497] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-15T22:36:20.512026] [INFO ] [MAIN ] Derivative Progress: 539/1803 symbols completed. DV took 1.2s. Estimated remaining: 7m 57s. Rate: 159.0 symbols/min [2025-10-15T22:36:20.551713] [DEBUG] [LOCAL ] DX: Loaded 52502 existing records from primary storage. [2025-10-15T22:36:20.551854] [INFO ] [MAIN ] DX: Loaded 52502 primary data records. [2025-10-15T22:36:20.851263] [DEBUG] [MAIN ] DX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:20.852014] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52502 primary records. [2025-10-15T22:36:20.852135] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-15T22:36:20.875576] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-10-15T22:36:20.875760] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-15T22:36:20.879130] [INFO ] [MAIN ] Derivative Progress: 540/1803 symbols completed. DX took 0.4s. Estimated remaining: 7m 56s. Rate: 159.0 symbols/min [2025-10-15T22:36:20.879877] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:20.879944] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:20.880432] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:20.940126] [DEBUG] [LOCAL ] DY: Loaded 28456 existing records from primary storage. [2025-10-15T22:36:20.940880] [DEBUG] [LOCAL ] DXYZ: Loaded 37126 existing records from primary storage. [2025-10-15T22:36:20.941117] [INFO ] [MAIN ] DY: Loaded 28456 primary data records. [2025-10-15T22:36:20.941378] [INFO ] [MAIN ] DXYZ: Loaded 37126 primary data records. [2025-10-15T22:36:21.136089] [DEBUG] [LOCAL ] DXC: Loaded 49875 existing records from primary storage. [2025-10-15T22:36:21.162004] [INFO ] [MAIN ] DXC: Loaded 49875 primary data records. [2025-10-15T22:36:21.946295] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:21.947179] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28456 primary records. [2025-10-15T22:36:21.947360] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-15T22:36:21.979480] [DEBUG] [MAIN ] DXYZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:36:21.982124] [INFO ] [MAIN ] DXYZ: Generated 1793 derivative records from 37126 primary records. [2025-10-15T22:36:21.982218] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-15T22:36:21.983876] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-15T22:36:21.992990] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-15T22:36:21.997830] [INFO ] [MAIN ] Derivative Progress: 541/1803 symbols completed. DY took 1.1s. Estimated remaining: 7m 58s. Rate: 158.5 symbols/min [2025-10-15T22:36:22.005885] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:22.005589] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1793 records). [2025-10-15T22:36:22.006580] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-15T22:36:22.016746] [INFO ] [MAIN ] Derivative Progress: 542/1803 symbols completed. DXYZ took 1.1s. Estimated remaining: 7m 57s. Rate: 158.7 symbols/min [2025-10-15T22:36:22.022012] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:22.022915] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:22.023621] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49875 primary records. [2025-10-15T22:36:22.023712] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-15T22:36:22.046989] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-15T22:36:22.047142] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-15T22:36:22.050406] [INFO ] [MAIN ] Derivative Progress: 543/1803 symbols completed. DXC took 1.2s. Estimated remaining: 7m 55s. Rate: 159.0 symbols/min [2025-10-15T22:36:22.050851] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:22.083240] [DEBUG] [LOCAL ] E: Loaded 33280 existing records from primary storage. [2025-10-15T22:36:22.083376] [INFO ] [MAIN ] E: Loaded 33280 primary data records. [2025-10-15T22:36:22.200977] [DEBUG] [LOCAL ] EAF: Loaded 41701 existing records from primary storage. [2025-10-15T22:36:22.210952] [INFO ] [MAIN ] EAF: Loaded 41701 primary data records. [2025-10-15T22:36:22.265968] [DEBUG] [LOCAL ] EARN: Loaded 28609 existing records from primary storage. [2025-10-15T22:36:22.340743] [INFO ] [MAIN ] EARN: Loaded 28609 primary data records. [2025-10-15T22:36:23.015092] [DEBUG] [MAIN ] E: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:23.016096] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33280 primary records. [2025-10-15T22:36:23.017247] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-15T22:36:23.045621] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-15T22:36:23.050533] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-15T22:36:23.052966] [INFO ] [MAIN ] Derivative Progress: 544/1803 symbols completed. E took 1.0s. Estimated remaining: 7m 57s. Rate: 158.5 symbols/min [2025-10-15T22:36:23.051037] [DEBUG] [MAIN ] EAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:23.054090] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 41701 primary records. [2025-10-15T22:36:23.054201] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-15T22:36:23.057722] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:23.082013] [DEBUG] [MAIN ] EARN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:23.087055] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 28609 primary records. [2025-10-15T22:36:23.086134] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-10-15T22:36:23.087160] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-15T22:36:23.087318] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-15T22:36:23.089957] [INFO ] [MAIN ] Derivative Progress: 545/1803 symbols completed. EAF took 1.1s. Estimated remaining: 7m 55s. Rate: 158.8 symbols/min [2025-10-15T22:36:23.090922] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:23.106451] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-10-15T22:36:23.106565] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-15T22:36:23.109454] [INFO ] [MAIN ] Derivative Progress: 546/1803 symbols completed. EARN took 1.1s. Estimated remaining: 7m 54s. Rate: 159.1 symbols/min [2025-10-15T22:36:23.109749] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:23.160931] [DEBUG] [LOCAL ] EB: Loaded 36538 existing records from primary storage. [2025-10-15T22:36:23.161815] [INFO ] [MAIN ] EB: Loaded 36538 primary data records. [2025-10-15T22:36:23.161704] [DEBUG] [LOCAL ] EBR: Loaded 43297 existing records from primary storage. [2025-10-15T22:36:23.173286] [INFO ] [MAIN ] EBR: Loaded 43297 primary data records. [2025-10-15T22:36:23.413796] [DEBUG] [LOCAL ] EBS: Loaded 46759 existing records from primary storage. [2025-10-15T22:36:23.450783] [INFO ] [MAIN ] EBS: Loaded 46759 primary data records. [2025-10-15T22:36:24.148952] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:24.148571] [DEBUG] [MAIN ] EB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:24.149939] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43297 primary records. [2025-10-15T22:36:24.150110] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-15T22:36:24.150972] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 36538 primary records. [2025-10-15T22:36:24.151054] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-15T22:36:24.181974] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-10-15T22:36:24.183736] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-15T22:36:24.186168] [INFO ] [MAIN ] Derivative Progress: 547/1803 symbols completed. EB took 1.1s. Estimated remaining: 7m 55s. Rate: 158.5 symbols/min [2025-10-15T22:36:24.186309] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:24.200294] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-15T22:36:24.200636] [DEBUG] [MAIN ] EBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:24.201457] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46759 primary records. [2025-10-15T22:36:24.201513] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-15T22:36:24.204021] [INFO ] [MAIN ] Derivative Progress: 548/1803 symbols completed. EBR took 1.1s. Estimated remaining: 7m 54s. Rate: 158.8 symbols/min [2025-10-15T22:36:24.204240] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:24.204290] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-15T22:36:24.222228] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-10-15T22:36:24.222457] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-15T22:36:24.225818] [INFO ] [MAIN ] Derivative Progress: 549/1803 symbols completed. EBS took 1.1s. Estimated remaining: 7m 53s. Rate: 159.1 symbols/min [2025-10-15T22:36:24.226130] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:24.247885] [DEBUG] [LOCAL ] ECCU: Loaded 2218 existing records from primary storage. [2025-10-15T22:36:24.248070] [INFO ] [MAIN ] ECCU: Loaded 2218 primary data records. [2025-10-15T22:36:24.322444] [DEBUG] [LOCAL ] ECAT: Loaded 29496 existing records from primary storage. [2025-10-15T22:36:24.371128] [INFO ] [MAIN ] ECAT: Loaded 29496 primary data records. [2025-10-15T22:36:24.375534] [DEBUG] [LOCAL ] EC: Loaded 49000 existing records from primary storage. [2025-10-15T22:36:24.386704] [INFO ] [MAIN ] EC: Loaded 49000 primary data records. [2025-10-15T22:36:25.228634] [DEBUG] [MAIN ] ECCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:25.229482] [INFO ] [MAIN ] ECCU: Generated 1794 derivative records from 2218 primary records. [2025-10-15T22:36:25.229754] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-15T22:36:25.244541] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1794 records). [2025-10-15T22:36:25.246366] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-15T22:36:25.249619] [INFO ] [MAIN ] Derivative Progress: 550/1803 symbols completed. ECCU took 1.0s. Estimated remaining: 7m 54s. Rate: 158.6 symbols/min [2025-10-15T22:36:25.250542] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:25.277500] [DEBUG] [MAIN ] EC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:25.277251] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:25.278390] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49000 primary records. [2025-10-15T22:36:25.279054] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29496 primary records. [2025-10-15T22:36:25.279119] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-15T22:36:25.279891] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-15T22:36:25.306067] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-15T22:36:25.306510] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-15T22:36:25.309267] [INFO ] [MAIN ] Derivative Progress: 551/1803 symbols completed. ECAT took 1.1s. Estimated remaining: 7m 53s. Rate: 158.8 symbols/min [2025-10-15T22:36:25.313494] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-10-15T22:36:25.313690] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-15T22:36:25.312440] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:25.317556] [INFO ] [MAIN ] Derivative Progress: 552/1803 symbols completed. EC took 1.1s. Estimated remaining: 7m 52s. Rate: 159.1 symbols/min [2025-10-15T22:36:25.318278] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:25.342214] [DEBUG] [LOCAL ] ECG: Loaded 33179 existing records from primary storage. [2025-10-15T22:36:25.342416] [INFO ] [MAIN ] ECG: Loaded 33179 primary data records. [2025-10-15T22:36:25.686816] [DEBUG] [LOCAL ] ECL: Loaded 46668 existing records from primary storage. [2025-10-15T22:36:25.688013] [INFO ] [MAIN ] ECL: Loaded 46668 primary data records. [2025-10-15T22:36:25.689231] [DEBUG] [LOCAL ] ECVT: Loaded 43302 existing records from primary storage. [2025-10-15T22:36:25.701003] [INFO ] [MAIN ] ECVT: Loaded 43302 primary data records. [2025-10-15T22:36:26.315980] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:26.317573] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33179 primary records. [2025-10-15T22:36:26.317899] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-15T22:36:26.335187] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-15T22:36:26.335407] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-15T22:36:26.338828] [INFO ] [MAIN ] Derivative Progress: 553/1803 symbols completed. ECG took 1.1s. Estimated remaining: 7m 53s. Rate: 158.6 symbols/min [2025-10-15T22:36:26.355507] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:26.356169] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46668 primary records. [2025-10-15T22:36:26.356323] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-15T22:36:26.374518] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-15T22:36:26.374689] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-15T22:36:26.376911] [INFO ] [MAIN ] Derivative Progress: 554/1803 symbols completed. ECL took 1.1s. Estimated remaining: 7m 52s. Rate: 158.9 symbols/min [2025-10-15T22:36:26.390010] [DEBUG] [MAIN ] ECVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:26.390585] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43302 primary records. [2025-10-15T22:36:26.390683] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-15T22:36:26.406109] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-15T22:36:26.406196] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-15T22:36:26.409121] [INFO ] [MAIN ] Derivative Progress: 555/1803 symbols completed. ECVT took 1.1s. Estimated remaining: 7m 51s. Rate: 159.1 symbols/min [2025-10-15T22:36:26.409735] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:26.409680] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:26.409578] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:26.430040] [DEBUG] [LOCAL ] EDF: Loaded 13052 existing records from primary storage. [2025-10-15T22:36:26.430300] [INFO ] [MAIN ] EDF: Loaded 13052 primary data records. [2025-10-15T22:36:26.524979] [DEBUG] [LOCAL ] EDN: Loaded 19013 existing records from primary storage. [2025-10-15T22:36:26.554975] [INFO ] [MAIN ] EDN: Loaded 19013 primary data records. [2025-10-15T22:36:26.598004] [DEBUG] [LOCAL ] EDD: Loaded 26779 existing records from primary storage. [2025-10-15T22:36:26.641228] [INFO ] [MAIN ] EDD: Loaded 26779 primary data records. [2025-10-15T22:36:27.410732] [DEBUG] [MAIN ] EDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:27.412587] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13052 primary records. [2025-10-15T22:36:27.412956] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-15T22:36:27.431515] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-15T22:36:27.431905] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-15T22:36:27.434089] [INFO ] [MAIN ] Derivative Progress: 556/1803 symbols completed. EDF took 1.0s. Estimated remaining: 7m 52s. Rate: 158.7 symbols/min [2025-10-15T22:36:27.434623] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:27.448306] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:27.449193] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 19013 primary records. [2025-10-15T22:36:27.449432] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-15T22:36:27.479003] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:27.480207] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 26779 primary records. [2025-10-15T22:36:27.480363] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-15T22:36:27.482276] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-15T22:36:27.482445] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-15T22:36:27.484970] [INFO ] [MAIN ] Derivative Progress: 557/1803 symbols completed. EDN took 1.1s. Estimated remaining: 7m 50s. Rate: 158.9 symbols/min [2025-10-15T22:36:27.495473] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:27.503882] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-15T22:36:27.504228] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-15T22:36:27.507622] [INFO ] [MAIN ] Derivative Progress: 558/1803 symbols completed. EDD took 1.1s. Estimated remaining: 7m 49s. Rate: 159.2 symbols/min [2025-10-15T22:36:27.507968] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:27.531037] [DEBUG] [LOCAL ] EEX: Loaded 10208 existing records from primary storage. [2025-10-15T22:36:27.531791] [INFO ] [MAIN ] EEX: Loaded 10208 primary data records. [2025-10-15T22:36:27.618284] [DEBUG] [LOCAL ] EDU: Loaded 44813 existing records from primary storage. [2025-10-15T22:36:27.635072] [INFO ] [MAIN ] EDU: Loaded 44813 primary data records. [2025-10-15T22:36:27.722411] [DEBUG] [LOCAL ] EE: Loaded 32990 existing records from primary storage. [2025-10-15T22:36:27.736598] [INFO ] [MAIN ] EE: Loaded 32990 primary data records. [2025-10-15T22:36:28.527073] [DEBUG] [MAIN ] EDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:28.529145] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44813 primary records. [2025-10-15T22:36:28.520289] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:28.529246] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-15T22:36:28.531881] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 10208 primary records. [2025-10-15T22:36:28.532084] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-15T22:36:28.570315] [DEBUG] [MAIN ] EE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:28.576160] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32990 primary records. [2025-10-15T22:36:28.577195] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-15T22:36:28.585060] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-15T22:36:28.586002] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-15T22:36:28.602492] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-15T22:36:28.605163] [INFO ] [MAIN ] Derivative Progress: 559/1803 symbols completed. EEX took 1.1s. Estimated remaining: 7m 51s. Rate: 158.6 symbols/min [2025-10-15T22:36:28.606716] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-15T22:36:28.607128] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-15T22:36:28.607054] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-15T22:36:28.610280] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:28.613563] [INFO ] [MAIN ] Derivative Progress: 560/1803 symbols completed. EE took 1.1s. Estimated remaining: 7m 49s. Rate: 158.9 symbols/min [2025-10-15T22:36:28.613909] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:28.614455] [INFO ] [MAIN ] Derivative Progress: 561/1803 symbols completed. EDU took 1.2s. Estimated remaining: 7m 48s. Rate: 159.2 symbols/min [2025-10-15T22:36:28.615019] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:28.635206] [DEBUG] [LOCAL ] EFT: Loaded 13087 existing records from primary storage. [2025-10-15T22:36:28.635618] [INFO ] [MAIN ] EFT: Loaded 13087 primary data records. [2025-10-15T22:36:28.663501] [DEBUG] [LOCAL ] EFR: Loaded 15060 existing records from primary storage. [2025-10-15T22:36:28.681184] [INFO ] [MAIN ] EFR: Loaded 15060 primary data records. [2025-10-15T22:36:29.108080] [DEBUG] [LOCAL ] EFC: Loaded 46431 existing records from primary storage. [2025-10-15T22:36:29.161033] [INFO ] [MAIN ] EFC: Loaded 46431 primary data records. [2025-10-15T22:36:29.668615] [DEBUG] [MAIN ] EFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:29.670755] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 13087 primary records. [2025-10-15T22:36:29.671137] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-15T22:36:29.699563] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:29.701419] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 15060 primary records. [2025-10-15T22:36:29.702139] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-15T22:36:29.714265] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-15T22:36:29.721323] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-15T22:36:29.721609] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-15T22:36:29.724127] [INFO ] [MAIN ] Derivative Progress: 562/1803 symbols completed. EFR took 1.1s. Estimated remaining: 7m 49s. Rate: 158.6 symbols/min [2025-10-15T22:36:29.724297] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:29.721421] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-15T22:36:29.726938] [INFO ] [MAIN ] Derivative Progress: 563/1803 symbols completed. EFT took 1.1s. Estimated remaining: 7m 48s. Rate: 158.9 symbols/min [2025-10-15T22:36:29.727104] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:29.745005] [DEBUG] [MAIN ] EFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:29.745765] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46431 primary records. [2025-10-15T22:36:29.745964] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-15T22:36:29.770596] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-10-15T22:36:29.770777] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-15T22:36:29.773913] [INFO ] [MAIN ] Derivative Progress: 564/1803 symbols completed. EFC took 1.2s. Estimated remaining: 7m 47s. Rate: 159.2 symbols/min [2025-10-15T22:36:29.774761] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:29.784855] [DEBUG] [LOCAL ] EFXT: Loaded 29684 existing records from primary storage. [2025-10-15T22:36:29.785076] [INFO ] [MAIN ] EFXT: Loaded 29684 primary data records. [2025-10-15T22:36:29.934357] [DEBUG] [LOCAL ] EFX: Loaded 44637 existing records from primary storage. [2025-10-15T22:36:29.974512] [INFO ] [MAIN ] EFX: Loaded 44637 primary data records. [2025-10-15T22:36:30.153837] [DEBUG] [LOCAL ] EG: Loaded 27797 existing records from primary storage. [2025-10-15T22:36:30.187153] [INFO ] [MAIN ] EG: Loaded 27797 primary data records. [2025-10-15T22:36:30.753238] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:30.754392] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29684 primary records. [2025-10-15T22:36:30.754614] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-15T22:36:30.771746] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-15T22:36:30.772994] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-15T22:36:30.776338] [INFO ] [MAIN ] Derivative Progress: 565/1803 symbols completed. EFXT took 1.0s. Estimated remaining: 7m 48s. Rate: 158.7 symbols/min [2025-10-15T22:36:30.777303] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:30.792882] [DEBUG] [MAIN ] EFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:30.793626] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44637 primary records. [2025-10-15T22:36:30.793788] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-15T22:36:30.813619] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-15T22:36:30.814124] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-15T22:36:30.817411] [INFO ] [MAIN ] Derivative Progress: 566/1803 symbols completed. EFX took 1.1s. Estimated remaining: 7m 47s. Rate: 158.9 symbols/min [2025-10-15T22:36:30.831200] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:30.832226] [DEBUG] [MAIN ] EG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:30.835230] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27797 primary records. [2025-10-15T22:36:30.835311] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-15T22:36:30.852004] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-15T22:36:30.852179] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-15T22:36:30.854974] [INFO ] [MAIN ] Derivative Progress: 567/1803 symbols completed. EG took 1.1s. Estimated remaining: 7m 46s. Rate: 159.2 symbols/min [2025-10-15T22:36:30.855237] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:30.910272] [DEBUG] [LOCAL ] EGO: Loaded 51726 existing records from primary storage. [2025-10-15T22:36:30.910510] [INFO ] [MAIN ] EGO: Loaded 51726 primary data records. [2025-10-15T22:36:30.971349] [DEBUG] [LOCAL ] EGP: Loaded 30418 existing records from primary storage. [2025-10-15T22:36:30.999500] [INFO ] [MAIN ] EGP: Loaded 30418 primary data records. [2025-10-15T22:36:31.043137] [DEBUG] [LOCAL ] EGY: Loaded 41558 existing records from primary storage. [2025-10-15T22:36:31.043272] [INFO ] [MAIN ] EGY: Loaded 41558 primary data records. [2025-10-15T22:36:31.900871] [DEBUG] [MAIN ] EGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:31.902486] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51726 primary records. [2025-10-15T22:36:31.902691] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-15T22:36:31.933721] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:31.947435] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30418 primary records. [2025-10-15T22:36:31.934769] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-15T22:36:31.947889] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:31.948057] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-15T22:36:31.947950] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-15T22:36:31.950752] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41558 primary records. [2025-10-15T22:36:31.949936] [INFO ] [MAIN ] Derivative Progress: 568/1803 symbols completed. EGO took 1.2s. Estimated remaining: 7m 47s. Rate: 158.7 symbols/min [2025-10-15T22:36:31.950872] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-15T22:36:31.983254] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-15T22:36:31.982876] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-15T22:36:31.983418] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-15T22:36:31.986153] [INFO ] [MAIN ] Derivative Progress: 569/1803 symbols completed. EGP took 1.2s. Estimated remaining: 7m 46s. Rate: 158.9 symbols/min [2025-10-15T22:36:31.986375] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-15T22:36:31.989578] [INFO ] [MAIN ] Derivative Progress: 570/1803 symbols completed. EGY took 1.1s. Estimated remaining: 7m 45s. Rate: 159.2 symbols/min [2025-10-15T22:36:31.989996] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:31.990443] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:31.990160] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:32.004004] [DEBUG] [LOCAL ] EHI: Loaded 10605 existing records from primary storage. [2025-10-15T22:36:32.004280] [INFO ] [MAIN ] EHI: Loaded 10605 primary data records. [2025-10-15T22:36:32.176166] [DEBUG] [LOCAL ] EIC: Loaded 22908 existing records from primary storage. [2025-10-15T22:36:32.335853] [DEBUG] [LOCAL ] EHAB: Loaded 29337 existing records from primary storage. [2025-10-15T22:36:32.336877] [INFO ] [MAIN ] EIC: Loaded 22908 primary data records. [2025-10-15T22:36:32.336759] [INFO ] [MAIN ] EHAB: Loaded 29337 primary data records. [2025-10-15T22:36:33.023565] [DEBUG] [MAIN ] EHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:33.025084] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10605 primary records. [2025-10-15T22:36:33.025914] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-15T22:36:33.046790] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-15T22:36:33.047341] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-15T22:36:33.049715] [INFO ] [MAIN ] Derivative Progress: 571/1803 symbols completed. EHI took 1.1s. Estimated remaining: 7m 46s. Rate: 158.7 symbols/min [2025-10-15T22:36:33.049908] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:33.085428] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:33.085795] [DEBUG] [MAIN ] EIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:33.092307] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29337 primary records. [2025-10-15T22:36:33.091525] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 22908 primary records. [2025-10-15T22:36:33.092563] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-15T22:36:33.092489] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-15T22:36:33.121497] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-15T22:36:33.130211] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-15T22:36:33.130622] [DEBUG] [LOCAL ] EIG: Loaded 20221 existing records from primary storage. [2025-10-15T22:36:33.132086] [INFO ] [MAIN ] EIG: Loaded 20221 primary data records. [2025-10-15T22:36:33.134935] [INFO ] [MAIN ] Derivative Progress: 572/1803 symbols completed. EHAB took 1.1s. Estimated remaining: 7m 45s. Rate: 158.9 symbols/min [2025-10-15T22:36:33.135833] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-15T22:36:33.136210] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-15T22:36:33.135967] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:33.138949] [INFO ] [MAIN ] Derivative Progress: 573/1803 symbols completed. EIC took 1.1s. Estimated remaining: 7m 44s. Rate: 159.2 symbols/min [2025-10-15T22:36:33.139221] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:33.484763] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-15T22:36:33.485316] [INFO ] [MAIN ] EL: Loaded 53376 primary data records. [2025-10-15T22:36:33.603865] [DEBUG] [LOCAL ] EIX: Loaded 53375 existing records from primary storage. [2025-10-15T22:36:33.626835] [INFO ] [MAIN ] EIX: Loaded 53375 primary data records. [2025-10-15T22:36:33.893816] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:33.900252] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20221 primary records. [2025-10-15T22:36:33.900410] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-15T22:36:33.941745] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-15T22:36:33.942023] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-15T22:36:33.943897] [INFO ] [MAIN ] Derivative Progress: 574/1803 symbols completed. EIG took 0.9s. Estimated remaining: 7m 44s. Rate: 158.9 symbols/min [2025-10-15T22:36:33.959629] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:34.172505] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:34.173783] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53376 primary records. [2025-10-15T22:36:34.173989] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-15T22:36:34.204661] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-15T22:36:34.204829] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-15T22:36:34.206867] [INFO ] [MAIN ] Derivative Progress: 575/1803 symbols completed. EL took 1.1s. Estimated remaining: 7m 44s. Rate: 159.0 symbols/min [2025-10-15T22:36:34.207211] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:34.216613] [DEBUG] [LOCAL ] ELC: Loaded 3506 existing records from primary storage. [2025-10-15T22:36:34.230193] [INFO ] [MAIN ] ELC: Loaded 3506 primary data records. [2025-10-15T22:36:34.307240] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:34.308964] [DEBUG] [LOCAL ] ELAN: Loaded 53301 existing records from primary storage. [2025-10-15T22:36:34.326711] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53375 primary records. [2025-10-15T22:36:34.332251] [INFO ] [MAIN ] ELAN: Loaded 53301 primary data records. [2025-10-15T22:36:34.344758] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-15T22:36:34.401591] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-15T22:36:34.425343] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-15T22:36:34.458310] [INFO ] [MAIN ] Derivative Progress: 576/1803 symbols completed. EIX took 1.3s. Estimated remaining: 7m 43s. Rate: 159.0 symbols/min [2025-10-15T22:36:34.469042] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:34.915224] [DEBUG] [MAIN ] ELC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:34.918381] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3506 primary records. [2025-10-15T22:36:34.918629] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-15T22:36:34.918490] [DEBUG] [LOCAL ] ELF: Loaded 52028 existing records from primary storage. [2025-10-15T22:36:34.919545] [INFO ] [MAIN ] ELF: Loaded 52028 primary data records. [2025-10-15T22:36:35.015687] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-15T22:36:35.026598] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-15T22:36:35.036026] [INFO ] [MAIN ] Derivative Progress: 577/1803 symbols completed. ELC took 0.8s. Estimated remaining: 7m 43s. Rate: 158.9 symbols/min [2025-10-15T22:36:35.051429] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:35.052567] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:35.069286] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53301 primary records. [2025-10-15T22:36:35.074826] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-15T22:36:35.146439] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-15T22:36:35.278314] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-15T22:36:35.293939] [INFO ] [MAIN ] Derivative Progress: 578/1803 symbols completed. ELAN took 1.3s. Estimated remaining: 7m 42s. Rate: 159.0 symbols/min [2025-10-15T22:36:35.294929] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:35.341819] [DEBUG] [LOCAL ] ELME: Loaded 39404 existing records from primary storage. [2025-10-15T22:36:35.341142] [DEBUG] [LOCAL ] ELP: Loaded 25680 existing records from primary storage. [2025-10-15T22:36:35.343713] [INFO ] [MAIN ] ELP: Loaded 25680 primary data records. [2025-10-15T22:36:35.355073] [INFO ] [MAIN ] ELME: Loaded 39404 primary data records. [2025-10-15T22:36:35.419862] [DEBUG] [MAIN ] ELF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:35.497228] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52028 primary records. [2025-10-15T22:36:35.559475] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-15T22:36:35.838277] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-15T22:36:35.851464] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-15T22:36:35.853534] [INFO ] [MAIN ] Derivative Progress: 579/1803 symbols completed. ELF took 1.4s. Estimated remaining: 7m 42s. Rate: 158.9 symbols/min [2025-10-15T22:36:35.853761] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:35.997852] [DEBUG] [MAIN ] ELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:35.998723] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25680 primary records. [2025-10-15T22:36:35.999087] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-15T22:36:36.026829] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-15T22:36:36.029169] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-15T22:36:36.043970] [INFO ] [MAIN ] Derivative Progress: 580/1803 symbols completed. ELP took 0.7s. Estimated remaining: 7m 42s. Rate: 159.0 symbols/min [2025-10-15T22:36:36.045412] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:36.058278] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:36.059790] [DEBUG] [LOCAL ] ELS: Loaded 49862 existing records from primary storage. [2025-10-15T22:36:36.060538] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39404 primary records. [2025-10-15T22:36:36.060839] [INFO ] [MAIN ] ELS: Loaded 49862 primary data records. [2025-10-15T22:36:36.060977] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-15T22:36:36.189553] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-15T22:36:36.205288] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-15T22:36:36.235793] [INFO ] [MAIN ] Derivative Progress: 581/1803 symbols completed. ELME took 1.2s. Estimated remaining: 7m 41s. Rate: 159.1 symbols/min [2025-10-15T22:36:36.291744] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:36.423377] [DEBUG] [LOCAL ] EMD: Loaded 20863 existing records from primary storage. [2025-10-15T22:36:36.424541] [DEBUG] [LOCAL ] ELV: Loaded 50691 existing records from primary storage. [2025-10-15T22:36:36.424706] [INFO ] [MAIN ] EMD: Loaded 20863 primary data records. [2025-10-15T22:36:36.424795] [INFO ] [MAIN ] ELV: Loaded 50691 primary data records. [2025-10-15T22:36:36.793261] [DEBUG] [MAIN ] ELS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:37.062575] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49862 primary records. [2025-10-15T22:36:37.072141] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-15T22:36:37.101010] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-10-15T22:36:37.101931] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-15T22:36:37.105374] [INFO ] [MAIN ] Derivative Progress: 582/1803 symbols completed. ELS took 1.3s. Estimated remaining: 7m 41s. Rate: 158.8 symbols/min [2025-10-15T22:36:37.105819] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:37.154223] [DEBUG] [MAIN ] ELV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:37.161160] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50691 primary records. [2025-10-15T22:36:37.161256] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-15T22:36:37.160146] [DEBUG] [MAIN ] EMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:37.162539] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 20863 primary records. [2025-10-15T22:36:37.177338] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-15T22:36:37.189795] [DEBUG] [LOCAL ] EME: Loaded 30952 existing records from primary storage. [2025-10-15T22:36:37.194595] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-15T22:36:37.195190] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-15T22:36:37.194720] [INFO ] [MAIN ] EME: Loaded 30952 primary data records. [2025-10-15T22:36:37.197254] [INFO ] [MAIN ] Derivative Progress: 583/1803 symbols completed. ELV took 1.2s. Estimated remaining: 7m 40s. Rate: 159.0 symbols/min [2025-10-15T22:36:37.265229] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-10-15T22:36:37.291846] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-15T22:36:37.294783] [INFO ] [MAIN ] Derivative Progress: 584/1803 symbols completed. EMD took 1.0s. Estimated remaining: 7m 39s. Rate: 159.2 symbols/min [2025-10-15T22:36:37.542725] [DEBUG] [MAIN ] EME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:37.543396] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 30952 primary records. [2025-10-15T22:36:37.543456] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-15T22:36:37.558355] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-15T22:36:37.558414] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-15T22:36:37.560318] [INFO ] [MAIN ] Derivative Progress: 585/1803 symbols completed. EME took 0.5s. Estimated remaining: 7m 39s. Rate: 159.3 symbols/min [2025-10-15T22:36:37.560993] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:37.561278] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:37.561403] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:37.568961] [DEBUG] [LOCAL ] EMF: Loaded 3211 existing records from primary storage. [2025-10-15T22:36:37.569087] [INFO ] [MAIN ] EMF: Loaded 3211 primary data records. [2025-10-15T22:36:37.687285] [DEBUG] [LOCAL ] EMO: Loaded 13265 existing records from primary storage. [2025-10-15T22:36:37.690561] [INFO ] [MAIN ] EMO: Loaded 13265 primary data records. [2025-10-15T22:36:38.016860] [DEBUG] [LOCAL ] EMN: Loaded 50780 existing records from primary storage. [2025-10-15T22:36:38.027356] [INFO ] [MAIN ] EMN: Loaded 50780 primary data records. [2025-10-15T22:36:38.571157] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:38.573532] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3211 primary records. [2025-10-15T22:36:38.576169] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-15T22:36:38.614465] [DEBUG] [MAIN ] EMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:38.616793] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 13265 primary records. [2025-10-15T22:36:38.618062] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-15T22:36:38.639005] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-15T22:36:38.640125] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-15T22:36:38.643098] [INFO ] [MAIN ] Derivative Progress: 586/1803 symbols completed. EMF took 1.1s. Estimated remaining: 7m 40s. Rate: 158.7 symbols/min [2025-10-15T22:36:38.645123] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:38.652110] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-15T22:36:38.652279] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-15T22:36:38.654944] [INFO ] [MAIN ] Derivative Progress: 587/1803 symbols completed. EMO took 1.1s. Estimated remaining: 7m 39s. Rate: 159.0 symbols/min [2025-10-15T22:36:38.655729] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:38.682878] [DEBUG] [MAIN ] EMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:38.688827] [DEBUG] [LOCAL ] EMP: Loaded 3037 existing records from primary storage. [2025-10-15T22:36:38.689017] [INFO ] [MAIN ] EMP: Loaded 3037 primary data records. [2025-10-15T22:36:38.684686] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50780 primary records. [2025-10-15T22:36:38.710727] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-15T22:36:38.894080] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-15T22:36:38.894523] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-15T22:36:38.918816] [INFO ] [MAIN ] Derivative Progress: 588/1803 symbols completed. EMN took 1.4s. Estimated remaining: 7m 38s. Rate: 159.1 symbols/min [2025-10-15T22:36:38.945824] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:39.012066] [DEBUG] [LOCAL ] EMR: Loaded 53206 existing records from primary storage. [2025-10-15T22:36:39.012635] [INFO ] [MAIN ] EMR: Loaded 53206 primary data records. [2025-10-15T22:36:39.617562] [DEBUG] [LOCAL ] ENB: Loaded 53513 existing records from primary storage. [2025-10-15T22:36:39.618035] [INFO ] [MAIN ] ENB: Loaded 53513 primary data records. [2025-10-15T22:36:39.662962] [DEBUG] [MAIN ] EMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:39.701227] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3037 primary records. [2025-10-15T22:36:39.701333] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-15T22:36:39.827943] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-10-15T22:36:39.831569] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-15T22:36:39.833930] [INFO ] [MAIN ] Derivative Progress: 589/1803 symbols completed. EMP took 1.2s. Estimated remaining: 7m 39s. Rate: 158.7 symbols/min [2025-10-15T22:36:39.834202] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:39.981588] [DEBUG] [MAIN ] EMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:39.982711] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53206 primary records. [2025-10-15T22:36:39.982804] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-15T22:36:40.000149] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-15T22:36:40.000337] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-15T22:36:40.002513] [INFO ] [MAIN ] Derivative Progress: 590/1803 symbols completed. EMR took 1.3s. Estimated remaining: 7m 38s. Rate: 158.9 symbols/min [2025-10-15T22:36:40.003053] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:40.008581] [DEBUG] [LOCAL ] ENO: Loaded 1855 existing records from primary storage. [2025-10-15T22:36:40.009135] [INFO ] [MAIN ] ENO: Loaded 1855 primary data records. [2025-10-15T22:36:40.147814] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:40.142730] [DEBUG] [LOCAL ] ENIC: Loaded 36700 existing records from primary storage. [2025-10-15T22:36:40.148907] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53513 primary records. [2025-10-15T22:36:40.148961] [INFO ] [MAIN ] ENIC: Loaded 36700 primary data records. [2025-10-15T22:36:40.149154] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-15T22:36:40.505468] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-15T22:36:40.514833] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-15T22:36:40.548480] [INFO ] [MAIN ] Derivative Progress: 591/1803 symbols completed. ENB took 1.6s. Estimated remaining: 7m 38s. Rate: 158.7 symbols/min [2025-10-15T22:36:40.654711] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:40.688218] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:40.689282] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1855 primary records. [2025-10-15T22:36:40.689515] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-15T22:36:40.703439] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-10-15T22:36:40.703844] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-15T22:36:40.705777] [INFO ] [MAIN ] Derivative Progress: 592/1803 symbols completed. ENO took 0.7s. Estimated remaining: 7m 37s. Rate: 158.9 symbols/min [2025-10-15T22:36:40.706040] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:40.733089] [DEBUG] [MAIN ] ENIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:40.733808] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36700 primary records. [2025-10-15T22:36:40.734000] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-15T22:36:40.763836] [DEBUG] [LOCAL ] ENOV: Loaded 44851 existing records from primary storage. [2025-10-15T22:36:40.763993] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-15T22:36:40.764247] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-15T22:36:40.764188] [INFO ] [MAIN ] ENOV: Loaded 44851 primary data records. [2025-10-15T22:36:40.766833] [INFO ] [MAIN ] Derivative Progress: 593/1803 symbols completed. ENIC took 0.9s. Estimated remaining: 7m 36s. Rate: 159.1 symbols/min [2025-10-15T22:36:40.778306] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:40.969376] [DEBUG] [LOCAL ] ENR: Loaded 43703 existing records from primary storage. [2025-10-15T22:36:41.087174] [INFO ] [MAIN ] ENR: Loaded 43703 primary data records. [2025-10-15T22:36:41.179958] [DEBUG] [LOCAL ] ENS: Loaded 29689 existing records from primary storage. [2025-10-15T22:36:41.202048] [INFO ] [MAIN ] ENS: Loaded 29689 primary data records. [2025-10-15T22:36:41.746365] [DEBUG] [MAIN ] ENOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:41.750070] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44851 primary records. [2025-10-15T22:36:41.750499] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-15T22:36:41.769961] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-15T22:36:41.770661] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-15T22:36:41.773618] [INFO ] [MAIN ] Derivative Progress: 594/1803 symbols completed. ENOV took 1.1s. Estimated remaining: 7m 37s. Rate: 158.7 symbols/min [2025-10-15T22:36:41.774115] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:41.792320] [DEBUG] [MAIN ] ENR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:41.793132] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43703 primary records. [2025-10-15T22:36:41.793276] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-15T22:36:41.830504] [DEBUG] [MAIN ] ENS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:41.832446] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29689 primary records. [2025-10-15T22:36:41.832754] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-15T22:36:41.834563] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-15T22:36:41.834677] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-15T22:36:41.836769] [INFO ] [MAIN ] Derivative Progress: 595/1803 symbols completed. ENR took 1.1s. Estimated remaining: 7m 36s. Rate: 158.9 symbols/min [2025-10-15T22:36:41.837260] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:41.860149] [DEBUG] [LOCAL ] ENVA: Loaded 25474 existing records from primary storage. [2025-10-15T22:36:41.861868] [INFO ] [MAIN ] ENVA: Loaded 25474 primary data records. [2025-10-15T22:36:41.863176] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-15T22:36:41.898190] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-15T22:36:41.956083] [INFO ] [MAIN ] Derivative Progress: 596/1803 symbols completed. ENS took 1.2s. Estimated remaining: 7m 35s. Rate: 159.1 symbols/min [2025-10-15T22:36:41.961755] [DEBUG] [LOCAL ] EOD: Loaded 15054 existing records from primary storage. [2025-10-15T22:36:41.976253] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:41.976482] [INFO ] [MAIN ] EOD: Loaded 15054 primary data records. [2025-10-15T22:36:42.527991] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:42.530440] [DEBUG] [LOCAL ] EOG: Loaded 53373 existing records from primary storage. [2025-10-15T22:36:42.531460] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25474 primary records. [2025-10-15T22:36:42.531676] [INFO ] [MAIN ] EOG: Loaded 53373 primary data records. [2025-10-15T22:36:42.532544] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-15T22:36:42.645753] [DEBUG] [MAIN ] EOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:42.651611] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-15T22:36:42.658861] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 15054 primary records. [2025-10-15T22:36:42.666734] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-15T22:36:42.672742] [INFO ] [MAIN ] Derivative Progress: 597/1803 symbols completed. ENVA took 0.9s. Estimated remaining: 7m 36s. Rate: 158.8 symbols/min [2025-10-15T22:36:42.672873] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-15T22:36:42.673460] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:42.894244] [DEBUG] [LOCAL ] EOI: Loaded 10670 existing records from primary storage. [2025-10-15T22:36:42.893816] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-15T22:36:42.894391] [INFO ] [MAIN ] EOI: Loaded 10670 primary data records. [2025-10-15T22:36:42.894556] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-15T22:36:42.897355] [INFO ] [MAIN ] Derivative Progress: 598/1803 symbols completed. EOD took 1.1s. Estimated remaining: 7m 35s. Rate: 158.9 symbols/min [2025-10-15T22:36:43.244441] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:43.245186] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53373 primary records. [2025-10-15T22:36:43.245330] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-15T22:36:43.263034] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-15T22:36:43.263255] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-15T22:36:43.265581] [INFO ] [MAIN ] Derivative Progress: 599/1803 symbols completed. EOG took 1.3s. Estimated remaining: 7m 34s. Rate: 159.0 symbols/min [2025-10-15T22:36:43.285237] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:43.285827] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10670 primary records. [2025-10-15T22:36:43.285887] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-15T22:36:43.300739] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-15T22:36:43.300797] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-15T22:36:43.302955] [INFO ] [MAIN ] Derivative Progress: 600/1803 symbols completed. EOI took 0.6s. Estimated remaining: 7m 33s. Rate: 159.2 symbols/min [2025-10-15T22:36:43.303552] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:43.303693] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:43.304075] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:43.314528] [DEBUG] [LOCAL ] EOT: Loaded 6957 existing records from primary storage. [2025-10-15T22:36:43.318183] [INFO ] [MAIN ] EOT: Loaded 6957 primary data records. [2025-10-15T22:36:43.429359] [DEBUG] [LOCAL ] EOS: Loaded 15153 existing records from primary storage. [2025-10-15T22:36:43.440321] [INFO ] [MAIN ] EOS: Loaded 15153 primary data records. [2025-10-15T22:36:43.440825] [DEBUG] [LOCAL ] EPAC: Loaded 26461 existing records from primary storage. [2025-10-15T22:36:43.441141] [INFO ] [MAIN ] EPAC: Loaded 26461 primary data records. [2025-10-15T22:36:44.255805] [DEBUG] [MAIN ] EOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:44.256753] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6957 primary records. [2025-10-15T22:36:44.257368] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-15T22:36:44.277304] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-15T22:36:44.278475] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-15T22:36:44.289761] [INFO ] [MAIN ] Derivative Progress: 601/1803 symbols completed. EOT took 1.0s. Estimated remaining: 7m 34s. Rate: 158.8 symbols/min [2025-10-15T22:36:44.290080] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:44.307989] [DEBUG] [MAIN ] EPAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:44.308904] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26461 primary records. [2025-10-15T22:36:44.309343] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:44.309402] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-15T22:36:44.310743] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15153 primary records. [2025-10-15T22:36:44.311000] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-15T22:36:44.339036] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-15T22:36:44.340910] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-15T22:36:44.343830] [INFO ] [MAIN ] Derivative Progress: 602/1803 symbols completed. EPAC took 1.0s. Estimated remaining: 7m 33s. Rate: 159.0 symbols/min [2025-10-15T22:36:44.345241] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:44.345662] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-15T22:36:44.346142] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-15T22:36:44.348363] [INFO ] [MAIN ] Derivative Progress: 603/1803 symbols completed. EOS took 1.0s. Estimated remaining: 7m 32s. Rate: 159.3 symbols/min [2025-10-15T22:36:44.348625] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:44.381770] [DEBUG] [LOCAL ] EPAM: Loaded 39462 existing records from primary storage. [2025-10-15T22:36:44.382075] [INFO ] [MAIN ] EPAM: Loaded 39462 primary data records. [2025-10-15T22:36:44.541471] [DEBUG] [LOCAL ] EPC: Loaded 39741 existing records from primary storage. [2025-10-15T22:36:44.569565] [INFO ] [MAIN ] EPC: Loaded 39741 primary data records. [2025-10-15T22:36:44.786470] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-15T22:36:44.807861] [INFO ] [MAIN ] EPD: Loaded 53611 primary data records. [2025-10-15T22:36:45.379187] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:45.381535] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39462 primary records. [2025-10-15T22:36:45.381704] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-15T22:36:45.405540] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-15T22:36:45.405683] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-15T22:36:45.412869] [INFO ] [MAIN ] Derivative Progress: 604/1803 symbols completed. EPAM took 1.1s. Estimated remaining: 7m 33s. Rate: 158.8 symbols/min [2025-10-15T22:36:45.413260] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:45.414171] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:45.415131] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39741 primary records. [2025-10-15T22:36:45.415347] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-15T22:36:45.446765] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:45.447967] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53611 primary records. [2025-10-15T22:36:45.448344] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-15T22:36:45.450084] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-15T22:36:45.450605] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-15T22:36:45.453133] [INFO ] [MAIN ] Derivative Progress: 605/1803 symbols completed. EPC took 1.1s. Estimated remaining: 7m 32s. Rate: 159.0 symbols/min [2025-10-15T22:36:45.464439] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:45.469993] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-15T22:36:45.479263] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-15T22:36:45.482091] [INFO ] [MAIN ] Derivative Progress: 606/1803 symbols completed. EPD took 1.1s. Estimated remaining: 7m 31s. Rate: 159.2 symbols/min [2025-10-15T22:36:45.482287] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:45.491498] [DEBUG] [LOCAL ] EQBK: Loaded 11247 existing records from primary storage. [2025-10-15T22:36:45.491625] [INFO ] [MAIN ] EQBK: Loaded 11247 primary data records. [2025-10-15T22:36:45.611587] [DEBUG] [LOCAL ] EPR: Loaded 43877 existing records from primary storage. [2025-10-15T22:36:45.623821] [INFO ] [MAIN ] EPR: Loaded 43877 primary data records. [2025-10-15T22:36:46.161357] [DEBUG] [LOCAL ] EQH: Loaded 52699 existing records from primary storage. [2025-10-15T22:36:46.162126] [INFO ] [MAIN ] EQH: Loaded 52699 primary data records. [2025-10-15T22:36:46.493543] [DEBUG] [MAIN ] EQBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:46.494943] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 11247 primary records. [2025-10-15T22:36:46.495194] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-15T22:36:46.514127] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-10-15T22:36:46.514480] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-15T22:36:46.516966] [INFO ] [MAIN ] Derivative Progress: 607/1803 symbols completed. EQBK took 1.1s. Estimated remaining: 7m 32s. Rate: 158.8 symbols/min [2025-10-15T22:36:46.525581] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:46.531493] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:46.532128] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43877 primary records. [2025-10-15T22:36:46.532293] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-15T22:36:46.549084] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-15T22:36:46.549599] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-15T22:36:46.552089] [INFO ] [MAIN ] Derivative Progress: 608/1803 symbols completed. EPR took 1.1s. Estimated remaining: 7m 31s. Rate: 159.0 symbols/min [2025-10-15T22:36:46.552245] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:46.569936] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:46.570577] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52699 primary records. [2025-10-15T22:36:46.570781] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-15T22:36:46.586485] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-15T22:36:46.599520] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-15T22:36:46.601848] [INFO ] [MAIN ] Derivative Progress: 609/1803 symbols completed. EQH took 1.1s. Estimated remaining: 7m 30s. Rate: 159.3 symbols/min [2025-10-15T22:36:46.602202] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:46.625562] [DEBUG] [LOCAL ] EQNR: Loaded 53047 existing records from primary storage. [2025-10-15T22:36:46.625871] [INFO ] [MAIN ] EQNR: Loaded 53047 primary data records. [2025-10-15T22:36:46.963857] [DEBUG] [LOCAL ] EQR: Loaded 51721 existing records from primary storage. [2025-10-15T22:36:46.964154] [INFO ] [MAIN ] EQR: Loaded 51721 primary data records. [2025-10-15T22:36:47.104629] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-15T22:36:47.115168] [INFO ] [MAIN ] EQT: Loaded 53685 primary data records. [2025-10-15T22:36:47.652227] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:47.653824] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53047 primary records. [2025-10-15T22:36:47.654160] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-15T22:36:47.689504] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:47.690174] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-15T22:36:47.690538] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-15T22:36:47.691342] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51721 primary records. [2025-10-15T22:36:47.691453] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-15T22:36:47.694381] [INFO ] [MAIN ] Derivative Progress: 610/1803 symbols completed. EQNR took 1.2s. Estimated remaining: 7m 31s. Rate: 158.8 symbols/min [2025-10-15T22:36:47.696022] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:47.717748] [DEBUG] [LOCAL ] EQV: Loaded 2688 existing records from primary storage. [2025-10-15T22:36:47.718536] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-15T22:36:47.718731] [INFO ] [MAIN ] EQV: Loaded 2688 primary data records. [2025-10-15T22:36:47.718825] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-15T22:36:47.754396] [INFO ] [MAIN ] Derivative Progress: 611/1803 symbols completed. EQR took 1.2s. Estimated remaining: 7m 30s. Rate: 159.0 symbols/min [2025-10-15T22:36:47.791824] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:47.814349] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:47.832907] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53685 primary records. [2025-10-15T22:36:47.845102] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-15T22:36:48.058085] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-15T22:36:48.058495] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-15T22:36:48.060697] [INFO ] [MAIN ] Derivative Progress: 612/1803 symbols completed. EQT took 1.5s. Estimated remaining: 7m 29s. Rate: 159.0 symbols/min [2025-10-15T22:36:48.061503] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:48.103446] [DEBUG] [LOCAL ] ERJ: Loaded 50317 existing records from primary storage. [2025-10-15T22:36:48.104150] [INFO ] [MAIN ] ERJ: Loaded 50317 primary data records. [2025-10-15T22:36:48.229554] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:48.241159] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2688 primary records. [2025-10-15T22:36:48.246376] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-15T22:36:48.319057] [DEBUG] [LOCAL ] ERO: Loaded 41875 existing records from primary storage. [2025-10-15T22:36:48.330676] [INFO ] [MAIN ] ERO: Loaded 41875 primary data records. [2025-10-15T22:36:48.555905] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-15T22:36:48.571536] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-15T22:36:48.574135] [INFO ] [MAIN ] Derivative Progress: 613/1803 symbols completed. EQV took 0.9s. Estimated remaining: 7m 29s. Rate: 158.9 symbols/min [2025-10-15T22:36:48.763557] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:48.764535] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50317 primary records. [2025-10-15T22:36:48.764770] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-15T22:36:48.781609] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-15T22:36:48.781890] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-15T22:36:48.784089] [INFO ] [MAIN ] Derivative Progress: 614/1803 symbols completed. ERJ took 1.0s. Estimated remaining: 7m 29s. Rate: 159.1 symbols/min [2025-10-15T22:36:48.799475] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:48.800030] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41875 primary records. [2025-10-15T22:36:48.800092] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-15T22:36:48.815001] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-15T22:36:48.815060] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-15T22:36:48.817041] [INFO ] [MAIN ] Derivative Progress: 615/1803 symbols completed. ERO took 0.8s. Estimated remaining: 7m 27s. Rate: 159.3 symbols/min [2025-10-15T22:36:48.817441] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:48.817587] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:48.817529] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:48.845122] [DEBUG] [LOCAL ] ESE: Loaded 16509 existing records from primary storage. [2025-10-15T22:36:48.845264] [INFO ] [MAIN ] ESE: Loaded 16509 primary data records. [2025-10-15T22:36:48.929556] [DEBUG] [LOCAL ] ESAB: Loaded 26058 existing records from primary storage. [2025-10-15T22:36:48.945831] [INFO ] [MAIN ] ESAB: Loaded 26058 primary data records. [2025-10-15T22:36:49.208015] [DEBUG] [LOCAL ] ES: Loaded 52695 existing records from primary storage. [2025-10-15T22:36:49.255614] [INFO ] [MAIN ] ES: Loaded 52695 primary data records. [2025-10-15T22:36:49.868794] [DEBUG] [MAIN ] ESAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:49.869259] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:49.870104] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16509 primary records. [2025-10-15T22:36:49.870858] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26058 primary records. [2025-10-15T22:36:49.871049] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-15T22:36:49.871866] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-15T22:36:49.903625] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-15T22:36:49.902520] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-15T22:36:49.904071] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-15T22:36:49.904008] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-15T22:36:49.906099] [INFO ] [MAIN ] Derivative Progress: 616/1803 symbols completed. ESAB took 1.1s. Estimated remaining: 7m 28s. Rate: 158.8 symbols/min [2025-10-15T22:36:49.908981] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:49.909330] [INFO ] [MAIN ] Derivative Progress: 617/1803 symbols completed. ESE took 1.1s. Estimated remaining: 7m 27s. Rate: 159.1 symbols/min [2025-10-15T22:36:49.909909] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:49.928293] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:49.929375] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52695 primary records. [2025-10-15T22:36:49.929576] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-15T22:36:49.950581] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-15T22:36:49.950762] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-15T22:36:49.953415] [INFO ] [MAIN ] Derivative Progress: 618/1803 symbols completed. ES took 1.1s. Estimated remaining: 7m 26s. Rate: 159.3 symbols/min [2025-10-15T22:36:49.953598] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:50.003066] [DEBUG] [LOCAL ] ESI: Loaded 50648 existing records from primary storage. [2025-10-15T22:36:50.014007] [INFO ] [MAIN ] ESI: Loaded 50648 primary data records. [2025-10-15T22:36:50.044909] [DEBUG] [LOCAL ] ESNT: Loaded 38289 existing records from primary storage. [2025-10-15T22:36:50.056742] [INFO ] [MAIN ] ESNT: Loaded 38289 primary data records. [2025-10-15T22:36:50.322797] [DEBUG] [LOCAL ] ESRT: Loaded 46481 existing records from primary storage. [2025-10-15T22:36:50.446728] [INFO ] [MAIN ] ESRT: Loaded 46481 primary data records. [2025-10-15T22:36:50.990335] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:50.996343] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50648 primary records. [2025-10-15T22:36:50.996751] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-15T22:36:50.997883] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:50.998809] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38289 primary records. [2025-10-15T22:36:51.005943] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-15T22:36:51.031763] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-15T22:36:51.032666] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-15T22:36:51.036080] [INFO ] [MAIN ] Derivative Progress: 619/1803 symbols completed. ESI took 1.1s. Estimated remaining: 7m 27s. Rate: 158.8 symbols/min [2025-10-15T22:36:51.036675] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-15T22:36:51.036322] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:51.036940] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-15T22:36:51.052465] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:51.052135] [INFO ] [MAIN ] Derivative Progress: 620/1803 symbols completed. ESNT took 1.1s. Estimated remaining: 7m 26s. Rate: 159.0 symbols/min [2025-10-15T22:36:51.053516] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:51.053434] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46481 primary records. [2025-10-15T22:36:51.053975] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-15T22:36:51.070180] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-15T22:36:51.070371] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-15T22:36:51.072695] [INFO ] [MAIN ] Derivative Progress: 621/1803 symbols completed. ESRT took 1.1s. Estimated remaining: 7m 25s. Rate: 159.3 symbols/min [2025-10-15T22:36:51.072963] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:51.106979] [DEBUG] [LOCAL ] ESS: Loaded 30136 existing records from primary storage. [2025-10-15T22:36:51.107208] [INFO ] [MAIN ] ESS: Loaded 30136 primary data records. [2025-10-15T22:36:51.221979] [DEBUG] [LOCAL ] ESTC: Loaded 50337 existing records from primary storage. [2025-10-15T22:36:51.250870] [INFO ] [MAIN ] ESTC: Loaded 50337 primary data records. [2025-10-15T22:36:51.520434] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-15T22:36:51.537543] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-15T22:36:52.059768] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:52.060557] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30136 primary records. [2025-10-15T22:36:52.060808] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-15T22:36:52.092187] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-15T22:36:52.092756] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:52.092903] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-15T22:36:52.095902] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50337 primary records. [2025-10-15T22:36:52.096143] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-15T22:36:52.095024] [INFO ] [MAIN ] Derivative Progress: 622/1803 symbols completed. ESS took 1.1s. Estimated remaining: 7m 26s. Rate: 158.9 symbols/min [2025-10-15T22:36:52.096788] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:52.131899] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:52.137195] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-15T22:36:52.138036] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-15T22:36:52.137978] [DEBUG] [LOCAL ] ETB: Loaded 11985 existing records from primary storage. [2025-10-15T22:36:52.137730] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-15T22:36:52.138484] [INFO ] [MAIN ] ETB: Loaded 11985 primary data records. [2025-10-15T22:36:52.138559] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-15T22:36:52.177229] [INFO ] [MAIN ] Derivative Progress: 623/1803 symbols completed. ESTC took 1.1s. Estimated remaining: 7m 25s. Rate: 159.1 symbols/min [2025-10-15T22:36:52.184584] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:52.326002] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-15T22:36:52.363420] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-15T22:36:52.473882] [INFO ] [MAIN ] Derivative Progress: 624/1803 symbols completed. ET took 1.4s. Estimated remaining: 7m 25s. Rate: 159.1 symbols/min [2025-10-15T22:36:52.487342] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:52.488426] [DEBUG] [LOCAL ] ETD: Loaded 27336 existing records from primary storage. [2025-10-15T22:36:52.488526] [INFO ] [MAIN ] ETD: Loaded 27336 primary data records. [2025-10-15T22:36:52.677501] [DEBUG] [LOCAL ] ETG: Loaded 16670 existing records from primary storage. [2025-10-15T22:36:52.716701] [INFO ] [MAIN ] ETG: Loaded 16670 primary data records. [2025-10-15T22:36:53.140671] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:53.141741] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 11985 primary records. [2025-10-15T22:36:53.142062] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-15T22:36:53.161934] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-15T22:36:53.162263] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-15T22:36:53.164292] [INFO ] [MAIN ] Derivative Progress: 625/1803 symbols completed. ETB took 1.1s. Estimated remaining: 7m 25s. Rate: 158.9 symbols/min [2025-10-15T22:36:53.164575] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:53.178597] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:53.179489] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27336 primary records. [2025-10-15T22:36:53.179758] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-15T22:36:53.201103] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-15T22:36:53.208673] [DEBUG] [LOCAL ] ETJ: Loaded 16847 existing records from primary storage. [2025-10-15T22:36:53.208908] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-15T22:36:53.209046] [INFO ] [MAIN ] ETJ: Loaded 16847 primary data records. [2025-10-15T22:36:53.211429] [INFO ] [MAIN ] Derivative Progress: 626/1803 symbols completed. ETD took 1.0s. Estimated remaining: 7m 24s. Rate: 159.1 symbols/min [2025-10-15T22:36:53.222292] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:53.272577] [DEBUG] [MAIN ] ETG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:53.293802] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16670 primary records. [2025-10-15T22:36:53.305691] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-15T22:36:53.562695] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-15T22:36:53.563514] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-15T22:36:53.567094] [INFO ] [MAIN ] Derivative Progress: 627/1803 symbols completed. ETG took 1.1s. Estimated remaining: 7m 23s. Rate: 159.1 symbols/min [2025-10-15T22:36:53.567713] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:53.591226] [DEBUG] [LOCAL ] ETN: Loaded 52641 existing records from primary storage. [2025-10-15T22:36:53.593722] [INFO ] [MAIN ] ETN: Loaded 52641 primary data records. [2025-10-15T22:36:53.630215] [DEBUG] [LOCAL ] ETO: Loaded 6976 existing records from primary storage. [2025-10-15T22:36:53.642593] [INFO ] [MAIN ] ETO: Loaded 6976 primary data records. [2025-10-15T22:36:53.856985] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:53.895466] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16847 primary records. [2025-10-15T22:36:53.930153] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-15T22:36:54.208715] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-15T22:36:54.210044] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-15T22:36:54.212106] [INFO ] [MAIN ] Derivative Progress: 628/1803 symbols completed. ETJ took 1.0s. Estimated remaining: 7m 24s. Rate: 159.0 symbols/min [2025-10-15T22:36:54.239914] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:54.251993] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:54.252609] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6976 primary records. [2025-10-15T22:36:54.253186] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52641 primary records. [2025-10-15T22:36:54.253271] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-15T22:36:54.253374] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-15T22:36:54.282269] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-15T22:36:54.282569] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-15T22:36:54.285271] [INFO ] [MAIN ] Derivative Progress: 629/1803 symbols completed. ETN took 1.1s. Estimated remaining: 7m 23s. Rate: 159.2 symbols/min [2025-10-15T22:36:54.286707] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-15T22:36:54.286766] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-15T22:36:54.289084] [INFO ] [MAIN ] Derivative Progress: 630/1803 symbols completed. ETO took 0.7s. Estimated remaining: 7m 22s. Rate: 159.4 symbols/min [2025-10-15T22:36:54.289959] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:54.289902] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:54.290123] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:54.328477] [DEBUG] [LOCAL ] ETV: Loaded 22258 existing records from primary storage. [2025-10-15T22:36:54.328737] [INFO ] [MAIN ] ETV: Loaded 22258 primary data records. [2025-10-15T22:36:54.466851] [DEBUG] [LOCAL ] ETSY: Loaded 53577 existing records from primary storage. [2025-10-15T22:36:54.486598] [INFO ] [MAIN ] ETSY: Loaded 53577 primary data records. [2025-10-15T22:36:54.547166] [DEBUG] [LOCAL ] ETR: Loaded 53210 existing records from primary storage. [2025-10-15T22:36:54.710704] [INFO ] [MAIN ] ETR: Loaded 53210 primary data records. [2025-10-15T22:36:55.332465] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:55.333261] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 22258 primary records. [2025-10-15T22:36:55.333381] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-15T22:36:55.350102] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-15T22:36:55.350278] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-15T22:36:55.352593] [INFO ] [MAIN ] Derivative Progress: 631/1803 symbols completed. ETV took 1.1s. Estimated remaining: 7m 22s. Rate: 158.9 symbols/min [2025-10-15T22:36:55.353811] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:55.369867] [DEBUG] [MAIN ] ETSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:55.371006] [INFO ] [MAIN ] ETSY: Generated 1794 derivative records from 53577 primary records. [2025-10-15T22:36:55.371951] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-15T22:36:55.411550] [DEBUG] [MAIN ] ETR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:55.412663] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53210 primary records. [2025-10-15T22:36:55.412789] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-15T22:36:55.422023] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1794 records). [2025-10-15T22:36:55.422749] [DEBUG] [LOCAL ] ETW: Loaded 25583 existing records from primary storage. [2025-10-15T22:36:55.422856] [INFO ] [MAIN ] ETW: Loaded 25583 primary data records. [2025-10-15T22:36:55.422372] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-15T22:36:55.464835] [INFO ] [MAIN ] Derivative Progress: 632/1803 symbols completed. ETSY took 1.2s. Estimated remaining: 7m 22s. Rate: 159.1 symbols/min [2025-10-15T22:36:55.491360] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:55.545380] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-15T22:36:55.546555] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-15T22:36:55.549260] [INFO ] [MAIN ] Derivative Progress: 633/1803 symbols completed. ETR took 1.3s. Estimated remaining: 7m 21s. Rate: 159.3 symbols/min [2025-10-15T22:36:55.560251] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:55.574130] [DEBUG] [LOCAL ] ETX: Loaded 5256 existing records from primary storage. [2025-10-15T22:36:55.592695] [INFO ] [MAIN ] ETX: Loaded 5256 primary data records. [2025-10-15T22:36:55.893284] [DEBUG] [LOCAL ] ETY: Loaded 22961 existing records from primary storage. [2025-10-15T22:36:55.931338] [INFO ] [MAIN ] ETY: Loaded 22961 primary data records. [2025-10-15T22:36:56.369088] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:56.370444] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25583 primary records. [2025-10-15T22:36:56.372349] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-15T22:36:56.396053] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:56.403753] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5256 primary records. [2025-10-15T22:36:56.404134] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-15T22:36:56.405253] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-15T22:36:56.406482] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-15T22:36:56.415556] [INFO ] [MAIN ] Derivative Progress: 634/1803 symbols completed. ETW took 1.1s. Estimated remaining: 7m 21s. Rate: 159.0 symbols/min [2025-10-15T22:36:56.415809] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:56.425217] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-15T22:36:56.425601] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-15T22:36:56.428203] [INFO ] [MAIN ] Derivative Progress: 635/1803 symbols completed. ETX took 0.9s. Estimated remaining: 7m 20s. Rate: 159.2 symbols/min [2025-10-15T22:36:56.428461] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:56.450274] [DEBUG] [MAIN ] ETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:56.451016] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22961 primary records. [2025-10-15T22:36:56.451478] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-15T22:36:56.457605] [DEBUG] [LOCAL ] EVC: Loaded 18093 existing records from primary storage. [2025-10-15T22:36:56.457860] [INFO ] [MAIN ] EVC: Loaded 18093 primary data records. [2025-10-15T22:36:56.542988] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-15T22:36:56.543150] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-15T22:36:56.557048] [INFO ] [MAIN ] Derivative Progress: 636/1803 symbols completed. ETY took 1.0s. Estimated remaining: 7m 19s. Rate: 159.4 symbols/min [2025-10-15T22:36:56.581018] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:56.673964] [DEBUG] [LOCAL ] EVEX: Loaded 32374 existing records from primary storage. [2025-10-15T22:36:56.696674] [INFO ] [MAIN ] EVEX: Loaded 32374 primary data records. [2025-10-15T22:36:56.879882] [DEBUG] [LOCAL ] EVF: Loaded 9830 existing records from primary storage. [2025-10-15T22:36:56.900312] [INFO ] [MAIN ] EVF: Loaded 9830 primary data records. [2025-10-15T22:36:57.447029] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:57.448765] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18093 primary records. [2025-10-15T22:36:57.448970] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-15T22:36:57.467360] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-15T22:36:57.467476] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-15T22:36:57.469638] [INFO ] [MAIN ] Derivative Progress: 637/1803 symbols completed. EVC took 1.1s. Estimated remaining: 7m 20s. Rate: 159.0 symbols/min [2025-10-15T22:36:57.469974] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:57.487413] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:57.488114] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 32374 primary records. [2025-10-15T22:36:57.488511] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-15T22:36:57.502369] [DEBUG] [LOCAL ] EVG: Loaded 5933 existing records from primary storage. [2025-10-15T22:36:57.506037] [INFO ] [MAIN ] EVG: Loaded 5933 primary data records. [2025-10-15T22:36:57.509172] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-15T22:36:57.509296] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-15T22:36:57.511729] [INFO ] [MAIN ] Derivative Progress: 638/1803 symbols completed. EVEX took 1.1s. Estimated remaining: 7m 19s. Rate: 159.3 symbols/min [2025-10-15T22:36:57.523209] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:57.619403] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:57.631325] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9830 primary records. [2025-10-15T22:36:57.641879] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-15T22:36:57.844558] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-15T22:36:57.844790] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-15T22:36:57.847394] [INFO ] [MAIN ] Derivative Progress: 639/1803 symbols completed. EVF took 1.3s. Estimated remaining: 7m 18s. Rate: 159.3 symbols/min [2025-10-15T22:36:57.847676] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:57.869286] [DEBUG] [LOCAL ] EVH: Loaded 49624 existing records from primary storage. [2025-10-15T22:36:57.869668] [INFO ] [MAIN ] EVH: Loaded 49624 primary data records. [2025-10-15T22:36:57.938756] [DEBUG] [LOCAL ] EVN: Loaded 10787 existing records from primary storage. [2025-10-15T22:36:57.950946] [INFO ] [MAIN ] EVN: Loaded 10787 primary data records. [2025-10-15T22:36:58.286477] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:58.309499] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5933 primary records. [2025-10-15T22:36:58.358548] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-15T22:36:58.539785] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-15T22:36:58.541549] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-15T22:36:58.543785] [INFO ] [MAIN ] Derivative Progress: 640/1803 symbols completed. EVG took 1.1s. Estimated remaining: 7m 19s. Rate: 159.1 symbols/min [2025-10-15T22:36:58.544038] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:58.568315] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:58.569157] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49624 primary records. [2025-10-15T22:36:58.576762] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-15T22:36:58.598181] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:58.598959] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10787 primary records. [2025-10-15T22:36:58.602952] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-15T22:36:58.627979] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-15T22:36:58.628082] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-15T22:36:58.631843] [INFO ] [MAIN ] Derivative Progress: 641/1803 symbols completed. EVH took 1.1s. Estimated remaining: 7m 18s. Rate: 159.3 symbols/min [2025-10-15T22:36:58.631972] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:58.635585] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-15T22:36:58.636063] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-15T22:36:58.639547] [INFO ] [MAIN ] Derivative Progress: 642/1803 symbols completed. EVN took 0.8s. Estimated remaining: 7m 17s. Rate: 159.5 symbols/min [2025-10-15T22:36:58.637005] [DEBUG] [LOCAL ] EVR: Loaded 34420 existing records from primary storage. [2025-10-15T22:36:58.639817] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:58.640141] [INFO ] [MAIN ] EVR: Loaded 34420 primary data records. [2025-10-15T22:36:58.794367] [DEBUG] [LOCAL ] EVT: Loaded 16833 existing records from primary storage. [2025-10-15T22:36:58.809558] [INFO ] [MAIN ] EVT: Loaded 16833 primary data records. [2025-10-15T22:36:59.073925] [DEBUG] [LOCAL ] EVTC: Loaded 26787 existing records from primary storage. [2025-10-15T22:36:59.074262] [INFO ] [MAIN ] EVTC: Loaded 26787 primary data records. [2025-10-15T22:36:59.577493] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:59.578741] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34420 primary records. [2025-10-15T22:36:59.578873] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-15T22:36:59.599933] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-15T22:36:59.600331] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-15T22:36:59.602835] [INFO ] [MAIN ] Derivative Progress: 643/1803 symbols completed. EVR took 1.1s. Estimated remaining: 7m 17s. Rate: 159.1 symbols/min [2025-10-15T22:36:59.616085] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:59.616767] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16833 primary records. [2025-10-15T22:36:59.616951] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-15T22:36:59.635267] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-15T22:36:59.635497] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-15T22:36:59.638133] [INFO ] [MAIN ] Derivative Progress: 644/1803 symbols completed. EVT took 1.0s. Estimated remaining: 7m 16s. Rate: 159.4 symbols/min [2025-10-15T22:36:59.650380] [DEBUG] [MAIN ] EVTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:36:59.651017] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26787 primary records. [2025-10-15T22:36:59.651079] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-15T22:36:59.666150] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-15T22:36:59.666211] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-15T22:36:59.668493] [INFO ] [MAIN ] Derivative Progress: 645/1803 symbols completed. EVTC took 1.0s. Estimated remaining: 7m 15s. Rate: 159.6 symbols/min [2025-10-15T22:36:59.668989] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:59.668916] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:59.669905] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:36:59.734021] [DEBUG] [LOCAL ] EXG: Loaded 34033 existing records from primary storage. [2025-10-15T22:36:59.735045] [INFO ] [MAIN ] EXG: Loaded 34033 primary data records. [2025-10-15T22:36:59.734895] [DEBUG] [LOCAL ] EVTL: Loaded 40293 existing records from primary storage. [2025-10-15T22:36:59.735306] [INFO ] [MAIN ] EVTL: Loaded 40293 primary data records. [2025-10-15T22:36:59.918036] [DEBUG] [LOCAL ] EW: Loaded 53406 existing records from primary storage. [2025-10-15T22:36:59.964014] [INFO ] [MAIN ] EW: Loaded 53406 primary data records. [2025-10-15T22:37:00.719855] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:00.720035] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:00.720910] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 40293 primary records. [2025-10-15T22:37:00.721811] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34033 primary records. [2025-10-15T22:37:00.721103] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-15T22:37:00.722262] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-15T22:37:00.749857] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-15T22:37:00.750947] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-15T22:37:00.753533] [INFO ] [MAIN ] Derivative Progress: 646/1803 symbols completed. EXG took 1.1s. Estimated remaining: 7m 16s. Rate: 159.1 symbols/min [2025-10-15T22:37:00.754252] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:00.758141] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-15T22:37:00.758358] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-15T22:37:00.767812] [INFO ] [MAIN ] Derivative Progress: 647/1803 symbols completed. EVTL took 1.1s. Estimated remaining: 7m 15s. Rate: 159.4 symbols/min [2025-10-15T22:37:00.773382] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:00.773194] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:00.774166] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53406 primary records. [2025-10-15T22:37:00.774372] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-15T22:37:00.791857] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-15T22:37:00.792103] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-15T22:37:00.794957] [INFO ] [MAIN ] Derivative Progress: 648/1803 symbols completed. EW took 1.1s. Estimated remaining: 7m 14s. Rate: 159.6 symbols/min [2025-10-15T22:37:00.795303] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:00.829443] [DEBUG] [LOCAL ] EXP: Loaded 29600 existing records from primary storage. [2025-10-15T22:37:00.829716] [INFO ] [MAIN ] EXP: Loaded 29600 primary data records. [2025-10-15T22:37:00.949226] [DEBUG] [LOCAL ] EXK: Loaded 53171 existing records from primary storage. [2025-10-15T22:37:00.998826] [INFO ] [MAIN ] EXK: Loaded 53171 primary data records. [2025-10-15T22:37:01.212015] [DEBUG] [LOCAL ] EXPD: Loaded 47973 existing records from primary storage. [2025-10-15T22:37:01.250933] [INFO ] [MAIN ] EXPD: Loaded 47973 primary data records. [2025-10-15T22:37:01.796240] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:01.797260] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29600 primary records. [2025-10-15T22:37:01.797769] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-15T22:37:01.816445] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-15T22:37:01.816731] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-15T22:37:01.819203] [INFO ] [MAIN ] Derivative Progress: 649/1803 symbols completed. EXP took 1.0s. Estimated remaining: 7m 15s. Rate: 159.2 symbols/min [2025-10-15T22:37:01.819471] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:01.836496] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:01.839419] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53171 primary records. [2025-10-15T22:37:01.839669] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-15T22:37:01.866334] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:01.867479] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47973 primary records. [2025-10-15T22:37:01.867920] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-15T22:37:01.872400] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-15T22:37:01.883525] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-15T22:37:01.887566] [INFO ] [MAIN ] Derivative Progress: 650/1803 symbols completed. EXK took 1.1s. Estimated remaining: 7m 14s. Rate: 159.4 symbols/min [2025-10-15T22:37:01.888255] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:01.890515] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-15T22:37:01.890694] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-15T22:37:01.893184] [INFO ] [MAIN ] Derivative Progress: 651/1803 symbols completed. EXPD took 1.1s. Estimated remaining: 7m 13s. Rate: 159.6 symbols/min [2025-10-15T22:37:01.893590] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:01.928773] [DEBUG] [LOCAL ] EXR: Loaded 45550 existing records from primary storage. [2025-10-15T22:37:01.929027] [INFO ] [MAIN ] EXR: Loaded 45550 primary data records. [2025-10-15T22:37:02.109702] [DEBUG] [LOCAL ] FAF: Loaded 41492 existing records from primary storage. [2025-10-15T22:37:02.179313] [INFO ] [MAIN ] FAF: Loaded 41492 primary data records. [2025-10-15T22:37:02.332828] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-15T22:37:02.370881] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-15T22:37:03.006749] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:03.007883] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45550 primary records. [2025-10-15T22:37:03.008131] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-15T22:37:03.026763] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-15T22:37:03.027167] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-15T22:37:03.030695] [INFO ] [MAIN ] Derivative Progress: 652/1803 symbols completed. EXR took 1.2s. Estimated remaining: 7m 14s. Rate: 159.1 symbols/min [2025-10-15T22:37:03.031205] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:03.049759] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:03.050821] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41492 primary records. [2025-10-15T22:37:03.051186] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-15T22:37:03.086452] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:03.088208] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-15T22:37:03.088891] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-15T22:37:03.088716] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-15T22:37:03.089903] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-15T22:37:03.092103] [INFO ] [MAIN ] Derivative Progress: 653/1803 symbols completed. FAF took 1.2s. Estimated remaining: 7m 13s. Rate: 159.3 symbols/min [2025-10-15T22:37:03.092603] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:03.121096] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-15T22:37:03.121319] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-15T22:37:03.124036] [INFO ] [MAIN ] Derivative Progress: 654/1803 symbols completed. F took 1.2s. Estimated remaining: 7m 12s. Rate: 159.5 symbols/min [2025-10-15T22:37:03.124295] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:03.153947] [DEBUG] [LOCAL ] FBIN: Loaded 50393 existing records from primary storage. [2025-10-15T22:37:03.154263] [INFO ] [MAIN ] FBIN: Loaded 50393 primary data records. [2025-10-15T22:37:03.234488] [DEBUG] [LOCAL ] FBK: Loaded 27411 existing records from primary storage. [2025-10-15T22:37:03.263939] [INFO ] [MAIN ] FBK: Loaded 27411 primary data records. [2025-10-15T22:37:03.549914] [DEBUG] [LOCAL ] FBP: Loaded 45728 existing records from primary storage. [2025-10-15T22:37:03.613190] [INFO ] [MAIN ] FBP: Loaded 45728 primary data records. [2025-10-15T22:37:04.157442] [DEBUG] [MAIN ] FBIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:04.158475] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50393 primary records. [2025-10-15T22:37:04.158719] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-15T22:37:04.180180] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:04.185327] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 27411 primary records. [2025-10-15T22:37:04.185703] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-15T22:37:04.199608] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-15T22:37:04.203201] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-15T22:37:04.206479] [INFO ] [MAIN ] Derivative Progress: 655/1803 symbols completed. FBIN took 1.2s. Estimated remaining: 7m 13s. Rate: 159.1 symbols/min [2025-10-15T22:37:04.206876] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:04.214221] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-15T22:37:04.214545] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-15T22:37:04.217105] [INFO ] [MAIN ] Derivative Progress: 656/1803 symbols completed. FBK took 1.1s. Estimated remaining: 7m 12s. Rate: 159.3 symbols/min [2025-10-15T22:37:04.217435] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:04.231329] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:04.232281] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45728 primary records. [2025-10-15T22:37:04.232369] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-15T22:37:04.249138] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-15T22:37:04.253555] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-15T22:37:04.256518] [INFO ] [MAIN ] Derivative Progress: 657/1803 symbols completed. FBP took 1.1s. Estimated remaining: 7m 11s. Rate: 159.5 symbols/min [2025-10-15T22:37:04.256787] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:04.274036] [DEBUG] [LOCAL ] FC: Loaded 14873 existing records from primary storage. [2025-10-15T22:37:04.274339] [INFO ] [MAIN ] FC: Loaded 14873 primary data records. [2025-10-15T22:37:04.373505] [DEBUG] [LOCAL ] FBRT: Loaded 35439 existing records from primary storage. [2025-10-15T22:37:04.391283] [INFO ] [MAIN ] FBRT: Loaded 35439 primary data records. [2025-10-15T22:37:04.535888] [DEBUG] [LOCAL ] FCN: Loaded 26052 existing records from primary storage. [2025-10-15T22:37:04.566130] [INFO ] [MAIN ] FCN: Loaded 26052 primary data records. [2025-10-15T22:37:05.296822] [DEBUG] [MAIN ] FC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:05.311156] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 14873 primary records. [2025-10-15T22:37:05.312431] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:05.313377] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 35439 primary records. [2025-10-15T22:37:05.313577] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-15T22:37:05.314319] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-15T22:37:05.348051] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-15T22:37:05.349684] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-15T22:37:05.349884] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-15T22:37:05.352025] [INFO ] [MAIN ] Derivative Progress: 658/1803 symbols completed. FC took 1.1s. Estimated remaining: 7m 12s. Rate: 159.1 symbols/min [2025-10-15T22:37:05.348947] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-15T22:37:05.367503] [INFO ] [MAIN ] Derivative Progress: 659/1803 symbols completed. FBRT took 1.2s. Estimated remaining: 7m 11s. Rate: 159.3 symbols/min [2025-10-15T22:37:05.367754] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:05.368864] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26052 primary records. [2025-10-15T22:37:05.369022] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-15T22:37:05.384689] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-15T22:37:05.384753] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-15T22:37:05.387504] [INFO ] [MAIN ] Derivative Progress: 660/1803 symbols completed. FCN took 1.1s. Estimated remaining: 7m 10s. Rate: 159.5 symbols/min [2025-10-15T22:37:05.388222] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:05.388381] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:05.388134] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:05.404799] [DEBUG] [LOCAL ] FCT: Loaded 14677 existing records from primary storage. [2025-10-15T22:37:05.404925] [INFO ] [MAIN ] FCT: Loaded 14677 primary data records. [2025-10-15T22:37:05.730149] [DEBUG] [LOCAL ] FCPT: Loaded 37344 existing records from primary storage. [2025-10-15T22:37:05.738924] [INFO ] [MAIN ] FCPT: Loaded 37344 primary data records. [2025-10-15T22:37:05.846394] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-15T22:37:05.863881] [INFO ] [MAIN ] FCX: Loaded 53701 primary data records. [2025-10-15T22:37:06.373914] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:06.376427] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14677 primary records. [2025-10-15T22:37:06.376950] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-15T22:37:06.395561] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-15T22:37:06.395817] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-15T22:37:06.398409] [INFO ] [MAIN ] Derivative Progress: 661/1803 symbols completed. FCT took 1.0s. Estimated remaining: 7m 11s. Rate: 159.1 symbols/min [2025-10-15T22:37:06.398848] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:06.416832] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:06.417570] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37344 primary records. [2025-10-15T22:37:06.417756] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-15T22:37:06.435604] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-15T22:37:06.445014] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-15T22:37:06.447300] [INFO ] [MAIN ] Derivative Progress: 662/1803 symbols completed. FCPT took 1.1s. Estimated remaining: 7m 10s. Rate: 159.3 symbols/min [2025-10-15T22:37:06.447615] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:06.461426] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:06.462284] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53701 primary records. [2025-10-15T22:37:06.462482] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-15T22:37:06.484588] [DEBUG] [LOCAL ] FDP: Loaded 29807 existing records from primary storage. [2025-10-15T22:37:06.487744] [INFO ] [MAIN ] FDP: Loaded 29807 primary data records. [2025-10-15T22:37:06.488712] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-15T22:37:06.488869] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-15T22:37:06.502867] [INFO ] [MAIN ] Derivative Progress: 663/1803 symbols completed. FCX took 1.1s. Estimated remaining: 7m 9s. Rate: 159.5 symbols/min [2025-10-15T22:37:06.512780] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:06.634020] [DEBUG] [LOCAL ] FDS: Loaded 27640 existing records from primary storage. [2025-10-15T22:37:06.662167] [INFO ] [MAIN ] FDS: Loaded 27640 primary data records. [2025-10-15T22:37:07.148034] [DEBUG] [LOCAL ] FDX: Loaded 51368 existing records from primary storage. [2025-10-15T22:37:07.148172] [INFO ] [MAIN ] FDX: Loaded 51368 primary data records. [2025-10-15T22:37:07.489479] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:07.490502] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 29807 primary records. [2025-10-15T22:37:07.491904] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-15T22:37:07.512190] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-15T22:37:07.513924] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-15T22:37:07.516487] [INFO ] [MAIN ] Derivative Progress: 664/1803 symbols completed. FDP took 1.1s. Estimated remaining: 7m 9s. Rate: 159.1 symbols/min [2025-10-15T22:37:07.516946] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:07.530112] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:07.531989] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 27640 primary records. [2025-10-15T22:37:07.532254] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-15T22:37:07.554153] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-15T22:37:07.555832] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-15T22:37:07.558607] [INFO ] [MAIN ] Derivative Progress: 665/1803 symbols completed. FDS took 1.1s. Estimated remaining: 7m 8s. Rate: 159.3 symbols/min [2025-10-15T22:37:07.558852] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:07.572306] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:07.573069] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51368 primary records. [2025-10-15T22:37:07.573222] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-15T22:37:07.591384] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-15T22:37:07.604994] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-15T22:37:07.607868] [INFO ] [MAIN ] Derivative Progress: 666/1803 symbols completed. FDX took 1.1s. Estimated remaining: 7m 8s. Rate: 159.6 symbols/min [2025-10-15T22:37:07.608296] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:07.635112] [DEBUG] [LOCAL ] FE: Loaded 53432 existing records from primary storage. [2025-10-15T22:37:07.635415] [INFO ] [MAIN ] FE: Loaded 53432 primary data records. [2025-10-15T22:37:07.651877] [DEBUG] [LOCAL ] FET: Loaded 12838 existing records from primary storage. [2025-10-15T22:37:07.661533] [INFO ] [MAIN ] FET: Loaded 12838 primary data records. [2025-10-15T22:37:07.866575] [DEBUG] [LOCAL ] FERG: Loaded 48746 existing records from primary storage. [2025-10-15T22:37:07.912563] [INFO ] [MAIN ] FERG: Loaded 48746 primary data records. [2025-10-15T22:37:08.717222] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:08.718410] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12838 primary records. [2025-10-15T22:37:08.717429] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:08.719364] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53432 primary records. [2025-10-15T22:37:08.719831] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-15T22:37:08.720709] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-15T22:37:08.752169] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-15T22:37:08.754981] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-15T22:37:08.757735] [INFO ] [MAIN ] Derivative Progress: 667/1803 symbols completed. FE took 1.2s. Estimated remaining: 7m 9s. Rate: 159.1 symbols/min [2025-10-15T22:37:08.758514] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:08.758405] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-15T22:37:08.759314] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-15T22:37:08.762466] [INFO ] [MAIN ] Derivative Progress: 668/1803 symbols completed. FET took 1.2s. Estimated remaining: 7m 7s. Rate: 159.3 symbols/min [2025-10-15T22:37:08.763181] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:08.788349] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:08.789266] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48746 primary records. [2025-10-15T22:37:08.789482] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-15T22:37:08.793317] [DEBUG] [LOCAL ] FFA: Loaded 5921 existing records from primary storage. [2025-10-15T22:37:08.794029] [INFO ] [MAIN ] FFA: Loaded 5921 primary data records. [2025-10-15T22:37:08.870969] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-15T22:37:08.871153] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-15T22:37:08.882284] [INFO ] [MAIN ] Derivative Progress: 669/1803 symbols completed. FERG took 1.3s. Estimated remaining: 7m 7s. Rate: 159.5 symbols/min [2025-10-15T22:37:08.906824] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:08.949445] [DEBUG] [LOCAL ] FF: Loaded 24337 existing records from primary storage. [2025-10-15T22:37:08.960631] [INFO ] [MAIN ] FF: Loaded 24337 primary data records. [2025-10-15T22:37:09.263241] [DEBUG] [LOCAL ] FFC: Loaded 16719 existing records from primary storage. [2025-10-15T22:37:09.278909] [INFO ] [MAIN ] FFC: Loaded 16719 primary data records. [2025-10-15T22:37:09.803746] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:09.809940] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24337 primary records. [2025-10-15T22:37:09.809011] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:09.810224] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-15T22:37:09.811089] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5921 primary records. [2025-10-15T22:37:09.811959] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-15T22:37:09.840915] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-15T22:37:09.841979] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-15T22:37:09.848364] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-15T22:37:09.848589] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-15T22:37:09.847494] [INFO ] [MAIN ] Derivative Progress: 670/1803 symbols completed. FF took 1.1s. Estimated remaining: 7m 7s. Rate: 159.1 symbols/min [2025-10-15T22:37:09.863324] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:09.863663] [INFO ] [MAIN ] Derivative Progress: 671/1803 symbols completed. FFA took 1.1s. Estimated remaining: 7m 6s. Rate: 159.3 symbols/min [2025-10-15T22:37:09.864388] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:09.864538] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:09.865385] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16719 primary records. [2025-10-15T22:37:09.865889] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-15T22:37:09.882047] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-15T22:37:09.882733] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-15T22:37:09.885431] [INFO ] [MAIN ] Derivative Progress: 672/1803 symbols completed. FFC took 1.0s. Estimated remaining: 7m 5s. Rate: 159.5 symbols/min [2025-10-15T22:37:09.885680] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:09.898140] [DEBUG] [LOCAL ] FGN: Loaded 3724 existing records from primary storage. [2025-10-15T22:37:09.906010] [INFO ] [MAIN ] FGN: Loaded 3724 primary data records. [2025-10-15T22:37:10.004076] [DEBUG] [LOCAL ] FG: Loaded 22183 existing records from primary storage. [2025-10-15T22:37:10.004699] [DEBUG] [LOCAL ] FFWM: Loaded 35915 existing records from primary storage. [2025-10-15T22:37:10.004951] [INFO ] [MAIN ] FG: Loaded 22183 primary data records. [2025-10-15T22:37:10.010230] [INFO ] [MAIN ] FFWM: Loaded 35915 primary data records. [2025-10-15T22:37:10.917333] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:10.918868] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3724 primary records. [2025-10-15T22:37:10.918095] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:10.919043] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-15T22:37:10.921854] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22183 primary records. [2025-10-15T22:37:10.931057] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-15T22:37:10.937998] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-15T22:37:10.938803] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-15T22:37:10.940891] [INFO ] [MAIN ] Derivative Progress: 673/1803 symbols completed. FGN took 1.1s. Estimated remaining: 7m 6s. Rate: 159.1 symbols/min [2025-10-15T22:37:10.964913] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:10.965887] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35915 primary records. [2025-10-15T22:37:10.965967] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-15T22:37:10.984929] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-15T22:37:10.985589] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-15T22:37:10.985728] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-15T22:37:10.985799] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-15T22:37:10.988715] [INFO ] [MAIN ] Derivative Progress: 674/1803 symbols completed. FFWM took 1.1s. Estimated remaining: 7m 5s. Rate: 159.3 symbols/min [2025-10-15T22:37:10.991691] [INFO ] [MAIN ] Derivative Progress: 675/1803 symbols completed. FG took 1.1s. Estimated remaining: 7m 4s. Rate: 159.6 symbols/min [2025-10-15T22:37:10.992126] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:10.992257] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:10.992395] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:11.042761] [DEBUG] [LOCAL ] FHI: Loaded 39897 existing records from primary storage. [2025-10-15T22:37:11.068970] [INFO ] [MAIN ] FHI: Loaded 39897 primary data records. [2025-10-15T22:37:11.201938] [DEBUG] [LOCAL ] FI: Loaded 53580 existing records from primary storage. [2025-10-15T22:37:11.208420] [INFO ] [MAIN ] FI: Loaded 53580 primary data records. [2025-10-15T22:37:11.202765] [DEBUG] [LOCAL ] FHN: Loaded 53392 existing records from primary storage. [2025-10-15T22:37:11.219877] [INFO ] [MAIN ] FHN: Loaded 53392 primary data records. [2025-10-15T22:37:12.017324] [DEBUG] [MAIN ] FHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:12.019292] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 39897 primary records. [2025-10-15T22:37:12.019390] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-15T22:37:12.047695] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:12.050676] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53580 primary records. [2025-10-15T22:37:12.051513] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-15T22:37:12.054348] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-15T22:37:12.054794] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-15T22:37:12.056786] [INFO ] [MAIN ] Derivative Progress: 676/1803 symbols completed. FHI took 1.1s. Estimated remaining: 7m 5s. Rate: 159.1 symbols/min [2025-10-15T22:37:12.075272] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:12.083031] [DEBUG] [MAIN ] FHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:12.084691] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53392 primary records. [2025-10-15T22:37:12.085359] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-15T22:37:12.095844] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-15T22:37:12.099848] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-15T22:37:12.102826] [INFO ] [MAIN ] Derivative Progress: 677/1803 symbols completed. FI took 1.1s. Estimated remaining: 7m 4s. Rate: 159.3 symbols/min [2025-10-15T22:37:12.103489] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:12.115031] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-15T22:37:12.121770] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-15T22:37:12.126022] [INFO ] [MAIN ] Derivative Progress: 678/1803 symbols completed. FHN took 1.1s. Estimated remaining: 7m 3s. Rate: 159.6 symbols/min [2025-10-15T22:37:12.126859] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:12.126753] [DEBUG] [LOCAL ] FICO: Loaded 21752 existing records from primary storage. [2025-10-15T22:37:12.127403] [INFO ] [MAIN ] FICO: Loaded 21752 primary data records. [2025-10-15T22:37:12.460977] [DEBUG] [LOCAL ] FIGS: Loaded 48583 existing records from primary storage. [2025-10-15T22:37:12.473053] [INFO ] [MAIN ] FIGS: Loaded 48583 primary data records. [2025-10-15T22:37:12.473669] [DEBUG] [LOCAL ] FIHL: Loaded 39437 existing records from primary storage. [2025-10-15T22:37:12.481539] [INFO ] [MAIN ] FIHL: Loaded 39437 primary data records. [2025-10-15T22:37:13.138952] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:37:13.141018] [INFO ] [MAIN ] FICO: Generated 1793 derivative records from 21752 primary records. [2025-10-15T22:37:13.141174] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-15T22:37:13.159127] [DEBUG] [LOCAL ] FICO: Derivative data saved (1793 records). [2025-10-15T22:37:13.159314] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-15T22:37:13.162008] [INFO ] [MAIN ] Derivative Progress: 679/1803 symbols completed. FICO took 1.1s. Estimated remaining: 7m 4s. Rate: 159.1 symbols/min [2025-10-15T22:37:13.162423] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:13.199106] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:13.199916] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:13.201603] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48583 primary records. [2025-10-15T22:37:13.200827] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39437 primary records. [2025-10-15T22:37:13.201746] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-15T22:37:13.202553] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-15T22:37:13.221988] [DEBUG] [LOCAL ] FINS: Loaded 8292 existing records from primary storage. [2025-10-15T22:37:13.224863] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-15T22:37:13.225044] [INFO ] [MAIN ] FINS: Loaded 8292 primary data records. [2025-10-15T22:37:13.261825] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-15T22:37:13.277731] [INFO ] [MAIN ] Derivative Progress: 680/1803 symbols completed. FIHL took 1.2s. Estimated remaining: 7m 3s. Rate: 159.3 symbols/min [2025-10-15T22:37:13.286037] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:13.400559] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-15T22:37:13.441469] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-15T22:37:13.557734] [INFO ] [MAIN ] Derivative Progress: 681/1803 symbols completed. FIGS took 1.5s. Estimated remaining: 7m 2s. Rate: 159.4 symbols/min [2025-10-15T22:37:13.558081] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:13.591855] [DEBUG] [LOCAL ] FINV: Loaded 45270 existing records from primary storage. [2025-10-15T22:37:13.592334] [INFO ] [MAIN ] FINV: Loaded 45270 primary data records. [2025-10-15T22:37:13.754712] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:13.797615] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8292 primary records. [2025-10-15T22:37:13.834529] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-15T22:37:13.972192] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-15T22:37:13.963720] [DEBUG] [LOCAL ] FIS: Loaded 53339 existing records from primary storage. [2025-10-15T22:37:13.972568] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-15T22:37:13.972695] [INFO ] [MAIN ] FIS: Loaded 53339 primary data records. [2025-10-15T22:37:13.974788] [INFO ] [MAIN ] Derivative Progress: 682/1803 symbols completed. FINS took 0.8s. Estimated remaining: 7m 2s. Rate: 159.3 symbols/min [2025-10-15T22:37:13.975688] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:14.294636] [DEBUG] [LOCAL ] FIX: Loaded 28800 existing records from primary storage. [2025-10-15T22:37:14.295805] [INFO ] [MAIN ] FIX: Loaded 28800 primary data records. [2025-10-15T22:37:14.331046] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:14.348591] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45270 primary records. [2025-10-15T22:37:14.406210] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-15T22:37:14.476160] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-15T22:37:14.517413] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-15T22:37:14.520907] [INFO ] [MAIN ] Derivative Progress: 683/1803 symbols completed. FINV took 1.2s. Estimated remaining: 7m 2s. Rate: 159.2 symbols/min [2025-10-15T22:37:14.655831] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:14.689056] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:14.691411] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53339 primary records. [2025-10-15T22:37:14.695169] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-15T22:37:14.695412] [DEBUG] [LOCAL ] FLC: Loaded 5420 existing records from primary storage. [2025-10-15T22:37:14.695686] [INFO ] [MAIN ] FLC: Loaded 5420 primary data records. [2025-10-15T22:37:14.834710] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-15T22:37:14.845338] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-15T22:37:14.879834] [INFO ] [MAIN ] Derivative Progress: 684/1803 symbols completed. FIS took 1.3s. Estimated remaining: 7m 2s. Rate: 159.2 symbols/min [2025-10-15T22:37:14.900793] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:15.039328] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:15.040627] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 28800 primary records. [2025-10-15T22:37:15.040869] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-15T22:37:15.059615] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-10-15T22:37:15.060096] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-15T22:37:15.062921] [INFO ] [MAIN ] Derivative Progress: 685/1803 symbols completed. FIX took 1.1s. Estimated remaining: 7m 1s. Rate: 159.4 symbols/min [2025-10-15T22:37:15.063225] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:15.095713] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:15.096358] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5420 primary records. [2025-10-15T22:37:15.096559] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-15T22:37:15.134096] [DEBUG] [LOCAL ] FLG: Loaded 53327 existing records from primary storage. [2025-10-15T22:37:15.134944] [INFO ] [MAIN ] FLG: Loaded 53327 primary data records. [2025-10-15T22:37:15.167275] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-15T22:37:15.199740] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-15T22:37:15.244724] [INFO ] [MAIN ] Derivative Progress: 686/1803 symbols completed. FLC took 0.6s. Estimated remaining: 7m 0s. Rate: 159.5 symbols/min [2025-10-15T22:37:15.248883] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:15.250105] [DEBUG] [LOCAL ] FLNG: Loaded 33712 existing records from primary storage. [2025-10-15T22:37:15.266096] [INFO ] [MAIN ] FLNG: Loaded 33712 primary data records. [2025-10-15T22:37:15.794804] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:15.795932] [DEBUG] [LOCAL ] FLO: Loaded 52082 existing records from primary storage. [2025-10-15T22:37:15.796958] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53327 primary records. [2025-10-15T22:37:15.797074] [INFO ] [MAIN ] FLO: Loaded 52082 primary data records. [2025-10-15T22:37:15.797342] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-15T22:37:15.966925] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-15T22:37:15.992013] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-15T22:37:15.994103] [INFO ] [MAIN ] Derivative Progress: 687/1803 symbols completed. FLG took 1.1s. Estimated remaining: 7m 0s. Rate: 159.3 symbols/min [2025-10-15T22:37:16.071132] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:16.134696] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:16.135919] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33712 primary records. [2025-10-15T22:37:16.136631] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-15T22:37:16.156246] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-15T22:37:16.156361] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-15T22:37:16.158834] [INFO ] [MAIN ] Derivative Progress: 688/1803 symbols completed. FLNG took 1.1s. Estimated remaining: 6m 60s. Rate: 159.4 symbols/min [2025-10-15T22:37:16.191720] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:16.192385] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 52082 primary records. [2025-10-15T22:37:16.192446] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-15T22:37:16.228083] [DEBUG] [LOCAL ] FLR: Loaded 53241 existing records from primary storage. [2025-10-15T22:37:16.229542] [INFO ] [MAIN ] FLR: Loaded 53241 primary data records. [2025-10-15T22:37:16.261809] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-15T22:37:16.273414] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-15T22:37:16.296184] [INFO ] [MAIN ] Derivative Progress: 689/1803 symbols completed. FLO took 1.0s. Estimated remaining: 6m 59s. Rate: 159.5 symbols/min [2025-10-15T22:37:16.564765] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:16.565349] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53241 primary records. [2025-10-15T22:37:16.565409] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-15T22:37:16.580129] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-15T22:37:16.580188] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-15T22:37:16.582188] [INFO ] [MAIN ] Derivative Progress: 690/1803 symbols completed. FLR took 0.5s. Estimated remaining: 6m 58s. Rate: 159.6 symbols/min [2025-10-15T22:37:16.582953] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:16.583062] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:16.583179] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:16.606386] [DEBUG] [LOCAL ] FLXR: Loaded 21029 existing records from primary storage. [2025-10-15T22:37:16.606593] [INFO ] [MAIN ] FLXR: Loaded 21029 primary data records. [2025-10-15T22:37:16.806691] [DEBUG] [LOCAL ] FLUT: Loaded 50758 existing records from primary storage. [2025-10-15T22:37:16.821959] [INFO ] [MAIN ] FLUT: Loaded 50758 primary data records. [2025-10-15T22:37:17.048800] [DEBUG] [LOCAL ] FLS: Loaded 50373 existing records from primary storage. [2025-10-15T22:37:17.067678] [INFO ] [MAIN ] FLS: Loaded 50373 primary data records. [2025-10-15T22:37:17.609593] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:17.612556] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 21029 primary records. [2025-10-15T22:37:17.613568] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-15T22:37:17.649164] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:17.650817] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-15T22:37:17.652000] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50758 primary records. [2025-10-15T22:37:17.652084] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-15T22:37:17.655218] [INFO ] [MAIN ] Derivative Progress: 691/1803 symbols completed. FLXR took 1.1s. Estimated remaining: 6m 59s. Rate: 159.2 symbols/min [2025-10-15T22:37:17.655486] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:17.656045] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-15T22:37:17.674425] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-15T22:37:17.674994] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-15T22:37:17.677880] [INFO ] [MAIN ] Derivative Progress: 692/1803 symbols completed. FLUT took 1.1s. Estimated remaining: 6m 58s. Rate: 159.4 symbols/min [2025-10-15T22:37:17.678319] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:17.709128] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:17.713009] [DEBUG] [LOCAL ] FMN: Loaded 5431 existing records from primary storage. [2025-10-15T22:37:17.714002] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50373 primary records. [2025-10-15T22:37:17.714317] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-15T22:37:17.714683] [INFO ] [MAIN ] FMN: Loaded 5431 primary data records. [2025-10-15T22:37:17.870700] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-15T22:37:17.882428] [DEBUG] [LOCAL ] FMC: Loaded 51849 existing records from primary storage. [2025-10-15T22:37:17.898327] [INFO ] [MAIN ] FMC: Loaded 51849 primary data records. [2025-10-15T22:37:17.898459] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-15T22:37:17.997275] [INFO ] [MAIN ] Derivative Progress: 693/1803 symbols completed. FLS took 1.4s. Estimated remaining: 6m 58s. Rate: 159.4 symbols/min [2025-10-15T22:37:18.134810] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:18.414230] [DEBUG] [LOCAL ] FMS: Loaded 30232 existing records from primary storage. [2025-10-15T22:37:18.414632] [INFO ] [MAIN ] FMS: Loaded 30232 primary data records. [2025-10-15T22:37:18.607114] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:18.799812] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5431 primary records. [2025-10-15T22:37:18.800563] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-15T22:37:18.820809] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-15T22:37:18.821018] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-15T22:37:18.823882] [INFO ] [MAIN ] Derivative Progress: 694/1803 symbols completed. FMN took 1.1s. Estimated remaining: 6m 58s. Rate: 159.1 symbols/min [2025-10-15T22:37:18.837353] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:18.839027] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:18.840057] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51849 primary records. [2025-10-15T22:37:18.840501] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-15T22:37:18.860381] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-15T22:37:18.860586] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-15T22:37:18.862683] [INFO ] [MAIN ] Derivative Progress: 695/1803 symbols completed. FMC took 1.2s. Estimated remaining: 6m 57s. Rate: 159.3 symbols/min [2025-10-15T22:37:18.862968] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:18.869012] [DEBUG] [LOCAL ] FMY: Loaded 1388 existing records from primary storage. [2025-10-15T22:37:18.869545] [INFO ] [MAIN ] FMY: Loaded 1388 primary data records. [2025-10-15T22:37:19.062170] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:19.068827] [DEBUG] [LOCAL ] FMX: Loaded 40547 existing records from primary storage. [2025-10-15T22:37:19.120723] [INFO ] [MAIN ] FMX: Loaded 40547 primary data records. [2025-10-15T22:37:19.141807] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30232 primary records. [2025-10-15T22:37:19.220778] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-15T22:37:19.434185] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-15T22:37:19.454481] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-15T22:37:19.462013] [INFO ] [MAIN ] Derivative Progress: 696/1803 symbols completed. FMS took 1.3s. Estimated remaining: 6m 57s. Rate: 159.2 symbols/min [2025-10-15T22:37:19.526226] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:19.618206] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:19.619055] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1388 primary records. [2025-10-15T22:37:19.619200] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-15T22:37:19.661181] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:19.660631] [DEBUG] [LOCAL ] FN: Loaded 37711 existing records from primary storage. [2025-10-15T22:37:19.662817] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40547 primary records. [2025-10-15T22:37:19.662085] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-10-15T22:37:19.663033] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-15T22:37:19.662956] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-15T22:37:19.663152] [INFO ] [MAIN ] FN: Loaded 37711 primary data records. [2025-10-15T22:37:19.665253] [INFO ] [MAIN ] Derivative Progress: 697/1803 symbols completed. FMY took 0.8s. Estimated remaining: 6m 57s. Rate: 159.3 symbols/min [2025-10-15T22:37:19.665531] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:19.786264] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-15T22:37:19.786681] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-15T22:37:19.789407] [INFO ] [MAIN ] Derivative Progress: 698/1803 symbols completed. FMX took 1.0s. Estimated remaining: 6m 56s. Rate: 159.5 symbols/min [2025-10-15T22:37:19.794885] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:20.045572] [DEBUG] [LOCAL ] FNB: Loaded 52596 existing records from primary storage. [2025-10-15T22:37:20.046607] [INFO ] [MAIN ] FNB: Loaded 52596 primary data records. [2025-10-15T22:37:20.060611] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:20.097306] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 37711 primary records. [2025-10-15T22:37:20.139578] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-15T22:37:20.184414] [DEBUG] [LOCAL ] FND: Loaded 52150 existing records from primary storage. [2025-10-15T22:37:20.216626] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-15T22:37:20.217399] [INFO ] [MAIN ] FND: Loaded 52150 primary data records. [2025-10-15T22:37:20.217322] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-15T22:37:20.243808] [INFO ] [MAIN ] Derivative Progress: 699/1803 symbols completed. FN took 0.7s. Estimated remaining: 6m 56s. Rate: 159.4 symbols/min [2025-10-15T22:37:20.289440] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:20.822216] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:20.824315] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52596 primary records. [2025-10-15T22:37:20.823268] [DEBUG] [LOCAL ] FNF: Loaded 48942 existing records from primary storage. [2025-10-15T22:37:20.824582] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-15T22:37:20.824795] [INFO ] [MAIN ] FNF: Loaded 48942 primary data records. [2025-10-15T22:37:20.871457] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-15T22:37:20.882485] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-15T22:37:20.890499] [INFO ] [MAIN ] Derivative Progress: 700/1803 symbols completed. FNB took 1.2s. Estimated remaining: 6m 56s. Rate: 159.3 symbols/min [2025-10-15T22:37:20.898365] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:20.945700] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:20.963509] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52150 primary records. [2025-10-15T22:37:20.967293] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-15T22:37:21.020271] [DEBUG] [LOCAL ] FOA: Loaded 13050 existing records from primary storage. [2025-10-15T22:37:21.046681] [INFO ] [MAIN ] FOA: Loaded 13050 primary data records. [2025-10-15T22:37:21.265181] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-15T22:37:21.270667] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-15T22:37:21.280209] [INFO ] [MAIN ] Derivative Progress: 701/1803 symbols completed. FND took 1.5s. Estimated remaining: 6m 55s. Rate: 159.2 symbols/min [2025-10-15T22:37:21.285998] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:21.509226] [DEBUG] [LOCAL ] FOF: Loaded 8595 existing records from primary storage. [2025-10-15T22:37:21.509842] [INFO ] [MAIN ] FOF: Loaded 8595 primary data records. [2025-10-15T22:37:21.849997] [DEBUG] [MAIN ] FNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:21.851538] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48942 primary records. [2025-10-15T22:37:21.851952] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-15T22:37:21.872789] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-15T22:37:21.875553] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-15T22:37:21.878102] [INFO ] [MAIN ] Derivative Progress: 702/1803 symbols completed. FNF took 1.6s. Estimated remaining: 6m 55s. Rate: 159.1 symbols/min [2025-10-15T22:37:21.878706] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:21.893955] [DEBUG] [MAIN ] FOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:21.894871] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13050 primary records. [2025-10-15T22:37:21.894982] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-15T22:37:21.913250] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-15T22:37:21.917918] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-15T22:37:21.920405] [INFO ] [MAIN ] Derivative Progress: 703/1803 symbols completed. FOA took 1.0s. Estimated remaining: 6m 54s. Rate: 159.3 symbols/min [2025-10-15T22:37:21.930372] [DEBUG] [LOCAL ] FOR: Loaded 19813 existing records from primary storage. [2025-10-15T22:37:21.931158] [INFO ] [MAIN ] FOR: Loaded 19813 primary data records. [2025-10-15T22:37:22.017160] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:22.033384] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8595 primary records. [2025-10-15T22:37:22.041325] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-15T22:37:22.114822] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-15T22:37:22.134005] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-15T22:37:22.240179] [INFO ] [MAIN ] Derivative Progress: 704/1803 symbols completed. FOF took 1.0s. Estimated remaining: 6m 54s. Rate: 159.3 symbols/min [2025-10-15T22:37:22.277620] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:22.278274] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19813 primary records. [2025-10-15T22:37:22.278337] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-15T22:37:22.294970] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-15T22:37:22.295035] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-15T22:37:22.297320] [INFO ] [MAIN ] Derivative Progress: 705/1803 symbols completed. FOR took 0.4s. Estimated remaining: 6m 53s. Rate: 159.5 symbols/min [2025-10-15T22:37:22.297735] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:22.297882] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:22.297794] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:22.332275] [DEBUG] [LOCAL ] FPH: Loaded 19325 existing records from primary storage. [2025-10-15T22:37:22.332988] [DEBUG] [LOCAL ] FPF: Loaded 18844 existing records from primary storage. [2025-10-15T22:37:22.342824] [INFO ] [MAIN ] FPF: Loaded 18844 primary data records. [2025-10-15T22:37:22.342740] [INFO ] [MAIN ] FPH: Loaded 19325 primary data records. [2025-10-15T22:37:22.577769] [DEBUG] [LOCAL ] FOUR: Loaded 49718 existing records from primary storage. [2025-10-15T22:37:22.612076] [INFO ] [MAIN ] FOUR: Loaded 49718 primary data records. [2025-10-15T22:37:23.346738] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:23.352407] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:23.353142] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18844 primary records. [2025-10-15T22:37:23.353820] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19325 primary records. [2025-10-15T22:37:23.354079] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-15T22:37:23.354541] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-15T22:37:23.389204] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-15T22:37:23.389129] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-15T22:37:23.390698] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-15T22:37:23.390116] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-15T22:37:23.393144] [INFO ] [MAIN ] Derivative Progress: 706/1803 symbols completed. FPH took 1.1s. Estimated remaining: 6m 54s. Rate: 159.1 symbols/min [2025-10-15T22:37:23.395871] [INFO ] [MAIN ] Derivative Progress: 707/1803 symbols completed. FPF took 1.1s. Estimated remaining: 6m 53s. Rate: 159.3 symbols/min [2025-10-15T22:37:23.395784] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:23.396316] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:23.411569] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:23.412442] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49718 primary records. [2025-10-15T22:37:23.412569] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-15T22:37:23.431355] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-15T22:37:23.439046] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-15T22:37:23.441622] [INFO ] [MAIN ] Derivative Progress: 708/1803 symbols completed. FOUR took 1.1s. Estimated remaining: 6m 52s. Rate: 159.5 symbols/min [2025-10-15T22:37:23.441984] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:23.468598] [DEBUG] [LOCAL ] FPI: Loaded 31359 existing records from primary storage. [2025-10-15T22:37:23.468878] [INFO ] [MAIN ] FPI: Loaded 31359 primary data records. [2025-10-15T22:37:23.538125] [DEBUG] [LOCAL ] FRA: Loaded 14294 existing records from primary storage. [2025-10-15T22:37:23.572457] [INFO ] [MAIN ] FRA: Loaded 14294 primary data records. [2025-10-15T22:37:23.640453] [DEBUG] [LOCAL ] FR: Loaded 46546 existing records from primary storage. [2025-10-15T22:37:23.721286] [INFO ] [MAIN ] FR: Loaded 46546 primary data records. [2025-10-15T22:37:24.477998] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:24.479312] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31359 primary records. [2025-10-15T22:37:24.480075] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-15T22:37:24.499729] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-15T22:37:24.500020] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-15T22:37:24.502110] [INFO ] [MAIN ] Derivative Progress: 709/1803 symbols completed. FPI took 1.1s. Estimated remaining: 6m 53s. Rate: 159.1 symbols/min [2025-10-15T22:37:24.505139] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:24.520571] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:24.522981] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46546 primary records. [2025-10-15T22:37:24.523280] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-15T22:37:24.548698] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:24.553161] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-15T22:37:24.557129] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-15T22:37:24.560475] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14294 primary records. [2025-10-15T22:37:24.560664] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-15T22:37:24.559568] [INFO ] [MAIN ] Derivative Progress: 710/1803 symbols completed. FR took 1.2s. Estimated remaining: 6m 52s. Rate: 159.3 symbols/min [2025-10-15T22:37:24.561479] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:24.583464] [DEBUG] [LOCAL ] FRGE: Loaded 16119 existing records from primary storage. [2025-10-15T22:37:24.584335] [INFO ] [MAIN ] FRGE: Loaded 16119 primary data records. [2025-10-15T22:37:24.584129] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-15T22:37:24.621343] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-15T22:37:24.674299] [INFO ] [MAIN ] Derivative Progress: 711/1803 symbols completed. FRA took 1.2s. Estimated remaining: 6m 51s. Rate: 159.5 symbols/min [2025-10-15T22:37:24.692985] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:24.968105] [DEBUG] [LOCAL ] FRO: Loaded 51696 existing records from primary storage. [2025-10-15T22:37:24.969386] [INFO ] [MAIN ] FRO: Loaded 51696 primary data records. [2025-10-15T22:37:25.082908] [DEBUG] [LOCAL ] FRT: Loaded 41709 existing records from primary storage. [2025-10-15T22:37:25.086144] [INFO ] [MAIN ] FRT: Loaded 41709 primary data records. [2025-10-15T22:37:25.605819] [DEBUG] [MAIN ] FRGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:25.607561] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 16119 primary records. [2025-10-15T22:37:25.607731] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-15T22:37:25.634512] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-15T22:37:25.634709] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-15T22:37:25.637539] [INFO ] [MAIN ] Derivative Progress: 712/1803 symbols completed. FRGE took 1.1s. Estimated remaining: 6m 51s. Rate: 159.1 symbols/min [2025-10-15T22:37:25.639215] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:25.658045] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:25.659737] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51696 primary records. [2025-10-15T22:37:25.660639] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-15T22:37:25.687282] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:25.691272] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-15T22:37:25.691444] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-15T22:37:25.689336] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41709 primary records. [2025-10-15T22:37:25.693467] [INFO ] [MAIN ] Derivative Progress: 713/1803 symbols completed. FRO took 1.1s. Estimated remaining: 6m 51s. Rate: 159.3 symbols/min [2025-10-15T22:37:25.693898] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:25.693794] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-15T22:37:25.719206] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-15T22:37:25.719481] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-15T22:37:25.721714] [INFO ] [MAIN ] Derivative Progress: 714/1803 symbols completed. FRT took 1.0s. Estimated remaining: 6m 50s. Rate: 159.5 symbols/min [2025-10-15T22:37:25.721891] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:25.735395] [DEBUG] [LOCAL ] FSCO: Loaded 38487 existing records from primary storage. [2025-10-15T22:37:25.735805] [INFO ] [MAIN ] FSCO: Loaded 38487 primary data records. [2025-10-15T22:37:26.071892] [DEBUG] [LOCAL ] FSK: Loaded 49506 existing records from primary storage. [2025-10-15T22:37:26.072504] [INFO ] [MAIN ] FSK: Loaded 49506 primary data records. [2025-10-15T22:37:26.152426] [DEBUG] [LOCAL ] FSLY: Loaded 51325 existing records from primary storage. [2025-10-15T22:37:26.170554] [INFO ] [MAIN ] FSLY: Loaded 51325 primary data records. [2025-10-15T22:37:26.757097] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:26.758270] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 38487 primary records. [2025-10-15T22:37:26.758837] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-15T22:37:26.778553] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-15T22:37:26.779574] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-15T22:37:26.783217] [INFO ] [MAIN ] Derivative Progress: 715/1803 symbols completed. FSCO took 1.1s. Estimated remaining: 6m 50s. Rate: 159.1 symbols/min [2025-10-15T22:37:26.783458] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:26.802579] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:26.803707] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49506 primary records. [2025-10-15T22:37:26.803792] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-15T22:37:26.817853] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:26.831200] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51325 primary records. [2025-10-15T22:37:26.835736] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-15T22:37:26.835604] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-15T22:37:26.836265] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-15T22:37:26.838724] [INFO ] [MAIN ] Derivative Progress: 716/1803 symbols completed. FSK took 1.1s. Estimated remaining: 6m 49s. Rate: 159.3 symbols/min [2025-10-15T22:37:26.839151] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:26.854918] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-15T22:37:26.854991] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-15T22:37:26.857092] [INFO ] [MAIN ] Derivative Progress: 717/1803 symbols completed. FSLY took 1.1s. Estimated remaining: 6m 48s. Rate: 159.5 symbols/min [2025-10-15T22:37:26.857302] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:26.881755] [DEBUG] [LOCAL ] FT: Loaded 6804 existing records from primary storage. [2025-10-15T22:37:26.881866] [INFO ] [MAIN ] FT: Loaded 6804 primary data records. [2025-10-15T22:37:27.006635] [DEBUG] [LOCAL ] FSM: Loaded 53301 existing records from primary storage. [2025-10-15T22:37:27.016506] [INFO ] [MAIN ] FSM: Loaded 53301 primary data records. [2025-10-15T22:37:27.043988] [DEBUG] [LOCAL ] FSS: Loaded 33666 existing records from primary storage. [2025-10-15T22:37:27.151411] [INFO ] [MAIN ] FSS: Loaded 33666 primary data records. [2025-10-15T22:37:27.824333] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:27.825367] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6804 primary records. [2025-10-15T22:37:27.826872] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-15T22:37:27.845160] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-15T22:37:27.845294] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-15T22:37:27.847621] [INFO ] [MAIN ] Derivative Progress: 718/1803 symbols completed. FT took 1.0s. Estimated remaining: 6m 49s. Rate: 159.2 symbols/min [2025-10-15T22:37:27.861949] [DEBUG] [MAIN ] FSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:27.862859] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53301 primary records. [2025-10-15T22:37:27.863201] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-15T22:37:27.897668] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:27.898200] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-15T22:37:27.899196] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33666 primary records. [2025-10-15T22:37:27.899292] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-15T22:37:27.898429] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-15T22:37:27.901958] [INFO ] [MAIN ] Derivative Progress: 719/1803 symbols completed. FSM took 1.1s. Estimated remaining: 6m 48s. Rate: 159.3 symbols/min [2025-10-15T22:37:27.917738] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-15T22:37:27.917820] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-15T22:37:27.920214] [INFO ] [MAIN ] Derivative Progress: 720/1803 symbols completed. FSS took 1.1s. Estimated remaining: 6m 47s. Rate: 159.6 symbols/min [2025-10-15T22:37:27.920914] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:27.921028] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:27.921145] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:27.939906] [DEBUG] [LOCAL ] FTHY: Loaded 12336 existing records from primary storage. [2025-10-15T22:37:27.948129] [INFO ] [MAIN ] FTHY: Loaded 12336 primary data records. [2025-10-15T22:37:28.094102] [DEBUG] [LOCAL ] FTK: Loaded 32908 existing records from primary storage. [2025-10-15T22:37:28.098394] [INFO ] [MAIN ] FTK: Loaded 32908 primary data records. [2025-10-15T22:37:28.286825] [DEBUG] [LOCAL ] FTI: Loaded 53296 existing records from primary storage. [2025-10-15T22:37:28.286963] [INFO ] [MAIN ] FTI: Loaded 53296 primary data records. [2025-10-15T22:37:29.002890] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:29.009509] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12336 primary records. [2025-10-15T22:37:29.008681] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:29.009618] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-15T22:37:29.010716] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32908 primary records. [2025-10-15T22:37:29.012611] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-15T22:37:29.031067] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-15T22:37:29.039463] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-15T22:37:29.049100] [INFO ] [MAIN ] Derivative Progress: 721/1803 symbols completed. FTHY took 1.1s. Estimated remaining: 6m 48s. Rate: 159.1 symbols/min [2025-10-15T22:37:29.049365] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:29.062600] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-15T22:37:29.062890] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:29.063146] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-15T22:37:29.065623] [INFO ] [MAIN ] Derivative Progress: 722/1803 symbols completed. FTK took 1.1s. Estimated remaining: 6m 47s. Rate: 159.3 symbols/min [2025-10-15T22:37:29.066690] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:29.066519] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53296 primary records. [2025-10-15T22:37:29.067049] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-15T22:37:29.083715] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-15T22:37:29.083900] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-15T22:37:29.086344] [INFO ] [MAIN ] Derivative Progress: 723/1803 symbols completed. FTI took 1.2s. Estimated remaining: 6m 46s. Rate: 159.5 symbols/min [2025-10-15T22:37:29.086541] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:29.091608] [DEBUG] [LOCAL ] FTWO: Loaded 1915 existing records from primary storage. [2025-10-15T22:37:29.091883] [INFO ] [MAIN ] FTWO: Loaded 1915 primary data records. [2025-10-15T22:37:29.304585] [DEBUG] [LOCAL ] FTS: Loaded 42538 existing records from primary storage. [2025-10-15T22:37:29.416325] [INFO ] [MAIN ] FTS: Loaded 42538 primary data records. [2025-10-15T22:37:29.516561] [DEBUG] [LOCAL ] FTV: Loaded 53067 existing records from primary storage. [2025-10-15T22:37:29.534298] [INFO ] [MAIN ] FTV: Loaded 53067 primary data records. [2025-10-15T22:37:30.020335] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:37:30.021757] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1915 primary records. [2025-10-15T22:37:30.022460] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-15T22:37:30.172167] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-15T22:37:30.172608] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-15T22:37:30.174975] [INFO ] [MAIN ] Derivative Progress: 724/1803 symbols completed. FTWO took 1.1s. Estimated remaining: 6m 47s. Rate: 159.1 symbols/min [2025-10-15T22:37:30.176162] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:30.210200] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:30.211317] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42538 primary records. [2025-10-15T22:37:30.211561] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-15T22:37:30.228613] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-15T22:37:30.228875] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-15T22:37:30.230794] [INFO ] [MAIN ] Derivative Progress: 725/1803 symbols completed. FTS took 1.2s. Estimated remaining: 6m 46s. Rate: 159.3 symbols/min [2025-10-15T22:37:30.232260] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:30.267193] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:30.268256] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 53067 primary records. [2025-10-15T22:37:30.268403] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-15T22:37:30.307106] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-15T22:37:30.308214] [INFO ] [MAIN ] FUBO: Loaded 53718 primary data records. [2025-10-15T22:37:30.319871] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-15T22:37:30.362938] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-15T22:37:30.417572] [INFO ] [MAIN ] Derivative Progress: 726/1803 symbols completed. FTV took 1.4s. Estimated remaining: 6m 45s. Rate: 159.4 symbols/min [2025-10-15T22:37:30.420992] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:30.422349] [DEBUG] [LOCAL ] FUL: Loaded 32393 existing records from primary storage. [2025-10-15T22:37:30.439680] [INFO ] [MAIN ] FUL: Loaded 32393 primary data records. [2025-10-15T22:37:30.979807] [DEBUG] [LOCAL ] FUN: Loaded 51916 existing records from primary storage. [2025-10-15T22:37:30.980064] [INFO ] [MAIN ] FUN: Loaded 51916 primary data records. [2025-10-15T22:37:31.418516] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:31.592498] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53718 primary records. [2025-10-15T22:37:31.593135] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-15T22:37:31.614031] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-15T22:37:31.614840] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-15T22:37:31.619477] [INFO ] [MAIN ] Derivative Progress: 727/1803 symbols completed. FUBO took 1.4s. Estimated remaining: 6m 46s. Rate: 158.9 symbols/min [2025-10-15T22:37:31.620094] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:31.635910] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:31.637588] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32393 primary records. [2025-10-15T22:37:31.638619] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-15T22:37:31.663637] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-15T22:37:31.664086] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-15T22:37:31.666724] [INFO ] [MAIN ] Derivative Progress: 728/1803 symbols completed. FUL took 1.4s. Estimated remaining: 6m 45s. Rate: 159.1 symbols/min [2025-10-15T22:37:31.667065] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:31.681985] [DEBUG] [LOCAL ] FVR: Loaded 21190 existing records from primary storage. [2025-10-15T22:37:31.682602] [INFO ] [MAIN ] FVR: Loaded 21190 primary data records. [2025-10-15T22:37:31.711828] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:31.740891] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51916 primary records. [2025-10-15T22:37:31.775145] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-15T22:37:31.912063] [DEBUG] [LOCAL ] FVRR: Loaded 40631 existing records from primary storage. [2025-10-15T22:37:31.903986] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-15T22:37:31.937949] [INFO ] [MAIN ] FVRR: Loaded 40631 primary data records. [2025-10-15T22:37:31.938091] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-15T22:37:32.080140] [INFO ] [MAIN ] Derivative Progress: 729/1803 symbols completed. FUN took 1.7s. Estimated remaining: 6m 45s. Rate: 159.1 symbols/min [2025-10-15T22:37:32.096274] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:32.171115] [DEBUG] [LOCAL ] FXED: Loaded 1246 existing records from primary storage. [2025-10-15T22:37:32.171825] [INFO ] [MAIN ] FXED: Loaded 1246 primary data records. [2025-10-15T22:37:32.677114] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:32.678520] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21190 primary records. [2025-10-15T22:37:32.679118] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-15T22:37:32.696306] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-15T22:37:32.696700] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-15T22:37:32.698793] [INFO ] [MAIN ] Derivative Progress: 730/1803 symbols completed. FVR took 1.1s. Estimated remaining: 6m 45s. Rate: 159.0 symbols/min [2025-10-15T22:37:32.699204] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:32.717114] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:32.718283] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40631 primary records. [2025-10-15T22:37:32.718393] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-15T22:37:32.748332] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:32.751034] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-15T22:37:32.752057] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-15T22:37:32.751911] [INFO ] [MAIN ] FXED: Generated 1794 derivative records from 1246 primary records. [2025-10-15T22:37:32.754265] [INFO ] [MAIN ] Derivative Progress: 731/1803 symbols completed. FVRR took 1.1s. Estimated remaining: 6m 44s. Rate: 159.1 symbols/min [2025-10-15T22:37:32.754475] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-15T22:37:32.755075] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:32.780186] [DEBUG] [LOCAL ] FXED: Derivative data saved (1794 records). [2025-10-15T22:37:32.780311] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-15T22:37:32.782713] [INFO ] [MAIN ] Derivative Progress: 732/1803 symbols completed. FXED took 0.7s. Estimated remaining: 6m 43s. Rate: 159.3 symbols/min [2025-10-15T22:37:32.783012] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:32.801212] [DEBUG] [LOCAL ] G: Loaded 50051 existing records from primary storage. [2025-10-15T22:37:32.809247] [INFO ] [MAIN ] G: Loaded 50051 primary data records. [2025-10-15T22:37:32.811910] [DEBUG] [LOCAL ] GAM: Loaded 3926 existing records from primary storage. [2025-10-15T22:37:32.842551] [INFO ] [MAIN ] GAM: Loaded 3926 primary data records. [2025-10-15T22:37:32.939625] [DEBUG] [LOCAL ] GAB: Loaded 27709 existing records from primary storage. [2025-10-15T22:37:32.972149] [INFO ] [MAIN ] GAB: Loaded 27709 primary data records. [2025-10-15T22:37:33.836984] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:33.837488] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:33.837825] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:33.839450] [INFO ] [MAIN ] G: Generated 1794 derivative records from 50051 primary records. [2025-10-15T22:37:33.840160] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 3926 primary records. [2025-10-15T22:37:33.840356] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-15T22:37:33.840272] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-15T22:37:33.838720] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27709 primary records. [2025-10-15T22:37:33.840526] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-15T22:37:33.871747] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-15T22:37:33.871906] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-15T22:37:33.874879] [INFO ] [MAIN ] Derivative Progress: 733/1803 symbols completed. GAM took 1.1s. Estimated remaining: 6m 44s. Rate: 158.9 symbols/min [2025-10-15T22:37:33.887038] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-15T22:37:33.889064] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-15T22:37:33.891741] [INFO ] [MAIN ] Derivative Progress: 734/1803 symbols completed. G took 1.2s. Estimated remaining: 6m 43s. Rate: 159.1 symbols/min [2025-10-15T22:37:33.892602] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-15T22:37:33.892700] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-15T22:37:33.895191] [INFO ] [MAIN ] Derivative Progress: 735/1803 symbols completed. GAB took 1.1s. Estimated remaining: 6m 42s. Rate: 159.4 symbols/min [2025-10-15T22:37:33.895596] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:33.895903] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:33.895779] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:33.916701] [DEBUG] [LOCAL ] GBAB: Loaded 12868 existing records from primary storage. [2025-10-15T22:37:33.916871] [INFO ] [MAIN ] GBAB: Loaded 12868 primary data records. [2025-10-15T22:37:33.995178] [DEBUG] [LOCAL ] GATX: Loaded 18079 existing records from primary storage. [2025-10-15T22:37:34.006861] [INFO ] [MAIN ] GATX: Loaded 18079 primary data records. [2025-10-15T22:37:34.448176] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-15T22:37:34.562801] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-15T22:37:34.955701] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:34.957026] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 12868 primary records. [2025-10-15T22:37:34.959244] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-15T22:37:34.988548] [DEBUG] [MAIN ] GATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:34.990608] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18079 primary records. [2025-10-15T22:37:34.991250] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-15T22:37:35.003533] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-15T22:37:35.006691] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-15T22:37:35.009013] [INFO ] [MAIN ] Derivative Progress: 736/1803 symbols completed. GBAB took 1.1s. Estimated remaining: 6m 43s. Rate: 158.9 symbols/min [2025-10-15T22:37:35.009501] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:35.011198] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-15T22:37:35.011281] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-15T22:37:35.013516] [INFO ] [MAIN ] Derivative Progress: 737/1803 symbols completed. GATX took 1.1s. Estimated remaining: 6m 42s. Rate: 159.1 symbols/min [2025-10-15T22:37:35.013882] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:35.029915] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:35.030513] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-15T22:37:35.030573] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-15T22:37:35.046583] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-15T22:37:35.046781] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-15T22:37:35.049364] [INFO ] [MAIN ] Derivative Progress: 738/1803 symbols completed. GAP took 1.2s. Estimated remaining: 6m 41s. Rate: 159.3 symbols/min [2025-10-15T22:37:35.049677] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:35.097928] [DEBUG] [LOCAL ] GBTG: Loaded 40255 existing records from primary storage. [2025-10-15T22:37:35.110069] [INFO ] [MAIN ] GBTG: Loaded 40255 primary data records. [2025-10-15T22:37:35.110796] [DEBUG] [LOCAL ] GBCI: Loaded 40856 existing records from primary storage. [2025-10-15T22:37:35.122870] [INFO ] [MAIN ] GBCI: Loaded 40856 primary data records. [2025-10-15T22:37:35.211746] [DEBUG] [LOCAL ] GBX: Loaded 28929 existing records from primary storage. [2025-10-15T22:37:35.308738] [INFO ] [MAIN ] GBX: Loaded 28929 primary data records. [2025-10-15T22:37:36.084241] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:36.084752] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:36.085967] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40255 primary records. [2025-10-15T22:37:36.086778] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40856 primary records. [2025-10-15T22:37:36.087133] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-15T22:37:36.086946] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-15T22:37:36.127334] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-15T22:37:36.134255] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-15T22:37:36.134158] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-15T22:37:36.136823] [INFO ] [MAIN ] Derivative Progress: 739/1803 symbols completed. GBCI took 1.1s. Estimated remaining: 6m 42s. Rate: 158.9 symbols/min [2025-10-15T22:37:36.137561] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-15T22:37:36.137319] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:36.137783] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:36.141023] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 28929 primary records. [2025-10-15T22:37:36.140212] [INFO ] [MAIN ] Derivative Progress: 740/1803 symbols completed. GBTG took 1.1s. Estimated remaining: 6m 41s. Rate: 159.2 symbols/min [2025-10-15T22:37:36.141195] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-15T22:37:36.141974] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:36.158996] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-15T22:37:36.159066] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-15T22:37:36.161724] [INFO ] [MAIN ] Derivative Progress: 741/1803 symbols completed. GBX took 1.1s. Estimated remaining: 6m 40s. Rate: 159.4 symbols/min [2025-10-15T22:37:36.161918] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:36.196666] [DEBUG] [LOCAL ] GCO: Loaded 23651 existing records from primary storage. [2025-10-15T22:37:36.196883] [INFO ] [MAIN ] GCO: Loaded 23651 primary data records. [2025-10-15T22:37:36.258075] [DEBUG] [LOCAL ] GCTS: Loaded 20465 existing records from primary storage. [2025-10-15T22:37:36.277448] [INFO ] [MAIN ] GCTS: Loaded 20465 primary data records. [2025-10-15T22:37:36.299725] [DEBUG] [LOCAL ] GCI: Loaded 43878 existing records from primary storage. [2025-10-15T22:37:36.358094] [INFO ] [MAIN ] GCI: Loaded 43878 primary data records. [2025-10-15T22:37:37.227442] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:37.228769] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 23651 primary records. [2025-10-15T22:37:37.229412] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-15T22:37:37.250885] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-10-15T22:37:37.253086] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-15T22:37:37.255880] [INFO ] [MAIN ] Derivative Progress: 742/1803 symbols completed. GCO took 1.1s. Estimated remaining: 6m 41s. Rate: 158.9 symbols/min [2025-10-15T22:37:37.264214] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:37.269396] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:37.278458] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20465 primary records. [2025-10-15T22:37:37.283470] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-15T22:37:37.284468] [DEBUG] [MAIN ] GCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:37.285718] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 43878 primary records. [2025-10-15T22:37:37.286060] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-15T22:37:37.311394] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-15T22:37:37.311572] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-15T22:37:37.322360] [INFO ] [MAIN ] Derivative Progress: 743/1803 symbols completed. GCTS took 1.2s. Estimated remaining: 6m 40s. Rate: 159.1 symbols/min [2025-10-15T22:37:37.323011] [DEBUG] [LOCAL ] GCV: Loaded 7804 existing records from primary storage. [2025-10-15T22:37:37.326235] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:37.327905] [INFO ] [MAIN ] GCV: Loaded 7804 primary data records. [2025-10-15T22:37:37.333233] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-15T22:37:37.333444] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-15T22:37:37.337310] [INFO ] [MAIN ] Derivative Progress: 744/1803 symbols completed. GCI took 1.2s. Estimated remaining: 6m 39s. Rate: 159.3 symbols/min [2025-10-15T22:37:37.364453] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:37.680800] [DEBUG] [LOCAL ] GD: Loaded 46735 existing records from primary storage. [2025-10-15T22:37:37.681454] [INFO ] [MAIN ] GD: Loaded 46735 primary data records. [2025-10-15T22:37:37.801415] [DEBUG] [LOCAL ] GDDY: Loaded 49776 existing records from primary storage. [2025-10-15T22:37:37.807405] [INFO ] [MAIN ] GDDY: Loaded 49776 primary data records. [2025-10-15T22:37:38.315946] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:38.317258] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7804 primary records. [2025-10-15T22:37:38.318137] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-15T22:37:38.338721] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-15T22:37:38.339272] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-15T22:37:38.342147] [INFO ] [MAIN ] Derivative Progress: 745/1803 symbols completed. GCV took 1.1s. Estimated remaining: 6m 39s. Rate: 159.0 symbols/min [2025-10-15T22:37:38.342559] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:38.358843] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:38.359607] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46735 primary records. [2025-10-15T22:37:38.361204] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-15T22:37:38.365459] [DEBUG] [LOCAL ] GDIV: Loaded 3598 existing records from primary storage. [2025-10-15T22:37:38.377173] [INFO ] [MAIN ] GDIV: Loaded 3598 primary data records. [2025-10-15T22:37:38.503286] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-15T22:37:38.507792] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:38.507325] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-15T22:37:38.511559] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49776 primary records. [2025-10-15T22:37:38.510501] [INFO ] [MAIN ] Derivative Progress: 746/1803 symbols completed. GD took 1.2s. Estimated remaining: 6m 39s. Rate: 159.1 symbols/min [2025-10-15T22:37:38.512338] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:38.512182] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-15T22:37:38.728188] [DEBUG] [LOCAL ] GDL: Loaded 2523 existing records from primary storage. [2025-10-15T22:37:38.730757] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-15T22:37:38.730870] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-15T22:37:38.733424] [INFO ] [MAIN ] GDL: Loaded 2523 primary data records. [2025-10-15T22:37:38.733321] [INFO ] [MAIN ] Derivative Progress: 747/1803 symbols completed. GDDY took 1.4s. Estimated remaining: 6m 38s. Rate: 159.2 symbols/min [2025-10-15T22:37:38.733820] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:38.846778] [DEBUG] [LOCAL ] GDO: Loaded 5849 existing records from primary storage. [2025-10-15T22:37:38.848261] [INFO ] [MAIN ] GDO: Loaded 5849 primary data records. [2025-10-15T22:37:39.462440] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:37:39.464210] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3598 primary records. [2025-10-15T22:37:39.464469] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-15T22:37:39.491791] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-10-15T22:37:39.492253] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-15T22:37:39.494339] [INFO ] [MAIN ] Derivative Progress: 748/1803 symbols completed. GDIV took 1.2s. Estimated remaining: 6m 38s. Rate: 159.0 symbols/min [2025-10-15T22:37:39.513623] [DEBUG] [MAIN ] GDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:39.514686] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2523 primary records. [2025-10-15T22:37:39.514789] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-15T22:37:39.530878] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-10-15T22:37:39.531047] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-15T22:37:39.533343] [INFO ] [MAIN ] Derivative Progress: 749/1803 symbols completed. GDL took 1.0s. Estimated remaining: 6m 37s. Rate: 159.2 symbols/min [2025-10-15T22:37:39.546332] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:39.547012] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5849 primary records. [2025-10-15T22:37:39.547076] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-15T22:37:39.561496] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-15T22:37:39.561606] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-15T22:37:39.563954] [INFO ] [MAIN ] Derivative Progress: 750/1803 symbols completed. GDO took 0.8s. Estimated remaining: 6m 36s. Rate: 159.3 symbols/min [2025-10-15T22:37:39.564452] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:39.564567] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:39.565076] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:39.587444] [DEBUG] [LOCAL ] GDV: Loaded 19531 existing records from primary storage. [2025-10-15T22:37:39.587582] [INFO ] [MAIN ] GDV: Loaded 19531 primary data records. [2025-10-15T22:37:39.725341] [DEBUG] [LOCAL ] GDOT: Loaded 37755 existing records from primary storage. [2025-10-15T22:37:39.803950] [INFO ] [MAIN ] GDOT: Loaded 37755 primary data records. [2025-10-15T22:37:40.057719] [DEBUG] [LOCAL ] GE: Loaded 53699 existing records from primary storage. [2025-10-15T22:37:40.058483] [INFO ] [MAIN ] GE: Loaded 53699 primary data records. [2025-10-15T22:37:40.567907] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:40.569279] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19531 primary records. [2025-10-15T22:37:40.569697] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-15T22:37:40.589437] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-15T22:37:40.591147] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-15T22:37:40.593422] [INFO ] [MAIN ] Derivative Progress: 751/1803 symbols completed. GDV took 1.0s. Estimated remaining: 6m 37s. Rate: 159.0 symbols/min [2025-10-15T22:37:40.593566] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:40.610718] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:40.611452] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37755 primary records. [2025-10-15T22:37:40.611720] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-15T22:37:40.635444] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-15T22:37:40.635585] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-15T22:37:40.637872] [INFO ] [MAIN ] Derivative Progress: 752/1803 symbols completed. GDOT took 1.1s. Estimated remaining: 6m 36s. Rate: 159.2 symbols/min [2025-10-15T22:37:40.638097] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:40.652586] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:40.659560] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53699 primary records. [2025-10-15T22:37:40.659959] [DEBUG] [LOCAL ] GEF: Loaded 20790 existing records from primary storage. [2025-10-15T22:37:40.660060] [INFO ] [MAIN ] GEF: Loaded 20790 primary data records. [2025-10-15T22:37:40.665692] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-15T22:37:40.784913] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-15T22:37:40.795554] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-15T22:37:40.813406] [INFO ] [MAIN ] Derivative Progress: 753/1803 symbols completed. GE took 1.2s. Estimated remaining: 6m 36s. Rate: 159.3 symbols/min [2025-10-15T22:37:40.865364] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:41.021347] [DEBUG] [LOCAL ] GEL: Loaded 31836 existing records from primary storage. [2025-10-15T22:37:41.021633] [INFO ] [MAIN ] GEL: Loaded 31836 primary data records. [2025-10-15T22:37:41.362867] [DEBUG] [LOCAL ] GENI: Loaded 52942 existing records from primary storage. [2025-10-15T22:37:41.363279] [INFO ] [MAIN ] GENI: Loaded 52942 primary data records. [2025-10-15T22:37:41.689335] [DEBUG] [MAIN ] GEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:41.691092] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20790 primary records. [2025-10-15T22:37:41.692116] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-15T22:37:41.713059] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-15T22:37:41.713485] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-15T22:37:41.715908] [INFO ] [MAIN ] Derivative Progress: 754/1803 symbols completed. GEF took 1.1s. Estimated remaining: 6m 36s. Rate: 159.0 symbols/min [2025-10-15T22:37:41.716127] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:41.730007] [DEBUG] [MAIN ] GEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:41.730676] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 31836 primary records. [2025-10-15T22:37:41.730848] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-15T22:37:41.751011] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-15T22:37:41.751372] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-15T22:37:41.767677] [INFO ] [MAIN ] Derivative Progress: 755/1803 symbols completed. GEL took 1.1s. Estimated remaining: 6m 35s. Rate: 159.2 symbols/min [2025-10-15T22:37:41.768394] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:41.769677] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52942 primary records. [2025-10-15T22:37:41.769909] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-15T22:37:41.769851] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:41.805682] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-15T22:37:41.805927] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-15T22:37:41.808869] [INFO ] [MAIN ] Derivative Progress: 756/1803 symbols completed. GENI took 0.9s. Estimated remaining: 6m 34s. Rate: 159.4 symbols/min [2025-10-15T22:37:41.809343] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:41.841390] [DEBUG] [LOCAL ] GEO: Loaded 51820 existing records from primary storage. [2025-10-15T22:37:41.841866] [INFO ] [MAIN ] GEO: Loaded 51820 primary data records. [2025-10-15T22:37:41.970294] [DEBUG] [LOCAL ] GES: Loaded 38288 existing records from primary storage. [2025-10-15T22:37:41.991812] [INFO ] [MAIN ] GES: Loaded 38288 primary data records. [2025-10-15T22:37:42.128464] [DEBUG] [LOCAL ] GETY: Loaded 34990 existing records from primary storage. [2025-10-15T22:37:42.145434] [INFO ] [MAIN ] GETY: Loaded 34990 primary data records. [2025-10-15T22:37:42.801512] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:42.802517] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51820 primary records. [2025-10-15T22:37:42.802877] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-15T22:37:42.838755] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-15T22:37:42.838156] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:42.839811] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-15T22:37:42.839730] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 38288 primary records. [2025-10-15T22:37:42.842529] [INFO ] [MAIN ] Derivative Progress: 757/1803 symbols completed. GEO took 1.1s. Estimated remaining: 6m 35s. Rate: 159.0 symbols/min [2025-10-15T22:37:42.839933] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-15T22:37:42.844013] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:42.862874] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-15T22:37:42.870861] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-15T22:37:42.878917] [DEBUG] [MAIN ] GETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:42.879752] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 34990 primary records. [2025-10-15T22:37:42.879923] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-15T22:37:42.878490] [INFO ] [MAIN ] Derivative Progress: 758/1803 symbols completed. GES took 1.1s. Estimated remaining: 6m 34s. Rate: 159.2 symbols/min [2025-10-15T22:37:42.880460] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:42.900972] [DEBUG] [LOCAL ] GF: Loaded 2697 existing records from primary storage. [2025-10-15T22:37:42.901796] [INFO ] [MAIN ] GF: Loaded 2697 primary data records. [2025-10-15T22:37:42.934201] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-15T22:37:42.946137] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-15T22:37:42.954259] [INFO ] [MAIN ] Derivative Progress: 759/1803 symbols completed. GETY took 1.1s. Estimated remaining: 6m 33s. Rate: 159.3 symbols/min [2025-10-15T22:37:42.961969] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:43.237580] [DEBUG] [LOCAL ] GEV: Loaded 53000 existing records from primary storage. [2025-10-15T22:37:43.259279] [INFO ] [MAIN ] GEV: Loaded 53000 primary data records. [2025-10-15T22:37:43.360945] [DEBUG] [LOCAL ] GFF: Loaded 30002 existing records from primary storage. [2025-10-15T22:37:43.372314] [INFO ] [MAIN ] GFF: Loaded 30002 primary data records. [2025-10-15T22:37:43.896579] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:43.899014] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2697 primary records. [2025-10-15T22:37:43.899771] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-15T22:37:43.914809] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-15T22:37:43.914893] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-15T22:37:43.916915] [INFO ] [MAIN ] Derivative Progress: 760/1803 symbols completed. GF took 1.0s. Estimated remaining: 6m 34s. Rate: 159.0 symbols/min [2025-10-15T22:37:43.917410] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:43.936492] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:43.937460] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53000 primary records. [2025-10-15T22:37:43.937725] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-15T22:37:43.956592] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-15T22:37:43.956876] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-15T22:37:43.959922] [INFO ] [MAIN ] Derivative Progress: 761/1803 symbols completed. GEV took 1.1s. Estimated remaining: 6m 33s. Rate: 159.2 symbols/min [2025-10-15T22:37:43.960425] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:43.973762] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:43.974370] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30002 primary records. [2025-10-15T22:37:43.974429] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-15T22:37:44.006353] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-15T22:37:44.006576] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-15T22:37:44.009050] [INFO ] [MAIN ] Derivative Progress: 762/1803 symbols completed. GFF took 1.0s. Estimated remaining: 6m 32s. Rate: 159.4 symbols/min [2025-10-15T22:37:44.009315] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:44.032837] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-15T22:37:44.033196] [INFO ] [MAIN ] GFI: Loaded 53116 primary data records. [2025-10-15T22:37:44.197587] [DEBUG] [LOCAL ] GFL: Loaded 47671 existing records from primary storage. [2025-10-15T22:37:44.203035] [INFO ] [MAIN ] GFL: Loaded 47671 primary data records. [2025-10-15T22:37:44.494606] [DEBUG] [LOCAL ] GGB: Loaded 51471 existing records from primary storage. [2025-10-15T22:37:44.501246] [INFO ] [MAIN ] GGB: Loaded 51471 primary data records. [2025-10-15T22:37:45.084695] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:45.097816] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53116 primary records. [2025-10-15T22:37:45.098537] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:45.099880] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-15T22:37:45.099798] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47671 primary records. [2025-10-15T22:37:45.101151] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-15T22:37:45.129105] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-15T22:37:45.131153] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-15T22:37:45.133099] [INFO ] [MAIN ] Derivative Progress: 763/1803 symbols completed. GFL took 1.2s. Estimated remaining: 6m 33s. Rate: 159.0 symbols/min [2025-10-15T22:37:45.134748] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-15T22:37:45.134832] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-15T22:37:45.137952] [INFO ] [MAIN ] Derivative Progress: 764/1803 symbols completed. GFI took 1.2s. Estimated remaining: 6m 32s. Rate: 159.2 symbols/min [2025-10-15T22:37:45.151229] [DEBUG] [MAIN ] GGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:45.151885] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51471 primary records. [2025-10-15T22:37:45.151947] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-15T22:37:45.167135] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-15T22:37:45.167197] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-15T22:37:45.170702] [INFO ] [MAIN ] Derivative Progress: 765/1803 symbols completed. GGB took 1.2s. Estimated remaining: 6m 31s. Rate: 159.4 symbols/min [2025-10-15T22:37:45.171092] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:45.171158] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:45.171436] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:45.177567] [DEBUG] [LOCAL ] GGZ: Loaded 2401 existing records from primary storage. [2025-10-15T22:37:45.177811] [INFO ] [MAIN ] GGZ: Loaded 2401 primary data records. [2025-10-15T22:37:45.287816] [DEBUG] [LOCAL ] GGT: Loaded 14408 existing records from primary storage. [2025-10-15T22:37:45.318521] [INFO ] [MAIN ] GGT: Loaded 14408 primary data records. [2025-10-15T22:37:45.595134] [DEBUG] [LOCAL ] GGG: Loaded 40679 existing records from primary storage. [2025-10-15T22:37:45.599333] [INFO ] [MAIN ] GGG: Loaded 40679 primary data records. [2025-10-15T22:37:46.131308] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:46.132394] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2401 primary records. [2025-10-15T22:37:46.134572] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-15T22:37:46.162597] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-15T22:37:46.163312] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:46.163057] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-15T22:37:46.165691] [INFO ] [MAIN ] Derivative Progress: 766/1803 symbols completed. GGZ took 1.0s. Estimated remaining: 6m 31s. Rate: 159.0 symbols/min [2025-10-15T22:37:46.166626] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14408 primary records. [2025-10-15T22:37:46.165884] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:46.166911] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-15T22:37:46.183484] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-15T22:37:46.183671] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-15T22:37:46.186090] [INFO ] [MAIN ] Derivative Progress: 767/1803 symbols completed. GGT took 1.0s. Estimated remaining: 6m 30s. Rate: 159.2 symbols/min [2025-10-15T22:37:46.186261] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:46.189802] [DEBUG] [LOCAL ] GHC: Loaded 2926 existing records from primary storage. [2025-10-15T22:37:46.189961] [INFO ] [MAIN ] GHC: Loaded 2926 primary data records. [2025-10-15T22:37:46.249454] [DEBUG] [LOCAL ] GHG: Loaded 3296 existing records from primary storage. [2025-10-15T22:37:46.263474] [INFO ] [MAIN ] GHG: Loaded 3296 primary data records. [2025-10-15T22:37:46.376753] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:46.389355] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40679 primary records. [2025-10-15T22:37:46.415638] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-15T22:37:46.484488] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-15T22:37:46.503386] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-15T22:37:46.562584] [INFO ] [MAIN ] Derivative Progress: 768/1803 symbols completed. GGG took 1.4s. Estimated remaining: 6m 30s. Rate: 159.2 symbols/min [2025-10-15T22:37:46.583732] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:46.865062] [DEBUG] [LOCAL ] GHI: Loaded 7364 existing records from primary storage. [2025-10-15T22:37:46.866823] [INFO ] [MAIN ] GHI: Loaded 7364 primary data records. [2025-10-15T22:37:47.182875] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:37:47.184915] [INFO ] [MAIN ] GHC: Generated 1793 derivative records from 2926 primary records. [2025-10-15T22:37:47.186097] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-15T22:37:47.213425] [DEBUG] [LOCAL ] GHC: Derivative data saved (1793 records). [2025-10-15T22:37:47.213914] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-15T22:37:47.216072] [INFO ] [MAIN ] Derivative Progress: 769/1803 symbols completed. GHC took 1.1s. Estimated remaining: 6m 30s. Rate: 159.1 symbols/min [2025-10-15T22:37:47.216223] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:47.213828] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:47.217948] [INFO ] [MAIN ] GHG: Generated 1794 derivative records from 3296 primary records. [2025-10-15T22:37:47.218762] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-15T22:37:47.237919] [DEBUG] [LOCAL ] GHG: Derivative data saved (1794 records). [2025-10-15T22:37:47.238144] [DEBUG] [LOCAL ] GHLD: Loaded 4222 existing records from primary storage. [2025-10-15T22:37:47.238382] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-15T22:37:47.240833] [INFO ] [MAIN ] Derivative Progress: 770/1803 symbols completed. GHG took 1.1s. Estimated remaining: 6m 29s. Rate: 159.3 symbols/min [2025-10-15T22:37:47.241223] [INFO ] [MAIN ] GHLD: Loaded 4222 primary data records. [2025-10-15T22:37:47.241096] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:47.407087] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:47.431793] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7364 primary records. [2025-10-15T22:37:47.425513] [DEBUG] [LOCAL ] GHM: Loaded 14368 existing records from primary storage. [2025-10-15T22:37:47.431911] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-15T22:37:47.456985] [INFO ] [MAIN ] GHM: Loaded 14368 primary data records. [2025-10-15T22:37:47.670267] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-15T22:37:47.681135] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-15T22:37:47.683888] [INFO ] [MAIN ] Derivative Progress: 771/1803 symbols completed. GHI took 1.1s. Estimated remaining: 6m 29s. Rate: 159.2 symbols/min [2025-10-15T22:37:47.695432] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:47.907787] [DEBUG] [LOCAL ] GHY: Loaded 20928 existing records from primary storage. [2025-10-15T22:37:47.908364] [INFO ] [MAIN ] GHY: Loaded 20928 primary data records. [2025-10-15T22:37:48.055413] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:48.080585] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4222 primary records. [2025-10-15T22:37:48.107535] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-15T22:37:48.240752] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-10-15T22:37:48.242474] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-15T22:37:48.244723] [INFO ] [MAIN ] Derivative Progress: 772/1803 symbols completed. GHLD took 1.0s. Estimated remaining: 6m 29s. Rate: 159.1 symbols/min [2025-10-15T22:37:48.246040] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:48.260020] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:48.261533] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14368 primary records. [2025-10-15T22:37:48.261890] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-15T22:37:48.281541] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-15T22:37:48.281980] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-15T22:37:48.284548] [INFO ] [MAIN ] Derivative Progress: 773/1803 symbols completed. GHM took 1.0s. Estimated remaining: 6m 28s. Rate: 159.3 symbols/min [2025-10-15T22:37:48.284958] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:48.308137] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:48.316220] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20928 primary records. [2025-10-15T22:37:48.316408] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-15T22:37:48.322745] [DEBUG] [LOCAL ] GIC: Loaded 13411 existing records from primary storage. [2025-10-15T22:37:48.334147] [INFO ] [MAIN ] GIC: Loaded 13411 primary data records. [2025-10-15T22:37:48.434525] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-15T22:37:48.435271] [DEBUG] [LOCAL ] GIB: Loaded 31659 existing records from primary storage. [2025-10-15T22:37:48.449058] [INFO ] [MAIN ] GIB: Loaded 31659 primary data records. [2025-10-15T22:37:48.448980] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-15T22:37:48.454959] [INFO ] [MAIN ] Derivative Progress: 774/1803 symbols completed. GHY took 0.8s. Estimated remaining: 6m 27s. Rate: 159.4 symbols/min [2025-10-15T22:37:48.455188] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:49.006957] [DEBUG] [LOCAL ] GIL: Loaded 43829 existing records from primary storage. [2025-10-15T22:37:49.007813] [INFO ] [MAIN ] GIL: Loaded 43829 primary data records. [2025-10-15T22:37:49.316266] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:49.317463] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13411 primary records. [2025-10-15T22:37:49.318116] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-15T22:37:49.338728] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-15T22:37:49.338975] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-15T22:37:49.354532] [INFO ] [MAIN ] Derivative Progress: 775/1803 symbols completed. GIC took 1.1s. Estimated remaining: 6m 28s. Rate: 159.1 symbols/min [2025-10-15T22:37:49.355218] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:49.355319] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:49.356689] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31659 primary records. [2025-10-15T22:37:49.357287] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-15T22:37:49.378265] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-15T22:37:49.378632] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-15T22:37:49.381572] [INFO ] [MAIN ] Derivative Progress: 776/1803 symbols completed. GIB took 1.1s. Estimated remaining: 6m 27s. Rate: 159.3 symbols/min [2025-10-15T22:37:49.382062] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:49.396001] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:49.396823] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43829 primary records. [2025-10-15T22:37:49.397044] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-15T22:37:49.427467] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-15T22:37:49.427749] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-15T22:37:49.430912] [INFO ] [MAIN ] Derivative Progress: 777/1803 symbols completed. GIL took 1.0s. Estimated remaining: 6m 26s. Rate: 159.5 symbols/min [2025-10-15T22:37:49.431208] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:49.464616] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-10-15T22:37:49.465020] [INFO ] [MAIN ] GIS: Loaded 53673 primary data records. [2025-10-15T22:37:49.603260] [DEBUG] [LOCAL ] GKOS: Loaded 42541 existing records from primary storage. [2025-10-15T22:37:49.615132] [INFO ] [MAIN ] GKOS: Loaded 42541 primary data records. [2025-10-15T22:37:49.626609] [DEBUG] [LOCAL ] GL: Loaded 37640 existing records from primary storage. [2025-10-15T22:37:49.668426] [INFO ] [MAIN ] GL: Loaded 37640 primary data records. [2025-10-15T22:37:50.441903] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:50.444415] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53673 primary records. [2025-10-15T22:37:50.444626] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-15T22:37:50.471462] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:50.479491] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42541 primary records. [2025-10-15T22:37:50.479955] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-15T22:37:50.480069] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-15T22:37:50.481827] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-15T22:37:50.483759] [INFO ] [MAIN ] Derivative Progress: 778/1803 symbols completed. GIS took 1.1s. Estimated remaining: 6m 26s. Rate: 159.1 symbols/min [2025-10-15T22:37:50.504314] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-15T22:37:50.504745] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-15T22:37:50.522488] [INFO ] [MAIN ] Derivative Progress: 779/1803 symbols completed. GKOS took 1.1s. Estimated remaining: 6m 26s. Rate: 159.3 symbols/min [2025-10-15T22:37:50.523523] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:50.524599] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37640 primary records. [2025-10-15T22:37:50.524709] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-15T22:37:50.541193] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-15T22:37:50.541383] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-15T22:37:50.546029] [INFO ] [MAIN ] Derivative Progress: 780/1803 symbols completed. GL took 1.1s. Estimated remaining: 6m 25s. Rate: 159.5 symbols/min [2025-10-15T22:37:50.546870] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:50.546770] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:50.546980] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:50.565089] [DEBUG] [LOCAL ] GLP: Loaded 9278 existing records from primary storage. [2025-10-15T22:37:50.565471] [INFO ] [MAIN ] GLP: Loaded 9278 primary data records. [2025-10-15T22:37:50.731262] [DEBUG] [LOCAL ] GLOB: Loaded 47983 existing records from primary storage. [2025-10-15T22:37:50.748179] [INFO ] [MAIN ] GLOB: Loaded 47983 primary data records. [2025-10-15T22:37:50.882081] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-15T22:37:51.066195] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-15T22:37:51.653728] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:51.654541] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9278 primary records. [2025-10-15T22:37:51.654731] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-15T22:37:51.674584] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-15T22:37:51.675274] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-15T22:37:51.677540] [INFO ] [MAIN ] Derivative Progress: 781/1803 symbols completed. GLP took 1.1s. Estimated remaining: 6m 25s. Rate: 159.1 symbols/min [2025-10-15T22:37:51.678336] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:51.696015] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:51.696987] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-15T22:37:51.698095] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-15T22:37:51.727145] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:51.728698] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47983 primary records. [2025-10-15T22:37:51.728841] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-15T22:37:51.731623] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-15T22:37:51.732069] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-15T22:37:51.735060] [INFO ] [MAIN ] Derivative Progress: 782/1803 symbols completed. GLW took 1.2s. Estimated remaining: 6m 25s. Rate: 159.3 symbols/min [2025-10-15T22:37:51.742315] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:51.765500] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-15T22:37:51.765854] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-15T22:37:51.768368] [INFO ] [MAIN ] Derivative Progress: 783/1803 symbols completed. GLOB took 1.2s. Estimated remaining: 6m 24s. Rate: 159.5 symbols/min [2025-10-15T22:37:51.768736] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:51.799387] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-15T22:37:51.799852] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-15T22:37:52.033930] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-15T22:37:52.074283] [DEBUG] [LOCAL ] GMED: Loaded 48294 existing records from primary storage. [2025-10-15T22:37:52.074410] [INFO ] [MAIN ] GME: Loaded 53781 primary data records. [2025-10-15T22:37:52.181613] [INFO ] [MAIN ] GMED: Loaded 48294 primary data records. [2025-10-15T22:37:52.873912] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:52.875677] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-15T22:37:52.876024] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-15T22:37:52.898566] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-15T22:37:52.898769] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-15T22:37:52.900671] [INFO ] [MAIN ] Derivative Progress: 784/1803 symbols completed. GM took 1.2s. Estimated remaining: 6m 24s. Rate: 159.1 symbols/min [2025-10-15T22:37:52.900925] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:52.914350] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:52.915001] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48294 primary records. [2025-10-15T22:37:52.915163] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-15T22:37:52.934881] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-15T22:37:52.944185] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-15T22:37:52.952933] [INFO ] [MAIN ] Derivative Progress: 785/1803 symbols completed. GMED took 1.2s. Estimated remaining: 6m 24s. Rate: 159.2 symbols/min [2025-10-15T22:37:52.953275] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:52.950475] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:52.954580] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53781 primary records. [2025-10-15T22:37:52.963804] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-15T22:37:52.982026] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-15T22:37:52.996046] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-15T22:37:52.999965] [INFO ] [MAIN ] Derivative Progress: 786/1803 symbols completed. GME took 1.3s. Estimated remaining: 6m 23s. Rate: 159.4 symbols/min [2025-10-15T22:37:53.000219] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:53.001430] [DEBUG] [LOCAL ] GMRE: Loaded 37100 existing records from primary storage. [2025-10-15T22:37:53.001622] [INFO ] [MAIN ] GMRE: Loaded 37100 primary data records. [2025-10-15T22:37:53.044457] [DEBUG] [LOCAL ] GNE: Loaded 18040 existing records from primary storage. [2025-10-15T22:37:53.077238] [INFO ] [MAIN ] GNE: Loaded 18040 primary data records. [2025-10-15T22:37:53.504077] [DEBUG] [LOCAL ] GNK: Loaded 40065 existing records from primary storage. [2025-10-15T22:37:53.653105] [INFO ] [MAIN ] GNK: Loaded 40065 primary data records. [2025-10-15T22:37:54.024002] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:54.030500] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:54.030167] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37100 primary records. [2025-10-15T22:37:54.031698] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 18040 primary records. [2025-10-15T22:37:54.031888] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-15T22:37:54.031819] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-15T22:37:54.049512] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-15T22:37:54.050221] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-15T22:37:54.060596] [INFO ] [MAIN ] Derivative Progress: 787/1803 symbols completed. GMRE took 1.2s. Estimated remaining: 6m 23s. Rate: 159.0 symbols/min [2025-10-15T22:37:54.067512] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:54.070161] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-15T22:37:54.071136] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-15T22:37:54.081718] [INFO ] [MAIN ] Derivative Progress: 788/1803 symbols completed. GNE took 1.1s. Estimated remaining: 6m 22s. Rate: 159.2 symbols/min [2025-10-15T22:37:54.087720] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:54.087322] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:54.088985] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40065 primary records. [2025-10-15T22:37:54.089062] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-15T22:37:54.105837] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-15T22:37:54.106061] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-15T22:37:54.108582] [INFO ] [MAIN ] Derivative Progress: 789/1803 symbols completed. GNK took 1.1s. Estimated remaining: 6m 22s. Rate: 159.4 symbols/min [2025-10-15T22:37:54.108733] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:54.119909] [DEBUG] [LOCAL ] GNT: Loaded 8426 existing records from primary storage. [2025-10-15T22:37:54.120060] [INFO ] [MAIN ] GNT: Loaded 8426 primary data records. [2025-10-15T22:37:54.275120] [DEBUG] [LOCAL ] GNL: Loaded 46728 existing records from primary storage. [2025-10-15T22:37:54.275856] [DEBUG] [LOCAL ] GNRC: Loaded 45508 existing records from primary storage. [2025-10-15T22:37:54.276042] [INFO ] [MAIN ] GNRC: Loaded 45508 primary data records. [2025-10-15T22:37:54.275978] [INFO ] [MAIN ] GNL: Loaded 46728 primary data records. [2025-10-15T22:37:55.142505] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:55.143870] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8426 primary records. [2025-10-15T22:37:55.145772] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-15T22:37:55.176289] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-15T22:37:55.177026] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-15T22:37:55.179383] [INFO ] [MAIN ] Derivative Progress: 790/1803 symbols completed. GNT took 1.1s. Estimated remaining: 6m 22s. Rate: 159.1 symbols/min [2025-10-15T22:37:55.179863] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:55.201268] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:55.204080] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46728 primary records. [2025-10-15T22:37:55.205338] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-15T22:37:55.235271] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:55.237779] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45508 primary records. [2025-10-15T22:37:55.238500] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-15T22:37:55.242066] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-15T22:37:55.242561] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-15T22:37:55.272285] [INFO ] [MAIN ] Derivative Progress: 791/1803 symbols completed. GNL took 1.2s. Estimated remaining: 6m 21s. Rate: 159.2 symbols/min [2025-10-15T22:37:55.274058] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:55.277578] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-15T22:37:55.277951] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-15T22:37:55.281445] [INFO ] [MAIN ] Derivative Progress: 792/1803 symbols completed. GNRC took 1.2s. Estimated remaining: 6m 21s. Rate: 159.4 symbols/min [2025-10-15T22:37:55.281876] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:55.300086] [DEBUG] [LOCAL ] GNW: Loaded 51403 existing records from primary storage. [2025-10-15T22:37:55.300386] [INFO ] [MAIN ] GNW: Loaded 51403 primary data records. [2025-10-15T22:37:55.633325] [DEBUG] [LOCAL ] GOLF: Loaded 30944 existing records from primary storage. [2025-10-15T22:37:55.635022] [INFO ] [MAIN ] GOLF: Loaded 30944 primary data records. [2025-10-15T22:37:55.634663] [DEBUG] [LOCAL ] GOF: Loaded 42604 existing records from primary storage. [2025-10-15T22:37:55.635323] [INFO ] [MAIN ] GOF: Loaded 42604 primary data records. [2025-10-15T22:37:56.292582] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:56.294111] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51403 primary records. [2025-10-15T22:37:56.294243] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-15T22:37:56.311959] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-15T22:37:56.312168] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-15T22:37:56.315096] [INFO ] [MAIN ] Derivative Progress: 793/1803 symbols completed. GNW took 1.1s. Estimated remaining: 6m 21s. Rate: 159.0 symbols/min [2025-10-15T22:37:56.335993] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:56.337221] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 30944 primary records. [2025-10-15T22:37:56.337573] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-15T22:37:56.358028] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-15T22:37:56.358285] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-15T22:37:56.361688] [INFO ] [MAIN ] Derivative Progress: 794/1803 symbols completed. GOLF took 1.1s. Estimated remaining: 6m 20s. Rate: 159.2 symbols/min [2025-10-15T22:37:56.375340] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:56.376264] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42604 primary records. [2025-10-15T22:37:56.376336] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-15T22:37:56.393061] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-15T22:37:56.393184] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-15T22:37:56.396856] [INFO ] [MAIN ] Derivative Progress: 795/1803 symbols completed. GOF took 1.1s. Estimated remaining: 6m 19s. Rate: 159.4 symbols/min [2025-10-15T22:37:56.397595] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:56.397822] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:56.397500] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:56.461395] [DEBUG] [LOCAL ] GOTU: Loaded 37301 existing records from primary storage. [2025-10-15T22:37:56.461598] [INFO ] [MAIN ] GOTU: Loaded 37301 primary data records. [2025-10-15T22:37:56.583450] [DEBUG] [LOCAL ] GPC: Loaded 46017 existing records from primary storage. [2025-10-15T22:37:56.612853] [INFO ] [MAIN ] GPC: Loaded 46017 primary data records. [2025-10-15T22:37:56.657282] [DEBUG] [LOCAL ] GOOS: Loaded 44661 existing records from primary storage. [2025-10-15T22:37:56.679227] [INFO ] [MAIN ] GOOS: Loaded 44661 primary data records. [2025-10-15T22:37:57.553800] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:57.555325] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 37301 primary records. [2025-10-15T22:37:57.555619] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-15T22:37:57.574575] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-15T22:37:57.575373] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-15T22:37:57.577966] [INFO ] [MAIN ] Derivative Progress: 796/1803 symbols completed. GOTU took 1.2s. Estimated remaining: 6m 20s. Rate: 159.0 symbols/min [2025-10-15T22:37:57.578196] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:57.607875] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:57.614200] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44661 primary records. [2025-10-15T22:37:57.614803] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:57.616018] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46017 primary records. [2025-10-15T22:37:57.621371] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-15T22:37:57.622453] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-15T22:37:57.661473] [DEBUG] [LOCAL ] GPI: Loaded 14894 existing records from primary storage. [2025-10-15T22:37:57.660849] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-15T22:37:57.661817] [INFO ] [MAIN ] GPI: Loaded 14894 primary data records. [2025-10-15T22:37:57.662060] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-15T22:37:57.656288] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-15T22:37:57.662412] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-15T22:37:57.671354] [INFO ] [MAIN ] Derivative Progress: 797/1803 symbols completed. GOOS took 1.3s. Estimated remaining: 6m 19s. Rate: 159.1 symbols/min [2025-10-15T22:37:57.716483] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:57.726510] [INFO ] [MAIN ] Derivative Progress: 798/1803 symbols completed. GPC took 1.3s. Estimated remaining: 6m 19s. Rate: 159.3 symbols/min [2025-10-15T22:37:57.771025] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:57.838824] [DEBUG] [LOCAL ] GPJA: Loaded 4202 existing records from primary storage. [2025-10-15T22:37:57.878815] [INFO ] [MAIN ] GPJA: Loaded 4202 primary data records. [2025-10-15T22:37:58.374365] [DEBUG] [LOCAL ] GPK: Loaded 52775 existing records from primary storage. [2025-10-15T22:37:58.376302] [INFO ] [MAIN ] GPK: Loaded 52775 primary data records. [2025-10-15T22:37:58.589485] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:58.597030] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14894 primary records. [2025-10-15T22:37:58.722056] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-15T22:37:58.761153] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-10-15T22:37:58.762384] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-15T22:37:58.765246] [INFO ] [MAIN ] Derivative Progress: 799/1803 symbols completed. GPI took 1.2s. Estimated remaining: 6m 19s. Rate: 159.0 symbols/min [2025-10-15T22:37:58.766921] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:58.785204] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:58.786312] [INFO ] [MAIN ] GPJA: Generated 1794 derivative records from 4202 primary records. [2025-10-15T22:37:58.786484] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-15T22:37:58.803161] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1794 records). [2025-10-15T22:37:58.803471] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-15T22:37:58.807577] [INFO ] [MAIN ] Derivative Progress: 800/1803 symbols completed. GPJA took 1.1s. Estimated remaining: 6m 18s. Rate: 159.1 symbols/min [2025-10-15T22:37:58.807970] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:58.844407] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:58.846985] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52775 primary records. [2025-10-15T22:37:58.847093] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-15T22:37:58.858671] [DEBUG] [LOCAL ] GPMT: Loaded 25932 existing records from primary storage. [2025-10-15T22:37:58.863842] [INFO ] [MAIN ] GPMT: Loaded 25932 primary data records. [2025-10-15T22:37:58.987320] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-15T22:37:59.010103] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-15T22:37:59.039594] [INFO ] [MAIN ] Derivative Progress: 801/1803 symbols completed. GPK took 1.3s. Estimated remaining: 6m 18s. Rate: 159.2 symbols/min [2025-10-15T22:37:59.066454] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:59.225983] [DEBUG] [LOCAL ] GPN: Loaded 52001 existing records from primary storage. [2025-10-15T22:37:59.227153] [INFO ] [MAIN ] GPN: Loaded 52001 primary data records. [2025-10-15T22:37:59.437340] [DEBUG] [LOCAL ] GPOR: Loaded 23324 existing records from primary storage. [2025-10-15T22:37:59.556117] [INFO ] [MAIN ] GPOR: Loaded 23324 primary data records. [2025-10-15T22:37:59.771547] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:59.882192] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25932 primary records. [2025-10-15T22:37:59.882359] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-15T22:37:59.915059] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-15T22:37:59.916154] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-15T22:37:59.918492] [INFO ] [MAIN ] Derivative Progress: 802/1803 symbols completed. GPMT took 1.2s. Estimated remaining: 6m 18s. Rate: 158.9 symbols/min [2025-10-15T22:37:59.919728] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:59.940728] [DEBUG] [MAIN ] GPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:37:59.941952] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52001 primary records. [2025-10-15T22:37:59.942557] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-15T22:37:59.974415] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-15T22:37:59.974635] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-15T22:37:59.977494] [INFO ] [MAIN ] Derivative Progress: 803/1803 symbols completed. GPN took 1.2s. Estimated remaining: 6m 17s. Rate: 159.1 symbols/min [2025-10-15T22:37:59.977919] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:37:59.995290] [DEBUG] [LOCAL ] GPRK: Loaded 39736 existing records from primary storage. [2025-10-15T22:37:59.995933] [INFO ] [MAIN ] GPRK: Loaded 39736 primary data records. [2025-10-15T22:38:00.010487] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:00.054456] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23324 primary records. [2025-10-15T22:38:00.066782] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-15T22:38:00.204255] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-15T22:38:00.204922] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-15T22:38:00.226898] [INFO ] [MAIN ] Derivative Progress: 804/1803 symbols completed. GPOR took 1.2s. Estimated remaining: 6m 17s. Rate: 159.2 symbols/min [2025-10-15T22:38:00.240957] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:00.359811] [DEBUG] [LOCAL ] GRBK: Loaded 27164 existing records from primary storage. [2025-10-15T22:38:00.360043] [INFO ] [MAIN ] GRBK: Loaded 27164 primary data records. [2025-10-15T22:38:00.470843] [DEBUG] [LOCAL ] GRC: Loaded 9292 existing records from primary storage. [2025-10-15T22:38:00.471856] [INFO ] [MAIN ] GRC: Loaded 9292 primary data records. [2025-10-15T22:38:01.045158] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:01.049127] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39736 primary records. [2025-10-15T22:38:01.050360] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-15T22:38:01.068553] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-15T22:38:01.068705] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-15T22:38:01.071088] [INFO ] [MAIN ] Derivative Progress: 805/1803 symbols completed. GPRK took 1.2s. Estimated remaining: 6m 17s. Rate: 158.9 symbols/min [2025-10-15T22:38:01.072986] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:01.093196] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:01.094901] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27164 primary records. [2025-10-15T22:38:01.095196] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-15T22:38:01.131452] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:01.140268] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9292 primary records. [2025-10-15T22:38:01.142394] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-15T22:38:01.141503] [DEBUG] [LOCAL ] GRDN: Loaded 20984 existing records from primary storage. [2025-10-15T22:38:01.145476] [INFO ] [MAIN ] GRDN: Loaded 20984 primary data records. [2025-10-15T22:38:01.145340] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-15T22:38:01.168153] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-15T22:38:01.180987] [INFO ] [MAIN ] Derivative Progress: 806/1803 symbols completed. GRBK took 1.2s. Estimated remaining: 6m 16s. Rate: 159.1 symbols/min [2025-10-15T22:38:01.223384] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:01.287923] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-15T22:38:01.311543] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-15T22:38:01.314753] [INFO ] [MAIN ] Derivative Progress: 807/1803 symbols completed. GRC took 1.1s. Estimated remaining: 6m 15s. Rate: 159.2 symbols/min [2025-10-15T22:38:01.326333] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:01.501553] [DEBUG] [LOCAL ] GRMN: Loaded 40425 existing records from primary storage. [2025-10-15T22:38:01.502224] [INFO ] [MAIN ] GRMN: Loaded 40425 primary data records. [2025-10-15T22:38:01.680675] [DEBUG] [LOCAL ] GRND: Loaded 50119 existing records from primary storage. [2025-10-15T22:38:01.700222] [INFO ] [MAIN ] GRND: Loaded 50119 primary data records. [2025-10-15T22:38:01.905010] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:01.938284] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20984 primary records. [2025-10-15T22:38:01.963703] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-15T22:38:02.206457] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-15T22:38:02.219714] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-15T22:38:02.222326] [INFO ] [MAIN ] Derivative Progress: 808/1803 symbols completed. GRDN took 1.1s. Estimated remaining: 6m 16s. Rate: 158.9 symbols/min [2025-10-15T22:38:02.244608] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:02.245535] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 40425 primary records. [2025-10-15T22:38:02.245627] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-15T22:38:02.265704] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-15T22:38:02.265986] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-15T22:38:02.268939] [INFO ] [MAIN ] Derivative Progress: 809/1803 symbols completed. GRMN took 1.0s. Estimated remaining: 6m 15s. Rate: 159.1 symbols/min [2025-10-15T22:38:02.286582] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:02.287355] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50119 primary records. [2025-10-15T22:38:02.287421] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-15T22:38:02.304452] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-15T22:38:02.304565] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-15T22:38:02.308896] [INFO ] [MAIN ] Derivative Progress: 810/1803 symbols completed. GRND took 1.0s. Estimated remaining: 6m 14s. Rate: 159.3 symbols/min [2025-10-15T22:38:02.309703] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:02.309843] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:02.309545] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:02.324293] [DEBUG] [LOCAL ] GRX: Loaded 4797 existing records from primary storage. [2025-10-15T22:38:02.324682] [INFO ] [MAIN ] GRX: Loaded 4797 primary data records. [2025-10-15T22:38:02.433620] [DEBUG] [LOCAL ] GROV: Loaded 8760 existing records from primary storage. [2025-10-15T22:38:02.457212] [INFO ] [MAIN ] GROV: Loaded 8760 primary data records. [2025-10-15T22:38:02.657360] [DEBUG] [LOCAL ] GRNT: Loaded 33966 existing records from primary storage. [2025-10-15T22:38:02.676705] [INFO ] [MAIN ] GRNT: Loaded 33966 primary data records. [2025-10-15T22:38:03.420671] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:03.422920] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4797 primary records. [2025-10-15T22:38:03.423266] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-15T22:38:03.457162] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:03.457695] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-15T22:38:03.459220] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8760 primary records. [2025-10-15T22:38:03.459638] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-15T22:38:03.460133] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-15T22:38:03.462804] [INFO ] [MAIN ] Derivative Progress: 811/1803 symbols completed. GRX took 1.2s. Estimated remaining: 6m 15s. Rate: 158.9 symbols/min [2025-10-15T22:38:03.463082] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:03.495852] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:03.498051] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33966 primary records. [2025-10-15T22:38:03.498252] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-15T22:38:03.500247] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-15T22:38:03.500669] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-15T22:38:03.511910] [INFO ] [MAIN ] Derivative Progress: 812/1803 symbols completed. GROV took 1.2s. Estimated remaining: 6m 14s. Rate: 159.0 symbols/min [2025-10-15T22:38:03.516584] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:03.520837] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-15T22:38:03.521378] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-15T22:38:03.525197] [INFO ] [MAIN ] Derivative Progress: 813/1803 symbols completed. GRNT took 1.2s. Estimated remaining: 6m 13s. Rate: 159.2 symbols/min [2025-10-15T22:38:03.525706] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:03.618259] [DEBUG] [LOCAL ] GS: Loaded 51783 existing records from primary storage. [2025-10-15T22:38:03.620573] [INFO ] [MAIN ] GS: Loaded 51783 primary data records. [2025-10-15T22:38:03.633539] [DEBUG] [LOCAL ] GSBD: Loaded 39619 existing records from primary storage. [2025-10-15T22:38:03.655190] [INFO ] [MAIN ] GSBD: Loaded 39619 primary data records. [2025-10-15T22:38:03.760743] [DEBUG] [LOCAL ] GSK: Loaded 53505 existing records from primary storage. [2025-10-15T22:38:03.809173] [INFO ] [MAIN ] GSK: Loaded 53505 primary data records. [2025-10-15T22:38:04.660772] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:04.671479] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39619 primary records. [2025-10-15T22:38:04.676316] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-15T22:38:04.678034] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:04.680990] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51783 primary records. [2025-10-15T22:38:04.681105] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-15T22:38:04.718145] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:04.722513] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53505 primary records. [2025-10-15T22:38:04.727775] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-15T22:38:04.727897] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-15T22:38:04.727991] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-15T22:38:04.728674] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-15T22:38:04.732570] [INFO ] [MAIN ] Derivative Progress: 814/1803 symbols completed. GS took 1.3s. Estimated remaining: 6m 14s. Rate: 158.8 symbols/min [2025-10-15T22:38:04.733900] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-15T22:38:04.733403] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:04.747084] [INFO ] [MAIN ] Derivative Progress: 815/1803 symbols completed. GSBD took 1.2s. Estimated remaining: 6m 13s. Rate: 159.0 symbols/min [2025-10-15T22:38:04.751792] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:04.751615] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-15T22:38:04.752790] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-15T22:38:04.756804] [INFO ] [MAIN ] Derivative Progress: 816/1803 symbols completed. GSK took 1.2s. Estimated remaining: 6m 12s. Rate: 159.2 symbols/min [2025-10-15T22:38:04.757521] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:04.834409] [DEBUG] [LOCAL ] GTES: Loaded 50380 existing records from primary storage. [2025-10-15T22:38:04.835301] [INFO ] [MAIN ] GTES: Loaded 50380 primary data records. [2025-10-15T22:38:04.835425] [DEBUG] [LOCAL ] GSL: Loaded 33284 existing records from primary storage. [2025-10-15T22:38:04.849089] [INFO ] [MAIN ] GSL: Loaded 33284 primary data records. [2025-10-15T22:38:05.028343] [DEBUG] [LOCAL ] GTLS: Loaded 43272 existing records from primary storage. [2025-10-15T22:38:05.057524] [INFO ] [MAIN ] GTLS: Loaded 43272 primary data records. [2025-10-15T22:38:05.926410] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:05.939152] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50380 primary records. [2025-10-15T22:38:05.939474] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-15T22:38:05.939754] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:05.941404] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33284 primary records. [2025-10-15T22:38:05.943205] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-15T22:38:05.979427] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-15T22:38:05.979977] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-15T22:38:05.983008] [INFO ] [MAIN ] Derivative Progress: 817/1803 symbols completed. GTES took 1.2s. Estimated remaining: 6m 13s. Rate: 158.7 symbols/min [2025-10-15T22:38:05.983295] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:05.980477] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-15T22:38:05.983841] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-15T22:38:05.988365] [INFO ] [MAIN ] Derivative Progress: 818/1803 symbols completed. GSL took 1.3s. Estimated remaining: 6m 12s. Rate: 158.9 symbols/min [2025-10-15T22:38:05.988966] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:06.006877] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:06.007912] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43272 primary records. [2025-10-15T22:38:06.007983] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-15T22:38:06.035811] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-15T22:38:06.036163] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-15T22:38:06.041187] [INFO ] [MAIN ] Derivative Progress: 819/1803 symbols completed. GTLS took 1.3s. Estimated remaining: 6m 11s. Rate: 159.1 symbols/min [2025-10-15T22:38:06.041782] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:06.094482] [DEBUG] [LOCAL ] GTY: Loaded 30274 existing records from primary storage. [2025-10-15T22:38:06.095637] [INFO ] [MAIN ] GTY: Loaded 30274 primary data records. [2025-10-15T22:38:06.095451] [DEBUG] [LOCAL ] GTN: Loaded 45215 existing records from primary storage. [2025-10-15T22:38:06.113157] [INFO ] [MAIN ] GTN: Loaded 45215 primary data records. [2025-10-15T22:38:06.123542] [DEBUG] [LOCAL ] GUG: Loaded 12167 existing records from primary storage. [2025-10-15T22:38:06.199464] [INFO ] [MAIN ] GUG: Loaded 12167 primary data records. [2025-10-15T22:38:07.091569] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:07.094485] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30274 primary records. [2025-10-15T22:38:07.094940] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-15T22:38:07.095391] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:07.096486] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45215 primary records. [2025-10-15T22:38:07.096662] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-15T22:38:07.112028] [DEBUG] [MAIN ] GUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:07.113050] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12167 primary records. [2025-10-15T22:38:07.123920] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-15T22:38:07.156750] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-15T22:38:07.157095] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-15T22:38:07.160216] [INFO ] [MAIN ] Derivative Progress: 820/1803 symbols completed. GTN took 1.2s. Estimated remaining: 6m 12s. Rate: 158.7 symbols/min [2025-10-15T22:38:07.161973] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-15T22:38:07.160844] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:07.162436] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-15T22:38:07.163573] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-15T22:38:07.166750] [INFO ] [MAIN ] Derivative Progress: 821/1803 symbols completed. GUG took 1.1s. Estimated remaining: 6m 11s. Rate: 158.9 symbols/min [2025-10-15T22:38:07.166987] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:07.167104] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-15T22:38:07.169431] [INFO ] [MAIN ] Derivative Progress: 822/1803 symbols completed. GTY took 1.2s. Estimated remaining: 6m 10s. Rate: 159.1 symbols/min [2025-10-15T22:38:07.169714] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:07.189420] [DEBUG] [LOCAL ] GUT: Loaded 15593 existing records from primary storage. [2025-10-15T22:38:07.189637] [INFO ] [MAIN ] GUT: Loaded 15593 primary data records. [2025-10-15T22:38:07.260696] [DEBUG] [LOCAL ] GWH: Loaded 18636 existing records from primary storage. [2025-10-15T22:38:07.272826] [INFO ] [MAIN ] GWH: Loaded 18636 primary data records. [2025-10-15T22:38:07.448215] [DEBUG] [LOCAL ] GVA: Loaded 32702 existing records from primary storage. [2025-10-15T22:38:07.507254] [INFO ] [MAIN ] GVA: Loaded 32702 primary data records. [2025-10-15T22:38:08.239026] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:08.240027] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15593 primary records. [2025-10-15T22:38:08.240448] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-15T22:38:08.254326] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:08.255215] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 18636 primary records. [2025-10-15T22:38:08.255307] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-15T22:38:08.289369] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-15T22:38:08.290011] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-15T22:38:08.302005] [INFO ] [MAIN ] Derivative Progress: 823/1803 symbols completed. GWH took 1.1s. Estimated remaining: 6m 10s. Rate: 158.7 symbols/min [2025-10-15T22:38:08.307772] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-15T22:38:08.307980] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-15T22:38:08.310584] [INFO ] [MAIN ] Derivative Progress: 824/1803 symbols completed. GUT took 1.1s. Estimated remaining: 6m 10s. Rate: 158.9 symbols/min [2025-10-15T22:38:08.311086] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:08.311885] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 32702 primary records. [2025-10-15T22:38:08.311957] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-15T22:38:08.328411] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-15T22:38:08.328499] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-15T22:38:08.331546] [INFO ] [MAIN ] Derivative Progress: 825/1803 symbols completed. GVA took 1.2s. Estimated remaining: 6m 9s. Rate: 159.1 symbols/min [2025-10-15T22:38:08.332389] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:08.332301] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:08.332824] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:08.364124] [DEBUG] [LOCAL ] GWW: Loaded 19562 existing records from primary storage. [2025-10-15T22:38:08.364385] [INFO ] [MAIN ] GWW: Loaded 19562 primary data records. [2025-10-15T22:38:08.519909] [DEBUG] [LOCAL ] GWRE: Loaded 39928 existing records from primary storage. [2025-10-15T22:38:08.582231] [DEBUG] [LOCAL ] GXO: Loaded 46756 existing records from primary storage. [2025-10-15T22:38:08.582364] [INFO ] [MAIN ] GWRE: Loaded 39928 primary data records. [2025-10-15T22:38:08.748316] [INFO ] [MAIN ] GXO: Loaded 46756 primary data records. [2025-10-15T22:38:09.411025] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:09.411805] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19562 primary records. [2025-10-15T22:38:09.411978] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-15T22:38:09.442669] [DEBUG] [MAIN ] GWRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:09.444097] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 39928 primary records. [2025-10-15T22:38:09.444888] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-15T22:38:09.457995] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-15T22:38:09.458219] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-15T22:38:09.460278] [INFO ] [MAIN ] Derivative Progress: 826/1803 symbols completed. GWW took 1.1s. Estimated remaining: 6m 9s. Rate: 158.7 symbols/min [2025-10-15T22:38:09.464023] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:09.465168] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-15T22:38:09.465729] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-15T22:38:09.469427] [INFO ] [MAIN ] Derivative Progress: 827/1803 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 9s. Rate: 158.9 symbols/min [2025-10-15T22:38:09.469675] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:09.482826] [DEBUG] [LOCAL ] GYLD: Loaded 1544 existing records from primary storage. [2025-10-15T22:38:09.487859] [DEBUG] [MAIN ] GXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:09.488595] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 46756 primary records. [2025-10-15T22:38:09.488820] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-15T22:38:09.488721] [INFO ] [MAIN ] GYLD: Loaded 1544 primary data records. [2025-10-15T22:38:09.571694] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-15T22:38:09.571835] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-15T22:38:09.582493] [INFO ] [MAIN ] Derivative Progress: 828/1803 symbols completed. GXO took 1.3s. Estimated remaining: 6m 8s. Rate: 159.0 symbols/min [2025-10-15T22:38:09.589490] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:09.841905] [DEBUG] [LOCAL ] H: Loaded 44421 existing records from primary storage. [2025-10-15T22:38:09.842457] [INFO ] [MAIN ] H: Loaded 44421 primary data records. [2025-10-15T22:38:09.959457] [DEBUG] [LOCAL ] HAE: Loaded 39371 existing records from primary storage. [2025-10-15T22:38:09.965391] [INFO ] [MAIN ] HAE: Loaded 39371 primary data records. [2025-10-15T22:38:10.359581] [DEBUG] [MAIN ] GYLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:10.385884] [INFO ] [MAIN ] GYLD: Generated 1794 derivative records from 1544 primary records. [2025-10-15T22:38:10.386749] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-15T22:38:10.534718] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1794 records). [2025-10-15T22:38:10.536038] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-15T22:38:10.539452] [INFO ] [MAIN ] Derivative Progress: 829/1803 symbols completed. GYLD took 1.1s. Estimated remaining: 6m 8s. Rate: 158.7 symbols/min [2025-10-15T22:38:10.540914] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:10.568875] [DEBUG] [MAIN ] H: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:10.569973] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44421 primary records. [2025-10-15T22:38:10.570247] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-15T22:38:10.587454] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-15T22:38:10.587787] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-15T22:38:10.591414] [INFO ] [MAIN ] Derivative Progress: 830/1803 symbols completed. H took 1.1s. Estimated remaining: 6m 7s. Rate: 158.9 symbols/min [2025-10-15T22:38:10.608327] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:10.632265] [DEBUG] [MAIN ] HAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:10.633394] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39371 primary records. [2025-10-15T22:38:10.646311] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-15T22:38:10.649483] [DEBUG] [LOCAL ] HAFN: Loaded 42943 existing records from primary storage. [2025-10-15T22:38:10.660501] [INFO ] [MAIN ] HAFN: Loaded 42943 primary data records. [2025-10-15T22:38:10.680209] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-15T22:38:10.695297] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-15T22:38:10.698564] [INFO ] [MAIN ] Derivative Progress: 831/1803 symbols completed. HAE took 1.1s. Estimated remaining: 6m 7s. Rate: 159.0 symbols/min [2025-10-15T22:38:10.714025] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:11.010412] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-15T22:38:11.022091] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-15T22:38:11.147697] [DEBUG] [LOCAL ] HASI: Loaded 47673 existing records from primary storage. [2025-10-15T22:38:11.154321] [INFO ] [MAIN ] HASI: Loaded 47673 primary data records. [2025-10-15T22:38:11.614061] [DEBUG] [MAIN ] HAFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:11.671407] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 42943 primary records. [2025-10-15T22:38:11.705850] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-15T22:38:11.726178] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-15T22:38:11.728437] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-15T22:38:11.731517] [INFO ] [MAIN ] Derivative Progress: 832/1803 symbols completed. HAFN took 1.2s. Estimated remaining: 6m 7s. Rate: 158.7 symbols/min [2025-10-15T22:38:11.731892] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:11.746400] [DEBUG] [MAIN ] HAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:11.747285] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-15T22:38:11.747629] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-15T22:38:11.764246] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-15T22:38:11.764410] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-15T22:38:11.766400] [INFO ] [MAIN ] Derivative Progress: 833/1803 symbols completed. HAL took 1.2s. Estimated remaining: 6m 6s. Rate: 158.9 symbols/min [2025-10-15T22:38:11.766767] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:11.785966] [DEBUG] [MAIN ] HASI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:11.786708] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47673 primary records. [2025-10-15T22:38:11.786845] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-15T22:38:11.790443] [DEBUG] [LOCAL ] HBB: Loaded 6475 existing records from primary storage. [2025-10-15T22:38:11.790744] [INFO ] [MAIN ] HBB: Loaded 6475 primary data records. [2025-10-15T22:38:11.917484] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-15T22:38:11.918035] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-15T22:38:11.938371] [INFO ] [MAIN ] Derivative Progress: 834/1803 symbols completed. HASI took 1.2s. Estimated remaining: 6m 6s. Rate: 159.0 symbols/min [2025-10-15T22:38:11.955075] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:11.975047] [DEBUG] [LOCAL ] HAYW: Loaded 48908 existing records from primary storage. [2025-10-15T22:38:12.007733] [INFO ] [MAIN ] HAYW: Loaded 48908 primary data records. [2025-10-15T22:38:12.468896] [DEBUG] [LOCAL ] HBI: Loaded 52974 existing records from primary storage. [2025-10-15T22:38:12.470051] [INFO ] [MAIN ] HBI: Loaded 52974 primary data records. [2025-10-15T22:38:12.665941] [DEBUG] [MAIN ] HBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:12.666618] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6475 primary records. [2025-10-15T22:38:12.666825] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-15T22:38:12.811500] [DEBUG] [MAIN ] HAYW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:12.812760] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48908 primary records. [2025-10-15T22:38:12.813817] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-15T22:38:12.813876] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-10-15T22:38:12.815683] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-15T22:38:12.828730] [INFO ] [MAIN ] Derivative Progress: 835/1803 symbols completed. HBB took 1.1s. Estimated remaining: 6m 6s. Rate: 158.7 symbols/min [2025-10-15T22:38:12.832067] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:12.834512] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-15T22:38:12.834672] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-15T22:38:12.837357] [INFO ] [MAIN ] Derivative Progress: 836/1803 symbols completed. HAYW took 1.1s. Estimated remaining: 6m 5s. Rate: 158.9 symbols/min [2025-10-15T22:38:12.837537] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:12.855297] [DEBUG] [MAIN ] HBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:12.856104] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52974 primary records. [2025-10-15T22:38:12.856209] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-15T22:38:12.871911] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-15T22:38:12.872110] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-15T22:38:12.874692] [INFO ] [MAIN ] Derivative Progress: 837/1803 symbols completed. HBI took 0.9s. Estimated remaining: 6m 4s. Rate: 159.1 symbols/min [2025-10-15T22:38:12.874910] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:12.924147] [DEBUG] [LOCAL ] HBM: Loaded 52958 existing records from primary storage. [2025-10-15T22:38:12.924361] [INFO ] [MAIN ] HBM: Loaded 52958 primary data records. [2025-10-15T22:38:13.051630] [DEBUG] [LOCAL ] HCA: Loaded 46992 existing records from primary storage. [2025-10-15T22:38:13.051828] [INFO ] [MAIN ] HCA: Loaded 46992 primary data records. [2025-10-15T22:38:13.355428] [DEBUG] [LOCAL ] HCC: Loaded 45241 existing records from primary storage. [2025-10-15T22:38:13.371777] [INFO ] [MAIN ] HCC: Loaded 45241 primary data records. [2025-10-15T22:38:13.913406] [DEBUG] [MAIN ] HBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:13.914588] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52958 primary records. [2025-10-15T22:38:13.914896] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-15T22:38:13.947606] [DEBUG] [MAIN ] HCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:13.950819] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46992 primary records. [2025-10-15T22:38:13.951422] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-15T22:38:13.954715] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-15T22:38:13.954841] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-15T22:38:13.958475] [INFO ] [MAIN ] Derivative Progress: 838/1803 symbols completed. HBM took 1.1s. Estimated remaining: 6m 5s. Rate: 158.7 symbols/min [2025-10-15T22:38:13.974951] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-15T22:38:13.975366] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-15T22:38:13.977659] [INFO ] [MAIN ] Derivative Progress: 839/1803 symbols completed. HCA took 1.1s. Estimated remaining: 6m 4s. Rate: 158.9 symbols/min [2025-10-15T22:38:13.992433] [DEBUG] [MAIN ] HCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:13.993068] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45241 primary records. [2025-10-15T22:38:13.993128] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-15T22:38:14.007869] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-15T22:38:14.007927] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-15T22:38:14.010844] [INFO ] [MAIN ] Derivative Progress: 840/1803 symbols completed. HCC took 1.1s. Estimated remaining: 6m 3s. Rate: 159.1 symbols/min [2025-10-15T22:38:14.011423] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:14.011343] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:14.011495] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:14.032184] [DEBUG] [LOCAL ] HCI: Loaded 14115 existing records from primary storage. [2025-10-15T22:38:14.032402] [INFO ] [MAIN ] HCI: Loaded 14115 primary data records. [2025-10-15T22:38:14.385134] [DEBUG] [LOCAL ] HDB: Loaded 51932 existing records from primary storage. [2025-10-15T22:38:14.385543] [INFO ] [MAIN ] HDB: Loaded 51932 primary data records. [2025-10-15T22:38:14.386376] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-15T22:38:14.419634] [INFO ] [MAIN ] HD: Loaded 53492 primary data records. [2025-10-15T22:38:15.022111] [DEBUG] [MAIN ] HCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:15.023683] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14115 primary records. [2025-10-15T22:38:15.023799] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-15T22:38:15.042433] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-15T22:38:15.043693] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-15T22:38:15.046315] [INFO ] [MAIN ] Derivative Progress: 841/1803 symbols completed. HCI took 1.0s. Estimated remaining: 6m 4s. Rate: 158.7 symbols/min [2025-10-15T22:38:15.046705] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:15.075361] [DEBUG] [MAIN ] HD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:15.081289] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53492 primary records. [2025-10-15T22:38:15.080570] [DEBUG] [MAIN ] HDB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:15.082061] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51932 primary records. [2025-10-15T22:38:15.081468] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-15T22:38:15.082261] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-15T22:38:15.114212] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-15T22:38:15.113940] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-15T22:38:15.114495] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-15T22:38:15.114437] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-15T22:38:15.117115] [INFO ] [MAIN ] Derivative Progress: 842/1803 symbols completed. HDB took 1.1s. Estimated remaining: 6m 3s. Rate: 158.9 symbols/min [2025-10-15T22:38:15.119443] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:15.119557] [INFO ] [MAIN ] Derivative Progress: 843/1803 symbols completed. HD took 1.1s. Estimated remaining: 6m 2s. Rate: 159.1 symbols/min [2025-10-15T22:38:15.120085] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:15.138432] [DEBUG] [LOCAL ] HEQ: Loaded 6769 existing records from primary storage. [2025-10-15T22:38:15.138622] [INFO ] [MAIN ] HEQ: Loaded 6769 primary data records. [2025-10-15T22:38:15.267469] [DEBUG] [LOCAL ] HE: Loaded 48936 existing records from primary storage. [2025-10-15T22:38:15.292440] [INFO ] [MAIN ] HE: Loaded 48936 primary data records. [2025-10-15T22:38:15.303288] [DEBUG] [LOCAL ] HEI: Loaded 31248 existing records from primary storage. [2025-10-15T22:38:15.387325] [INFO ] [MAIN ] HEI: Loaded 31248 primary data records. [2025-10-15T22:38:16.126897] [DEBUG] [MAIN ] HEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:16.128600] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6769 primary records. [2025-10-15T22:38:16.129029] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-15T22:38:16.146378] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-15T22:38:16.146768] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-15T22:38:16.149775] [INFO ] [MAIN ] Derivative Progress: 844/1803 symbols completed. HEQ took 1.0s. Estimated remaining: 6m 2s. Rate: 158.8 symbols/min [2025-10-15T22:38:16.150161] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:16.167590] [DEBUG] [MAIN ] HE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:16.168491] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48936 primary records. [2025-10-15T22:38:16.176077] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-15T22:38:16.189035] [DEBUG] [MAIN ] HEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:16.190876] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 31248 primary records. [2025-10-15T22:38:16.193538] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-15T22:38:16.211856] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-15T22:38:16.213155] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-15T22:38:16.215552] [INFO ] [MAIN ] Derivative Progress: 845/1803 symbols completed. HE took 1.2s. Estimated remaining: 6m 2s. Rate: 158.9 symbols/min [2025-10-15T22:38:16.216208] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:16.218831] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-15T22:38:16.218953] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-15T22:38:16.221846] [INFO ] [MAIN ] Derivative Progress: 846/1803 symbols completed. HEI took 1.1s. Estimated remaining: 6m 1s. Rate: 159.1 symbols/min [2025-10-15T22:38:16.234701] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:16.247012] [DEBUG] [LOCAL ] HFRO: Loaded 16923 existing records from primary storage. [2025-10-15T22:38:16.247136] [INFO ] [MAIN ] HFRO: Loaded 16923 primary data records. [2025-10-15T22:38:16.369897] [DEBUG] [LOCAL ] HGER: Loaded 14918 existing records from primary storage. [2025-10-15T22:38:16.376268] [DEBUG] [LOCAL ] HESM: Loaded 48517 existing records from primary storage. [2025-10-15T22:38:16.392050] [INFO ] [MAIN ] HGER: Loaded 14918 primary data records. [2025-10-15T22:38:16.391956] [INFO ] [MAIN ] HESM: Loaded 48517 primary data records. [2025-10-15T22:38:17.182252] [DEBUG] [MAIN ] HFRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:17.183460] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 16923 primary records. [2025-10-15T22:38:17.183555] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-15T22:38:17.229947] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-15T22:38:17.230891] [DEBUG] [MAIN ] HGER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:17.231662] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 14918 primary records. [2025-10-15T22:38:17.230527] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-15T22:38:17.232049] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-15T22:38:17.232276] [DEBUG] [MAIN ] HESM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:17.235079] [INFO ] [MAIN ] Derivative Progress: 847/1803 symbols completed. HFRO took 1.0s. Estimated remaining: 6m 1s. Rate: 158.8 symbols/min [2025-10-15T22:38:17.236221] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:17.236011] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48517 primary records. [2025-10-15T22:38:17.237083] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-15T22:38:17.268987] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-15T22:38:17.271419] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-15T22:38:17.271194] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-15T22:38:17.274196] [INFO ] [MAIN ] Derivative Progress: 848/1803 symbols completed. HESM took 1.1s. Estimated remaining: 6m 1s. Rate: 158.9 symbols/min [2025-10-15T22:38:17.274697] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:17.275208] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-15T22:38:17.277784] [INFO ] [MAIN ] Derivative Progress: 849/1803 symbols completed. HGER took 1.0s. Estimated remaining: 5m 60s. Rate: 159.1 symbols/min [2025-10-15T22:38:17.281979] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:17.282407] [DEBUG] [LOCAL ] HGLB: Loaded 9584 existing records from primary storage. [2025-10-15T22:38:17.282791] [INFO ] [MAIN ] HGLB: Loaded 9584 primary data records. [2025-10-15T22:38:17.393579] [DEBUG] [LOCAL ] HGTY: Loaded 13285 existing records from primary storage. [2025-10-15T22:38:17.464823] [INFO ] [MAIN ] HGTY: Loaded 13285 primary data records. [2025-10-15T22:38:17.738737] [DEBUG] [LOCAL ] HGV: Loaded 46390 existing records from primary storage. [2025-10-15T22:38:17.749542] [INFO ] [MAIN ] HGV: Loaded 46390 primary data records. [2025-10-15T22:38:18.251750] [DEBUG] [MAIN ] HGLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:18.253260] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9584 primary records. [2025-10-15T22:38:18.253567] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-15T22:38:18.270280] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-15T22:38:18.273761] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-15T22:38:18.275940] [INFO ] [MAIN ] Derivative Progress: 850/1803 symbols completed. HGLB took 1.0s. Estimated remaining: 6m 0s. Rate: 158.8 symbols/min [2025-10-15T22:38:18.276217] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:18.291251] [DEBUG] [MAIN ] HGTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:18.292341] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13285 primary records. [2025-10-15T22:38:18.292586] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-15T22:38:18.334140] [DEBUG] [MAIN ] HGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:18.333519] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-10-15T22:38:18.334349] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-15T22:38:18.338680] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46390 primary records. [2025-10-15T22:38:18.338842] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-15T22:38:18.337582] [INFO ] [MAIN ] Derivative Progress: 851/1803 symbols completed. HGTY took 1.1s. Estimated remaining: 5m 59s. Rate: 159.0 symbols/min [2025-10-15T22:38:18.339029] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:18.364562] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-15T22:38:18.365308] [DEBUG] [LOCAL ] HHH: Loaded 33258 existing records from primary storage. [2025-10-15T22:38:18.365515] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-15T22:38:18.365458] [INFO ] [MAIN ] HHH: Loaded 33258 primary data records. [2025-10-15T22:38:18.368388] [INFO ] [MAIN ] Derivative Progress: 852/1803 symbols completed. HGV took 1.1s. Estimated remaining: 5m 59s. Rate: 159.1 symbols/min [2025-10-15T22:38:18.389143] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:18.689123] [DEBUG] [LOCAL ] HI: Loaded 35761 existing records from primary storage. [2025-10-15T22:38:18.702474] [INFO ] [MAIN ] HI: Loaded 35761 primary data records. [2025-10-15T22:38:18.833502] [DEBUG] [LOCAL ] HIG: Loaded 51192 existing records from primary storage. [2025-10-15T22:38:18.876516] [INFO ] [MAIN ] HIG: Loaded 51192 primary data records. [2025-10-15T22:38:19.387230] [DEBUG] [MAIN ] HHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:19.390331] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 33258 primary records. [2025-10-15T22:38:19.391424] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-15T22:38:19.412704] [DEBUG] [MAIN ] HI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:19.419034] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35761 primary records. [2025-10-15T22:38:19.419462] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-15T22:38:19.437764] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-15T22:38:19.438258] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-15T22:38:19.440728] [INFO ] [MAIN ] Derivative Progress: 853/1803 symbols completed. HHH took 1.2s. Estimated remaining: 5m 59s. Rate: 158.8 symbols/min [2025-10-15T22:38:19.440851] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-15T22:38:19.441044] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-15T22:38:19.443706] [INFO ] [MAIN ] Derivative Progress: 854/1803 symbols completed. HI took 1.1s. Estimated remaining: 5m 58s. Rate: 159.0 symbols/min [2025-10-15T22:38:19.460182] [DEBUG] [MAIN ] HIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:19.460918] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51192 primary records. [2025-10-15T22:38:19.460980] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-15T22:38:19.476443] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-15T22:38:19.476507] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-15T22:38:19.479197] [INFO ] [MAIN ] Derivative Progress: 855/1803 symbols completed. HIG took 1.1s. Estimated remaining: 5m 57s. Rate: 159.2 symbols/min [2025-10-15T22:38:19.479584] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:19.479726] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:19.479832] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:19.513718] [DEBUG] [LOCAL ] HIO: Loaded 24351 existing records from primary storage. [2025-10-15T22:38:19.513873] [INFO ] [MAIN ] HIO: Loaded 24351 primary data records. [2025-10-15T22:38:19.621966] [DEBUG] [LOCAL ] HII: Loaded 33852 existing records from primary storage. [2025-10-15T22:38:19.638945] [INFO ] [MAIN ] HII: Loaded 33852 primary data records. [2025-10-15T22:38:19.922544] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-15T22:38:19.928523] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-15T22:38:20.539064] [DEBUG] [MAIN ] HIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:20.540570] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24351 primary records. [2025-10-15T22:38:20.540925] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-15T22:38:20.577192] [DEBUG] [MAIN ] HII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:20.579587] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 33852 primary records. [2025-10-15T22:38:20.578841] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-15T22:38:20.579996] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-15T22:38:20.580105] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-15T22:38:20.583288] [INFO ] [MAIN ] Derivative Progress: 856/1803 symbols completed. HIO took 1.1s. Estimated remaining: 5m 58s. Rate: 158.8 symbols/min [2025-10-15T22:38:20.584002] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:20.617138] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-15T22:38:20.617674] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-15T22:38:20.619979] [INFO ] [MAIN ] Derivative Progress: 857/1803 symbols completed. HII took 1.1s. Estimated remaining: 5m 57s. Rate: 159.0 symbols/min [2025-10-15T22:38:20.617503] [DEBUG] [MAIN ] HIMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:20.620282] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:20.621278] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-15T22:38:20.627199] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-15T22:38:20.644520] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-15T22:38:20.644838] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-15T22:38:20.647809] [INFO ] [MAIN ] Derivative Progress: 858/1803 symbols completed. HIMS took 1.2s. Estimated remaining: 5m 56s. Rate: 159.1 symbols/min [2025-10-15T22:38:20.656219] [DEBUG] [LOCAL ] HIPO: Loaded 21869 existing records from primary storage. [2025-10-15T22:38:20.654760] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:20.656732] [INFO ] [MAIN ] HIPO: Loaded 21869 primary data records. [2025-10-15T22:38:20.851694] [DEBUG] [LOCAL ] HIX: Loaded 20507 existing records from primary storage. [2025-10-15T22:38:20.881517] [INFO ] [MAIN ] HIX: Loaded 20507 primary data records. [2025-10-15T22:38:20.881408] [DEBUG] [LOCAL ] HIW: Loaded 44595 existing records from primary storage. [2025-10-15T22:38:20.913692] [INFO ] [MAIN ] HIW: Loaded 44595 primary data records. [2025-10-15T22:38:21.671659] [DEBUG] [MAIN ] HIPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:21.672858] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 21869 primary records. [2025-10-15T22:38:21.673049] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-15T22:38:21.690174] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-15T22:38:21.690392] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-15T22:38:21.692988] [INFO ] [MAIN ] Derivative Progress: 859/1803 symbols completed. HIPO took 1.1s. Estimated remaining: 5m 57s. Rate: 158.8 symbols/min [2025-10-15T22:38:21.693480] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:21.711825] [DEBUG] [MAIN ] HIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:21.713951] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20507 primary records. [2025-10-15T22:38:21.714190] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-15T22:38:21.738957] [DEBUG] [MAIN ] HIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:21.745467] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44595 primary records. [2025-10-15T22:38:21.746692] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-15T22:38:21.753470] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-15T22:38:21.754206] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-15T22:38:21.757258] [INFO ] [MAIN ] Derivative Progress: 860/1803 symbols completed. HIX took 1.1s. Estimated remaining: 5m 56s. Rate: 159.0 symbols/min [2025-10-15T22:38:21.758155] [DEBUG] [LOCAL ] HKD: Loaded 18657 existing records from primary storage. [2025-10-15T22:38:21.758522] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:21.758725] [INFO ] [MAIN ] HKD: Loaded 18657 primary data records. [2025-10-15T22:38:21.878063] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-15T22:38:21.878353] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-15T22:38:21.881599] [INFO ] [MAIN ] Derivative Progress: 861/1803 symbols completed. HIW took 1.3s. Estimated remaining: 5m 55s. Rate: 159.1 symbols/min [2025-10-15T22:38:21.892261] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:22.116455] [DEBUG] [LOCAL ] HL: Loaded 53675 existing records from primary storage. [2025-10-15T22:38:22.116971] [INFO ] [MAIN ] HL: Loaded 53675 primary data records. [2025-10-15T22:38:22.325299] [DEBUG] [LOCAL ] HLF: Loaded 48547 existing records from primary storage. [2025-10-15T22:38:22.325582] [INFO ] [MAIN ] HLF: Loaded 48547 primary data records. [2025-10-15T22:38:22.524716] [DEBUG] [MAIN ] HKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:22.558755] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18657 primary records. [2025-10-15T22:38:22.559246] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-15T22:38:22.771122] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-15T22:38:22.771512] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-15T22:38:22.773757] [INFO ] [MAIN ] Derivative Progress: 862/1803 symbols completed. HKD took 1.1s. Estimated remaining: 5m 55s. Rate: 158.8 symbols/min [2025-10-15T22:38:22.774474] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:22.796322] [DEBUG] [MAIN ] HL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:22.797208] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53675 primary records. [2025-10-15T22:38:22.797615] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-15T22:38:22.815986] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-15T22:38:22.825835] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-15T22:38:22.828393] [INFO ] [MAIN ] Derivative Progress: 863/1803 symbols completed. HL took 1.1s. Estimated remaining: 5m 55s. Rate: 159.0 symbols/min [2025-10-15T22:38:22.828708] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:22.842578] [DEBUG] [MAIN ] HLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:22.843331] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48547 primary records. [2025-10-15T22:38:22.843489] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-15T22:38:22.869971] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-15T22:38:22.868849] [DEBUG] [LOCAL ] HLI: Loaded 30847 existing records from primary storage. [2025-10-15T22:38:22.870263] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-15T22:38:22.870377] [INFO ] [MAIN ] HLI: Loaded 30847 primary data records. [2025-10-15T22:38:22.874293] [INFO ] [MAIN ] Derivative Progress: 864/1803 symbols completed. HLF took 1.0s. Estimated remaining: 5m 54s. Rate: 159.2 symbols/min [2025-10-15T22:38:22.874757] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:23.010586] [DEBUG] [LOCAL ] HLIO: Loaded 28238 existing records from primary storage. [2025-10-15T22:38:23.029969] [INFO ] [MAIN ] HLIO: Loaded 28238 primary data records. [2025-10-15T22:38:23.278841] [DEBUG] [LOCAL ] HLLY: Loaded 33508 existing records from primary storage. [2025-10-15T22:38:23.302748] [INFO ] [MAIN ] HLLY: Loaded 33508 primary data records. [2025-10-15T22:38:23.934779] [DEBUG] [MAIN ] HLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:23.936265] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30847 primary records. [2025-10-15T22:38:23.936557] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-15T22:38:23.974622] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-15T22:38:23.990496] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-15T22:38:23.995737] [INFO ] [MAIN ] Derivative Progress: 865/1803 symbols completed. HLI took 1.2s. Estimated remaining: 5m 54s. Rate: 158.8 symbols/min [2025-10-15T22:38:23.990101] [DEBUG] [MAIN ] HLIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:23.997429] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:23.997230] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28238 primary records. [2025-10-15T22:38:23.998102] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-15T22:38:24.031887] [DEBUG] [MAIN ] HLLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:24.034868] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33508 primary records. [2025-10-15T22:38:24.034987] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-15T22:38:24.066936] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-15T22:38:24.069834] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-15T22:38:24.070063] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-15T22:38:24.074270] [INFO ] [MAIN ] Derivative Progress: 866/1803 symbols completed. HLIO took 1.2s. Estimated remaining: 5m 54s. Rate: 158.9 symbols/min [2025-10-15T22:38:24.068997] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-15T22:38:24.080063] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:24.080606] [INFO ] [MAIN ] Derivative Progress: 867/1803 symbols completed. HLLY took 1.2s. Estimated remaining: 5m 53s. Rate: 159.1 symbols/min [2025-10-15T22:38:24.080989] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:24.160793] [DEBUG] [LOCAL ] HLN: Loaded 53123 existing records from primary storage. [2025-10-15T22:38:24.161095] [INFO ] [MAIN ] HLN: Loaded 53123 primary data records. [2025-10-15T22:38:24.366365] [DEBUG] [LOCAL ] HLX: Loaded 47471 existing records from primary storage. [2025-10-15T22:38:24.407206] [INFO ] [MAIN ] HLX: Loaded 47471 primary data records. [2025-10-15T22:38:24.407061] [DEBUG] [LOCAL ] HLT: Loaded 50527 existing records from primary storage. [2025-10-15T22:38:24.407401] [INFO ] [MAIN ] HLT: Loaded 50527 primary data records. [2025-10-15T22:38:25.336812] [DEBUG] [MAIN ] HLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:25.337854] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53123 primary records. [2025-10-15T22:38:25.338082] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-15T22:38:25.357100] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-15T22:38:25.359173] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-15T22:38:25.369342] [INFO ] [MAIN ] Derivative Progress: 868/1803 symbols completed. HLN took 1.4s. Estimated remaining: 5m 54s. Rate: 158.7 symbols/min [2025-10-15T22:38:25.374880] [DEBUG] [MAIN ] HLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:25.375783] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47471 primary records. [2025-10-15T22:38:25.388285] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-15T22:38:25.388558] [DEBUG] [MAIN ] HLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:25.390251] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50527 primary records. [2025-10-15T22:38:25.396896] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-15T22:38:25.405240] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-15T22:38:25.405540] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-15T22:38:25.417151] [INFO ] [MAIN ] Derivative Progress: 869/1803 symbols completed. HLX took 1.3s. Estimated remaining: 5m 53s. Rate: 158.8 symbols/min [2025-10-15T22:38:25.423787] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-15T22:38:25.423880] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-15T22:38:25.427192] [INFO ] [MAIN ] Derivative Progress: 870/1803 symbols completed. HLT took 1.3s. Estimated remaining: 5m 52s. Rate: 159.0 symbols/min [2025-10-15T22:38:25.427846] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:25.427991] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:25.427782] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:25.453582] [DEBUG] [LOCAL ] HMN: Loaded 23512 existing records from primary storage. [2025-10-15T22:38:25.453828] [INFO ] [MAIN ] HMN: Loaded 23512 primary data records. [2025-10-15T22:38:25.671478] [DEBUG] [LOCAL ] HMC: Loaded 46489 existing records from primary storage. [2025-10-15T22:38:25.693014] [INFO ] [MAIN ] HMC: Loaded 46489 primary data records. [2025-10-15T22:38:25.831984] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-15T22:38:25.876694] [INFO ] [MAIN ] HMY: Loaded 53166 primary data records. [2025-10-15T22:38:26.455102] [DEBUG] [MAIN ] HMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:26.456126] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23512 primary records. [2025-10-15T22:38:26.456430] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-15T22:38:26.474668] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-15T22:38:26.482226] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-15T22:38:26.490441] [DEBUG] [MAIN ] HMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:26.490111] [INFO ] [MAIN ] Derivative Progress: 871/1803 symbols completed. HMN took 1.1s. Estimated remaining: 5m 52s. Rate: 158.7 symbols/min [2025-10-15T22:38:26.491345] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46489 primary records. [2025-10-15T22:38:26.491493] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-15T22:38:26.491614] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:26.510043] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-15T22:38:26.510279] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-15T22:38:26.520686] [INFO ] [MAIN ] Derivative Progress: 872/1803 symbols completed. HMC took 1.1s. Estimated remaining: 5m 52s. Rate: 158.9 symbols/min [2025-10-15T22:38:26.526052] [DEBUG] [MAIN ] HMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:26.526813] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53166 primary records. [2025-10-15T22:38:26.527013] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:26.527456] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-15T22:38:26.551752] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-15T22:38:26.551970] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-15T22:38:26.554674] [INFO ] [MAIN ] Derivative Progress: 873/1803 symbols completed. HMY took 1.1s. Estimated remaining: 5m 51s. Rate: 159.0 symbols/min [2025-10-15T22:38:26.554969] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:26.566765] [DEBUG] [LOCAL ] HNI: Loaded 29627 existing records from primary storage. [2025-10-15T22:38:26.566974] [INFO ] [MAIN ] HNI: Loaded 29627 primary data records. [2025-10-15T22:38:26.906242] [DEBUG] [LOCAL ] HOMB: Loaded 43633 existing records from primary storage. [2025-10-15T22:38:26.906613] [INFO ] [MAIN ] HOMB: Loaded 43633 primary data records. [2025-10-15T22:38:27.019767] [DEBUG] [LOCAL ] HOG: Loaded 50849 existing records from primary storage. [2025-10-15T22:38:27.031129] [INFO ] [MAIN ] HOG: Loaded 50849 primary data records. [2025-10-15T22:38:27.604375] [DEBUG] [MAIN ] HNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:27.605343] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29627 primary records. [2025-10-15T22:38:27.605919] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-15T22:38:27.625241] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-15T22:38:27.625798] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-15T22:38:27.628049] [INFO ] [MAIN ] Derivative Progress: 874/1803 symbols completed. HNI took 1.1s. Estimated remaining: 5m 51s. Rate: 158.7 symbols/min [2025-10-15T22:38:27.628783] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:27.657544] [DEBUG] [MAIN ] HOMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:27.658687] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43633 primary records. [2025-10-15T22:38:27.658950] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-15T22:38:27.686988] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-15T22:38:27.709281] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-15T22:38:27.712360] [DEBUG] [MAIN ] HOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:27.711932] [INFO ] [MAIN ] Derivative Progress: 875/1803 symbols completed. HOMB took 1.2s. Estimated remaining: 5m 51s. Rate: 158.8 symbols/min [2025-10-15T22:38:27.712631] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:27.713445] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 50849 primary records. [2025-10-15T22:38:27.713963] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-15T22:38:27.745208] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-15T22:38:27.749556] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-15T22:38:27.750551] [DEBUG] [LOCAL ] HOUS: Loaded 45340 existing records from primary storage. [2025-10-15T22:38:27.753351] [INFO ] [MAIN ] Derivative Progress: 876/1803 symbols completed. HOG took 1.2s. Estimated remaining: 5m 50s. Rate: 159.0 symbols/min [2025-10-15T22:38:27.753547] [INFO ] [MAIN ] HOUS: Loaded 45340 primary data records. [2025-10-15T22:38:27.753688] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:27.829792] [DEBUG] [LOCAL ] HOV: Loaded 14032 existing records from primary storage. [2025-10-15T22:38:27.841608] [INFO ] [MAIN ] HOV: Loaded 14032 primary data records. [2025-10-15T22:38:28.423331] [DEBUG] [LOCAL ] HP: Loaded 51543 existing records from primary storage. [2025-10-15T22:38:28.424028] [INFO ] [MAIN ] HP: Loaded 51543 primary data records. [2025-10-15T22:38:28.626587] [DEBUG] [MAIN ] HOUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:28.739243] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 45340 primary records. [2025-10-15T22:38:28.748105] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-15T22:38:28.783052] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-15T22:38:28.784209] [DEBUG] [MAIN ] HOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:28.785081] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 14032 primary records. [2025-10-15T22:38:28.783877] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-15T22:38:28.788322] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-15T22:38:28.788257] [INFO ] [MAIN ] Derivative Progress: 877/1803 symbols completed. HOUS took 1.2s. Estimated remaining: 5m 50s. Rate: 158.7 symbols/min [2025-10-15T22:38:28.790476] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:28.807910] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-10-15T22:38:28.808221] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-15T22:38:28.810278] [INFO ] [MAIN ] Derivative Progress: 878/1803 symbols completed. HOV took 1.1s. Estimated remaining: 5m 49s. Rate: 158.8 symbols/min [2025-10-15T22:38:28.810609] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:28.831373] [DEBUG] [MAIN ] HP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:28.835204] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51543 primary records. [2025-10-15T22:38:28.835544] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-15T22:38:28.835496] [DEBUG] [LOCAL ] HPF: Loaded 7499 existing records from primary storage. [2025-10-15T22:38:28.835897] [INFO ] [MAIN ] HPF: Loaded 7499 primary data records. [2025-10-15T22:38:28.977493] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-15T22:38:28.993744] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-15T22:38:29.046844] [INFO ] [MAIN ] Derivative Progress: 879/1803 symbols completed. HP took 1.3s. Estimated remaining: 5m 49s. Rate: 158.9 symbols/min [2025-10-15T22:38:29.061758] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:29.177290] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-15T22:38:29.178059] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-15T22:38:29.296894] [DEBUG] [LOCAL ] HPI: Loaded 10655 existing records from primary storage. [2025-10-15T22:38:29.331690] [INFO ] [MAIN ] HPI: Loaded 10655 primary data records. [2025-10-15T22:38:29.847480] [DEBUG] [MAIN ] HPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:29.849327] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7499 primary records. [2025-10-15T22:38:29.849619] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-15T22:38:29.871256] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-15T22:38:29.871580] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-15T22:38:29.886122] [INFO ] [MAIN ] Derivative Progress: 880/1803 symbols completed. HPF took 1.1s. Estimated remaining: 5m 49s. Rate: 158.7 symbols/min [2025-10-15T22:38:29.886618] [DEBUG] [MAIN ] HPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:29.886297] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:29.887593] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-15T22:38:29.888134] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-15T22:38:29.906430] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-15T22:38:29.907381] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-15T22:38:29.909545] [INFO ] [MAIN ] Derivative Progress: 881/1803 symbols completed. HPE took 1.1s. Estimated remaining: 5m 48s. Rate: 158.9 symbols/min [2025-10-15T22:38:29.909914] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:29.924312] [DEBUG] [MAIN ] HPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:29.925256] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10655 primary records. [2025-10-15T22:38:29.925463] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-15T22:38:29.945336] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-15T22:38:29.945567] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-15T22:38:29.948212] [INFO ] [MAIN ] Derivative Progress: 882/1803 symbols completed. HPI took 0.9s. Estimated remaining: 5m 48s. Rate: 159.0 symbols/min [2025-10-15T22:38:29.962060] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:29.988528] [DEBUG] [LOCAL ] HPS: Loaded 10310 existing records from primary storage. [2025-10-15T22:38:30.001631] [INFO ] [MAIN ] HPS: Loaded 10310 primary data records. [2025-10-15T22:38:30.060176] [DEBUG] [LOCAL ] HPP: Loaded 51192 existing records from primary storage. [2025-10-15T22:38:30.099707] [INFO ] [MAIN ] HPP: Loaded 51192 primary data records. [2025-10-15T22:38:30.165295] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-15T22:38:30.206775] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-10-15T22:38:30.945129] [DEBUG] [MAIN ] HPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:30.946772] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10310 primary records. [2025-10-15T22:38:30.947978] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-15T22:38:30.979511] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-15T22:38:30.979713] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-15T22:38:30.982174] [INFO ] [MAIN ] Derivative Progress: 883/1803 symbols completed. HPS took 1.0s. Estimated remaining: 5m 48s. Rate: 158.7 symbols/min [2025-10-15T22:38:30.980275] [DEBUG] [MAIN ] HPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:30.983447] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51192 primary records. [2025-10-15T22:38:30.983539] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-15T22:38:31.014198] [DEBUG] [MAIN ] HPQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:31.015467] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-15T22:38:31.016172] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53669 primary records. [2025-10-15T22:38:31.016333] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-15T22:38:31.016272] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-15T22:38:31.019486] [INFO ] [MAIN ] Derivative Progress: 884/1803 symbols completed. HPP took 1.1s. Estimated remaining: 5m 47s. Rate: 158.9 symbols/min [2025-10-15T22:38:31.034567] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-15T22:38:31.034701] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-15T22:38:31.037733] [INFO ] [MAIN ] Derivative Progress: 885/1803 symbols completed. HPQ took 1.1s. Estimated remaining: 5m 46s. Rate: 159.0 symbols/min [2025-10-15T22:38:31.038321] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:31.038207] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:31.038773] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:31.066294] [DEBUG] [LOCAL ] HQL: Loaded 16872 existing records from primary storage. [2025-10-15T22:38:31.066801] [INFO ] [MAIN ] HQL: Loaded 16872 primary data records. [2025-10-15T22:38:31.161323] [DEBUG] [LOCAL ] HQH: Loaded 25800 existing records from primary storage. [2025-10-15T22:38:31.177636] [INFO ] [MAIN ] HQH: Loaded 25800 primary data records. [2025-10-15T22:38:31.500758] [DEBUG] [LOCAL ] HR: Loaded 52106 existing records from primary storage. [2025-10-15T22:38:31.527432] [INFO ] [MAIN ] HR: Loaded 52106 primary data records. [2025-10-15T22:38:32.068052] [DEBUG] [MAIN ] HQL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:32.069238] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16872 primary records. [2025-10-15T22:38:32.076777] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-15T22:38:32.081850] [DEBUG] [MAIN ] HQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:32.083529] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25800 primary records. [2025-10-15T22:38:32.084522] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-15T22:38:32.115998] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-15T22:38:32.117399] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-15T22:38:32.117661] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-15T22:38:32.120047] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-15T22:38:32.119982] [INFO ] [MAIN ] Derivative Progress: 886/1803 symbols completed. HQL took 1.1s. Estimated remaining: 5m 47s. Rate: 158.7 symbols/min [2025-10-15T22:38:32.122814] [INFO ] [MAIN ] Derivative Progress: 887/1803 symbols completed. HQH took 1.1s. Estimated remaining: 5m 46s. Rate: 158.9 symbols/min [2025-10-15T22:38:32.122399] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:32.123559] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:32.140825] [DEBUG] [MAIN ] HR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:32.141524] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 52106 primary records. [2025-10-15T22:38:32.141636] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-15T22:38:32.159567] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-15T22:38:32.167385] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-15T22:38:32.169994] [INFO ] [MAIN ] Derivative Progress: 888/1803 symbols completed. HR took 1.1s. Estimated remaining: 5m 45s. Rate: 159.0 symbols/min [2025-10-15T22:38:32.170323] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:32.193716] [DEBUG] [LOCAL ] HRI: Loaded 32443 existing records from primary storage. [2025-10-15T22:38:32.194423] [INFO ] [MAIN ] HRI: Loaded 32443 primary data records. [2025-10-15T22:38:32.274889] [DEBUG] [LOCAL ] HRB: Loaded 48404 existing records from primary storage. [2025-10-15T22:38:32.287540] [INFO ] [MAIN ] HRB: Loaded 48404 primary data records. [2025-10-15T22:38:32.733847] [DEBUG] [LOCAL ] HRL: Loaded 53128 existing records from primary storage. [2025-10-15T22:38:32.849176] [INFO ] [MAIN ] HRL: Loaded 53128 primary data records. [2025-10-15T22:38:33.176511] [DEBUG] [MAIN ] HRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:33.177707] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32443 primary records. [2025-10-15T22:38:33.177985] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-15T22:38:33.191374] [DEBUG] [MAIN ] HRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:33.192407] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48404 primary records. [2025-10-15T22:38:33.192797] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-15T22:38:33.220509] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-10-15T22:38:33.220854] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-15T22:38:33.224908] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-15T22:38:33.227270] [INFO ] [MAIN ] Derivative Progress: 889/1803 symbols completed. HRI took 1.1s. Estimated remaining: 5m 46s. Rate: 158.7 symbols/min [2025-10-15T22:38:33.227492] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:33.225105] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-15T22:38:33.230598] [INFO ] [MAIN ] Derivative Progress: 890/1803 symbols completed. HRB took 1.1s. Estimated remaining: 5m 45s. Rate: 158.9 symbols/min [2025-10-15T22:38:33.231155] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:33.248852] [DEBUG] [MAIN ] HRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:33.249726] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53128 primary records. [2025-10-15T22:38:33.249801] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-15T22:38:33.267180] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-15T22:38:33.267470] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-15T22:38:33.270323] [INFO ] [MAIN ] Derivative Progress: 891/1803 symbols completed. HRL took 1.1s. Estimated remaining: 5m 44s. Rate: 159.1 symbols/min [2025-10-15T22:38:33.270709] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:33.308911] [DEBUG] [LOCAL ] HRTG: Loaded 34367 existing records from primary storage. [2025-10-15T22:38:33.309092] [INFO ] [MAIN ] HRTG: Loaded 34367 primary data records. [2025-10-15T22:38:33.359375] [DEBUG] [LOCAL ] HSHP: Loaded 14871 existing records from primary storage. [2025-10-15T22:38:33.381717] [INFO ] [MAIN ] HSHP: Loaded 14871 primary data records. [2025-10-15T22:38:33.505128] [DEBUG] [LOCAL ] HSBC: Loaded 51004 existing records from primary storage. [2025-10-15T22:38:33.550509] [INFO ] [MAIN ] HSBC: Loaded 51004 primary data records. [2025-10-15T22:38:34.265253] [DEBUG] [MAIN ] HRTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:34.270136] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 34367 primary records. [2025-10-15T22:38:34.270238] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-15T22:38:34.303101] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-15T22:38:34.303573] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-15T22:38:34.305752] [INFO ] [MAIN ] Derivative Progress: 892/1803 symbols completed. HRTG took 1.1s. Estimated remaining: 5m 44s. Rate: 158.7 symbols/min [2025-10-15T22:38:34.319321] [DEBUG] [MAIN ] HSHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:34.319118] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:34.320524] [DEBUG] [MAIN ] HSBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:34.320266] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 14871 primary records. [2025-10-15T22:38:34.321710] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51004 primary records. [2025-10-15T22:38:34.321021] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-15T22:38:34.322457] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-15T22:38:34.349903] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-15T22:38:34.350505] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-15T22:38:34.353112] [INFO ] [MAIN ] Derivative Progress: 893/1803 symbols completed. HSHP took 1.1s. Estimated remaining: 5m 44s. Rate: 158.9 symbols/min [2025-10-15T22:38:34.353341] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:34.357629] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-15T22:38:34.357877] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-15T22:38:34.360407] [INFO ] [MAIN ] Derivative Progress: 894/1803 symbols completed. HSBC took 1.1s. Estimated remaining: 5m 43s. Rate: 159.1 symbols/min [2025-10-15T22:38:34.360591] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:34.371757] [DEBUG] [LOCAL ] HTD: Loaded 14172 existing records from primary storage. [2025-10-15T22:38:34.372032] [INFO ] [MAIN ] HTD: Loaded 14172 primary data records. [2025-10-15T22:38:34.551836] [DEBUG] [LOCAL ] HSY: Loaded 50437 existing records from primary storage. [2025-10-15T22:38:34.562733] [INFO ] [MAIN ] HSY: Loaded 50437 primary data records. [2025-10-15T22:38:34.819955] [DEBUG] [LOCAL ] HTGC: Loaded 47734 existing records from primary storage. [2025-10-15T22:38:34.820830] [INFO ] [MAIN ] HTGC: Loaded 47734 primary data records. [2025-10-15T22:38:35.439504] [DEBUG] [MAIN ] HTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:35.442048] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 14172 primary records. [2025-10-15T22:38:35.442151] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-15T22:38:35.460693] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-15T22:38:35.461016] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-15T22:38:35.463520] [INFO ] [MAIN ] Derivative Progress: 895/1803 symbols completed. HTD took 1.1s. Estimated remaining: 5m 43s. Rate: 158.7 symbols/min [2025-10-15T22:38:35.464082] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:35.486451] [DEBUG] [MAIN ] HSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:35.487749] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50437 primary records. [2025-10-15T22:38:35.487823] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-15T22:38:35.541136] [DEBUG] [LOCAL ] HTH: Loaded 32576 existing records from primary storage. [2025-10-15T22:38:35.542376] [INFO ] [MAIN ] HTH: Loaded 32576 primary data records. [2025-10-15T22:38:35.542003] [DEBUG] [MAIN ] HTGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:35.555519] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47734 primary records. [2025-10-15T22:38:35.566203] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-15T22:38:35.583902] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-15T22:38:35.611345] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-15T22:38:35.622864] [INFO ] [MAIN ] Derivative Progress: 896/1803 symbols completed. HSY took 1.3s. Estimated remaining: 5m 43s. Rate: 158.8 symbols/min [2025-10-15T22:38:35.628401] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:35.674997] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-15T22:38:35.675248] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-15T22:38:35.678784] [INFO ] [MAIN ] Derivative Progress: 897/1803 symbols completed. HTGC took 1.3s. Estimated remaining: 5m 42s. Rate: 159.0 symbols/min [2025-10-15T22:38:35.679410] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:35.925341] [DEBUG] [LOCAL ] HUBB: Loaded 36510 existing records from primary storage. [2025-10-15T22:38:35.925751] [INFO ] [MAIN ] HUBB: Loaded 36510 primary data records. [2025-10-15T22:38:35.953257] [DEBUG] [LOCAL ] HUBS: Loaded 40051 existing records from primary storage. [2025-10-15T22:38:35.980560] [INFO ] [MAIN ] HUBS: Loaded 40051 primary data records. [2025-10-15T22:38:36.533506] [DEBUG] [MAIN ] HTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:36.582264] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32576 primary records. [2025-10-15T22:38:36.582970] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-15T22:38:36.605331] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-15T22:38:36.605897] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-15T22:38:36.612616] [INFO ] [MAIN ] Derivative Progress: 898/1803 symbols completed. HTH took 1.1s. Estimated remaining: 5m 42s. Rate: 158.7 symbols/min [2025-10-15T22:38:36.636611] [DEBUG] [MAIN ] HUBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:36.637511] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36510 primary records. [2025-10-15T22:38:36.649776] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-15T22:38:36.650349] [DEBUG] [MAIN ] HUBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:36.651383] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 40051 primary records. [2025-10-15T22:38:36.651616] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-15T22:38:36.681235] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-10-15T22:38:36.682317] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-15T22:38:36.682428] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-15T22:38:36.685139] [INFO ] [MAIN ] Derivative Progress: 899/1803 symbols completed. HUBS took 1.0s. Estimated remaining: 5m 41s. Rate: 158.9 symbols/min [2025-10-15T22:38:36.685254] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-15T22:38:36.688031] [INFO ] [MAIN ] Derivative Progress: 900/1803 symbols completed. HUBB took 1.1s. Estimated remaining: 5m 41s. Rate: 159.0 symbols/min [2025-10-15T22:38:36.688625] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:36.688750] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:36.688934] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:36.782330] [DEBUG] [LOCAL ] HUYA: Loaded 43809 existing records from primary storage. [2025-10-15T22:38:36.782527] [INFO ] [MAIN ] HUYA: Loaded 43809 primary data records. [2025-10-15T22:38:36.783258] [DEBUG] [LOCAL ] HUM: Loaded 49309 existing records from primary storage. [2025-10-15T22:38:36.796143] [INFO ] [MAIN ] HUM: Loaded 49309 primary data records. [2025-10-15T22:38:36.952523] [DEBUG] [LOCAL ] HUN: Loaded 53214 existing records from primary storage. [2025-10-15T22:38:36.979757] [INFO ] [MAIN ] HUN: Loaded 53214 primary data records. [2025-10-15T22:38:37.827444] [DEBUG] [MAIN ] HUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:37.828340] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 49309 primary records. [2025-10-15T22:38:37.828686] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-15T22:38:37.845488] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-10-15T22:38:37.848168] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-15T22:38:37.850860] [INFO ] [MAIN ] Derivative Progress: 901/1803 symbols completed. HUM took 1.2s. Estimated remaining: 5m 41s. Rate: 158.7 symbols/min [2025-10-15T22:38:37.851195] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:37.865789] [DEBUG] [MAIN ] HUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:37.866764] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53214 primary records. [2025-10-15T22:38:37.869112] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-15T22:38:37.895087] [DEBUG] [MAIN ] HUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:37.902053] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-15T22:38:37.902458] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-15T22:38:37.907594] [DEBUG] [LOCAL ] HVT: Loaded 15120 existing records from primary storage. [2025-10-15T22:38:37.908418] [INFO ] [MAIN ] HVT: Loaded 15120 primary data records. [2025-10-15T22:38:37.908306] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43809 primary records. [2025-10-15T22:38:37.911292] [INFO ] [MAIN ] Derivative Progress: 902/1803 symbols completed. HUN took 1.2s. Estimated remaining: 5m 40s. Rate: 158.8 symbols/min [2025-10-15T22:38:37.911453] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:37.911505] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-15T22:38:37.964086] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-15T22:38:38.003711] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-15T22:38:38.033976] [INFO ] [MAIN ] Derivative Progress: 903/1803 symbols completed. HUYA took 1.3s. Estimated remaining: 5m 40s. Rate: 158.9 symbols/min [2025-10-15T22:38:38.034343] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:38.277550] [DEBUG] [LOCAL ] HWM: Loaded 52813 existing records from primary storage. [2025-10-15T22:38:38.278019] [INFO ] [MAIN ] HWM: Loaded 52813 primary data records. [2025-10-15T22:38:38.373959] [DEBUG] [LOCAL ] HXL: Loaded 45841 existing records from primary storage. [2025-10-15T22:38:38.399399] [INFO ] [MAIN ] HXL: Loaded 45841 primary data records. [2025-10-15T22:38:38.589488] [DEBUG] [MAIN ] HVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:38.707733] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15120 primary records. [2025-10-15T22:38:38.733284] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-15T22:38:38.929954] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-15T22:38:38.930129] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-15T22:38:38.932672] [INFO ] [MAIN ] Derivative Progress: 904/1803 symbols completed. HVT took 1.1s. Estimated remaining: 5m 40s. Rate: 158.7 symbols/min [2025-10-15T22:38:38.933090] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:38.948976] [DEBUG] [LOCAL ] HY: Loaded 10057 existing records from primary storage. [2025-10-15T22:38:38.950042] [INFO ] [MAIN ] HY: Loaded 10057 primary data records. [2025-10-15T22:38:39.098024] [DEBUG] [MAIN ] HWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:39.124239] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52813 primary records. [2025-10-15T22:38:39.138424] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-15T22:38:39.144078] [DEBUG] [MAIN ] HXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:39.150678] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45841 primary records. [2025-10-15T22:38:39.150797] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-15T22:38:39.195057] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-15T22:38:39.235925] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-15T22:38:39.267299] [INFO ] [MAIN ] Derivative Progress: 905/1803 symbols completed. HWM took 1.4s. Estimated remaining: 5m 39s. Rate: 158.7 symbols/min [2025-10-15T22:38:39.267987] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:39.391502] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-15T22:38:39.393140] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-15T22:38:39.395718] [INFO ] [MAIN ] Derivative Progress: 906/1803 symbols completed. HXL took 1.4s. Estimated remaining: 5m 39s. Rate: 158.8 symbols/min [2025-10-15T22:38:39.400055] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:39.400305] [DEBUG] [LOCAL ] HYI: Loaded 9824 existing records from primary storage. [2025-10-15T22:38:39.400885] [INFO ] [MAIN ] HYI: Loaded 9824 primary data records. [2025-10-15T22:38:39.750259] [DEBUG] [LOCAL ] HYT: Loaded 33599 existing records from primary storage. [2025-10-15T22:38:39.750990] [INFO ] [MAIN ] HYT: Loaded 33599 primary data records. [2025-10-15T22:38:39.837415] [DEBUG] [MAIN ] HY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:39.851518] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10057 primary records. [2025-10-15T22:38:39.876957] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-15T22:38:40.085079] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-15T22:38:40.094085] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-15T22:38:40.096394] [INFO ] [MAIN ] Derivative Progress: 907/1803 symbols completed. HY took 1.2s. Estimated remaining: 5m 39s. Rate: 158.7 symbols/min [2025-10-15T22:38:40.096709] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:40.120048] [DEBUG] [LOCAL ] HYTR: Loaded 3132 existing records from primary storage. [2025-10-15T22:38:40.119818] [DEBUG] [MAIN ] HYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:40.121876] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9824 primary records. [2025-10-15T22:38:40.122041] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-15T22:38:40.120702] [INFO ] [MAIN ] HYTR: Loaded 3132 primary data records. [2025-10-15T22:38:40.208733] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-15T22:38:40.225622] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-15T22:38:40.241959] [INFO ] [MAIN ] Derivative Progress: 908/1803 symbols completed. HYI took 1.0s. Estimated remaining: 5m 38s. Rate: 158.8 symbols/min [2025-10-15T22:38:40.247853] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:40.481696] [DEBUG] [MAIN ] HYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:40.482495] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33599 primary records. [2025-10-15T22:38:40.483019] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-15T22:38:40.493881] [DEBUG] [LOCAL ] HZO: Loaded 29081 existing records from primary storage. [2025-10-15T22:38:40.494430] [INFO ] [MAIN ] HZO: Loaded 29081 primary data records. [2025-10-15T22:38:40.554771] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-15T22:38:40.567055] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-15T22:38:40.569664] [INFO ] [MAIN ] Derivative Progress: 909/1803 symbols completed. HYT took 1.2s. Estimated remaining: 5m 38s. Rate: 158.8 symbols/min [2025-10-15T22:38:40.578811] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:40.631473] [DEBUG] [LOCAL ] IAE: Loaded 6256 existing records from primary storage. [2025-10-15T22:38:40.659758] [INFO ] [MAIN ] IAE: Loaded 6256 primary data records. [2025-10-15T22:38:40.665246] [DEBUG] [MAIN ] HYTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:38:40.699860] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3132 primary records. [2025-10-15T22:38:40.894566] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-15T22:38:40.950973] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-15T22:38:40.956320] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-15T22:38:40.969766] [INFO ] [MAIN ] Derivative Progress: 910/1803 symbols completed. HYTR took 0.9s. Estimated remaining: 5m 37s. Rate: 158.8 symbols/min [2025-10-15T22:38:40.975025] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:41.173626] [DEBUG] [MAIN ] HZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:41.174529] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29081 primary records. [2025-10-15T22:38:41.174926] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-15T22:38:41.204566] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-15T22:38:41.204944] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-15T22:38:41.207042] [INFO ] [MAIN ] Derivative Progress: 911/1803 symbols completed. HZO took 1.0s. Estimated remaining: 5m 37s. Rate: 158.9 symbols/min [2025-10-15T22:38:41.207247] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:41.241194] [DEBUG] [MAIN ] IAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:41.242000] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6256 primary records. [2025-10-15T22:38:41.240935] [DEBUG] [LOCAL ] IAG: Loaded 53488 existing records from primary storage. [2025-10-15T22:38:41.242163] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-15T22:38:41.242274] [INFO ] [MAIN ] IAG: Loaded 53488 primary data records. [2025-10-15T22:38:41.313696] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-15T22:38:41.322376] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-15T22:38:41.324774] [INFO ] [MAIN ] Derivative Progress: 912/1803 symbols completed. IAE took 0.7s. Estimated remaining: 5m 36s. Rate: 159.0 symbols/min [2025-10-15T22:38:41.337423] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:41.623345] [DEBUG] [LOCAL ] IBM: Loaded 53633 existing records from primary storage. [2025-10-15T22:38:41.636418] [INFO ] [MAIN ] IBM: Loaded 53633 primary data records. [2025-10-15T22:38:41.757802] [DEBUG] [LOCAL ] IBN: Loaded 52819 existing records from primary storage. [2025-10-15T22:38:41.758304] [INFO ] [MAIN ] IBN: Loaded 52819 primary data records. [2025-10-15T22:38:42.269929] [DEBUG] [MAIN ] IAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:42.271047] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53488 primary records. [2025-10-15T22:38:42.271327] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-15T22:38:42.290667] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-15T22:38:42.291083] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-15T22:38:42.293395] [INFO ] [MAIN ] Derivative Progress: 913/1803 symbols completed. IAG took 1.3s. Estimated remaining: 5m 36s. Rate: 158.7 symbols/min [2025-10-15T22:38:42.310258] [DEBUG] [MAIN ] IBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:42.311281] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53633 primary records. [2025-10-15T22:38:42.311475] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-15T22:38:42.328570] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-15T22:38:42.328695] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-15T22:38:42.331273] [INFO ] [MAIN ] Derivative Progress: 914/1803 symbols completed. IBM took 1.1s. Estimated remaining: 5m 36s. Rate: 158.9 symbols/min [2025-10-15T22:38:42.347012] [DEBUG] [MAIN ] IBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:42.347537] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52819 primary records. [2025-10-15T22:38:42.347597] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-15T22:38:42.362909] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-15T22:38:42.362970] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-15T22:38:42.365009] [INFO ] [MAIN ] Derivative Progress: 915/1803 symbols completed. IBN took 1.0s. Estimated remaining: 5m 35s. Rate: 159.0 symbols/min [2025-10-15T22:38:42.365510] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:42.365621] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:42.365419] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:42.417149] [DEBUG] [LOCAL ] IBP: Loaded 28891 existing records from primary storage. [2025-10-15T22:38:42.417289] [INFO ] [MAIN ] IBP: Loaded 28891 primary data records. [2025-10-15T22:38:42.546959] [DEBUG] [LOCAL ] ICE: Loaded 53018 existing records from primary storage. [2025-10-15T22:38:42.547418] [INFO ] [MAIN ] ICE: Loaded 53018 primary data records. [2025-10-15T22:38:42.546232] [DEBUG] [LOCAL ] IBTA: Loaded 36655 existing records from primary storage. [2025-10-15T22:38:42.563844] [INFO ] [MAIN ] IBTA: Loaded 36655 primary data records. [2025-10-15T22:38:43.355266] [DEBUG] [MAIN ] IBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:43.356192] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28891 primary records. [2025-10-15T22:38:43.356597] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-15T22:38:43.378996] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-15T22:38:43.379396] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-15T22:38:43.405584] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:43.407548] [INFO ] [MAIN ] Derivative Progress: 916/1803 symbols completed. IBP took 1.0s. Estimated remaining: 5m 35s. Rate: 158.7 symbols/min [2025-10-15T22:38:43.407977] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:43.409795] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 36655 primary records. [2025-10-15T22:38:43.409091] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:43.408955] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53018 primary records. [2025-10-15T22:38:43.410466] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-15T22:38:43.410273] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-15T22:38:43.444164] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-15T22:38:43.444981] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-15T22:38:43.447387] [INFO ] [MAIN ] Derivative Progress: 917/1803 symbols completed. ICE took 1.1s. Estimated remaining: 5m 35s. Rate: 158.9 symbols/min [2025-10-15T22:38:43.448029] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:43.449571] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-15T22:38:43.449781] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-15T22:38:43.452460] [INFO ] [MAIN ] Derivative Progress: 918/1803 symbols completed. IBTA took 1.1s. Estimated remaining: 5m 34s. Rate: 159.1 symbols/min [2025-10-15T22:38:43.453034] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:43.486183] [DEBUG] [LOCAL ] IDE: Loaded 9108 existing records from primary storage. [2025-10-15T22:38:43.487128] [DEBUG] [LOCAL ] ICL: Loaded 38552 existing records from primary storage. [2025-10-15T22:38:43.493903] [INFO ] [MAIN ] ICL: Loaded 38552 primary data records. [2025-10-15T22:38:43.486407] [INFO ] [MAIN ] IDE: Loaded 9108 primary data records. [2025-10-15T22:38:43.678130] [DEBUG] [LOCAL ] IDA: Loaded 32824 existing records from primary storage. [2025-10-15T22:38:43.729800] [INFO ] [MAIN ] IDA: Loaded 32824 primary data records. [2025-10-15T22:38:44.530303] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:44.531456] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38552 primary records. [2025-10-15T22:38:44.531564] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-15T22:38:44.530045] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:44.532944] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 9108 primary records. [2025-10-15T22:38:44.533043] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-15T22:38:44.583453] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:44.584475] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-15T22:38:44.586113] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32824 primary records. [2025-10-15T22:38:44.585336] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-15T22:38:44.586221] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-15T22:38:44.586345] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-15T22:38:44.586464] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-15T22:38:44.589762] [INFO ] [MAIN ] Derivative Progress: 919/1803 symbols completed. IDE took 1.1s. Estimated remaining: 5m 34s. Rate: 158.7 symbols/min [2025-10-15T22:38:44.591753] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:44.592597] [INFO ] [MAIN ] Derivative Progress: 920/1803 symbols completed. ICL took 1.2s. Estimated remaining: 5m 33s. Rate: 158.9 symbols/min [2025-10-15T22:38:44.600596] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:44.610373] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-15T22:38:44.610484] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-15T22:38:44.612866] [INFO ] [MAIN ] Derivative Progress: 921/1803 symbols completed. IDA took 1.2s. Estimated remaining: 5m 33s. Rate: 159.0 symbols/min [2025-10-15T22:38:44.613207] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:44.629381] [DEBUG] [LOCAL ] IDT: Loaded 18488 existing records from primary storage. [2025-10-15T22:38:44.629544] [INFO ] [MAIN ] IDT: Loaded 18488 primary data records. [2025-10-15T22:38:44.997153] [DEBUG] [LOCAL ] IEX: Loaded 38458 existing records from primary storage. [2025-10-15T22:38:44.997490] [INFO ] [MAIN ] IEX: Loaded 38458 primary data records. [2025-10-15T22:38:45.064759] [DEBUG] [LOCAL ] IFF: Loaded 51147 existing records from primary storage. [2025-10-15T22:38:45.070493] [INFO ] [MAIN ] IFF: Loaded 51147 primary data records. [2025-10-15T22:38:45.703187] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:45.704141] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18488 primary records. [2025-10-15T22:38:45.705301] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-15T22:38:45.729538] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-15T22:38:45.731051] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-15T22:38:45.733531] [INFO ] [MAIN ] Derivative Progress: 922/1803 symbols completed. IDT took 1.1s. Estimated remaining: 5m 33s. Rate: 158.7 symbols/min [2025-10-15T22:38:45.733770] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:45.750477] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:45.753197] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38458 primary records. [2025-10-15T22:38:45.754103] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-15T22:38:45.780147] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:45.786839] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51147 primary records. [2025-10-15T22:38:45.786975] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-15T22:38:45.806681] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-15T22:38:45.807095] [DEBUG] [LOCAL ] IFN: Loaded 18517 existing records from primary storage. [2025-10-15T22:38:45.811810] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-15T22:38:45.814699] [INFO ] [MAIN ] Derivative Progress: 923/1803 symbols completed. IEX took 1.2s. Estimated remaining: 5m 32s. Rate: 158.8 symbols/min [2025-10-15T22:38:45.815102] [INFO ] [MAIN ] IFN: Loaded 18517 primary data records. [2025-10-15T22:38:45.816331] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-15T22:38:45.816758] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-15T22:38:45.819241] [INFO ] [MAIN ] Derivative Progress: 924/1803 symbols completed. IFF took 1.2s. Estimated remaining: 5m 32s. Rate: 159.0 symbols/min [2025-10-15T22:38:45.816636] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:45.842545] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:46.033210] [DEBUG] [LOCAL ] IFS: Loaded 22636 existing records from primary storage. [2025-10-15T22:38:46.043179] [INFO ] [MAIN ] IFS: Loaded 22636 primary data records. [2025-10-15T22:38:46.032365] [DEBUG] [LOCAL ] IGA: Loaded 10170 existing records from primary storage. [2025-10-15T22:38:46.043355] [INFO ] [MAIN ] IGA: Loaded 10170 primary data records. [2025-10-15T22:38:46.836193] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:46.837156] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18517 primary records. [2025-10-15T22:38:46.837508] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-15T22:38:46.879906] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:46.881458] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-15T22:38:46.882742] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-15T22:38:46.882684] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22636 primary records. [2025-10-15T22:38:46.898669] [INFO ] [MAIN ] Derivative Progress: 925/1803 symbols completed. IFN took 1.2s. Estimated remaining: 5m 32s. Rate: 158.7 symbols/min [2025-10-15T22:38:46.898744] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-15T22:38:46.899472] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:46.899602] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:46.901633] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 10170 primary records. [2025-10-15T22:38:46.901881] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-15T22:38:46.930361] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-15T22:38:46.938343] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-15T22:38:46.938460] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-15T22:38:46.940736] [INFO ] [MAIN ] Derivative Progress: 926/1803 symbols completed. IGA took 1.1s. Estimated remaining: 5m 31s. Rate: 158.8 symbols/min [2025-10-15T22:38:46.938223] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-15T22:38:46.943483] [INFO ] [MAIN ] Derivative Progress: 927/1803 symbols completed. IFS took 1.1s. Estimated remaining: 5m 31s. Rate: 159.0 symbols/min [2025-10-15T22:38:46.941037] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:46.944197] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:46.952236] [DEBUG] [LOCAL ] IGD: Loaded 19405 existing records from primary storage. [2025-10-15T22:38:46.953623] [INFO ] [MAIN ] IGD: Loaded 19405 primary data records. [2025-10-15T22:38:47.005626] [DEBUG] [LOCAL ] IGI: Loaded 3999 existing records from primary storage. [2025-10-15T22:38:47.041602] [INFO ] [MAIN ] IGI: Loaded 3999 primary data records. [2025-10-15T22:38:47.280687] [DEBUG] [LOCAL ] IGR: Loaded 30438 existing records from primary storage. [2025-10-15T22:38:47.292792] [INFO ] [MAIN ] IGR: Loaded 30438 primary data records. [2025-10-15T22:38:47.996702] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:47.998521] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19405 primary records. [2025-10-15T22:38:47.999278] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-15T22:38:48.029401] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-15T22:38:48.030038] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:48.030099] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-15T22:38:48.030936] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3999 primary records. [2025-10-15T22:38:48.033178] [INFO ] [MAIN ] Derivative Progress: 928/1803 symbols completed. IGD took 1.1s. Estimated remaining: 5m 31s. Rate: 158.7 symbols/min [2025-10-15T22:38:48.033304] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-15T22:38:48.052099] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-15T22:38:48.052239] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-15T22:38:48.054799] [INFO ] [MAIN ] Derivative Progress: 929/1803 symbols completed. IGI took 1.1s. Estimated remaining: 5m 30s. Rate: 158.9 symbols/min [2025-10-15T22:38:48.067288] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:48.067943] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30438 primary records. [2025-10-15T22:38:48.068006] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-15T22:38:48.082985] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-15T22:38:48.083048] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-15T22:38:48.085624] [INFO ] [MAIN ] Derivative Progress: 930/1803 symbols completed. IGR took 1.1s. Estimated remaining: 5m 29s. Rate: 159.0 symbols/min [2025-10-15T22:38:48.086066] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:48.086160] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:48.086322] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:48.092735] [DEBUG] [LOCAL ] IH: Loaded 2799 existing records from primary storage. [2025-10-15T22:38:48.092864] [INFO ] [MAIN ] IH: Loaded 2799 primary data records. [2025-10-15T22:38:48.158187] [DEBUG] [LOCAL ] IHD: Loaded 7329 existing records from primary storage. [2025-10-15T22:38:48.186531] [INFO ] [MAIN ] IHD: Loaded 7329 primary data records. [2025-10-15T22:38:48.386600] [DEBUG] [LOCAL ] IHG: Loaded 24302 existing records from primary storage. [2025-10-15T22:38:48.544411] [INFO ] [MAIN ] IHG: Loaded 24302 primary data records. [2025-10-15T22:38:49.098246] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:49.100930] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7329 primary records. [2025-10-15T22:38:49.097761] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:49.102682] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 2799 primary records. [2025-10-15T22:38:49.101702] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-15T22:38:49.111103] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-15T22:38:49.117625] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:49.130227] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24302 primary records. [2025-10-15T22:38:49.131693] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-15T22:38:49.146547] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-15T22:38:49.142905] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-15T22:38:49.154406] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-15T22:38:49.146945] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-15T22:38:49.160363] [INFO ] [MAIN ] Derivative Progress: 931/1803 symbols completed. IH took 1.1s. Estimated remaining: 5m 30s. Rate: 158.7 symbols/min [2025-10-15T22:38:49.162944] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:49.163619] [INFO ] [MAIN ] Derivative Progress: 932/1803 symbols completed. IHD took 1.1s. Estimated remaining: 5m 29s. Rate: 158.9 symbols/min [2025-10-15T22:38:49.164977] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:49.168484] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-15T22:38:49.168681] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-15T22:38:49.171251] [INFO ] [MAIN ] Derivative Progress: 933/1803 symbols completed. IHG took 1.1s. Estimated remaining: 5m 28s. Rate: 159.0 symbols/min [2025-10-15T22:38:49.171449] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:49.180106] [DEBUG] [LOCAL ] IIF: Loaded 5591 existing records from primary storage. [2025-10-15T22:38:49.180452] [INFO ] [MAIN ] IIF: Loaded 5591 primary data records. [2025-10-15T22:38:49.306850] [DEBUG] [LOCAL ] IIIN: Loaded 15979 existing records from primary storage. [2025-10-15T22:38:49.307051] [INFO ] [MAIN ] IIIN: Loaded 15979 primary data records. [2025-10-15T22:38:49.490935] [DEBUG] [LOCAL ] IHS: Loaded 37622 existing records from primary storage. [2025-10-15T22:38:49.622932] [INFO ] [MAIN ] IHS: Loaded 37622 primary data records. [2025-10-15T22:38:50.184307] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:50.186920] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5591 primary records. [2025-10-15T22:38:50.187321] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-15T22:38:50.204962] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-15T22:38:50.207596] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-15T22:38:50.209790] [INFO ] [MAIN ] Derivative Progress: 934/1803 symbols completed. IIF took 1.0s. Estimated remaining: 5m 28s. Rate: 158.7 symbols/min [2025-10-15T22:38:50.210091] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:50.225158] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:50.228112] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 15979 primary records. [2025-10-15T22:38:50.229124] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-15T22:38:50.261914] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-15T22:38:50.262491] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-15T22:38:50.262322] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:50.265915] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 37622 primary records. [2025-10-15T22:38:50.265118] [INFO ] [MAIN ] Derivative Progress: 935/1803 symbols completed. IIIN took 1.1s. Estimated remaining: 5m 28s. Rate: 158.9 symbols/min [2025-10-15T22:38:50.266466] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-15T22:38:50.272270] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:50.273306] [DEBUG] [LOCAL ] IIM: Loaded 15661 existing records from primary storage. [2025-10-15T22:38:50.274381] [INFO ] [MAIN ] IIM: Loaded 15661 primary data records. [2025-10-15T22:38:50.325593] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-15T22:38:50.332135] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-15T22:38:50.355539] [INFO ] [MAIN ] Derivative Progress: 936/1803 symbols completed. IHS took 1.2s. Estimated remaining: 5m 27s. Rate: 159.0 symbols/min [2025-10-15T22:38:50.361051] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:50.594160] [DEBUG] [LOCAL ] IIPR: Loaded 29450 existing records from primary storage. [2025-10-15T22:38:50.602548] [INFO ] [MAIN ] IIPR: Loaded 29450 primary data records. [2025-10-15T22:38:50.745050] [DEBUG] [LOCAL ] INFA: Loaded 49000 existing records from primary storage. [2025-10-15T22:38:50.774459] [INFO ] [MAIN ] INFA: Loaded 49000 primary data records. [2025-10-15T22:38:51.235542] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:51.238219] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15661 primary records. [2025-10-15T22:38:51.238680] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-15T22:38:51.256301] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-15T22:38:51.256690] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-15T22:38:51.259566] [INFO ] [MAIN ] Derivative Progress: 937/1803 symbols completed. IIM took 1.0s. Estimated remaining: 5m 27s. Rate: 158.8 symbols/min [2025-10-15T22:38:51.259739] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:51.281946] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:51.282917] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29450 primary records. [2025-10-15T22:38:51.283211] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-15T22:38:51.302118] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-15T22:38:51.302557] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-15T22:38:51.312438] [INFO ] [MAIN ] Derivative Progress: 938/1803 symbols completed. IIPR took 1.0s. Estimated remaining: 5m 27s. Rate: 158.9 symbols/min [2025-10-15T22:38:51.317557] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:51.317898] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:51.319123] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49000 primary records. [2025-10-15T22:38:51.319203] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-15T22:38:51.349193] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-15T22:38:51.349260] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-15T22:38:51.351693] [INFO ] [MAIN ] Derivative Progress: 939/1803 symbols completed. INFA took 1.0s. Estimated remaining: 5m 26s. Rate: 159.1 symbols/min [2025-10-15T22:38:51.351908] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:51.376187] [DEBUG] [LOCAL ] INFY: Loaded 53597 existing records from primary storage. [2025-10-15T22:38:51.376529] [INFO ] [MAIN ] INFY: Loaded 53597 primary data records. [2025-10-15T22:38:51.530510] [DEBUG] [LOCAL ] INGM: Loaded 28330 existing records from primary storage. [2025-10-15T22:38:51.565061] [INFO ] [MAIN ] INGM: Loaded 28330 primary data records. [2025-10-15T22:38:51.831239] [DEBUG] [LOCAL ] ING: Loaded 50732 existing records from primary storage. [2025-10-15T22:38:51.846377] [INFO ] [MAIN ] ING: Loaded 50732 primary data records. [2025-10-15T22:38:52.368101] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:52.369208] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53597 primary records. [2025-10-15T22:38:52.369316] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-15T22:38:52.387893] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-15T22:38:52.389537] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-15T22:38:52.391994] [INFO ] [MAIN ] Derivative Progress: 940/1803 symbols completed. INFY took 1.1s. Estimated remaining: 5m 26s. Rate: 158.8 symbols/min [2025-10-15T22:38:52.392510] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:52.406781] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:52.407593] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28330 primary records. [2025-10-15T22:38:52.407900] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-15T22:38:52.439183] [DEBUG] [MAIN ] ING: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:52.440857] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50732 primary records. [2025-10-15T22:38:52.442090] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-15T22:38:52.442380] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-15T22:38:52.442320] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-15T22:38:52.444702] [INFO ] [MAIN ] Derivative Progress: 941/1803 symbols completed. INGM took 1.1s. Estimated remaining: 5m 25s. Rate: 158.9 symbols/min [2025-10-15T22:38:52.453966] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:52.470899] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-15T22:38:52.480887] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-15T22:38:52.483767] [INFO ] [MAIN ] Derivative Progress: 942/1803 symbols completed. ING took 1.2s. Estimated remaining: 5m 25s. Rate: 159.1 symbols/min [2025-10-15T22:38:52.485147] [DEBUG] [LOCAL ] INGR: Loaded 33816 existing records from primary storage. [2025-10-15T22:38:52.484149] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:52.485752] [INFO ] [MAIN ] INGR: Loaded 33816 primary data records. [2025-10-15T22:38:52.825802] [DEBUG] [LOCAL ] INN: Loaded 41819 existing records from primary storage. [2025-10-15T22:38:52.826178] [INFO ] [MAIN ] INN: Loaded 41819 primary data records. [2025-10-15T22:38:52.890904] [DEBUG] [LOCAL ] INSP: Loaded 38333 existing records from primary storage. [2025-10-15T22:38:52.891026] [INFO ] [MAIN ] INSP: Loaded 38333 primary data records. [2025-10-15T22:38:53.505053] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:53.506616] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33816 primary records. [2025-10-15T22:38:53.506796] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-15T22:38:53.523809] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-15T22:38:53.524018] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-15T22:38:53.526354] [INFO ] [MAIN ] Derivative Progress: 943/1803 symbols completed. INGR took 1.1s. Estimated remaining: 5m 25s. Rate: 158.8 symbols/min [2025-10-15T22:38:53.547294] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:53.548791] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 38333 primary records. [2025-10-15T22:38:53.549447] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-15T22:38:53.575475] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:53.577347] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41819 primary records. [2025-10-15T22:38:53.578054] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-15T22:38:53.579360] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-15T22:38:53.579776] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-15T22:38:53.582049] [INFO ] [MAIN ] Derivative Progress: 944/1803 symbols completed. INSP took 1.1s. Estimated remaining: 5m 24s. Rate: 158.9 symbols/min [2025-10-15T22:38:53.597034] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-15T22:38:53.597099] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-15T22:38:53.599536] [INFO ] [MAIN ] Derivative Progress: 945/1803 symbols completed. INN took 1.1s. Estimated remaining: 5m 24s. Rate: 159.1 symbols/min [2025-10-15T22:38:53.599898] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:53.599971] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:53.600516] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:53.633873] [DEBUG] [LOCAL ] INVX: Loaded 29342 existing records from primary storage. [2025-10-15T22:38:53.634017] [INFO ] [MAIN ] INVX: Loaded 29342 primary data records. [2025-10-15T22:38:53.816498] [DEBUG] [LOCAL ] INSW: Loaded 39595 existing records from primary storage. [2025-10-15T22:38:53.854812] [DEBUG] [LOCAL ] INVH: Loaded 53197 existing records from primary storage. [2025-10-15T22:38:53.839701] [INFO ] [MAIN ] INSW: Loaded 39595 primary data records. [2025-10-15T22:38:53.859502] [INFO ] [MAIN ] INVH: Loaded 53197 primary data records. [2025-10-15T22:38:54.584556] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:54.586273] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29342 primary records. [2025-10-15T22:38:54.586415] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-15T22:38:54.623269] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-15T22:38:54.623622] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-15T22:38:54.625805] [INFO ] [MAIN ] Derivative Progress: 946/1803 symbols completed. INVX took 1.0s. Estimated remaining: 5m 24s. Rate: 158.8 symbols/min [2025-10-15T22:38:54.626114] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:54.626639] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:54.628091] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53197 primary records. [2025-10-15T22:38:54.628307] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-15T22:38:54.647428] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-15T22:38:54.647829] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-15T22:38:54.663319] [INFO ] [MAIN ] Derivative Progress: 947/1803 symbols completed. INVH took 1.1s. Estimated remaining: 5m 23s. Rate: 158.9 symbols/min [2025-10-15T22:38:54.663834] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:54.663631] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:54.665092] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39595 primary records. [2025-10-15T22:38:54.665292] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-15T22:38:54.682266] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-15T22:38:54.682339] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-15T22:38:54.684776] [INFO ] [MAIN ] Derivative Progress: 948/1803 symbols completed. INSW took 1.1s. Estimated remaining: 5m 22s. Rate: 159.1 symbols/min [2025-10-15T22:38:54.685112] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:54.738082] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-15T22:38:54.738386] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-15T22:38:54.886677] [DEBUG] [LOCAL ] IOT: Loaded 53480 existing records from primary storage. [2025-10-15T22:38:54.893040] [INFO ] [MAIN ] IOT: Loaded 53480 primary data records. [2025-10-15T22:38:55.063783] [DEBUG] [LOCAL ] IP: Loaded 53307 existing records from primary storage. [2025-10-15T22:38:55.083013] [INFO ] [MAIN ] IP: Loaded 53307 primary data records. [2025-10-15T22:38:55.817180] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:55.818367] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-15T22:38:55.818545] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-15T22:38:55.851409] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:55.854284] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53480 primary records. [2025-10-15T22:38:55.855377] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-15T22:38:55.858759] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-15T22:38:55.867023] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-15T22:38:55.868984] [INFO ] [MAIN ] Derivative Progress: 949/1803 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 23s. Rate: 158.7 symbols/min [2025-10-15T22:38:55.881380] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:55.890531] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-15T22:38:55.890883] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:55.890964] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-15T22:38:55.894459] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53307 primary records. [2025-10-15T22:38:55.893722] [INFO ] [MAIN ] Derivative Progress: 950/1803 symbols completed. IOT took 1.2s. Estimated remaining: 5m 22s. Rate: 158.9 symbols/min [2025-10-15T22:38:55.894906] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-15T22:38:55.894782] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:55.914276] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-15T22:38:55.914493] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-15T22:38:55.918426] [INFO ] [MAIN ] Derivative Progress: 951/1803 symbols completed. IP took 1.2s. Estimated remaining: 5m 21s. Rate: 159.0 symbols/min [2025-10-15T22:38:55.918797] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:55.936436] [DEBUG] [LOCAL ] IPI: Loaded 21357 existing records from primary storage. [2025-10-15T22:38:55.936570] [INFO ] [MAIN ] IPI: Loaded 21357 primary data records. [2025-10-15T22:38:56.067771] [DEBUG] [LOCAL ] IQI: Loaded 17837 existing records from primary storage. [2025-10-15T22:38:56.088718] [INFO ] [MAIN ] IQI: Loaded 17837 primary data records. [2025-10-15T22:38:56.258395] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-10-15T22:38:56.378004] [INFO ] [MAIN ] IPG: Loaded 53331 primary data records. [2025-10-15T22:38:56.910040] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:56.911003] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21357 primary records. [2025-10-15T22:38:56.912541] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-15T22:38:56.932589] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-15T22:38:56.932867] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-15T22:38:56.934870] [INFO ] [MAIN ] Derivative Progress: 952/1803 symbols completed. IPI took 1.0s. Estimated remaining: 5m 22s. Rate: 158.8 symbols/min [2025-10-15T22:38:56.946842] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:56.948566] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:56.949465] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17837 primary records. [2025-10-15T22:38:56.949606] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-15T22:38:56.979197] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:56.980457] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53331 primary records. [2025-10-15T22:38:56.980601] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-15T22:38:57.000105] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-15T22:38:57.000912] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-15T22:38:57.001002] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-15T22:38:57.001087] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-15T22:38:57.003616] [INFO ] [MAIN ] Derivative Progress: 953/1803 symbols completed. IPG took 1.1s. Estimated remaining: 5m 21s. Rate: 158.9 symbols/min [2025-10-15T22:38:57.006330] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:57.006424] [INFO ] [MAIN ] Derivative Progress: 954/1803 symbols completed. IQI took 1.1s. Estimated remaining: 5m 20s. Rate: 159.1 symbols/min [2025-10-15T22:38:57.007006] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:57.044213] [DEBUG] [LOCAL ] IQV: Loaded 50051 existing records from primary storage. [2025-10-15T22:38:57.044700] [INFO ] [MAIN ] IQV: Loaded 50051 primary data records. [2025-10-15T22:38:57.418136] [DEBUG] [LOCAL ] IRM: Loaded 49144 existing records from primary storage. [2025-10-15T22:38:57.416969] [DEBUG] [LOCAL ] IR: Loaded 52780 existing records from primary storage. [2025-10-15T22:38:57.418364] [INFO ] [MAIN ] IRM: Loaded 49144 primary data records. [2025-10-15T22:38:57.418551] [INFO ] [MAIN ] IR: Loaded 52780 primary data records. [2025-10-15T22:38:58.079907] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:58.081090] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50051 primary records. [2025-10-15T22:38:58.081297] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-15T22:38:58.104636] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-15T22:38:58.104852] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-15T22:38:58.108358] [INFO ] [MAIN ] Derivative Progress: 955/1803 symbols completed. IQV took 1.2s. Estimated remaining: 5m 21s. Rate: 158.7 symbols/min [2025-10-15T22:38:58.120596] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:58.129050] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:58.134977] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49144 primary records. [2025-10-15T22:38:58.135202] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:58.135359] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-15T22:38:58.136591] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52780 primary records. [2025-10-15T22:38:58.136700] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-15T22:38:58.163096] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-15T22:38:58.166156] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-15T22:38:58.168312] [INFO ] [MAIN ] Derivative Progress: 956/1803 symbols completed. IRM took 1.2s. Estimated remaining: 5m 20s. Rate: 158.9 symbols/min [2025-10-15T22:38:58.169270] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:58.169117] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-15T22:38:58.169915] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-15T22:38:58.173008] [INFO ] [MAIN ] Derivative Progress: 957/1803 symbols completed. IR took 1.2s. Estimated remaining: 5m 19s. Rate: 159.1 symbols/min [2025-10-15T22:38:58.179120] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:58.191964] [DEBUG] [LOCAL ] IRS: Loaded 23063 existing records from primary storage. [2025-10-15T22:38:58.192176] [INFO ] [MAIN ] IRS: Loaded 23063 primary data records. [2025-10-15T22:38:58.325813] [DEBUG] [LOCAL ] ISD: Loaded 15874 existing records from primary storage. [2025-10-15T22:38:58.367744] [INFO ] [MAIN ] ISD: Loaded 15874 primary data records. [2025-10-15T22:38:58.617361] [DEBUG] [LOCAL ] IRT: Loaded 50567 existing records from primary storage. [2025-10-15T22:38:58.641876] [INFO ] [MAIN ] IRT: Loaded 50567 primary data records. [2025-10-15T22:38:59.242509] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:59.246174] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 23063 primary records. [2025-10-15T22:38:59.247487] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-15T22:38:59.271223] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:59.278128] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15874 primary records. [2025-10-15T22:38:59.279455] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-15T22:38:59.300712] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-15T22:38:59.301405] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-15T22:38:59.304827] [INFO ] [MAIN ] Derivative Progress: 958/1803 symbols completed. ISD took 1.1s. Estimated remaining: 5m 19s. Rate: 158.7 symbols/min [2025-10-15T22:38:59.319121] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:38:59.320113] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-15T22:38:59.320442] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-15T22:38:59.321361] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50567 primary records. [2025-10-15T22:38:59.324732] [INFO ] [MAIN ] Derivative Progress: 959/1803 symbols completed. IRS took 1.2s. Estimated remaining: 5m 19s. Rate: 158.9 symbols/min [2025-10-15T22:38:59.325033] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-15T22:38:59.341600] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-15T22:38:59.341720] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-15T22:38:59.344138] [INFO ] [MAIN ] Derivative Progress: 960/1803 symbols completed. IRT took 1.2s. Estimated remaining: 5m 18s. Rate: 159.0 symbols/min [2025-10-15T22:38:59.344769] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:59.344872] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:59.344696] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:38:59.412998] [DEBUG] [LOCAL ] ITGR: Loaded 31316 existing records from primary storage. [2025-10-15T22:38:59.413678] [DEBUG] [LOCAL ] ITT: Loaded 32710 existing records from primary storage. [2025-10-15T22:38:59.414001] [INFO ] [MAIN ] ITT: Loaded 32710 primary data records. [2025-10-15T22:38:59.414147] [INFO ] [MAIN ] ITGR: Loaded 31316 primary data records. [2025-10-15T22:38:59.611065] [DEBUG] [LOCAL ] IT: Loaded 42223 existing records from primary storage. [2025-10-15T22:38:59.643158] [INFO ] [MAIN ] IT: Loaded 42223 primary data records. [2025-10-15T22:39:00.463667] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:00.466499] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32710 primary records. [2025-10-15T22:39:00.467093] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-15T22:39:00.484514] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-15T22:39:00.497553] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:00.496992] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-15T22:39:00.498525] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31316 primary records. [2025-10-15T22:39:00.498627] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-15T22:39:00.501398] [INFO ] [MAIN ] Derivative Progress: 961/1803 symbols completed. ITT took 1.2s. Estimated remaining: 5m 18s. Rate: 158.7 symbols/min [2025-10-15T22:39:00.504701] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:00.522300] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-15T22:39:00.522492] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-15T22:39:00.525552] [INFO ] [MAIN ] Derivative Progress: 962/1803 symbols completed. ITGR took 1.2s. Estimated remaining: 5m 18s. Rate: 158.8 symbols/min [2025-10-15T22:39:00.525961] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:00.544619] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:00.545626] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 42223 primary records. [2025-10-15T22:39:00.545801] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-15T22:39:00.577908] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-10-15T22:39:00.578007] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-15T22:39:00.581587] [INFO ] [MAIN ] Derivative Progress: 963/1803 symbols completed. IT took 1.2s. Estimated remaining: 5m 17s. Rate: 159.0 symbols/min [2025-10-15T22:39:00.581867] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:00.611179] [DEBUG] [LOCAL ] ITUB: Loaded 53332 existing records from primary storage. [2025-10-15T22:39:00.611530] [INFO ] [MAIN ] ITUB: Loaded 53332 primary data records. [2025-10-15T22:39:00.736319] [DEBUG] [LOCAL ] ITW: Loaded 45789 existing records from primary storage. [2025-10-15T22:39:00.742206] [INFO ] [MAIN ] ITW: Loaded 45789 primary data records. [2025-10-15T22:39:00.886077] [DEBUG] [LOCAL ] IVT: Loaded 31347 existing records from primary storage. [2025-10-15T22:39:00.933952] [INFO ] [MAIN ] IVT: Loaded 31347 primary data records. [2025-10-15T22:39:01.644133] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:01.645006] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53332 primary records. [2025-10-15T22:39:01.645293] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-15T22:39:01.666621] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-15T22:39:01.667057] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-15T22:39:01.682321] [INFO ] [MAIN ] Derivative Progress: 964/1803 symbols completed. ITUB took 1.2s. Estimated remaining: 5m 17s. Rate: 158.7 symbols/min [2025-10-15T22:39:01.683219] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:01.683608] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:01.685125] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45789 primary records. [2025-10-15T22:39:01.685300] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-15T22:39:01.715847] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:01.718176] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31347 primary records. [2025-10-15T22:39:01.718786] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-15T22:39:01.720631] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-15T22:39:01.720819] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-15T22:39:01.731251] [INFO ] [MAIN ] Derivative Progress: 965/1803 symbols completed. ITW took 1.2s. Estimated remaining: 5m 17s. Rate: 158.8 symbols/min [2025-10-15T22:39:01.735364] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:01.740834] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-15T22:39:01.741008] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-15T22:39:01.743416] [INFO ] [MAIN ] Derivative Progress: 966/1803 symbols completed. IVT took 1.2s. Estimated remaining: 5m 16s. Rate: 159.0 symbols/min [2025-10-15T22:39:01.743681] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:01.780333] [DEBUG] [LOCAL ] IX: Loaded 22281 existing records from primary storage. [2025-10-15T22:39:01.781309] [INFO ] [MAIN ] IX: Loaded 22281 primary data records. [2025-10-15T22:39:01.845670] [DEBUG] [LOCAL ] IVZ: Loaded 53117 existing records from primary storage. [2025-10-15T22:39:01.851875] [INFO ] [MAIN ] IVZ: Loaded 53117 primary data records. [2025-10-15T22:39:02.143347] [DEBUG] [LOCAL ] J: Loaded 40381 existing records from primary storage. [2025-10-15T22:39:02.280298] [INFO ] [MAIN ] J: Loaded 40381 primary data records. [2025-10-15T22:39:02.858200] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:02.859945] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22281 primary records. [2025-10-15T22:39:02.861081] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-15T22:39:02.889510] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:02.892253] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53117 primary records. [2025-10-15T22:39:02.892355] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-15T22:39:02.911221] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-15T22:39:02.913249] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-15T22:39:02.911574] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-15T22:39:02.916375] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-15T22:39:02.916263] [INFO ] [MAIN ] Derivative Progress: 967/1803 symbols completed. IVZ took 1.2s. Estimated remaining: 5m 16s. Rate: 158.6 symbols/min [2025-10-15T22:39:02.918908] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:02.920971] [INFO ] [MAIN ] Derivative Progress: 968/1803 symbols completed. IX took 1.2s. Estimated remaining: 5m 16s. Rate: 158.8 symbols/min [2025-10-15T22:39:02.922185] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:02.938927] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:02.939835] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40381 primary records. [2025-10-15T22:39:02.939982] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-15T22:39:02.959874] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-15T22:39:02.960167] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-15T22:39:02.963006] [INFO ] [MAIN ] Derivative Progress: 969/1803 symbols completed. J took 1.2s. Estimated remaining: 5m 15s. Rate: 158.9 symbols/min [2025-10-15T22:39:02.963300] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:03.022627] [DEBUG] [LOCAL ] JBGS: Loaded 42194 existing records from primary storage. [2025-10-15T22:39:03.022953] [INFO ] [MAIN ] JBGS: Loaded 42194 primary data records. [2025-10-15T22:39:03.023699] [DEBUG] [LOCAL ] JBI: Loaded 42989 existing records from primary storage. [2025-10-15T22:39:03.037346] [INFO ] [MAIN ] JBI: Loaded 42989 primary data records. [2025-10-15T22:39:03.296156] [DEBUG] [LOCAL ] JBL: Loaded 48349 existing records from primary storage. [2025-10-15T22:39:03.346403] [INFO ] [MAIN ] JBL: Loaded 48349 primary data records. [2025-10-15T22:39:04.046388] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:04.048336] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42194 primary records. [2025-10-15T22:39:04.048447] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-15T22:39:04.047275] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:04.049683] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 42989 primary records. [2025-10-15T22:39:04.050234] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-15T22:39:04.082806] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-15T22:39:04.083886] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-15T22:39:04.085049] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-15T22:39:04.084043] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-15T22:39:04.088392] [INFO ] [MAIN ] Derivative Progress: 970/1803 symbols completed. JBI took 1.2s. Estimated remaining: 5m 15s. Rate: 158.6 symbols/min [2025-10-15T22:39:04.088591] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:04.090604] [INFO ] [MAIN ] Derivative Progress: 971/1803 symbols completed. JBGS took 1.2s. Estimated remaining: 5m 14s. Rate: 158.8 symbols/min [2025-10-15T22:39:04.091987] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:04.105847] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:04.106520] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48349 primary records. [2025-10-15T22:39:04.106703] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-15T22:39:04.126439] [DEBUG] [LOCAL ] JCE: Loaded 7439 existing records from primary storage. [2025-10-15T22:39:04.128362] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-15T22:39:04.127961] [INFO ] [MAIN ] JCE: Loaded 7439 primary data records. [2025-10-15T22:39:04.149441] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-15T22:39:04.179984] [INFO ] [MAIN ] Derivative Progress: 972/1803 symbols completed. JBL took 1.2s. Estimated remaining: 5m 14s. Rate: 158.9 symbols/min [2025-10-15T22:39:04.180237] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:04.256367] [DEBUG] [LOCAL ] JBND: Loaded 26907 existing records from primary storage. [2025-10-15T22:39:04.257060] [INFO ] [MAIN ] JBND: Loaded 26907 primary data records. [2025-10-15T22:39:04.781932] [DEBUG] [LOCAL ] JCI: Loaded 53527 existing records from primary storage. [2025-10-15T22:39:04.782512] [INFO ] [MAIN ] JCI: Loaded 53527 primary data records. [2025-10-15T22:39:05.107215] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:05.108491] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7439 primary records. [2025-10-15T22:39:05.113566] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-15T22:39:05.132338] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-15T22:39:05.132689] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-15T22:39:05.147713] [INFO ] [MAIN ] Derivative Progress: 973/1803 symbols completed. JCE took 1.1s. Estimated remaining: 5m 14s. Rate: 158.6 symbols/min [2025-10-15T22:39:05.148548] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:05.149379] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26907 primary records. [2025-10-15T22:39:05.149527] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-15T22:39:05.165986] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-15T22:39:05.166840] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-15T22:39:05.170190] [INFO ] [MAIN ] Derivative Progress: 974/1803 symbols completed. JBND took 1.1s. Estimated remaining: 5m 13s. Rate: 158.8 symbols/min [2025-10-15T22:39:05.183968] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:05.184535] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53527 primary records. [2025-10-15T22:39:05.184593] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-15T22:39:05.201349] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-15T22:39:05.201405] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-15T22:39:05.203763] [INFO ] [MAIN ] Derivative Progress: 975/1803 symbols completed. JCI took 1.0s. Estimated remaining: 5m 13s. Rate: 158.9 symbols/min [2025-10-15T22:39:05.204433] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:05.204488] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:05.204350] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:05.237083] [DEBUG] [LOCAL ] JFR: Loaded 30985 existing records from primary storage. [2025-10-15T22:39:05.237252] [INFO ] [MAIN ] JFR: Loaded 30985 primary data records. [2025-10-15T22:39:05.475114] [DEBUG] [LOCAL ] JEF: Loaded 50171 existing records from primary storage. [2025-10-15T22:39:05.477419] [INFO ] [MAIN ] JEF: Loaded 50171 primary data records. [2025-10-15T22:39:05.477269] [DEBUG] [LOCAL ] JELD: Loaded 46134 existing records from primary storage. [2025-10-15T22:39:05.514530] [INFO ] [MAIN ] JELD: Loaded 46134 primary data records. [2025-10-15T22:39:06.287093] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:06.288529] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30985 primary records. [2025-10-15T22:39:06.288923] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-15T22:39:06.307856] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-15T22:39:06.308416] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-15T22:39:06.311205] [INFO ] [MAIN ] Derivative Progress: 976/1803 symbols completed. JFR took 1.1s. Estimated remaining: 5m 13s. Rate: 158.6 symbols/min [2025-10-15T22:39:06.311557] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:06.335839] [DEBUG] [MAIN ] JEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:06.337521] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50171 primary records. [2025-10-15T22:39:06.339556] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-15T22:39:06.353907] [DEBUG] [LOCAL ] JGH: Loaded 12453 existing records from primary storage. [2025-10-15T22:39:06.358921] [INFO ] [MAIN ] JGH: Loaded 12453 primary data records. [2025-10-15T22:39:06.423416] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:06.437722] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-15T22:39:06.459829] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46134 primary records. [2025-10-15T22:39:06.452021] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-15T22:39:06.486364] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-15T22:39:06.472935] [INFO ] [MAIN ] Derivative Progress: 977/1803 symbols completed. JEF took 1.3s. Estimated remaining: 5m 12s. Rate: 158.7 symbols/min [2025-10-15T22:39:06.486875] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:06.711381] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-15T22:39:06.711761] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-15T22:39:06.714326] [INFO ] [MAIN ] Derivative Progress: 978/1803 symbols completed. JELD took 1.5s. Estimated remaining: 5m 12s. Rate: 158.8 symbols/min [2025-10-15T22:39:06.714551] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:06.734910] [DEBUG] [LOCAL ] JHI: Loaded 4041 existing records from primary storage. [2025-10-15T22:39:06.735322] [INFO ] [MAIN ] JHI: Loaded 4041 primary data records. [2025-10-15T22:39:06.853639] [DEBUG] [LOCAL ] JHG: Loaded 47560 existing records from primary storage. [2025-10-15T22:39:06.859698] [INFO ] [MAIN ] JHG: Loaded 47560 primary data records. [2025-10-15T22:39:07.170806] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:07.184604] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 12453 primary records. [2025-10-15T22:39:07.185514] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-15T22:39:07.405509] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-15T22:39:07.406501] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-15T22:39:07.409387] [INFO ] [MAIN ] Derivative Progress: 979/1803 symbols completed. JGH took 1.1s. Estimated remaining: 5m 12s. Rate: 158.7 symbols/min [2025-10-15T22:39:07.411747] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:07.421147] [DEBUG] [LOCAL ] JHS: Loaded 2933 existing records from primary storage. [2025-10-15T22:39:07.421838] [INFO ] [MAIN ] JHS: Loaded 2933 primary data records. [2025-10-15T22:39:07.827379] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:07.830240] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 4041 primary records. [2025-10-15T22:39:07.831000] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-15T22:39:07.865632] [DEBUG] [MAIN ] JHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:07.869769] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-15T22:39:07.869067] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47560 primary records. [2025-10-15T22:39:07.869990] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-15T22:39:07.874699] [INFO ] [MAIN ] Derivative Progress: 980/1803 symbols completed. JHI took 1.2s. Estimated remaining: 5m 11s. Rate: 158.6 symbols/min [2025-10-15T22:39:07.874854] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:07.875465] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-15T22:39:07.899272] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-15T22:39:07.899516] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-15T22:39:07.905252] [INFO ] [MAIN ] Derivative Progress: 981/1803 symbols completed. JHG took 1.4s. Estimated remaining: 5m 11s. Rate: 158.8 symbols/min [2025-10-15T22:39:07.906093] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:07.925018] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:07.926030] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2933 primary records. [2025-10-15T22:39:07.926098] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-15T22:39:07.947853] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-15T22:39:07.948072] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-15T22:39:07.950794] [INFO ] [MAIN ] Derivative Progress: 982/1803 symbols completed. JHS took 0.5s. Estimated remaining: 5m 10s. Rate: 158.9 symbols/min [2025-10-15T22:39:07.950964] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:07.977142] [DEBUG] [LOCAL ] JILL: Loaded 15931 existing records from primary storage. [2025-10-15T22:39:07.977434] [INFO ] [MAIN ] JILL: Loaded 15931 primary data records. [2025-10-15T22:39:08.131568] [DEBUG] [LOCAL ] JHX: Loaded 53161 existing records from primary storage. [2025-10-15T22:39:08.131958] [INFO ] [MAIN ] JHX: Loaded 53161 primary data records. [2025-10-15T22:39:08.477747] [DEBUG] [LOCAL ] JKS: Loaded 39674 existing records from primary storage. [2025-10-15T22:39:08.501289] [INFO ] [MAIN ] JKS: Loaded 39674 primary data records. [2025-10-15T22:39:08.994464] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:09.017746] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 15931 primary records. [2025-10-15T22:39:09.017975] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-15T22:39:09.154594] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:09.156233] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 53161 primary records. [2025-10-15T22:39:09.156801] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-15T22:39:09.186799] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-15T22:39:09.187586] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-15T22:39:09.190550] [INFO ] [MAIN ] Derivative Progress: 983/1803 symbols completed. JILL took 1.3s. Estimated remaining: 5m 10s. Rate: 158.5 symbols/min [2025-10-15T22:39:09.191203] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:09.197426] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-15T22:39:09.197631] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-15T22:39:09.200965] [INFO ] [MAIN ] Derivative Progress: 984/1803 symbols completed. JHX took 1.3s. Estimated remaining: 5m 10s. Rate: 158.7 symbols/min [2025-10-15T22:39:09.201277] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:09.211317] [DEBUG] [LOCAL ] JLS: Loaded 4209 existing records from primary storage. [2025-10-15T22:39:09.211727] [INFO ] [MAIN ] JLS: Loaded 4209 primary data records. [2025-10-15T22:39:09.341814] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:09.356849] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39674 primary records. [2025-10-15T22:39:09.362314] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-15T22:39:09.355210] [DEBUG] [LOCAL ] JLL: Loaded 31768 existing records from primary storage. [2025-10-15T22:39:09.373955] [INFO ] [MAIN ] JLL: Loaded 31768 primary data records. [2025-10-15T22:39:09.505575] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-15T22:39:09.586001] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-15T22:39:09.656088] [INFO ] [MAIN ] Derivative Progress: 985/1803 symbols completed. JKS took 1.7s. Estimated remaining: 5m 9s. Rate: 158.7 symbols/min [2025-10-15T22:39:09.682322] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:09.940105] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:09.941448] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4209 primary records. [2025-10-15T22:39:09.942239] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-15T22:39:09.976780] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-15T22:39:09.977277] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-15T22:39:09.979389] [INFO ] [MAIN ] Derivative Progress: 986/1803 symbols completed. JLS took 0.8s. Estimated remaining: 5m 9s. Rate: 158.7 symbols/min [2025-10-15T22:39:09.979687] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:09.999280] [DEBUG] [LOCAL ] JMIA: Loaded 51055 existing records from primary storage. [2025-10-15T22:39:09.999797] [INFO ] [MAIN ] JMIA: Loaded 51055 primary data records. [2025-10-15T22:39:10.110296] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:10.128375] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31768 primary records. [2025-10-15T22:39:10.128772] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-15T22:39:10.250191] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-15T22:39:10.250368] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-15T22:39:10.254090] [INFO ] [MAIN ] Derivative Progress: 987/1803 symbols completed. JLL took 1.1s. Estimated remaining: 5m 8s. Rate: 158.7 symbols/min [2025-10-15T22:39:10.296085] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:10.427608] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-15T22:39:10.428122] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-15T22:39:10.793849] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:10.796971] [DEBUG] [LOCAL ] JOBY: Loaded 53808 existing records from primary storage. [2025-10-15T22:39:10.795569] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 51055 primary records. [2025-10-15T22:39:10.797144] [INFO ] [MAIN ] JOBY: Loaded 53808 primary data records. [2025-10-15T22:39:10.797213] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-15T22:39:10.893044] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-15T22:39:10.903873] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-15T22:39:10.914778] [INFO ] [MAIN ] Derivative Progress: 988/1803 symbols completed. JMIA took 1.2s. Estimated remaining: 5m 8s. Rate: 158.6 symbols/min [2025-10-15T22:39:11.142904] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:11.143730] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-15T22:39:11.144027] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-15T22:39:11.162508] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-15T22:39:11.162872] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-15T22:39:11.166177] [INFO ] [MAIN ] Derivative Progress: 989/1803 symbols completed. JNJ took 1.2s. Estimated remaining: 5m 8s. Rate: 158.7 symbols/min [2025-10-15T22:39:11.188187] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:11.189043] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53808 primary records. [2025-10-15T22:39:11.189110] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-15T22:39:11.205248] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-15T22:39:11.205320] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-15T22:39:11.208388] [INFO ] [MAIN ] Derivative Progress: 990/1803 symbols completed. JOBY took 0.9s. Estimated remaining: 5m 7s. Rate: 158.8 symbols/min [2025-10-15T22:39:11.208907] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:11.208995] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:11.209551] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:11.222982] [DEBUG] [LOCAL ] JOF: Loaded 6891 existing records from primary storage. [2025-10-15T22:39:11.223200] [INFO ] [MAIN ] JOF: Loaded 6891 primary data records. [2025-10-15T22:39:11.355099] [DEBUG] [LOCAL ] JOE: Loaded 23893 existing records from primary storage. [2025-10-15T22:39:11.371097] [INFO ] [MAIN ] JOE: Loaded 23893 primary data records. [2025-10-15T22:39:11.494368] [DEBUG] [LOCAL ] JPC: Loaded 37227 existing records from primary storage. [2025-10-15T22:39:11.654543] [INFO ] [MAIN ] JPC: Loaded 37227 primary data records. [2025-10-15T22:39:12.310575] [DEBUG] [MAIN ] JOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:12.311698] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6891 primary records. [2025-10-15T22:39:12.312530] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-15T22:39:12.340962] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-15T22:39:12.347118] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-15T22:39:12.346905] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:12.349295] [INFO ] [MAIN ] Derivative Progress: 991/1803 symbols completed. JOF took 1.1s. Estimated remaining: 5m 7s. Rate: 158.5 symbols/min [2025-10-15T22:39:12.350293] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23893 primary records. [2025-10-15T22:39:12.350598] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:12.351018] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-15T22:39:12.372950] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-15T22:39:12.373913] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-15T22:39:12.376630] [INFO ] [MAIN ] Derivative Progress: 992/1803 symbols completed. JOE took 1.2s. Estimated remaining: 5m 7s. Rate: 158.6 symbols/min [2025-10-15T22:39:12.377136] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:12.391960] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:12.392900] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37227 primary records. [2025-10-15T22:39:12.393001] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-15T22:39:12.409481] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-15T22:39:12.409757] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-15T22:39:12.413404] [INFO ] [MAIN ] Derivative Progress: 993/1803 symbols completed. JPC took 1.2s. Estimated remaining: 5m 6s. Rate: 158.8 symbols/min [2025-10-15T22:39:12.413634] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:12.459194] [DEBUG] [LOCAL ] JQC: Loaded 33645 existing records from primary storage. [2025-10-15T22:39:12.482040] [DEBUG] [LOCAL ] JRI: Loaded 15410 existing records from primary storage. [2025-10-15T22:39:12.483862] [INFO ] [MAIN ] JQC: Loaded 33645 primary data records. [2025-10-15T22:39:12.484300] [INFO ] [MAIN ] JRI: Loaded 15410 primary data records. [2025-10-15T22:39:12.497263] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-15T22:39:12.530116] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-15T22:39:13.505338] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:13.506528] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33645 primary records. [2025-10-15T22:39:13.506712] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-15T22:39:13.551519] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-15T22:39:13.551875] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-15T22:39:13.547335] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:13.552326] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:13.553256] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-15T22:39:13.555912] [INFO ] [MAIN ] Derivative Progress: 994/1803 symbols completed. JQC took 1.2s. Estimated remaining: 5m 6s. Rate: 158.5 symbols/min [2025-10-15T22:39:13.556751] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15410 primary records. [2025-10-15T22:39:13.557093] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:13.556947] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-15T22:39:13.557835] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-15T22:39:13.585251] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-15T22:39:13.591308] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-15T22:39:13.597872] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-15T22:39:13.597158] [INFO ] [MAIN ] Derivative Progress: 995/1803 symbols completed. JRI took 1.2s. Estimated remaining: 5m 6s. Rate: 158.6 symbols/min [2025-10-15T22:39:13.598059] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-15T22:39:13.600996] [INFO ] [MAIN ] Derivative Progress: 996/1803 symbols completed. JPM took 1.3s. Estimated remaining: 5m 5s. Rate: 158.8 symbols/min [2025-10-15T22:39:13.601394] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:13.598225] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:13.608598] [DEBUG] [LOCAL ] JRS: Loaded 11669 existing records from primary storage. [2025-10-15T22:39:13.609220] [INFO ] [MAIN ] JRS: Loaded 11669 primary data records. [2025-10-15T22:39:13.967157] [DEBUG] [LOCAL ] JXN: Loaded 44730 existing records from primary storage. [2025-10-15T22:39:13.968595] [DEBUG] [LOCAL ] K: Loaded 50422 existing records from primary storage. [2025-10-15T22:39:13.969283] [INFO ] [MAIN ] K: Loaded 50422 primary data records. [2025-10-15T22:39:13.969409] [INFO ] [MAIN ] JXN: Loaded 44730 primary data records. [2025-10-15T22:39:14.682077] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:14.685185] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11669 primary records. [2025-10-15T22:39:14.685685] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-15T22:39:14.702477] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-15T22:39:14.702948] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-15T22:39:14.705887] [INFO ] [MAIN ] Derivative Progress: 997/1803 symbols completed. JRS took 1.1s. Estimated remaining: 5m 5s. Rate: 158.4 symbols/min [2025-10-15T22:39:14.706852] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:14.725162] [DEBUG] [LOCAL ] KAI: Loaded 13579 existing records from primary storage. [2025-10-15T22:39:14.725698] [INFO ] [MAIN ] KAI: Loaded 13579 primary data records. [2025-10-15T22:39:14.856398] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:14.856863] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:14.860957] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 44730 primary records. [2025-10-15T22:39:14.861682] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50422 primary records. [2025-10-15T22:39:14.861065] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-15T22:39:14.867329] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-15T22:39:15.072320] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-15T22:39:15.083723] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-15T22:39:15.086179] [INFO ] [MAIN ] Derivative Progress: 998/1803 symbols completed. JXN took 1.5s. Estimated remaining: 5m 5s. Rate: 158.4 symbols/min [2025-10-15T22:39:15.089542] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:15.094207] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-15T22:39:15.094863] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-15T22:39:15.098221] [INFO ] [MAIN ] Derivative Progress: 999/1803 symbols completed. K took 1.5s. Estimated remaining: 5m 4s. Rate: 158.6 symbols/min [2025-10-15T22:39:15.098955] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:15.129202] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:15.130048] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13579 primary records. [2025-10-15T22:39:15.146233] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-15T22:39:15.147134] [DEBUG] [LOCAL ] KB: Loaded 23340 existing records from primary storage. [2025-10-15T22:39:15.148014] [INFO ] [MAIN ] KB: Loaded 23340 primary data records. [2025-10-15T22:39:15.196092] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-15T22:39:15.208863] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-15T22:39:15.223077] [INFO ] [MAIN ] Derivative Progress: 1000/1803 symbols completed. KAI took 0.5s. Estimated remaining: 5m 4s. Rate: 158.7 symbols/min [2025-10-15T22:39:15.261636] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:15.262568] [DEBUG] [LOCAL ] KAR: Loaded 40054 existing records from primary storage. [2025-10-15T22:39:15.268115] [INFO ] [MAIN ] KAR: Loaded 40054 primary data records. [2025-10-15T22:39:15.684079] [DEBUG] [LOCAL ] KBDC: Loaded 22209 existing records from primary storage. [2025-10-15T22:39:15.690886] [INFO ] [MAIN ] KBDC: Loaded 22209 primary data records. [2025-10-15T22:39:16.198518] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:16.200198] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23340 primary records. [2025-10-15T22:39:16.202124] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-15T22:39:16.237554] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-15T22:39:16.237862] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-15T22:39:16.236058] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:16.240130] [INFO ] [MAIN ] Derivative Progress: 1001/1803 symbols completed. KB took 1.1s. Estimated remaining: 5m 4s. Rate: 158.4 symbols/min [2025-10-15T22:39:16.241300] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40054 primary records. [2025-10-15T22:39:16.241528] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-15T22:39:16.241683] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:16.262988] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-15T22:39:16.263413] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-15T22:39:16.266390] [INFO ] [MAIN ] Derivative Progress: 1002/1803 symbols completed. KAR took 1.2s. Estimated remaining: 5m 3s. Rate: 158.6 symbols/min [2025-10-15T22:39:16.266943] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:16.287165] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:16.288036] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 22209 primary records. [2025-10-15T22:39:16.288197] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-15T22:39:16.308160] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-15T22:39:16.319429] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-15T22:39:16.322622] [INFO ] [MAIN ] Derivative Progress: 1003/1803 symbols completed. KBDC took 1.1s. Estimated remaining: 5m 2s. Rate: 158.7 symbols/min [2025-10-15T22:39:16.353433] [DEBUG] [LOCAL ] KBH: Loaded 48840 existing records from primary storage. [2025-10-15T22:39:16.353665] [INFO ] [MAIN ] KBH: Loaded 48840 primary data records. [2025-10-15T22:39:16.518917] [DEBUG] [LOCAL ] KBR: Loaded 48081 existing records from primary storage. [2025-10-15T22:39:16.519173] [INFO ] [MAIN ] KBR: Loaded 48081 primary data records. [2025-10-15T22:39:17.212695] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:17.213841] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48840 primary records. [2025-10-15T22:39:17.214052] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-15T22:39:17.233003] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-15T22:39:17.233898] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-15T22:39:17.236762] [INFO ] [MAIN ] Derivative Progress: 1004/1803 symbols completed. KBH took 1.0s. Estimated remaining: 5m 2s. Rate: 158.5 symbols/min [2025-10-15T22:39:17.250265] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:17.250914] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48081 primary records. [2025-10-15T22:39:17.250975] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-15T22:39:17.266458] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-15T22:39:17.266571] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-15T22:39:17.269189] [INFO ] [MAIN ] Derivative Progress: 1005/1803 symbols completed. KBR took 1.0s. Estimated remaining: 5m 2s. Rate: 158.6 symbols/min [2025-10-15T22:39:17.269751] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:17.269622] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:17.270042] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:17.279843] [DEBUG] [LOCAL ] KEN: Loaded 4705 existing records from primary storage. [2025-10-15T22:39:17.280065] [INFO ] [MAIN ] KEN: Loaded 4705 primary data records. [2025-10-15T22:39:17.430860] [DEBUG] [LOCAL ] KEP: Loaded 31996 existing records from primary storage. [2025-10-15T22:39:17.454665] [INFO ] [MAIN ] KEP: Loaded 31996 primary data records. [2025-10-15T22:39:17.770017] [DEBUG] [LOCAL ] KD: Loaded 52354 existing records from primary storage. [2025-10-15T22:39:17.789507] [INFO ] [MAIN ] KD: Loaded 52354 primary data records. [2025-10-15T22:39:18.267380] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:18.268842] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4705 primary records. [2025-10-15T22:39:18.269114] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-15T22:39:18.286241] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-15T22:39:18.286460] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-15T22:39:18.288634] [INFO ] [MAIN ] Derivative Progress: 1006/1803 symbols completed. KEN took 1.0s. Estimated remaining: 5m 2s. Rate: 158.4 symbols/min [2025-10-15T22:39:18.288812] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:18.307089] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:18.307780] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31996 primary records. [2025-10-15T22:39:18.308083] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-15T22:39:18.326198] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-15T22:39:18.326421] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-15T22:39:18.330694] [INFO ] [MAIN ] Derivative Progress: 1007/1803 symbols completed. KEP took 1.1s. Estimated remaining: 5m 1s. Rate: 158.5 symbols/min [2025-10-15T22:39:18.331432] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:18.354443] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:18.355121] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52354 primary records. [2025-10-15T22:39:18.355283] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-15T22:39:18.370969] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-15T22:39:18.381561] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-15T22:39:18.384923] [INFO ] [MAIN ] Derivative Progress: 1008/1803 symbols completed. KD took 1.1s. Estimated remaining: 5m 1s. Rate: 158.6 symbols/min [2025-10-15T22:39:18.385186] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:18.386109] [DEBUG] [LOCAL ] KEX: Loaded 38604 existing records from primary storage. [2025-10-15T22:39:18.386260] [INFO ] [MAIN ] KEX: Loaded 38604 primary data records. [2025-10-15T22:39:18.554232] [DEBUG] [LOCAL ] KFRC: Loaded 20493 existing records from primary storage. [2025-10-15T22:39:18.591800] [INFO ] [MAIN ] KFRC: Loaded 20493 primary data records. [2025-10-15T22:39:18.812212] [DEBUG] [LOCAL ] KEYS: Loaded 43274 existing records from primary storage. [2025-10-15T22:39:18.824194] [INFO ] [MAIN ] KEYS: Loaded 43274 primary data records. [2025-10-15T22:39:19.347260] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:19.348936] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38604 primary records. [2025-10-15T22:39:19.349283] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-15T22:39:19.366733] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-15T22:39:19.366941] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-15T22:39:19.369022] [INFO ] [MAIN ] Derivative Progress: 1009/1803 symbols completed. KEX took 1.1s. Estimated remaining: 5m 1s. Rate: 158.4 symbols/min [2025-10-15T22:39:19.369980] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:19.390332] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:19.391058] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 20493 primary records. [2025-10-15T22:39:19.391181] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-15T22:39:19.395744] [DEBUG] [LOCAL ] KFS: Loaded 8664 existing records from primary storage. [2025-10-15T22:39:19.396010] [INFO ] [MAIN ] KFS: Loaded 8664 primary data records. [2025-10-15T22:39:19.431816] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-15T22:39:19.431920] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-15T22:39:19.445694] [INFO ] [MAIN ] Derivative Progress: 1010/1803 symbols completed. KFRC took 1.1s. Estimated remaining: 5m 0s. Rate: 158.5 symbols/min [2025-10-15T22:39:19.469588] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:19.529676] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:19.530674] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43274 primary records. [2025-10-15T22:39:19.546432] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-15T22:39:19.743740] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-15T22:39:19.751210] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-15T22:39:19.755064] [INFO ] [MAIN ] Derivative Progress: 1011/1803 symbols completed. KEYS took 1.4s. Estimated remaining: 4m 60s. Rate: 158.5 symbols/min [2025-10-15T22:39:19.755596] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:19.769440] [DEBUG] [LOCAL ] KFY: Loaded 29991 existing records from primary storage. [2025-10-15T22:39:19.769866] [INFO ] [MAIN ] KFY: Loaded 29991 primary data records. [2025-10-15T22:39:20.003222] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:39:20.108478] [INFO ] [MAIN ] KFS: Generated 1793 derivative records from 8664 primary records. [2025-10-15T22:39:20.113725] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-15T22:39:20.155581] [DEBUG] [LOCAL ] KFS: Derivative data saved (1793 records). [2025-10-15T22:39:20.158590] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-15T22:39:20.157194] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-15T22:39:20.158989] [INFO ] [MAIN ] KGC: Loaded 53700 primary data records. [2025-10-15T22:39:20.161305] [INFO ] [MAIN ] Derivative Progress: 1012/1803 symbols completed. KFS took 0.8s. Estimated remaining: 4m 59s. Rate: 158.5 symbols/min [2025-10-15T22:39:20.162129] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:20.518715] [DEBUG] [LOCAL ] KGS: Loaded 46135 existing records from primary storage. [2025-10-15T22:39:20.520522] [INFO ] [MAIN ] KGS: Loaded 46135 primary data records. [2025-10-15T22:39:20.625318] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:20.636571] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 29991 primary records. [2025-10-15T22:39:20.637485] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-15T22:39:20.733029] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-15T22:39:20.845591] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-15T22:39:20.849244] [INFO ] [MAIN ] Derivative Progress: 1013/1803 symbols completed. KFY took 1.4s. Estimated remaining: 4m 59s. Rate: 158.4 symbols/min [2025-10-15T22:39:20.849598] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:20.869712] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:20.870593] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53700 primary records. [2025-10-15T22:39:20.870703] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-15T22:39:20.888486] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-15T22:39:20.888780] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-15T22:39:20.890858] [INFO ] [MAIN ] Derivative Progress: 1014/1803 symbols completed. KGC took 1.1s. Estimated remaining: 4m 59s. Rate: 158.5 symbols/min [2025-10-15T22:39:20.891225] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:20.929182] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:20.930448] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 46135 primary records. [2025-10-15T22:39:20.930791] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-15T22:39:20.973186] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-15T22:39:20.980779] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-15T22:39:20.985337] [DEBUG] [LOCAL ] KIO: Loaded 21606 existing records from primary storage. [2025-10-15T22:39:20.984841] [INFO ] [MAIN ] Derivative Progress: 1015/1803 symbols completed. KGS took 0.8s. Estimated remaining: 4m 58s. Rate: 158.7 symbols/min [2025-10-15T22:39:20.987568] [INFO ] [MAIN ] KIO: Loaded 21606 primary data records. [2025-10-15T22:39:20.987768] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:20.987339] [DEBUG] [LOCAL ] KIM: Loaded 53004 existing records from primary storage. [2025-10-15T22:39:20.993728] [INFO ] [MAIN ] KIM: Loaded 53004 primary data records. [2025-10-15T22:39:21.655146] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-15T22:39:21.657364] [INFO ] [MAIN ] KKR: Loaded 53503 primary data records. [2025-10-15T22:39:21.995137] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:21.997205] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21606 primary records. [2025-10-15T22:39:21.997817] [DEBUG] [MAIN ] KIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:21.998533] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53004 primary records. [2025-10-15T22:39:21.997917] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-15T22:39:21.998684] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-15T22:39:22.038619] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-15T22:39:22.038107] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-15T22:39:22.038932] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-15T22:39:22.039059] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-15T22:39:22.041205] [INFO ] [MAIN ] Derivative Progress: 1016/1803 symbols completed. KIO took 1.1s. Estimated remaining: 4m 58s. Rate: 158.4 symbols/min [2025-10-15T22:39:22.058010] [INFO ] [MAIN ] Derivative Progress: 1017/1803 symbols completed. KIM took 1.2s. Estimated remaining: 4m 57s. Rate: 158.5 symbols/min [2025-10-15T22:39:22.057880] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:22.062134] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:22.063288] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53503 primary records. [2025-10-15T22:39:22.063746] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:22.063984] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-15T22:39:22.087857] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-15T22:39:22.087430] [DEBUG] [LOCAL ] KKRS: Loaded 5638 existing records from primary storage. [2025-10-15T22:39:22.088355] [INFO ] [MAIN ] KKRS: Loaded 5638 primary data records. [2025-10-15T22:39:22.088148] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-15T22:39:22.091838] [INFO ] [MAIN ] Derivative Progress: 1018/1803 symbols completed. KKR took 1.1s. Estimated remaining: 4m 57s. Rate: 158.7 symbols/min [2025-10-15T22:39:22.298719] [DEBUG] [LOCAL ] KLC: Loaded 36505 existing records from primary storage. [2025-10-15T22:39:22.303457] [INFO ] [MAIN ] KLC: Loaded 36505 primary data records. [2025-10-15T22:39:22.818035] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:22.818925] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5638 primary records. [2025-10-15T22:39:22.819143] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-15T22:39:22.835264] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-15T22:39:22.835518] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-15T22:39:22.837558] [INFO ] [MAIN ] Derivative Progress: 1019/1803 symbols completed. KKRS took 0.8s. Estimated remaining: 4m 57s. Rate: 158.5 symbols/min [2025-10-15T22:39:22.853570] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:22.854388] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36505 primary records. [2025-10-15T22:39:22.854458] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-15T22:39:22.871121] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-15T22:39:22.871196] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-15T22:39:22.875152] [INFO ] [MAIN ] Derivative Progress: 1020/1803 symbols completed. KLC took 0.8s. Estimated remaining: 4m 56s. Rate: 158.7 symbols/min [2025-10-15T22:39:22.875712] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:22.875853] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:22.876086] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:22.885037] [DEBUG] [LOCAL ] KMPB: Loaded 3652 existing records from primary storage. [2025-10-15T22:39:22.885223] [INFO ] [MAIN ] KMPB: Loaded 3652 primary data records. [2025-10-15T22:39:23.223473] [DEBUG] [LOCAL ] KMPR: Loaded 39987 existing records from primary storage. [2025-10-15T22:39:23.223837] [INFO ] [MAIN ] KMPR: Loaded 39987 primary data records. [2025-10-15T22:39:23.346366] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-15T22:39:23.346634] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-15T22:39:23.877997] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:23.880050] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3652 primary records. [2025-10-15T22:39:23.880556] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-15T22:39:23.899033] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-10-15T22:39:23.899181] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-15T22:39:23.901518] [INFO ] [MAIN ] Derivative Progress: 1021/1803 symbols completed. KMPB took 1.0s. Estimated remaining: 4m 56s. Rate: 158.4 symbols/min [2025-10-15T22:39:23.901842] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:23.918961] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:23.919825] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 39987 primary records. [2025-10-15T22:39:23.919994] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-15T22:39:23.948138] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:23.949112] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-15T22:39:23.951453] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-15T22:39:23.953407] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-15T22:39:23.963500] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-15T22:39:23.973596] [INFO ] [MAIN ] Derivative Progress: 1022/1803 symbols completed. KMPR took 1.1s. Estimated remaining: 4m 56s. Rate: 158.5 symbols/min [2025-10-15T22:39:23.973833] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:23.983043] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-15T22:39:23.983211] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-15T22:39:23.985825] [INFO ] [MAIN ] Derivative Progress: 1023/1803 symbols completed. KMI took 1.1s. Estimated remaining: 4m 55s. Rate: 158.7 symbols/min [2025-10-15T22:39:23.986133] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:24.000565] [DEBUG] [LOCAL ] KMT: Loaded 42946 existing records from primary storage. [2025-10-15T22:39:24.000780] [INFO ] [MAIN ] KMT: Loaded 42946 primary data records. [2025-10-15T22:39:24.344177] [DEBUG] [LOCAL ] KN: Loaded 38621 existing records from primary storage. [2025-10-15T22:39:24.344873] [INFO ] [MAIN ] KN: Loaded 38621 primary data records. [2025-10-15T22:39:24.368365] [DEBUG] [LOCAL ] KMX: Loaded 53277 existing records from primary storage. [2025-10-15T22:39:24.414857] [INFO ] [MAIN ] KMX: Loaded 53277 primary data records. [2025-10-15T22:39:25.033363] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:25.035231] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42946 primary records. [2025-10-15T22:39:25.035388] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-15T22:39:25.059145] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-15T22:39:25.059437] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-15T22:39:25.062029] [INFO ] [MAIN ] Derivative Progress: 1024/1803 symbols completed. KMT took 1.2s. Estimated remaining: 4m 55s. Rate: 158.4 symbols/min [2025-10-15T22:39:25.062366] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:25.076607] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:25.078102] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38621 primary records. [2025-10-15T22:39:25.079114] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-15T22:39:25.100171] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:25.104493] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53277 primary records. [2025-10-15T22:39:25.104800] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-15T22:39:25.109693] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-15T22:39:25.110027] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-15T22:39:25.119383] [INFO ] [MAIN ] Derivative Progress: 1025/1803 symbols completed. KN took 1.1s. Estimated remaining: 4m 54s. Rate: 158.5 symbols/min [2025-10-15T22:39:25.119612] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:25.128935] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-15T22:39:25.129690] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-15T22:39:25.132434] [INFO ] [MAIN ] Derivative Progress: 1026/1803 symbols completed. KMX took 1.2s. Estimated remaining: 4m 54s. Rate: 158.7 symbols/min [2025-10-15T22:39:25.132766] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:25.150340] [DEBUG] [LOCAL ] KNOP: Loaded 10486 existing records from primary storage. [2025-10-15T22:39:25.150482] [INFO ] [MAIN ] KNOP: Loaded 10486 primary data records. [2025-10-15T22:39:25.260935] [DEBUG] [LOCAL ] KNF: Loaded 36599 existing records from primary storage. [2025-10-15T22:39:25.272059] [INFO ] [MAIN ] KNF: Loaded 36599 primary data records. [2025-10-15T22:39:25.349951] [DEBUG] [LOCAL ] KNSL: Loaded 18426 existing records from primary storage. [2025-10-15T22:39:25.364065] [INFO ] [MAIN ] KNSL: Loaded 18426 primary data records. [2025-10-15T22:39:26.112467] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:26.113429] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10486 primary records. [2025-10-15T22:39:26.113770] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-15T22:39:26.153866] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:26.155148] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36599 primary records. [2025-10-15T22:39:26.155555] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-15T22:39:26.170044] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-15T22:39:26.170443] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-15T22:39:26.183694] [INFO ] [MAIN ] Derivative Progress: 1027/1803 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 54s. Rate: 158.4 symbols/min [2025-10-15T22:39:26.181678] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:26.183883] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:26.188707] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18426 primary records. [2025-10-15T22:39:26.189260] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-15T22:39:26.207941] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-15T22:39:26.209553] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-15T22:39:26.212860] [INFO ] [MAIN ] Derivative Progress: 1028/1803 symbols completed. KNF took 1.2s. Estimated remaining: 4m 53s. Rate: 158.5 symbols/min [2025-10-15T22:39:26.213801] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-15T22:39:26.214121] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-15T22:39:26.216934] [INFO ] [MAIN ] Derivative Progress: 1029/1803 symbols completed. KNSL took 1.1s. Estimated remaining: 4m 53s. Rate: 158.7 symbols/min [2025-10-15T22:39:26.214054] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:26.217128] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:26.268493] [DEBUG] [LOCAL ] KNTK: Loaded 47085 existing records from primary storage. [2025-10-15T22:39:26.268794] [INFO ] [MAIN ] KNTK: Loaded 47085 primary data records. [2025-10-15T22:39:26.416962] [DEBUG] [LOCAL ] KODK: Loaded 43766 existing records from primary storage. [2025-10-15T22:39:26.423070] [INFO ] [MAIN ] KODK: Loaded 43766 primary data records. [2025-10-15T22:39:26.627893] [DEBUG] [LOCAL ] KNX: Loaded 52615 existing records from primary storage. [2025-10-15T22:39:26.711827] [INFO ] [MAIN ] KNX: Loaded 52615 primary data records. [2025-10-15T22:39:27.275988] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:27.277495] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 47085 primary records. [2025-10-15T22:39:27.277612] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-15T22:39:27.296413] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-15T22:39:27.297553] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-15T22:39:27.301493] [INFO ] [MAIN ] Derivative Progress: 1030/1803 symbols completed. KNTK took 1.1s. Estimated remaining: 4m 53s. Rate: 158.4 symbols/min [2025-10-15T22:39:27.314236] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:27.314596] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:27.315779] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43766 primary records. [2025-10-15T22:39:27.323488] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-15T22:39:27.329096] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:27.329865] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52615 primary records. [2025-10-15T22:39:27.330122] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-15T22:39:27.358428] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-15T22:39:27.358528] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-15T22:39:27.368716] [INFO ] [MAIN ] Derivative Progress: 1031/1803 symbols completed. KODK took 1.2s. Estimated remaining: 4m 52s. Rate: 158.5 symbols/min [2025-10-15T22:39:27.369142] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:27.371760] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-15T22:39:27.371889] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-15T22:39:27.375351] [INFO ] [MAIN ] Derivative Progress: 1032/1803 symbols completed. KNX took 1.2s. Estimated remaining: 4m 52s. Rate: 158.7 symbols/min [2025-10-15T22:39:27.376197] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:27.385418] [DEBUG] [LOCAL ] KOF: Loaded 26616 existing records from primary storage. [2025-10-15T22:39:27.385710] [INFO ] [MAIN ] KOF: Loaded 26616 primary data records. [2025-10-15T22:39:27.457873] [DEBUG] [LOCAL ] KORE: Loaded 2164 existing records from primary storage. [2025-10-15T22:39:27.470075] [INFO ] [MAIN ] KORE: Loaded 2164 primary data records. [2025-10-15T22:39:27.580951] [DEBUG] [LOCAL ] KOP: Loaded 17433 existing records from primary storage. [2025-10-15T22:39:27.614087] [INFO ] [MAIN ] KOP: Loaded 17433 primary data records. [2025-10-15T22:39:28.369344] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:28.371464] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26616 primary records. [2025-10-15T22:39:28.371758] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-15T22:39:28.397050] [DEBUG] [MAIN ] KORE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:28.400725] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 2164 primary records. [2025-10-15T22:39:28.401688] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-15T22:39:28.410496] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-15T22:39:28.410600] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-15T22:39:28.427674] [INFO ] [MAIN ] Derivative Progress: 1033/1803 symbols completed. KOF took 1.1s. Estimated remaining: 4m 52s. Rate: 158.4 symbols/min [2025-10-15T22:39:28.429625] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:28.431918] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17433 primary records. [2025-10-15T22:39:28.432559] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-10-15T22:39:28.432659] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-15T22:39:28.432717] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-15T22:39:28.434720] [INFO ] [MAIN ] Derivative Progress: 1034/1803 symbols completed. KORE took 1.1s. Estimated remaining: 4m 51s. Rate: 158.6 symbols/min [2025-10-15T22:39:28.449542] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-15T22:39:28.449599] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-15T22:39:28.452364] [INFO ] [MAIN ] Derivative Progress: 1035/1803 symbols completed. KOP took 1.1s. Estimated remaining: 4m 50s. Rate: 158.7 symbols/min [2025-10-15T22:39:28.452722] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:28.452816] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:28.452949] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:28.506812] [DEBUG] [LOCAL ] KREF: Loaded 37941 existing records from primary storage. [2025-10-15T22:39:28.518723] [INFO ] [MAIN ] KREF: Loaded 37941 primary data records. [2025-10-15T22:39:28.635420] [DEBUG] [LOCAL ] KR: Loaded 53680 existing records from primary storage. [2025-10-15T22:39:28.698850] [DEBUG] [LOCAL ] KOS: Loaded 53097 existing records from primary storage. [2025-10-15T22:39:28.733681] [INFO ] [MAIN ] KR: Loaded 53680 primary data records. [2025-10-15T22:39:28.834142] [INFO ] [MAIN ] KOS: Loaded 53097 primary data records. [2025-10-15T22:39:29.461288] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:29.462435] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37941 primary records. [2025-10-15T22:39:29.462684] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-15T22:39:29.483405] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-15T22:39:29.483674] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-15T22:39:29.485784] [INFO ] [MAIN ] Derivative Progress: 1036/1803 symbols completed. KREF took 1.0s. Estimated remaining: 4m 50s. Rate: 158.4 symbols/min [2025-10-15T22:39:29.486048] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:29.499532] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:29.500299] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53680 primary records. [2025-10-15T22:39:29.500528] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-15T22:39:29.518680] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-15T22:39:29.519467] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-15T22:39:29.522018] [INFO ] [MAIN ] Derivative Progress: 1037/1803 symbols completed. KR took 1.1s. Estimated remaining: 4m 50s. Rate: 158.6 symbols/min [2025-10-15T22:39:29.522157] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:29.536067] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:29.536862] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53097 primary records. [2025-10-15T22:39:29.537812] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-15T22:39:29.572089] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-15T22:39:29.572344] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-15T22:39:29.575477] [INFO ] [MAIN ] Derivative Progress: 1038/1803 symbols completed. KOS took 1.1s. Estimated remaining: 4m 49s. Rate: 158.7 symbols/min [2025-10-15T22:39:29.582870] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:29.584772] [DEBUG] [LOCAL ] KRO: Loaded 26413 existing records from primary storage. [2025-10-15T22:39:29.584909] [INFO ] [MAIN ] KRO: Loaded 26413 primary data records. [2025-10-15T22:39:29.699769] [DEBUG] [LOCAL ] KRG: Loaded 49285 existing records from primary storage. [2025-10-15T22:39:29.699971] [INFO ] [MAIN ] KRG: Loaded 49285 primary data records. [2025-10-15T22:39:30.035457] [DEBUG] [LOCAL ] KRP: Loaded 36348 existing records from primary storage. [2025-10-15T22:39:30.061819] [INFO ] [MAIN ] KRP: Loaded 36348 primary data records. [2025-10-15T22:39:30.557049] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:30.558969] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26413 primary records. [2025-10-15T22:39:30.559420] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-15T22:39:30.572594] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:30.573458] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49285 primary records. [2025-10-15T22:39:30.573881] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-15T22:39:30.602365] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-15T22:39:30.603780] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-15T22:39:30.606223] [INFO ] [MAIN ] Derivative Progress: 1039/1803 symbols completed. KRO took 1.1s. Estimated remaining: 4m 49s. Rate: 158.4 symbols/min [2025-10-15T22:39:30.606379] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:30.608373] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-15T22:39:30.608589] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-15T22:39:30.610920] [INFO ] [MAIN ] Derivative Progress: 1040/1803 symbols completed. KRG took 1.1s. Estimated remaining: 4m 49s. Rate: 158.6 symbols/min [2025-10-15T22:39:30.611251] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:30.627902] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:30.628584] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36348 primary records. [2025-10-15T22:39:30.628800] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-15T22:39:30.646204] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-15T22:39:30.646398] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-15T22:39:30.649440] [INFO ] [MAIN ] Derivative Progress: 1041/1803 symbols completed. KRP took 1.1s. Estimated remaining: 4m 48s. Rate: 158.7 symbols/min [2025-10-15T22:39:30.649845] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:30.710594] [DEBUG] [LOCAL ] KSS: Loaded 53593 existing records from primary storage. [2025-10-15T22:39:30.711209] [DEBUG] [LOCAL ] KT: Loaded 45480 existing records from primary storage. [2025-10-15T22:39:30.711364] [INFO ] [MAIN ] KT: Loaded 45480 primary data records. [2025-10-15T22:39:30.711567] [INFO ] [MAIN ] KSS: Loaded 53593 primary data records. [2025-10-15T22:39:30.936492] [DEBUG] [LOCAL ] KTB: Loaded 40516 existing records from primary storage. [2025-10-15T22:39:30.947749] [INFO ] [MAIN ] KTB: Loaded 40516 primary data records. [2025-10-15T22:39:31.696195] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:31.696457] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:31.697921] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53593 primary records. [2025-10-15T22:39:31.697331] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45480 primary records. [2025-10-15T22:39:31.698364] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-15T22:39:31.698161] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-15T22:39:31.728224] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-15T22:39:31.737547] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-15T22:39:31.740598] [INFO ] [MAIN ] Derivative Progress: 1042/1803 symbols completed. KT took 1.1s. Estimated remaining: 4m 48s. Rate: 158.4 symbols/min [2025-10-15T22:39:31.746446] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:31.746176] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:31.749470] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40516 primary records. [2025-10-15T22:39:31.749611] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-15T22:39:31.749550] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-15T22:39:31.750255] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-15T22:39:31.753221] [INFO ] [MAIN ] Derivative Progress: 1043/1803 symbols completed. KSS took 1.1s. Estimated remaining: 4m 48s. Rate: 158.6 symbols/min [2025-10-15T22:39:31.753600] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:31.773286] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-15T22:39:31.773760] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-15T22:39:31.778440] [DEBUG] [LOCAL ] KTF: Loaded 11799 existing records from primary storage. [2025-10-15T22:39:31.780925] [INFO ] [MAIN ] Derivative Progress: 1044/1803 symbols completed. KTB took 1.1s. Estimated remaining: 4m 47s. Rate: 158.7 symbols/min [2025-10-15T22:39:31.781058] [INFO ] [MAIN ] KTF: Loaded 11799 primary data records. [2025-10-15T22:39:31.801741] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:32.115766] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-15T22:39:32.116919] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-15T22:39:32.241843] [DEBUG] [LOCAL ] KVYO: Loaded 50785 existing records from primary storage. [2025-10-15T22:39:32.247472] [INFO ] [MAIN ] KVYO: Loaded 50785 primary data records. [2025-10-15T22:39:32.639703] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:32.678429] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 11799 primary records. [2025-10-15T22:39:32.787517] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-15T22:39:32.821244] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-15T22:39:32.821508] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-15T22:39:32.823631] [INFO ] [MAIN ] Derivative Progress: 1045/1803 symbols completed. KTF took 1.1s. Estimated remaining: 4m 47s. Rate: 158.5 symbols/min [2025-10-15T22:39:32.824141] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:32.841988] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:32.842723] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-15T22:39:32.842987] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-15T22:39:32.860055] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-15T22:39:32.861137] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-15T22:39:32.863973] [INFO ] [MAIN ] Derivative Progress: 1046/1803 symbols completed. KVUE took 1.1s. Estimated remaining: 4m 46s. Rate: 158.6 symbols/min [2025-10-15T22:39:32.864718] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:32.888875] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:39:32.889597] [INFO ] [MAIN ] KVYO: Generated 1793 derivative records from 50785 primary records. [2025-10-15T22:39:32.889847] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-15T22:39:32.920711] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1793 records). [2025-10-15T22:39:32.920888] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-15T22:39:32.923445] [INFO ] [MAIN ] Derivative Progress: 1047/1803 symbols completed. KVYO took 1.1s. Estimated remaining: 4m 46s. Rate: 158.7 symbols/min [2025-10-15T22:39:32.924676] [DEBUG] [LOCAL ] KW: Loaded 40511 existing records from primary storage. [2025-10-15T22:39:32.923683] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:32.930440] [INFO ] [MAIN ] KW: Loaded 40511 primary data records. [2025-10-15T22:39:32.930931] [DEBUG] [LOCAL ] KWR: Loaded 16108 existing records from primary storage. [2025-10-15T22:39:32.931180] [INFO ] [MAIN ] KWR: Loaded 16108 primary data records. [2025-10-15T22:39:33.314515] [DEBUG] [LOCAL ] KYN: Loaded 30275 existing records from primary storage. [2025-10-15T22:39:33.450172] [INFO ] [MAIN ] KYN: Loaded 30275 primary data records. [2025-10-15T22:39:33.935016] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:33.937468] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16108 primary records. [2025-10-15T22:39:33.938010] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-15T22:39:33.955673] [DEBUG] [MAIN ] KW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:33.965079] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40511 primary records. [2025-10-15T22:39:33.970871] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-15T22:39:33.974928] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-15T22:39:33.975553] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-15T22:39:33.978855] [INFO ] [MAIN ] Derivative Progress: 1048/1803 symbols completed. KWR took 1.1s. Estimated remaining: 4m 46s. Rate: 158.5 symbols/min [2025-10-15T22:39:33.995378] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-15T22:39:33.995850] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-15T22:39:33.998089] [INFO ] [MAIN ] Derivative Progress: 1049/1803 symbols completed. KW took 1.2s. Estimated remaining: 4m 45s. Rate: 158.6 symbols/min [2025-10-15T22:39:34.019142] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:34.020079] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30275 primary records. [2025-10-15T22:39:34.020163] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-15T22:39:34.039841] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-15T22:39:34.039996] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-15T22:39:34.042794] [INFO ] [MAIN ] Derivative Progress: 1050/1803 symbols completed. KYN took 1.1s. Estimated remaining: 4m 45s. Rate: 158.7 symbols/min [2025-10-15T22:39:34.043355] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:34.043435] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:34.043586] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:34.095597] [DEBUG] [LOCAL ] LAD: Loaded 23378 existing records from primary storage. [2025-10-15T22:39:34.096066] [INFO ] [MAIN ] LAD: Loaded 23378 primary data records. [2025-10-15T22:39:34.227964] [DEBUG] [LOCAL ] LAC: Loaded 52510 existing records from primary storage. [2025-10-15T22:39:34.239408] [INFO ] [MAIN ] LAC: Loaded 52510 primary data records. [2025-10-15T22:39:34.228731] [DEBUG] [LOCAL ] L: Loaded 41169 existing records from primary storage. [2025-10-15T22:39:34.289308] [INFO ] [MAIN ] L: Loaded 41169 primary data records. [2025-10-15T22:39:35.104207] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:35.106109] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23378 primary records. [2025-10-15T22:39:35.106495] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-15T22:39:35.124896] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-10-15T22:39:35.125171] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-15T22:39:35.127013] [INFO ] [MAIN ] Derivative Progress: 1051/1803 symbols completed. LAD took 1.1s. Estimated remaining: 4m 45s. Rate: 158.5 symbols/min [2025-10-15T22:39:35.127256] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:35.164406] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:35.166636] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52510 primary records. [2025-10-15T22:39:35.166493] [DEBUG] [MAIN ] L: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:35.166940] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-15T22:39:35.167917] [INFO ] [MAIN ] L: Generated 1794 derivative records from 41169 primary records. [2025-10-15T22:39:35.168772] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-15T22:39:35.210394] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-15T22:39:35.211378] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-15T22:39:35.214317] [INFO ] [MAIN ] Derivative Progress: 1052/1803 symbols completed. L took 1.2s. Estimated remaining: 4m 44s. Rate: 158.6 symbols/min [2025-10-15T22:39:35.216552] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-15T22:39:35.216774] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-15T22:39:35.219048] [INFO ] [MAIN ] Derivative Progress: 1053/1803 symbols completed. LAC took 1.2s. Estimated remaining: 4m 44s. Rate: 158.7 symbols/min [2025-10-15T22:39:35.219200] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:35.216697] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:35.224746] [DEBUG] [LOCAL ] LANV: Loaded 2784 existing records from primary storage. [2025-10-15T22:39:35.236312] [INFO ] [MAIN ] LANV: Loaded 2784 primary data records. [2025-10-15T22:39:35.279143] [DEBUG] [LOCAL ] LADR: Loaded 39396 existing records from primary storage. [2025-10-15T22:39:35.285366] [INFO ] [MAIN ] LADR: Loaded 39396 primary data records. [2025-10-15T22:39:35.407802] [DEBUG] [LOCAL ] LAW: Loaded 14653 existing records from primary storage. [2025-10-15T22:39:35.442906] [INFO ] [MAIN ] LAW: Loaded 14653 primary data records. [2025-10-15T22:39:36.232259] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:36.234819] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39396 primary records. [2025-10-15T22:39:36.235095] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-15T22:39:36.261900] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:36.264796] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-15T22:39:36.265685] [INFO ] [MAIN ] LANV: Generated 1794 derivative records from 2784 primary records. [2025-10-15T22:39:36.265788] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-15T22:39:36.265977] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-15T22:39:36.268512] [INFO ] [MAIN ] Derivative Progress: 1054/1803 symbols completed. LADR took 1.1s. Estimated remaining: 4m 44s. Rate: 158.5 symbols/min [2025-10-15T22:39:36.268722] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:36.284563] [DEBUG] [LOCAL ] LANV: Derivative data saved (1794 records). [2025-10-15T22:39:36.284750] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-15T22:39:36.286673] [INFO ] [MAIN ] Derivative Progress: 1055/1803 symbols completed. LANV took 1.1s. Estimated remaining: 4m 43s. Rate: 158.6 symbols/min [2025-10-15T22:39:36.286910] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:36.299981] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:36.300562] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14653 primary records. [2025-10-15T22:39:36.300756] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-15T22:39:36.316584] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-15T22:39:36.316757] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-15T22:39:36.319576] [INFO ] [MAIN ] Derivative Progress: 1056/1803 symbols completed. LAW took 1.1s. Estimated remaining: 4m 42s. Rate: 158.7 symbols/min [2025-10-15T22:39:36.319897] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:36.356494] [DEBUG] [LOCAL ] LAZ: Loaded 44741 existing records from primary storage. [2025-10-15T22:39:36.356718] [INFO ] [MAIN ] LAZ: Loaded 44741 primary data records. [2025-10-15T22:39:36.481018] [DEBUG] [LOCAL ] LB: Loaded 37383 existing records from primary storage. [2025-10-15T22:39:36.481461] [INFO ] [MAIN ] LB: Loaded 37383 primary data records. [2025-10-15T22:39:36.820450] [DEBUG] [LOCAL ] LBRT: Loaded 52959 existing records from primary storage. [2025-10-15T22:39:36.874466] [INFO ] [MAIN ] LBRT: Loaded 52959 primary data records. [2025-10-15T22:39:37.351168] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:37.352178] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44741 primary records. [2025-10-15T22:39:37.352437] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-15T22:39:37.371743] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-15T22:39:37.384695] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-15T22:39:37.387074] [INFO ] [MAIN ] Derivative Progress: 1057/1803 symbols completed. LAZ took 1.1s. Estimated remaining: 4m 42s. Rate: 158.5 symbols/min [2025-10-15T22:39:37.384617] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:37.388101] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37383 primary records. [2025-10-15T22:39:37.388291] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:37.388918] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-15T22:39:37.422736] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-15T22:39:37.422340] [DEBUG] [MAIN ] LBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:37.423449] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52959 primary records. [2025-10-15T22:39:37.423591] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-15T22:39:37.423527] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-15T22:39:37.426169] [INFO ] [MAIN ] Derivative Progress: 1058/1803 symbols completed. LB took 1.1s. Estimated remaining: 4m 42s. Rate: 158.6 symbols/min [2025-10-15T22:39:37.427083] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:37.454734] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-15T22:39:37.454909] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-15T22:39:37.457758] [INFO ] [MAIN ] Derivative Progress: 1059/1803 symbols completed. LBRT took 1.1s. Estimated remaining: 4m 41s. Rate: 158.7 symbols/min [2025-10-15T22:39:37.458083] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:37.482833] [DEBUG] [LOCAL ] LC: Loaded 48164 existing records from primary storage. [2025-10-15T22:39:37.483042] [INFO ] [MAIN ] LC: Loaded 48164 primary data records. [2025-10-15T22:39:37.598694] [DEBUG] [LOCAL ] LCII: Loaded 27437 existing records from primary storage. [2025-10-15T22:39:37.598964] [INFO ] [MAIN ] LCII: Loaded 27437 primary data records. [2025-10-15T22:39:38.075236] [DEBUG] [LOCAL ] LDI: Loaded 44806 existing records from primary storage. [2025-10-15T22:39:38.117858] [INFO ] [MAIN ] LDI: Loaded 44806 primary data records. [2025-10-15T22:39:38.525980] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:38.525224] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:38.526783] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48164 primary records. [2025-10-15T22:39:38.527512] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 27437 primary records. [2025-10-15T22:39:38.527714] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-15T22:39:38.527670] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-15T22:39:38.561220] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-15T22:39:38.561788] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-15T22:39:38.564861] [INFO ] [MAIN ] Derivative Progress: 1060/1803 symbols completed. LC took 1.2s. Estimated remaining: 4m 41s. Rate: 158.4 symbols/min [2025-10-15T22:39:38.561954] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-15T22:39:38.565089] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:38.566543] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-15T22:39:38.569372] [INFO ] [MAIN ] Derivative Progress: 1061/1803 symbols completed. LCII took 1.1s. Estimated remaining: 4m 41s. Rate: 158.6 symbols/min [2025-10-15T22:39:38.569796] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:38.601137] [DEBUG] [LOCAL ] LDP: Loaded 12815 existing records from primary storage. [2025-10-15T22:39:38.601692] [INFO ] [MAIN ] LDP: Loaded 12815 primary data records. [2025-10-15T22:39:38.601597] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:38.632789] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44806 primary records. [2025-10-15T22:39:38.638024] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-15T22:39:38.941218] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-15T22:39:38.950680] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-15T22:39:38.953403] [INFO ] [MAIN ] Derivative Progress: 1062/1803 symbols completed. LDI took 1.5s. Estimated remaining: 4m 40s. Rate: 158.6 symbols/min [2025-10-15T22:39:38.953738] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:38.954988] [DEBUG] [LOCAL ] LDOS: Loaded 44998 existing records from primary storage. [2025-10-15T22:39:38.956069] [INFO ] [MAIN ] LDOS: Loaded 44998 primary data records. [2025-10-15T22:39:39.299048] [DEBUG] [LOCAL ] LEA: Loaded 41359 existing records from primary storage. [2025-10-15T22:39:39.299422] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:39.300886] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12815 primary records. [2025-10-15T22:39:39.300981] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-15T22:39:39.301085] [INFO ] [MAIN ] LEA: Loaded 41359 primary data records. [2025-10-15T22:39:39.419776] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-15T22:39:39.425809] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-15T22:39:39.463144] [INFO ] [MAIN ] Derivative Progress: 1063/1803 symbols completed. LDP took 0.9s. Estimated remaining: 4m 40s. Rate: 158.5 symbols/min [2025-10-15T22:39:39.627500] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:39.628203] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 44998 primary records. [2025-10-15T22:39:39.628283] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-15T22:39:39.646776] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-15T22:39:39.646946] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-15T22:39:39.650314] [INFO ] [MAIN ] Derivative Progress: 1064/1803 symbols completed. LDOS took 1.1s. Estimated remaining: 4m 40s. Rate: 158.6 symbols/min [2025-10-15T22:39:39.669198] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:39.669917] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41359 primary records. [2025-10-15T22:39:39.669979] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-15T22:39:39.685194] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-15T22:39:39.685259] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-15T22:39:39.687275] [INFO ] [MAIN ] Derivative Progress: 1065/1803 symbols completed. LEA took 0.7s. Estimated remaining: 4m 39s. Rate: 158.7 symbols/min [2025-10-15T22:39:39.687679] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:39.687735] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:39.688196] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:39.705401] [DEBUG] [LOCAL ] LEO: Loaded 16652 existing records from primary storage. [2025-10-15T22:39:39.705552] [INFO ] [MAIN ] LEO: Loaded 16652 primary data records. [2025-10-15T22:39:40.048531] [DEBUG] [LOCAL ] LEG: Loaded 50170 existing records from primary storage. [2025-10-15T22:39:40.048918] [INFO ] [MAIN ] LEG: Loaded 50170 primary data records. [2025-10-15T22:39:40.107831] [DEBUG] [LOCAL ] LEN: Loaded 53195 existing records from primary storage. [2025-10-15T22:39:40.120776] [INFO ] [MAIN ] LEN: Loaded 53195 primary data records. [2025-10-15T22:39:40.746134] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:40.748176] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16652 primary records. [2025-10-15T22:39:40.748466] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-15T22:39:40.769103] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-15T22:39:40.769386] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-15T22:39:40.772192] [INFO ] [MAIN ] Derivative Progress: 1066/1803 symbols completed. LEO took 1.1s. Estimated remaining: 4m 39s. Rate: 158.5 symbols/min [2025-10-15T22:39:40.772455] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:40.792234] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:40.793102] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50170 primary records. [2025-10-15T22:39:40.793295] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-15T22:39:40.815874] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:40.824087] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-15T22:39:40.824244] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-15T22:39:40.822793] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53195 primary records. [2025-10-15T22:39:40.826154] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-15T22:39:40.826033] [INFO ] [MAIN ] Derivative Progress: 1067/1803 symbols completed. LEG took 1.1s. Estimated remaining: 4m 38s. Rate: 158.6 symbols/min [2025-10-15T22:39:40.827307] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:40.844162] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-15T22:39:40.844474] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-15T22:39:40.846803] [INFO ] [MAIN ] Derivative Progress: 1068/1803 symbols completed. LEN took 1.2s. Estimated remaining: 4m 38s. Rate: 158.7 symbols/min [2025-10-15T22:39:40.846986] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:40.880878] [DEBUG] [LOCAL ] LFT: Loaded 18357 existing records from primary storage. [2025-10-15T22:39:40.882175] [INFO ] [MAIN ] LFT: Loaded 18357 primary data records. [2025-10-15T22:39:40.881174] [DEBUG] [LOCAL ] LGI: Loaded 10092 existing records from primary storage. [2025-10-15T22:39:40.882590] [INFO ] [MAIN ] LGI: Loaded 10092 primary data records. [2025-10-15T22:39:40.948941] [DEBUG] [LOCAL ] LEVI: Loaded 51780 existing records from primary storage. [2025-10-15T22:39:40.989230] [INFO ] [MAIN ] LEVI: Loaded 51780 primary data records. [2025-10-15T22:39:41.844843] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:41.848802] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18357 primary records. [2025-10-15T22:39:41.849697] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-15T22:39:41.890881] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:41.890509] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-15T22:39:41.891496] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:41.891584] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-15T22:39:41.893122] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51780 primary records. [2025-10-15T22:39:41.892355] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10092 primary records. [2025-10-15T22:39:41.895097] [INFO ] [MAIN ] Derivative Progress: 1069/1803 symbols completed. LFT took 1.1s. Estimated remaining: 4m 38s. Rate: 158.5 symbols/min [2025-10-15T22:39:41.895234] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-15T22:39:41.895476] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-15T22:39:41.895397] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:41.928009] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-15T22:39:41.924829] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-15T22:39:41.928362] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-15T22:39:41.928203] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-15T22:39:41.930899] [INFO ] [MAIN ] Derivative Progress: 1070/1803 symbols completed. LGI took 1.1s. Estimated remaining: 4m 37s. Rate: 158.6 symbols/min [2025-10-15T22:39:41.933904] [INFO ] [MAIN ] Derivative Progress: 1071/1803 symbols completed. LEVI took 1.2s. Estimated remaining: 4m 37s. Rate: 158.8 symbols/min [2025-10-15T22:39:41.933822] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:41.934332] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:41.981696] [DEBUG] [LOCAL ] LII: Loaded 27767 existing records from primary storage. [2025-10-15T22:39:41.982760] [DEBUG] [LOCAL ] LH: Loaded 37607 existing records from primary storage. [2025-10-15T22:39:41.982873] [INFO ] [MAIN ] LII: Loaded 27767 primary data records. [2025-10-15T22:39:41.983134] [INFO ] [MAIN ] LH: Loaded 37607 primary data records. [2025-10-15T22:39:42.275020] [DEBUG] [LOCAL ] LHX: Loaded 48604 existing records from primary storage. [2025-10-15T22:39:42.311962] [INFO ] [MAIN ] LHX: Loaded 48604 primary data records. [2025-10-15T22:39:42.982519] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:42.983711] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27767 primary records. [2025-10-15T22:39:42.983832] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-15T22:39:43.009052] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:43.013083] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-15T22:39:43.013877] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37607 primary records. [2025-10-15T22:39:43.013978] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-15T22:39:43.015928] [INFO ] [MAIN ] Derivative Progress: 1072/1803 symbols completed. LII took 1.1s. Estimated remaining: 4m 37s. Rate: 158.5 symbols/min [2025-10-15T22:39:43.016188] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:43.014054] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-15T22:39:43.037122] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-15T22:39:43.038608] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-15T22:39:43.041458] [INFO ] [MAIN ] Derivative Progress: 1073/1803 symbols completed. LH took 1.1s. Estimated remaining: 4m 36s. Rate: 158.6 symbols/min [2025-10-15T22:39:43.041715] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:43.055311] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:43.055990] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48604 primary records. [2025-10-15T22:39:43.057154] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-15T22:39:43.078660] [DEBUG] [LOCAL ] LITB: Loaded 4146 existing records from primary storage. [2025-10-15T22:39:43.082435] [INFO ] [MAIN ] LITB: Loaded 4146 primary data records. [2025-10-15T22:39:43.204009] [DEBUG] [LOCAL ] LION: Loaded 46349 existing records from primary storage. [2025-10-15T22:39:43.209369] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-15T22:39:43.225068] [INFO ] [MAIN ] LION: Loaded 46349 primary data records. [2025-10-15T22:39:43.225159] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-15T22:39:43.255476] [INFO ] [MAIN ] Derivative Progress: 1074/1803 symbols completed. LHX took 1.3s. Estimated remaining: 4m 36s. Rate: 158.7 symbols/min [2025-10-15T22:39:43.317502] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:43.765075] [DEBUG] [MAIN ] LITB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:43.780326] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4146 primary records. [2025-10-15T22:39:43.780669] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-15T22:39:43.782552] [DEBUG] [LOCAL ] LLY: Loaded 53261 existing records from primary storage. [2025-10-15T22:39:43.788835] [INFO ] [MAIN ] LLY: Loaded 53261 primary data records. [2025-10-15T22:39:43.887042] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-15T22:39:43.904291] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-15T22:39:43.926334] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:43.937481] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 46349 primary records. [2025-10-15T22:39:43.920729] [INFO ] [MAIN ] Derivative Progress: 1075/1803 symbols completed. LITB took 0.9s. Estimated remaining: 4m 35s. Rate: 158.6 symbols/min [2025-10-15T22:39:43.994056] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-15T22:39:43.993949] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:44.133362] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-15T22:39:44.134208] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-15T22:39:44.136845] [INFO ] [MAIN ] Derivative Progress: 1076/1803 symbols completed. LION took 1.1s. Estimated remaining: 4m 35s. Rate: 158.6 symbols/min [2025-10-15T22:39:44.137097] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:44.160297] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:44.165107] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53261 primary records. [2025-10-15T22:39:44.165279] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-15T22:39:44.194519] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-15T22:39:44.194753] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-15T22:39:44.196884] [INFO ] [MAIN ] Derivative Progress: 1077/1803 symbols completed. LLY took 0.9s. Estimated remaining: 4m 34s. Rate: 158.8 symbols/min [2025-10-15T22:39:44.197211] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:44.227600] [DEBUG] [LOCAL ] LMND: Loaded 52062 existing records from primary storage. [2025-10-15T22:39:44.227882] [INFO ] [MAIN ] LMND: Loaded 52062 primary data records. [2025-10-15T22:39:44.342353] [DEBUG] [LOCAL ] LMT: Loaded 49623 existing records from primary storage. [2025-10-15T22:39:44.349988] [INFO ] [MAIN ] LMT: Loaded 49623 primary data records. [2025-10-15T22:39:44.900213] [DEBUG] [LOCAL ] LNC: Loaded 51556 existing records from primary storage. [2025-10-15T22:39:44.901163] [INFO ] [MAIN ] LNC: Loaded 51556 primary data records. [2025-10-15T22:39:45.244124] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:45.245324] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:45.244988] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49623 primary records. [2025-10-15T22:39:45.246284] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 52062 primary records. [2025-10-15T22:39:45.246710] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-15T22:39:45.247473] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-15T22:39:45.277773] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-15T22:39:45.279912] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-15T22:39:45.283279] [INFO ] [MAIN ] Derivative Progress: 1078/1803 symbols completed. LMT took 1.1s. Estimated remaining: 4m 34s. Rate: 158.5 symbols/min [2025-10-15T22:39:45.284714] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-15T22:39:45.284823] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-15T22:39:45.287215] [INFO ] [MAIN ] Derivative Progress: 1079/1803 symbols completed. LMND took 1.3s. Estimated remaining: 4m 34s. Rate: 158.6 symbols/min [2025-10-15T22:39:45.302221] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:45.302862] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51556 primary records. [2025-10-15T22:39:45.302925] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-15T22:39:45.318396] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-15T22:39:45.318463] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-15T22:39:45.322541] [INFO ] [MAIN ] Derivative Progress: 1080/1803 symbols completed. LNC took 1.1s. Estimated remaining: 4m 33s. Rate: 158.8 symbols/min [2025-10-15T22:39:45.323196] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:45.323125] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:45.323028] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:45.330915] [DEBUG] [LOCAL ] LND: Loaded 4972 existing records from primary storage. [2025-10-15T22:39:45.331057] [INFO ] [MAIN ] LND: Loaded 4972 primary data records. [2025-10-15T22:39:45.421564] [DEBUG] [LOCAL ] LNN: Loaded 11430 existing records from primary storage. [2025-10-15T22:39:45.432213] [INFO ] [MAIN ] LNN: Loaded 11430 primary data records. [2025-10-15T22:39:45.778555] [DEBUG] [LOCAL ] LNG: Loaded 51216 existing records from primary storage. [2025-10-15T22:39:45.795982] [INFO ] [MAIN ] LNG: Loaded 51216 primary data records. [2025-10-15T22:39:46.364433] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:46.365948] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4972 primary records. [2025-10-15T22:39:46.366136] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-15T22:39:46.382791] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-15T22:39:46.382911] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-15T22:39:46.384980] [INFO ] [MAIN ] Derivative Progress: 1081/1803 symbols completed. LND took 1.1s. Estimated remaining: 4m 33s. Rate: 158.5 symbols/min [2025-10-15T22:39:46.385206] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:46.402259] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:46.403194] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11430 primary records. [2025-10-15T22:39:46.403354] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-15T22:39:46.435952] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-15T22:39:46.436311] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-15T22:39:46.438685] [INFO ] [MAIN ] Derivative Progress: 1082/1803 symbols completed. LNN took 1.1s. Estimated remaining: 4m 33s. Rate: 158.6 symbols/min [2025-10-15T22:39:46.436234] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:46.438909] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:46.449338] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51216 primary records. [2025-10-15T22:39:46.449880] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-15T22:39:46.465771] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-15T22:39:46.466504] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-15T22:39:46.469042] [INFO ] [MAIN ] Derivative Progress: 1083/1803 symbols completed. LNG took 1.1s. Estimated remaining: 4m 32s. Rate: 158.8 symbols/min [2025-10-15T22:39:46.469203] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:46.483401] [DEBUG] [LOCAL ] LOAR: Loaded 42140 existing records from primary storage. [2025-10-15T22:39:46.483560] [INFO ] [MAIN ] LOAR: Loaded 42140 primary data records. [2025-10-15T22:39:46.530673] [DEBUG] [LOCAL ] LOCL: Loaded 3781 existing records from primary storage. [2025-10-15T22:39:46.562305] [INFO ] [MAIN ] LOCL: Loaded 3781 primary data records. [2025-10-15T22:39:46.666149] [DEBUG] [LOCAL ] LOB: Loaded 26728 existing records from primary storage. [2025-10-15T22:39:46.698684] [INFO ] [MAIN ] LOB: Loaded 26728 primary data records. [2025-10-15T22:39:47.443983] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:47.457534] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3781 primary records. [2025-10-15T22:39:47.457897] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-15T22:39:47.458373] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:47.460003] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42140 primary records. [2025-10-15T22:39:47.465922] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-15T22:39:47.476891] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-15T22:39:47.484325] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-15T22:39:47.492405] [INFO ] [MAIN ] Derivative Progress: 1084/1803 symbols completed. LOCL took 1.0s. Estimated remaining: 4m 32s. Rate: 158.5 symbols/min [2025-10-15T22:39:47.496973] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:47.496500] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-15T22:39:47.510393] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-15T22:39:47.512907] [INFO ] [MAIN ] Derivative Progress: 1085/1803 symbols completed. LOAR took 1.1s. Estimated remaining: 4m 32s. Rate: 158.6 symbols/min [2025-10-15T22:39:47.513331] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:47.513104] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:47.514423] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 26728 primary records. [2025-10-15T22:39:47.514981] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-15T22:39:47.531505] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-15T22:39:47.531709] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-15T22:39:47.534160] [INFO ] [MAIN ] Derivative Progress: 1086/1803 symbols completed. LOB took 1.1s. Estimated remaining: 4m 31s. Rate: 158.8 symbols/min [2025-10-15T22:39:47.534418] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:47.583075] [DEBUG] [LOCAL ] LOMA: Loaded 32694 existing records from primary storage. [2025-10-15T22:39:47.594442] [INFO ] [MAIN ] LOMA: Loaded 32694 primary data records. [2025-10-15T22:39:47.715272] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-15T22:39:47.731264] [INFO ] [MAIN ] LOW: Loaded 52993 primary data records. [2025-10-15T22:39:47.750519] [DEBUG] [LOCAL ] LPG: Loaded 39643 existing records from primary storage. [2025-10-15T22:39:47.782060] [INFO ] [MAIN ] LPG: Loaded 39643 primary data records. [2025-10-15T22:39:48.650043] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:48.664119] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32694 primary records. [2025-10-15T22:39:48.664546] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:48.665456] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52993 primary records. [2025-10-15T22:39:48.666298] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-15T22:39:48.666660] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-15T22:39:48.696704] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-15T22:39:48.700026] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-15T22:39:48.702126] [INFO ] [MAIN ] Derivative Progress: 1087/1803 symbols completed. LOMA took 1.2s. Estimated remaining: 4m 31s. Rate: 158.5 symbols/min [2025-10-15T22:39:48.702286] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:48.717555] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-15T22:39:48.718317] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:48.719269] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39643 primary records. [2025-10-15T22:39:48.719338] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-15T22:39:48.722077] [INFO ] [MAIN ] Derivative Progress: 1088/1803 symbols completed. LOW took 1.2s. Estimated remaining: 4m 30s. Rate: 158.6 symbols/min [2025-10-15T22:39:48.722457] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-15T22:39:48.722329] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:48.739479] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-15T22:39:48.739666] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-15T22:39:48.742224] [INFO ] [MAIN ] Derivative Progress: 1089/1803 symbols completed. LPG took 1.2s. Estimated remaining: 4m 30s. Rate: 158.8 symbols/min [2025-10-15T22:39:48.742446] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:48.764217] [DEBUG] [LOCAL ] LPL: Loaded 28287 existing records from primary storage. [2025-10-15T22:39:48.764489] [INFO ] [MAIN ] LPL: Loaded 28287 primary data records. [2025-10-15T22:39:49.096434] [DEBUG] [LOCAL ] LRN: Loaded 39565 existing records from primary storage. [2025-10-15T22:39:49.107038] [INFO ] [MAIN ] LRN: Loaded 39565 primary data records. [2025-10-15T22:39:49.098314] [DEBUG] [LOCAL ] LPX: Loaded 40329 existing records from primary storage. [2025-10-15T22:39:49.120248] [INFO ] [MAIN ] LPX: Loaded 40329 primary data records. [2025-10-15T22:39:49.754634] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:49.756308] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 28287 primary records. [2025-10-15T22:39:49.756742] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-15T22:39:49.775280] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-15T22:39:49.775691] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-15T22:39:49.778753] [INFO ] [MAIN ] Derivative Progress: 1090/1803 symbols completed. LPL took 1.1s. Estimated remaining: 4m 30s. Rate: 158.5 symbols/min [2025-10-15T22:39:49.778992] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:49.802083] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:49.805063] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39565 primary records. [2025-10-15T22:39:49.807455] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-15T22:39:49.847947] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:49.849745] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-15T22:39:49.850012] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-15T22:39:49.853283] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 40329 primary records. [2025-10-15T22:39:49.853959] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-15T22:39:49.852394] [INFO ] [MAIN ] Derivative Progress: 1091/1803 symbols completed. LRN took 1.1s. Estimated remaining: 4m 29s. Rate: 158.6 symbols/min [2025-10-15T22:39:49.854925] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:49.879457] [DEBUG] [LOCAL ] LSPD: Loaded 42581 existing records from primary storage. [2025-10-15T22:39:49.882312] [INFO ] [MAIN ] LSPD: Loaded 42581 primary data records. [2025-10-15T22:39:49.907825] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-15T22:39:49.946255] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-15T22:39:49.966231] [INFO ] [MAIN ] Derivative Progress: 1092/1803 symbols completed. LPX took 1.2s. Estimated remaining: 4m 29s. Rate: 158.7 symbols/min [2025-10-15T22:39:49.977591] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:50.090326] [DEBUG] [LOCAL ] LTC: Loaded 30625 existing records from primary storage. [2025-10-15T22:39:50.207220] [INFO ] [MAIN ] LTC: Loaded 30625 primary data records. [2025-10-15T22:39:50.577939] [DEBUG] [LOCAL ] LTH: Loaded 51743 existing records from primary storage. [2025-10-15T22:39:50.578683] [INFO ] [MAIN ] LTH: Loaded 51743 primary data records. [2025-10-15T22:39:50.711761] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:50.728473] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42581 primary records. [2025-10-15T22:39:50.769244] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-15T22:39:50.925175] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-15T22:39:50.926698] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-15T22:39:50.928748] [INFO ] [MAIN ] Derivative Progress: 1093/1803 symbols completed. LSPD took 1.1s. Estimated remaining: 4m 29s. Rate: 158.5 symbols/min [2025-10-15T22:39:50.948794] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:50.950152] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30625 primary records. [2025-10-15T22:39:50.950219] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-15T22:39:50.966182] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-15T22:39:50.966339] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-15T22:39:50.968815] [INFO ] [MAIN ] Derivative Progress: 1094/1803 symbols completed. LTC took 1.1s. Estimated remaining: 4m 28s. Rate: 158.6 symbols/min [2025-10-15T22:39:50.985341] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:50.986149] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51743 primary records. [2025-10-15T22:39:50.986214] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-15T22:39:51.002302] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-15T22:39:51.002406] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-15T22:39:51.005129] [INFO ] [MAIN ] Derivative Progress: 1095/1803 symbols completed. LTH took 1.0s. Estimated remaining: 4m 28s. Rate: 158.8 symbols/min [2025-10-15T22:39:51.005564] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:51.005683] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:51.006181] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:51.048845] [DEBUG] [LOCAL ] LUCK: Loaded 24196 existing records from primary storage. [2025-10-15T22:39:51.048996] [INFO ] [MAIN ] LUCK: Loaded 24196 primary data records. [2025-10-15T22:39:51.180803] [DEBUG] [LOCAL ] LTM: Loaded 38692 existing records from primary storage. [2025-10-15T22:39:51.181490] [DEBUG] [LOCAL ] LU: Loaded 49048 existing records from primary storage. [2025-10-15T22:39:51.181997] [INFO ] [MAIN ] LTM: Loaded 38692 primary data records. [2025-10-15T22:39:51.202829] [INFO ] [MAIN ] LU: Loaded 49048 primary data records. [2025-10-15T22:39:52.008360] [DEBUG] [MAIN ] LUCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:52.009850] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24196 primary records. [2025-10-15T22:39:52.010027] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-15T22:39:52.028719] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-15T22:39:52.028921] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-15T22:39:52.031178] [INFO ] [MAIN ] Derivative Progress: 1096/1803 symbols completed. LUCK took 1.0s. Estimated remaining: 4m 28s. Rate: 158.5 symbols/min [2025-10-15T22:39:52.031329] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:52.051914] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:52.052984] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 38692 primary records. [2025-10-15T22:39:52.053065] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-15T22:39:52.074300] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:52.079176] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 49048 primary records. [2025-10-15T22:39:52.079604] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-15T22:39:52.084518] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-15T22:39:52.093481] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-15T22:39:52.112951] [INFO ] [MAIN ] Derivative Progress: 1097/1803 symbols completed. LTM took 1.1s. Estimated remaining: 4m 27s. Rate: 158.6 symbols/min [2025-10-15T22:39:52.116786] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:52.117769] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-15T22:39:52.118415] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-15T22:39:52.121099] [INFO ] [MAIN ] Derivative Progress: 1098/1803 symbols completed. LU took 1.1s. Estimated remaining: 4m 26s. Rate: 158.8 symbols/min [2025-10-15T22:39:52.122016] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:52.139688] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-15T22:39:52.139944] [INFO ] [MAIN ] LUMN: Loaded 53646 primary data records. [2025-10-15T22:39:52.528067] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-15T22:39:52.528800] [INFO ] [MAIN ] LVS: Loaded 53570 primary data records. [2025-10-15T22:39:52.541004] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-15T22:39:52.560966] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-15T22:39:53.141273] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:53.142884] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53646 primary records. [2025-10-15T22:39:53.143208] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-15T22:39:53.161734] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-15T22:39:53.162200] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-15T22:39:53.164473] [INFO ] [MAIN ] Derivative Progress: 1099/1803 symbols completed. LUMN took 1.1s. Estimated remaining: 4m 26s. Rate: 158.5 symbols/min [2025-10-15T22:39:53.164783] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:53.197310] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:53.211386] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53570 primary records. [2025-10-15T22:39:53.210285] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:53.218046] [DEBUG] [LOCAL ] LVWR: Loaded 18485 existing records from primary storage. [2025-10-15T22:39:53.218171] [INFO ] [MAIN ] LVWR: Loaded 18485 primary data records. [2025-10-15T22:39:53.217720] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-15T22:39:53.219079] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-15T22:39:53.240487] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-15T22:39:53.349074] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-15T22:39:53.352953] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-15T22:39:53.356266] [INFO ] [MAIN ] Derivative Progress: 1100/1803 symbols completed. LVS took 1.2s. Estimated remaining: 4m 26s. Rate: 158.6 symbols/min [2025-10-15T22:39:53.356767] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:53.401729] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-15T22:39:53.418472] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-15T22:39:53.438858] [INFO ] [MAIN ] Derivative Progress: 1101/1803 symbols completed. LUV took 1.3s. Estimated remaining: 4m 25s. Rate: 158.7 symbols/min [2025-10-15T22:39:53.439169] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:53.590831] [DEBUG] [LOCAL ] LXFR: Loaded 16648 existing records from primary storage. [2025-10-15T22:39:53.591797] [INFO ] [MAIN ] LXFR: Loaded 16648 primary data records. [2025-10-15T22:39:53.685567] [DEBUG] [LOCAL ] LW: Loaded 51215 existing records from primary storage. [2025-10-15T22:39:53.709627] [INFO ] [MAIN ] LW: Loaded 51215 primary data records. [2025-10-15T22:39:54.385670] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:54.405610] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18485 primary records. [2025-10-15T22:39:54.405875] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-15T22:39:54.424255] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-15T22:39:54.424514] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-15T22:39:54.427372] [INFO ] [MAIN ] Derivative Progress: 1102/1803 symbols completed. LVWR took 1.3s. Estimated remaining: 4m 25s. Rate: 158.5 symbols/min [2025-10-15T22:39:54.428039] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:54.455491] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:54.456903] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16648 primary records. [2025-10-15T22:39:54.457203] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-15T22:39:54.505704] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:54.505961] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-15T22:39:54.506776] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51215 primary records. [2025-10-15T22:39:54.506982] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-15T22:39:54.507101] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-15T22:39:54.510879] [INFO ] [MAIN ] Derivative Progress: 1103/1803 symbols completed. LXFR took 1.1s. Estimated remaining: 4m 25s. Rate: 158.6 symbols/min [2025-10-15T22:39:54.512138] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:54.547563] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-15T22:39:54.547941] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-15T22:39:54.549053] [DEBUG] [LOCAL ] LXP: Loaded 50765 existing records from primary storage. [2025-10-15T22:39:54.553067] [INFO ] [MAIN ] Derivative Progress: 1104/1803 symbols completed. LW took 1.2s. Estimated remaining: 4m 24s. Rate: 158.7 symbols/min [2025-10-15T22:39:54.553331] [INFO ] [MAIN ] LXP: Loaded 50765 primary data records. [2025-10-15T22:39:54.553526] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:54.880273] [DEBUG] [LOCAL ] LXU: Loaded 31770 existing records from primary storage. [2025-10-15T22:39:54.880692] [INFO ] [MAIN ] LXU: Loaded 31770 primary data records. [2025-10-15T22:39:55.037761] [DEBUG] [LOCAL ] LYB: Loaded 53618 existing records from primary storage. [2025-10-15T22:39:55.048501] [INFO ] [MAIN ] LYB: Loaded 53618 primary data records. [2025-10-15T22:39:55.566794] [DEBUG] [MAIN ] LXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:55.568108] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50765 primary records. [2025-10-15T22:39:55.568438] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-15T22:39:55.589410] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-15T22:39:55.589591] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-15T22:39:55.591965] [INFO ] [MAIN ] Derivative Progress: 1105/1803 symbols completed. LXP took 1.2s. Estimated remaining: 4m 24s. Rate: 158.4 symbols/min [2025-10-15T22:39:55.592251] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:55.612332] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:55.613192] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31770 primary records. [2025-10-15T22:39:55.613270] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-15T22:39:55.630784] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-15T22:39:55.631081] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-15T22:39:55.633116] [INFO ] [MAIN ] Derivative Progress: 1106/1803 symbols completed. LXU took 1.1s. Estimated remaining: 4m 24s. Rate: 158.6 symbols/min [2025-10-15T22:39:55.633307] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:55.646439] [DEBUG] [MAIN ] LYB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:55.647446] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53618 primary records. [2025-10-15T22:39:55.647555] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-15T22:39:55.677189] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-15T22:39:55.677307] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-15T22:39:55.679810] [INFO ] [MAIN ] Derivative Progress: 1107/1803 symbols completed. LYB took 1.1s. Estimated remaining: 4m 23s. Rate: 158.7 symbols/min [2025-10-15T22:39:55.680814] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:55.696588] [DEBUG] [LOCAL ] LYG: Loaded 52693 existing records from primary storage. [2025-10-15T22:39:55.697418] [INFO ] [MAIN ] LYG: Loaded 52693 primary data records. [2025-10-15T22:39:56.039630] [DEBUG] [LOCAL ] LZB: Loaded 35168 existing records from primary storage. [2025-10-15T22:39:56.039859] [INFO ] [MAIN ] LZB: Loaded 35168 primary data records. [2025-10-15T22:39:56.041100] [DEBUG] [LOCAL ] LYV: Loaded 51136 existing records from primary storage. [2025-10-15T22:39:56.061975] [INFO ] [MAIN ] LYV: Loaded 51136 primary data records. [2025-10-15T22:39:56.705923] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:56.707278] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52693 primary records. [2025-10-15T22:39:56.707524] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-15T22:39:56.724256] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-15T22:39:56.724531] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-15T22:39:56.726767] [INFO ] [MAIN ] Derivative Progress: 1108/1803 symbols completed. LYG took 1.1s. Estimated remaining: 4m 23s. Rate: 158.4 symbols/min [2025-10-15T22:39:56.746151] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:56.747078] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35168 primary records. [2025-10-15T22:39:56.747179] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-15T22:39:56.760529] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:56.761451] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51136 primary records. [2025-10-15T22:39:56.768673] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-15T22:39:56.777260] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-15T22:39:56.785750] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-15T22:39:56.787791] [INFO ] [MAIN ] Derivative Progress: 1109/1803 symbols completed. LZB took 1.1s. Estimated remaining: 4m 23s. Rate: 158.6 symbols/min [2025-10-15T22:39:56.794610] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-15T22:39:56.794715] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-15T22:39:56.797192] [INFO ] [MAIN ] Derivative Progress: 1110/1803 symbols completed. LYV took 1.2s. Estimated remaining: 4m 22s. Rate: 158.7 symbols/min [2025-10-15T22:39:56.797696] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:56.797838] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:56.797611] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:56.815945] [DEBUG] [LOCAL ] LZM: Loaded 14485 existing records from primary storage. [2025-10-15T22:39:56.816531] [INFO ] [MAIN ] LZM: Loaded 14485 primary data records. [2025-10-15T22:39:57.167172] [DEBUG] [LOCAL ] M: Loaded 53545 existing records from primary storage. [2025-10-15T22:39:57.176111] [DEBUG] [LOCAL ] MA: Loaded 52480 existing records from primary storage. [2025-10-15T22:39:57.176286] [INFO ] [MAIN ] M: Loaded 53545 primary data records. [2025-10-15T22:39:57.176377] [INFO ] [MAIN ] MA: Loaded 52480 primary data records. [2025-10-15T22:39:57.796884] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:57.797840] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14485 primary records. [2025-10-15T22:39:57.800398] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-15T22:39:57.817597] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-15T22:39:57.817732] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-15T22:39:57.820141] [INFO ] [MAIN ] Derivative Progress: 1111/1803 symbols completed. LZM took 1.0s. Estimated remaining: 4m 22s. Rate: 158.5 symbols/min [2025-10-15T22:39:57.820598] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:57.854773] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:57.855251] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:57.857026] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52480 primary records. [2025-10-15T22:39:57.856183] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53545 primary records. [2025-10-15T22:39:57.857528] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-15T22:39:57.858028] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-15T22:39:57.883019] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-15T22:39:57.883224] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-15T22:39:57.892577] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-15T22:39:57.892798] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-15T22:39:57.892497] [INFO ] [MAIN ] Derivative Progress: 1112/1803 symbols completed. MA took 1.1s. Estimated remaining: 4m 21s. Rate: 158.6 symbols/min [2025-10-15T22:39:57.892958] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:57.895675] [INFO ] [MAIN ] Derivative Progress: 1113/1803 symbols completed. M took 1.1s. Estimated remaining: 4m 21s. Rate: 158.7 symbols/min [2025-10-15T22:39:57.896191] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:57.929831] [DEBUG] [LOCAL ] MAA: Loaded 42905 existing records from primary storage. [2025-10-15T22:39:57.930101] [INFO ] [MAIN ] MAA: Loaded 42905 primary data records. [2025-10-15T22:39:58.086296] [DEBUG] [LOCAL ] MAGN: Loaded 36089 existing records from primary storage. [2025-10-15T22:39:58.091853] [INFO ] [MAIN ] MAGN: Loaded 36089 primary data records. [2025-10-15T22:39:58.108476] [DEBUG] [LOCAL ] MAC: Loaded 49774 existing records from primary storage. [2025-10-15T22:39:58.160520] [INFO ] [MAIN ] MAC: Loaded 49774 primary data records. [2025-10-15T22:39:58.983112] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:58.985079] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42905 primary records. [2025-10-15T22:39:58.985522] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-15T22:39:59.004675] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-15T22:39:59.005269] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-15T22:39:59.008155] [INFO ] [MAIN ] Derivative Progress: 1114/1803 symbols completed. MAA took 1.2s. Estimated remaining: 4m 21s. Rate: 158.4 symbols/min [2025-10-15T22:39:59.008577] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:59.029494] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:59.030870] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49774 primary records. [2025-10-15T22:39:59.031100] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-15T22:39:59.057031] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:39:59.061765] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-15T22:39:59.062573] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 36089 primary records. [2025-10-15T22:39:59.062870] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-15T22:39:59.062942] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-15T22:39:59.065536] [INFO ] [MAIN ] Derivative Progress: 1115/1803 symbols completed. MAC took 1.2s. Estimated remaining: 4m 20s. Rate: 158.6 symbols/min [2025-10-15T22:39:59.065808] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:59.093542] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-15T22:39:59.093756] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-15T22:39:59.096560] [INFO ] [MAIN ] Derivative Progress: 1116/1803 symbols completed. MAGN took 1.2s. Estimated remaining: 4m 20s. Rate: 158.7 symbols/min [2025-10-15T22:39:59.096941] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:39:59.111114] [DEBUG] [LOCAL ] MAIN: Loaded 41822 existing records from primary storage. [2025-10-15T22:39:59.111322] [INFO ] [MAIN ] MAIN: Loaded 41822 primary data records. [2025-10-15T22:39:59.305687] [DEBUG] [LOCAL ] MANU: Loaded 27055 existing records from primary storage. [2025-10-15T22:39:59.431444] [INFO ] [MAIN ] MANU: Loaded 27055 primary data records. [2025-10-15T22:39:59.327255] [DEBUG] [LOCAL ] MAN: Loaded 44037 existing records from primary storage. [2025-10-15T22:39:59.440024] [INFO ] [MAIN ] MAN: Loaded 44037 primary data records. [2025-10-15T22:40:00.130512] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:00.133352] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41822 primary records. [2025-10-15T22:40:00.134243] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-15T22:40:00.152483] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-15T22:40:00.153125] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-15T22:40:00.155683] [INFO ] [MAIN ] Derivative Progress: 1117/1803 symbols completed. MAIN took 1.1s. Estimated remaining: 4m 20s. Rate: 158.4 symbols/min [2025-10-15T22:40:00.156504] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:00.185024] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:00.191036] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 44037 primary records. [2025-10-15T22:40:00.191499] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:00.191679] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-15T22:40:00.192414] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27055 primary records. [2025-10-15T22:40:00.193363] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-15T22:40:00.226916] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-15T22:40:00.240077] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-15T22:40:00.243777] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-15T22:40:00.243877] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-15T22:40:00.243122] [INFO ] [MAIN ] Derivative Progress: 1118/1803 symbols completed. MAN took 1.2s. Estimated remaining: 4m 19s. Rate: 158.6 symbols/min [2025-10-15T22:40:00.244020] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:00.246870] [INFO ] [MAIN ] Derivative Progress: 1119/1803 symbols completed. MANU took 1.1s. Estimated remaining: 4m 19s. Rate: 158.7 symbols/min [2025-10-15T22:40:00.247289] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:00.266624] [DEBUG] [LOCAL ] MAS: Loaded 52288 existing records from primary storage. [2025-10-15T22:40:00.266913] [INFO ] [MAIN ] MAS: Loaded 52288 primary data records. [2025-10-15T22:40:00.426977] [DEBUG] [LOCAL ] MATV: Loaded 35661 existing records from primary storage. [2025-10-15T22:40:00.427247] [INFO ] [MAIN ] MATV: Loaded 35661 primary data records. [2025-10-15T22:40:00.512841] [DEBUG] [LOCAL ] MATX: Loaded 31970 existing records from primary storage. [2025-10-15T22:40:00.611212] [INFO ] [MAIN ] MATX: Loaded 31970 primary data records. [2025-10-15T22:40:01.310180] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:01.313331] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52288 primary records. [2025-10-15T22:40:01.313702] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-15T22:40:01.336549] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-15T22:40:01.337105] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-15T22:40:01.340112] [INFO ] [MAIN ] Derivative Progress: 1120/1803 symbols completed. MAS took 1.2s. Estimated remaining: 4m 19s. Rate: 158.4 symbols/min [2025-10-15T22:40:01.341311] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:01.363420] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:01.365351] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 35661 primary records. [2025-10-15T22:40:01.365532] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-15T22:40:01.395528] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-15T22:40:01.398771] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-15T22:40:01.401239] [INFO ] [MAIN ] Derivative Progress: 1121/1803 symbols completed. MATV took 1.2s. Estimated remaining: 4m 18s. Rate: 158.5 symbols/min [2025-10-15T22:40:01.401603] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:01.437967] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:01.439398] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31970 primary records. [2025-10-15T22:40:01.440943] [DEBUG] [LOCAL ] MAX: Loaded 31010 existing records from primary storage. [2025-10-15T22:40:01.439697] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-15T22:40:01.441225] [INFO ] [MAIN ] MAX: Loaded 31010 primary data records. [2025-10-15T22:40:01.600723] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-15T22:40:01.613085] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-15T22:40:01.617965] [INFO ] [MAIN ] Derivative Progress: 1122/1803 symbols completed. MATX took 1.4s. Estimated remaining: 4m 18s. Rate: 158.6 symbols/min [2025-10-15T22:40:01.635270] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:01.896699] [DEBUG] [LOCAL ] MBC: Loaded 43915 existing records from primary storage. [2025-10-15T22:40:01.903975] [INFO ] [MAIN ] MBC: Loaded 43915 primary data records. [2025-10-15T22:40:02.020393] [DEBUG] [LOCAL ] MBI: Loaded 24330 existing records from primary storage. [2025-10-15T22:40:02.031683] [INFO ] [MAIN ] MBI: Loaded 24330 primary data records. [2025-10-15T22:40:02.496257] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:02.670329] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 31010 primary records. [2025-10-15T22:40:02.681871] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-15T22:40:02.704210] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-15T22:40:02.705225] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-15T22:40:02.707919] [INFO ] [MAIN ] Derivative Progress: 1123/1803 symbols completed. MAX took 1.4s. Estimated remaining: 4m 18s. Rate: 158.3 symbols/min [2025-10-15T22:40:02.733051] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:02.734004] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43915 primary records. [2025-10-15T22:40:02.734088] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-15T22:40:02.766181] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-15T22:40:02.764135] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:02.766306] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-15T22:40:02.769019] [INFO ] [MAIN ] Derivative Progress: 1124/1803 symbols completed. MBC took 1.4s. Estimated remaining: 4m 17s. Rate: 158.5 symbols/min [2025-10-15T22:40:02.769868] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24330 primary records. [2025-10-15T22:40:02.769932] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-15T22:40:02.784255] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-15T22:40:02.784315] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-15T22:40:02.787236] [INFO ] [MAIN ] Derivative Progress: 1125/1803 symbols completed. MBI took 1.2s. Estimated remaining: 4m 17s. Rate: 158.6 symbols/min [2025-10-15T22:40:02.787872] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:02.788003] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:02.787808] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:02.797774] [DEBUG] [LOCAL ] MCI: Loaded 6403 existing records from primary storage. [2025-10-15T22:40:02.800526] [INFO ] [MAIN ] MCI: Loaded 6403 primary data records. [2025-10-15T22:40:02.861299] [DEBUG] [LOCAL ] MCB: Loaded 11339 existing records from primary storage. [2025-10-15T22:40:02.887002] [INFO ] [MAIN ] MCB: Loaded 11339 primary data records. [2025-10-15T22:40:03.137527] [DEBUG] [LOCAL ] MC: Loaded 43982 existing records from primary storage. [2025-10-15T22:40:03.258093] [INFO ] [MAIN ] MC: Loaded 43982 primary data records. [2025-10-15T22:40:03.786380] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:03.788211] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6403 primary records. [2025-10-15T22:40:03.788496] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-15T22:40:03.802158] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:03.802951] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11339 primary records. [2025-10-15T22:40:03.803246] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-15T22:40:03.829842] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-15T22:40:03.830435] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-15T22:40:03.834265] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-15T22:40:03.836457] [INFO ] [MAIN ] Derivative Progress: 1126/1803 symbols completed. MCI took 1.0s. Estimated remaining: 4m 17s. Rate: 158.3 symbols/min [2025-10-15T22:40:03.837522] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:03.837795] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-15T22:40:03.841848] [INFO ] [MAIN ] Derivative Progress: 1127/1803 symbols completed. MCB took 1.1s. Estimated remaining: 4m 16s. Rate: 158.5 symbols/min [2025-10-15T22:40:03.842098] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:03.857372] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:03.858150] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 43982 primary records. [2025-10-15T22:40:03.860354] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-15T22:40:03.880398] [DEBUG] [LOCAL ] MCN: Loaded 8174 existing records from primary storage. [2025-10-15T22:40:03.880025] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-15T22:40:03.880512] [INFO ] [MAIN ] MCN: Loaded 8174 primary data records. [2025-10-15T22:40:03.891766] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-15T22:40:03.915719] [INFO ] [MAIN ] Derivative Progress: 1128/1803 symbols completed. MC took 1.1s. Estimated remaining: 4m 15s. Rate: 158.6 symbols/min [2025-10-15T22:40:03.943440] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:04.209787] [DEBUG] [LOCAL ] MCK: Loaded 38560 existing records from primary storage. [2025-10-15T22:40:04.210005] [INFO ] [MAIN ] MCK: Loaded 38560 primary data records. [2025-10-15T22:40:04.518309] [DEBUG] [LOCAL ] MCO: Loaded 39462 existing records from primary storage. [2025-10-15T22:40:04.526689] [INFO ] [MAIN ] MCO: Loaded 39462 primary data records. [2025-10-15T22:40:04.728832] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:04.895056] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8174 primary records. [2025-10-15T22:40:04.895614] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-15T22:40:04.917576] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-15T22:40:04.930411] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-15T22:40:04.931378] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:04.934291] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38560 primary records. [2025-10-15T22:40:04.933545] [INFO ] [MAIN ] Derivative Progress: 1129/1803 symbols completed. MCN took 1.1s. Estimated remaining: 4m 15s. Rate: 158.4 symbols/min [2025-10-15T22:40:04.934765] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:04.934473] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-15T22:40:04.956202] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-15T22:40:04.960344] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-15T22:40:04.963309] [INFO ] [MAIN ] Derivative Progress: 1130/1803 symbols completed. MCK took 1.1s. Estimated remaining: 4m 15s. Rate: 158.5 symbols/min [2025-10-15T22:40:04.963751] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:04.960600] [DEBUG] [LOCAL ] MCR: Loaded 8895 existing records from primary storage. [2025-10-15T22:40:04.964137] [INFO ] [MAIN ] MCR: Loaded 8895 primary data records. [2025-10-15T22:40:05.132165] [DEBUG] [LOCAL ] MCS: Loaded 21099 existing records from primary storage. [2025-10-15T22:40:05.170694] [INFO ] [MAIN ] MCS: Loaded 21099 primary data records. [2025-10-15T22:40:05.171476] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:05.311561] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39462 primary records. [2025-10-15T22:40:05.358989] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-15T22:40:05.431920] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-15T22:40:05.473156] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-15T22:40:05.479068] [INFO ] [MAIN ] Derivative Progress: 1131/1803 symbols completed. MCO took 1.5s. Estimated remaining: 4m 14s. Rate: 158.4 symbols/min [2025-10-15T22:40:05.479356] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:05.668778] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:05.684451] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8895 primary records. [2025-10-15T22:40:05.685137] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-15T22:40:05.685887] [DEBUG] [LOCAL ] MCY: Loaded 23955 existing records from primary storage. [2025-10-15T22:40:05.688192] [INFO ] [MAIN ] MCY: Loaded 23955 primary data records. [2025-10-15T22:40:05.828535] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-15T22:40:05.861607] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-15T22:40:05.864073] [INFO ] [MAIN ] Derivative Progress: 1132/1803 symbols completed. MCR took 0.9s. Estimated remaining: 4m 14s. Rate: 158.4 symbols/min [2025-10-15T22:40:05.874082] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:06.042274] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:06.044340] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21099 primary records. [2025-10-15T22:40:06.044522] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-15T22:40:06.071970] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-15T22:40:06.073107] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-15T22:40:06.076852] [INFO ] [MAIN ] Derivative Progress: 1133/1803 symbols completed. MCS took 1.1s. Estimated remaining: 4m 14s. Rate: 158.5 symbols/min [2025-10-15T22:40:06.077805] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:06.112678] [DEBUG] [LOCAL ] MDST: Loaded 5952 existing records from primary storage. [2025-10-15T22:40:06.113533] [DEBUG] [LOCAL ] MD: Loaded 38550 existing records from primary storage. [2025-10-15T22:40:06.113717] [INFO ] [MAIN ] MDST: Loaded 5952 primary data records. [2025-10-15T22:40:06.119543] [INFO ] [MAIN ] MD: Loaded 38550 primary data records. [2025-10-15T22:40:06.801433] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:06.802341] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 23955 primary records. [2025-10-15T22:40:06.803182] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-15T22:40:06.823520] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-15T22:40:06.824049] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-15T22:40:06.826872] [INFO ] [MAIN ] Derivative Progress: 1134/1803 symbols completed. MCY took 1.3s. Estimated remaining: 4m 13s. Rate: 158.4 symbols/min [2025-10-15T22:40:06.827047] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:06.868514] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:06.870271] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:06.872229] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5952 primary records. [2025-10-15T22:40:06.871116] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38550 primary records. [2025-10-15T22:40:06.872403] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-15T22:40:06.873129] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-15T22:40:06.900996] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-10-15T22:40:06.901667] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-15T22:40:06.923134] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-15T22:40:06.922235] [INFO ] [MAIN ] Derivative Progress: 1135/1803 symbols completed. MDST took 0.8s. Estimated remaining: 4m 13s. Rate: 158.5 symbols/min [2025-10-15T22:40:06.923313] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-15T22:40:06.926127] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:06.926348] [INFO ] [MAIN ] Derivative Progress: 1136/1803 symbols completed. MD took 1.1s. Estimated remaining: 4m 12s. Rate: 158.6 symbols/min [2025-10-15T22:40:06.926556] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:06.952018] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-15T22:40:06.956693] [DEBUG] [LOCAL ] MDV: Loaded 8465 existing records from primary storage. [2025-10-15T22:40:06.956970] [INFO ] [MAIN ] MDV: Loaded 8465 primary data records. [2025-10-15T22:40:06.957087] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-15T22:40:07.351507] [DEBUG] [LOCAL ] MDU: Loaded 48061 existing records from primary storage. [2025-10-15T22:40:07.609309] [INFO ] [MAIN ] MDU: Loaded 48061 primary data records. [2025-10-15T22:40:07.929486] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:07.931568] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8465 primary records. [2025-10-15T22:40:07.937475] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-15T22:40:07.951067] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:07.959210] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-15T22:40:07.965085] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-15T22:40:07.982779] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-15T22:40:07.983240] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-15T22:40:07.985677] [INFO ] [MAIN ] Derivative Progress: 1137/1803 symbols completed. MDV took 1.1s. Estimated remaining: 4m 12s. Rate: 158.3 symbols/min [2025-10-15T22:40:07.986747] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-15T22:40:07.987162] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-15T22:40:07.986972] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:07.989852] [INFO ] [MAIN ] Derivative Progress: 1138/1803 symbols completed. MDT took 1.2s. Estimated remaining: 4m 12s. Rate: 158.5 symbols/min [2025-10-15T22:40:08.006194] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:08.006916] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 48061 primary records. [2025-10-15T22:40:08.007035] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-15T22:40:08.026581] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-15T22:40:08.032064] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-15T22:40:08.032352] [DEBUG] [LOCAL ] MEC: Loaded 16364 existing records from primary storage. [2025-10-15T22:40:08.035908] [INFO ] [MAIN ] Derivative Progress: 1139/1803 symbols completed. MDU took 1.1s. Estimated remaining: 4m 11s. Rate: 158.6 symbols/min [2025-10-15T22:40:08.036003] [INFO ] [MAIN ] MEC: Loaded 16364 primary data records. [2025-10-15T22:40:08.332154] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:08.332818] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16364 primary records. [2025-10-15T22:40:08.332883] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-15T22:40:08.348005] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-15T22:40:08.348065] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-15T22:40:08.350188] [INFO ] [MAIN ] Derivative Progress: 1140/1803 symbols completed. MEC took 0.4s. Estimated remaining: 4m 11s. Rate: 158.6 symbols/min [2025-10-15T22:40:08.351059] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:08.350986] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:08.352047] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:08.382441] [DEBUG] [LOCAL ] MEGI: Loaded 19796 existing records from primary storage. [2025-10-15T22:40:08.388755] [INFO ] [MAIN ] MEGI: Loaded 19796 primary data records. [2025-10-15T22:40:08.426342] [DEBUG] [LOCAL ] MED: Loaded 21236 existing records from primary storage. [2025-10-15T22:40:08.426479] [INFO ] [MAIN ] MED: Loaded 21236 primary data records. [2025-10-15T22:40:08.515124] [DEBUG] [LOCAL ] MEG: Loaded 31598 existing records from primary storage. [2025-10-15T22:40:08.556111] [INFO ] [MAIN ] MEG: Loaded 31598 primary data records. [2025-10-15T22:40:09.408989] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:09.412272] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19796 primary records. [2025-10-15T22:40:09.412403] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-15T22:40:09.442890] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:09.442484] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-15T22:40:09.443164] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-15T22:40:09.444103] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21236 primary records. [2025-10-15T22:40:09.446405] [INFO ] [MAIN ] Derivative Progress: 1141/1803 symbols completed. MEGI took 1.1s. Estimated remaining: 4m 11s. Rate: 158.4 symbols/min [2025-10-15T22:40:09.446462] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-15T22:40:09.447268] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:09.467228] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-15T22:40:09.480384] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-15T22:40:09.483362] [INFO ] [MAIN ] Derivative Progress: 1142/1803 symbols completed. MED took 1.1s. Estimated remaining: 4m 10s. Rate: 158.5 symbols/min [2025-10-15T22:40:09.484039] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:09.483877] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:09.484896] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31598 primary records. [2025-10-15T22:40:09.485138] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-15T22:40:09.520166] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-15T22:40:09.520384] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-15T22:40:09.522980] [INFO ] [MAIN ] Derivative Progress: 1143/1803 symbols completed. MEG took 1.2s. Estimated remaining: 4m 10s. Rate: 158.6 symbols/min [2025-10-15T22:40:09.524324] [DEBUG] [LOCAL ] MEI: Loaded 31678 existing records from primary storage. [2025-10-15T22:40:09.523195] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:09.524619] [INFO ] [MAIN ] MEI: Loaded 31678 primary data records. [2025-10-15T22:40:09.870075] [DEBUG] [LOCAL ] MET: Loaded 53316 existing records from primary storage. [2025-10-15T22:40:09.870333] [INFO ] [MAIN ] MET: Loaded 53316 primary data records. [2025-10-15T22:40:09.990918] [DEBUG] [LOCAL ] MFA: Loaded 45762 existing records from primary storage. [2025-10-15T22:40:10.002228] [INFO ] [MAIN ] MFA: Loaded 45762 primary data records. [2025-10-15T22:40:10.500320] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:10.501403] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31678 primary records. [2025-10-15T22:40:10.501597] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-15T22:40:10.518696] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-15T22:40:10.519755] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-15T22:40:10.522302] [INFO ] [MAIN ] Derivative Progress: 1144/1803 symbols completed. MEI took 1.1s. Estimated remaining: 4m 10s. Rate: 158.4 symbols/min [2025-10-15T22:40:10.522852] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:10.544562] [DEBUG] [LOCAL ] MFAN: Loaded 4377 existing records from primary storage. [2025-10-15T22:40:10.545316] [INFO ] [MAIN ] MFAN: Loaded 4377 primary data records. [2025-10-15T22:40:10.545255] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:10.557303] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53316 primary records. [2025-10-15T22:40:10.557514] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-15T22:40:10.665086] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-15T22:40:10.665278] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-15T22:40:10.667324] [INFO ] [MAIN ] Derivative Progress: 1145/1803 symbols completed. MET took 1.2s. Estimated remaining: 4m 9s. Rate: 158.5 symbols/min [2025-10-15T22:40:10.667839] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:10.695905] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:10.760384] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45762 primary records. [2025-10-15T22:40:10.760551] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-15T22:40:10.920339] [DEBUG] [LOCAL ] MFAO: Loaded 3980 existing records from primary storage. [2025-10-15T22:40:10.921354] [INFO ] [MAIN ] MFAO: Loaded 3980 primary data records. [2025-10-15T22:40:11.003368] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-15T22:40:11.014040] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-15T22:40:11.031051] [INFO ] [MAIN ] Derivative Progress: 1146/1803 symbols completed. MFA took 1.5s. Estimated remaining: 4m 9s. Rate: 158.5 symbols/min [2025-10-15T22:40:11.031304] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:11.259742] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:40:11.260746] [INFO ] [MAIN ] MFAN: Generated 1793 derivative records from 4377 primary records. [2025-10-15T22:40:11.260857] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-15T22:40:11.290382] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1793 records). [2025-10-15T22:40:11.290684] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-15T22:40:11.292854] [INFO ] [MAIN ] Derivative Progress: 1147/1803 symbols completed. MFAN took 0.8s. Estimated remaining: 4m 8s. Rate: 158.5 symbols/min [2025-10-15T22:40:11.293333] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:11.330049] [DEBUG] [LOCAL ] MFC: Loaded 51094 existing records from primary storage. [2025-10-15T22:40:11.330471] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:40:11.330679] [INFO ] [MAIN ] MFC: Loaded 51094 primary data records. [2025-10-15T22:40:11.331629] [INFO ] [MAIN ] MFAO: Generated 1793 derivative records from 3980 primary records. [2025-10-15T22:40:11.362736] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-15T22:40:11.468219] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1793 records). [2025-10-15T22:40:11.484459] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-15T22:40:11.502851] [INFO ] [MAIN ] Derivative Progress: 1148/1803 symbols completed. MFAO took 0.8s. Estimated remaining: 4m 8s. Rate: 158.6 symbols/min [2025-10-15T22:40:11.517767] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:11.693760] [DEBUG] [LOCAL ] MFG: Loaded 49508 existing records from primary storage. [2025-10-15T22:40:11.697202] [INFO ] [MAIN ] MFG: Loaded 49508 primary data records. [2025-10-15T22:40:11.769378] [DEBUG] [LOCAL ] MFM: Loaded 14602 existing records from primary storage. [2025-10-15T22:40:11.786806] [INFO ] [MAIN ] MFM: Loaded 14602 primary data records. [2025-10-15T22:40:12.348261] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:12.350248] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51094 primary records. [2025-10-15T22:40:12.350574] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-15T22:40:12.370316] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-15T22:40:12.370600] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-15T22:40:12.373323] [INFO ] [MAIN ] Derivative Progress: 1149/1803 symbols completed. MFC took 1.3s. Estimated remaining: 4m 8s. Rate: 158.4 symbols/min [2025-10-15T22:40:12.373581] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:12.403490] [DEBUG] [LOCAL ] MFSG: Loaded 5774 existing records from primary storage. [2025-10-15T22:40:12.403891] [INFO ] [MAIN ] MFSG: Loaded 5774 primary data records. [2025-10-15T22:40:12.415406] [DEBUG] [MAIN ] MFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:12.468348] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49508 primary records. [2025-10-15T22:40:12.468695] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-15T22:40:12.534393] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-15T22:40:12.545626] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-15T22:40:12.566246] [INFO ] [MAIN ] Derivative Progress: 1150/1803 symbols completed. MFG took 1.3s. Estimated remaining: 4m 7s. Rate: 158.5 symbols/min [2025-10-15T22:40:12.607625] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:12.600354] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:12.609299] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14602 primary records. [2025-10-15T22:40:12.629317] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-15T22:40:12.797429] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-15T22:40:12.801046] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-15T22:40:12.803835] [INFO ] [MAIN ] Derivative Progress: 1151/1803 symbols completed. MFM took 1.3s. Estimated remaining: 4m 7s. Rate: 158.5 symbols/min [2025-10-15T22:40:12.803988] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:12.812222] [DEBUG] [LOCAL ] MFSI: Loaded 12132 existing records from primary storage. [2025-10-15T22:40:12.813182] [INFO ] [MAIN ] MFSI: Loaded 12132 primary data records. [2025-10-15T22:40:12.846707] [DEBUG] [LOCAL ] MFSV: Loaded 2827 existing records from primary storage. [2025-10-15T22:40:12.858757] [INFO ] [MAIN ] MFSV: Loaded 2827 primary data records. [2025-10-15T22:40:13.433414] [DEBUG] [MAIN ] MFSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:13.435503] [INFO ] [MAIN ] MFSG: Generated 1794 derivative records from 5774 primary records. [2025-10-15T22:40:13.435850] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-15T22:40:13.452770] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1794 records). [2025-10-15T22:40:13.454127] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-15T22:40:13.456396] [INFO ] [MAIN ] Derivative Progress: 1152/1803 symbols completed. MFSG took 1.1s. Estimated remaining: 4m 7s. Rate: 158.4 symbols/min [2025-10-15T22:40:13.456559] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:13.489968] [DEBUG] [LOCAL ] MG: Loaded 15861 existing records from primary storage. [2025-10-15T22:40:13.502540] [INFO ] [MAIN ] MG: Loaded 15861 primary data records. [2025-10-15T22:40:13.502917] [DEBUG] [MAIN ] MFSV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-15T22:40:13.503817] [INFO ] [MAIN ] MFSV: Generated 1792 derivative records from 2827 primary records. [2025-10-15T22:40:13.515445] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-15T22:40:13.504243] [DEBUG] [MAIN ] MFSI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:40:13.548792] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 12132 primary records. [2025-10-15T22:40:13.587303] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-15T22:40:13.624299] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1792 records). [2025-10-15T22:40:13.647480] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-15T22:40:13.663083] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-15T22:40:13.653954] [INFO ] [MAIN ] Derivative Progress: 1153/1803 symbols completed. MFSV took 0.8s. Estimated remaining: 4m 6s. Rate: 158.5 symbols/min [2025-10-15T22:40:13.698033] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-15T22:40:13.700729] [INFO ] [MAIN ] Derivative Progress: 1154/1803 symbols completed. MFSI took 1.1s. Estimated remaining: 4m 6s. Rate: 158.6 symbols/min [2025-10-15T22:40:13.852980] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:13.853556] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 15861 primary records. [2025-10-15T22:40:13.853638] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-15T22:40:13.868213] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-15T22:40:13.868308] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-15T22:40:13.870637] [INFO ] [MAIN ] Derivative Progress: 1155/1803 symbols completed. MG took 0.4s. Estimated remaining: 4m 5s. Rate: 158.7 symbols/min [2025-10-15T22:40:13.871155] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:13.871340] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:13.871796] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:13.878748] [DEBUG] [LOCAL ] MGF: Loaded 4154 existing records from primary storage. [2025-10-15T22:40:13.879012] [INFO ] [MAIN ] MGF: Loaded 4154 primary data records. [2025-10-15T22:40:14.216120] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-15T22:40:14.216582] [INFO ] [MAIN ] MGM: Loaded 53607 primary data records. [2025-10-15T22:40:14.315505] [DEBUG] [LOCAL ] MGA: Loaded 50591 existing records from primary storage. [2025-10-15T22:40:14.337981] [INFO ] [MAIN ] MGA: Loaded 50591 primary data records. [2025-10-15T22:40:14.881226] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:14.882719] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4154 primary records. [2025-10-15T22:40:14.883437] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-15T22:40:14.900972] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-10-15T22:40:14.901139] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-15T22:40:14.903543] [INFO ] [MAIN ] Derivative Progress: 1156/1803 symbols completed. MGF took 1.0s. Estimated remaining: 4m 5s. Rate: 158.4 symbols/min [2025-10-15T22:40:14.904083] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:14.925919] [DEBUG] [MAIN ] MGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:14.929977] [DEBUG] [LOCAL ] MGR: Loaded 5619 existing records from primary storage. [2025-10-15T22:40:14.931163] [INFO ] [MAIN ] MGR: Loaded 5619 primary data records. [2025-10-15T22:40:14.931055] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53607 primary records. [2025-10-15T22:40:14.960330] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-15T22:40:15.004327] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:15.034393] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50591 primary records. [2025-10-15T22:40:15.049212] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-15T22:40:15.059799] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-15T22:40:15.065435] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-15T22:40:15.067371] [INFO ] [MAIN ] Derivative Progress: 1157/1803 symbols completed. MGM took 1.2s. Estimated remaining: 4m 5s. Rate: 158.5 symbols/min [2025-10-15T22:40:15.096953] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:15.101487] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-15T22:40:15.101728] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-15T22:40:15.104638] [INFO ] [MAIN ] Derivative Progress: 1158/1803 symbols completed. MGA took 1.2s. Estimated remaining: 4m 4s. Rate: 158.7 symbols/min [2025-10-15T22:40:15.116757] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:15.193294] [DEBUG] [LOCAL ] MGRD: Loaded 2232 existing records from primary storage. [2025-10-15T22:40:15.193526] [DEBUG] [LOCAL ] MGRB: Loaded 4034 existing records from primary storage. [2025-10-15T22:40:15.199706] [INFO ] [MAIN ] MGRD: Loaded 2232 primary data records. [2025-10-15T22:40:15.199965] [INFO ] [MAIN ] MGRB: Loaded 4034 primary data records. [2025-10-15T22:40:15.942456] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:15.943368] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5619 primary records. [2025-10-15T22:40:15.943488] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-15T22:40:15.963294] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-15T22:40:15.963434] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-15T22:40:15.965921] [INFO ] [MAIN ] Derivative Progress: 1159/1803 symbols completed. MGR took 1.1s. Estimated remaining: 4m 4s. Rate: 158.5 symbols/min [2025-10-15T22:40:15.966161] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:15.979567] [DEBUG] [LOCAL ] MGRE: Loaded 6560 existing records from primary storage. [2025-10-15T22:40:15.979839] [INFO ] [MAIN ] MGRE: Loaded 6560 primary data records. [2025-10-15T22:40:16.025453] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:16.036106] [DEBUG] [MAIN ] MGRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:16.060788] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2232 primary records. [2025-10-15T22:40:16.069349] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-15T22:40:16.075283] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4034 primary records. [2025-10-15T22:40:16.094420] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-15T22:40:16.129169] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-15T22:40:16.129338] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-15T22:40:16.131601] [INFO ] [MAIN ] Derivative Progress: 1160/1803 symbols completed. MGRD took 1.0s. Estimated remaining: 4m 3s. Rate: 158.6 symbols/min [2025-10-15T22:40:16.132625] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:16.157977] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-15T22:40:16.187145] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-15T22:40:16.198845] [INFO ] [MAIN ] Derivative Progress: 1161/1803 symbols completed. MGRB took 1.1s. Estimated remaining: 4m 3s. Rate: 158.7 symbols/min [2025-10-15T22:40:16.222433] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:16.366021] [DEBUG] [LOCAL ] MHD: Loaded 12201 existing records from primary storage. [2025-10-15T22:40:16.367183] [INFO ] [MAIN ] MHD: Loaded 12201 primary data records. [2025-10-15T22:40:16.726372] [DEBUG] [LOCAL ] MGY: Loaded 52423 existing records from primary storage. [2025-10-15T22:40:16.729600] [INFO ] [MAIN ] MGY: Loaded 52423 primary data records. [2025-10-15T22:40:16.842140] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:16.846011] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6560 primary records. [2025-10-15T22:40:16.846146] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-15T22:40:16.940163] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-15T22:40:17.060611] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-15T22:40:17.063227] [INFO ] [MAIN ] Derivative Progress: 1162/1803 symbols completed. MGRE took 1.1s. Estimated remaining: 4m 3s. Rate: 158.5 symbols/min [2025-10-15T22:40:17.063925] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:17.089125] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:17.090106] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12201 primary records. [2025-10-15T22:40:17.088787] [DEBUG] [LOCAL ] MHF: Loaded 8872 existing records from primary storage. [2025-10-15T22:40:17.090735] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-15T22:40:17.090506] [INFO ] [MAIN ] MHF: Loaded 8872 primary data records. [2025-10-15T22:40:17.162819] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-15T22:40:17.175298] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-15T22:40:17.177788] [INFO ] [MAIN ] Derivative Progress: 1163/1803 symbols completed. MHD took 1.0s. Estimated remaining: 4m 2s. Rate: 158.6 symbols/min [2025-10-15T22:40:17.185630] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:17.431330] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:17.432560] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52423 primary records. [2025-10-15T22:40:17.432843] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-15T22:40:17.449268] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-15T22:40:17.450034] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-15T22:40:17.452455] [INFO ] [MAIN ] Derivative Progress: 1164/1803 symbols completed. MGY took 1.3s. Estimated remaining: 4m 2s. Rate: 158.6 symbols/min [2025-10-15T22:40:17.465687] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:17.466678] [DEBUG] [LOCAL ] MHK: Loaded 42138 existing records from primary storage. [2025-10-15T22:40:17.466784] [INFO ] [MAIN ] MHK: Loaded 42138 primary data records. [2025-10-15T22:40:17.580560] [DEBUG] [LOCAL ] MHN: Loaded 7476 existing records from primary storage. [2025-10-15T22:40:17.584902] [INFO ] [MAIN ] MHN: Loaded 7476 primary data records. [2025-10-15T22:40:17.666561] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:17.697712] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8872 primary records. [2025-10-15T22:40:17.734698] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-15T22:40:17.981441] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-15T22:40:18.095094] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-15T22:40:18.098193] [INFO ] [MAIN ] Derivative Progress: 1165/1803 symbols completed. MHF took 1.0s. Estimated remaining: 4m 1s. Rate: 158.5 symbols/min [2025-10-15T22:40:18.098808] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:18.137727] [DEBUG] [LOCAL ] MHO: Loaded 23792 existing records from primary storage. [2025-10-15T22:40:18.129679] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:18.138536] [INFO ] [MAIN ] MHO: Loaded 23792 primary data records. [2025-10-15T22:40:18.139974] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42138 primary records. [2025-10-15T22:40:18.150930] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-15T22:40:18.265062] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:18.274909] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-15T22:40:18.275680] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-15T22:40:18.275598] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7476 primary records. [2025-10-15T22:40:18.277790] [INFO ] [MAIN ] Derivative Progress: 1166/1803 symbols completed. MHK took 1.1s. Estimated remaining: 4m 1s. Rate: 158.6 symbols/min [2025-10-15T22:40:18.275819] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-15T22:40:18.283795] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:18.361205] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-15T22:40:18.364737] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-15T22:40:18.450636] [INFO ] [MAIN ] Derivative Progress: 1167/1803 symbols completed. MHN took 1.0s. Estimated remaining: 4m 0s. Rate: 158.7 symbols/min [2025-10-15T22:40:18.470723] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:18.526879] [DEBUG] [LOCAL ] MIN: Loaded 13871 existing records from primary storage. [2025-10-15T22:40:18.527091] [INFO ] [MAIN ] MIN: Loaded 13871 primary data records. [2025-10-15T22:40:18.871956] [DEBUG] [LOCAL ] MIR: Loaded 51281 existing records from primary storage. [2025-10-15T22:40:18.872903] [INFO ] [MAIN ] MIR: Loaded 51281 primary data records. [2025-10-15T22:40:19.016568] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:19.054573] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23792 primary records. [2025-10-15T22:40:19.074328] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-15T22:40:19.206893] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-15T22:40:19.207854] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-15T22:40:19.210883] [INFO ] [MAIN ] Derivative Progress: 1168/1803 symbols completed. MHO took 1.1s. Estimated remaining: 4m 0s. Rate: 158.5 symbols/min [2025-10-15T22:40:19.228619] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:19.229487] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13871 primary records. [2025-10-15T22:40:19.229584] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-15T22:40:19.246003] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-15T22:40:19.246205] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-15T22:40:19.248409] [INFO ] [MAIN ] Derivative Progress: 1169/1803 symbols completed. MIN took 1.0s. Estimated remaining: 3m 60s. Rate: 158.7 symbols/min [2025-10-15T22:40:19.263981] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:19.264480] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51281 primary records. [2025-10-15T22:40:19.264541] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-15T22:40:19.279611] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-15T22:40:19.279696] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-15T22:40:19.282194] [INFO ] [MAIN ] Derivative Progress: 1170/1803 symbols completed. MIR took 0.8s. Estimated remaining: 3m 59s. Rate: 158.8 symbols/min [2025-10-15T22:40:19.282827] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:19.283053] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:19.282988] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:19.288461] [DEBUG] [LOCAL ] MITP: Loaded 2320 existing records from primary storage. [2025-10-15T22:40:19.290029] [INFO ] [MAIN ] MITP: Loaded 2320 primary data records. [2025-10-15T22:40:19.375534] [DEBUG] [LOCAL ] MIY: Loaded 6260 existing records from primary storage. [2025-10-15T22:40:19.386374] [INFO ] [MAIN ] MIY: Loaded 6260 primary data records. [2025-10-15T22:40:19.498137] [DEBUG] [LOCAL ] MITT: Loaded 22621 existing records from primary storage. [2025-10-15T22:40:19.583599] [INFO ] [MAIN ] MITT: Loaded 22621 primary data records. [2025-10-15T22:40:20.279571] [DEBUG] [MAIN ] MITP: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-15T22:40:20.280942] [INFO ] [MAIN ] MITP: Generated 1791 derivative records from 2320 primary records. [2025-10-15T22:40:20.281398] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-15T22:40:20.311419] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:20.312336] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6260 primary records. [2025-10-15T22:40:20.310601] [DEBUG] [LOCAL ] MITP: Derivative data saved (1791 records). [2025-10-15T22:40:20.312512] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-15T22:40:20.313108] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-15T22:40:20.316089] [INFO ] [MAIN ] Derivative Progress: 1171/1803 symbols completed. MITP took 1.0s. Estimated remaining: 3m 59s. Rate: 158.5 symbols/min [2025-10-15T22:40:20.323106] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:20.332971] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-15T22:40:20.333386] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-15T22:40:20.335688] [INFO ] [MAIN ] Derivative Progress: 1172/1803 symbols completed. MIY took 1.1s. Estimated remaining: 3m 59s. Rate: 158.7 symbols/min [2025-10-15T22:40:20.335977] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:20.352374] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:20.353093] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22621 primary records. [2025-10-15T22:40:20.353154] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-15T22:40:20.369821] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-15T22:40:20.370075] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-15T22:40:20.373089] [INFO ] [MAIN ] Derivative Progress: 1173/1803 symbols completed. MITT took 1.1s. Estimated remaining: 3m 58s. Rate: 158.8 symbols/min [2025-10-15T22:40:20.373313] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:20.427941] [DEBUG] [LOCAL ] MKL: Loaded 34067 existing records from primary storage. [2025-10-15T22:40:20.428141] [INFO ] [MAIN ] MKL: Loaded 34067 primary data records. [2025-10-15T22:40:20.569079] [DEBUG] [LOCAL ] MKC: Loaded 52520 existing records from primary storage. [2025-10-15T22:40:20.570089] [DEBUG] [LOCAL ] MLI: Loaded 43495 existing records from primary storage. [2025-10-15T22:40:20.570524] [INFO ] [MAIN ] MKC: Loaded 52520 primary data records. [2025-10-15T22:40:20.570429] [INFO ] [MAIN ] MLI: Loaded 43495 primary data records. [2025-10-15T22:40:21.393235] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:21.394185] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34067 primary records. [2025-10-15T22:40:21.394500] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-15T22:40:21.413354] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-15T22:40:21.415731] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-15T22:40:21.424492] [INFO ] [MAIN ] Derivative Progress: 1174/1803 symbols completed. MKL took 1.1s. Estimated remaining: 3m 58s. Rate: 158.6 symbols/min [2025-10-15T22:40:21.433867] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:21.434200] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:21.442588] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52520 primary records. [2025-10-15T22:40:21.447762] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:21.447466] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-15T22:40:21.448458] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43495 primary records. [2025-10-15T22:40:21.449028] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-15T22:40:21.471893] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-15T22:40:21.472811] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-15T22:40:21.475006] [INFO ] [MAIN ] Derivative Progress: 1175/1803 symbols completed. MKC took 1.2s. Estimated remaining: 3m 57s. Rate: 158.7 symbols/min [2025-10-15T22:40:21.475155] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:21.490674] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-15T22:40:21.490887] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-15T22:40:21.494163] [INFO ] [MAIN ] Derivative Progress: 1176/1803 symbols completed. MLI took 1.1s. Estimated remaining: 3m 57s. Rate: 158.8 symbols/min [2025-10-15T22:40:21.494418] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:21.506054] [DEBUG] [LOCAL ] MLP: Loaded 3075 existing records from primary storage. [2025-10-15T22:40:21.514449] [INFO ] [MAIN ] MLP: Loaded 3075 primary data records. [2025-10-15T22:40:21.545390] [DEBUG] [LOCAL ] MLM: Loaded 29252 existing records from primary storage. [2025-10-15T22:40:21.602067] [DEBUG] [LOCAL ] MLNK: Loaded 26767 existing records from primary storage. [2025-10-15T22:40:21.619904] [INFO ] [MAIN ] MLM: Loaded 29252 primary data records. [2025-10-15T22:40:21.642691] [INFO ] [MAIN ] MLNK: Loaded 26767 primary data records. [2025-10-15T22:40:22.477817] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:22.481694] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3075 primary records. [2025-10-15T22:40:22.482968] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-15T22:40:22.509679] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-10-15T22:40:22.510056] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-15T22:40:22.510316] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:22.529486] [INFO ] [MAIN ] Derivative Progress: 1177/1803 symbols completed. MLP took 1.0s. Estimated remaining: 3m 57s. Rate: 158.6 symbols/min [2025-10-15T22:40:22.530108] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:22.531249] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29252 primary records. [2025-10-15T22:40:22.530476] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:22.529703] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 26767 primary records. [2025-10-15T22:40:22.531762] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-15T22:40:22.532026] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-15T22:40:22.549849] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-15T22:40:22.558352] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-15T22:40:22.561138] [INFO ] [MAIN ] Derivative Progress: 1178/1803 symbols completed. MLM took 1.1s. Estimated remaining: 3m 56s. Rate: 158.7 symbols/min [2025-10-15T22:40:22.571250] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-15T22:40:22.571599] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:22.571475] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-15T22:40:22.574575] [INFO ] [MAIN ] Derivative Progress: 1179/1803 symbols completed. MLNK took 1.1s. Estimated remaining: 3m 56s. Rate: 158.8 symbols/min [2025-10-15T22:40:22.574894] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:22.582776] [DEBUG] [LOCAL ] MLR: Loaded 12461 existing records from primary storage. [2025-10-15T22:40:22.583036] [INFO ] [MAIN ] MLR: Loaded 12461 primary data records. [2025-10-15T22:40:22.677549] [DEBUG] [LOCAL ] MMD: Loaded 10914 existing records from primary storage. [2025-10-15T22:40:22.694473] [INFO ] [MAIN ] MMD: Loaded 10914 primary data records. [2025-10-15T22:40:23.059340] [DEBUG] [LOCAL ] MMC: Loaded 51929 existing records from primary storage. [2025-10-15T22:40:23.098771] [INFO ] [MAIN ] MMC: Loaded 51929 primary data records. [2025-10-15T22:40:23.543890] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:23.544747] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12461 primary records. [2025-10-15T22:40:23.544989] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-15T22:40:23.578900] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-15T22:40:23.579480] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-15T22:40:23.579203] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:23.580488] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 10914 primary records. [2025-10-15T22:40:23.582463] [INFO ] [MAIN ] Derivative Progress: 1180/1803 symbols completed. MLR took 1.1s. Estimated remaining: 3m 56s. Rate: 158.6 symbols/min [2025-10-15T22:40:23.582781] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-15T22:40:23.583235] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:23.609166] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-15T22:40:23.609455] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-15T22:40:23.611997] [INFO ] [MAIN ] Derivative Progress: 1181/1803 symbols completed. MMD took 1.0s. Estimated remaining: 3m 55s. Rate: 158.7 symbols/min [2025-10-15T22:40:23.612252] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:23.625980] [DEBUG] [MAIN ] MMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:23.627137] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51929 primary records. [2025-10-15T22:40:23.632541] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-15T22:40:23.632920] [DEBUG] [LOCAL ] MMI: Loaded 15512 existing records from primary storage. [2025-10-15T22:40:23.634119] [INFO ] [MAIN ] MMI: Loaded 15512 primary data records. [2025-10-15T22:40:23.730533] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-15T22:40:23.750854] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-15T22:40:23.757602] [INFO ] [MAIN ] Derivative Progress: 1182/1803 symbols completed. MMC took 1.2s. Estimated remaining: 3m 55s. Rate: 158.8 symbols/min [2025-10-15T22:40:23.758330] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:24.017822] [DEBUG] [LOCAL ] MMM: Loaded 53114 existing records from primary storage. [2025-10-15T22:40:24.018447] [INFO ] [MAIN ] MMM: Loaded 53114 primary data records. [2025-10-15T22:40:24.138940] [DEBUG] [LOCAL ] MMS: Loaded 33758 existing records from primary storage. [2025-10-15T22:40:24.156369] [INFO ] [MAIN ] MMS: Loaded 33758 primary data records. [2025-10-15T22:40:24.276162] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:24.355506] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15512 primary records. [2025-10-15T22:40:24.395451] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-15T22:40:24.748026] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-15T22:40:24.795301] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-15T22:40:24.797962] [INFO ] [MAIN ] Derivative Progress: 1183/1803 symbols completed. MMI took 1.2s. Estimated remaining: 3m 55s. Rate: 158.6 symbols/min [2025-10-15T22:40:24.991871] [DEBUG] [MAIN ] MMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:24.992770] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53114 primary records. [2025-10-15T22:40:24.992974] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-15T22:40:25.011885] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-15T22:40:25.013034] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-15T22:40:25.017950] [INFO ] [MAIN ] Derivative Progress: 1184/1803 symbols completed. MMM took 1.4s. Estimated remaining: 3m 54s. Rate: 158.6 symbols/min [2025-10-15T22:40:25.039528] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:25.040467] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33758 primary records. [2025-10-15T22:40:25.040550] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-15T22:40:25.064714] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-15T22:40:25.064890] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-15T22:40:25.067934] [INFO ] [MAIN ] Derivative Progress: 1185/1803 symbols completed. MMS took 1.3s. Estimated remaining: 3m 54s. Rate: 158.7 symbols/min [2025-10-15T22:40:25.068673] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:25.068770] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:25.068900] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:25.106122] [DEBUG] [LOCAL ] MMU: Loaded 16587 existing records from primary storage. [2025-10-15T22:40:25.106854] [DEBUG] [LOCAL ] MMT: Loaded 10346 existing records from primary storage. [2025-10-15T22:40:25.107117] [INFO ] [MAIN ] MMT: Loaded 10346 primary data records. [2025-10-15T22:40:25.106972] [INFO ] [MAIN ] MMU: Loaded 16587 primary data records. [2025-10-15T22:40:25.297440] [DEBUG] [LOCAL ] MNR: Loaded 24924 existing records from primary storage. [2025-10-15T22:40:25.333902] [INFO ] [MAIN ] MNR: Loaded 24924 primary data records. [2025-10-15T22:40:26.054156] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:26.055051] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10346 primary records. [2025-10-15T22:40:26.055222] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-15T22:40:26.072113] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-15T22:40:26.072275] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-15T22:40:26.086388] [INFO ] [MAIN ] Derivative Progress: 1186/1803 symbols completed. MMT took 1.0s. Estimated remaining: 3m 54s. Rate: 158.5 symbols/min [2025-10-15T22:40:26.086879] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:26.086781] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:26.089786] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16587 primary records. [2025-10-15T22:40:26.090235] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-15T22:40:26.117538] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:26.118743] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-15T22:40:26.118822] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-15T22:40:26.122039] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24924 primary records. [2025-10-15T22:40:26.122178] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-15T22:40:26.121266] [INFO ] [MAIN ] Derivative Progress: 1187/1803 symbols completed. MMU took 1.1s. Estimated remaining: 3m 53s. Rate: 158.6 symbols/min [2025-10-15T22:40:26.123054] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:26.138625] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-15T22:40:26.138838] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-15T22:40:26.141673] [INFO ] [MAIN ] Derivative Progress: 1188/1803 symbols completed. MNR took 1.1s. Estimated remaining: 3m 52s. Rate: 158.8 symbols/min [2025-10-15T22:40:26.141982] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:26.196384] [DEBUG] [LOCAL ] MNSO: Loaded 44171 existing records from primary storage. [2025-10-15T22:40:26.196632] [INFO ] [MAIN ] MNSO: Loaded 44171 primary data records. [2025-10-15T22:40:26.290946] [DEBUG] [LOCAL ] MOD: Loaded 44781 existing records from primary storage. [2025-10-15T22:40:26.325940] [INFO ] [MAIN ] MOD: Loaded 44781 primary data records. [2025-10-15T22:40:26.326725] [DEBUG] [LOCAL ] MODG: Loaded 51597 existing records from primary storage. [2025-10-15T22:40:26.326832] [INFO ] [MAIN ] MODG: Loaded 51597 primary data records. [2025-10-15T22:40:27.181498] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:27.182772] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44171 primary records. [2025-10-15T22:40:27.183132] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-15T22:40:27.201720] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-15T22:40:27.201837] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-15T22:40:27.203755] [INFO ] [MAIN ] Derivative Progress: 1189/1803 symbols completed. MNSO took 1.1s. Estimated remaining: 3m 52s. Rate: 158.5 symbols/min [2025-10-15T22:40:27.206006] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:27.220114] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:27.221226] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51597 primary records. [2025-10-15T22:40:27.221416] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-15T22:40:27.235322] [DEBUG] [MAIN ] MOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:27.246969] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 44781 primary records. [2025-10-15T22:40:27.247708] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-15T22:40:27.251944] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-15T22:40:27.252335] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-15T22:40:27.255265] [INFO ] [MAIN ] Derivative Progress: 1190/1803 symbols completed. MODG took 1.1s. Estimated remaining: 3m 52s. Rate: 158.6 symbols/min [2025-10-15T22:40:27.266816] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:27.271849] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-15T22:40:27.272129] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-15T22:40:27.274364] [INFO ] [MAIN ] Derivative Progress: 1191/1803 symbols completed. MOD took 1.2s. Estimated remaining: 3m 51s. Rate: 158.8 symbols/min [2025-10-15T22:40:27.274660] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:27.304155] [DEBUG] [LOCAL ] MOH: Loaded 42649 existing records from primary storage. [2025-10-15T22:40:27.304500] [INFO ] [MAIN ] MOH: Loaded 42649 primary data records. [2025-10-15T22:40:27.430463] [DEBUG] [LOCAL ] MOV: Loaded 21692 existing records from primary storage. [2025-10-15T22:40:27.430745] [INFO ] [MAIN ] MOV: Loaded 21692 primary data records. [2025-10-15T22:40:27.770897] [DEBUG] [LOCAL ] MOS: Loaded 53508 existing records from primary storage. [2025-10-15T22:40:27.792317] [INFO ] [MAIN ] MOS: Loaded 53508 primary data records. [2025-10-15T22:40:28.265807] [DEBUG] [MAIN ] MOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:28.266751] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 42649 primary records. [2025-10-15T22:40:28.267500] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-15T22:40:28.287669] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-15T22:40:28.287925] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-15T22:40:28.290372] [INFO ] [MAIN ] Derivative Progress: 1192/1803 symbols completed. MOH took 1.1s. Estimated remaining: 3m 51s. Rate: 158.5 symbols/min [2025-10-15T22:40:28.290849] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:28.304754] [DEBUG] [MAIN ] MOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:28.307454] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21692 primary records. [2025-10-15T22:40:28.307592] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-15T22:40:28.324823] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-15T22:40:28.325364] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-15T22:40:28.327702] [INFO ] [MAIN ] Derivative Progress: 1193/1803 symbols completed. MOV took 1.1s. Estimated remaining: 3m 51s. Rate: 158.7 symbols/min [2025-10-15T22:40:28.327966] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:28.365488] [DEBUG] [LOCAL ] MPA: Loaded 5368 existing records from primary storage. [2025-10-15T22:40:28.365245] [DEBUG] [MAIN ] MOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:28.366562] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53508 primary records. [2025-10-15T22:40:28.365798] [INFO ] [MAIN ] MPA: Loaded 5368 primary data records. [2025-10-15T22:40:28.366700] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-15T22:40:28.473071] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-15T22:40:28.505130] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-15T22:40:28.513456] [INFO ] [MAIN ] Derivative Progress: 1194/1803 symbols completed. MOS took 1.2s. Estimated remaining: 3m 50s. Rate: 158.7 symbols/min [2025-10-15T22:40:28.518833] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:28.536048] [DEBUG] [LOCAL ] MP: Loaded 53722 existing records from primary storage. [2025-10-15T22:40:28.570100] [INFO ] [MAIN ] MP: Loaded 53722 primary data records. [2025-10-15T22:40:29.073317] [DEBUG] [LOCAL ] MPC: Loaded 52051 existing records from primary storage. [2025-10-15T22:40:29.073631] [INFO ] [MAIN ] MPC: Loaded 52051 primary data records. [2025-10-15T22:40:29.219954] [DEBUG] [MAIN ] MPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:29.271310] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5368 primary records. [2025-10-15T22:40:29.387003] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-15T22:40:29.405510] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-15T22:40:29.406302] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-15T22:40:29.408375] [INFO ] [MAIN ] Derivative Progress: 1195/1803 symbols completed. MPA took 1.1s. Estimated remaining: 3m 50s. Rate: 158.5 symbols/min [2025-10-15T22:40:29.408995] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:29.427518] [DEBUG] [MAIN ] MP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:29.428629] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53722 primary records. [2025-10-15T22:40:29.428931] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-15T22:40:29.447377] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-15T22:40:29.447732] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-15T22:40:29.451139] [INFO ] [MAIN ] Derivative Progress: 1196/1803 symbols completed. MP took 1.2s. Estimated remaining: 3m 50s. Rate: 158.7 symbols/min [2025-10-15T22:40:29.451586] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:29.469414] [DEBUG] [MAIN ] MPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:29.470160] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52051 primary records. [2025-10-15T22:40:29.470274] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-15T22:40:29.481201] [DEBUG] [LOCAL ] MPV: Loaded 4661 existing records from primary storage. [2025-10-15T22:40:29.497875] [INFO ] [MAIN ] MPV: Loaded 4661 primary data records. [2025-10-15T22:40:29.508509] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-10-15T22:40:29.542074] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-15T22:40:29.569116] [INFO ] [MAIN ] Derivative Progress: 1197/1803 symbols completed. MPC took 1.1s. Estimated remaining: 3m 49s. Rate: 158.8 symbols/min [2025-10-15T22:40:29.580839] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:29.640067] [DEBUG] [LOCAL ] MPLX: Loaded 50757 existing records from primary storage. [2025-10-15T22:40:29.640258] [INFO ] [MAIN ] MPLX: Loaded 50757 primary data records. [2025-10-15T22:40:30.148355] [DEBUG] [LOCAL ] MPW: Loaded 53496 existing records from primary storage. [2025-10-15T22:40:30.150110] [INFO ] [MAIN ] MPW: Loaded 53496 primary data records. [2025-10-15T22:40:30.524775] [DEBUG] [MAIN ] MPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:30.525788] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4661 primary records. [2025-10-15T22:40:30.525907] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-15T22:40:30.544262] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-15T22:40:30.544489] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-15T22:40:30.546357] [INFO ] [MAIN ] Derivative Progress: 1198/1803 symbols completed. MPV took 1.1s. Estimated remaining: 3m 49s. Rate: 158.5 symbols/min [2025-10-15T22:40:30.560802] [DEBUG] [MAIN ] MPLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:30.562043] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50757 primary records. [2025-10-15T22:40:30.562229] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-15T22:40:30.579942] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-15T22:40:30.580088] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-15T22:40:30.582535] [INFO ] [MAIN ] Derivative Progress: 1199/1803 symbols completed. MPLX took 1.2s. Estimated remaining: 3m 48s. Rate: 158.7 symbols/min [2025-10-15T22:40:30.600103] [DEBUG] [MAIN ] MPW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:30.600601] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53496 primary records. [2025-10-15T22:40:30.600698] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-15T22:40:30.614952] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-10-15T22:40:30.615009] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-15T22:40:30.617257] [INFO ] [MAIN ] Derivative Progress: 1200/1803 symbols completed. MPW took 1.0s. Estimated remaining: 3m 48s. Rate: 158.8 symbols/min [2025-10-15T22:40:30.617925] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:30.617858] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:30.618453] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:30.626933] [DEBUG] [LOCAL ] MPX: Loaded 4065 existing records from primary storage. [2025-10-15T22:40:30.629050] [INFO ] [MAIN ] MPX: Loaded 4065 primary data records. [2025-10-15T22:40:30.681841] [DEBUG] [LOCAL ] MSB: Loaded 7796 existing records from primary storage. [2025-10-15T22:40:30.687359] [INFO ] [MAIN ] MSB: Loaded 7796 primary data records. [2025-10-15T22:40:30.757543] [DEBUG] [LOCAL ] MQT: Loaded 8325 existing records from primary storage. [2025-10-15T22:40:30.791039] [INFO ] [MAIN ] MQT: Loaded 8325 primary data records. [2025-10-15T22:40:31.548359] [DEBUG] [MAIN ] MPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:31.551783] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4065 primary records. [2025-10-15T22:40:31.552002] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-15T22:40:31.572461] [DEBUG] [MAIN ] MSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:31.581554] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-10-15T22:40:31.577220] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7796 primary records. [2025-10-15T22:40:31.581949] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-15T22:40:31.582013] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-15T22:40:31.585135] [INFO ] [MAIN ] Derivative Progress: 1201/1803 symbols completed. MPX took 1.0s. Estimated remaining: 3m 48s. Rate: 158.6 symbols/min [2025-10-15T22:40:31.586051] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:31.615791] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-10-15T22:40:31.614736] [DEBUG] [MAIN ] MQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:31.616059] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-15T22:40:31.619415] [INFO ] [MAIN ] Derivative Progress: 1202/1803 symbols completed. MSB took 1.0s. Estimated remaining: 3m 47s. Rate: 158.7 symbols/min [2025-10-15T22:40:31.616935] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8325 primary records. [2025-10-15T22:40:31.623565] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:31.624095] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-15T22:40:31.647148] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-15T22:40:31.647060] [DEBUG] [LOCAL ] MSD: Loaded 16546 existing records from primary storage. [2025-10-15T22:40:31.647312] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-15T22:40:31.650107] [INFO ] [MAIN ] Derivative Progress: 1203/1803 symbols completed. MQT took 1.0s. Estimated remaining: 3m 47s. Rate: 158.8 symbols/min [2025-10-15T22:40:31.650357] [INFO ] [MAIN ] MSD: Loaded 16546 primary data records. [2025-10-15T22:40:31.650292] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:31.729531] [DEBUG] [LOCAL ] MTD: Loaded 15452 existing records from primary storage. [2025-10-15T22:40:31.748728] [INFO ] [MAIN ] MTD: Loaded 15452 primary data records. [2025-10-15T22:40:31.871550] [DEBUG] [LOCAL ] MUA: Loaded 11546 existing records from primary storage. [2025-10-15T22:40:31.910268] [INFO ] [MAIN ] MUA: Loaded 11546 primary data records. [2025-10-15T22:40:32.688904] [DEBUG] [MAIN ] MSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:32.690276] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16546 primary records. [2025-10-15T22:40:32.690735] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-15T22:40:32.708270] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-15T22:40:32.708626] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-15T22:40:32.710938] [INFO ] [MAIN ] Derivative Progress: 1204/1803 symbols completed. MSD took 1.1s. Estimated remaining: 3m 47s. Rate: 158.6 symbols/min [2025-10-15T22:40:32.713164] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:32.732412] [DEBUG] [MAIN ] MUA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:32.733401] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11546 primary records. [2025-10-15T22:40:32.733576] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-15T22:40:32.758524] [DEBUG] [MAIN ] MTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:32.766171] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-15T22:40:32.766272] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-15T22:40:32.768947] [INFO ] [MAIN ] Derivative Progress: 1205/1803 symbols completed. MUA took 1.1s. Estimated remaining: 3m 46s. Rate: 158.7 symbols/min [2025-10-15T22:40:32.770113] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15452 primary records. [2025-10-15T22:40:32.769121] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:32.770291] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-15T22:40:32.775845] [DEBUG] [LOCAL ] MUE: Loaded 11930 existing records from primary storage. [2025-10-15T22:40:32.784578] [INFO ] [MAIN ] MUE: Loaded 11930 primary data records. [2025-10-15T22:40:32.859290] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-10-15T22:40:32.870562] [DEBUG] [LOCAL ] MVF: Loaded 12768 existing records from primary storage. [2025-10-15T22:40:32.870264] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-15T22:40:32.884519] [INFO ] [MAIN ] Derivative Progress: 1206/1803 symbols completed. MTD took 1.3s. Estimated remaining: 3m 46s. Rate: 158.8 symbols/min [2025-10-15T22:40:32.870738] [INFO ] [MAIN ] MVF: Loaded 12768 primary data records. [2025-10-15T22:40:32.906095] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:33.069494] [DEBUG] [LOCAL ] MVO: Loaded 8824 existing records from primary storage. [2025-10-15T22:40:33.092386] [INFO ] [MAIN ] MVO: Loaded 8824 primary data records. [2025-10-15T22:40:33.815531] [DEBUG] [MAIN ] MUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:33.816625] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11930 primary records. [2025-10-15T22:40:33.817109] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-15T22:40:33.837421] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-15T22:40:33.840178] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-15T22:40:33.842212] [INFO ] [MAIN ] Derivative Progress: 1207/1803 symbols completed. MUE took 1.1s. Estimated remaining: 3m 46s. Rate: 158.6 symbols/min [2025-10-15T22:40:33.842480] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:33.868593] [DEBUG] [MAIN ] MVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:33.869420] [DEBUG] [MAIN ] MVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:33.870287] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12768 primary records. [2025-10-15T22:40:33.870481] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-15T22:40:33.871208] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 8824 primary records. [2025-10-15T22:40:33.873798] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-15T22:40:33.908619] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-10-15T22:40:33.908800] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-15T22:40:33.909619] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-15T22:40:33.909800] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-15T22:40:33.912364] [INFO ] [MAIN ] Derivative Progress: 1208/1803 symbols completed. MVF took 1.1s. Estimated remaining: 3m 45s. Rate: 158.7 symbols/min [2025-10-15T22:40:33.904408] [DEBUG] [LOCAL ] MVT: Loaded 10021 existing records from primary storage. [2025-10-15T22:40:33.912598] [INFO ] [MAIN ] MVT: Loaded 10021 primary data records. [2025-10-15T22:40:33.915410] [INFO ] [MAIN ] Derivative Progress: 1209/1803 symbols completed. MVO took 1.0s. Estimated remaining: 3m 44s. Rate: 158.8 symbols/min [2025-10-15T22:40:33.912790] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:33.920822] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:34.045552] [DEBUG] [LOCAL ] MXF: Loaded 5589 existing records from primary storage. [2025-10-15T22:40:34.051235] [INFO ] [MAIN ] MXF: Loaded 5589 primary data records. [2025-10-15T22:40:34.103947] [DEBUG] [LOCAL ] MX: Loaded 22327 existing records from primary storage. [2025-10-15T22:40:34.133424] [INFO ] [MAIN ] MX: Loaded 22327 primary data records. [2025-10-15T22:40:34.983819] [DEBUG] [MAIN ] MVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:34.986060] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10021 primary records. [2025-10-15T22:40:34.986193] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-15T22:40:35.012979] [DEBUG] [MAIN ] MXF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:35.018092] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-15T22:40:35.017180] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5589 primary records. [2025-10-15T22:40:35.018220] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-15T22:40:35.019080] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-15T22:40:35.021360] [INFO ] [MAIN ] Derivative Progress: 1210/1803 symbols completed. MVT took 1.2s. Estimated remaining: 3m 44s. Rate: 158.6 symbols/min [2025-10-15T22:40:35.021660] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:35.037220] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-10-15T22:40:35.039621] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-15T22:40:35.042328] [INFO ] [MAIN ] Derivative Progress: 1211/1803 symbols completed. MXF took 1.1s. Estimated remaining: 3m 44s. Rate: 158.7 symbols/min [2025-10-15T22:40:35.043016] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:35.050757] [DEBUG] [LOCAL ] MYN: Loaded 9786 existing records from primary storage. [2025-10-15T22:40:35.051140] [INFO ] [MAIN ] MYN: Loaded 9786 primary data records. [2025-10-15T22:40:35.112889] [DEBUG] [MAIN ] MX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:35.135861] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22327 primary records. [2025-10-15T22:40:35.154875] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-15T22:40:35.239841] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-10-15T22:40:35.403768] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-15T22:40:35.406415] [INFO ] [MAIN ] Derivative Progress: 1212/1803 symbols completed. MX took 1.5s. Estimated remaining: 3m 43s. Rate: 158.7 symbols/min [2025-10-15T22:40:35.406745] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:35.430740] [DEBUG] [LOCAL ] NAT: Loaded 49224 existing records from primary storage. [2025-10-15T22:40:35.431038] [INFO ] [MAIN ] NAT: Loaded 49224 primary data records. [2025-10-15T22:40:35.449830] [DEBUG] [LOCAL ] NAZ: Loaded 2663 existing records from primary storage. [2025-10-15T22:40:35.483101] [INFO ] [MAIN ] NAZ: Loaded 2663 primary data records. [2025-10-15T22:40:35.937227] [DEBUG] [MAIN ] MYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:35.938559] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9786 primary records. [2025-10-15T22:40:36.054802] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-15T22:40:36.074982] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-15T22:40:36.076245] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-15T22:40:36.078925] [INFO ] [MAIN ] Derivative Progress: 1213/1803 symbols completed. MYN took 1.1s. Estimated remaining: 3m 43s. Rate: 158.6 symbols/min [2025-10-15T22:40:36.099192] [DEBUG] [MAIN ] NAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:36.100687] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49224 primary records. [2025-10-15T22:40:36.101432] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-15T22:40:36.128936] [DEBUG] [MAIN ] NAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:36.130943] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2663 primary records. [2025-10-15T22:40:36.131028] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-15T22:40:36.132067] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-10-15T22:40:36.132399] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-15T22:40:36.134960] [INFO ] [MAIN ] Derivative Progress: 1214/1803 symbols completed. NAT took 1.1s. Estimated remaining: 3m 43s. Rate: 158.7 symbols/min [2025-10-15T22:40:36.150121] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-15T22:40:36.150185] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-15T22:40:36.153401] [INFO ] [MAIN ] Derivative Progress: 1215/1803 symbols completed. NAZ took 0.7s. Estimated remaining: 3m 42s. Rate: 158.8 symbols/min [2025-10-15T22:40:36.153832] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:36.153961] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:36.154440] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:36.160101] [DEBUG] [LOCAL ] NC: Loaded 1963 existing records from primary storage. [2025-10-15T22:40:36.162626] [INFO ] [MAIN ] NC: Loaded 1963 primary data records. [2025-10-15T22:40:36.255910] [DEBUG] [LOCAL ] NBB: Loaded 9062 existing records from primary storage. [2025-10-15T22:40:36.278787] [INFO ] [MAIN ] NBB: Loaded 9062 primary data records. [2025-10-15T22:40:36.278691] [DEBUG] [LOCAL ] NCA: Loaded 9994 existing records from primary storage. [2025-10-15T22:40:36.291927] [INFO ] [MAIN ] NCA: Loaded 9994 primary data records. [2025-10-15T22:40:37.175057] [DEBUG] [MAIN ] NC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:40:37.178606] [INFO ] [MAIN ] NC: Generated 1793 derivative records from 1963 primary records. [2025-10-15T22:40:37.178929] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-15T22:40:37.209474] [DEBUG] [LOCAL ] NC: Derivative data saved (1793 records). [2025-10-15T22:40:37.209831] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-15T22:40:37.212421] [INFO ] [MAIN ] Derivative Progress: 1216/1803 symbols completed. NC took 1.1s. Estimated remaining: 3m 42s. Rate: 158.6 symbols/min [2025-10-15T22:40:37.212586] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:37.210255] [DEBUG] [MAIN ] NBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:37.226909] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9062 primary records. [2025-10-15T22:40:37.226103] [DEBUG] [MAIN ] NCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:37.227064] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-15T22:40:37.227700] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 9994 primary records. [2025-10-15T22:40:37.228707] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-15T22:40:37.260573] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-15T22:40:37.262330] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-15T22:40:37.262488] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-15T22:40:37.265319] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-15T22:40:37.265240] [INFO ] [MAIN ] Derivative Progress: 1217/1803 symbols completed. NCA took 1.1s. Estimated remaining: 3m 42s. Rate: 158.7 symbols/min [2025-10-15T22:40:37.268221] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:37.268443] [INFO ] [MAIN ] Derivative Progress: 1218/1803 symbols completed. NBB took 1.1s. Estimated remaining: 3m 41s. Rate: 158.8 symbols/min [2025-10-15T22:40:37.273890] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:37.274352] [DEBUG] [LOCAL ] NCV: Loaded 13954 existing records from primary storage. [2025-10-15T22:40:37.274804] [INFO ] [MAIN ] NCV: Loaded 13954 primary data records. [2025-10-15T22:40:37.380121] [DEBUG] [LOCAL ] NEXA: Loaded 5247 existing records from primary storage. [2025-10-15T22:40:37.383392] [INFO ] [MAIN ] NEXA: Loaded 5247 primary data records. [2025-10-15T22:40:37.482560] [DEBUG] [LOCAL ] NCZ: Loaded 12383 existing records from primary storage. [2025-10-15T22:40:37.491348] [INFO ] [MAIN ] NCZ: Loaded 12383 primary data records. [2025-10-15T22:40:38.267886] [DEBUG] [MAIN ] NCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:38.268956] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13954 primary records. [2025-10-15T22:40:38.269460] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-15T22:40:38.288359] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-15T22:40:38.289407] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-15T22:40:38.291637] [INFO ] [MAIN ] Derivative Progress: 1219/1803 symbols completed. NCV took 1.1s. Estimated remaining: 3m 41s. Rate: 158.6 symbols/min [2025-10-15T22:40:38.292061] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:38.306844] [DEBUG] [MAIN ] NEXA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:38.307924] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 5247 primary records. [2025-10-15T22:40:38.309012] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-15T22:40:38.346919] [DEBUG] [MAIN ] NCZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:38.349190] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-10-15T22:40:38.350244] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-15T22:40:38.353052] [INFO ] [MAIN ] Derivative Progress: 1220/1803 symbols completed. NEXA took 1.1s. Estimated remaining: 3m 40s. Rate: 158.7 symbols/min [2025-10-15T22:40:38.350103] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12383 primary records. [2025-10-15T22:40:38.353355] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-15T22:40:38.353491] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:38.378502] [DEBUG] [LOCAL ] NGL: Loaded 30004 existing records from primary storage. [2025-10-15T22:40:38.379864] [INFO ] [MAIN ] NGL: Loaded 30004 primary data records. [2025-10-15T22:40:38.421754] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-15T22:40:38.428578] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-15T22:40:38.462114] [DEBUG] [LOCAL ] NGS: Loaded 11176 existing records from primary storage. [2025-10-15T22:40:38.443445] [INFO ] [MAIN ] Derivative Progress: 1221/1803 symbols completed. NCZ took 1.2s. Estimated remaining: 3m 40s. Rate: 158.8 symbols/min [2025-10-15T22:40:38.479294] [INFO ] [MAIN ] NGS: Loaded 11176 primary data records. [2025-10-15T22:40:38.479222] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:38.801473] [DEBUG] [LOCAL ] NIE: Loaded 11908 existing records from primary storage. [2025-10-15T22:40:38.807396] [INFO ] [MAIN ] NIE: Loaded 11908 primary data records. [2025-10-15T22:40:39.324414] [DEBUG] [MAIN ] NGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:39.325493] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30004 primary records. [2025-10-15T22:40:39.325832] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-15T22:40:39.346340] [DEBUG] [MAIN ] NGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:39.351898] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11176 primary records. [2025-10-15T22:40:39.352843] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-15T22:40:39.370846] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-10-15T22:40:39.371220] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-15T22:40:39.373878] [INFO ] [MAIN ] Derivative Progress: 1222/1803 symbols completed. NGS took 1.0s. Estimated remaining: 3m 40s. Rate: 158.6 symbols/min [2025-10-15T22:40:39.374320] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:39.375628] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-10-15T22:40:39.377404] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-15T22:40:39.379936] [INFO ] [MAIN ] Derivative Progress: 1223/1803 symbols completed. NGL took 1.1s. Estimated remaining: 3m 39s. Rate: 158.8 symbols/min [2025-10-15T22:40:39.381236] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:39.386595] [DEBUG] [LOCAL ] NIM: Loaded 3526 existing records from primary storage. [2025-10-15T22:40:39.386902] [INFO ] [MAIN ] NIM: Loaded 3526 primary data records. [2025-10-15T22:40:39.442110] [DEBUG] [MAIN ] NIE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:39.474387] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11908 primary records. [2025-10-15T22:40:39.504755] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-15T22:40:39.609006] [DEBUG] [LOCAL ] NINE: Loaded 28362 existing records from primary storage. [2025-10-15T22:40:39.616385] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-15T22:40:39.616538] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-15T22:40:39.616673] [INFO ] [MAIN ] NINE: Loaded 28362 primary data records. [2025-10-15T22:40:39.619537] [INFO ] [MAIN ] Derivative Progress: 1224/1803 symbols completed. NIE took 1.1s. Estimated remaining: 3m 39s. Rate: 158.8 symbols/min [2025-10-15T22:40:39.747631] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:40.098430] [DEBUG] [MAIN ] NIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:40.100480] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 3526 primary records. [2025-10-15T22:40:40.100944] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-15T22:40:40.102840] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-15T22:40:40.109527] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-15T22:40:40.215731] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-15T22:40:40.233873] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-15T22:40:40.236923] [INFO ] [MAIN ] Derivative Progress: 1225/1803 symbols completed. NIM took 0.9s. Estimated remaining: 3m 38s. Rate: 158.7 symbols/min [2025-10-15T22:40:40.285066] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:40.480096] [DEBUG] [MAIN ] NINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:40.486097] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28362 primary records. [2025-10-15T22:40:40.486781] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-15T22:40:40.506308] [DEBUG] [LOCAL ] NKX: Loaded 13656 existing records from primary storage. [2025-10-15T22:40:40.510467] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-10-15T22:40:40.510712] [INFO ] [MAIN ] NKX: Loaded 13656 primary data records. [2025-10-15T22:40:40.510782] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-15T22:40:40.513398] [INFO ] [MAIN ] Derivative Progress: 1226/1803 symbols completed. NINE took 1.1s. Estimated remaining: 3m 38s. Rate: 158.8 symbols/min [2025-10-15T22:40:40.518763] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:40.652059] [DEBUG] [LOCAL ] NMAI: Loaded 12861 existing records from primary storage. [2025-10-15T22:40:40.684028] [INFO ] [MAIN ] NMAI: Loaded 12861 primary data records. [2025-10-15T22:40:40.986618] [DEBUG] [MAIN ] NIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:41.028310] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-10-15T22:40:41.142603] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-15T22:40:41.162164] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-10-15T22:40:41.162394] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-15T22:40:41.165039] [INFO ] [MAIN ] Derivative Progress: 1227/1803 symbols completed. NIO took 1.4s. Estimated remaining: 3m 38s. Rate: 158.7 symbols/min [2025-10-15T22:40:41.165186] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:41.179103] [DEBUG] [LOCAL ] NMG: Loaded 10641 existing records from primary storage. [2025-10-15T22:40:41.179622] [INFO ] [MAIN ] NMG: Loaded 10641 primary data records. [2025-10-15T22:40:41.289682] [DEBUG] [MAIN ] NKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:41.302095] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13656 primary records. [2025-10-15T22:40:41.309442] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-15T22:40:41.522309] [DEBUG] [MAIN ] NMAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:41.529811] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12861 primary records. [2025-10-15T22:40:41.531760] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-15T22:40:41.531636] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-15T22:40:41.532974] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-15T22:40:41.544030] [INFO ] [MAIN ] Derivative Progress: 1228/1803 symbols completed. NKX took 1.3s. Estimated remaining: 3m 37s. Rate: 158.7 symbols/min [2025-10-15T22:40:41.553705] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-10-15T22:40:41.553822] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-15T22:40:41.556534] [INFO ] [MAIN ] Derivative Progress: 1229/1803 symbols completed. NMAI took 1.0s. Estimated remaining: 3m 37s. Rate: 158.8 symbols/min [2025-10-15T22:40:41.575389] [DEBUG] [MAIN ] NMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:41.576055] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 10641 primary records. [2025-10-15T22:40:41.576118] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-15T22:40:41.590789] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-10-15T22:40:41.590854] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-15T22:40:41.593375] [INFO ] [MAIN ] Derivative Progress: 1230/1803 symbols completed. NMG took 0.4s. Estimated remaining: 3m 36s. Rate: 158.9 symbols/min [2025-10-15T22:40:41.593938] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:41.593889] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:41.594010] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:41.604247] [DEBUG] [LOCAL ] NMS: Loaded 2910 existing records from primary storage. [2025-10-15T22:40:41.602337] [DEBUG] [LOCAL ] NMI: Loaded 4054 existing records from primary storage. [2025-10-15T22:40:41.604467] [INFO ] [MAIN ] NMI: Loaded 4054 primary data records. [2025-10-15T22:40:41.604528] [INFO ] [MAIN ] NMS: Loaded 2910 primary data records. [2025-10-15T22:40:41.986428] [DEBUG] [LOCAL ] NMR: Loaded 35582 existing records from primary storage. [2025-10-15T22:40:42.089208] [INFO ] [MAIN ] NMR: Loaded 35582 primary data records. [2025-10-15T22:40:42.646475] [DEBUG] [MAIN ] NMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:42.646208] [DEBUG] [MAIN ] NMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:42.648452] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4054 primary records. [2025-10-15T22:40:42.647841] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2910 primary records. [2025-10-15T22:40:42.648603] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-15T22:40:42.648698] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-15T22:40:42.678591] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-15T22:40:42.678518] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-10-15T22:40:42.678761] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-15T22:40:42.678869] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-15T22:40:42.681246] [INFO ] [MAIN ] Derivative Progress: 1231/1803 symbols completed. NMS took 1.1s. Estimated remaining: 3m 36s. Rate: 158.7 symbols/min [2025-10-15T22:40:42.684151] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:42.684208] [INFO ] [MAIN ] Derivative Progress: 1232/1803 symbols completed. NMI took 1.1s. Estimated remaining: 3m 36s. Rate: 158.8 symbols/min [2025-10-15T22:40:42.685189] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:42.690461] [DEBUG] [LOCAL ] NMT: Loaded 2835 existing records from primary storage. [2025-10-15T22:40:42.690751] [INFO ] [MAIN ] NMT: Loaded 2835 primary data records. [2025-10-15T22:40:42.797263] [DEBUG] [LOCAL ] NNI: Loaded 10444 existing records from primary storage. [2025-10-15T22:40:42.808863] [INFO ] [MAIN ] NNI: Loaded 10444 primary data records. [2025-10-15T22:40:42.876300] [DEBUG] [MAIN ] NMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:42.912751] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35582 primary records. [2025-10-15T22:40:42.917996] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-15T22:40:43.192425] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-10-15T22:40:43.214397] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-15T22:40:43.332860] [INFO ] [MAIN ] Derivative Progress: 1233/1803 symbols completed. NMR took 1.7s. Estimated remaining: 3m 36s. Rate: 158.7 symbols/min [2025-10-15T22:40:43.333726] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:43.344591] [DEBUG] [LOCAL ] NNY: Loaded 5659 existing records from primary storage. [2025-10-15T22:40:43.345298] [INFO ] [MAIN ] NNY: Loaded 5659 primary data records. [2025-10-15T22:40:43.547559] [DEBUG] [MAIN ] NMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:43.666873] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2835 primary records. [2025-10-15T22:40:43.669209] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-15T22:40:43.698430] [DEBUG] [MAIN ] NNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:43.700686] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-10-15T22:40:43.700974] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-15T22:40:43.701822] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10444 primary records. [2025-10-15T22:40:43.702160] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-15T22:40:43.705438] [INFO ] [MAIN ] Derivative Progress: 1234/1803 symbols completed. NMT took 1.0s. Estimated remaining: 3m 35s. Rate: 158.7 symbols/min [2025-10-15T22:40:43.705857] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:43.720608] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-10-15T22:40:43.721534] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-15T22:40:43.725100] [INFO ] [MAIN ] Derivative Progress: 1235/1803 symbols completed. NNI took 1.0s. Estimated remaining: 3m 35s. Rate: 158.8 symbols/min [2025-10-15T22:40:43.725509] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:43.745022] [DEBUG] [MAIN ] NNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:43.745708] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5659 primary records. [2025-10-15T22:40:43.745770] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-15T22:40:43.761998] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-15T22:40:43.762130] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-15T22:40:43.764974] [INFO ] [MAIN ] Derivative Progress: 1236/1803 symbols completed. NNY took 0.4s. Estimated remaining: 3m 34s. Rate: 158.9 symbols/min [2025-10-15T22:40:43.774085] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:43.804226] [DEBUG] [LOCAL ] NOTE: Loaded 40429 existing records from primary storage. [2025-10-15T22:40:43.809023] [DEBUG] [LOCAL ] NPFD: Loaded 10070 existing records from primary storage. [2025-10-15T22:40:43.808801] [INFO ] [MAIN ] NOTE: Loaded 40429 primary data records. [2025-10-15T22:40:43.809289] [INFO ] [MAIN ] NPFD: Loaded 10070 primary data records. [2025-10-15T22:40:43.889819] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-15T22:40:43.952557] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-15T22:40:44.811952] [DEBUG] [MAIN ] NOTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:44.818549] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 40429 primary records. [2025-10-15T22:40:44.817579] [DEBUG] [MAIN ] NPFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:44.818718] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-15T22:40:44.819922] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 10070 primary records. [2025-10-15T22:40:44.820068] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-15T22:40:44.821238] [DEBUG] [MAIN ] NOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:44.829002] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53622 primary records. [2025-10-15T22:40:44.829409] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-15T22:40:44.863848] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-10-15T22:40:44.865743] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-15T22:40:44.868758] [INFO ] [MAIN ] Derivative Progress: 1237/1803 symbols completed. NPFD took 1.1s. Estimated remaining: 3m 34s. Rate: 158.7 symbols/min [2025-10-15T22:40:44.869223] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:44.870218] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-10-15T22:40:44.871414] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-10-15T22:40:44.872103] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-15T22:40:44.871866] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-15T22:40:44.875098] [INFO ] [MAIN ] Derivative Progress: 1238/1803 symbols completed. NOK took 1.2s. Estimated remaining: 3m 33s. Rate: 158.8 symbols/min [2025-10-15T22:40:44.878098] [INFO ] [MAIN ] Derivative Progress: 1239/1803 symbols completed. NOTE took 1.2s. Estimated remaining: 3m 33s. Rate: 158.9 symbols/min [2025-10-15T22:40:44.875362] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:44.878535] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:44.892356] [DEBUG] [LOCAL ] NPV: Loaded 5356 existing records from primary storage. [2025-10-15T22:40:44.892824] [DEBUG] [LOCAL ] NPK: Loaded 8408 existing records from primary storage. [2025-10-15T22:40:44.893005] [INFO ] [MAIN ] NPV: Loaded 5356 primary data records. [2025-10-15T22:40:44.892941] [INFO ] [MAIN ] NPK: Loaded 8408 primary data records. [2025-10-15T22:40:45.143870] [DEBUG] [LOCAL ] NRDY: Loaded 32694 existing records from primary storage. [2025-10-15T22:40:45.221946] [INFO ] [MAIN ] NRDY: Loaded 32694 primary data records. [2025-10-15T22:40:45.841941] [DEBUG] [MAIN ] NPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:45.851039] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5356 primary records. [2025-10-15T22:40:45.856363] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-15T22:40:45.857585] [DEBUG] [MAIN ] NPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:45.858870] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8408 primary records. [2025-10-15T22:40:45.859169] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-15T22:40:45.875183] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-15T22:40:45.882121] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-15T22:40:45.889143] [INFO ] [MAIN ] Derivative Progress: 1240/1803 symbols completed. NPV took 1.0s. Estimated remaining: 3m 33s. Rate: 158.7 symbols/min [2025-10-15T22:40:45.894821] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:45.893450] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-10-15T22:40:45.897514] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-15T22:40:45.899805] [INFO ] [MAIN ] Derivative Progress: 1241/1803 symbols completed. NPK took 1.0s. Estimated remaining: 3m 32s. Rate: 158.9 symbols/min [2025-10-15T22:40:45.900235] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:45.923051] [DEBUG] [MAIN ] NRDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:45.924098] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32694 primary records. [2025-10-15T22:40:45.924260] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-15T22:40:45.945266] [DEBUG] [LOCAL ] NREF: Loaded 7865 existing records from primary storage. [2025-10-15T22:40:45.949988] [INFO ] [MAIN ] NREF: Loaded 7865 primary data records. [2025-10-15T22:40:45.988269] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-10-15T22:40:46.015562] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-15T22:40:46.041157] [INFO ] [MAIN ] Derivative Progress: 1242/1803 symbols completed. NRDY took 1.2s. Estimated remaining: 3m 32s. Rate: 158.9 symbols/min [2025-10-15T22:40:46.066970] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:46.177803] [DEBUG] [LOCAL ] NRP: Loaded 4190 existing records from primary storage. [2025-10-15T22:40:46.296105] [DEBUG] [LOCAL ] NRGV: Loaded 43749 existing records from primary storage. [2025-10-15T22:40:46.296266] [INFO ] [MAIN ] NRGV: Loaded 43749 primary data records. [2025-10-15T22:40:46.295010] [INFO ] [MAIN ] NRP: Loaded 4190 primary data records. [2025-10-15T22:40:46.931057] [DEBUG] [MAIN ] NREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:46.933182] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7865 primary records. [2025-10-15T22:40:46.933983] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-15T22:40:46.952183] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-10-15T22:40:46.952529] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-15T22:40:46.954732] [INFO ] [MAIN ] Derivative Progress: 1243/1803 symbols completed. NREF took 1.1s. Estimated remaining: 3m 32s. Rate: 158.8 symbols/min [2025-10-15T22:40:46.973961] [DEBUG] [MAIN ] NRGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:46.974940] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43749 primary records. [2025-10-15T22:40:46.986974] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-15T22:40:46.987846] [DEBUG] [MAIN ] NRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:46.989612] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4190 primary records. [2025-10-15T22:40:47.000232] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-15T22:40:47.017896] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-10-15T22:40:47.019277] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-10-15T22:40:47.019448] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-15T22:40:47.021806] [INFO ] [MAIN ] Derivative Progress: 1244/1803 symbols completed. NRP took 1.0s. Estimated remaining: 3m 31s. Rate: 158.9 symbols/min [2025-10-15T22:40:47.019543] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-15T22:40:47.024992] [INFO ] [MAIN ] Derivative Progress: 1245/1803 symbols completed. NRGV took 1.1s. Estimated remaining: 3m 31s. Rate: 159.0 symbols/min [2025-10-15T22:40:47.025560] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:47.025664] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:47.025772] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:47.036166] [DEBUG] [LOCAL ] NRT: Loaded 4917 existing records from primary storage. [2025-10-15T22:40:47.036344] [INFO ] [MAIN ] NRT: Loaded 4917 primary data records. [2025-10-15T22:40:47.071197] [DEBUG] [LOCAL ] NUW: Loaded 6769 existing records from primary storage. [2025-10-15T22:40:47.083142] [INFO ] [MAIN ] NUW: Loaded 6769 primary data records. [2025-10-15T22:40:47.314817] [DEBUG] [LOCAL ] NUV: Loaded 23747 existing records from primary storage. [2025-10-15T22:40:47.451857] [INFO ] [MAIN ] NUV: Loaded 23747 primary data records. [2025-10-15T22:40:48.019202] [DEBUG] [MAIN ] NRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:48.021152] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4917 primary records. [2025-10-15T22:40:48.023743] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-15T22:40:48.047579] [DEBUG] [MAIN ] NUW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:48.048586] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 6769 primary records. [2025-10-15T22:40:48.048986] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-15T22:40:48.066211] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-10-15T22:40:48.066568] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-15T22:40:48.068916] [INFO ] [MAIN ] Derivative Progress: 1246/1803 symbols completed. NRT took 1.0s. Estimated remaining: 3m 31s. Rate: 158.8 symbols/min [2025-10-15T22:40:48.069785] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:48.075628] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-15T22:40:48.075889] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-15T22:40:48.078348] [INFO ] [MAIN ] Derivative Progress: 1247/1803 symbols completed. NUW took 1.1s. Estimated remaining: 3m 30s. Rate: 158.9 symbols/min [2025-10-15T22:40:48.091139] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:48.091514] [DEBUG] [MAIN ] NUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:48.092740] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23747 primary records. [2025-10-15T22:40:48.092977] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-15T22:40:48.114724] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-15T22:40:48.117518] [DEBUG] [LOCAL ] NXC: Loaded 4142 existing records from primary storage. [2025-10-15T22:40:48.117970] [INFO ] [MAIN ] NXC: Loaded 4142 primary data records. [2025-10-15T22:40:48.117747] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-15T22:40:48.121379] [INFO ] [MAIN ] Derivative Progress: 1248/1803 symbols completed. NUV took 1.1s. Estimated remaining: 3m 29s. Rate: 159.0 symbols/min [2025-10-15T22:40:48.208795] [DEBUG] [LOCAL ] NVR: Loaded 18536 existing records from primary storage. [2025-10-15T22:40:48.214516] [INFO ] [MAIN ] NVR: Loaded 18536 primary data records. [2025-10-15T22:40:48.214367] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:48.443150] [DEBUG] [LOCAL ] NXDT: Loaded 14958 existing records from primary storage. [2025-10-15T22:40:48.573976] [INFO ] [MAIN ] NXDT: Loaded 14958 primary data records. [2025-10-15T22:40:49.106416] [DEBUG] [MAIN ] NXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:49.109054] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4142 primary records. [2025-10-15T22:40:49.109272] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-15T22:40:49.138880] [DEBUG] [MAIN ] NVR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:40:49.141269] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 18536 primary records. [2025-10-15T22:40:49.141464] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-15T22:40:49.175901] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-10-15T22:40:49.168636] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-15T22:40:49.169153] [DEBUG] [MAIN ] NXDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:49.176115] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-15T22:40:49.177091] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-15T22:40:49.179438] [INFO ] [MAIN ] Derivative Progress: 1249/1803 symbols completed. NXC took 1.1s. Estimated remaining: 3m 29s. Rate: 158.8 symbols/min [2025-10-15T22:40:49.176979] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 14958 primary records. [2025-10-15T22:40:49.182165] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-15T22:40:49.182403] [INFO ] [MAIN ] Derivative Progress: 1250/1803 symbols completed. NVR took 1.1s. Estimated remaining: 3m 29s. Rate: 158.9 symbols/min [2025-10-15T22:40:49.182296] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:49.183375] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:49.199914] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-10-15T22:40:49.200076] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-15T22:40:49.202732] [INFO ] [MAIN ] Derivative Progress: 1251/1803 symbols completed. NXDT took 1.0s. Estimated remaining: 3m 28s. Rate: 159.0 symbols/min [2025-10-15T22:40:49.202924] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:49.205891] [DEBUG] [LOCAL ] NXN: Loaded 2264 existing records from primary storage. [2025-10-15T22:40:49.206301] [INFO ] [MAIN ] NXN: Loaded 2264 primary data records. [2025-10-15T22:40:49.315161] [DEBUG] [LOCAL ] NXP: Loaded 12319 existing records from primary storage. [2025-10-15T22:40:49.315333] [INFO ] [MAIN ] NXP: Loaded 12319 primary data records. [2025-10-15T22:40:49.684461] [DEBUG] [LOCAL ] NXE: Loaded 53044 existing records from primary storage. [2025-10-15T22:40:49.709514] [INFO ] [MAIN ] NXE: Loaded 53044 primary data records. [2025-10-15T22:40:50.204787] [DEBUG] [MAIN ] NXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:50.208269] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2264 primary records. [2025-10-15T22:40:50.208504] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-15T22:40:50.230457] [DEBUG] [MAIN ] NXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:50.237786] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12319 primary records. [2025-10-15T22:40:50.236777] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-10-15T22:40:50.238027] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-15T22:40:50.239193] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-15T22:40:50.241802] [INFO ] [MAIN ] Derivative Progress: 1252/1803 symbols completed. NXN took 1.1s. Estimated remaining: 3m 28s. Rate: 158.8 symbols/min [2025-10-15T22:40:50.242012] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:50.261136] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-15T22:40:50.263550] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-15T22:40:50.266577] [INFO ] [MAIN ] Derivative Progress: 1253/1803 symbols completed. NXP took 1.1s. Estimated remaining: 3m 28s. Rate: 158.9 symbols/min [2025-10-15T22:40:50.283532] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:50.283420] [DEBUG] [LOCAL ] OCFT: Loaded 7359 existing records from primary storage. [2025-10-15T22:40:50.279571] [DEBUG] [MAIN ] NXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:50.283867] [INFO ] [MAIN ] OCFT: Loaded 7359 primary data records. [2025-10-15T22:40:50.304934] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 53044 primary records. [2025-10-15T22:40:50.326948] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-15T22:40:50.447122] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-10-15T22:40:50.433436] [DEBUG] [LOCAL ] ODC: Loaded 8543 existing records from primary storage. [2025-10-15T22:40:50.517711] [INFO ] [MAIN ] ODC: Loaded 8543 primary data records. [2025-10-15T22:40:50.517815] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-15T22:40:50.624807] [INFO ] [MAIN ] Derivative Progress: 1254/1803 symbols completed. NXE took 1.4s. Estimated remaining: 3m 27s. Rate: 158.9 symbols/min [2025-10-15T22:40:50.642793] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:50.929766] [DEBUG] [LOCAL ] ODV: Loaded 28950 existing records from primary storage. [2025-10-15T22:40:50.931896] [INFO ] [MAIN ] ODV: Loaded 28950 primary data records. [2025-10-15T22:40:51.063161] [DEBUG] [MAIN ] OCFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:51.069982] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 7359 primary records. [2025-10-15T22:40:51.075305] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-15T22:40:51.289763] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-10-15T22:40:51.290130] [DEBUG] [MAIN ] ODC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:51.291178] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8543 primary records. [2025-10-15T22:40:51.290365] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-15T22:40:51.293609] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-15T22:40:51.293520] [INFO ] [MAIN ] Derivative Progress: 1255/1803 symbols completed. OCFT took 1.1s. Estimated remaining: 3m 27s. Rate: 158.8 symbols/min [2025-10-15T22:40:51.295681] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:51.320272] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-10-15T22:40:51.320528] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-15T22:40:51.323728] [INFO ] [MAIN ] Derivative Progress: 1256/1803 symbols completed. ODC took 1.0s. Estimated remaining: 3m 27s. Rate: 158.9 symbols/min [2025-10-15T22:40:51.323970] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:51.331010] [DEBUG] [LOCAL ] OIA: Loaded 13137 existing records from primary storage. [2025-10-15T22:40:51.331420] [INFO ] [MAIN ] OIA: Loaded 13137 primary data records. [2025-10-15T22:40:51.474341] [DEBUG] [MAIN ] ODV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:51.499777] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 28950 primary records. [2025-10-15T22:40:51.533596] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-15T22:40:51.572683] [DEBUG] [LOCAL ] OIS: Loaded 40031 existing records from primary storage. [2025-10-15T22:40:51.697819] [INFO ] [MAIN ] OIS: Loaded 40031 primary data records. [2025-10-15T22:40:51.833944] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-10-15T22:40:51.834689] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-15T22:40:51.837792] [INFO ] [MAIN ] Derivative Progress: 1257/1803 symbols completed. ODV took 1.2s. Estimated remaining: 3m 26s. Rate: 158.9 symbols/min [2025-10-15T22:40:51.853689] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:52.046430] [DEBUG] [LOCAL ] ONIT: Loaded 7657 existing records from primary storage. [2025-10-15T22:40:52.046628] [INFO ] [MAIN ] ONIT: Loaded 7657 primary data records. [2025-10-15T22:40:52.233215] [DEBUG] [MAIN ] OIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:52.250073] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13137 primary records. [2025-10-15T22:40:52.255430] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-15T22:40:52.400267] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-15T22:40:52.402073] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-15T22:40:52.406556] [INFO ] [MAIN ] Derivative Progress: 1258/1803 symbols completed. OIA took 1.1s. Estimated remaining: 3m 26s. Rate: 158.8 symbols/min [2025-10-15T22:40:52.421388] [DEBUG] [MAIN ] OIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:52.422288] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 40031 primary records. [2025-10-15T22:40:52.422389] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-15T22:40:52.440921] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-10-15T22:40:52.440998] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-15T22:40:52.443895] [INFO ] [MAIN ] Derivative Progress: 1259/1803 symbols completed. OIS took 1.1s. Estimated remaining: 3m 25s. Rate: 158.9 symbols/min [2025-10-15T22:40:52.458768] [DEBUG] [MAIN ] ONIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:52.459291] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7657 primary records. [2025-10-15T22:40:52.459353] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-15T22:40:52.473959] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-10-15T22:40:52.474021] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-15T22:40:52.476876] [INFO ] [MAIN ] Derivative Progress: 1260/1803 symbols completed. ONIT took 0.6s. Estimated remaining: 3m 25s. Rate: 159.1 symbols/min [2025-10-15T22:40:52.477443] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:52.477562] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:52.478111] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:52.516086] [DEBUG] [LOCAL ] ONTF: Loaded 22588 existing records from primary storage. [2025-10-15T22:40:52.524416] [INFO ] [MAIN ] ONTF: Loaded 22588 primary data records. [2025-10-15T22:40:52.525387] [DEBUG] [LOCAL ] ONL: Loaded 29572 existing records from primary storage. [2025-10-15T22:40:52.563864] [INFO ] [MAIN ] ONL: Loaded 29572 primary data records. [2025-10-15T22:40:52.564233] [DEBUG] [LOCAL ] OPAD: Loaded 25096 existing records from primary storage. [2025-10-15T22:40:52.569531] [INFO ] [MAIN ] OPAD: Loaded 25096 primary data records. [2025-10-15T22:40:53.449247] [DEBUG] [MAIN ] ONTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:53.450310] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22588 primary records. [2025-10-15T22:40:53.450506] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-15T22:40:53.479457] [DEBUG] [MAIN ] OPAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:53.483104] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 25096 primary records. [2025-10-15T22:40:53.485284] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-15T22:40:53.484633] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-10-15T22:40:53.485461] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-15T22:40:53.488009] [INFO ] [MAIN ] Derivative Progress: 1261/1803 symbols completed. ONTF took 1.0s. Estimated remaining: 3m 25s. Rate: 158.8 symbols/min [2025-10-15T22:40:53.488468] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:53.516843] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-10-15T22:40:53.515970] [DEBUG] [MAIN ] ONL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:53.517013] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-15T22:40:53.520509] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 29572 primary records. [2025-10-15T22:40:53.519758] [INFO ] [MAIN ] Derivative Progress: 1262/1803 symbols completed. OPAD took 1.0s. Estimated remaining: 3m 24s. Rate: 159.0 symbols/min [2025-10-15T22:40:53.520731] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-15T22:40:53.520873] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:53.542753] [DEBUG] [LOCAL ] OPP: Loaded 12199 existing records from primary storage. [2025-10-15T22:40:53.543361] [INFO ] [MAIN ] OPP: Loaded 12199 primary data records. [2025-10-15T22:40:53.643856] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-10-15T22:40:53.647138] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-15T22:40:53.650447] [INFO ] [MAIN ] Derivative Progress: 1263/1803 symbols completed. ONL took 1.2s. Estimated remaining: 3m 24s. Rate: 159.0 symbols/min [2025-10-15T22:40:53.650700] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:53.906962] [DEBUG] [LOCAL ] ORC: Loaded 52512 existing records from primary storage. [2025-10-15T22:40:53.907900] [INFO ] [MAIN ] ORC: Loaded 52512 primary data records. [2025-10-15T22:40:53.917986] [DEBUG] [LOCAL ] ORN: Loaded 30933 existing records from primary storage. [2025-10-15T22:40:53.930103] [INFO ] [MAIN ] ORN: Loaded 30933 primary data records. [2025-10-15T22:40:54.535584] [DEBUG] [MAIN ] OPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:54.536560] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 12199 primary records. [2025-10-15T22:40:54.537966] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-15T22:40:54.554293] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-15T22:40:54.555600] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-15T22:40:54.558070] [INFO ] [MAIN ] Derivative Progress: 1264/1803 symbols completed. OPP took 1.1s. Estimated remaining: 3m 24s. Rate: 158.9 symbols/min [2025-10-15T22:40:54.558329] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:54.578740] [DEBUG] [MAIN ] ORC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:54.584003] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52512 primary records. [2025-10-15T22:40:54.584116] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-15T22:40:54.584946] [DEBUG] [LOCAL ] OWLT: Loaded 9352 existing records from primary storage. [2025-10-15T22:40:54.586621] [INFO ] [MAIN ] OWLT: Loaded 9352 primary data records. [2025-10-15T22:40:54.642595] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-10-15T22:40:54.648132] [DEBUG] [MAIN ] ORN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:54.655149] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-15T22:40:54.669472] [INFO ] [MAIN ] Derivative Progress: 1265/1803 symbols completed. ORC took 1.1s. Estimated remaining: 3m 23s. Rate: 159.0 symbols/min [2025-10-15T22:40:54.688900] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:54.695132] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 30933 primary records. [2025-10-15T22:40:54.721163] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-15T22:40:54.821227] [DEBUG] [LOCAL ] PAC: Loaded 11713 existing records from primary storage. [2025-10-15T22:40:54.822104] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-10-15T22:40:54.822419] [INFO ] [MAIN ] PAC: Loaded 11713 primary data records. [2025-10-15T22:40:54.957415] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-15T22:40:55.012274] [INFO ] [MAIN ] Derivative Progress: 1266/1803 symbols completed. ORN took 1.4s. Estimated remaining: 3m 23s. Rate: 159.0 symbols/min [2025-10-15T22:40:55.035548] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:55.266802] [DEBUG] [LOCAL ] PACK: Loaded 31968 existing records from primary storage. [2025-10-15T22:40:55.267606] [INFO ] [MAIN ] PACK: Loaded 31968 primary data records. [2025-10-15T22:40:55.282386] [DEBUG] [MAIN ] OWLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:55.294491] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 9352 primary records. [2025-10-15T22:40:55.314455] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-15T22:40:55.384278] [DEBUG] [MAIN ] PAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:55.401424] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11713 primary records. [2025-10-15T22:40:55.408960] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-15T22:40:55.414913] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-10-15T22:40:55.437165] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-15T22:40:55.475681] [INFO ] [MAIN ] Derivative Progress: 1267/1803 symbols completed. OWLT took 0.9s. Estimated remaining: 3m 22s. Rate: 158.9 symbols/min [2025-10-15T22:40:55.501730] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:55.662264] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-10-15T22:40:55.661920] [DEBUG] [LOCAL ] PAI: Loaded 2732 existing records from primary storage. [2025-10-15T22:40:55.663375] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-15T22:40:55.665974] [INFO ] [MAIN ] Derivative Progress: 1268/1803 symbols completed. PAC took 1.0s. Estimated remaining: 3m 22s. Rate: 159.0 symbols/min [2025-10-15T22:40:55.663698] [INFO ] [MAIN ] PAI: Loaded 2732 primary data records. [2025-10-15T22:40:55.672022] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:55.848526] [DEBUG] [LOCAL ] PCF: Loaded 9040 existing records from primary storage. [2025-10-15T22:40:55.965311] [INFO ] [MAIN ] PCF: Loaded 9040 primary data records. [2025-10-15T22:40:56.165518] [DEBUG] [MAIN ] PACK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:56.279280] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31968 primary records. [2025-10-15T22:40:56.280074] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-15T22:40:56.303256] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-10-15T22:40:56.303543] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-15T22:40:56.318743] [INFO ] [MAIN ] Derivative Progress: 1269/1803 symbols completed. PACK took 1.3s. Estimated remaining: 3m 22s. Rate: 158.9 symbols/min [2025-10-15T22:40:56.319573] [DEBUG] [MAIN ] PAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:56.319964] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:56.321248] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2732 primary records. [2025-10-15T22:40:56.321584] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-15T22:40:56.342411] [DEBUG] [LOCAL ] PCM: Loaded 6810 existing records from primary storage. [2025-10-15T22:40:56.342214] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-15T22:40:56.342604] [INFO ] [MAIN ] PCM: Loaded 6810 primary data records. [2025-10-15T22:40:56.354017] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-15T22:40:56.365958] [INFO ] [MAIN ] Derivative Progress: 1270/1803 symbols completed. PAI took 0.9s. Estimated remaining: 3m 21s. Rate: 159.0 symbols/min [2025-10-15T22:40:56.381903] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:56.499236] [DEBUG] [MAIN ] PCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:56.513888] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 9040 primary records. [2025-10-15T22:40:56.499630] [DEBUG] [LOCAL ] PCQ: Loaded 12168 existing records from primary storage. [2025-10-15T22:40:56.553131] [INFO ] [MAIN ] PCQ: Loaded 12168 primary data records. [2025-10-15T22:40:56.548798] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-15T22:40:56.754726] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-15T22:40:56.771285] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-15T22:40:56.803225] [INFO ] [MAIN ] Derivative Progress: 1271/1803 symbols completed. PCF took 1.1s. Estimated remaining: 3m 21s. Rate: 159.0 symbols/min [2025-10-15T22:40:56.819546] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:57.030698] [DEBUG] [LOCAL ] PDS: Loaded 17227 existing records from primary storage. [2025-10-15T22:40:57.032041] [INFO ] [MAIN ] PDS: Loaded 17227 primary data records. [2025-10-15T22:40:57.032323] [DEBUG] [MAIN ] PCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:57.055620] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6810 primary records. [2025-10-15T22:40:57.066960] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-15T22:40:57.149844] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-15T22:40:57.153221] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-15T22:40:57.155439] [INFO ] [MAIN ] Derivative Progress: 1272/1803 symbols completed. PCM took 0.8s. Estimated remaining: 3m 20s. Rate: 159.0 symbols/min [2025-10-15T22:40:57.156093] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:57.410925] [DEBUG] [MAIN ] PCQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:57.411689] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12168 primary records. [2025-10-15T22:40:57.411820] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-15T22:40:57.431239] [DEBUG] [LOCAL ] PDT: Loaded 17557 existing records from primary storage. [2025-10-15T22:40:57.433187] [INFO ] [MAIN ] PDT: Loaded 17557 primary data records. [2025-10-15T22:40:57.545576] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-15T22:40:57.546094] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-15T22:40:57.549594] [INFO ] [MAIN ] Derivative Progress: 1273/1803 symbols completed. PCQ took 1.2s. Estimated remaining: 3m 20s. Rate: 159.0 symbols/min [2025-10-15T22:40:57.767508] [DEBUG] [MAIN ] PDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:57.768393] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 17227 primary records. [2025-10-15T22:40:57.769339] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-15T22:40:57.788020] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-10-15T22:40:57.788116] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-15T22:40:57.790537] [INFO ] [MAIN ] Derivative Progress: 1274/1803 symbols completed. PDS took 1.0s. Estimated remaining: 3m 20s. Rate: 159.0 symbols/min [2025-10-15T22:40:57.808616] [DEBUG] [MAIN ] PDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:57.809264] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17557 primary records. [2025-10-15T22:40:57.809325] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-15T22:40:57.824223] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-15T22:40:57.824280] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-15T22:40:57.826719] [INFO ] [MAIN ] Derivative Progress: 1275/1803 symbols completed. PDT took 0.7s. Estimated remaining: 3m 19s. Rate: 159.2 symbols/min [2025-10-15T22:40:57.827097] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:57.827281] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:57.827167] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:57.843111] [DEBUG] [LOCAL ] PFD: Loaded 5425 existing records from primary storage. [2025-10-15T22:40:57.843285] [INFO ] [MAIN ] PFD: Loaded 5425 primary data records. [2025-10-15T22:40:57.922258] [DEBUG] [LOCAL ] PERF: Loaded 14391 existing records from primary storage. [2025-10-15T22:40:57.916754] [DEBUG] [LOCAL ] PEO: Loaded 11154 existing records from primary storage. [2025-10-15T22:40:57.929057] [INFO ] [MAIN ] PERF: Loaded 14391 primary data records. [2025-10-15T22:40:57.934321] [INFO ] [MAIN ] PEO: Loaded 11154 primary data records. [2025-10-15T22:40:58.797257] [DEBUG] [MAIN ] PFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:58.799569] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5425 primary records. [2025-10-15T22:40:58.801203] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-15T22:40:58.839181] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-10-15T22:40:58.839817] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-15T22:40:58.841108] [DEBUG] [MAIN ] PERF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:58.843795] [INFO ] [MAIN ] Derivative Progress: 1276/1803 symbols completed. PFD took 1.0s. Estimated remaining: 3m 19s. Rate: 158.9 symbols/min [2025-10-15T22:40:58.845896] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14391 primary records. [2025-10-15T22:40:58.847165] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-15T22:40:58.846941] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:58.874729] [DEBUG] [MAIN ] PEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:58.876112] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11154 primary records. [2025-10-15T22:40:58.876810] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-15T22:40:58.899513] [DEBUG] [LOCAL ] PFH: Loaded 6595 existing records from primary storage. [2025-10-15T22:40:58.902263] [INFO ] [MAIN ] PFH: Loaded 6595 primary data records. [2025-10-15T22:40:58.952936] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-15T22:40:58.979948] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-10-15T22:40:58.996913] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-15T22:40:58.996725] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-15T22:40:59.020376] [INFO ] [MAIN ] Derivative Progress: 1277/1803 symbols completed. PERF took 1.2s. Estimated remaining: 3m 18s. Rate: 159.0 symbols/min [2025-10-15T22:40:59.025612] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:59.025763] [INFO ] [MAIN ] Derivative Progress: 1278/1803 symbols completed. PEO took 1.2s. Estimated remaining: 3m 18s. Rate: 159.1 symbols/min [2025-10-15T22:40:59.047866] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:59.234910] [DEBUG] [LOCAL ] PFL: Loaded 14344 existing records from primary storage. [2025-10-15T22:40:59.235840] [INFO ] [MAIN ] PFL: Loaded 14344 primary data records. [2025-10-15T22:40:59.324544] [DEBUG] [LOCAL ] PFN: Loaded 22372 existing records from primary storage. [2025-10-15T22:40:59.335253] [INFO ] [MAIN ] PFN: Loaded 22372 primary data records. [2025-10-15T22:40:59.919773] [DEBUG] [MAIN ] PFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:59.920489] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6595 primary records. [2025-10-15T22:40:59.920685] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-15T22:40:59.939707] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-10-15T22:40:59.940039] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-15T22:40:59.944892] [INFO ] [MAIN ] Derivative Progress: 1279/1803 symbols completed. PFH took 1.1s. Estimated remaining: 3m 18s. Rate: 159.0 symbols/min [2025-10-15T22:40:59.945383] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:40:59.959398] [DEBUG] [MAIN ] PFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:40:59.960348] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 14344 primary records. [2025-10-15T22:40:59.960666] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-15T22:40:59.977667] [DEBUG] [LOCAL ] PFO: Loaded 6104 existing records from primary storage. [2025-10-15T22:40:59.981725] [INFO ] [MAIN ] PFO: Loaded 6104 primary data records. [2025-10-15T22:40:59.981862] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-15T22:40:59.993089] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-15T22:41:00.015920] [INFO ] [MAIN ] Derivative Progress: 1280/1803 symbols completed. PFL took 1.0s. Estimated remaining: 3m 17s. Rate: 159.1 symbols/min [2025-10-15T22:41:00.040181] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:00.113920] [DEBUG] [MAIN ] PFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:00.130252] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22372 primary records. [2025-10-15T22:41:00.143695] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-15T22:41:00.181840] [DEBUG] [LOCAL ] PGP: Loaded 5700 existing records from primary storage. [2025-10-15T22:41:00.185936] [INFO ] [MAIN ] PGP: Loaded 5700 primary data records. [2025-10-15T22:41:00.398595] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-15T22:41:00.412975] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-15T22:41:00.427400] [INFO ] [MAIN ] Derivative Progress: 1281/1803 symbols completed. PFN took 1.4s. Estimated remaining: 3m 17s. Rate: 159.0 symbols/min [2025-10-15T22:41:00.439569] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:00.669827] [DEBUG] [MAIN ] PFO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:00.670879] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6104 primary records. [2025-10-15T22:41:00.671196] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-15T22:41:00.689213] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-15T22:41:00.705310] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-15T22:41:00.708784] [INFO ] [MAIN ] Derivative Progress: 1282/1803 symbols completed. PFO took 0.8s. Estimated remaining: 3m 17s. Rate: 159.1 symbols/min [2025-10-15T22:41:00.710260] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:00.709997] [DEBUG] [LOCAL ] PGRE: Loaded 47027 existing records from primary storage. [2025-10-15T22:41:00.723058] [INFO ] [MAIN ] PGRE: Loaded 47027 primary data records. [2025-10-15T22:41:00.735668] [DEBUG] [MAIN ] PGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:00.758176] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5700 primary records. [2025-10-15T22:41:00.797234] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-15T22:41:00.855181] [DEBUG] [LOCAL ] PGZ: Loaded 5522 existing records from primary storage. [2025-10-15T22:41:00.869014] [INFO ] [MAIN ] PGZ: Loaded 5522 primary data records. [2025-10-15T22:41:01.142474] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-15T22:41:01.159000] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-15T22:41:01.162400] [INFO ] [MAIN ] Derivative Progress: 1283/1803 symbols completed. PGP took 1.1s. Estimated remaining: 3m 16s. Rate: 159.0 symbols/min [2025-10-15T22:41:01.168575] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:01.434503] [DEBUG] [MAIN ] PGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:01.443822] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 47027 primary records. [2025-10-15T22:41:01.444088] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-15T22:41:01.445736] [DEBUG] [LOCAL ] PHK: Loaded 26718 existing records from primary storage. [2025-10-15T22:41:01.445945] [INFO ] [MAIN ] PHK: Loaded 26718 primary data records. [2025-10-15T22:41:01.506424] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-10-15T22:41:01.518947] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-15T22:41:01.529974] [INFO ] [MAIN ] Derivative Progress: 1284/1803 symbols completed. PGRE took 1.1s. Estimated remaining: 3m 16s. Rate: 159.1 symbols/min [2025-10-15T22:41:01.552285] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:01.582498] [DEBUG] [MAIN ] PGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:01.600802] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5522 primary records. [2025-10-15T22:41:01.606079] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-15T22:41:01.672470] [DEBUG] [LOCAL ] PIM: Loaded 4822 existing records from primary storage. [2025-10-15T22:41:01.792738] [INFO ] [MAIN ] PIM: Loaded 4822 primary data records. [2025-10-15T22:41:01.887639] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-15T22:41:01.904677] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-15T22:41:01.918206] [INFO ] [MAIN ] Derivative Progress: 1285/1803 symbols completed. PGZ took 1.2s. Estimated remaining: 3m 15s. Rate: 159.0 symbols/min [2025-10-15T22:41:01.986746] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:02.160069] [DEBUG] [LOCAL ] PINE: Loaded 14395 existing records from primary storage. [2025-10-15T22:41:02.160542] [INFO ] [MAIN ] PINE: Loaded 14395 primary data records. [2025-10-15T22:41:02.161007] [DEBUG] [MAIN ] PHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:02.163736] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26718 primary records. [2025-10-15T22:41:02.196142] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-15T22:41:02.500031] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-15T22:41:02.513406] [DEBUG] [MAIN ] PIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:02.513100] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-15T22:41:02.514234] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4822 primary records. [2025-10-15T22:41:02.517254] [INFO ] [MAIN ] Derivative Progress: 1286/1803 symbols completed. PHK took 1.3s. Estimated remaining: 3m 15s. Rate: 159.0 symbols/min [2025-10-15T22:41:02.517696] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-15T22:41:02.519599] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:02.537692] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-15T22:41:02.543413] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-15T22:41:02.546392] [INFO ] [MAIN ] Derivative Progress: 1287/1803 symbols completed. PIM took 1.0s. Estimated remaining: 3m 15s. Rate: 159.1 symbols/min [2025-10-15T22:41:02.546770] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:02.554312] [DEBUG] [LOCAL ] PKE: Loaded 14099 existing records from primary storage. [2025-10-15T22:41:02.554515] [INFO ] [MAIN ] PKE: Loaded 14099 primary data records. [2025-10-15T22:41:02.721498] [DEBUG] [LOCAL ] PML: Loaded 21800 existing records from primary storage. [2025-10-15T22:41:02.730067] [DEBUG] [MAIN ] PINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:02.755243] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14395 primary records. [2025-10-15T22:41:02.755369] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-15T22:41:02.753486] [INFO ] [MAIN ] PML: Loaded 21800 primary data records. [2025-10-15T22:41:02.994108] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-10-15T22:41:03.013311] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-15T22:41:03.045206] [INFO ] [MAIN ] Derivative Progress: 1288/1803 symbols completed. PINE took 1.1s. Estimated remaining: 3m 14s. Rate: 159.1 symbols/min [2025-10-15T22:41:03.257870] [DEBUG] [MAIN ] PKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:03.259098] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 14099 primary records. [2025-10-15T22:41:03.259372] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-15T22:41:03.277311] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-10-15T22:41:03.277375] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-15T22:41:03.279797] [INFO ] [MAIN ] Derivative Progress: 1289/1803 symbols completed. PKE took 0.8s. Estimated remaining: 3m 14s. Rate: 159.1 symbols/min [2025-10-15T22:41:03.296509] [DEBUG] [MAIN ] PML: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:03.297148] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21800 primary records. [2025-10-15T22:41:03.297212] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-15T22:41:03.312591] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-15T22:41:03.312676] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-15T22:41:03.315342] [INFO ] [MAIN ] Derivative Progress: 1290/1803 symbols completed. PML took 0.8s. Estimated remaining: 3m 13s. Rate: 159.2 symbols/min [2025-10-15T22:41:03.315889] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:03.315824] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:03.316458] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:03.328386] [DEBUG] [LOCAL ] PNI: Loaded 6782 existing records from primary storage. [2025-10-15T22:41:03.331928] [INFO ] [MAIN ] PNI: Loaded 6782 primary data records. [2025-10-15T22:41:03.347315] [DEBUG] [LOCAL ] PMO: Loaded 9887 existing records from primary storage. [2025-10-15T22:41:03.366808] [INFO ] [MAIN ] PMO: Loaded 9887 primary data records. [2025-10-15T22:41:03.450799] [DEBUG] [LOCAL ] PMM: Loaded 10233 existing records from primary storage. [2025-10-15T22:41:03.487712] [INFO ] [MAIN ] PMM: Loaded 10233 primary data records. [2025-10-15T22:41:04.242757] [DEBUG] [MAIN ] PNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:04.243940] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6782 primary records. [2025-10-15T22:41:04.244306] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-15T22:41:04.264498] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-15T22:41:04.264951] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-15T22:41:04.267480] [INFO ] [MAIN ] Derivative Progress: 1291/1803 symbols completed. PNI took 1.0s. Estimated remaining: 3m 13s. Rate: 159.0 symbols/min [2025-10-15T22:41:04.267933] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:04.293868] [DEBUG] [MAIN ] PMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:04.294242] [DEBUG] [MAIN ] PMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:04.295178] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10233 primary records. [2025-10-15T22:41:04.295269] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-15T22:41:04.296126] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 9887 primary records. [2025-10-15T22:41:04.296797] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-15T22:41:04.323419] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-15T22:41:04.323905] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-15T22:41:04.329564] [INFO ] [MAIN ] Derivative Progress: 1292/1803 symbols completed. PMM took 1.0s. Estimated remaining: 3m 13s. Rate: 159.1 symbols/min [2025-10-15T22:41:04.330027] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:04.342213] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-15T22:41:04.342378] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-15T22:41:04.344799] [INFO ] [MAIN ] Derivative Progress: 1293/1803 symbols completed. PMO took 1.0s. Estimated remaining: 3m 12s. Rate: 159.2 symbols/min [2025-10-15T22:41:04.345020] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:04.362233] [DEBUG] [LOCAL ] PNNT: Loaded 33478 existing records from primary storage. [2025-10-15T22:41:04.362471] [INFO ] [MAIN ] PNNT: Loaded 33478 primary data records. [2025-10-15T22:41:04.425833] [DEBUG] [LOCAL ] PRCS: Loaded 2781 existing records from primary storage. [2025-10-15T22:41:04.445826] [INFO ] [MAIN ] PRCS: Loaded 2781 primary data records. [2025-10-15T22:41:04.451317] [DEBUG] [LOCAL ] PPT: Loaded 19872 existing records from primary storage. [2025-10-15T22:41:04.462003] [INFO ] [MAIN ] PPT: Loaded 19872 primary data records. [2025-10-15T22:41:05.364092] [DEBUG] [MAIN ] PNNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:05.364749] [DEBUG] [MAIN ] PPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:05.367985] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19872 primary records. [2025-10-15T22:41:05.367151] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 33478 primary records. [2025-10-15T22:41:05.368984] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-15T22:41:05.369052] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-15T22:41:05.397579] [DEBUG] [MAIN ] PRCS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:41:05.399575] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2781 primary records. [2025-10-15T22:41:05.406351] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-15T22:41:05.414098] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-10-15T22:41:05.415476] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-15T22:41:05.423187] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-15T22:41:05.429788] [INFO ] [MAIN ] Derivative Progress: 1294/1803 symbols completed. PNNT took 1.2s. Estimated remaining: 3m 12s. Rate: 159.0 symbols/min [2025-10-15T22:41:05.430788] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:05.430952] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-15T22:41:05.434133] [INFO ] [MAIN ] Derivative Progress: 1295/1803 symbols completed. PPT took 1.1s. Estimated remaining: 3m 12s. Rate: 159.1 symbols/min [2025-10-15T22:41:05.436823] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-15T22:41:05.436153] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:05.437527] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-15T22:41:05.440544] [INFO ] [MAIN ] Derivative Progress: 1296/1803 symbols completed. PRCS took 1.1s. Estimated remaining: 3m 11s. Rate: 159.3 symbols/min [2025-10-15T22:41:05.442065] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:05.447319] [DEBUG] [LOCAL ] PRH: Loaded 4757 existing records from primary storage. [2025-10-15T22:41:05.447437] [INFO ] [MAIN ] PRH: Loaded 4757 primary data records. [2025-10-15T22:41:05.507401] [DEBUG] [LOCAL ] PRT: Loaded 5170 existing records from primary storage. [2025-10-15T22:41:05.527705] [INFO ] [MAIN ] PRT: Loaded 5170 primary data records. [2025-10-15T22:41:05.566514] [DEBUG] [LOCAL ] PSBD: Loaded 7956 existing records from primary storage. [2025-10-15T22:41:05.581837] [INFO ] [MAIN ] PSBD: Loaded 7956 primary data records. [2025-10-15T22:41:06.442836] [DEBUG] [MAIN ] PRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:06.443705] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4757 primary records. [2025-10-15T22:41:06.443803] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-15T22:41:06.476680] [DEBUG] [MAIN ] PSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:06.491845] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-10-15T22:41:06.486000] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 7956 primary records. [2025-10-15T22:41:06.492313] [DEBUG] [MAIN ] PRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:06.492715] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-15T22:41:06.492550] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-15T22:41:06.493467] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5170 primary records. [2025-10-15T22:41:06.496838] [INFO ] [MAIN ] Derivative Progress: 1297/1803 symbols completed. PRH took 1.1s. Estimated remaining: 3m 11s. Rate: 159.0 symbols/min [2025-10-15T22:41:06.497360] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:06.496928] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-15T22:41:06.526355] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-10-15T22:41:06.530350] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-10-15T22:41:06.530627] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-15T22:41:06.530510] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-15T22:41:06.533634] [INFO ] [MAIN ] Derivative Progress: 1298/1803 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 10s. Rate: 159.1 symbols/min [2025-10-15T22:41:06.536675] [INFO ] [MAIN ] Derivative Progress: 1299/1803 symbols completed. PRT took 1.1s. Estimated remaining: 3m 10s. Rate: 159.3 symbols/min [2025-10-15T22:41:06.536511] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:06.536906] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:06.541446] [DEBUG] [LOCAL ] PSF: Loaded 6982 existing records from primary storage. [2025-10-15T22:41:06.541567] [INFO ] [MAIN ] PSF: Loaded 6982 primary data records. [2025-10-15T22:41:06.654926] [DEBUG] [LOCAL ] PVL: Loaded 4725 existing records from primary storage. [2025-10-15T22:41:06.660698] [INFO ] [MAIN ] PVL: Loaded 4725 primary data records. [2025-10-15T22:41:07.017890] [DEBUG] [LOCAL ] PSQH: Loaded 35505 existing records from primary storage. [2025-10-15T22:41:07.042834] [INFO ] [MAIN ] PSQH: Loaded 35505 primary data records. [2025-10-15T22:41:07.523840] [DEBUG] [MAIN ] PSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:07.525370] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6982 primary records. [2025-10-15T22:41:07.525747] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-15T22:41:07.543319] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-15T22:41:07.543520] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-15T22:41:07.547421] [INFO ] [MAIN ] Derivative Progress: 1300/1803 symbols completed. PSF took 1.1s. Estimated remaining: 3m 10s. Rate: 159.1 symbols/min [2025-10-15T22:41:07.549937] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:07.564394] [DEBUG] [MAIN ] PVL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:07.565594] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4725 primary records. [2025-10-15T22:41:07.565900] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-15T22:41:07.595558] [DEBUG] [MAIN ] PSQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:07.597508] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 35505 primary records. [2025-10-15T22:41:07.597593] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-15T22:41:07.596697] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-10-15T22:41:07.597825] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-15T22:41:07.601839] [INFO ] [MAIN ] Derivative Progress: 1301/1803 symbols completed. PVL took 1.1s. Estimated remaining: 3m 9s. Rate: 159.2 symbols/min [2025-10-15T22:41:07.602300] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:07.634498] [DEBUG] [LOCAL ] QD: Loaded 27493 existing records from primary storage. [2025-10-15T22:41:07.635144] [INFO ] [MAIN ] QD: Loaded 27493 primary data records. [2025-10-15T22:41:07.656836] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-10-15T22:41:07.700170] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-15T22:41:07.724820] [INFO ] [MAIN ] Derivative Progress: 1302/1803 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 9s. Rate: 159.2 symbols/min [2025-10-15T22:41:07.736162] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:07.766324] [DEBUG] [LOCAL ] QUAD: Loaded 23361 existing records from primary storage. [2025-10-15T22:41:07.766733] [INFO ] [MAIN ] QUAD: Loaded 23361 primary data records. [2025-10-15T22:41:08.053070] [DEBUG] [LOCAL ] QVCD: Loaded 4697 existing records from primary storage. [2025-10-15T22:41:08.066917] [INFO ] [MAIN ] QVCD: Loaded 4697 primary data records. [2025-10-15T22:41:08.594712] [DEBUG] [MAIN ] QD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:08.595781] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27493 primary records. [2025-10-15T22:41:08.595880] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-15T22:41:08.627749] [DEBUG] [MAIN ] QUAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:08.628625] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23361 primary records. [2025-10-15T22:41:08.627884] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-10-15T22:41:08.628841] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-15T22:41:08.629735] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-15T22:41:08.632358] [INFO ] [MAIN ] Derivative Progress: 1303/1803 symbols completed. QD took 1.1s. Estimated remaining: 3m 9s. Rate: 159.1 symbols/min [2025-10-15T22:41:08.660630] [DEBUG] [MAIN ] QVCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:08.662080] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4697 primary records. [2025-10-15T22:41:08.662367] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-15T22:41:08.663362] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-10-15T22:41:08.663677] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-15T22:41:08.666170] [INFO ] [MAIN ] Derivative Progress: 1304/1803 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 8s. Rate: 159.2 symbols/min [2025-10-15T22:41:08.679429] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-10-15T22:41:08.679491] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-15T22:41:08.682377] [INFO ] [MAIN ] Derivative Progress: 1305/1803 symbols completed. QVCD took 0.9s. Estimated remaining: 3m 8s. Rate: 159.3 symbols/min [2025-10-15T22:41:08.682848] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:08.682935] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:08.682793] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:08.691202] [DEBUG] [LOCAL ] RBOT: Loaded 6064 existing records from primary storage. [2025-10-15T22:41:08.691437] [INFO ] [MAIN ] RBOT: Loaded 6064 primary data records. [2025-10-15T22:41:08.807308] [DEBUG] [LOCAL ] RCS: Loaded 12292 existing records from primary storage. [2025-10-15T22:41:08.823353] [INFO ] [MAIN ] RCS: Loaded 12292 primary data records. [2025-10-15T22:41:09.105177] [DEBUG] [LOCAL ] RC: Loaded 48911 existing records from primary storage. [2025-10-15T22:41:09.163504] [INFO ] [MAIN ] RC: Loaded 48911 primary data records. [2025-10-15T22:41:09.673882] [DEBUG] [MAIN ] RBOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:09.677731] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 6064 primary records. [2025-10-15T22:41:09.678061] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-15T22:41:09.691454] [DEBUG] [MAIN ] RCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:09.692222] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 12292 primary records. [2025-10-15T22:41:09.698496] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-15T22:41:09.722762] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-15T22:41:09.723676] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-15T22:41:09.726779] [INFO ] [MAIN ] Derivative Progress: 1306/1803 symbols completed. RCS took 1.0s. Estimated remaining: 3m 7s. Rate: 159.1 symbols/min [2025-10-15T22:41:09.724074] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-10-15T22:41:09.726936] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:09.727020] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-15T22:41:09.729967] [INFO ] [MAIN ] Derivative Progress: 1307/1803 symbols completed. RBOT took 1.0s. Estimated remaining: 3m 7s. Rate: 159.2 symbols/min [2025-10-15T22:41:09.730170] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:09.743519] [DEBUG] [MAIN ] RC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:09.744221] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48911 primary records. [2025-10-15T22:41:09.744282] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-15T22:41:09.764200] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-10-15T22:41:09.764394] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-15T22:41:09.767337] [INFO ] [MAIN ] Derivative Progress: 1308/1803 symbols completed. RC took 1.1s. Estimated remaining: 3m 6s. Rate: 159.3 symbols/min [2025-10-15T22:41:09.767553] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:09.791475] [DEBUG] [LOCAL ] RFI: Loaded 10434 existing records from primary storage. [2025-10-15T22:41:09.791714] [INFO ] [MAIN ] RFI: Loaded 10434 primary data records. [2025-10-15T22:41:09.914723] [DEBUG] [LOCAL ] RERE: Loaded 41543 existing records from primary storage. [2025-10-15T22:41:09.931480] [INFO ] [MAIN ] RERE: Loaded 41543 primary data records. [2025-10-15T22:41:10.164076] [DEBUG] [LOCAL ] RES: Loaded 46957 existing records from primary storage. [2025-10-15T22:41:10.198458] [INFO ] [MAIN ] RES: Loaded 46957 primary data records. [2025-10-15T22:41:10.743067] [DEBUG] [MAIN ] RFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:10.744556] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10434 primary records. [2025-10-15T22:41:10.745020] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-15T22:41:10.769828] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-15T22:41:10.770381] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-15T22:41:10.783050] [DEBUG] [MAIN ] RERE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:10.786929] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41543 primary records. [2025-10-15T22:41:10.785862] [INFO ] [MAIN ] Derivative Progress: 1309/1803 symbols completed. RFI took 1.0s. Estimated remaining: 3m 6s. Rate: 159.1 symbols/min [2025-10-15T22:41:10.787410] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-15T22:41:10.787344] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:10.812632] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-10-15T22:41:10.813167] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-15T22:41:10.815754] [INFO ] [MAIN ] Derivative Progress: 1310/1803 symbols completed. RERE took 1.1s. Estimated remaining: 3m 6s. Rate: 159.2 symbols/min [2025-10-15T22:41:10.816104] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:10.834454] [DEBUG] [MAIN ] RES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:10.835474] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 46957 primary records. [2025-10-15T22:41:10.835670] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-15T22:41:10.844863] [DEBUG] [LOCAL ] RFL: Loaded 11445 existing records from primary storage. [2025-10-15T22:41:10.844318] [DEBUG] [LOCAL ] RFM: Loaded 4156 existing records from primary storage. [2025-10-15T22:41:10.851939] [INFO ] [MAIN ] RFL: Loaded 11445 primary data records. [2025-10-15T22:41:10.855557] [INFO ] [MAIN ] RFM: Loaded 4156 primary data records. [2025-10-15T22:41:11.094025] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-10-15T22:41:11.124550] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-15T22:41:11.127882] [INFO ] [MAIN ] Derivative Progress: 1311/1803 symbols completed. RES took 1.4s. Estimated remaining: 3m 5s. Rate: 159.2 symbols/min [2025-10-15T22:41:11.136738] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:11.503203] [DEBUG] [LOCAL ] RFMZ: Loaded 8716 existing records from primary storage. [2025-10-15T22:41:11.503799] [INFO ] [MAIN ] RFMZ: Loaded 8716 primary data records. [2025-10-15T22:41:11.829257] [DEBUG] [MAIN ] RFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:11.830888] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11445 primary records. [2025-10-15T22:41:11.843632] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-15T22:41:11.853019] [DEBUG] [MAIN ] RFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:11.861180] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4156 primary records. [2025-10-15T22:41:11.865101] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-15T22:41:11.870403] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-10-15T22:41:11.870810] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-15T22:41:11.879805] [INFO ] [MAIN ] Derivative Progress: 1312/1803 symbols completed. RFL took 1.1s. Estimated remaining: 3m 5s. Rate: 159.1 symbols/min [2025-10-15T22:41:11.881487] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:11.890773] [DEBUG] [LOCAL ] RGT: Loaded 2747 existing records from primary storage. [2025-10-15T22:41:11.891842] [INFO ] [MAIN ] RGT: Loaded 2747 primary data records. [2025-10-15T22:41:11.967528] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-10-15T22:41:12.012190] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-15T22:41:12.012775] [DEBUG] [MAIN ] RFMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:12.030318] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8716 primary records. [2025-10-15T22:41:12.040694] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-15T22:41:12.025053] [INFO ] [MAIN ] Derivative Progress: 1313/1803 symbols completed. RFM took 1.2s. Estimated remaining: 3m 5s. Rate: 159.2 symbols/min [2025-10-15T22:41:12.046333] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:12.235575] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-10-15T22:41:12.236002] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-15T22:41:12.239176] [INFO ] [MAIN ] Derivative Progress: 1314/1803 symbols completed. RFMZ took 1.1s. Estimated remaining: 3m 4s. Rate: 159.2 symbols/min [2025-10-15T22:41:12.239486] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:12.256952] [DEBUG] [LOCAL ] RLTY: Loaded 11163 existing records from primary storage. [2025-10-15T22:41:12.257358] [INFO ] [MAIN ] RLTY: Loaded 11163 primary data records. [2025-10-15T22:41:12.370762] [DEBUG] [MAIN ] RGT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:41:12.403189] [INFO ] [MAIN ] RGT: Generated 1793 derivative records from 2747 primary records. [2025-10-15T22:41:12.403462] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-15T22:41:12.416053] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-15T22:41:12.453999] [INFO ] [MAIN ] RIG: Loaded 53675 primary data records. [2025-10-15T22:41:12.669412] [DEBUG] [LOCAL ] RGT: Derivative data saved (1793 records). [2025-10-15T22:41:12.701262] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-15T22:41:12.717250] [INFO ] [MAIN ] Derivative Progress: 1315/1803 symbols completed. RGT took 0.8s. Estimated remaining: 3m 4s. Rate: 159.2 symbols/min [2025-10-15T22:41:12.721109] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:12.995875] [DEBUG] [MAIN ] RLTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:12.996712] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11163 primary records. [2025-10-15T22:41:12.997001] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-15T22:41:13.014225] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-10-15T22:41:13.017021] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-15T22:41:13.031784] [INFO ] [MAIN ] Derivative Progress: 1316/1803 symbols completed. RLTY took 0.8s. Estimated remaining: 3m 4s. Rate: 159.2 symbols/min [2025-10-15T22:41:13.033232] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:13.046881] [DEBUG] [LOCAL ] RLX: Loaded 48146 existing records from primary storage. [2025-10-15T22:41:13.047081] [INFO ] [MAIN ] RLX: Loaded 48146 primary data records. [2025-10-15T22:41:13.047958] [DEBUG] [MAIN ] RIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:13.079367] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53675 primary records. [2025-10-15T22:41:13.097366] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-15T22:41:13.181248] [DEBUG] [LOCAL ] RM: Loaded 7558 existing records from primary storage. [2025-10-15T22:41:13.186390] [INFO ] [MAIN ] RM: Loaded 7558 primary data records. [2025-10-15T22:41:13.203835] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-10-15T22:41:13.220371] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-15T22:41:13.223277] [INFO ] [MAIN ] Derivative Progress: 1317/1803 symbols completed. RIG took 1.2s. Estimated remaining: 3m 3s. Rate: 159.3 symbols/min [2025-10-15T22:41:13.233260] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:13.678772] [DEBUG] [LOCAL ] RMT: Loaded 17509 existing records from primary storage. [2025-10-15T22:41:13.692946] [INFO ] [MAIN ] RMT: Loaded 17509 primary data records. [2025-10-15T22:41:14.027296] [DEBUG] [MAIN ] RLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:14.028268] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48146 primary records. [2025-10-15T22:41:14.028555] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-15T22:41:14.047162] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-10-15T22:41:14.048697] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-15T22:41:14.051068] [INFO ] [MAIN ] Derivative Progress: 1318/1803 symbols completed. RLX took 1.3s. Estimated remaining: 3m 3s. Rate: 159.1 symbols/min [2025-10-15T22:41:14.068255] [DEBUG] [MAIN ] RM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:14.069163] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7558 primary records. [2025-10-15T22:41:14.069421] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-15T22:41:14.084702] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-10-15T22:41:14.084868] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-15T22:41:14.087151] [INFO ] [MAIN ] Derivative Progress: 1319/1803 symbols completed. RM took 1.1s. Estimated remaining: 3m 2s. Rate: 159.3 symbols/min [2025-10-15T22:41:14.101842] [DEBUG] [MAIN ] RMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:14.102352] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17509 primary records. [2025-10-15T22:41:14.102409] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-15T22:41:14.116822] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-15T22:41:14.116880] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-15T22:41:14.119624] [INFO ] [MAIN ] Derivative Progress: 1320/1803 symbols completed. RMT took 0.9s. Estimated remaining: 3m 2s. Rate: 159.4 symbols/min [2025-10-15T22:41:14.120181] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:14.120083] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:14.120280] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:14.127748] [DEBUG] [LOCAL ] RSF: Loaded 4330 existing records from primary storage. [2025-10-15T22:41:14.128008] [INFO ] [MAIN ] RSF: Loaded 4330 primary data records. [2025-10-15T22:41:14.243355] [DEBUG] [LOCAL ] RPT: Loaded 19093 existing records from primary storage. [2025-10-15T22:41:14.255226] [DEBUG] [LOCAL ] RNP: Loaded 16190 existing records from primary storage. [2025-10-15T22:41:14.255332] [INFO ] [MAIN ] RPT: Loaded 19093 primary data records. [2025-10-15T22:41:14.270935] [INFO ] [MAIN ] RNP: Loaded 16190 primary data records. [2025-10-15T22:41:15.115144] [DEBUG] [MAIN ] RSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:15.116127] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4330 primary records. [2025-10-15T22:41:15.116815] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-15T22:41:15.132490] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-15T22:41:15.132735] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-15T22:41:15.135237] [INFO ] [MAIN ] Derivative Progress: 1321/1803 symbols completed. RSF took 1.0s. Estimated remaining: 3m 2s. Rate: 159.2 symbols/min [2025-10-15T22:41:15.135418] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:15.168779] [DEBUG] [MAIN ] RNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:15.170109] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 16190 primary records. [2025-10-15T22:41:15.170554] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-15T22:41:15.170408] [DEBUG] [MAIN ] RPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:15.172169] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19093 primary records. [2025-10-15T22:41:15.172582] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-15T22:41:15.211427] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-15T22:41:15.209496] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-10-15T22:41:15.211767] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-15T22:41:15.211693] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-15T22:41:15.214672] [INFO ] [MAIN ] Derivative Progress: 1322/1803 symbols completed. RPT took 1.1s. Estimated remaining: 3m 1s. Rate: 159.3 symbols/min [2025-10-15T22:41:15.217547] [INFO ] [MAIN ] Derivative Progress: 1323/1803 symbols completed. RNP took 1.1s. Estimated remaining: 3m 1s. Rate: 159.4 symbols/min [2025-10-15T22:41:15.217781] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:15.217460] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:15.230983] [DEBUG] [LOCAL ] RSKD: Loaded 33461 existing records from primary storage. [2025-10-15T22:41:15.231144] [INFO ] [MAIN ] RSKD: Loaded 33461 primary data records. [2025-10-15T22:41:15.556832] [DEBUG] [LOCAL ] RWT: Loaded 40745 existing records from primary storage. [2025-10-15T22:41:15.557897] [INFO ] [MAIN ] RWT: Loaded 40745 primary data records. [2025-10-15T22:41:15.676094] [DEBUG] [LOCAL ] S: Loaded 53536 existing records from primary storage. [2025-10-15T22:41:15.677512] [INFO ] [MAIN ] S: Loaded 53536 primary data records. [2025-10-15T22:41:16.191555] [DEBUG] [MAIN ] RSKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:16.192490] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33461 primary records. [2025-10-15T22:41:16.192615] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-15T22:41:16.211677] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-10-15T22:41:16.211974] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-15T22:41:16.214675] [INFO ] [MAIN ] Derivative Progress: 1324/1803 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 1s. Rate: 159.2 symbols/min [2025-10-15T22:41:16.214943] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:16.234368] [DEBUG] [MAIN ] RWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:16.235207] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40745 primary records. [2025-10-15T22:41:16.235397] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-15T22:41:16.252348] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-15T22:41:16.253405] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-15T22:41:16.255350] [INFO ] [MAIN ] Derivative Progress: 1325/1803 symbols completed. RWT took 1.0s. Estimated remaining: 3m 0s. Rate: 159.3 symbols/min [2025-10-15T22:41:16.256553] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:16.270299] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:16.271049] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53536 primary records. [2025-10-15T22:41:16.271315] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-15T22:41:16.302683] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-15T22:41:16.302767] [DEBUG] [LOCAL ] SABA: Loaded 9309 existing records from primary storage. [2025-10-15T22:41:16.302935] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-15T22:41:16.303023] [INFO ] [MAIN ] SABA: Loaded 9309 primary data records. [2025-10-15T22:41:16.306026] [INFO ] [MAIN ] Derivative Progress: 1326/1803 symbols completed. S took 1.1s. Estimated remaining: 2m 60s. Rate: 159.4 symbols/min [2025-10-15T22:41:16.306193] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:16.436797] [DEBUG] [LOCAL ] SA: Loaded 44342 existing records from primary storage. [2025-10-15T22:41:16.470598] [INFO ] [MAIN ] SA: Loaded 44342 primary data records. [2025-10-15T22:41:16.779140] [DEBUG] [LOCAL ] SAFE: Loaded 30428 existing records from primary storage. [2025-10-15T22:41:16.783280] [INFO ] [MAIN ] SAFE: Loaded 30428 primary data records. [2025-10-15T22:41:17.566102] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:17.568763] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9309 primary records. [2025-10-15T22:41:17.569377] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-15T22:41:17.606395] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:17.607676] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-15T22:41:17.608755] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 44342 primary records. [2025-10-15T22:41:17.609923] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-15T22:41:17.610265] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-15T22:41:17.614129] [INFO ] [MAIN ] Derivative Progress: 1327/1803 symbols completed. SABA took 1.4s. Estimated remaining: 2m 60s. Rate: 159.1 symbols/min [2025-10-15T22:41:17.622758] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:17.636783] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-15T22:41:17.637112] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-15T22:41:17.639899] [INFO ] [MAIN ] Derivative Progress: 1328/1803 symbols completed. SA took 1.4s. Estimated remaining: 2m 59s. Rate: 159.2 symbols/min [2025-10-15T22:41:17.640682] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:17.668983] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:17.669792] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30428 primary records. [2025-10-15T22:41:17.670043] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-15T22:41:17.697503] [DEBUG] [LOCAL ] SAH: Loaded 21266 existing records from primary storage. [2025-10-15T22:41:17.700788] [INFO ] [MAIN ] SAH: Loaded 21266 primary data records. [2025-10-15T22:41:17.703034] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-15T22:41:17.740733] [DEBUG] [LOCAL ] SAM: Loaded 21391 existing records from primary storage. [2025-10-15T22:41:17.739824] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-15T22:41:17.769939] [INFO ] [MAIN ] SAM: Loaded 21391 primary data records. [2025-10-15T22:41:17.808771] [INFO ] [MAIN ] Derivative Progress: 1329/1803 symbols completed. SAFE took 1.5s. Estimated remaining: 2m 59s. Rate: 159.3 symbols/min [2025-10-15T22:41:17.892539] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:18.414185] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:18.415256] [DEBUG] [LOCAL ] SAN: Loaded 52965 existing records from primary storage. [2025-10-15T22:41:18.416289] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21266 primary records. [2025-10-15T22:41:18.415460] [INFO ] [MAIN ] SAN: Loaded 52965 primary data records. [2025-10-15T22:41:18.416746] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-15T22:41:18.554427] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:18.554496] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-15T22:41:18.555633] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21391 primary records. [2025-10-15T22:41:18.555018] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-15T22:41:18.566114] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-15T22:41:18.578711] [INFO ] [MAIN ] Derivative Progress: 1330/1803 symbols completed. SAH took 1.0s. Estimated remaining: 2m 58s. Rate: 159.1 symbols/min [2025-10-15T22:41:18.605931] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:18.772424] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-15T22:41:18.772908] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-15T22:41:18.775231] [INFO ] [MAIN ] Derivative Progress: 1331/1803 symbols completed. SAM took 1.1s. Estimated remaining: 2m 58s. Rate: 159.2 symbols/min [2025-10-15T22:41:18.775772] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:18.805524] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:18.806934] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52965 primary records. [2025-10-15T22:41:18.807036] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-15T22:41:18.837573] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-15T22:41:18.847222] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-15T22:41:18.849932] [INFO ] [MAIN ] Derivative Progress: 1332/1803 symbols completed. SAN took 1.0s. Estimated remaining: 2m 57s. Rate: 159.3 symbols/min [2025-10-15T22:41:18.850283] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:18.873604] [DEBUG] [LOCAL ] SAND: Loaded 51858 existing records from primary storage. [2025-10-15T22:41:18.886733] [INFO ] [MAIN ] SAND: Loaded 51858 primary data records. [2025-10-15T22:41:18.955706] [DEBUG] [LOCAL ] SAP: Loaded 49879 existing records from primary storage. [2025-10-15T22:41:18.996705] [INFO ] [MAIN ] SAP: Loaded 49879 primary data records. [2025-10-15T22:41:18.989308] [DEBUG] [LOCAL ] SAR: Loaded 17223 existing records from primary storage. [2025-10-15T22:41:19.010819] [INFO ] [MAIN ] SAR: Loaded 17223 primary data records. [2025-10-15T22:41:19.841104] [DEBUG] [MAIN ] SAND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:19.842009] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51858 primary records. [2025-10-15T22:41:19.842320] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-15T22:41:19.861763] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-15T22:41:19.864355] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-15T22:41:19.867393] [INFO ] [MAIN ] Derivative Progress: 1333/1803 symbols completed. SAND took 1.3s. Estimated remaining: 2m 57s. Rate: 159.1 symbols/min [2025-10-15T22:41:19.880538] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:19.881330] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 17223 primary records. [2025-10-15T22:41:19.893033] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-15T22:41:19.893278] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:19.894483] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49879 primary records. [2025-10-15T22:41:19.894816] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-15T22:41:19.918387] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-15T22:41:19.924009] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-15T22:41:19.928400] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-15T22:41:19.927435] [INFO ] [MAIN ] Derivative Progress: 1334/1803 symbols completed. SAR took 1.1s. Estimated remaining: 2m 57s. Rate: 159.2 symbols/min [2025-10-15T22:41:19.928689] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-15T22:41:19.930513] [INFO ] [MAIN ] Derivative Progress: 1335/1803 symbols completed. SAP took 1.2s. Estimated remaining: 2m 56s. Rate: 159.3 symbols/min [2025-10-15T22:41:19.930933] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:19.930985] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:19.931073] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:19.984953] [DEBUG] [LOCAL ] SB: Loaded 32932 existing records from primary storage. [2025-10-15T22:41:19.985208] [INFO ] [MAIN ] SB: Loaded 32932 primary data records. [2025-10-15T22:41:20.104227] [DEBUG] [LOCAL ] SBH: Loaded 49860 existing records from primary storage. [2025-10-15T22:41:20.104833] [INFO ] [MAIN ] SBH: Loaded 49860 primary data records. [2025-10-15T22:41:20.199273] [DEBUG] [LOCAL ] SARO: Loaded 48340 existing records from primary storage. [2025-10-15T22:41:20.227315] [INFO ] [MAIN ] SARO: Loaded 48340 primary data records. [2025-10-15T22:41:20.976847] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:20.978372] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 32932 primary records. [2025-10-15T22:41:20.978583] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-15T22:41:21.000567] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:21.001474] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49860 primary records. [2025-10-15T22:41:21.005318] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-15T22:41:21.018525] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-15T22:41:21.018631] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-15T22:41:21.020619] [INFO ] [MAIN ] Derivative Progress: 1336/1803 symbols completed. SB took 1.1s. Estimated remaining: 2m 56s. Rate: 159.1 symbols/min [2025-10-15T22:41:21.023559] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:21.033888] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-15T22:41:21.034050] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-15T22:41:21.036034] [INFO ] [MAIN ] Derivative Progress: 1337/1803 symbols completed. SBH took 1.1s. Estimated remaining: 2m 56s. Rate: 159.2 symbols/min [2025-10-15T22:41:21.036230] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:21.052683] [DEBUG] [LOCAL ] SBI: Loaded 7530 existing records from primary storage. [2025-10-15T22:41:21.052878] [INFO ] [MAIN ] SBI: Loaded 7530 primary data records. [2025-10-15T22:41:21.053167] [DEBUG] [MAIN ] SARO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:21.075570] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48340 primary records. [2025-10-15T22:41:21.101586] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-15T22:41:21.169037] [DEBUG] [LOCAL ] SBR: Loaded 7811 existing records from primary storage. [2025-10-15T22:41:21.179910] [INFO ] [MAIN ] SBR: Loaded 7811 primary data records. [2025-10-15T22:41:21.215687] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-15T22:41:21.243455] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-15T22:41:21.289809] [INFO ] [MAIN ] Derivative Progress: 1338/1803 symbols completed. SARO took 1.4s. Estimated remaining: 2m 55s. Rate: 159.2 symbols/min [2025-10-15T22:41:21.336334] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:21.730068] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:21.731791] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7530 primary records. [2025-10-15T22:41:21.730922] [DEBUG] [LOCAL ] SBS: Loaded 49319 existing records from primary storage. [2025-10-15T22:41:21.732164] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-15T22:41:21.732688] [INFO ] [MAIN ] SBS: Loaded 49319 primary data records. [2025-10-15T22:41:21.782738] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-15T22:41:21.816089] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-15T22:41:21.831339] [INFO ] [MAIN ] Derivative Progress: 1339/1803 symbols completed. SBI took 0.8s. Estimated remaining: 2m 55s. Rate: 159.2 symbols/min [2025-10-15T22:41:21.844128] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:21.885138] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:21.943632] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7811 primary records. [2025-10-15T22:41:21.948603] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-15T22:41:22.084898] [DEBUG] [LOCAL ] SBSI: Loaded 14905 existing records from primary storage. [2025-10-15T22:41:22.086180] [INFO ] [MAIN ] SBSI: Loaded 14905 primary data records. [2025-10-15T22:41:22.166501] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-15T22:41:22.183533] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-15T22:41:22.185703] [INFO ] [MAIN ] Derivative Progress: 1340/1803 symbols completed. SBR took 1.1s. Estimated remaining: 2m 54s. Rate: 159.2 symbols/min [2025-10-15T22:41:22.203577] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:22.416870] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:22.417921] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49319 primary records. [2025-10-15T22:41:22.418020] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-15T22:41:22.450565] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-15T22:41:22.451012] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-15T22:41:22.453361] [INFO ] [MAIN ] Derivative Progress: 1341/1803 symbols completed. SBS took 1.1s. Estimated remaining: 2m 54s. Rate: 159.2 symbols/min [2025-10-15T22:41:22.453852] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:22.472245] [DEBUG] [LOCAL ] SBSW: Loaded 53172 existing records from primary storage. [2025-10-15T22:41:22.472632] [INFO ] [MAIN ] SBSW: Loaded 53172 primary data records. [2025-10-15T22:41:22.604583] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:22.641044] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14905 primary records. [2025-10-15T22:41:22.685684] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-15T22:41:22.879280] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-15T22:41:22.881089] [DEBUG] [LOCAL ] SCCO: Loaded 49593 existing records from primary storage. [2025-10-15T22:41:22.879676] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-15T22:41:22.883336] [INFO ] [MAIN ] Derivative Progress: 1342/1803 symbols completed. SBSI took 1.0s. Estimated remaining: 2m 54s. Rate: 159.2 symbols/min [2025-10-15T22:41:22.883708] [INFO ] [MAIN ] SCCO: Loaded 49593 primary data records. [2025-10-15T22:41:22.883844] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:23.027873] [DEBUG] [LOCAL ] SCD: Loaded 13297 existing records from primary storage. [2025-10-15T22:41:23.072319] [INFO ] [MAIN ] SCD: Loaded 13297 primary data records. [2025-10-15T22:41:23.311692] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:23.312625] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53172 primary records. [2025-10-15T22:41:23.318282] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-15T22:41:23.520004] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-15T22:41:23.520501] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-15T22:41:23.522894] [INFO ] [MAIN ] Derivative Progress: 1343/1803 symbols completed. SBSW took 1.3s. Estimated remaining: 2m 53s. Rate: 159.1 symbols/min [2025-10-15T22:41:23.523078] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:23.543087] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:23.544190] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49593 primary records. [2025-10-15T22:41:23.544891] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-15T22:41:23.561556] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-15T22:41:23.561788] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-15T22:41:23.564216] [INFO ] [MAIN ] Derivative Progress: 1344/1803 symbols completed. SCCO took 1.1s. Estimated remaining: 2m 53s. Rate: 159.2 symbols/min [2025-10-15T22:41:23.564445] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:23.596007] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:23.596671] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13297 primary records. [2025-10-15T22:41:23.596835] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-15T22:41:23.633993] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-15T22:41:23.634878] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-15T22:41:23.636097] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-15T22:41:23.645697] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-15T22:41:23.660346] [INFO ] [MAIN ] Derivative Progress: 1345/1803 symbols completed. SCD took 0.8s. Estimated remaining: 2m 52s. Rate: 159.3 symbols/min [2025-10-15T22:41:23.696846] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:23.803196] [DEBUG] [LOCAL ] SCI: Loaded 46535 existing records from primary storage. [2025-10-15T22:41:23.838962] [INFO ] [MAIN ] SCI: Loaded 46535 primary data records. [2025-10-15T22:41:24.051917] [DEBUG] [LOCAL ] SCL: Loaded 14940 existing records from primary storage. [2025-10-15T22:41:24.083635] [INFO ] [MAIN ] SCL: Loaded 14940 primary data records. [2025-10-15T22:41:24.610885] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:24.611901] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-15T22:41:24.612073] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-15T22:41:24.630573] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-15T22:41:24.642745] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-15T22:41:24.643366] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:24.646237] [INFO ] [MAIN ] Derivative Progress: 1346/1803 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 52s. Rate: 159.1 symbols/min [2025-10-15T22:41:24.644078] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46535 primary records. [2025-10-15T22:41:24.646430] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-15T22:41:24.646533] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:24.677565] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-15T22:41:24.678001] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-15T22:41:24.680026] [INFO ] [MAIN ] Derivative Progress: 1347/1803 symbols completed. SCI took 1.1s. Estimated remaining: 2m 52s. Rate: 159.2 symbols/min [2025-10-15T22:41:24.680181] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:24.680554] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:24.681562] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14940 primary records. [2025-10-15T22:41:24.681736] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-15T22:41:24.707278] [DEBUG] [LOCAL ] SCM: Loaded 20187 existing records from primary storage. [2025-10-15T22:41:24.708132] [INFO ] [MAIN ] SCM: Loaded 20187 primary data records. [2025-10-15T22:41:24.746350] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-15T22:41:24.765175] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-15T22:41:24.776355] [INFO ] [MAIN ] Derivative Progress: 1348/1803 symbols completed. SCL took 1.1s. Estimated remaining: 2m 51s. Rate: 159.3 symbols/min [2025-10-15T22:41:24.928337] [DEBUG] [LOCAL ] SCS: Loaded 43524 existing records from primary storage. [2025-10-15T22:41:24.963697] [INFO ] [MAIN ] SCS: Loaded 43524 primary data records. [2025-10-15T22:41:25.375357] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:25.376347] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 20187 primary records. [2025-10-15T22:41:25.376468] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-15T22:41:25.395339] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-15T22:41:25.395430] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-15T22:41:25.397560] [INFO ] [MAIN ] Derivative Progress: 1349/1803 symbols completed. SCM took 0.8s. Estimated remaining: 2m 51s. Rate: 159.3 symbols/min [2025-10-15T22:41:25.412952] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:25.413545] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43524 primary records. [2025-10-15T22:41:25.413606] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-15T22:41:25.428882] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-15T22:41:25.428942] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-15T22:41:25.431715] [INFO ] [MAIN ] Derivative Progress: 1350/1803 symbols completed. SCS took 0.8s. Estimated remaining: 2m 51s. Rate: 159.4 symbols/min [2025-10-15T22:41:25.432091] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:25.432555] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:25.432201] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:25.448346] [DEBUG] [LOCAL ] SDHC: Loaded 10340 existing records from primary storage. [2025-10-15T22:41:25.453540] [INFO ] [MAIN ] SDHC: Loaded 10340 primary data records. [2025-10-15T22:41:25.461210] [DEBUG] [LOCAL ] SDHY: Loaded 11036 existing records from primary storage. [2025-10-15T22:41:25.473588] [INFO ] [MAIN ] SDHY: Loaded 11036 primary data records. [2025-10-15T22:41:25.651814] [DEBUG] [LOCAL ] SD: Loaded 28737 existing records from primary storage. [2025-10-15T22:41:25.675920] [INFO ] [MAIN ] SD: Loaded 28737 primary data records. [2025-10-15T22:41:26.401492] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:26.404457] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10340 primary records. [2025-10-15T22:41:26.404831] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-15T22:41:26.429626] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:26.433621] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-15T22:41:26.434459] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 11036 primary records. [2025-10-15T22:41:26.433846] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-15T22:41:26.435384] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-15T22:41:26.437632] [INFO ] [MAIN ] Derivative Progress: 1351/1803 symbols completed. SDHC took 1.0s. Estimated remaining: 2m 50s. Rate: 159.2 symbols/min [2025-10-15T22:41:26.438231] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:26.454748] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-15T22:41:26.467289] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-15T22:41:26.467553] [DEBUG] [MAIN ] SD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:26.469621] [INFO ] [MAIN ] Derivative Progress: 1352/1803 symbols completed. SDHY took 1.0s. Estimated remaining: 2m 50s. Rate: 159.3 symbols/min [2025-10-15T22:41:26.469857] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:26.470949] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28737 primary records. [2025-10-15T22:41:26.471198] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-15T22:41:26.487488] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-15T22:41:26.488551] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-15T22:41:26.491453] [INFO ] [MAIN ] Derivative Progress: 1353/1803 symbols completed. SD took 1.1s. Estimated remaining: 2m 49s. Rate: 159.4 symbols/min [2025-10-15T22:41:26.491675] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:26.534635] [DEBUG] [LOCAL ] SDRL: Loaded 41576 existing records from primary storage. [2025-10-15T22:41:26.534947] [INFO ] [MAIN ] SDRL: Loaded 41576 primary data records. [2025-10-15T22:41:26.669712] [DEBUG] [LOCAL ] SE: Loaded 53302 existing records from primary storage. [2025-10-15T22:41:26.710371] [INFO ] [MAIN ] SE: Loaded 53302 primary data records. [2025-10-15T22:41:26.987585] [DEBUG] [LOCAL ] SEE: Loaded 48189 existing records from primary storage. [2025-10-15T22:41:26.993861] [INFO ] [MAIN ] SEE: Loaded 48189 primary data records. [2025-10-15T22:41:27.544705] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:27.545677] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41576 primary records. [2025-10-15T22:41:27.545895] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-15T22:41:27.565107] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-15T22:41:27.565233] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-15T22:41:27.567299] [INFO ] [MAIN ] Derivative Progress: 1354/1803 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 49s. Rate: 159.2 symbols/min [2025-10-15T22:41:27.567547] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:27.580863] [DEBUG] [MAIN ] SE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:27.581624] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53302 primary records. [2025-10-15T22:41:27.581918] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-15T22:41:27.615374] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:27.621238] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-15T22:41:27.622229] [DEBUG] [LOCAL ] SEG: Loaded 12834 existing records from primary storage. [2025-10-15T22:41:27.622347] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-15T22:41:27.622393] [INFO ] [MAIN ] SEG: Loaded 12834 primary data records. [2025-10-15T22:41:27.621969] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48189 primary records. [2025-10-15T22:41:27.622537] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-15T22:41:27.635685] [INFO ] [MAIN ] Derivative Progress: 1355/1803 symbols completed. SE took 1.2s. Estimated remaining: 2m 49s. Rate: 159.3 symbols/min [2025-10-15T22:41:27.675309] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:27.770972] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-15T22:41:27.804767] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-15T22:41:27.937522] [INFO ] [MAIN ] Derivative Progress: 1356/1803 symbols completed. SEE took 1.4s. Estimated remaining: 2m 48s. Rate: 159.3 symbols/min [2025-10-15T22:41:27.937900] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:27.974689] [DEBUG] [LOCAL ] SEI: Loaded 49935 existing records from primary storage. [2025-10-15T22:41:27.976428] [INFO ] [MAIN ] SEI: Loaded 49935 primary data records. [2025-10-15T22:41:28.109833] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:28.114255] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 12834 primary records. [2025-10-15T22:41:28.119872] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-15T22:41:28.113607] [DEBUG] [LOCAL ] SEM: Loaded 43203 existing records from primary storage. [2025-10-15T22:41:28.135587] [INFO ] [MAIN ] SEM: Loaded 43203 primary data records. [2025-10-15T22:41:28.268983] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-15T22:41:28.286421] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-15T22:41:28.293453] [INFO ] [MAIN ] Derivative Progress: 1357/1803 symbols completed. SEG took 0.7s. Estimated remaining: 2m 48s. Rate: 159.3 symbols/min [2025-10-15T22:41:28.400420] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:28.682792] [DEBUG] [LOCAL ] SEMR: Loaded 42055 existing records from primary storage. [2025-10-15T22:41:28.695343] [INFO ] [MAIN ] SEMR: Loaded 42055 primary data records. [2025-10-15T22:41:28.695815] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:28.696671] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49935 primary records. [2025-10-15T22:41:28.707629] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-15T22:41:28.853900] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-15T22:41:28.882718] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-15T22:41:28.905735] [INFO ] [MAIN ] Derivative Progress: 1358/1803 symbols completed. SEI took 1.2s. Estimated remaining: 2m 48s. Rate: 159.2 symbols/min [2025-10-15T22:41:28.906122] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:28.941716] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:29.005420] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43203 primary records. [2025-10-15T22:41:29.018667] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-15T22:41:29.038620] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-15T22:41:29.038969] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-15T22:41:29.041160] [INFO ] [MAIN ] Derivative Progress: 1359/1803 symbols completed. SEM took 1.1s. Estimated remaining: 2m 47s. Rate: 159.3 symbols/min [2025-10-15T22:41:29.041722] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:29.084566] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:29.085482] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 42055 primary records. [2025-10-15T22:41:29.085629] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-15T22:41:29.124520] [DEBUG] [LOCAL ] SES: Loaded 51578 existing records from primary storage. [2025-10-15T22:41:29.123588] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-15T22:41:29.124727] [INFO ] [MAIN ] SES: Loaded 51578 primary data records. [2025-10-15T22:41:29.124837] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-15T22:41:29.126964] [INFO ] [MAIN ] Derivative Progress: 1360/1803 symbols completed. SEMR took 0.7s. Estimated remaining: 2m 47s. Rate: 159.4 symbols/min [2025-10-15T22:41:29.127288] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:29.233389] [DEBUG] [LOCAL ] SFB: Loaded 3827 existing records from primary storage. [2025-10-15T22:41:29.243897] [INFO ] [MAIN ] SFB: Loaded 3827 primary data records. [2025-10-15T22:41:29.244698] [DEBUG] [LOCAL ] SF: Loaded 41554 existing records from primary storage. [2025-10-15T22:41:29.265935] [INFO ] [MAIN ] SF: Loaded 41554 primary data records. [2025-10-15T22:41:30.063212] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:30.065592] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51578 primary records. [2025-10-15T22:41:30.065785] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-15T22:41:30.080254] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:30.092674] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 3827 primary records. [2025-10-15T22:41:30.093247] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-15T22:41:30.119671] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:30.120843] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41554 primary records. [2025-10-15T22:41:30.121354] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-15T22:41:30.123831] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-15T22:41:30.125400] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-15T22:41:30.127447] [INFO ] [MAIN ] Derivative Progress: 1361/1803 symbols completed. SES took 1.2s. Estimated remaining: 2m 47s. Rate: 159.2 symbols/min [2025-10-15T22:41:30.135432] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:30.135589] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-15T22:41:30.143200] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-15T22:41:30.143493] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-15T22:41:30.143331] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-15T22:41:30.146311] [INFO ] [MAIN ] Derivative Progress: 1362/1803 symbols completed. SF took 1.1s. Estimated remaining: 2m 46s. Rate: 159.3 symbols/min [2025-10-15T22:41:30.149140] [INFO ] [MAIN ] Derivative Progress: 1363/1803 symbols completed. SFB took 1.0s. Estimated remaining: 2m 46s. Rate: 159.4 symbols/min [2025-10-15T22:41:30.149081] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:30.168774] [DEBUG] [LOCAL ] SFBS: Loaded 21196 existing records from primary storage. [2025-10-15T22:41:30.168911] [INFO ] [MAIN ] SFBS: Loaded 21196 primary data records. [2025-10-15T22:41:30.470146] [DEBUG] [LOCAL ] SFL: Loaded 45346 existing records from primary storage. [2025-10-15T22:41:30.478053] [INFO ] [MAIN ] SFL: Loaded 45346 primary data records. [2025-10-15T22:41:30.831742] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:30.832826] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21196 primary records. [2025-10-15T22:41:30.832904] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-15T22:41:30.849162] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-15T22:41:30.849439] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-15T22:41:30.851374] [INFO ] [MAIN ] Derivative Progress: 1364/1803 symbols completed. SFBS took 0.7s. Estimated remaining: 2m 45s. Rate: 159.3 symbols/min [2025-10-15T22:41:30.867191] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:30.867785] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45346 primary records. [2025-10-15T22:41:30.867846] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-15T22:41:30.882471] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-15T22:41:30.882529] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-15T22:41:30.884441] [INFO ] [MAIN ] Derivative Progress: 1365/1803 symbols completed. SFL took 0.7s. Estimated remaining: 2m 45s. Rate: 159.4 symbols/min [2025-10-15T22:41:30.884817] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:30.884908] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:30.885265] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:30.894985] [DEBUG] [LOCAL ] SGU: Loaded 6594 existing records from primary storage. [2025-10-15T22:41:30.895226] [INFO ] [MAIN ] SGU: Loaded 6594 primary data records. [2025-10-15T22:41:31.234806] [DEBUG] [LOCAL ] SGHC: Loaded 47022 existing records from primary storage. [2025-10-15T22:41:31.235902] [INFO ] [MAIN ] SGHC: Loaded 47022 primary data records. [2025-10-15T22:41:31.266825] [DEBUG] [LOCAL ] SG: Loaded 53494 existing records from primary storage. [2025-10-15T22:41:31.299135] [INFO ] [MAIN ] SG: Loaded 53494 primary data records. [2025-10-15T22:41:31.870373] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:31.871375] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6594 primary records. [2025-10-15T22:41:31.871588] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-15T22:41:31.888594] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-15T22:41:31.888895] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-15T22:41:31.891114] [INFO ] [MAIN ] Derivative Progress: 1366/1803 symbols completed. SGU took 1.0s. Estimated remaining: 2m 45s. Rate: 159.2 symbols/min [2025-10-15T22:41:31.891566] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:31.914165] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:31.928378] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:31.928006] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 47022 primary records. [2025-10-15T22:41:31.928592] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-15T22:41:31.929466] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53494 primary records. [2025-10-15T22:41:31.930424] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-15T22:41:31.968296] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-15T22:41:31.969136] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-15T22:41:31.972513] [INFO ] [MAIN ] Derivative Progress: 1367/1803 symbols completed. SG took 1.1s. Estimated remaining: 2m 44s. Rate: 159.3 symbols/min [2025-10-15T22:41:31.973294] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:31.977677] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-15T22:41:31.978263] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-15T22:41:31.980535] [INFO ] [MAIN ] Derivative Progress: 1368/1803 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 44s. Rate: 159.4 symbols/min [2025-10-15T22:41:31.980779] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:31.996413] [DEBUG] [LOCAL ] SHAK: Loaded 48835 existing records from primary storage. [2025-10-15T22:41:31.996564] [INFO ] [MAIN ] SHAK: Loaded 48835 primary data records. [2025-10-15T22:41:32.116358] [DEBUG] [LOCAL ] SHCO: Loaded 25461 existing records from primary storage. [2025-10-15T22:41:32.116557] [INFO ] [MAIN ] SHCO: Loaded 25461 primary data records. [2025-10-15T22:41:32.617843] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-10-15T22:41:32.685233] [INFO ] [MAIN ] SHEL: Loaded 53673 primary data records. [2025-10-15T22:41:33.008140] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:33.009637] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48835 primary records. [2025-10-15T22:41:33.009920] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-15T22:41:33.030023] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-15T22:41:33.030447] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-15T22:41:33.032248] [INFO ] [MAIN ] Derivative Progress: 1369/1803 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 44s. Rate: 159.2 symbols/min [2025-10-15T22:41:33.032627] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:33.046291] [DEBUG] [MAIN ] SHCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:33.047084] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25461 primary records. [2025-10-15T22:41:33.047269] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-15T22:41:33.088302] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-15T22:41:33.088406] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-15T22:41:33.088192] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:33.091485] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53673 primary records. [2025-10-15T22:41:33.090384] [INFO ] [MAIN ] Derivative Progress: 1370/1803 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 43s. Rate: 159.3 symbols/min [2025-10-15T22:41:33.091716] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-15T22:41:33.091816] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:33.113940] [DEBUG] [LOCAL ] SHG: Loaded 26500 existing records from primary storage. [2025-10-15T22:41:33.114624] [INFO ] [MAIN ] SHG: Loaded 26500 primary data records. [2025-10-15T22:41:33.221888] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-15T22:41:33.222186] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-15T22:41:33.225260] [INFO ] [MAIN ] Derivative Progress: 1371/1803 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 43s. Rate: 159.4 symbols/min [2025-10-15T22:41:33.236014] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:33.444030] [DEBUG] [LOCAL ] SHOC: Loaded 3243 existing records from primary storage. [2025-10-15T22:41:33.444209] [INFO ] [MAIN ] SHOC: Loaded 3243 primary data records. [2025-10-15T22:41:33.541528] [DEBUG] [LOCAL ] SHO: Loaded 49400 existing records from primary storage. [2025-10-15T22:41:33.552625] [INFO ] [MAIN ] SHO: Loaded 49400 primary data records. [2025-10-15T22:41:34.085839] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:34.087865] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26500 primary records. [2025-10-15T22:41:34.089028] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-15T22:41:34.107744] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-15T22:41:34.108231] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-15T22:41:34.110332] [INFO ] [MAIN ] Derivative Progress: 1372/1803 symbols completed. SHG took 1.1s. Estimated remaining: 2m 42s. Rate: 159.2 symbols/min [2025-10-15T22:41:34.110606] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:34.129407] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:41:34.130241] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3243 primary records. [2025-10-15T22:41:34.130396] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-15T22:41:34.148982] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-15T22:41:34.157084] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-15T22:41:34.164192] [INFO ] [MAIN ] Derivative Progress: 1373/1803 symbols completed. SHOC took 0.9s. Estimated remaining: 2m 42s. Rate: 159.3 symbols/min [2025-10-15T22:41:34.164379] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:34.164702] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:34.165895] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49400 primary records. [2025-10-15T22:41:34.165985] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-15T22:41:34.192877] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-15T22:41:34.193050] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-15T22:41:34.195747] [INFO ] [MAIN ] Derivative Progress: 1374/1803 symbols completed. SHO took 1.1s. Estimated remaining: 2m 41s. Rate: 159.4 symbols/min [2025-10-15T22:41:34.196105] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:34.212903] [DEBUG] [LOCAL ] SHW: Loaded 50362 existing records from primary storage. [2025-10-15T22:41:34.213082] [INFO ] [MAIN ] SHW: Loaded 50362 primary data records. [2025-10-15T22:41:34.396550] [DEBUG] [LOCAL ] SID: Loaded 42687 existing records from primary storage. [2025-10-15T22:41:34.420685] [INFO ] [MAIN ] SID: Loaded 42687 primary data records. [2025-10-15T22:41:34.710752] [DEBUG] [LOCAL ] SIG: Loaded 45678 existing records from primary storage. [2025-10-15T22:41:34.735341] [INFO ] [MAIN ] SIG: Loaded 45678 primary data records. [2025-10-15T22:41:35.249062] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:35.249947] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50362 primary records. [2025-10-15T22:41:35.250137] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-15T22:41:35.271520] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-15T22:41:35.272249] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-15T22:41:35.286090] [INFO ] [MAIN ] Derivative Progress: 1375/1803 symbols completed. SHW took 1.2s. Estimated remaining: 2m 41s. Rate: 159.2 symbols/min [2025-10-15T22:41:35.286428] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:35.287993] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:35.289291] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42687 primary records. [2025-10-15T22:41:35.289679] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-15T22:41:35.306468] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-15T22:41:35.306592] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-15T22:41:35.308477] [INFO ] [MAIN ] Derivative Progress: 1376/1803 symbols completed. SID took 1.1s. Estimated remaining: 2m 41s. Rate: 159.3 symbols/min [2025-10-15T22:41:35.308886] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:35.331288] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:35.332065] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45678 primary records. [2025-10-15T22:41:35.332209] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-15T22:41:35.354405] [DEBUG] [LOCAL ] SII: Loaded 23989 existing records from primary storage. [2025-10-15T22:41:35.356675] [INFO ] [MAIN ] SII: Loaded 23989 primary data records. [2025-10-15T22:41:35.422952] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-15T22:41:35.446275] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-15T22:41:35.484100] [DEBUG] [LOCAL ] SILA: Loaded 30516 existing records from primary storage. [2025-10-15T22:41:35.482942] [INFO ] [MAIN ] Derivative Progress: 1377/1803 symbols completed. SIG took 1.3s. Estimated remaining: 2m 40s. Rate: 159.4 symbols/min [2025-10-15T22:41:35.505358] [INFO ] [MAIN ] SILA: Loaded 30516 primary data records. [2025-10-15T22:41:35.510906] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:36.004319] [DEBUG] [LOCAL ] SITC: Loaded 41805 existing records from primary storage. [2025-10-15T22:41:36.006627] [INFO ] [MAIN ] SITC: Loaded 41805 primary data records. [2025-10-15T22:41:36.192622] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:36.220451] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23989 primary records. [2025-10-15T22:41:36.226069] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-15T22:41:36.373891] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:36.374513] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30516 primary records. [2025-10-15T22:41:36.375051] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-15T22:41:36.382330] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-15T22:41:36.393722] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-15T22:41:36.399961] [INFO ] [MAIN ] Derivative Progress: 1378/1803 symbols completed. SII took 1.1s. Estimated remaining: 2m 40s. Rate: 159.2 symbols/min [2025-10-15T22:41:36.400521] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-15T22:41:36.400780] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-15T22:41:36.403067] [INFO ] [MAIN ] Derivative Progress: 1379/1803 symbols completed. SILA took 1.1s. Estimated remaining: 2m 40s. Rate: 159.3 symbols/min [2025-10-15T22:41:36.421160] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:36.421845] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41805 primary records. [2025-10-15T22:41:36.421919] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-15T22:41:36.437973] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-15T22:41:36.438035] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-15T22:41:36.440854] [INFO ] [MAIN ] Derivative Progress: 1380/1803 symbols completed. SITC took 0.9s. Estimated remaining: 2m 39s. Rate: 159.5 symbols/min [2025-10-15T22:41:36.441260] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:36.441353] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:36.441870] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:36.470957] [DEBUG] [LOCAL ] SJT: Loaded 22559 existing records from primary storage. [2025-10-15T22:41:36.478663] [INFO ] [MAIN ] SJT: Loaded 22559 primary data records. [2025-10-15T22:41:36.603944] [DEBUG] [LOCAL ] SITE: Loaded 35608 existing records from primary storage. [2025-10-15T22:41:36.625418] [INFO ] [MAIN ] SITE: Loaded 35608 primary data records. [2025-10-15T22:41:36.742694] [DEBUG] [LOCAL ] SJM: Loaded 50137 existing records from primary storage. [2025-10-15T22:41:36.768049] [INFO ] [MAIN ] SJM: Loaded 50137 primary data records. [2025-10-15T22:41:37.460094] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:37.461383] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22559 primary records. [2025-10-15T22:41:37.461717] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-15T22:41:37.479228] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-15T22:41:37.480228] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-15T22:41:37.484212] [INFO ] [MAIN ] Derivative Progress: 1381/1803 symbols completed. SJT took 1.0s. Estimated remaining: 2m 39s. Rate: 159.2 symbols/min [2025-10-15T22:41:37.484680] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:37.499714] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:37.500589] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35608 primary records. [2025-10-15T22:41:37.500792] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-15T22:41:37.520682] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-15T22:41:37.520923] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-15T22:41:37.523106] [INFO ] [MAIN ] Derivative Progress: 1382/1803 symbols completed. SITE took 1.1s. Estimated remaining: 2m 39s. Rate: 159.4 symbols/min [2025-10-15T22:41:37.523320] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:37.536767] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:37.537518] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50137 primary records. [2025-10-15T22:41:37.537724] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-15T22:41:37.566762] [DEBUG] [LOCAL ] SKIL: Loaded 6591 existing records from primary storage. [2025-10-15T22:41:37.567360] [INFO ] [MAIN ] SKIL: Loaded 6591 primary data records. [2025-10-15T22:41:37.650804] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-15T22:41:37.659277] [DEBUG] [LOCAL ] SKE: Loaded 36903 existing records from primary storage. [2025-10-15T22:41:37.669935] [INFO ] [MAIN ] SKE: Loaded 36903 primary data records. [2025-10-15T22:41:37.664627] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-15T22:41:37.702818] [INFO ] [MAIN ] Derivative Progress: 1383/1803 symbols completed. SJM took 1.3s. Estimated remaining: 2m 38s. Rate: 159.4 symbols/min [2025-10-15T22:41:37.712310] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:37.862387] [DEBUG] [LOCAL ] SKLZ: Loaded 11597 existing records from primary storage. [2025-10-15T22:41:38.020770] [INFO ] [MAIN ] SKLZ: Loaded 11597 primary data records. [2025-10-15T22:41:38.589096] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:38.590007] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6591 primary records. [2025-10-15T22:41:38.590235] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-15T22:41:38.610460] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-15T22:41:38.612282] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-15T22:41:38.614502] [INFO ] [MAIN ] Derivative Progress: 1384/1803 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 38s. Rate: 159.2 symbols/min [2025-10-15T22:41:38.614826] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:38.629159] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:38.630128] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 36903 primary records. [2025-10-15T22:41:38.630260] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-15T22:41:38.662838] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-15T22:41:38.663402] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-15T22:41:38.663235] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:38.666544] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11597 primary records. [2025-10-15T22:41:38.666667] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-15T22:41:38.665838] [INFO ] [MAIN ] Derivative Progress: 1385/1803 symbols completed. SKE took 1.2s. Estimated remaining: 2m 37s. Rate: 159.3 symbols/min [2025-10-15T22:41:38.667121] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:38.692243] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-15T22:41:38.692393] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-15T22:41:38.695200] [INFO ] [MAIN ] Derivative Progress: 1386/1803 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 37s. Rate: 159.5 symbols/min [2025-10-15T22:41:38.695513] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:38.710633] [DEBUG] [LOCAL ] SKM: Loaded 35250 existing records from primary storage. [2025-10-15T22:41:38.710886] [INFO ] [MAIN ] SKM: Loaded 35250 primary data records. [2025-10-15T22:41:38.907415] [DEBUG] [LOCAL ] SKY: Loaded 38486 existing records from primary storage. [2025-10-15T22:41:38.914153] [INFO ] [MAIN ] SKY: Loaded 38486 primary data records. [2025-10-15T22:41:38.908768] [DEBUG] [LOCAL ] SKT: Loaded 42516 existing records from primary storage. [2025-10-15T22:41:38.958698] [INFO ] [MAIN ] SKT: Loaded 42516 primary data records. [2025-10-15T22:41:39.795332] [DEBUG] [MAIN ] SKM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:39.796938] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35250 primary records. [2025-10-15T22:41:39.797103] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-15T22:41:39.822060] [DEBUG] [MAIN ] SKY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:39.824241] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38486 primary records. [2025-10-15T22:41:39.824761] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-15T22:41:39.839933] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-15T22:41:39.840476] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-15T22:41:39.842883] [INFO ] [MAIN ] Derivative Progress: 1387/1803 symbols completed. SKM took 1.2s. Estimated remaining: 2m 37s. Rate: 159.2 symbols/min [2025-10-15T22:41:39.843156] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:39.860311] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:39.861853] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42516 primary records. [2025-10-15T22:41:39.862668] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-15T22:41:39.862238] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-15T22:41:39.862877] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-15T22:41:39.865864] [INFO ] [MAIN ] Derivative Progress: 1388/1803 symbols completed. SKY took 1.2s. Estimated remaining: 2m 36s. Rate: 159.3 symbols/min [2025-10-15T22:41:39.881342] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:39.891332] [DEBUG] [LOCAL ] SKYH: Loaded 16201 existing records from primary storage. [2025-10-15T22:41:39.891983] [INFO ] [MAIN ] SKYH: Loaded 16201 primary data records. [2025-10-15T22:41:39.897996] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-15T22:41:39.910986] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-15T22:41:39.914086] [INFO ] [MAIN ] Derivative Progress: 1389/1803 symbols completed. SKT took 1.2s. Estimated remaining: 2m 36s. Rate: 159.4 symbols/min [2025-10-15T22:41:39.935878] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:40.256389] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-15T22:41:40.259381] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-15T22:41:40.306379] [DEBUG] [LOCAL ] SLF: Loaded 38743 existing records from primary storage. [2025-10-15T22:41:40.333483] [INFO ] [MAIN ] SLF: Loaded 38743 primary data records. [2025-10-15T22:41:40.924058] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:40.925778] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16201 primary records. [2025-10-15T22:41:40.925886] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-15T22:41:40.945313] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-15T22:41:40.945508] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-15T22:41:40.948062] [INFO ] [MAIN ] Derivative Progress: 1390/1803 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 36s. Rate: 159.2 symbols/min [2025-10-15T22:41:40.948460] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:40.986468] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:40.986216] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:40.987896] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-15T22:41:40.988067] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-15T22:41:40.987303] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38743 primary records. [2025-10-15T22:41:40.988154] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-15T22:41:41.022695] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-15T22:41:41.027930] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-15T22:41:41.031812] [INFO ] [MAIN ] Derivative Progress: 1391/1803 symbols completed. SLB took 1.2s. Estimated remaining: 2m 35s. Rate: 159.3 symbols/min [2025-10-15T22:41:41.032006] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:41.033524] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-15T22:41:41.033735] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-15T22:41:41.037076] [INFO ] [MAIN ] Derivative Progress: 1392/1803 symbols completed. SLF took 1.1s. Estimated remaining: 2m 35s. Rate: 159.4 symbols/min [2025-10-15T22:41:41.037990] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:41.052299] [DEBUG] [LOCAL ] SLG: Loaded 45584 existing records from primary storage. [2025-10-15T22:41:41.052483] [INFO ] [MAIN ] SLG: Loaded 45584 primary data records. [2025-10-15T22:41:41.380090] [DEBUG] [LOCAL ] SLGN: Loaded 40857 existing records from primary storage. [2025-10-15T22:41:41.392734] [INFO ] [MAIN ] SLGN: Loaded 40857 primary data records. [2025-10-15T22:41:41.393504] [DEBUG] [LOCAL ] SLQT: Loaded 43522 existing records from primary storage. [2025-10-15T22:41:41.393665] [INFO ] [MAIN ] SLQT: Loaded 43522 primary data records. [2025-10-15T22:41:41.996545] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:41.998171] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45584 primary records. [2025-10-15T22:41:41.999559] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-15T22:41:42.016548] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-15T22:41:42.016852] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-15T22:41:42.019140] [INFO ] [MAIN ] Derivative Progress: 1393/1803 symbols completed. SLG took 1.1s. Estimated remaining: 2m 34s. Rate: 159.2 symbols/min [2025-10-15T22:41:42.037693] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:42.038335] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40857 primary records. [2025-10-15T22:41:42.038475] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-15T22:41:42.067987] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-15T22:41:42.068071] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-15T22:41:42.067024] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:42.070062] [INFO ] [MAIN ] Derivative Progress: 1394/1803 symbols completed. SLGN took 1.0s. Estimated remaining: 2m 34s. Rate: 159.3 symbols/min [2025-10-15T22:41:42.070800] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43522 primary records. [2025-10-15T22:41:42.071006] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-15T22:41:42.085460] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-15T22:41:42.085516] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-15T22:41:42.088085] [INFO ] [MAIN ] Derivative Progress: 1395/1803 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 34s. Rate: 159.5 symbols/min [2025-10-15T22:41:42.088536] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:42.088460] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:42.088696] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:42.101045] [DEBUG] [LOCAL ] SMBK: Loaded 8201 existing records from primary storage. [2025-10-15T22:41:42.101304] [INFO ] [MAIN ] SMBK: Loaded 8201 primary data records. [2025-10-15T22:41:42.266332] [DEBUG] [LOCAL ] SLVM: Loaded 27812 existing records from primary storage. [2025-10-15T22:41:42.319120] [INFO ] [MAIN ] SLVM: Loaded 27812 primary data records. [2025-10-15T22:41:42.518192] [DEBUG] [LOCAL ] SM: Loaded 52378 existing records from primary storage. [2025-10-15T22:41:42.539499] [INFO ] [MAIN ] SM: Loaded 52378 primary data records. [2025-10-15T22:41:43.092317] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:43.093252] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8201 primary records. [2025-10-15T22:41:43.093635] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-15T22:41:43.110221] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-15T22:41:43.110435] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-15T22:41:43.113370] [INFO ] [MAIN ] Derivative Progress: 1396/1803 symbols completed. SMBK took 1.0s. Estimated remaining: 2m 33s. Rate: 159.3 symbols/min [2025-10-15T22:41:43.113682] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:43.129210] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:43.133936] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27812 primary records. [2025-10-15T22:41:43.134075] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-15T22:41:43.165968] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:43.166349] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-15T22:41:43.167383] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52378 primary records. [2025-10-15T22:41:43.166769] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-15T22:41:43.166578] [DEBUG] [LOCAL ] SMC: Loaded 11266 existing records from primary storage. [2025-10-15T22:41:43.167503] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-15T22:41:43.169788] [INFO ] [MAIN ] Derivative Progress: 1397/1803 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 33s. Rate: 159.4 symbols/min [2025-10-15T22:41:43.169903] [INFO ] [MAIN ] SMC: Loaded 11266 primary data records. [2025-10-15T22:41:43.181061] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:43.253637] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-15T22:41:43.265703] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-15T22:41:43.288828] [INFO ] [MAIN ] Derivative Progress: 1398/1803 symbols completed. SM took 1.2s. Estimated remaining: 2m 32s. Rate: 159.4 symbols/min [2025-10-15T22:41:43.289080] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:43.522379] [DEBUG] [LOCAL ] SMFG: Loaded 48360 existing records from primary storage. [2025-10-15T22:41:43.522584] [INFO ] [MAIN ] SMFG: Loaded 48360 primary data records. [2025-10-15T22:41:43.591171] [DEBUG] [LOCAL ] SMG: Loaded 43369 existing records from primary storage. [2025-10-15T22:41:43.612671] [INFO ] [MAIN ] SMG: Loaded 43369 primary data records. [2025-10-15T22:41:44.029304] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:44.145243] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11266 primary records. [2025-10-15T22:41:44.154168] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-15T22:41:44.172511] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-15T22:41:44.173932] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-15T22:41:44.176591] [INFO ] [MAIN ] Derivative Progress: 1399/1803 symbols completed. SMC took 1.1s. Estimated remaining: 2m 32s. Rate: 159.3 symbols/min [2025-10-15T22:41:44.177241] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:44.199220] [DEBUG] [LOCAL ] SMHI: Loaded 13111 existing records from primary storage. [2025-10-15T22:41:44.199693] [INFO ] [MAIN ] SMHI: Loaded 13111 primary data records. [2025-10-15T22:41:44.297582] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:44.315886] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43369 primary records. [2025-10-15T22:41:44.310006] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:44.316733] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48360 primary records. [2025-10-15T22:41:44.316802] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-15T22:41:44.330700] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-15T22:41:44.382478] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-15T22:41:44.392075] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-15T22:41:44.384083] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-15T22:41:44.408458] [INFO ] [MAIN ] Derivative Progress: 1400/1803 symbols completed. SMG took 1.1s. Estimated remaining: 2m 32s. Rate: 159.3 symbols/min [2025-10-15T22:41:44.417278] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-15T22:41:44.429887] [INFO ] [MAIN ] Derivative Progress: 1401/1803 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 31s. Rate: 159.4 symbols/min [2025-10-15T22:41:44.408612] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:44.444305] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:44.608466] [DEBUG] [LOCAL ] SMP: Loaded 18828 existing records from primary storage. [2025-10-15T22:41:44.608896] [INFO ] [MAIN ] SMP: Loaded 18828 primary data records. [2025-10-15T22:41:44.940476] [DEBUG] [LOCAL ] SMR: Loaded 53799 existing records from primary storage. [2025-10-15T22:41:44.940917] [INFO ] [MAIN ] SMR: Loaded 53799 primary data records. [2025-10-15T22:41:45.018297] [DEBUG] [MAIN ] SMHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:45.032176] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13111 primary records. [2025-10-15T22:41:45.049219] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-15T22:41:45.266945] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-15T22:41:45.267104] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-15T22:41:45.269230] [INFO ] [MAIN ] Derivative Progress: 1402/1803 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 31s. Rate: 159.3 symbols/min [2025-10-15T22:41:45.269510] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:45.292028] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:45.292746] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 18828 primary records. [2025-10-15T22:41:45.292919] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-15T22:41:45.322476] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-15T22:41:45.322859] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-15T22:41:45.350167] [INFO ] [MAIN ] Derivative Progress: 1403/1803 symbols completed. SMP took 0.9s. Estimated remaining: 2m 31s. Rate: 159.4 symbols/min [2025-10-15T22:41:45.350342] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:45.348131] [DEBUG] [MAIN ] SMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:45.351726] [DEBUG] [LOCAL ] SMRT: Loaded 43964 existing records from primary storage. [2025-10-15T22:41:45.351940] [INFO ] [MAIN ] SMRT: Loaded 43964 primary data records. [2025-10-15T22:41:45.352798] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53799 primary records. [2025-10-15T22:41:45.352988] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-15T22:41:45.646464] [DEBUG] [LOCAL ] SMWB: Loaded 32187 existing records from primary storage. [2025-10-15T22:41:45.688387] [INFO ] [MAIN ] SMWB: Loaded 32187 primary data records. [2025-10-15T22:41:45.708345] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-15T22:41:45.714304] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-15T22:41:45.728714] [INFO ] [MAIN ] Derivative Progress: 1404/1803 symbols completed. SMR took 1.3s. Estimated remaining: 2m 30s. Rate: 159.4 symbols/min [2025-10-15T22:41:45.728891] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:46.045239] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:46.046250] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43964 primary records. [2025-10-15T22:41:46.046425] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-15T22:41:46.078682] [DEBUG] [LOCAL ] SN: Loaded 49983 existing records from primary storage. [2025-10-15T22:41:46.080536] [INFO ] [MAIN ] SN: Loaded 49983 primary data records. [2025-10-15T22:41:46.080454] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-15T22:41:46.080687] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-15T22:41:46.082786] [INFO ] [MAIN ] Derivative Progress: 1405/1803 symbols completed. SMRT took 0.8s. Estimated remaining: 2m 30s. Rate: 159.4 symbols/min [2025-10-15T22:41:46.088730] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:46.279893] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:46.295372] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32187 primary records. [2025-10-15T22:41:46.297162] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-15T22:41:46.454973] [DEBUG] [LOCAL ] SNA: Loaded 25783 existing records from primary storage. [2025-10-15T22:41:46.455393] [INFO ] [MAIN ] SNA: Loaded 25783 primary data records. [2025-10-15T22:41:46.590437] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-15T22:41:46.618856] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-15T22:41:46.629229] [INFO ] [MAIN ] Derivative Progress: 1406/1803 symbols completed. SMWB took 1.3s. Estimated remaining: 2m 30s. Rate: 159.3 symbols/min [2025-10-15T22:41:46.769747] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:46.795438] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:46.796490] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49983 primary records. [2025-10-15T22:41:46.797671] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-15T22:41:46.815764] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-15T22:41:46.816056] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-15T22:41:46.818155] [INFO ] [MAIN ] Derivative Progress: 1407/1803 symbols completed. SN took 1.1s. Estimated remaining: 2m 29s. Rate: 159.4 symbols/min [2025-10-15T22:41:46.818482] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:46.850344] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:46.851119] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25783 primary records. [2025-10-15T22:41:46.853822] [DEBUG] [LOCAL ] SNDA: Loaded 4464 existing records from primary storage. [2025-10-15T22:41:46.853632] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-15T22:41:46.854004] [INFO ] [MAIN ] SNDA: Loaded 4464 primary data records. [2025-10-15T22:41:46.991544] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-15T22:41:46.993172] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-15T22:41:46.998668] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-15T22:41:47.119069] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-15T22:41:47.249585] [INFO ] [MAIN ] Derivative Progress: 1408/1803 symbols completed. SNA took 1.2s. Estimated remaining: 2m 29s. Rate: 159.4 symbols/min [2025-10-15T22:41:47.511172] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:47.511924] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4464 primary records. [2025-10-15T22:41:47.512184] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-15T22:41:47.530172] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-15T22:41:47.531073] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-15T22:41:47.533818] [INFO ] [MAIN ] Derivative Progress: 1409/1803 symbols completed. SNDA took 0.7s. Estimated remaining: 2m 28s. Rate: 159.4 symbols/min [2025-10-15T22:41:47.546790] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:47.547314] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-15T22:41:47.547437] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-15T22:41:47.562192] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-15T22:41:47.562249] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-15T22:41:47.564259] [INFO ] [MAIN ] Derivative Progress: 1410/1803 symbols completed. SNAP took 0.8s. Estimated remaining: 2m 28s. Rate: 159.5 symbols/min [2025-10-15T22:41:47.564729] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:47.564789] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:47.564687] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:47.630038] [DEBUG] [LOCAL ] SNDR: Loaded 41524 existing records from primary storage. [2025-10-15T22:41:47.642757] [INFO ] [MAIN ] SNDR: Loaded 41524 primary data records. [2025-10-15T22:41:47.657116] [DEBUG] [LOCAL ] SNN: Loaded 44365 existing records from primary storage. [2025-10-15T22:41:47.669177] [DEBUG] [LOCAL ] SNOW: Loaded 53594 existing records from primary storage. [2025-10-15T22:41:47.669307] [INFO ] [MAIN ] SNN: Loaded 44365 primary data records. [2025-10-15T22:41:47.688960] [INFO ] [MAIN ] SNOW: Loaded 53594 primary data records. [2025-10-15T22:41:48.629230] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:48.635420] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41524 primary records. [2025-10-15T22:41:48.635596] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-15T22:41:48.636902] [DEBUG] [MAIN ] SNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:48.638045] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53594 primary records. [2025-10-15T22:41:48.646824] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-15T22:41:48.674754] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-15T22:41:48.682930] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-15T22:41:48.685367] [INFO ] [MAIN ] Derivative Progress: 1411/1803 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 28s. Rate: 159.3 symbols/min [2025-10-15T22:41:48.686376] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-15T22:41:48.685752] [DEBUG] [MAIN ] SNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:48.687449] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44365 primary records. [2025-10-15T22:41:48.686611] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-15T22:41:48.686532] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:48.689823] [INFO ] [MAIN ] Derivative Progress: 1412/1803 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 27s. Rate: 159.4 symbols/min [2025-10-15T22:41:48.687620] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-15T22:41:48.690696] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:48.707035] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-15T22:41:48.707197] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-15T22:41:48.709837] [INFO ] [MAIN ] Derivative Progress: 1413/1803 symbols completed. SNN took 1.1s. Estimated remaining: 2m 27s. Rate: 159.5 symbols/min [2025-10-15T22:41:48.710079] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:48.779236] [DEBUG] [LOCAL ] SNV: Loaded 49036 existing records from primary storage. [2025-10-15T22:41:48.780863] [DEBUG] [LOCAL ] SNX: Loaded 39434 existing records from primary storage. [2025-10-15T22:41:48.780349] [INFO ] [MAIN ] SNV: Loaded 49036 primary data records. [2025-10-15T22:41:48.781026] [INFO ] [MAIN ] SNX: Loaded 39434 primary data records. [2025-10-15T22:41:48.949868] [DEBUG] [LOCAL ] SO: Loaded 53614 existing records from primary storage. [2025-10-15T22:41:48.961775] [INFO ] [MAIN ] SO: Loaded 53614 primary data records. [2025-10-15T22:41:49.733774] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:49.735403] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 49036 primary records. [2025-10-15T22:41:49.735861] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-15T22:41:49.765290] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-15T22:41:49.765675] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-15T22:41:49.765504] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:49.768511] [INFO ] [MAIN ] Derivative Progress: 1414/1803 symbols completed. SNV took 1.1s. Estimated remaining: 2m 27s. Rate: 159.3 symbols/min [2025-10-15T22:41:49.766600] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39434 primary records. [2025-10-15T22:41:49.769627] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-15T22:41:49.769372] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:49.788608] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-15T22:41:49.796302] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-15T22:41:49.798391] [INFO ] [MAIN ] Derivative Progress: 1415/1803 symbols completed. SNX took 1.1s. Estimated remaining: 2m 26s. Rate: 159.4 symbols/min [2025-10-15T22:41:49.798537] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:49.803988] [DEBUG] [MAIN ] SO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:49.805071] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53614 primary records. [2025-10-15T22:41:49.805138] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-15T22:41:49.822282] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-15T22:41:49.822349] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-15T22:41:49.824837] [INFO ] [MAIN ] Derivative Progress: 1416/1803 symbols completed. SO took 1.1s. Estimated remaining: 2m 26s. Rate: 159.5 symbols/min [2025-10-15T22:41:49.825198] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:49.841869] [DEBUG] [LOCAL ] SOJC: Loaded 4812 existing records from primary storage. [2025-10-15T22:41:49.842059] [INFO ] [MAIN ] SOJC: Loaded 4812 primary data records. [2025-10-15T22:41:49.941046] [DEBUG] [LOCAL ] SOBO: Loaded 39401 existing records from primary storage. [2025-10-15T22:41:49.956809] [INFO ] [MAIN ] SOBO: Loaded 39401 primary data records. [2025-10-15T22:41:50.111862] [DEBUG] [LOCAL ] SOC: Loaded 50966 existing records from primary storage. [2025-10-15T22:41:50.155629] [INFO ] [MAIN ] SOC: Loaded 50966 primary data records. [2025-10-15T22:41:50.833887] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:50.835076] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4812 primary records. [2025-10-15T22:41:50.835285] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-15T22:41:50.869758] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-15T22:41:50.868489] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:50.869910] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-15T22:41:50.870963] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39401 primary records. [2025-10-15T22:41:50.871083] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-15T22:41:50.872995] [INFO ] [MAIN ] Derivative Progress: 1417/1803 symbols completed. SOJC took 1.0s. Estimated remaining: 2m 25s. Rate: 159.3 symbols/min [2025-10-15T22:41:50.873913] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:50.906154] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-15T22:41:50.906544] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-15T22:41:50.914104] [INFO ] [MAIN ] Derivative Progress: 1418/1803 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 25s. Rate: 159.4 symbols/min [2025-10-15T22:41:50.919094] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:50.919876] [DEBUG] [LOCAL ] SOJD: Loaded 12977 existing records from primary storage. [2025-10-15T22:41:50.920673] [INFO ] [MAIN ] SOJD: Loaded 12977 primary data records. [2025-10-15T22:41:50.920559] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:50.942899] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50966 primary records. [2025-10-15T22:41:50.953172] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-15T22:41:51.048786] [DEBUG] [LOCAL ] SOJE: Loaded 8875 existing records from primary storage. [2025-10-15T22:41:51.050043] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-15T22:41:51.055455] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-15T22:41:51.058786] [INFO ] [MAIN ] SOJE: Loaded 8875 primary data records. [2025-10-15T22:41:51.058677] [INFO ] [MAIN ] Derivative Progress: 1419/1803 symbols completed. SOC took 1.3s. Estimated remaining: 2m 24s. Rate: 159.5 symbols/min [2025-10-15T22:41:51.124724] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:51.561536] [DEBUG] [LOCAL ] SOL: Loaded 13195 existing records from primary storage. [2025-10-15T22:41:51.561799] [INFO ] [MAIN ] SOL: Loaded 13195 primary data records. [2025-10-15T22:41:51.906174] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:51.907276] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12977 primary records. [2025-10-15T22:41:51.907488] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-15T22:41:51.933009] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-15T22:41:51.933379] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-15T22:41:51.947805] [INFO ] [MAIN ] Derivative Progress: 1420/1803 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 24s. Rate: 159.3 symbols/min [2025-10-15T22:41:51.948538] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:51.948821] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:51.950372] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 8875 primary records. [2025-10-15T22:41:51.950847] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-15T22:41:51.968116] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-15T22:41:51.968365] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-15T22:41:51.970864] [INFO ] [MAIN ] Derivative Progress: 1421/1803 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 24s. Rate: 159.4 symbols/min [2025-10-15T22:41:51.971167] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:51.989547] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:51.990337] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13195 primary records. [2025-10-15T22:41:51.990470] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-15T22:41:52.029920] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-15T22:41:52.030089] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-15T22:41:52.030772] [DEBUG] [LOCAL ] SOLV: Loaded 43745 existing records from primary storage. [2025-10-15T22:41:52.034097] [INFO ] [MAIN ] Derivative Progress: 1422/1803 symbols completed. SOL took 0.9s. Estimated remaining: 2m 23s. Rate: 159.5 symbols/min [2025-10-15T22:41:52.034338] [INFO ] [MAIN ] SOLV: Loaded 43745 primary data records. [2025-10-15T22:41:52.034464] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:52.172138] [DEBUG] [LOCAL ] SON: Loaded 43365 existing records from primary storage. [2025-10-15T22:41:52.194115] [INFO ] [MAIN ] SON: Loaded 43365 primary data records. [2025-10-15T22:41:52.614002] [DEBUG] [LOCAL ] SONY: Loaded 53380 existing records from primary storage. [2025-10-15T22:41:52.725820] [INFO ] [MAIN ] SONY: Loaded 53380 primary data records. [2025-10-15T22:41:53.059065] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:53.062693] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43745 primary records. [2025-10-15T22:41:53.063812] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-15T22:41:53.101308] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:53.100518] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-15T22:41:53.101484] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-15T22:41:53.104404] [INFO ] [MAIN ] Derivative Progress: 1423/1803 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 23s. Rate: 159.3 symbols/min [2025-10-15T22:41:53.102251] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43365 primary records. [2025-10-15T22:41:53.104827] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-15T22:41:53.122565] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-15T22:41:53.122691] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-15T22:41:53.125895] [INFO ] [MAIN ] Derivative Progress: 1424/1803 symbols completed. SON took 1.2s. Estimated remaining: 2m 23s. Rate: 159.4 symbols/min [2025-10-15T22:41:53.139284] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:53.139986] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53380 primary records. [2025-10-15T22:41:53.140057] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-15T22:41:53.155673] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-15T22:41:53.155751] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-15T22:41:53.158265] [INFO ] [MAIN ] Derivative Progress: 1425/1803 symbols completed. SONY took 1.1s. Estimated remaining: 2m 22s. Rate: 159.5 symbols/min [2025-10-15T22:41:53.159128] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:53.159020] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:53.159197] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:53.169258] [DEBUG] [LOCAL ] SOR: Loaded 2893 existing records from primary storage. [2025-10-15T22:41:53.169476] [INFO ] [MAIN ] SOR: Loaded 2893 primary data records. [2025-10-15T22:41:53.273950] [DEBUG] [LOCAL ] SOS: Loaded 9468 existing records from primary storage. [2025-10-15T22:41:53.277128] [INFO ] [MAIN ] SOS: Loaded 9468 primary data records. [2025-10-15T22:41:53.658434] [DEBUG] [LOCAL ] SPB: Loaded 34181 existing records from primary storage. [2025-10-15T22:41:53.681413] [INFO ] [MAIN ] SPB: Loaded 34181 primary data records. [2025-10-15T22:41:54.173424] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:54.174499] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2893 primary records. [2025-10-15T22:41:54.175804] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-15T22:41:54.195183] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-15T22:41:54.195423] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-15T22:41:54.197531] [INFO ] [MAIN ] Derivative Progress: 1426/1803 symbols completed. SOR took 1.0s. Estimated remaining: 2m 22s. Rate: 159.3 symbols/min [2025-10-15T22:41:54.197901] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:54.213160] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:54.214475] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 9468 primary records. [2025-10-15T22:41:54.214719] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-15T22:41:54.232084] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-10-15T22:41:54.233247] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-15T22:41:54.235845] [INFO ] [MAIN ] Derivative Progress: 1427/1803 symbols completed. SOS took 1.1s. Estimated remaining: 2m 22s. Rate: 159.4 symbols/min [2025-10-15T22:41:54.236097] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:54.253296] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:54.255903] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34181 primary records. [2025-10-15T22:41:54.266790] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-15T22:41:54.270803] [DEBUG] [LOCAL ] SPE: Loaded 6264 existing records from primary storage. [2025-10-15T22:41:54.271118] [INFO ] [MAIN ] SPE: Loaded 6264 primary data records. [2025-10-15T22:41:54.382548] [DEBUG] [LOCAL ] SPCE: Loaded 49975 existing records from primary storage. [2025-10-15T22:41:54.395033] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-15T22:41:54.402552] [INFO ] [MAIN ] SPCE: Loaded 49975 primary data records. [2025-10-15T22:41:54.405917] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-15T22:41:54.409163] [INFO ] [MAIN ] Derivative Progress: 1428/1803 symbols completed. SPB took 1.2s. Estimated remaining: 2m 21s. Rate: 159.5 symbols/min [2025-10-15T22:41:54.425948] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:54.955241] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:54.969417] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6264 primary records. [2025-10-15T22:41:54.970058] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-15T22:41:54.973848] [DEBUG] [LOCAL ] SPG: Loaded 50225 existing records from primary storage. [2025-10-15T22:41:54.974749] [INFO ] [MAIN ] SPG: Loaded 50225 primary data records. [2025-10-15T22:41:55.075264] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-15T22:41:55.075427] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-15T22:41:55.082999] [INFO ] [MAIN ] Derivative Progress: 1429/1803 symbols completed. SPE took 0.8s. Estimated remaining: 2m 21s. Rate: 159.4 symbols/min [2025-10-15T22:41:55.098909] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:55.128774] [DEBUG] [MAIN ] SPCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:55.152626] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49975 primary records. [2025-10-15T22:41:55.186072] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-15T22:41:55.320317] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-15T22:41:55.320618] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-15T22:41:55.323000] [INFO ] [MAIN ] Derivative Progress: 1430/1803 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 20s. Rate: 159.4 symbols/min [2025-10-15T22:41:55.323297] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:55.377772] [DEBUG] [LOCAL ] SPH: Loaded 16693 existing records from primary storage. [2025-10-15T22:41:55.379227] [DEBUG] [LOCAL ] SPGI: Loaded 45865 existing records from primary storage. [2025-10-15T22:41:55.379353] [INFO ] [MAIN ] SPH: Loaded 16693 primary data records. [2025-10-15T22:41:55.378294] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:55.380331] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50225 primary records. [2025-10-15T22:41:55.379621] [INFO ] [MAIN ] SPGI: Loaded 45865 primary data records. [2025-10-15T22:41:55.385690] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-15T22:41:55.564252] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-15T22:41:55.603312] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-15T22:41:55.632955] [INFO ] [MAIN ] Derivative Progress: 1431/1803 symbols completed. SPG took 1.2s. Estimated remaining: 2m 20s. Rate: 159.5 symbols/min [2025-10-15T22:41:55.679103] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:56.040494] [DEBUG] [LOCAL ] SPHR: Loaded 40567 existing records from primary storage. [2025-10-15T22:41:56.045629] [INFO ] [MAIN ] SPHR: Loaded 40567 primary data records. [2025-10-15T22:41:56.046216] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:56.070463] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:56.080773] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 16693 primary records. [2025-10-15T22:41:56.080881] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-15T22:41:56.097670] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45865 primary records. [2025-10-15T22:41:56.109767] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-15T22:41:56.163924] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-15T22:41:56.170196] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-15T22:41:56.194831] [INFO ] [MAIN ] Derivative Progress: 1432/1803 symbols completed. SPH took 0.9s. Estimated remaining: 2m 20s. Rate: 159.4 symbols/min [2025-10-15T22:41:56.195426] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:56.211895] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-15T22:41:56.217217] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-15T22:41:56.224830] [INFO ] [MAIN ] Derivative Progress: 1433/1803 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 19s. Rate: 159.5 symbols/min [2025-10-15T22:41:56.225136] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:56.465304] [DEBUG] [LOCAL ] SPMC: Loaded 5228 existing records from primary storage. [2025-10-15T22:41:56.477230] [INFO ] [MAIN ] SPMC: Loaded 5228 primary data records. [2025-10-15T22:41:56.599525] [DEBUG] [LOCAL ] SPIR: Loaded 37593 existing records from primary storage. [2025-10-15T22:41:56.604629] [INFO ] [MAIN ] SPIR: Loaded 37593 primary data records. [2025-10-15T22:41:57.141040] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:57.142331] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40567 primary records. [2025-10-15T22:41:57.143931] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-15T22:41:57.168829] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-15T22:41:57.170460] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-15T22:41:57.173173] [INFO ] [MAIN ] Derivative Progress: 1434/1803 symbols completed. SPHR took 1.5s. Estimated remaining: 2m 19s. Rate: 159.3 symbols/min [2025-10-15T22:41:57.173702] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:57.195803] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:57.197027] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5228 primary records. [2025-10-15T22:41:57.197316] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-15T22:41:57.219086] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:57.224807] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37593 primary records. [2025-10-15T22:41:57.226906] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-15T22:41:57.238986] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-15T22:41:57.240275] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-15T22:41:57.243502] [INFO ] [MAIN ] Derivative Progress: 1435/1803 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 19s. Rate: 159.4 symbols/min [2025-10-15T22:41:57.251273] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:57.270944] [DEBUG] [LOCAL ] SPNT: Loaded 34702 existing records from primary storage. [2025-10-15T22:41:57.271118] [INFO ] [MAIN ] SPNT: Loaded 34702 primary data records. [2025-10-15T22:41:57.292807] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-15T22:41:57.314581] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-15T22:41:57.328784] [INFO ] [MAIN ] Derivative Progress: 1436/1803 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 18s. Rate: 159.5 symbols/min [2025-10-15T22:41:57.348983] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:57.623708] [DEBUG] [LOCAL ] SPOT: Loaded 50317 existing records from primary storage. [2025-10-15T22:41:57.624109] [INFO ] [MAIN ] SPOT: Loaded 50317 primary data records. [2025-10-15T22:41:57.693631] [DEBUG] [LOCAL ] SPR: Loaded 41138 existing records from primary storage. [2025-10-15T22:41:57.721393] [INFO ] [MAIN ] SPR: Loaded 41138 primary data records. [2025-10-15T22:41:58.325281] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:58.328466] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34702 primary records. [2025-10-15T22:41:58.328893] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-15T22:41:58.355032] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-15T22:41:58.356608] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-15T22:41:58.359886] [INFO ] [MAIN ] Derivative Progress: 1437/1803 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 18s. Rate: 159.3 symbols/min [2025-10-15T22:41:58.374143] [DEBUG] [MAIN ] SPOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:58.374365] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:58.376493] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50317 primary records. [2025-10-15T22:41:58.376670] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-15T22:41:58.416906] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:58.422308] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-15T22:41:58.423582] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41138 primary records. [2025-10-15T22:41:58.423865] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-15T22:41:58.422134] [DEBUG] [LOCAL ] SPRU: Loaded 9767 existing records from primary storage. [2025-10-15T22:41:58.423997] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-15T22:41:58.424306] [INFO ] [MAIN ] SPRU: Loaded 9767 primary data records. [2025-10-15T22:41:58.426512] [INFO ] [MAIN ] Derivative Progress: 1438/1803 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 17s. Rate: 159.4 symbols/min [2025-10-15T22:41:58.520565] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-15T22:41:58.547842] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-15T22:41:58.550855] [INFO ] [MAIN ] Derivative Progress: 1439/1803 symbols completed. SPR took 1.2s. Estimated remaining: 2m 17s. Rate: 159.5 symbols/min [2025-10-15T22:41:58.799881] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:58.800694] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9767 primary records. [2025-10-15T22:41:58.800763] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-15T22:41:58.816078] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-15T22:41:58.816158] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-15T22:41:58.819384] [INFO ] [MAIN ] Derivative Progress: 1440/1803 symbols completed. SPRU took 0.4s. Estimated remaining: 2m 17s. Rate: 159.5 symbols/min [2025-10-15T22:41:58.820527] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:58.820406] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:58.820238] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:58.834686] [DEBUG] [LOCAL ] SPXX: Loaded 9312 existing records from primary storage. [2025-10-15T22:41:58.834995] [INFO ] [MAIN ] SPXX: Loaded 9312 primary data records. [2025-10-15T22:41:58.979831] [DEBUG] [LOCAL ] SPXC: Loaded 23421 existing records from primary storage. [2025-10-15T22:41:59.015562] [INFO ] [MAIN ] SPXC: Loaded 23421 primary data records. [2025-10-15T22:41:59.271024] [DEBUG] [LOCAL ] SQM: Loaded 48822 existing records from primary storage. [2025-10-15T22:41:59.275706] [INFO ] [MAIN ] SQM: Loaded 48822 primary data records. [2025-10-15T22:41:59.807047] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:59.812881] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9312 primary records. [2025-10-15T22:41:59.813341] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-15T22:41:59.833258] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-15T22:41:59.835322] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-15T22:41:59.838154] [INFO ] [MAIN ] Derivative Progress: 1441/1803 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 16s. Rate: 159.3 symbols/min [2025-10-15T22:41:59.839723] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:59.853929] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:59.854742] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23421 primary records. [2025-10-15T22:41:59.854912] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-15T22:41:59.886148] [DEBUG] [MAIN ] SQM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:41:59.888212] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48822 primary records. [2025-10-15T22:41:59.888408] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-15T22:41:59.912901] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-15T22:41:59.915593] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-15T22:41:59.915908] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-15T22:41:59.916118] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-15T22:41:59.918690] [INFO ] [MAIN ] Derivative Progress: 1442/1803 symbols completed. SQM took 1.1s. Estimated remaining: 2m 16s. Rate: 159.4 symbols/min [2025-10-15T22:41:59.922613] [INFO ] [MAIN ] Derivative Progress: 1443/1803 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 15s. Rate: 159.5 symbols/min [2025-10-15T22:41:59.922425] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:59.923293] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:41:59.933423] [DEBUG] [LOCAL ] SQNS: Loaded 27540 existing records from primary storage. [2025-10-15T22:41:59.933564] [INFO ] [MAIN ] SQNS: Loaded 27540 primary data records. [2025-10-15T22:42:00.124552] [DEBUG] [LOCAL ] SR: Loaded 32516 existing records from primary storage. [2025-10-15T22:42:00.268789] [INFO ] [MAIN ] SR: Loaded 32516 primary data records. [2025-10-15T22:42:00.349815] [DEBUG] [LOCAL ] SRE: Loaded 53420 existing records from primary storage. [2025-10-15T22:42:00.367323] [INFO ] [MAIN ] SRE: Loaded 53420 primary data records. [2025-10-15T22:42:00.916004] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:00.917531] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 27540 primary records. [2025-10-15T22:42:00.918073] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-15T22:42:00.938726] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-15T22:42:00.939230] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-15T22:42:00.941718] [INFO ] [MAIN ] Derivative Progress: 1444/1803 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 15s. Rate: 159.3 symbols/min [2025-10-15T22:42:00.942073] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:00.964757] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:00.969484] [DEBUG] [LOCAL ] SREA: Loaded 10033 existing records from primary storage. [2025-10-15T22:42:00.977147] [INFO ] [MAIN ] SREA: Loaded 10033 primary data records. [2025-10-15T22:42:00.982693] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32516 primary records. [2025-10-15T22:42:00.982986] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:00.994799] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-15T22:42:00.994730] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53420 primary records. [2025-10-15T22:42:00.994910] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-15T22:42:01.091166] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-15T22:42:01.091790] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-15T22:42:01.095317] [INFO ] [MAIN ] Derivative Progress: 1445/1803 symbols completed. SRE took 1.2s. Estimated remaining: 2m 15s. Rate: 159.4 symbols/min [2025-10-15T22:42:01.118856] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-15T22:42:01.114245] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:01.119008] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-15T22:42:01.121611] [INFO ] [MAIN ] Derivative Progress: 1446/1803 symbols completed. SR took 1.2s. Estimated remaining: 2m 14s. Rate: 159.5 symbols/min [2025-10-15T22:42:01.139521] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:01.344563] [DEBUG] [LOCAL ] SRG: Loaded 15416 existing records from primary storage. [2025-10-15T22:42:01.345581] [INFO ] [MAIN ] SRG: Loaded 15416 primary data records. [2025-10-15T22:42:01.429995] [DEBUG] [LOCAL ] SRFM: Loaded 39060 existing records from primary storage. [2025-10-15T22:42:01.442513] [INFO ] [MAIN ] SRFM: Loaded 39060 primary data records. [2025-10-15T22:42:01.981167] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:01.982406] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10033 primary records. [2025-10-15T22:42:01.982685] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-15T22:42:01.999723] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-15T22:42:01.999869] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-15T22:42:02.002225] [INFO ] [MAIN ] Derivative Progress: 1447/1803 symbols completed. SREA took 1.1s. Estimated remaining: 2m 14s. Rate: 159.3 symbols/min [2025-10-15T22:42:02.003447] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:02.019946] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:02.020690] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15416 primary records. [2025-10-15T22:42:02.020852] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-15T22:42:02.046592] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-15T22:42:02.046778] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-15T22:42:02.049138] [INFO ] [MAIN ] Derivative Progress: 1448/1803 symbols completed. SRG took 0.9s. Estimated remaining: 2m 14s. Rate: 159.4 symbols/min [2025-10-15T22:42:02.062047] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:02.061767] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:02.063062] [INFO ] [MAIN ] SRFM: Generated 1793 derivative records from 39060 primary records. [2025-10-15T22:42:02.063702] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-15T22:42:02.085135] [DEBUG] [LOCAL ] SRI: Loaded 26475 existing records from primary storage. [2025-10-15T22:42:02.085271] [INFO ] [MAIN ] SRI: Loaded 26475 primary data records. [2025-10-15T22:42:02.119303] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1793 records). [2025-10-15T22:42:02.154505] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-15T22:42:02.162421] [INFO ] [MAIN ] Derivative Progress: 1449/1803 symbols completed. SRFM took 1.0s. Estimated remaining: 2m 13s. Rate: 159.5 symbols/min [2025-10-15T22:42:02.168841] [DEBUG] [LOCAL ] SRV: Loaded 7403 existing records from primary storage. [2025-10-15T22:42:02.184536] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:02.195012] [INFO ] [MAIN ] SRV: Loaded 7403 primary data records. [2025-10-15T22:42:02.725847] [DEBUG] [LOCAL ] SSB: Loaded 42768 existing records from primary storage. [2025-10-15T22:42:02.726727] [INFO ] [MAIN ] SSB: Loaded 42768 primary data records. [2025-10-15T22:42:02.926255] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:03.014886] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26475 primary records. [2025-10-15T22:42:03.031104] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-15T22:42:03.062965] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-15T22:42:03.063274] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-15T22:42:03.065812] [INFO ] [MAIN ] Derivative Progress: 1450/1803 symbols completed. SRI took 1.1s. Estimated remaining: 2m 13s. Rate: 159.4 symbols/min [2025-10-15T22:42:03.066240] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:03.080187] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:03.082068] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7403 primary records. [2025-10-15T22:42:03.082484] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-15T22:42:03.109191] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-15T22:42:03.121173] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-15T22:42:03.124093] [INFO ] [MAIN ] Derivative Progress: 1451/1803 symbols completed. SRV took 1.1s. Estimated remaining: 2m 12s. Rate: 159.5 symbols/min [2025-10-15T22:42:03.121790] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:03.124394] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:03.125568] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42768 primary records. [2025-10-15T22:42:03.126062] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-15T22:42:03.141578] [DEBUG] [LOCAL ] SSD: Loaded 22608 existing records from primary storage. [2025-10-15T22:42:03.142548] [INFO ] [MAIN ] SSD: Loaded 22608 primary data records. [2025-10-15T22:42:03.317573] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-15T22:42:03.403710] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-15T22:42:03.466125] [INFO ] [MAIN ] Derivative Progress: 1452/1803 symbols completed. SSB took 1.3s. Estimated remaining: 2m 12s. Rate: 159.5 symbols/min [2025-10-15T22:42:03.478204] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:03.480540] [DEBUG] [LOCAL ] SSL: Loaded 41512 existing records from primary storage. [2025-10-15T22:42:03.480765] [INFO ] [MAIN ] SSL: Loaded 41512 primary data records. [2025-10-15T22:42:03.608098] [DEBUG] [LOCAL ] SST: Loaded 11585 existing records from primary storage. [2025-10-15T22:42:03.636549] [INFO ] [MAIN ] SST: Loaded 11585 primary data records. [2025-10-15T22:42:04.141934] [DEBUG] [MAIN ] SSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:04.143858] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22608 primary records. [2025-10-15T22:42:04.144200] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-15T22:42:04.161729] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-10-15T22:42:04.162869] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-15T22:42:04.165051] [INFO ] [MAIN ] Derivative Progress: 1453/1803 symbols completed. SSD took 1.1s. Estimated remaining: 2m 12s. Rate: 159.4 symbols/min [2025-10-15T22:42:04.181541] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:04.182468] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41512 primary records. [2025-10-15T22:42:04.182548] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-15T22:42:04.201850] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-15T22:42:04.214525] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-15T22:42:04.216802] [INFO ] [MAIN ] Derivative Progress: 1454/1803 symbols completed. SSL took 1.1s. Estimated remaining: 2m 11s. Rate: 159.5 symbols/min [2025-10-15T22:42:04.214446] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:04.217610] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11585 primary records. [2025-10-15T22:42:04.217726] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-15T22:42:04.232467] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-15T22:42:04.232543] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-15T22:42:04.235146] [INFO ] [MAIN ] Derivative Progress: 1455/1803 symbols completed. SST took 0.8s. Estimated remaining: 2m 11s. Rate: 159.6 symbols/min [2025-10-15T22:42:04.235540] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:04.235632] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:04.235718] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:04.263188] [DEBUG] [LOCAL ] SSTK: Loaded 25292 existing records from primary storage. [2025-10-15T22:42:04.263340] [INFO ] [MAIN ] SSTK: Loaded 25292 primary data records. [2025-10-15T22:42:04.615354] [DEBUG] [LOCAL ] ST: Loaded 49847 existing records from primary storage. [2025-10-15T22:42:04.615780] [INFO ] [MAIN ] ST: Loaded 49847 primary data records. [2025-10-15T22:42:04.616760] [DEBUG] [LOCAL ] STAG: Loaded 50134 existing records from primary storage. [2025-10-15T22:42:04.628690] [INFO ] [MAIN ] STAG: Loaded 50134 primary data records. [2025-10-15T22:42:05.247696] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:05.248743] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25292 primary records. [2025-10-15T22:42:05.249208] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-15T22:42:05.267318] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-15T22:42:05.267795] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-15T22:42:05.270301] [INFO ] [MAIN ] Derivative Progress: 1456/1803 symbols completed. SSTK took 1.0s. Estimated remaining: 2m 11s. Rate: 159.4 symbols/min [2025-10-15T22:42:05.270588] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:05.288281] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:05.289323] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50134 primary records. [2025-10-15T22:42:05.290354] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-15T22:42:05.324961] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-15T22:42:05.325250] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-15T22:42:05.327394] [INFO ] [MAIN ] Derivative Progress: 1457/1803 symbols completed. STAG took 1.1s. Estimated remaining: 2m 10s. Rate: 159.5 symbols/min [2025-10-15T22:42:05.327832] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:05.327612] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:05.335526] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49847 primary records. [2025-10-15T22:42:05.335822] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-15T22:42:05.336343] [DEBUG] [LOCAL ] STC: Loaded 17323 existing records from primary storage. [2025-10-15T22:42:05.337076] [INFO ] [MAIN ] STC: Loaded 17323 primary data records. [2025-10-15T22:42:05.482865] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-15T22:42:05.504384] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-15T22:42:05.516342] [INFO ] [MAIN ] Derivative Progress: 1458/1803 symbols completed. ST took 1.3s. Estimated remaining: 2m 10s. Rate: 159.5 symbols/min [2025-10-15T22:42:05.522325] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:05.674512] [DEBUG] [LOCAL ] STE: Loaded 35387 existing records from primary storage. [2025-10-15T22:42:05.674942] [INFO ] [MAIN ] STE: Loaded 35387 primary data records. [2025-10-15T22:42:05.817518] [DEBUG] [LOCAL ] STEL: Loaded 22665 existing records from primary storage. [2025-10-15T22:42:05.842355] [INFO ] [MAIN ] STEL: Loaded 22665 primary data records. [2025-10-15T22:42:06.366483] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:06.369967] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17323 primary records. [2025-10-15T22:42:06.371306] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-15T22:42:06.392242] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-15T22:42:06.392751] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-15T22:42:06.395804] [INFO ] [MAIN ] Derivative Progress: 1459/1803 symbols completed. STC took 1.1s. Estimated remaining: 2m 9s. Rate: 159.4 symbols/min [2025-10-15T22:42:06.396458] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:06.421307] [DEBUG] [MAIN ] STE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:06.422592] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35387 primary records. [2025-10-15T22:42:06.435001] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-15T22:42:06.436518] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:06.438878] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22665 primary records. [2025-10-15T22:42:06.446396] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-15T22:42:06.456285] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-15T22:42:06.456937] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-15T22:42:06.480933] [INFO ] [MAIN ] Derivative Progress: 1460/1803 symbols completed. STE took 1.2s. Estimated remaining: 2m 9s. Rate: 159.5 symbols/min [2025-10-15T22:42:06.487430] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:06.491254] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-15T22:42:06.491452] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-15T22:42:06.495321] [INFO ] [MAIN ] Derivative Progress: 1461/1803 symbols completed. STEL took 1.0s. Estimated remaining: 2m 9s. Rate: 159.6 symbols/min [2025-10-15T22:42:06.496556] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:06.511699] [DEBUG] [LOCAL ] STEM: Loaded 38841 existing records from primary storage. [2025-10-15T22:42:06.512100] [INFO ] [MAIN ] STEM: Loaded 38841 primary data records. [2025-10-15T22:42:06.618062] [DEBUG] [LOCAL ] STEW: Loaded 15684 existing records from primary storage. [2025-10-15T22:42:06.626433] [INFO ] [MAIN ] STEW: Loaded 15684 primary data records. [2025-10-15T22:42:06.701673] [DEBUG] [LOCAL ] STK: Loaded 9726 existing records from primary storage. [2025-10-15T22:42:06.736899] [INFO ] [MAIN ] STK: Loaded 9726 primary data records. [2025-10-15T22:42:07.520733] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:07.522179] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 38841 primary records. [2025-10-15T22:42:07.522598] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-15T22:42:07.559957] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-15T22:42:07.560365] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-15T22:42:07.562469] [INFO ] [MAIN ] Derivative Progress: 1462/1803 symbols completed. STEM took 1.2s. Estimated remaining: 2m 8s. Rate: 159.4 symbols/min [2025-10-15T22:42:07.563177] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:07.563050] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:07.579854] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 15684 primary records. [2025-10-15T22:42:07.580245] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:07.581040] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-15T22:42:07.580958] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9726 primary records. [2025-10-15T22:42:07.581551] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-15T22:42:07.606288] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-15T22:42:07.610925] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-15T22:42:07.616061] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-15T22:42:07.616190] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-15T22:42:07.614799] [INFO ] [MAIN ] Derivative Progress: 1463/1803 symbols completed. STK took 1.1s. Estimated remaining: 2m 8s. Rate: 159.5 symbols/min [2025-10-15T22:42:07.619184] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:07.619362] [INFO ] [MAIN ] Derivative Progress: 1464/1803 symbols completed. STEW took 1.1s. Estimated remaining: 2m 7s. Rate: 159.6 symbols/min [2025-10-15T22:42:07.620070] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:07.657471] [DEBUG] [LOCAL ] STN: Loaded 22793 existing records from primary storage. [2025-10-15T22:42:07.657773] [INFO ] [MAIN ] STN: Loaded 22793 primary data records. [2025-10-15T22:42:07.787781] [DEBUG] [LOCAL ] STLA: Loaded 53555 existing records from primary storage. [2025-10-15T22:42:07.788030] [INFO ] [MAIN ] STLA: Loaded 53555 primary data records. [2025-10-15T22:42:08.114311] [DEBUG] [LOCAL ] STM: Loaded 53572 existing records from primary storage. [2025-10-15T22:42:08.148734] [INFO ] [MAIN ] STM: Loaded 53572 primary data records. [2025-10-15T22:42:08.647801] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:08.650312] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22793 primary records. [2025-10-15T22:42:08.650430] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-15T22:42:08.697117] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-15T22:42:08.699735] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-15T22:42:08.700687] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:08.703267] [INFO ] [MAIN ] Derivative Progress: 1465/1803 symbols completed. STN took 1.1s. Estimated remaining: 2m 7s. Rate: 159.4 symbols/min [2025-10-15T22:42:08.704795] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53555 primary records. [2025-10-15T22:42:08.705278] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-15T22:42:08.705462] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:08.752045] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:08.755187] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53572 primary records. [2025-10-15T22:42:08.756021] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-15T22:42:08.756175] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-15T22:42:08.755398] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-15T22:42:08.758576] [INFO ] [MAIN ] Derivative Progress: 1466/1803 symbols completed. STLA took 1.2s. Estimated remaining: 2m 7s. Rate: 159.5 symbols/min [2025-10-15T22:42:08.759219] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:08.803090] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-15T22:42:08.803211] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-15T22:42:08.806173] [INFO ] [MAIN ] Derivative Progress: 1467/1803 symbols completed. STM took 1.2s. Estimated remaining: 2m 6s. Rate: 159.6 symbols/min [2025-10-15T22:42:08.802447] [DEBUG] [LOCAL ] STRV: Loaded 11163 existing records from primary storage. [2025-10-15T22:42:08.806549] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:08.806709] [INFO ] [MAIN ] STRV: Loaded 11163 primary data records. [2025-10-15T22:42:08.957613] [DEBUG] [LOCAL ] STNG: Loaded 43606 existing records from primary storage. [2025-10-15T22:42:08.957892] [INFO ] [MAIN ] STNG: Loaded 43606 primary data records. [2025-10-15T22:42:09.457476] [DEBUG] [LOCAL ] STT: Loaded 51037 existing records from primary storage. [2025-10-15T22:42:09.463693] [INFO ] [MAIN ] STT: Loaded 51037 primary data records. [2025-10-15T22:42:10.033806] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:10.035442] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11163 primary records. [2025-10-15T22:42:10.044795] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-15T22:42:10.051388] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:10.052387] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43606 primary records. [2025-10-15T22:42:10.052578] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-15T22:42:10.081194] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-10-15T22:42:10.081900] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-15T22:42:10.085166] [INFO ] [MAIN ] Derivative Progress: 1468/1803 symbols completed. STRV took 1.3s. Estimated remaining: 2m 6s. Rate: 159.3 symbols/min [2025-10-15T22:42:10.090098] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-15T22:42:10.090783] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-15T22:42:10.093423] [INFO ] [MAIN ] Derivative Progress: 1469/1803 symbols completed. STNG took 1.4s. Estimated remaining: 2m 6s. Rate: 159.4 symbols/min [2025-10-15T22:42:10.106138] [DEBUG] [MAIN ] STT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:10.106712] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51037 primary records. [2025-10-15T22:42:10.106774] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-15T22:42:10.122387] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-15T22:42:10.122454] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-15T22:42:10.126138] [INFO ] [MAIN ] Derivative Progress: 1470/1803 symbols completed. STT took 1.3s. Estimated remaining: 2m 5s. Rate: 159.5 symbols/min [2025-10-15T22:42:10.126627] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:10.126527] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:10.127027] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:10.130911] [DEBUG] [LOCAL ] STXD: Loaded 1243 existing records from primary storage. [2025-10-15T22:42:10.131225] [INFO ] [MAIN ] STXD: Loaded 1243 primary data records. [2025-10-15T22:42:10.480350] [DEBUG] [LOCAL ] STVN: Loaded 26820 existing records from primary storage. [2025-10-15T22:42:10.480542] [INFO ] [MAIN ] STVN: Loaded 26820 primary data records. [2025-10-15T22:42:10.605535] [DEBUG] [LOCAL ] STWD: Loaded 51983 existing records from primary storage. [2025-10-15T22:42:10.643682] [INFO ] [MAIN ] STWD: Loaded 51983 primary data records. [2025-10-15T22:42:10.993077] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:11.001411] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1243 primary records. [2025-10-15T22:42:11.097680] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-15T22:42:11.120061] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-15T22:42:11.120337] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-15T22:42:11.122318] [INFO ] [MAIN ] Derivative Progress: 1471/1803 symbols completed. STXD took 1.0s. Estimated remaining: 2m 5s. Rate: 159.3 symbols/min [2025-10-15T22:42:11.122474] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:11.141301] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:11.144983] [DEBUG] [LOCAL ] STXE: Loaded 2092 existing records from primary storage. [2025-10-15T22:42:11.142191] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26820 primary records. [2025-10-15T22:42:11.145331] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-15T22:42:11.145399] [INFO ] [MAIN ] STXE: Loaded 2092 primary data records. [2025-10-15T22:42:11.206304] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-15T22:42:11.218725] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-15T22:42:11.230575] [INFO ] [MAIN ] Derivative Progress: 1472/1803 symbols completed. STVN took 1.1s. Estimated remaining: 2m 5s. Rate: 159.4 symbols/min [2025-10-15T22:42:11.268311] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:11.474837] [DEBUG] [LOCAL ] STXG: Loaded 2410 existing records from primary storage. [2025-10-15T22:42:11.489163] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:11.489359] [INFO ] [MAIN ] STXG: Loaded 2410 primary data records. [2025-10-15T22:42:11.490382] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51983 primary records. [2025-10-15T22:42:11.503239] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-15T22:42:11.581553] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-15T22:42:11.582084] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-15T22:42:11.585575] [INFO ] [MAIN ] Derivative Progress: 1473/1803 symbols completed. STWD took 1.5s. Estimated remaining: 2m 4s. Rate: 159.4 symbols/min [2025-10-15T22:42:11.591102] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:11.635305] [DEBUG] [LOCAL ] STXK: Loaded 1521 existing records from primary storage. [2025-10-15T22:42:11.681218] [INFO ] [MAIN ] STXK: Loaded 1521 primary data records. [2025-10-15T22:42:12.198022] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:12.199828] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2092 primary records. [2025-10-15T22:42:12.199960] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-15T22:42:12.216295] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-15T22:42:12.216950] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-15T22:42:12.219170] [INFO ] [MAIN ] Derivative Progress: 1474/1803 symbols completed. STXE took 1.1s. Estimated remaining: 2m 4s. Rate: 159.3 symbols/min [2025-10-15T22:42:12.221663] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:12.236576] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:12.237449] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2410 primary records. [2025-10-15T22:42:12.238588] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-15T22:42:12.242672] [DEBUG] [LOCAL ] STXT: Loaded 2491 existing records from primary storage. [2025-10-15T22:42:12.250551] [INFO ] [MAIN ] STXT: Loaded 2491 primary data records. [2025-10-15T22:42:12.326591] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-15T22:42:12.333221] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-15T22:42:12.346006] [INFO ] [MAIN ] Derivative Progress: 1475/1803 symbols completed. STXG took 1.1s. Estimated remaining: 2m 3s. Rate: 159.4 symbols/min [2025-10-15T22:42:12.351574] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:12.442573] [DEBUG] [LOCAL ] STXV: Loaded 1517 existing records from primary storage. [2025-10-15T22:42:12.446443] [INFO ] [MAIN ] STXV: Loaded 1517 primary data records. [2025-10-15T22:42:12.606775] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:12.620986] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1521 primary records. [2025-10-15T22:42:12.621097] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-15T22:42:12.697888] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-15T22:42:12.701421] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-15T22:42:12.704599] [INFO ] [MAIN ] Derivative Progress: 1476/1803 symbols completed. STXK took 1.1s. Estimated remaining: 2m 3s. Rate: 159.4 symbols/min [2025-10-15T22:42:12.705263] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:12.921690] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:12.922500] [INFO ] [MAIN ] STXT: Generated 1794 derivative records from 2491 primary records. [2025-10-15T22:42:12.923185] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-15T22:42:12.938857] [DEBUG] [LOCAL ] STXT: Derivative data saved (1794 records). [2025-10-15T22:42:12.939216] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-15T22:42:12.954631] [INFO ] [MAIN ] Derivative Progress: 1477/1803 symbols completed. STXT took 0.7s. Estimated remaining: 2m 3s. Rate: 159.4 symbols/min [2025-10-15T22:42:12.955114] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:12.974316] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:12.975084] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1517 primary records. [2025-10-15T22:42:12.975268] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-15T22:42:13.004006] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-10-15T22:42:13.004142] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-15T22:42:13.006631] [INFO ] [MAIN ] Derivative Progress: 1478/1803 symbols completed. STXV took 0.7s. Estimated remaining: 2m 2s. Rate: 159.5 symbols/min [2025-10-15T22:42:13.006902] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:13.008275] [DEBUG] [LOCAL ] STZ: Loaded 52414 existing records from primary storage. [2025-10-15T22:42:13.008519] [INFO ] [MAIN ] STZ: Loaded 52414 primary data records. [2025-10-15T22:42:13.337138] [DEBUG] [LOCAL ] SU: Loaded 53426 existing records from primary storage. [2025-10-15T22:42:13.337407] [INFO ] [MAIN ] SU: Loaded 53426 primary data records. [2025-10-15T22:42:13.457793] [DEBUG] [LOCAL ] SUI: Loaded 42096 existing records from primary storage. [2025-10-15T22:42:13.498530] [INFO ] [MAIN ] SUI: Loaded 42096 primary data records. [2025-10-15T22:42:14.019669] [DEBUG] [MAIN ] STZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:14.020689] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52414 primary records. [2025-10-15T22:42:14.021095] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-15T22:42:14.039152] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-15T22:42:14.039635] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-15T22:42:14.043773] [INFO ] [MAIN ] Derivative Progress: 1479/1803 symbols completed. STZ took 1.3s. Estimated remaining: 2m 2s. Rate: 159.4 symbols/min [2025-10-15T22:42:14.044388] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:14.061195] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:14.062136] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53426 primary records. [2025-10-15T22:42:14.062321] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-15T22:42:14.079505] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-15T22:42:14.079629] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-15T22:42:14.083605] [INFO ] [MAIN ] Derivative Progress: 1480/1803 symbols completed. SU took 1.1s. Estimated remaining: 2m 2s. Rate: 159.4 symbols/min [2025-10-15T22:42:14.084773] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:14.112346] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:14.113367] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 42096 primary records. [2025-10-15T22:42:14.124509] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-15T22:42:14.126160] [DEBUG] [LOCAL ] SUN: Loaded 38400 existing records from primary storage. [2025-10-15T22:42:14.137874] [INFO ] [MAIN ] SUN: Loaded 38400 primary data records. [2025-10-15T22:42:14.258133] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-15T22:42:14.258487] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-15T22:42:14.285965] [INFO ] [MAIN ] Derivative Progress: 1481/1803 symbols completed. SUI took 1.3s. Estimated remaining: 2m 1s. Rate: 159.5 symbols/min [2025-10-15T22:42:14.301797] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:14.326571] [DEBUG] [LOCAL ] SUPV: Loaded 47878 existing records from primary storage. [2025-10-15T22:42:14.326709] [INFO ] [MAIN ] SUPV: Loaded 47878 primary data records. [2025-10-15T22:42:14.795889] [DEBUG] [LOCAL ] SUZ: Loaded 45702 existing records from primary storage. [2025-10-15T22:42:14.797055] [INFO ] [MAIN ] SUZ: Loaded 45702 primary data records. [2025-10-15T22:42:14.967899] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:15.118905] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 38400 primary records. [2025-10-15T22:42:15.119796] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-15T22:42:15.137618] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-15T22:42:15.138182] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-15T22:42:15.140493] [INFO ] [MAIN ] Derivative Progress: 1482/1803 symbols completed. SUN took 1.1s. Estimated remaining: 2m 1s. Rate: 159.4 symbols/min [2025-10-15T22:42:15.140909] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:15.157584] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:15.158483] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47878 primary records. [2025-10-15T22:42:15.159488] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-15T22:42:15.178165] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-15T22:42:15.178326] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-15T22:42:15.181325] [INFO ] [MAIN ] Derivative Progress: 1483/1803 symbols completed. SUPV took 1.1s. Estimated remaining: 2m 0s. Rate: 159.5 symbols/min [2025-10-15T22:42:15.206544] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:15.207207] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45702 primary records. [2025-10-15T22:42:15.207318] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-15T22:42:15.232518] [DEBUG] [LOCAL ] SVV: Loaded 40205 existing records from primary storage. [2025-10-15T22:42:15.233859] [INFO ] [MAIN ] SVV: Loaded 40205 primary data records. [2025-10-15T22:42:15.303205] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-15T22:42:15.314034] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-15T22:42:15.336940] [INFO ] [MAIN ] Derivative Progress: 1484/1803 symbols completed. SUZ took 1.0s. Estimated remaining: 1m 60s. Rate: 159.5 symbols/min [2025-10-15T22:42:15.551947] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:15.552744] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 40205 primary records. [2025-10-15T22:42:15.552811] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-15T22:42:15.568838] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-15T22:42:15.568988] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-15T22:42:15.571374] [INFO ] [MAIN ] Derivative Progress: 1485/1803 symbols completed. SVV took 0.4s. Estimated remaining: 1m 60s. Rate: 159.6 symbols/min [2025-10-15T22:42:15.571983] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:15.572054] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:15.572488] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:15.622308] [DEBUG] [LOCAL ] SWX: Loaded 31034 existing records from primary storage. [2025-10-15T22:42:15.622498] [INFO ] [MAIN ] SWX: Loaded 31034 primary data records. [2025-10-15T22:42:15.782838] [DEBUG] [LOCAL ] SWK: Loaded 52481 existing records from primary storage. [2025-10-15T22:42:15.835765] [DEBUG] [LOCAL ] SW: Loaded 53187 existing records from primary storage. [2025-10-15T22:42:15.856363] [INFO ] [MAIN ] SWK: Loaded 52481 primary data records. [2025-10-15T22:42:15.856613] [INFO ] [MAIN ] SW: Loaded 53187 primary data records. [2025-10-15T22:42:16.630933] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:16.632138] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31034 primary records. [2025-10-15T22:42:16.632306] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-15T22:42:16.662843] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-15T22:42:16.668484] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-15T22:42:16.668389] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:16.671981] [INFO ] [MAIN ] Derivative Progress: 1486/1803 symbols completed. SWX took 1.1s. Estimated remaining: 1m 59s. Rate: 159.4 symbols/min [2025-10-15T22:42:16.672258] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:16.673245] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52481 primary records. [2025-10-15T22:42:16.673828] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-15T22:42:16.687383] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:16.699995] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53187 primary records. [2025-10-15T22:42:16.703225] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-15T22:42:16.720227] [DEBUG] [LOCAL ] SWZ: Loaded 6053 existing records from primary storage. [2025-10-15T22:42:16.720683] [INFO ] [MAIN ] SWZ: Loaded 6053 primary data records. [2025-10-15T22:42:16.760908] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-15T22:42:16.781374] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-15T22:42:16.793151] [INFO ] [MAIN ] Derivative Progress: 1487/1803 symbols completed. SWK took 1.2s. Estimated remaining: 1m 59s. Rate: 159.4 symbols/min [2025-10-15T22:42:16.798473] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:16.811087] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-15T22:42:16.811216] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-15T22:42:16.820750] [INFO ] [MAIN ] Derivative Progress: 1488/1803 symbols completed. SW took 1.2s. Estimated remaining: 1m 58s. Rate: 159.5 symbols/min [2025-10-15T22:42:16.829463] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:17.057370] [DEBUG] [LOCAL ] SXI: Loaded 11953 existing records from primary storage. [2025-10-15T22:42:17.057614] [INFO ] [MAIN ] SXI: Loaded 11953 primary data records. [2025-10-15T22:42:17.214484] [DEBUG] [LOCAL ] SXC: Loaded 41635 existing records from primary storage. [2025-10-15T22:42:17.241792] [INFO ] [MAIN ] SXC: Loaded 41635 primary data records. [2025-10-15T22:42:17.712286] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:17.713942] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6053 primary records. [2025-10-15T22:42:17.714137] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-15T22:42:17.732026] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-15T22:42:17.733160] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-15T22:42:17.736568] [INFO ] [MAIN ] Derivative Progress: 1489/1803 symbols completed. SWZ took 1.1s. Estimated remaining: 1m 58s. Rate: 159.4 symbols/min [2025-10-15T22:42:17.736916] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:17.750866] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:17.751574] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11953 primary records. [2025-10-15T22:42:17.751893] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-15T22:42:17.769664] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-15T22:42:17.769914] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-15T22:42:17.772268] [INFO ] [MAIN ] Derivative Progress: 1490/1803 symbols completed. SXI took 0.9s. Estimated remaining: 1m 58s. Rate: 159.5 symbols/min [2025-10-15T22:42:17.772496] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:17.786079] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:17.794770] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41635 primary records. [2025-10-15T22:42:17.795014] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-15T22:42:17.818753] [DEBUG] [LOCAL ] SXT: Loaded 29865 existing records from primary storage. [2025-10-15T22:42:17.819964] [INFO ] [MAIN ] SXT: Loaded 29865 primary data records. [2025-10-15T22:42:17.881133] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-15T22:42:17.901424] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-15T22:42:17.930411] [INFO ] [MAIN ] Derivative Progress: 1491/1803 symbols completed. SXC took 1.1s. Estimated remaining: 1m 57s. Rate: 159.5 symbols/min [2025-10-15T22:42:17.930811] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:18.183995] [DEBUG] [LOCAL ] SYF: Loaded 53454 existing records from primary storage. [2025-10-15T22:42:18.184276] [INFO ] [MAIN ] SYF: Loaded 53454 primary data records. [2025-10-15T22:42:18.517936] [DEBUG] [LOCAL ] SYK: Loaded 46942 existing records from primary storage. [2025-10-15T22:42:18.518359] [INFO ] [MAIN ] SYK: Loaded 46942 primary data records. [2025-10-15T22:42:18.719404] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:18.838455] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29865 primary records. [2025-10-15T22:42:18.838678] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-15T22:42:18.862149] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-15T22:42:18.862717] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-15T22:42:18.864978] [INFO ] [MAIN ] Derivative Progress: 1492/1803 symbols completed. SXT took 1.1s. Estimated remaining: 1m 57s. Rate: 159.4 symbols/min [2025-10-15T22:42:18.877728] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:18.878264] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:18.879499] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53454 primary records. [2025-10-15T22:42:18.879903] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-15T22:42:18.899125] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-15T22:42:18.899304] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-15T22:42:18.902385] [INFO ] [MAIN ] Derivative Progress: 1493/1803 symbols completed. SYF took 1.1s. Estimated remaining: 1m 57s. Rate: 159.5 symbols/min [2025-10-15T22:42:18.916153] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:18.916503] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:18.917727] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46942 primary records. [2025-10-15T22:42:18.917794] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-15T22:42:18.934177] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-15T22:42:18.947683] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-15T22:42:18.950259] [INFO ] [MAIN ] Derivative Progress: 1494/1803 symbols completed. SYK took 1.0s. Estimated remaining: 1m 56s. Rate: 159.6 symbols/min [2025-10-15T22:42:18.950445] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:18.971593] [DEBUG] [LOCAL ] SYY: Loaded 53219 existing records from primary storage. [2025-10-15T22:42:18.972004] [INFO ] [MAIN ] SYY: Loaded 53219 primary data records. [2025-10-15T22:42:19.311978] [DEBUG] [LOCAL ] TAC: Loaded 43086 existing records from primary storage. [2025-10-15T22:42:19.312215] [INFO ] [MAIN ] TAC: Loaded 43086 primary data records. [2025-10-15T22:42:19.313318] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-15T22:42:19.313498] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-15T22:42:19.981849] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:19.983007] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53219 primary records. [2025-10-15T22:42:19.983101] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-15T22:42:20.002521] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-15T22:42:20.002808] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-15T22:42:20.005102] [INFO ] [MAIN ] Derivative Progress: 1495/1803 symbols completed. SYY took 1.1s. Estimated remaining: 1m 56s. Rate: 159.4 symbols/min [2025-10-15T22:42:20.005687] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:20.026505] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:20.034986] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 43086 primary records. [2025-10-15T22:42:20.039907] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-15T22:42:20.041333] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:20.042510] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-15T22:42:20.053462] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-15T22:42:20.082331] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-15T22:42:20.085632] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-15T22:42:20.085752] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-15T22:42:20.084867] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-15T22:42:20.089596] [INFO ] [MAIN ] Derivative Progress: 1496/1803 symbols completed. T took 1.2s. Estimated remaining: 1m 56s. Rate: 159.5 symbols/min [2025-10-15T22:42:20.092215] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:20.092336] [INFO ] [MAIN ] Derivative Progress: 1497/1803 symbols completed. TAC took 1.1s. Estimated remaining: 1m 55s. Rate: 159.6 symbols/min [2025-10-15T22:42:20.092588] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:20.110172] [DEBUG] [LOCAL ] TAK: Loaded 50163 existing records from primary storage. [2025-10-15T22:42:20.110393] [INFO ] [MAIN ] TAK: Loaded 50163 primary data records. [2025-10-15T22:42:20.445422] [DEBUG] [LOCAL ] TALO: Loaded 50983 existing records from primary storage. [2025-10-15T22:42:20.461609] [INFO ] [MAIN ] TALO: Loaded 50983 primary data records. [2025-10-15T22:42:20.463292] [DEBUG] [LOCAL ] TAL: Loaded 51791 existing records from primary storage. [2025-10-15T22:42:20.498929] [INFO ] [MAIN ] TAL: Loaded 51791 primary data records. [2025-10-15T22:42:21.081096] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:21.082063] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 50163 primary records. [2025-10-15T22:42:21.082757] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-15T22:42:21.104369] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-15T22:42:21.104903] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-15T22:42:21.107296] [INFO ] [MAIN ] Derivative Progress: 1498/1803 symbols completed. TAK took 1.1s. Estimated remaining: 1m 55s. Rate: 159.4 symbols/min [2025-10-15T22:42:21.127038] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:21.127974] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50983 primary records. [2025-10-15T22:42:21.128266] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-15T22:42:21.158489] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-15T22:42:21.158745] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-15T22:42:21.161068] [INFO ] [MAIN ] Derivative Progress: 1499/1803 symbols completed. TALO took 1.1s. Estimated remaining: 1m 54s. Rate: 159.5 symbols/min [2025-10-15T22:42:21.159031] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:21.161879] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51791 primary records. [2025-10-15T22:42:21.161949] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-15T22:42:21.177554] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-15T22:42:21.177858] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-15T22:42:21.180678] [INFO ] [MAIN ] Derivative Progress: 1500/1803 symbols completed. TAL took 1.1s. Estimated remaining: 1m 54s. Rate: 159.6 symbols/min [2025-10-15T22:42:21.181123] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:21.181267] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:21.181070] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:21.195860] [DEBUG] [LOCAL ] TBB: Loaded 11523 existing records from primary storage. [2025-10-15T22:42:21.196062] [INFO ] [MAIN ] TBB: Loaded 11523 primary data records. [2025-10-15T22:42:21.363175] [DEBUG] [LOCAL ] TBBB: Loaded 35786 existing records from primary storage. [2025-10-15T22:42:21.384589] [INFO ] [MAIN ] TBBB: Loaded 35786 primary data records. [2025-10-15T22:42:21.674267] [DEBUG] [LOCAL ] TAP: Loaded 52965 existing records from primary storage. [2025-10-15T22:42:21.687332] [INFO ] [MAIN ] TAP: Loaded 52965 primary data records. [2025-10-15T22:42:22.203154] [DEBUG] [MAIN ] TBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:22.204322] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11523 primary records. [2025-10-15T22:42:22.205029] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-15T22:42:22.221517] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-15T22:42:22.221989] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-15T22:42:22.224722] [INFO ] [MAIN ] Derivative Progress: 1501/1803 symbols completed. TBB took 1.0s. Estimated remaining: 1m 54s. Rate: 159.4 symbols/min [2025-10-15T22:42:22.225843] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:22.244272] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:22.245179] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35786 primary records. [2025-10-15T22:42:22.245406] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-15T22:42:22.267476] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-15T22:42:22.267874] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-15T22:42:22.270083] [INFO ] [MAIN ] Derivative Progress: 1502/1803 symbols completed. TBBB took 1.1s. Estimated remaining: 1m 53s. Rate: 159.5 symbols/min [2025-10-15T22:42:22.276589] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:22.279042] [DEBUG] [LOCAL ] TBI: Loaded 22558 existing records from primary storage. [2025-10-15T22:42:22.280689] [INFO ] [MAIN ] TBI: Loaded 22558 primary data records. [2025-10-15T22:42:22.373853] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:22.385193] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52965 primary records. [2025-10-15T22:42:22.392748] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-15T22:42:22.399337] [DEBUG] [LOCAL ] TBN: Loaded 3962 existing records from primary storage. [2025-10-15T22:42:22.410229] [INFO ] [MAIN ] TBN: Loaded 3962 primary data records. [2025-10-15T22:42:22.771254] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-15T22:42:22.796001] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-15T22:42:22.805468] [INFO ] [MAIN ] Derivative Progress: 1503/1803 symbols completed. TAP took 1.6s. Estimated remaining: 1m 53s. Rate: 159.4 symbols/min [2025-10-15T22:42:22.831737] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:22.931214] [DEBUG] [LOCAL ] TCBX: Loaded 10141 existing records from primary storage. [2025-10-15T22:42:22.931495] [INFO ] [MAIN ] TCBX: Loaded 10141 primary data records. [2025-10-15T22:42:23.073989] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:23.112202] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22558 primary records. [2025-10-15T22:42:23.135702] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-15T22:42:23.271419] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-15T22:42:23.272197] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-15T22:42:23.275481] [INFO ] [MAIN ] Derivative Progress: 1504/1803 symbols completed. TBI took 1.0s. Estimated remaining: 1m 53s. Rate: 159.4 symbols/min [2025-10-15T22:42:23.277083] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:23.293779] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:23.294681] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 3962 primary records. [2025-10-15T22:42:23.294881] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-15T22:42:23.309715] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-10-15T22:42:23.309953] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-15T22:42:23.314792] [INFO ] [MAIN ] Derivative Progress: 1505/1803 symbols completed. TBN took 1.0s. Estimated remaining: 1m 52s. Rate: 159.5 symbols/min [2025-10-15T22:42:23.316550] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:23.329929] [DEBUG] [MAIN ] TCBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:23.330747] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10141 primary records. [2025-10-15T22:42:23.330912] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-15T22:42:23.346201] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-15T22:42:23.346284] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-15T22:42:23.362152] [INFO ] [MAIN ] Derivative Progress: 1506/1803 symbols completed. TCBX took 0.5s. Estimated remaining: 1m 52s. Rate: 159.6 symbols/min [2025-10-15T22:42:23.362399] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:23.371870] [DEBUG] [LOCAL ] TDF: Loaded 6346 existing records from primary storage. [2025-10-15T22:42:23.372681] [INFO ] [MAIN ] TDF: Loaded 6346 primary data records. [2025-10-15T22:42:23.439972] [DEBUG] [LOCAL ] TD: Loaded 52329 existing records from primary storage. [2025-10-15T22:42:23.460517] [INFO ] [MAIN ] TD: Loaded 52329 primary data records. [2025-10-15T22:42:23.529057] [DEBUG] [LOCAL ] TDC: Loaded 46556 existing records from primary storage. [2025-10-15T22:42:23.595835] [INFO ] [MAIN ] TDC: Loaded 46556 primary data records. [2025-10-15T22:42:24.369404] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:24.370263] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6346 primary records. [2025-10-15T22:42:24.370590] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-15T22:42:24.386707] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-15T22:42:24.388310] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-15T22:42:24.390566] [INFO ] [MAIN ] Derivative Progress: 1507/1803 symbols completed. TDF took 1.0s. Estimated remaining: 1m 51s. Rate: 159.4 symbols/min [2025-10-15T22:42:24.390911] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:24.405970] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:24.408596] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52329 primary records. [2025-10-15T22:42:24.408845] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-15T22:42:24.434197] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:24.437175] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46556 primary records. [2025-10-15T22:42:24.444222] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-15T22:42:24.445436] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-15T22:42:24.445817] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-15T22:42:24.448407] [INFO ] [MAIN ] Derivative Progress: 1508/1803 symbols completed. TD took 1.2s. Estimated remaining: 1m 51s. Rate: 159.5 symbols/min [2025-10-15T22:42:24.456891] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:24.468021] [DEBUG] [LOCAL ] TDG: Loaded 22140 existing records from primary storage. [2025-10-15T22:42:24.472050] [INFO ] [MAIN ] TDG: Loaded 22140 primary data records. [2025-10-15T22:42:24.471947] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-15T22:42:24.472223] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-15T22:42:24.474958] [INFO ] [MAIN ] Derivative Progress: 1509/1803 symbols completed. TDC took 1.2s. Estimated remaining: 1m 51s. Rate: 159.6 symbols/min [2025-10-15T22:42:24.475162] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:24.807896] [DEBUG] [LOCAL ] TDS: Loaded 42515 existing records from primary storage. [2025-10-15T22:42:24.823260] [INFO ] [MAIN ] TDS: Loaded 42515 primary data records. [2025-10-15T22:42:24.835242] [DEBUG] [LOCAL ] TDOC: Loaded 53365 existing records from primary storage. [2025-10-15T22:42:24.854784] [INFO ] [MAIN ] TDOC: Loaded 53365 primary data records. [2025-10-15T22:42:25.436461] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:25.437316] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22140 primary records. [2025-10-15T22:42:25.437543] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-15T22:42:25.454763] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-15T22:42:25.455059] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-15T22:42:25.457392] [INFO ] [MAIN ] Derivative Progress: 1510/1803 symbols completed. TDG took 1.1s. Estimated remaining: 1m 50s. Rate: 159.4 symbols/min [2025-10-15T22:42:25.457873] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:25.474671] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:25.475471] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42515 primary records. [2025-10-15T22:42:25.475668] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-15T22:42:25.506508] [DEBUG] [MAIN ] TDOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:25.507450] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53365 primary records. [2025-10-15T22:42:25.507932] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-15T22:42:25.508019] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-15T22:42:25.508106] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-15T22:42:25.510682] [INFO ] [MAIN ] Derivative Progress: 1511/1803 symbols completed. TDS took 1.0s. Estimated remaining: 1m 50s. Rate: 159.5 symbols/min [2025-10-15T22:42:25.510831] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:25.537313] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-15T22:42:25.537442] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-15T22:42:25.540088] [INFO ] [MAIN ] Derivative Progress: 1512/1803 symbols completed. TDOC took 1.1s. Estimated remaining: 1m 49s. Rate: 159.6 symbols/min [2025-10-15T22:42:25.541309] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:25.560205] [DEBUG] [LOCAL ] TDW: Loaded 45036 existing records from primary storage. [2025-10-15T22:42:25.560514] [INFO ] [MAIN ] TDW: Loaded 45036 primary data records. [2025-10-15T22:42:25.638568] [DEBUG] [LOCAL ] TDY: Loaded 22260 existing records from primary storage. [2025-10-15T22:42:25.658319] [INFO ] [MAIN ] TDY: Loaded 22260 primary data records. [2025-10-15T22:42:25.671350] [DEBUG] [LOCAL ] TEAF: Loaded 7411 existing records from primary storage. [2025-10-15T22:42:25.705353] [INFO ] [MAIN ] TEAF: Loaded 7411 primary data records. [2025-10-15T22:42:26.509334] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:26.510413] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45036 primary records. [2025-10-15T22:42:26.510518] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-15T22:42:26.530499] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-15T22:42:26.530690] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-15T22:42:26.541577] [INFO ] [MAIN ] Derivative Progress: 1513/1803 symbols completed. TDW took 1.1s. Estimated remaining: 1m 49s. Rate: 159.4 symbols/min [2025-10-15T22:42:26.549014] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:26.562549] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7411 primary records. [2025-10-15T22:42:26.563035] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-15T22:42:26.562910] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:26.564595] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22260 primary records. [2025-10-15T22:42:26.564765] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-15T22:42:26.595411] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-15T22:42:26.595722] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-15T22:42:26.595931] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-15T22:42:26.596001] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-15T22:42:26.598904] [INFO ] [MAIN ] Derivative Progress: 1514/1803 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 49s. Rate: 159.5 symbols/min [2025-10-15T22:42:26.601584] [INFO ] [MAIN ] Derivative Progress: 1515/1803 symbols completed. TDY took 1.1s. Estimated remaining: 1m 48s. Rate: 159.6 symbols/min [2025-10-15T22:42:26.602404] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:26.602549] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:26.602298] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:26.623104] [DEBUG] [LOCAL ] TEI: Loaded 21312 existing records from primary storage. [2025-10-15T22:42:26.623261] [INFO ] [MAIN ] TEI: Loaded 21312 primary data records. [2025-10-15T22:42:26.770329] [DEBUG] [LOCAL ] TEF: Loaded 36958 existing records from primary storage. [2025-10-15T22:42:26.804727] [INFO ] [MAIN ] TEF: Loaded 36958 primary data records. [2025-10-15T22:42:27.053024] [DEBUG] [LOCAL ] TECK: Loaded 53434 existing records from primary storage. [2025-10-15T22:42:27.076026] [INFO ] [MAIN ] TECK: Loaded 53434 primary data records. [2025-10-15T22:42:27.609957] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:27.611670] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21312 primary records. [2025-10-15T22:42:27.611942] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-15T22:42:27.640154] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:27.641201] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 36958 primary records. [2025-10-15T22:42:27.643410] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-15T22:42:27.644130] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-15T22:42:27.643129] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-15T22:42:27.646520] [INFO ] [MAIN ] Derivative Progress: 1516/1803 symbols completed. TEI took 1.0s. Estimated remaining: 1m 48s. Rate: 159.4 symbols/min [2025-10-15T22:42:27.659439] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:27.670256] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:27.670968] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53434 primary records. [2025-10-15T22:42:27.675005] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-15T22:42:27.674031] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-15T22:42:27.675754] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-15T22:42:27.678199] [INFO ] [MAIN ] Derivative Progress: 1517/1803 symbols completed. TEF took 1.1s. Estimated remaining: 1m 48s. Rate: 159.5 symbols/min [2025-10-15T22:42:27.678846] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:27.695052] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-15T22:42:27.695212] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-15T22:42:27.699512] [INFO ] [MAIN ] Derivative Progress: 1518/1803 symbols completed. TECK took 1.1s. Estimated remaining: 1m 47s. Rate: 159.6 symbols/min [2025-10-15T22:42:27.699758] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:27.743294] [DEBUG] [LOCAL ] TEN: Loaded 30592 existing records from primary storage. [2025-10-15T22:42:27.743562] [INFO ] [MAIN ] TEN: Loaded 30592 primary data records. [2025-10-15T22:42:27.782688] [DEBUG] [LOCAL ] TEO: Loaded 22500 existing records from primary storage. [2025-10-15T22:42:27.782827] [INFO ] [MAIN ] TEO: Loaded 22500 primary data records. [2025-10-15T22:42:27.866733] [DEBUG] [LOCAL ] TEL: Loaded 51067 existing records from primary storage. [2025-10-15T22:42:27.909486] [INFO ] [MAIN ] TEL: Loaded 51067 primary data records. [2025-10-15T22:42:28.702156] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:28.702938] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30592 primary records. [2025-10-15T22:42:28.703108] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-15T22:42:28.747260] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-15T22:42:28.747533] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-15T22:42:28.749385] [INFO ] [MAIN ] Derivative Progress: 1519/1803 symbols completed. TEN took 1.1s. Estimated remaining: 1m 47s. Rate: 159.5 symbols/min [2025-10-15T22:42:28.749800] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:28.749924] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:28.750412] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:28.751177] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51067 primary records. [2025-10-15T22:42:28.752055] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22500 primary records. [2025-10-15T22:42:28.752154] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-15T22:42:28.752233] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-15T22:42:28.784394] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-15T22:42:28.784877] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-15T22:42:28.787455] [INFO ] [MAIN ] Derivative Progress: 1520/1803 symbols completed. TEL took 1.1s. Estimated remaining: 1m 46s. Rate: 159.5 symbols/min [2025-10-15T22:42:28.783482] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-15T22:42:28.787843] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-15T22:42:28.790617] [INFO ] [MAIN ] Derivative Progress: 1521/1803 symbols completed. TEO took 1.1s. Estimated remaining: 1m 46s. Rate: 159.6 symbols/min [2025-10-15T22:42:28.787659] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:28.790793] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:28.840827] [DEBUG] [LOCAL ] TEVA: Loaded 53627 existing records from primary storage. [2025-10-15T22:42:28.841045] [INFO ] [MAIN ] TEVA: Loaded 53627 primary data records. [2025-10-15T22:42:28.970531] [DEBUG] [LOCAL ] TEX: Loaded 43861 existing records from primary storage. [2025-10-15T22:42:28.976084] [INFO ] [MAIN ] TEX: Loaded 43861 primary data records. [2025-10-15T22:42:29.030086] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-15T22:42:29.084709] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-15T22:42:29.872337] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:29.873616] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53627 primary records. [2025-10-15T22:42:29.873988] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-15T22:42:29.909046] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-15T22:42:29.909596] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-15T22:42:29.911710] [INFO ] [MAIN ] Derivative Progress: 1522/1803 symbols completed. TEVA took 1.2s. Estimated remaining: 1m 46s. Rate: 159.4 symbols/min [2025-10-15T22:42:29.909269] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:29.924585] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 43861 primary records. [2025-10-15T22:42:29.925037] [DEBUG] [MAIN ] TFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:29.925929] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-15T22:42:29.925314] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-15T22:42:29.925179] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:29.926018] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-15T22:42:29.955959] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-15T22:42:29.958315] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-15T22:42:29.958133] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-15T22:42:29.961002] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-15T22:42:29.960850] [INFO ] [MAIN ] Derivative Progress: 1523/1803 symbols completed. TEX took 1.2s. Estimated remaining: 1m 45s. Rate: 159.5 symbols/min [2025-10-15T22:42:29.964500] [INFO ] [MAIN ] Derivative Progress: 1524/1803 symbols completed. TFC took 1.2s. Estimated remaining: 1m 45s. Rate: 159.6 symbols/min [2025-10-15T22:42:29.964386] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:29.964801] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:29.994985] [DEBUG] [LOCAL ] TFII: Loaded 32821 existing records from primary storage. [2025-10-15T22:42:29.995150] [INFO ] [MAIN ] TFII: Loaded 32821 primary data records. [2025-10-15T22:42:30.092179] [DEBUG] [LOCAL ] TFIN: Loaded 23600 existing records from primary storage. [2025-10-15T22:42:30.109805] [INFO ] [MAIN ] TFIN: Loaded 23600 primary data records. [2025-10-15T22:42:30.185937] [DEBUG] [LOCAL ] TFPM: Loaded 39427 existing records from primary storage. [2025-10-15T22:42:30.230065] [INFO ] [MAIN ] TFPM: Loaded 39427 primary data records. [2025-10-15T22:42:30.934932] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:30.936158] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 32821 primary records. [2025-10-15T22:42:30.936362] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-15T22:42:30.956614] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-15T22:42:30.969271] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-15T22:42:30.971722] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:30.972627] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23600 primary records. [2025-10-15T22:42:30.971337] [INFO ] [MAIN ] Derivative Progress: 1525/1803 symbols completed. TFII took 1.0s. Estimated remaining: 1m 45s. Rate: 159.5 symbols/min [2025-10-15T22:42:30.973042] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:30.972952] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-15T22:42:30.990176] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-15T22:42:30.991971] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-15T22:42:30.995326] [INFO ] [MAIN ] Derivative Progress: 1526/1803 symbols completed. TFIN took 1.0s. Estimated remaining: 1m 44s. Rate: 159.6 symbols/min [2025-10-15T22:42:30.995611] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:31.009157] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:31.009869] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 39427 primary records. [2025-10-15T22:42:31.010050] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-15T22:42:31.029809] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-15T22:42:31.034190] [DEBUG] [LOCAL ] TG: Loaded 10520 existing records from primary storage. [2025-10-15T22:42:31.034391] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-15T22:42:31.034312] [INFO ] [MAIN ] TG: Loaded 10520 primary data records. [2025-10-15T22:42:31.044986] [INFO ] [MAIN ] Derivative Progress: 1527/1803 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 44s. Rate: 159.6 symbols/min [2025-10-15T22:42:31.076203] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:31.160073] [DEBUG] [LOCAL ] TFX: Loaded 36207 existing records from primary storage. [2025-10-15T22:42:31.165859] [INFO ] [MAIN ] TFX: Loaded 36207 primary data records. [2025-10-15T22:42:31.503448] [DEBUG] [LOCAL ] TGLS: Loaded 27631 existing records from primary storage. [2025-10-15T22:42:31.533271] [INFO ] [MAIN ] TGLS: Loaded 27631 primary data records. [2025-10-15T22:42:32.034373] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:32.036416] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10520 primary records. [2025-10-15T22:42:32.036791] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-15T22:42:32.055608] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-15T22:42:32.056142] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-15T22:42:32.070907] [INFO ] [MAIN ] Derivative Progress: 1528/1803 symbols completed. TG took 1.1s. Estimated remaining: 1m 43s. Rate: 159.5 symbols/min [2025-10-15T22:42:32.071350] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:32.072691] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 36207 primary records. [2025-10-15T22:42:32.073635] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-15T22:42:32.104464] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-15T22:42:32.104568] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-15T22:42:32.107189] [INFO ] [MAIN ] Derivative Progress: 1529/1803 symbols completed. TFX took 1.1s. Estimated remaining: 1m 43s. Rate: 159.6 symbols/min [2025-10-15T22:42:32.103210] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:32.108146] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27631 primary records. [2025-10-15T22:42:32.108293] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-15T22:42:32.123244] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-15T22:42:32.123304] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-15T22:42:32.126289] [INFO ] [MAIN ] Derivative Progress: 1530/1803 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 43s. Rate: 159.7 symbols/min [2025-10-15T22:42:32.126705] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:32.127176] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:32.126806] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:32.188277] [DEBUG] [LOCAL ] TGNA: Loaded 48617 existing records from primary storage. [2025-10-15T22:42:32.201913] [INFO ] [MAIN ] TGNA: Loaded 48617 primary data records. [2025-10-15T22:42:32.202785] [DEBUG] [LOCAL ] TGS: Loaded 33583 existing records from primary storage. [2025-10-15T22:42:32.233765] [INFO ] [MAIN ] TGS: Loaded 33583 primary data records. [2025-10-15T22:42:32.476812] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-15T22:42:32.602961] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-15T22:42:33.129613] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:33.130816] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48617 primary records. [2025-10-15T22:42:33.131111] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-15T22:42:33.152355] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-15T22:42:33.152679] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-15T22:42:33.155662] [INFO ] [MAIN ] Derivative Progress: 1531/1803 symbols completed. TGNA took 1.0s. Estimated remaining: 1m 42s. Rate: 159.5 symbols/min [2025-10-15T22:42:33.163833] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:33.169733] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:33.170479] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 33583 primary records. [2025-10-15T22:42:33.170675] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-15T22:42:33.207208] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:33.207936] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-15T22:42:33.208938] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-15T22:42:33.208861] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-15T22:42:33.211536] [INFO ] [MAIN ] Derivative Progress: 1532/1803 symbols completed. TGS took 1.1s. Estimated remaining: 1m 42s. Rate: 159.6 symbols/min [2025-10-15T22:42:33.211945] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-15T22:42:33.211826] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:33.231051] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-15T22:42:33.231283] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-15T22:42:33.234189] [INFO ] [MAIN ] Derivative Progress: 1533/1803 symbols completed. TGT took 1.1s. Estimated remaining: 1m 41s. Rate: 159.7 symbols/min [2025-10-15T22:42:33.246103] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:33.255181] [DEBUG] [LOCAL ] THIR: Loaded 2374 existing records from primary storage. [2025-10-15T22:42:33.255408] [INFO ] [MAIN ] THIR: Loaded 2374 primary data records. [2025-10-15T22:42:33.344514] [DEBUG] [LOCAL ] THG: Loaded 21713 existing records from primary storage. [2025-10-15T22:42:33.344732] [INFO ] [MAIN ] THG: Loaded 21713 primary data records. [2025-10-15T22:42:33.368058] [DEBUG] [LOCAL ] THC: Loaded 47056 existing records from primary storage. [2025-10-15T22:42:33.378538] [INFO ] [MAIN ] THC: Loaded 47056 primary data records. [2025-10-15T22:42:34.211635] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7729 incomplete bins [2025-10-15T22:42:34.212745] [INFO ] [MAIN ] THIR: Generated 1789 derivative records from 2374 primary records. [2025-10-15T22:42:34.213219] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-15T22:42:34.228991] [DEBUG] [LOCAL ] THIR: Derivative data saved (1789 records). [2025-10-15T22:42:34.229907] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-15T22:42:34.232023] [INFO ] [MAIN ] Derivative Progress: 1534/1803 symbols completed. THIR took 1.0s. Estimated remaining: 1m 41s. Rate: 159.5 symbols/min [2025-10-15T22:42:34.232276] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:34.248193] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:34.249187] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21713 primary records. [2025-10-15T22:42:34.249632] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-15T22:42:34.263831] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:34.275639] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47056 primary records. [2025-10-15T22:42:34.278110] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-15T22:42:34.278041] [DEBUG] [LOCAL ] THLV: Loaded 1510 existing records from primary storage. [2025-10-15T22:42:34.279677] [INFO ] [MAIN ] THLV: Loaded 1510 primary data records. [2025-10-15T22:42:34.283434] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-15T22:42:34.342801] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-15T22:42:34.352003] [INFO ] [MAIN ] Derivative Progress: 1535/1803 symbols completed. THG took 1.1s. Estimated remaining: 1m 41s. Rate: 159.6 symbols/min [2025-10-15T22:42:34.365587] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:34.405232] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-15T22:42:34.411103] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-15T22:42:34.414380] [INFO ] [MAIN ] Derivative Progress: 1536/1803 symbols completed. THC took 1.3s. Estimated remaining: 1m 40s. Rate: 159.7 symbols/min [2025-10-15T22:42:34.419715] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:34.641423] [DEBUG] [LOCAL ] THO: Loaded 41458 existing records from primary storage. [2025-10-15T22:42:34.642112] [INFO ] [MAIN ] THO: Loaded 41458 primary data records. [2025-10-15T22:42:34.642007] [DEBUG] [LOCAL ] THQ: Loaded 25363 existing records from primary storage. [2025-10-15T22:42:34.653706] [INFO ] [MAIN ] THQ: Loaded 25363 primary data records. [2025-10-15T22:42:34.919444] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:35.008998] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1510 primary records. [2025-10-15T22:42:35.125871] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-15T22:42:35.253141] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-10-15T22:42:35.254012] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-15T22:42:35.256268] [INFO ] [MAIN ] Derivative Progress: 1537/1803 symbols completed. THLV took 1.0s. Estimated remaining: 1m 40s. Rate: 159.5 symbols/min [2025-10-15T22:42:35.257380] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:35.280084] [DEBUG] [LOCAL ] THR: Loaded 19794 existing records from primary storage. [2025-10-15T22:42:35.281053] [INFO ] [MAIN ] THR: Loaded 19794 primary data records. [2025-10-15T22:42:35.371573] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:35.382957] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41458 primary records. [2025-10-15T22:42:35.389101] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-15T22:42:35.412627] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:35.435428] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25363 primary records. [2025-10-15T22:42:35.442800] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-15T22:42:35.581503] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-15T22:42:35.589679] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-15T22:42:35.668462] [INFO ] [MAIN ] Derivative Progress: 1538/1803 symbols completed. THO took 1.3s. Estimated remaining: 1m 40s. Rate: 159.5 symbols/min [2025-10-15T22:42:35.678333] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:35.685197] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-15T22:42:35.685975] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-15T22:42:35.689175] [INFO ] [MAIN ] Derivative Progress: 1539/1803 symbols completed. THQ took 1.3s. Estimated remaining: 1m 39s. Rate: 159.6 symbols/min [2025-10-15T22:42:35.689437] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:35.726564] [DEBUG] [MAIN ] THR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:35.727307] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19794 primary records. [2025-10-15T22:42:35.727447] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-15T22:42:35.750324] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-15T22:42:35.750451] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-15T22:42:35.746474] [DEBUG] [LOCAL ] THW: Loaded 19728 existing records from primary storage. [2025-10-15T22:42:35.752688] [INFO ] [MAIN ] THW: Loaded 19728 primary data records. [2025-10-15T22:42:35.752567] [INFO ] [MAIN ] Derivative Progress: 1540/1803 symbols completed. THR took 0.5s. Estimated remaining: 1m 39s. Rate: 159.7 symbols/min [2025-10-15T22:42:35.752869] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:35.833490] [DEBUG] [LOCAL ] THS: Loaded 38627 existing records from primary storage. [2025-10-15T22:42:35.862757] [INFO ] [MAIN ] THS: Loaded 38627 primary data records. [2025-10-15T22:42:36.192773] [DEBUG] [LOCAL ] TIMB: Loaded 35342 existing records from primary storage. [2025-10-15T22:42:36.198608] [INFO ] [MAIN ] TIMB: Loaded 35342 primary data records. [2025-10-15T22:42:36.702536] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:36.716377] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19728 primary records. [2025-10-15T22:42:36.716685] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-15T22:42:36.715606] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:36.718073] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38627 primary records. [2025-10-15T22:42:36.718705] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-15T22:42:36.741927] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-15T22:42:36.749973] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-15T22:42:36.745951] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-15T22:42:36.750611] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-15T22:42:36.753146] [INFO ] [MAIN ] Derivative Progress: 1541/1803 symbols completed. THW took 1.1s. Estimated remaining: 1m 39s. Rate: 159.5 symbols/min [2025-10-15T22:42:36.753381] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:36.757015] [INFO ] [MAIN ] Derivative Progress: 1542/1803 symbols completed. THS took 1.1s. Estimated remaining: 1m 38s. Rate: 159.6 symbols/min [2025-10-15T22:42:36.757844] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:36.771665] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:36.774187] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 35342 primary records. [2025-10-15T22:42:36.774385] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-15T22:42:36.777565] [DEBUG] [LOCAL ] TISI: Loaded 3331 existing records from primary storage. [2025-10-15T22:42:36.777759] [INFO ] [MAIN ] TISI: Loaded 3331 primary data records. [2025-10-15T22:42:36.879754] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-15T22:42:36.885511] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-15T22:42:36.899183] [INFO ] [MAIN ] Derivative Progress: 1543/1803 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 38s. Rate: 159.7 symbols/min [2025-10-15T22:42:36.931980] [DEBUG] [LOCAL ] TIXT: Loaded 32389 existing records from primary storage. [2025-10-15T22:42:36.942307] [INFO ] [MAIN ] TIXT: Loaded 32389 primary data records. [2025-10-15T22:42:37.456316] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:37.457203] [INFO ] [MAIN ] TISI: Generated 1793 derivative records from 3331 primary records. [2025-10-15T22:42:37.457504] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-15T22:42:37.471658] [DEBUG] [LOCAL ] TISI: Derivative data saved (1793 records). [2025-10-15T22:42:37.471880] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-15T22:42:37.473948] [INFO ] [MAIN ] Derivative Progress: 1544/1803 symbols completed. TISI took 0.7s. Estimated remaining: 1m 37s. Rate: 159.6 symbols/min [2025-10-15T22:42:37.488585] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:37.489256] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 32389 primary records. [2025-10-15T22:42:37.489318] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-15T22:42:37.503901] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-15T22:42:37.503965] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-15T22:42:37.506552] [INFO ] [MAIN ] Derivative Progress: 1545/1803 symbols completed. TIXT took 0.7s. Estimated remaining: 1m 37s. Rate: 159.7 symbols/min [2025-10-15T22:42:37.507210] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:37.507045] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:37.507143] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:37.587992] [DEBUG] [LOCAL ] TK: Loaded 39139 existing records from primary storage. [2025-10-15T22:42:37.588266] [INFO ] [MAIN ] TK: Loaded 39139 primary data records. [2025-10-15T22:42:37.588829] [DEBUG] [LOCAL ] TKC: Loaded 39494 existing records from primary storage. [2025-10-15T22:42:37.610394] [DEBUG] [LOCAL ] TKO: Loaded 43742 existing records from primary storage. [2025-10-15T22:42:37.609459] [INFO ] [MAIN ] TKC: Loaded 39494 primary data records. [2025-10-15T22:42:37.625843] [INFO ] [MAIN ] TKO: Loaded 43742 primary data records. [2025-10-15T22:42:38.506793] [DEBUG] [MAIN ] TK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:38.507605] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39139 primary records. [2025-10-15T22:42:38.507801] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-15T22:42:38.526374] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-15T22:42:38.540274] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-15T22:42:38.542309] [INFO ] [MAIN ] Derivative Progress: 1546/1803 symbols completed. TK took 1.0s. Estimated remaining: 1m 37s. Rate: 159.6 symbols/min [2025-10-15T22:42:38.542903] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:38.554724] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:38.555489] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39494 primary records. [2025-10-15T22:42:38.556209] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-15T22:42:38.557238] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:38.557983] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43742 primary records. [2025-10-15T22:42:38.564900] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-15T22:42:38.586759] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-15T22:42:38.588004] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-15T22:42:38.590697] [INFO ] [MAIN ] Derivative Progress: 1547/1803 symbols completed. TKC took 1.1s. Estimated remaining: 1m 36s. Rate: 159.6 symbols/min [2025-10-15T22:42:38.591810] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:38.593578] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-15T22:42:38.593771] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-15T22:42:38.598057] [INFO ] [MAIN ] Derivative Progress: 1548/1803 symbols completed. TKO took 1.1s. Estimated remaining: 1m 36s. Rate: 159.7 symbols/min [2025-10-15T22:42:38.598376] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:38.630738] [DEBUG] [LOCAL ] TKR: Loaded 39727 existing records from primary storage. [2025-10-15T22:42:38.636400] [INFO ] [MAIN ] TKR: Loaded 39727 primary data records. [2025-10-15T22:42:38.636849] [DEBUG] [LOCAL ] TLYS: Loaded 16578 existing records from primary storage. [2025-10-15T22:42:38.708944] [INFO ] [MAIN ] TLYS: Loaded 16578 primary data records. [2025-10-15T22:42:38.843158] [DEBUG] [LOCAL ] TLK: Loaded 38630 existing records from primary storage. [2025-10-15T22:42:38.911824] [INFO ] [MAIN ] TLK: Loaded 38630 primary data records. [2025-10-15T22:42:39.599674] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:39.600575] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39727 primary records. [2025-10-15T22:42:39.601086] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-15T22:42:39.630757] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:39.632427] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16578 primary records. [2025-10-15T22:42:39.633899] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-15T22:42:39.633985] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-15T22:42:39.634078] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-15T22:42:39.636086] [INFO ] [MAIN ] Derivative Progress: 1549/1803 symbols completed. TKR took 1.1s. Estimated remaining: 1m 36s. Rate: 159.6 symbols/min [2025-10-15T22:42:39.637714] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:39.665823] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:39.667308] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38630 primary records. [2025-10-15T22:42:39.667627] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-15T22:42:39.668772] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-15T22:42:39.669286] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-15T22:42:39.678744] [INFO ] [MAIN ] Derivative Progress: 1550/1803 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 35s. Rate: 159.7 symbols/min [2025-10-15T22:42:39.686065] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:39.687341] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-15T22:42:39.687919] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-15T22:42:39.690824] [INFO ] [MAIN ] Derivative Progress: 1551/1803 symbols completed. TLK took 1.1s. Estimated remaining: 1m 35s. Rate: 159.8 symbols/min [2025-10-15T22:42:39.691141] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:39.723619] [DEBUG] [LOCAL ] TM: Loaded 36494 existing records from primary storage. [2025-10-15T22:42:39.723989] [INFO ] [MAIN ] TM: Loaded 36494 primary data records. [2025-10-15T22:42:39.901977] [DEBUG] [LOCAL ] TMHC: Loaded 45461 existing records from primary storage. [2025-10-15T22:42:39.926756] [INFO ] [MAIN ] TMHC: Loaded 45461 primary data records. [2025-10-15T22:42:40.202235] [DEBUG] [LOCAL ] TME: Loaded 53194 existing records from primary storage. [2025-10-15T22:42:40.202455] [INFO ] [MAIN ] TME: Loaded 53194 primary data records. [2025-10-15T22:42:40.715880] [DEBUG] [MAIN ] TM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:40.717436] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36494 primary records. [2025-10-15T22:42:40.717611] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-15T22:42:40.730897] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:40.731863] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45461 primary records. [2025-10-15T22:42:40.732431] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-15T22:42:40.755522] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-15T22:42:40.755668] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-15T22:42:40.758561] [INFO ] [MAIN ] Derivative Progress: 1552/1803 symbols completed. TM took 1.1s. Estimated remaining: 1m 34s. Rate: 159.6 symbols/min [2025-10-15T22:42:40.758843] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:40.768032] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-15T22:42:40.769680] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-15T22:42:40.772052] [INFO ] [MAIN ] Derivative Progress: 1553/1803 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 34s. Rate: 159.7 symbols/min [2025-10-15T22:42:40.772482] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:40.786009] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:40.786766] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53194 primary records. [2025-10-15T22:42:40.786865] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-15T22:42:40.812952] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-15T22:42:40.813595] [DEBUG] [LOCAL ] TNC: Loaded 14448 existing records from primary storage. [2025-10-15T22:42:40.813221] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-15T22:42:40.816675] [INFO ] [MAIN ] Derivative Progress: 1554/1803 symbols completed. TME took 1.1s. Estimated remaining: 1m 34s. Rate: 159.8 symbols/min [2025-10-15T22:42:40.816810] [INFO ] [MAIN ] TNC: Loaded 14448 primary data records. [2025-10-15T22:42:40.816999] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:40.980521] [DEBUG] [LOCAL ] TMO: Loaded 52446 existing records from primary storage. [2025-10-15T22:42:41.047588] [DEBUG] [LOCAL ] TNET: Loaded 28305 existing records from primary storage. [2025-10-15T22:42:41.047169] [INFO ] [MAIN ] TMO: Loaded 52446 primary data records. [2025-10-15T22:42:41.086678] [INFO ] [MAIN ] TNET: Loaded 28305 primary data records. [2025-10-15T22:42:41.831056] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:41.832142] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14448 primary records. [2025-10-15T22:42:41.832258] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-15T22:42:41.852174] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-15T22:42:41.852390] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-15T22:42:41.854292] [INFO ] [MAIN ] Derivative Progress: 1555/1803 symbols completed. TNC took 1.1s. Estimated remaining: 1m 33s. Rate: 159.6 symbols/min [2025-10-15T22:42:41.854448] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:41.884856] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:41.885019] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:41.885877] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52446 primary records. [2025-10-15T22:42:41.886492] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28305 primary records. [2025-10-15T22:42:41.886599] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-15T22:42:41.886778] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-15T22:42:41.915222] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-15T22:42:41.919742] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-15T22:42:41.922735] [INFO ] [MAIN ] Derivative Progress: 1556/1803 symbols completed. TMO took 1.2s. Estimated remaining: 1m 33s. Rate: 159.7 symbols/min [2025-10-15T22:42:41.922925] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:41.919444] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-15T22:42:41.923667] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-15T22:42:41.934706] [INFO ] [MAIN ] Derivative Progress: 1557/1803 symbols completed. TNET took 1.1s. Estimated remaining: 1m 32s. Rate: 159.8 symbols/min [2025-10-15T22:42:41.935043] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:41.949472] [DEBUG] [LOCAL ] TNK: Loaded 35361 existing records from primary storage. [2025-10-15T22:42:41.949607] [INFO ] [MAIN ] TNK: Loaded 35361 primary data records. [2025-10-15T22:42:42.171579] [DEBUG] [LOCAL ] TNL: Loaded 41792 existing records from primary storage. [2025-10-15T22:42:42.249737] [INFO ] [MAIN ] TNL: Loaded 41792 primary data records. [2025-10-15T22:42:42.397206] [DEBUG] [LOCAL ] TOL: Loaded 50667 existing records from primary storage. [2025-10-15T22:42:42.409939] [INFO ] [MAIN ] TOL: Loaded 50667 primary data records. [2025-10-15T22:42:42.925530] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:42.927193] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35361 primary records. [2025-10-15T22:42:42.927860] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-15T22:42:42.945502] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-15T22:42:42.945785] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-15T22:42:42.948754] [INFO ] [MAIN ] Derivative Progress: 1558/1803 symbols completed. TNK took 1.1s. Estimated remaining: 1m 32s. Rate: 159.6 symbols/min [2025-10-15T22:42:42.981765] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:42.983080] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41792 primary records. [2025-10-15T22:42:42.983218] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-15T22:42:42.982257] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:42.984182] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50667 primary records. [2025-10-15T22:42:42.984271] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-15T22:42:43.016385] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-15T22:42:43.016497] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-15T22:42:43.015819] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-15T22:42:43.019352] [INFO ] [MAIN ] Derivative Progress: 1559/1803 symbols completed. TOL took 1.1s. Estimated remaining: 1m 32s. Rate: 159.7 symbols/min [2025-10-15T22:42:43.019503] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-15T22:42:43.022015] [INFO ] [MAIN ] Derivative Progress: 1560/1803 symbols completed. TNL took 1.1s. Estimated remaining: 1m 31s. Rate: 159.8 symbols/min [2025-10-15T22:42:43.022355] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:43.022672] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:43.022500] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:43.058036] [DEBUG] [LOCAL ] TPB: Loaded 26115 existing records from primary storage. [2025-10-15T22:42:43.058229] [INFO ] [MAIN ] TPB: Loaded 26115 primary data records. [2025-10-15T22:42:43.133798] [DEBUG] [LOCAL ] TPC: Loaded 39038 existing records from primary storage. [2025-10-15T22:42:43.158629] [INFO ] [MAIN ] TPC: Loaded 39038 primary data records. [2025-10-15T22:42:43.293679] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-15T22:42:43.320763] [INFO ] [MAIN ] TOST: Loaded 53690 primary data records. [2025-10-15T22:42:44.084776] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:44.085818] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 26115 primary records. [2025-10-15T22:42:44.098429] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-15T22:42:44.099808] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:44.108813] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 39038 primary records. [2025-10-15T22:42:44.109944] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-15T22:42:44.118290] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-15T22:42:44.118886] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-15T22:42:44.121075] [INFO ] [MAIN ] Derivative Progress: 1561/1803 symbols completed. TPB took 1.1s. Estimated remaining: 1m 31s. Rate: 159.6 symbols/min [2025-10-15T22:42:44.142027] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:44.145351] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53690 primary records. [2025-10-15T22:42:44.145664] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-15T22:42:44.145774] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:44.165984] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-15T22:42:44.166333] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-15T22:42:44.169558] [INFO ] [MAIN ] Derivative Progress: 1562/1803 symbols completed. TPC took 1.1s. Estimated remaining: 1m 31s. Rate: 159.7 symbols/min [2025-10-15T22:42:44.169824] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:44.169714] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-15T22:42:44.170401] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-15T22:42:44.174206] [INFO ] [MAIN ] Derivative Progress: 1563/1803 symbols completed. TOST took 1.2s. Estimated remaining: 1m 30s. Rate: 159.8 symbols/min [2025-10-15T22:42:44.174370] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:44.197604] [DEBUG] [LOCAL ] TPL: Loaded 12354 existing records from primary storage. [2025-10-15T22:42:44.197790] [INFO ] [MAIN ] TPL: Loaded 12354 primary data records. [2025-10-15T22:42:44.354709] [DEBUG] [LOCAL ] TPH: Loaded 44876 existing records from primary storage. [2025-10-15T22:42:44.370555] [INFO ] [MAIN ] TPH: Loaded 44876 primary data records. [2025-10-15T22:42:44.718960] [DEBUG] [LOCAL ] TPR: Loaded 53434 existing records from primary storage. [2025-10-15T22:42:44.745718] [INFO ] [MAIN ] TPR: Loaded 53434 primary data records. [2025-10-15T22:42:45.188434] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:45.189611] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12354 primary records. [2025-10-15T22:42:45.189868] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-15T22:42:45.210966] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-15T22:42:45.223345] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-15T22:42:45.225554] [INFO ] [MAIN ] Derivative Progress: 1564/1803 symbols completed. TPL took 1.1s. Estimated remaining: 1m 30s. Rate: 159.6 symbols/min [2025-10-15T22:42:45.226319] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:45.227776] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44876 primary records. [2025-10-15T22:42:45.227918] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:45.228066] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-15T22:42:45.245190] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-15T22:42:45.245513] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-15T22:42:45.248105] [INFO ] [MAIN ] Derivative Progress: 1565/1803 symbols completed. TPH took 1.1s. Estimated remaining: 1m 29s. Rate: 159.7 symbols/min [2025-10-15T22:42:45.248281] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:45.275877] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:45.279853] [DEBUG] [LOCAL ] TPYP: Loaded 7908 existing records from primary storage. [2025-10-15T22:42:45.280798] [INFO ] [MAIN ] TPYP: Loaded 7908 primary data records. [2025-10-15T22:42:45.280560] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53434 primary records. [2025-10-15T22:42:45.312686] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-15T22:42:45.356027] [DEBUG] [LOCAL ] TPVG: Loaded 27282 existing records from primary storage. [2025-10-15T22:42:45.361433] [INFO ] [MAIN ] TPVG: Loaded 27282 primary data records. [2025-10-15T22:42:45.431276] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-15T22:42:45.442047] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-15T22:42:45.450464] [INFO ] [MAIN ] Derivative Progress: 1566/1803 symbols completed. TPR took 1.3s. Estimated remaining: 1m 29s. Rate: 159.7 symbols/min [2025-10-15T22:42:45.488669] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:45.765448] [DEBUG] [LOCAL ] TPZ: Loaded 4686 existing records from primary storage. [2025-10-15T22:42:45.773929] [INFO ] [MAIN ] TPZ: Loaded 4686 primary data records. [2025-10-15T22:42:46.243920] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:46.245443] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7908 primary records. [2025-10-15T22:42:46.245738] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-15T22:42:46.264168] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-15T22:42:46.264443] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-15T22:42:46.266441] [INFO ] [MAIN ] Derivative Progress: 1567/1803 symbols completed. TPYP took 1.0s. Estimated remaining: 1m 29s. Rate: 159.6 symbols/min [2025-10-15T22:42:46.267686] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:46.282216] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:46.283204] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27282 primary records. [2025-10-15T22:42:46.283407] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-15T22:42:46.306308] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-15T22:42:46.306612] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-15T22:42:46.309310] [INFO ] [MAIN ] Derivative Progress: 1568/1803 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 28s. Rate: 159.7 symbols/min [2025-10-15T22:42:46.309500] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:46.319593] [DEBUG] [LOCAL ] TR: Loaded 18949 existing records from primary storage. [2025-10-15T22:42:46.327674] [INFO ] [MAIN ] TR: Loaded 18949 primary data records. [2025-10-15T22:42:46.335308] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:46.336061] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 4686 primary records. [2025-10-15T22:42:46.368533] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-15T22:42:46.414282] [DEBUG] [LOCAL ] TRAK: Loaded 9646 existing records from primary storage. [2025-10-15T22:42:46.426166] [INFO ] [MAIN ] TRAK: Loaded 9646 primary data records. [2025-10-15T22:42:46.534311] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-10-15T22:42:46.557557] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-15T22:42:46.589470] [INFO ] [MAIN ] Derivative Progress: 1569/1803 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 28s. Rate: 159.7 symbols/min [2025-10-15T22:42:46.623183] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:46.954689] [DEBUG] [LOCAL ] TRC: Loaded 15563 existing records from primary storage. [2025-10-15T22:42:46.955018] [INFO ] [MAIN ] TRC: Loaded 15563 primary data records. [2025-10-15T22:42:47.314444] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:47.315975] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18949 primary records. [2025-10-15T22:42:47.316512] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-15T22:42:47.338494] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:47.343199] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9646 primary records. [2025-10-15T22:42:47.346403] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-15T22:42:47.348115] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-15T22:42:47.348558] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-15T22:42:47.350579] [INFO ] [MAIN ] Derivative Progress: 1570/1803 symbols completed. TR took 1.1s. Estimated remaining: 1m 28s. Rate: 159.6 symbols/min [2025-10-15T22:42:47.350776] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:47.367031] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-15T22:42:47.367319] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-15T22:42:47.370041] [INFO ] [MAIN ] Derivative Progress: 1571/1803 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 27s. Rate: 159.7 symbols/min [2025-10-15T22:42:47.370306] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:47.389404] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:47.390180] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15563 primary records. [2025-10-15T22:42:47.391299] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-15T22:42:47.418486] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-15T22:42:47.418621] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-15T22:42:47.421520] [INFO ] [MAIN ] Derivative Progress: 1572/1803 symbols completed. TRC took 0.8s. Estimated remaining: 1m 27s. Rate: 159.8 symbols/min [2025-10-15T22:42:47.421766] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:47.453229] [DEBUG] [LOCAL ] TREX: Loaded 49839 existing records from primary storage. [2025-10-15T22:42:47.453453] [INFO ] [MAIN ] TREX: Loaded 49839 primary data records. [2025-10-15T22:42:47.567515] [DEBUG] [LOCAL ] TRGP: Loaded 50840 existing records from primary storage. [2025-10-15T22:42:47.579020] [INFO ] [MAIN ] TRGP: Loaded 50840 primary data records. [2025-10-15T22:42:47.716811] [DEBUG] [LOCAL ] TRN: Loaded 36777 existing records from primary storage. [2025-10-15T22:42:47.848762] [INFO ] [MAIN ] TRN: Loaded 36777 primary data records. [2025-10-15T22:42:48.401136] [DEBUG] [MAIN ] TREX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:48.402086] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49839 primary records. [2025-10-15T22:42:48.402723] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-15T22:42:48.421194] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-15T22:42:48.421412] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-15T22:42:48.423478] [INFO ] [MAIN ] Derivative Progress: 1573/1803 symbols completed. TREX took 1.1s. Estimated remaining: 1m 26s. Rate: 159.6 symbols/min [2025-10-15T22:42:48.436376] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:48.436993] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50840 primary records. [2025-10-15T22:42:48.437143] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-15T22:42:48.454439] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-15T22:42:48.455203] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-15T22:42:48.457918] [INFO ] [MAIN ] Derivative Progress: 1574/1803 symbols completed. TRGP took 1.1s. Estimated remaining: 1m 26s. Rate: 159.7 symbols/min [2025-10-15T22:42:48.470247] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:48.470891] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36777 primary records. [2025-10-15T22:42:48.470950] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-15T22:42:48.486100] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-15T22:42:48.486158] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-15T22:42:48.488810] [INFO ] [MAIN ] Derivative Progress: 1575/1803 symbols completed. TRN took 1.1s. Estimated remaining: 1m 26s. Rate: 159.8 symbols/min [2025-10-15T22:42:48.489281] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:48.489217] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:48.489148] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:48.573281] [DEBUG] [LOCAL ] TRNO: Loaded 43960 existing records from primary storage. [2025-10-15T22:42:48.575299] [INFO ] [MAIN ] TRNO: Loaded 43960 primary data records. [2025-10-15T22:42:48.597300] [DEBUG] [LOCAL ] TROX: Loaded 52169 existing records from primary storage. [2025-10-15T22:42:48.607705] [INFO ] [MAIN ] TROX: Loaded 52169 primary data records. [2025-10-15T22:42:48.702191] [DEBUG] [LOCAL ] TRP: Loaded 52141 existing records from primary storage. [2025-10-15T22:42:48.766596] [INFO ] [MAIN ] TRP: Loaded 52141 primary data records. [2025-10-15T22:42:49.536496] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:49.538199] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43960 primary records. [2025-10-15T22:42:49.542957] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-15T22:42:49.575851] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:49.575597] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-15T22:42:49.576122] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-15T22:42:49.576922] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 52169 primary records. [2025-10-15T22:42:49.577060] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-15T22:42:49.587137] [INFO ] [MAIN ] Derivative Progress: 1576/1803 symbols completed. TRNO took 1.1s. Estimated remaining: 1m 25s. Rate: 159.6 symbols/min [2025-10-15T22:42:49.592084] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:49.608190] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-15T22:42:49.604168] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:49.609263] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52141 primary records. [2025-10-15T22:42:49.609359] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-15T22:42:49.608473] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-15T22:42:49.614028] [INFO ] [MAIN ] Derivative Progress: 1577/1803 symbols completed. TROX took 1.1s. Estimated remaining: 1m 25s. Rate: 159.7 symbols/min [2025-10-15T22:42:49.615055] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:49.631236] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-15T22:42:49.631517] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-15T22:42:49.635014] [INFO ] [MAIN ] Derivative Progress: 1578/1803 symbols completed. TRP took 1.1s. Estimated remaining: 1m 24s. Rate: 159.8 symbols/min [2025-10-15T22:42:49.635235] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:49.682510] [DEBUG] [LOCAL ] TRTX: Loaded 37285 existing records from primary storage. [2025-10-15T22:42:49.682834] [INFO ] [MAIN ] TRTX: Loaded 37285 primary data records. [2025-10-15T22:42:49.812857] [DEBUG] [LOCAL ] TRU: Loaded 51431 existing records from primary storage. [2025-10-15T22:42:49.822723] [INFO ] [MAIN ] TRU: Loaded 51431 primary data records. [2025-10-15T22:42:49.903410] [DEBUG] [LOCAL ] TRV: Loaded 47454 existing records from primary storage. [2025-10-15T22:42:49.934052] [INFO ] [MAIN ] TRV: Loaded 47454 primary data records. [2025-10-15T22:42:50.688618] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:50.695073] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37285 primary records. [2025-10-15T22:42:50.694330] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:50.695831] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51431 primary records. [2025-10-15T22:42:50.695222] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-15T22:42:50.696324] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-15T22:42:50.727899] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-15T22:42:50.729128] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-15T22:42:50.730091] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-15T22:42:50.730822] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-15T22:42:50.732562] [INFO ] [MAIN ] Derivative Progress: 1579/1803 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 24s. Rate: 159.6 symbols/min [2025-10-15T22:42:50.736554] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:50.737020] [INFO ] [MAIN ] Derivative Progress: 1580/1803 symbols completed. TRU took 1.1s. Estimated remaining: 1m 24s. Rate: 159.7 symbols/min [2025-10-15T22:42:50.744888] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:50.750463] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:50.751301] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47454 primary records. [2025-10-15T22:42:50.751459] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-15T22:42:50.767633] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-15T22:42:50.767843] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-15T22:42:50.770495] [INFO ] [MAIN ] Derivative Progress: 1581/1803 symbols completed. TRV took 1.1s. Estimated remaining: 1m 23s. Rate: 159.8 symbols/min [2025-10-15T22:42:50.770835] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:50.797136] [DEBUG] [LOCAL ] TSI: Loaded 8053 existing records from primary storage. [2025-10-15T22:42:50.797687] [DEBUG] [LOCAL ] TSE: Loaded 27772 existing records from primary storage. [2025-10-15T22:42:50.797950] [INFO ] [MAIN ] TSI: Loaded 8053 primary data records. [2025-10-15T22:42:50.821238] [INFO ] [MAIN ] TSE: Loaded 27772 primary data records. [2025-10-15T22:42:51.049880] [DEBUG] [LOCAL ] TS: Loaded 51677 existing records from primary storage. [2025-10-15T22:42:51.070836] [INFO ] [MAIN ] TS: Loaded 51677 primary data records. [2025-10-15T22:42:51.792979] [DEBUG] [MAIN ] TSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:51.793226] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:51.794261] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 27772 primary records. [2025-10-15T22:42:51.795123] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8053 primary records. [2025-10-15T22:42:51.795256] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-15T22:42:51.795194] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-15T22:42:51.825568] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-15T22:42:51.825702] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-15T22:42:51.825169] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-15T22:42:51.828324] [INFO ] [MAIN ] Derivative Progress: 1582/1803 symbols completed. TSI took 1.1s. Estimated remaining: 1m 23s. Rate: 159.6 symbols/min [2025-10-15T22:42:51.829525] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:51.829384] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-15T22:42:51.833811] [INFO ] [MAIN ] Derivative Progress: 1583/1803 symbols completed. TSE took 1.1s. Estimated remaining: 1m 23s. Rate: 159.7 symbols/min [2025-10-15T22:42:51.834126] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:51.847565] [DEBUG] [MAIN ] TS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:51.848212] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51677 primary records. [2025-10-15T22:42:51.848356] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-15T22:42:51.863979] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-15T22:42:51.864139] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-15T22:42:51.867152] [INFO ] [MAIN ] Derivative Progress: 1584/1803 symbols completed. TS took 1.1s. Estimated remaining: 1m 22s. Rate: 159.8 symbols/min [2025-10-15T22:42:51.867474] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:51.894415] [DEBUG] [LOCAL ] TSLX: Loaded 35911 existing records from primary storage. [2025-10-15T22:42:51.894634] [INFO ] [MAIN ] TSLX: Loaded 35911 primary data records. [2025-10-15T22:42:52.120548] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-15T22:42:52.231564] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-15T22:42:52.246031] [DEBUG] [LOCAL ] TSN: Loaded 53044 existing records from primary storage. [2025-10-15T22:42:52.277399] [INFO ] [MAIN ] TSN: Loaded 53044 primary data records. [2025-10-15T22:42:52.845836] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:52.846864] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35911 primary records. [2025-10-15T22:42:52.847168] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-15T22:42:52.865138] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-15T22:42:52.865432] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-15T22:42:52.867747] [INFO ] [MAIN ] Derivative Progress: 1585/1803 symbols completed. TSLX took 1.0s. Estimated remaining: 1m 22s. Rate: 159.6 symbols/min [2025-10-15T22:42:52.867984] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:52.894567] [DEBUG] [LOCAL ] TSQ: Loaded 11703 existing records from primary storage. [2025-10-15T22:42:52.894866] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:52.895722] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 53044 primary records. [2025-10-15T22:42:52.907729] [INFO ] [MAIN ] TSQ: Loaded 11703 primary data records. [2025-10-15T22:42:52.908284] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:52.919692] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-15T22:42:52.929036] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-15T22:42:52.907892] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-15T22:42:53.035311] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-15T22:42:53.037410] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-15T22:42:53.060602] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-15T22:42:53.049433] [INFO ] [MAIN ] Derivative Progress: 1586/1803 symbols completed. TSM took 1.2s. Estimated remaining: 1m 22s. Rate: 159.7 symbols/min [2025-10-15T22:42:53.071112] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-15T22:42:53.065870] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:53.078684] [INFO ] [MAIN ] Derivative Progress: 1587/1803 symbols completed. TSN took 1.2s. Estimated remaining: 1m 21s. Rate: 159.8 symbols/min [2025-10-15T22:42:53.107892] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:53.298581] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:53.308073] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11703 primary records. [2025-10-15T22:42:53.308205] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-15T22:42:53.325023] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-15T22:42:53.336558] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-15T22:42:53.338501] [INFO ] [MAIN ] Derivative Progress: 1588/1803 symbols completed. TSQ took 0.5s. Estimated remaining: 1m 21s. Rate: 159.8 symbols/min [2025-10-15T22:42:53.339337] [DEBUG] [LOCAL ] TTC: Loaded 41993 existing records from primary storage. [2025-10-15T22:42:53.351584] [INFO ] [MAIN ] TTC: Loaded 41993 primary data records. [2025-10-15T22:42:53.415952] [DEBUG] [LOCAL ] TT: Loaded 47326 existing records from primary storage. [2025-10-15T22:42:53.427195] [INFO ] [MAIN ] TT: Loaded 47326 primary data records. [2025-10-15T22:42:53.944877] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:53.945774] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 41993 primary records. [2025-10-15T22:42:53.945875] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-15T22:42:53.975371] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:53.976525] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-15T22:42:53.976611] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-15T22:42:53.978601] [INFO ] [MAIN ] Derivative Progress: 1589/1803 symbols completed. TTC took 0.9s. Estimated remaining: 1m 20s. Rate: 159.7 symbols/min [2025-10-15T22:42:53.976482] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47326 primary records. [2025-10-15T22:42:53.978745] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-15T22:42:53.993916] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-15T22:42:53.993973] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-15T22:42:53.996124] [INFO ] [MAIN ] Derivative Progress: 1590/1803 symbols completed. TT took 0.9s. Estimated remaining: 1m 20s. Rate: 159.8 symbols/min [2025-10-15T22:42:53.996612] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:53.996554] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:53.996507] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:54.060956] [DEBUG] [LOCAL ] TTI: Loaded 46361 existing records from primary storage. [2025-10-15T22:42:54.061202] [INFO ] [MAIN ] TTI: Loaded 46361 primary data records. [2025-10-15T22:42:54.190272] [DEBUG] [LOCAL ] TTE: Loaded 51582 existing records from primary storage. [2025-10-15T22:42:54.201290] [INFO ] [MAIN ] TTE: Loaded 51582 primary data records. [2025-10-15T22:42:54.201870] [DEBUG] [LOCAL ] TU: Loaded 49837 existing records from primary storage. [2025-10-15T22:42:54.212226] [INFO ] [MAIN ] TU: Loaded 49837 primary data records. [2025-10-15T22:42:55.031668] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:55.032468] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 46361 primary records. [2025-10-15T22:42:55.032823] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-15T22:42:55.050771] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-15T22:42:55.051767] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-15T22:42:55.054286] [INFO ] [MAIN ] Derivative Progress: 1591/1803 symbols completed. TTI took 1.1s. Estimated remaining: 1m 20s. Rate: 159.7 symbols/min [2025-10-15T22:42:55.068739] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:55.068367] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:55.069633] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49837 primary records. [2025-10-15T22:42:55.069968] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-15T22:42:55.090691] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:55.095406] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51582 primary records. [2025-10-15T22:42:55.095726] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-15T22:42:55.112589] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-15T22:42:55.113231] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-15T22:42:55.116927] [INFO ] [MAIN ] Derivative Progress: 1592/1803 symbols completed. TU took 1.1s. Estimated remaining: 1m 19s. Rate: 159.7 symbols/min [2025-10-15T22:42:55.117383] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:55.120327] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-15T22:42:55.120449] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-15T22:42:55.122464] [INFO ] [MAIN ] Derivative Progress: 1593/1803 symbols completed. TTE took 1.1s. Estimated remaining: 1m 19s. Rate: 159.8 symbols/min [2025-10-15T22:42:55.122738] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:55.137548] [DEBUG] [LOCAL ] TVC: Loaded 3210 existing records from primary storage. [2025-10-15T22:42:55.137706] [INFO ] [MAIN ] TVC: Loaded 3210 primary data records. [2025-10-15T22:42:55.261578] [DEBUG] [LOCAL ] TUYA: Loaded 45932 existing records from primary storage. [2025-10-15T22:42:55.262253] [INFO ] [MAIN ] TUYA: Loaded 45932 primary data records. [2025-10-15T22:42:55.438813] [DEBUG] [LOCAL ] TV: Loaded 41583 existing records from primary storage. [2025-10-15T22:42:55.446278] [INFO ] [MAIN ] TV: Loaded 41583 primary data records. [2025-10-15T22:42:56.067311] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:42:56.068035] [INFO ] [MAIN ] TVC: Generated 1793 derivative records from 3210 primary records. [2025-10-15T22:42:56.068212] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-15T22:42:56.100133] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:56.100222] [DEBUG] [LOCAL ] TVC: Derivative data saved (1793 records). [2025-10-15T22:42:56.101076] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 45932 primary records. [2025-10-15T22:42:56.101207] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-15T22:42:56.108555] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-15T22:42:56.115842] [INFO ] [MAIN ] Derivative Progress: 1594/1803 symbols completed. TVC took 1.0s. Estimated remaining: 1m 19s. Rate: 159.7 symbols/min [2025-10-15T22:42:56.116408] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:56.116528] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:56.117450] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 41583 primary records. [2025-10-15T22:42:56.128433] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-15T22:42:56.144832] [DEBUG] [LOCAL ] TVE: Loaded 2634 existing records from primary storage. [2025-10-15T22:42:56.145348] [INFO ] [MAIN ] TVE: Loaded 2634 primary data records. [2025-10-15T22:42:56.192224] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-15T22:42:56.204308] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-15T22:42:56.215576] [INFO ] [MAIN ] Derivative Progress: 1595/1803 symbols completed. TV took 1.1s. Estimated remaining: 1m 18s. Rate: 159.8 symbols/min [2025-10-15T22:42:56.204587] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-15T22:42:56.220872] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-15T22:42:56.227420] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:56.245114] [INFO ] [MAIN ] Derivative Progress: 1596/1803 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 18s. Rate: 159.8 symbols/min [2025-10-15T22:42:56.255809] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:56.469669] [DEBUG] [LOCAL ] TWI: Loaded 33900 existing records from primary storage. [2025-10-15T22:42:56.469847] [INFO ] [MAIN ] TWI: Loaded 33900 primary data records. [2025-10-15T22:42:56.825944] [DEBUG] [LOCAL ] TWLO: Loaded 52830 existing records from primary storage. [2025-10-15T22:42:56.828512] [INFO ] [MAIN ] TWLO: Loaded 52830 primary data records. [2025-10-15T22:42:56.910079] [DEBUG] [MAIN ] TVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:56.945137] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2634 primary records. [2025-10-15T22:42:56.945763] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-15T22:42:57.137516] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-15T22:42:57.151495] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-15T22:42:57.153673] [INFO ] [MAIN ] Derivative Progress: 1597/1803 symbols completed. TVE took 1.0s. Estimated remaining: 1m 17s. Rate: 159.7 symbols/min [2025-10-15T22:42:57.154052] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:57.162016] [DEBUG] [LOCAL ] TWN: Loaded 3257 existing records from primary storage. [2025-10-15T22:42:57.162276] [INFO ] [MAIN ] TWN: Loaded 3257 primary data records. [2025-10-15T22:42:57.286636] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:57.293034] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 33900 primary records. [2025-10-15T22:42:57.298598] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-15T22:42:57.501050] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-15T22:42:57.502609] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-15T22:42:57.505475] [INFO ] [MAIN ] Derivative Progress: 1598/1803 symbols completed. TWI took 1.3s. Estimated remaining: 1m 17s. Rate: 159.7 symbols/min [2025-10-15T22:42:57.505622] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:57.519911] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:57.521408] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52830 primary records. [2025-10-15T22:42:57.521688] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-15T22:42:57.538053] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-15T22:42:57.538186] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-15T22:42:57.540613] [INFO ] [MAIN ] Derivative Progress: 1599/1803 symbols completed. TWLO took 1.3s. Estimated remaining: 1m 17s. Rate: 159.8 symbols/min [2025-10-15T22:42:57.540935] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:57.561576] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:57.562315] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3257 primary records. [2025-10-15T22:42:57.562409] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-15T22:42:57.599028] [DEBUG] [LOCAL ] TX: Loaded 23315 existing records from primary storage. [2025-10-15T22:42:57.591388] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-15T22:42:57.599374] [INFO ] [MAIN ] TX: Loaded 23315 primary data records. [2025-10-15T22:42:57.599275] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-15T22:42:57.613372] [INFO ] [MAIN ] Derivative Progress: 1600/1803 symbols completed. TWN took 0.5s. Estimated remaining: 1m 16s. Rate: 159.9 symbols/min [2025-10-15T22:42:57.632737] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:57.718637] [DEBUG] [LOCAL ] TWO: Loaded 48657 existing records from primary storage. [2025-10-15T22:42:57.739880] [INFO ] [MAIN ] TWO: Loaded 48657 primary data records. [2025-10-15T22:42:58.232369] [DEBUG] [LOCAL ] TXNM: Loaded 43447 existing records from primary storage. [2025-10-15T22:42:58.232778] [INFO ] [MAIN ] TXNM: Loaded 43447 primary data records. [2025-10-15T22:42:58.589284] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:58.590063] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23315 primary records. [2025-10-15T22:42:58.590292] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-15T22:42:58.608601] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-15T22:42:58.609121] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-15T22:42:58.611179] [INFO ] [MAIN ] Derivative Progress: 1601/1803 symbols completed. TX took 1.1s. Estimated remaining: 1m 16s. Rate: 159.7 symbols/min [2025-10-15T22:42:58.613369] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:58.628957] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:58.629933] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48657 primary records. [2025-10-15T22:42:58.630189] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-15T22:42:58.660587] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-15T22:42:58.660483] [DEBUG] [LOCAL ] TXO: Loaded 19818 existing records from primary storage. [2025-10-15T22:42:58.660747] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-15T22:42:58.663041] [INFO ] [MAIN ] Derivative Progress: 1602/1803 symbols completed. TWO took 1.2s. Estimated remaining: 1m 15s. Rate: 159.8 symbols/min [2025-10-15T22:42:58.663176] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:58.663302] [INFO ] [MAIN ] TXO: Loaded 19818 primary data records. [2025-10-15T22:42:58.697280] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:58.708020] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43447 primary records. [2025-10-15T22:42:58.732057] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-15T22:42:58.879898] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-15T22:42:58.901734] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-15T22:42:58.986926] [INFO ] [MAIN ] Derivative Progress: 1603/1803 symbols completed. TXNM took 1.4s. Estimated remaining: 1m 15s. Rate: 159.8 symbols/min [2025-10-15T22:42:59.011532] [DEBUG] [LOCAL ] TXT: Loaded 49610 existing records from primary storage. [2025-10-15T22:42:59.012541] [INFO ] [MAIN ] TXT: Loaded 49610 primary data records. [2025-10-15T22:42:59.317753] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:59.319073] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 19818 primary records. [2025-10-15T22:42:59.319155] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-15T22:42:59.336144] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-15T22:42:59.336233] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-15T22:42:59.338152] [INFO ] [MAIN ] Derivative Progress: 1604/1803 symbols completed. TXO took 0.7s. Estimated remaining: 1m 15s. Rate: 159.8 symbols/min [2025-10-15T22:42:59.354492] [DEBUG] [MAIN ] TXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:42:59.355076] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49610 primary records. [2025-10-15T22:42:59.355136] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-15T22:42:59.370554] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-15T22:42:59.370616] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-15T22:42:59.373015] [INFO ] [MAIN ] Derivative Progress: 1605/1803 symbols completed. TXT took 0.7s. Estimated remaining: 1m 14s. Rate: 159.9 symbols/min [2025-10-15T22:42:59.373561] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:59.373696] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:59.373791] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:42:59.387960] [DEBUG] [LOCAL ] TY: Loaded 7582 existing records from primary storage. [2025-10-15T22:42:59.388151] [INFO ] [MAIN ] TY: Loaded 7582 primary data records. [2025-10-15T22:42:59.475204] [DEBUG] [LOCAL ] TYG: Loaded 13894 existing records from primary storage. [2025-10-15T22:42:59.491711] [INFO ] [MAIN ] TYG: Loaded 13894 primary data records. [2025-10-15T22:42:59.588893] [DEBUG] [LOCAL ] TYL: Loaded 22414 existing records from primary storage. [2025-10-15T22:42:59.664196] [INFO ] [MAIN ] TYL: Loaded 22414 primary data records. [2025-10-15T22:43:00.353614] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:00.354529] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7582 primary records. [2025-10-15T22:43:00.354766] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-15T22:43:00.376807] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-15T22:43:00.377520] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-15T22:43:00.379709] [INFO ] [MAIN ] Derivative Progress: 1606/1803 symbols completed. TY took 1.0s. Estimated remaining: 1m 14s. Rate: 159.7 symbols/min [2025-10-15T22:43:00.380109] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:00.406502] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:00.407597] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22414 primary records. [2025-10-15T22:43:00.407989] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-15T22:43:00.407920] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:00.409621] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13894 primary records. [2025-10-15T22:43:00.409979] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-15T22:43:00.441537] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-15T22:43:00.442456] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-15T22:43:00.445313] [INFO ] [MAIN ] Derivative Progress: 1607/1803 symbols completed. TYL took 1.1s. Estimated remaining: 1m 14s. Rate: 159.8 symbols/min [2025-10-15T22:43:00.445725] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:00.448793] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-15T22:43:00.462733] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-15T22:43:00.465041] [INFO ] [MAIN ] Derivative Progress: 1608/1803 symbols completed. TYG took 1.1s. Estimated remaining: 1m 13s. Rate: 159.9 symbols/min [2025-10-15T22:43:00.465307] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:00.493591] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-15T22:43:00.493838] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-15T22:43:00.875301] [DEBUG] [LOCAL ] UA: Loaded 50489 existing records from primary storage. [2025-10-15T22:43:00.876858] [DEBUG] [LOCAL ] UAA: Loaded 53502 existing records from primary storage. [2025-10-15T22:43:00.877302] [INFO ] [MAIN ] UAA: Loaded 53502 primary data records. [2025-10-15T22:43:00.877218] [INFO ] [MAIN ] UA: Loaded 50489 primary data records. [2025-10-15T22:43:01.648423] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:01.649967] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-15T22:43:01.650245] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-15T22:43:01.679414] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-15T22:43:01.679823] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-15T22:43:01.697711] [INFO ] [MAIN ] Derivative Progress: 1609/1803 symbols completed. U took 1.3s. Estimated remaining: 1m 13s. Rate: 159.7 symbols/min [2025-10-15T22:43:01.699031] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:01.706628] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:01.706482] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50489 primary records. [2025-10-15T22:43:01.713616] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-15T22:43:01.722355] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:01.734404] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53502 primary records. [2025-10-15T22:43:01.740024] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-15T22:43:01.769416] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-15T22:43:01.769569] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-15T22:43:01.767498] [DEBUG] [LOCAL ] UAN: Loaded 5430 existing records from primary storage. [2025-10-15T22:43:01.773105] [INFO ] [MAIN ] UAN: Loaded 5430 primary data records. [2025-10-15T22:43:01.772800] [INFO ] [MAIN ] Derivative Progress: 1610/1803 symbols completed. UAA took 1.3s. Estimated remaining: 1m 12s. Rate: 159.8 symbols/min [2025-10-15T22:43:01.780311] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:01.864372] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-15T22:43:01.864750] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-15T22:43:01.867738] [INFO ] [MAIN ] Derivative Progress: 1611/1803 symbols completed. UA took 1.4s. Estimated remaining: 1m 12s. Rate: 159.8 symbols/min [2025-10-15T22:43:01.876120] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:02.266250] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-15T22:43:02.267339] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-15T22:43:02.395479] [DEBUG] [LOCAL ] UBS: Loaded 52312 existing records from primary storage. [2025-10-15T22:43:02.409864] [INFO ] [MAIN ] UBS: Loaded 52312 primary data records. [2025-10-15T22:43:02.983261] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:02.984304] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5430 primary records. [2025-10-15T22:43:02.984627] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-15T22:43:03.003071] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-15T22:43:03.003460] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-15T22:43:03.005590] [INFO ] [MAIN ] Derivative Progress: 1612/1803 symbols completed. UAN took 1.3s. Estimated remaining: 1m 12s. Rate: 159.6 symbols/min [2025-10-15T22:43:03.006218] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:03.023967] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:03.024679] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-15T22:43:03.024867] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-15T22:43:03.042323] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-15T22:43:03.042619] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-15T22:43:03.044480] [INFO ] [MAIN ] Derivative Progress: 1613/1803 symbols completed. UBER took 1.3s. Estimated remaining: 1m 11s. Rate: 159.7 symbols/min [2025-10-15T22:43:03.052543] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:03.070093] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:03.070954] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52312 primary records. [2025-10-15T22:43:03.071118] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-15T22:43:03.110891] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-15T22:43:03.111210] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-15T22:43:03.111945] [DEBUG] [LOCAL ] UCB: Loaded 37854 existing records from primary storage. [2025-10-15T22:43:03.114735] [INFO ] [MAIN ] Derivative Progress: 1614/1803 symbols completed. UBS took 1.2s. Estimated remaining: 1m 11s. Rate: 159.8 symbols/min [2025-10-15T22:43:03.114933] [INFO ] [MAIN ] UCB: Loaded 37854 primary data records. [2025-10-15T22:43:03.115083] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:03.449733] [DEBUG] [LOCAL ] UDR: Loaded 52059 existing records from primary storage. [2025-10-15T22:43:03.458185] [INFO ] [MAIN ] UDR: Loaded 52059 primary data records. [2025-10-15T22:43:03.575449] [DEBUG] [LOCAL ] UE: Loaded 42581 existing records from primary storage. [2025-10-15T22:43:03.586973] [INFO ] [MAIN ] UE: Loaded 42581 primary data records. [2025-10-15T22:43:04.077504] [DEBUG] [MAIN ] UCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:04.078982] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37854 primary records. [2025-10-15T22:43:04.079238] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-15T22:43:04.096723] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-15T22:43:04.096907] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-15T22:43:04.101175] [INFO ] [MAIN ] Derivative Progress: 1615/1803 symbols completed. UCB took 1.1s. Estimated remaining: 1m 11s. Rate: 159.7 symbols/min [2025-10-15T22:43:04.102210] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:04.116763] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:04.117559] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 52059 primary records. [2025-10-15T22:43:04.117639] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-15T22:43:04.139020] [DEBUG] [LOCAL ] UFI: Loaded 8151 existing records from primary storage. [2025-10-15T22:43:04.140214] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-15T22:43:04.140309] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-15T22:43:04.142381] [INFO ] [MAIN ] Derivative Progress: 1616/1803 symbols completed. UDR took 1.1s. Estimated remaining: 1m 10s. Rate: 159.7 symbols/min [2025-10-15T22:43:04.142520] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:04.140392] [INFO ] [MAIN ] UFI: Loaded 8151 primary data records. [2025-10-15T22:43:04.249838] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:04.260917] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42581 primary records. [2025-10-15T22:43:04.261330] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-15T22:43:04.479849] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-15T22:43:04.481179] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-15T22:43:04.484185] [INFO ] [MAIN ] Derivative Progress: 1617/1803 symbols completed. UE took 1.4s. Estimated remaining: 1m 10s. Rate: 159.8 symbols/min [2025-10-15T22:43:04.484624] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:04.500238] [DEBUG] [LOCAL ] UGI: Loaded 50621 existing records from primary storage. [2025-10-15T22:43:04.501215] [INFO ] [MAIN ] UGI: Loaded 50621 primary data records. [2025-10-15T22:43:04.869248] [DEBUG] [LOCAL ] UGP: Loaded 42890 existing records from primary storage. [2025-10-15T22:43:04.882693] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:04.883959] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8151 primary records. [2025-10-15T22:43:04.882383] [INFO ] [MAIN ] UGP: Loaded 42890 primary data records. [2025-10-15T22:43:04.884196] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-15T22:43:05.015900] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-15T22:43:05.027465] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-15T22:43:05.053473] [INFO ] [MAIN ] Derivative Progress: 1618/1803 symbols completed. UFI took 1.0s. Estimated remaining: 1m 10s. Rate: 159.7 symbols/min [2025-10-15T22:43:05.227948] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:05.229526] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50621 primary records. [2025-10-15T22:43:05.229982] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-15T22:43:05.247455] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-15T22:43:05.247574] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-15T22:43:05.249929] [INFO ] [MAIN ] Derivative Progress: 1619/1803 symbols completed. UGI took 1.1s. Estimated remaining: 1m 9s. Rate: 159.7 symbols/min [2025-10-15T22:43:05.267620] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:05.268204] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42890 primary records. [2025-10-15T22:43:05.268294] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-15T22:43:05.283443] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-15T22:43:05.283536] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-15T22:43:05.285531] [INFO ] [MAIN ] Derivative Progress: 1620/1803 symbols completed. UGP took 0.8s. Estimated remaining: 1m 9s. Rate: 159.8 symbols/min [2025-10-15T22:43:05.286529] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:05.287096] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:05.286412] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:05.307826] [DEBUG] [LOCAL ] UI: Loaded 13975 existing records from primary storage. [2025-10-15T22:43:05.314054] [INFO ] [MAIN ] UI: Loaded 13975 primary data records. [2025-10-15T22:43:05.335369] [DEBUG] [LOCAL ] UHAL: Loaded 16844 existing records from primary storage. [2025-10-15T22:43:05.351226] [INFO ] [MAIN ] UHAL: Loaded 16844 primary data records. [2025-10-15T22:43:05.732230] [DEBUG] [LOCAL ] UHS: Loaded 40167 existing records from primary storage. [2025-10-15T22:43:05.823295] [INFO ] [MAIN ] UHS: Loaded 40167 primary data records. [2025-10-15T22:43:06.279371] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:06.282202] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13975 primary records. [2025-10-15T22:43:06.282542] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-15T22:43:06.314863] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:06.316161] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16844 primary records. [2025-10-15T22:43:06.316260] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-15T22:43:06.317874] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-15T22:43:06.318160] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-15T22:43:06.320481] [INFO ] [MAIN ] Derivative Progress: 1621/1803 symbols completed. UI took 1.0s. Estimated remaining: 1m 8s. Rate: 159.7 symbols/min [2025-10-15T22:43:06.320886] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:06.337472] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-15T22:43:06.337610] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-15T22:43:06.339986] [INFO ] [MAIN ] Derivative Progress: 1622/1803 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 8s. Rate: 159.8 symbols/min [2025-10-15T22:43:06.340233] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:06.356965] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:06.357713] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40167 primary records. [2025-10-15T22:43:06.357860] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-15T22:43:06.376335] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-15T22:43:06.376424] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-15T22:43:06.387914] [INFO ] [MAIN ] Derivative Progress: 1623/1803 symbols completed. UHS took 1.1s. Estimated remaining: 1m 8s. Rate: 159.8 symbols/min [2025-10-15T22:43:06.388055] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:06.404076] [DEBUG] [LOCAL ] UIS: Loaded 36906 existing records from primary storage. [2025-10-15T22:43:06.418328] [INFO ] [MAIN ] UIS: Loaded 36906 primary data records. [2025-10-15T22:43:06.568884] [DEBUG] [LOCAL ] UL: Loaded 53078 existing records from primary storage. [2025-10-15T22:43:06.636551] [INFO ] [MAIN ] UL: Loaded 53078 primary data records. [2025-10-15T22:43:06.760479] [DEBUG] [LOCAL ] ULS: Loaded 38979 existing records from primary storage. [2025-10-15T22:43:06.806268] [INFO ] [MAIN ] ULS: Loaded 38979 primary data records. [2025-10-15T22:43:07.430918] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:07.432845] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36906 primary records. [2025-10-15T22:43:07.433783] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-15T22:43:07.455011] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-15T22:43:07.455704] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-15T22:43:07.458157] [INFO ] [MAIN ] Derivative Progress: 1624/1803 symbols completed. UIS took 1.1s. Estimated remaining: 1m 7s. Rate: 159.7 symbols/min [2025-10-15T22:43:07.458534] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:07.479504] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:07.487847] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53078 primary records. [2025-10-15T22:43:07.493110] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:07.492933] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-15T22:43:07.494227] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 38979 primary records. [2025-10-15T22:43:07.494316] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-15T22:43:07.525473] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-15T22:43:07.526784] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-15T22:43:07.526728] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-15T22:43:07.526995] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-15T22:43:07.529898] [INFO ] [MAIN ] Derivative Progress: 1625/1803 symbols completed. ULS took 1.1s. Estimated remaining: 1m 7s. Rate: 159.7 symbols/min [2025-10-15T22:43:07.532321] [INFO ] [MAIN ] Derivative Progress: 1626/1803 symbols completed. UL took 1.2s. Estimated remaining: 1m 6s. Rate: 159.8 symbols/min [2025-10-15T22:43:07.532262] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:07.532496] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:07.584782] [DEBUG] [LOCAL ] UMC: Loaded 52686 existing records from primary storage. [2025-10-15T22:43:07.585035] [INFO ] [MAIN ] UMC: Loaded 52686 primary data records. [2025-10-15T22:43:07.684248] [DEBUG] [LOCAL ] UMH: Loaded 34142 existing records from primary storage. [2025-10-15T22:43:07.702559] [INFO ] [MAIN ] UMH: Loaded 34142 primary data records. [2025-10-15T22:43:07.811494] [DEBUG] [LOCAL ] UNFI: Loaded 42628 existing records from primary storage. [2025-10-15T22:43:07.827292] [INFO ] [MAIN ] UNFI: Loaded 42628 primary data records. [2025-10-15T22:43:08.543098] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:08.546244] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52686 primary records. [2025-10-15T22:43:08.546400] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-15T22:43:08.576190] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:08.577638] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 34142 primary records. [2025-10-15T22:43:08.585713] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-15T22:43:08.593324] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:08.593996] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42628 primary records. [2025-10-15T22:43:08.594130] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-15T22:43:08.593048] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-15T22:43:08.602916] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-15T22:43:08.605232] [INFO ] [MAIN ] Derivative Progress: 1627/1803 symbols completed. UMC took 1.1s. Estimated remaining: 1m 6s. Rate: 159.7 symbols/min [2025-10-15T22:43:08.605631] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:08.625271] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-15T22:43:08.625867] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-15T22:43:08.628079] [INFO ] [MAIN ] Derivative Progress: 1628/1803 symbols completed. UMH took 1.1s. Estimated remaining: 1m 6s. Rate: 159.7 symbols/min [2025-10-15T22:43:08.629359] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:08.634104] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-15T22:43:08.634390] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-15T22:43:08.637946] [INFO ] [MAIN ] Derivative Progress: 1629/1803 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 5s. Rate: 159.8 symbols/min [2025-10-15T22:43:08.638303] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:08.648321] [DEBUG] [LOCAL ] UNMA: Loaded 3499 existing records from primary storage. [2025-10-15T22:43:08.648456] [INFO ] [MAIN ] UNMA: Loaded 3499 primary data records. [2025-10-15T22:43:09.033016] [DEBUG] [LOCAL ] UNM: Loaded 48146 existing records from primary storage. [2025-10-15T22:43:09.033288] [INFO ] [MAIN ] UNM: Loaded 48146 primary data records. [2025-10-15T22:43:09.034097] [DEBUG] [LOCAL ] UNH: Loaded 53818 existing records from primary storage. [2025-10-15T22:43:09.046073] [INFO ] [MAIN ] UNH: Loaded 53818 primary data records. [2025-10-15T22:43:09.689625] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:09.690858] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3499 primary records. [2025-10-15T22:43:09.691098] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-15T22:43:09.709568] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-10-15T22:43:09.709706] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-15T22:43:09.712083] [INFO ] [MAIN ] Derivative Progress: 1630/1803 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 5s. Rate: 159.7 symbols/min [2025-10-15T22:43:09.712451] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:09.733731] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:09.734799] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48146 primary records. [2025-10-15T22:43:09.735007] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-15T22:43:09.756120] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:09.756868] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53818 primary records. [2025-10-15T22:43:09.762211] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-15T22:43:09.781168] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-15T22:43:09.781923] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-15T22:43:09.784060] [INFO ] [MAIN ] Derivative Progress: 1631/1803 symbols completed. UNM took 1.2s. Estimated remaining: 1m 5s. Rate: 159.7 symbols/min [2025-10-15T22:43:09.784822] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:09.801927] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-15T22:43:09.802152] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-15T22:43:09.804794] [INFO ] [MAIN ] Derivative Progress: 1632/1803 symbols completed. UNH took 1.2s. Estimated remaining: 1m 4s. Rate: 159.8 symbols/min [2025-10-15T22:43:09.804999] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:09.827940] [DEBUG] [LOCAL ] UNP: Loaded 53328 existing records from primary storage. [2025-10-15T22:43:09.828326] [INFO ] [MAIN ] UNP: Loaded 53328 primary data records. [2025-10-15T22:43:10.176887] [DEBUG] [LOCAL ] UP: Loaded 44181 existing records from primary storage. [2025-10-15T22:43:10.177671] [DEBUG] [LOCAL ] UPS: Loaded 53719 existing records from primary storage. [2025-10-15T22:43:10.177788] [INFO ] [MAIN ] UP: Loaded 44181 primary data records. [2025-10-15T22:43:10.177882] [INFO ] [MAIN ] UPS: Loaded 53719 primary data records. [2025-10-15T22:43:10.823028] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:10.824379] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53328 primary records. [2025-10-15T22:43:10.824667] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-15T22:43:10.842846] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-15T22:43:10.843172] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-15T22:43:10.846172] [INFO ] [MAIN ] Derivative Progress: 1633/1803 symbols completed. UNP took 1.1s. Estimated remaining: 1m 4s. Rate: 159.7 symbols/min [2025-10-15T22:43:10.861997] [DEBUG] [MAIN ] UPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:10.862756] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53719 primary records. [2025-10-15T22:43:10.862896] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-15T22:43:10.880436] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-10-15T22:43:10.880555] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-15T22:43:10.883096] [INFO ] [MAIN ] Derivative Progress: 1634/1803 symbols completed. UPS took 1.1s. Estimated remaining: 1m 3s. Rate: 159.7 symbols/min [2025-10-15T22:43:10.895407] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:10.895967] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 44181 primary records. [2025-10-15T22:43:10.896027] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-15T22:43:10.910884] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-15T22:43:10.910940] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-15T22:43:10.913534] [INFO ] [MAIN ] Derivative Progress: 1635/1803 symbols completed. UP took 1.1s. Estimated remaining: 1m 3s. Rate: 159.8 symbols/min [2025-10-15T22:43:10.914154] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:10.914070] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:10.914203] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:10.946603] [DEBUG] [LOCAL ] USAC: Loaded 21665 existing records from primary storage. [2025-10-15T22:43:10.954116] [INFO ] [MAIN ] USAC: Loaded 21665 primary data records. [2025-10-15T22:43:11.076124] [DEBUG] [LOCAL ] URI: Loaded 34764 existing records from primary storage. [2025-10-15T22:43:11.092489] [DEBUG] [LOCAL ] USA: Loaded 36382 existing records from primary storage. [2025-10-15T22:43:11.092548] [INFO ] [MAIN ] URI: Loaded 34764 primary data records. [2025-10-15T22:43:11.102904] [INFO ] [MAIN ] USA: Loaded 36382 primary data records. [2025-10-15T22:43:11.883743] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:11.885831] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21665 primary records. [2025-10-15T22:43:11.886359] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-15T22:43:11.906825] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-15T22:43:11.907250] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-15T22:43:11.922065] [INFO ] [MAIN ] Derivative Progress: 1636/1803 symbols completed. USAC took 1.0s. Estimated remaining: 1m 3s. Rate: 159.7 symbols/min [2025-10-15T22:43:11.923442] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:11.923033] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:11.925201] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36382 primary records. [2025-10-15T22:43:11.926102] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-15T22:43:11.953202] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:11.955124] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 34764 primary records. [2025-10-15T22:43:11.955715] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-15T22:43:11.957389] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-15T22:43:11.957879] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-15T22:43:11.967818] [INFO ] [MAIN ] Derivative Progress: 1637/1803 symbols completed. USA took 1.1s. Estimated remaining: 1m 2s. Rate: 159.8 symbols/min [2025-10-15T22:43:11.969168] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:11.975867] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-15T22:43:11.976679] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-15T22:43:11.979424] [INFO ] [MAIN ] Derivative Progress: 1638/1803 symbols completed. URI took 1.1s. Estimated remaining: 1m 2s. Rate: 159.9 symbols/min [2025-10-15T22:43:11.979736] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:12.010732] [DEBUG] [LOCAL ] USNA: Loaded 17949 existing records from primary storage. [2025-10-15T22:43:12.010953] [INFO ] [MAIN ] USNA: Loaded 17949 primary data records. [2025-10-15T22:43:12.124849] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-15T22:43:12.145464] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-15T22:43:12.445757] [DEBUG] [LOCAL ] USFD: Loaded 51183 existing records from primary storage. [2025-10-15T22:43:12.463380] [INFO ] [MAIN ] USFD: Loaded 51183 primary data records. [2025-10-15T22:43:13.003494] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:13.005599] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17949 primary records. [2025-10-15T22:43:13.005834] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-15T22:43:13.024555] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-15T22:43:13.025530] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-15T22:43:13.028306] [INFO ] [MAIN ] Derivative Progress: 1639/1803 symbols completed. USNA took 1.0s. Estimated remaining: 1m 2s. Rate: 159.7 symbols/min [2025-10-15T22:43:13.028714] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:13.043187] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:13.043918] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-15T22:43:13.044121] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-15T22:43:13.079827] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:13.086591] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-15T22:43:13.087749] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51183 primary records. [2025-10-15T22:43:13.087878] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-15T22:43:13.088766] [DEBUG] [LOCAL ] USPH: Loaded 17107 existing records from primary storage. [2025-10-15T22:43:13.089160] [INFO ] [MAIN ] USPH: Loaded 17107 primary data records. [2025-10-15T22:43:13.088829] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-15T22:43:13.098777] [INFO ] [MAIN ] Derivative Progress: 1640/1803 symbols completed. USB took 1.2s. Estimated remaining: 1m 1s. Rate: 159.8 symbols/min [2025-10-15T22:43:13.123047] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:13.213299] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-15T22:43:13.223779] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-15T22:43:13.250541] [INFO ] [MAIN ] Derivative Progress: 1641/1803 symbols completed. USFD took 1.3s. Estimated remaining: 1m 1s. Rate: 159.8 symbols/min [2025-10-15T22:43:13.295783] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:13.416673] [DEBUG] [LOCAL ] UTF: Loaded 30808 existing records from primary storage. [2025-10-15T22:43:13.417226] [INFO ] [MAIN ] UTF: Loaded 30808 primary data records. [2025-10-15T22:43:13.768959] [DEBUG] [LOCAL ] UTI: Loaded 40492 existing records from primary storage. [2025-10-15T22:43:13.769553] [INFO ] [MAIN ] UTI: Loaded 40492 primary data records. [2025-10-15T22:43:13.769997] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:13.782717] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17107 primary records. [2025-10-15T22:43:13.814787] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-15T22:43:14.081569] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-15T22:43:14.081801] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-15T22:43:14.083825] [INFO ] [MAIN ] Derivative Progress: 1642/1803 symbols completed. USPH took 1.1s. Estimated remaining: 1m 0s. Rate: 159.7 symbols/min [2025-10-15T22:43:14.084139] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:14.102932] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:14.106792] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 30808 primary records. [2025-10-15T22:43:14.107002] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-15T22:43:14.123866] [DEBUG] [LOCAL ] UTL: Loaded 11800 existing records from primary storage. [2025-10-15T22:43:14.128342] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-15T22:43:14.129075] [INFO ] [MAIN ] UTL: Loaded 11800 primary data records. [2025-10-15T22:43:14.129027] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-15T22:43:14.142808] [INFO ] [MAIN ] Derivative Progress: 1643/1803 symbols completed. UTF took 1.0s. Estimated remaining: 1m 0s. Rate: 159.8 symbols/min [2025-10-15T22:43:14.143082] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:14.450152] [DEBUG] [MAIN ] UTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:14.450992] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40492 primary records. [2025-10-15T22:43:14.451175] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-15T22:43:14.468779] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-15T22:43:14.481373] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-15T22:43:14.484127] [INFO ] [MAIN ] Derivative Progress: 1644/1803 symbols completed. UTI took 1.2s. Estimated remaining: 59.7s. Rate: 159.8 symbols/min [2025-10-15T22:43:14.484349] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:14.485928] [DEBUG] [LOCAL ] UTZ: Loaded 44602 existing records from primary storage. [2025-10-15T22:43:14.486079] [INFO ] [MAIN ] UTZ: Loaded 44602 primary data records. [2025-10-15T22:43:14.657133] [DEBUG] [LOCAL ] UVE: Loaded 22014 existing records from primary storage. [2025-10-15T22:43:14.692006] [INFO ] [MAIN ] UVE: Loaded 22014 primary data records. [2025-10-15T22:43:14.976331] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:14.993843] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11800 primary records. [2025-10-15T22:43:14.994332] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-15T22:43:15.086875] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-15T22:43:15.087264] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-15T22:43:15.189862] [INFO ] [MAIN ] Derivative Progress: 1645/1803 symbols completed. UTL took 1.1s. Estimated remaining: 59.4s. Rate: 159.7 symbols/min [2025-10-15T22:43:15.204305] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:15.245523] [DEBUG] [LOCAL ] UVV: Loaded 22766 existing records from primary storage. [2025-10-15T22:43:15.246098] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:15.246316] [INFO ] [MAIN ] UVV: Loaded 22766 primary data records. [2025-10-15T22:43:15.247198] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44602 primary records. [2025-10-15T22:43:15.248892] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-15T22:43:15.379814] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-15T22:43:15.365299] [DEBUG] [MAIN ] UVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:15.383449] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-15T22:43:15.386771] [INFO ] [MAIN ] Derivative Progress: 1646/1803 symbols completed. UTZ took 1.2s. Estimated remaining: 59.0s. Rate: 159.7 symbols/min [2025-10-15T22:43:15.384153] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 22014 primary records. [2025-10-15T22:43:15.392266] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:15.392444] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-15T22:43:15.605213] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-15T22:43:15.605502] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-15T22:43:15.608544] [INFO ] [MAIN ] Derivative Progress: 1647/1803 symbols completed. UVE took 1.1s. Estimated remaining: 58.6s. Rate: 159.8 symbols/min [2025-10-15T22:43:15.609989] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:15.619422] [DEBUG] [LOCAL ] UZD: Loaded 6128 existing records from primary storage. [2025-10-15T22:43:15.633493] [INFO ] [MAIN ] UZD: Loaded 6128 primary data records. [2025-10-15T22:43:15.780273] [DEBUG] [LOCAL ] UWMC: Loaded 52955 existing records from primary storage. [2025-10-15T22:43:15.786115] [INFO ] [MAIN ] UWMC: Loaded 52955 primary data records. [2025-10-15T22:43:15.802847] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:15.832588] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22766 primary records. [2025-10-15T22:43:15.880325] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-15T22:43:16.141370] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-15T22:43:16.281383] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-15T22:43:16.283790] [INFO ] [MAIN ] Derivative Progress: 1648/1803 symbols completed. UVV took 1.1s. Estimated remaining: 58.2s. Rate: 159.7 symbols/min [2025-10-15T22:43:16.306546] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:16.307297] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6128 primary records. [2025-10-15T22:43:16.307444] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-15T22:43:16.334545] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:16.336085] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52955 primary records. [2025-10-15T22:43:16.336598] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-15T22:43:16.337966] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-15T22:43:16.338034] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-15T22:43:16.340095] [INFO ] [MAIN ] Derivative Progress: 1649/1803 symbols completed. UZD took 0.7s. Estimated remaining: 57.8s. Rate: 159.8 symbols/min [2025-10-15T22:43:16.353977] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-15T22:43:16.354036] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-15T22:43:16.356847] [INFO ] [MAIN ] Derivative Progress: 1650/1803 symbols completed. UWMC took 1.0s. Estimated remaining: 57.4s. Rate: 159.9 symbols/min [2025-10-15T22:43:16.357290] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:16.357215] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:16.357619] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:16.368606] [DEBUG] [LOCAL ] UZF: Loaded 6082 existing records from primary storage. [2025-10-15T22:43:16.372053] [INFO ] [MAIN ] UZF: Loaded 6082 primary data records. [2025-10-15T22:43:16.371935] [DEBUG] [LOCAL ] UZE: Loaded 7273 existing records from primary storage. [2025-10-15T22:43:16.392799] [INFO ] [MAIN ] UZE: Loaded 7273 primary data records. [2025-10-15T22:43:17.018294] [DEBUG] [LOCAL ] V: Loaded 53753 existing records from primary storage. [2025-10-15T22:43:17.020634] [INFO ] [MAIN ] V: Loaded 53753 primary data records. [2025-10-15T22:43:17.346482] [DEBUG] [MAIN ] UZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:17.347744] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6082 primary records. [2025-10-15T22:43:17.348543] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-15T22:43:17.367618] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-15T22:43:17.367867] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-15T22:43:17.370382] [INFO ] [MAIN ] Derivative Progress: 1651/1803 symbols completed. UZF took 1.0s. Estimated remaining: 57.1s. Rate: 159.7 symbols/min [2025-10-15T22:43:17.370578] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:17.385137] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:17.386167] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7273 primary records. [2025-10-15T22:43:17.386501] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-15T22:43:17.402712] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-15T22:43:17.403025] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-15T22:43:17.405592] [INFO ] [MAIN ] Derivative Progress: 1652/1803 symbols completed. UZE took 1.0s. Estimated remaining: 56.7s. Rate: 159.8 symbols/min [2025-10-15T22:43:17.407886] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:17.432910] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:17.433690] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53753 primary records. [2025-10-15T22:43:17.433891] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-15T22:43:17.461771] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-15T22:43:17.462748] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-15T22:43:17.465466] [INFO ] [MAIN ] Derivative Progress: 1653/1803 symbols completed. V took 1.1s. Estimated remaining: 56.3s. Rate: 159.9 symbols/min [2025-10-15T22:43:17.462622] [DEBUG] [LOCAL ] VAC: Loaded 34088 existing records from primary storage. [2025-10-15T22:43:17.465701] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:17.466419] [INFO ] [MAIN ] VAC: Loaded 34088 primary data records. [2025-10-15T22:43:17.649453] [DEBUG] [LOCAL ] VAL: Loaded 50174 existing records from primary storage. [2025-10-15T22:43:17.655039] [INFO ] [MAIN ] VAL: Loaded 50174 primary data records. [2025-10-15T22:43:17.969928] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-15T22:43:18.009618] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-15T22:43:18.369608] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:18.375426] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34088 primary records. [2025-10-15T22:43:18.375780] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-15T22:43:18.557478] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-15T22:43:18.559906] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-15T22:43:18.564404] [INFO ] [MAIN ] Derivative Progress: 1654/1803 symbols completed. VAC took 1.2s. Estimated remaining: 56.0s. Rate: 159.7 symbols/min [2025-10-15T22:43:18.565636] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:18.580795] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:18.581635] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50174 primary records. [2025-10-15T22:43:18.583131] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-15T22:43:18.600311] [DEBUG] [LOCAL ] VATE: Loaded 5215 existing records from primary storage. [2025-10-15T22:43:18.600839] [INFO ] [MAIN ] VATE: Loaded 5215 primary data records. [2025-10-15T22:43:18.674856] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-15T22:43:18.681272] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-15T22:43:18.689687] [INFO ] [MAIN ] Derivative Progress: 1655/1803 symbols completed. VAL took 1.3s. Estimated remaining: 55.6s. Rate: 159.8 symbols/min [2025-10-15T22:43:18.695066] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:18.747667] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:18.755625] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-15T22:43:18.776536] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-15T22:43:18.831632] [DEBUG] [LOCAL ] VBF: Loaded 7220 existing records from primary storage. [2025-10-15T22:43:18.953306] [INFO ] [MAIN ] VBF: Loaded 7220 primary data records. [2025-10-15T22:43:18.956932] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-15T22:43:18.978395] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-15T22:43:18.997486] [INFO ] [MAIN ] Derivative Progress: 1656/1803 symbols completed. VALE took 1.5s. Estimated remaining: 55.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:19.026010] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:19.157814] [DEBUG] [LOCAL ] VCV: Loaded 13659 existing records from primary storage. [2025-10-15T22:43:19.231716] [INFO ] [MAIN ] VCV: Loaded 13659 primary data records. [2025-10-15T22:43:19.589421] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:19.590454] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5215 primary records. [2025-10-15T22:43:19.590928] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-15T22:43:19.608855] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-15T22:43:19.611027] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-15T22:43:19.613203] [INFO ] [MAIN ] Derivative Progress: 1657/1803 symbols completed. VATE took 1.0s. Estimated remaining: 54.8s. Rate: 159.7 symbols/min [2025-10-15T22:43:19.613686] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:19.628117] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:19.629245] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7220 primary records. [2025-10-15T22:43:19.629552] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-15T22:43:19.645763] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-15T22:43:19.645891] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-15T22:43:19.648520] [INFO ] [MAIN ] Derivative Progress: 1658/1803 symbols completed. VBF took 1.0s. Estimated remaining: 54.4s. Rate: 159.8 symbols/min [2025-10-15T22:43:19.648800] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:19.665595] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:19.669245] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13659 primary records. [2025-10-15T22:43:19.669405] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-15T22:43:19.702138] [DEBUG] [LOCAL ] VEL: Loaded 12188 existing records from primary storage. [2025-10-15T22:43:19.703496] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-15T22:43:19.703616] [INFO ] [MAIN ] VEL: Loaded 12188 primary data records. [2025-10-15T22:43:19.709113] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-15T22:43:19.744973] [INFO ] [MAIN ] Derivative Progress: 1659/1803 symbols completed. VCV took 0.7s. Estimated remaining: 54.0s. Rate: 159.9 symbols/min [2025-10-15T22:43:19.775813] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:19.799206] [DEBUG] [LOCAL ] VEEV: Loaded 47309 existing records from primary storage. [2025-10-15T22:43:19.804665] [INFO ] [MAIN ] VEEV: Loaded 47309 primary data records. [2025-10-15T22:43:20.347544] [DEBUG] [LOCAL ] VET: Loaded 44112 existing records from primary storage. [2025-10-15T22:43:20.348077] [INFO ] [MAIN ] VET: Loaded 44112 primary data records. [2025-10-15T22:43:20.705930] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:20.709924] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12188 primary records. [2025-10-15T22:43:20.725374] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-15T22:43:20.726537] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:20.728332] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47309 primary records. [2025-10-15T22:43:20.728680] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-15T22:43:20.760994] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-15T22:43:20.761874] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-15T22:43:20.764913] [INFO ] [MAIN ] Derivative Progress: 1660/1803 symbols completed. VEEV took 1.2s. Estimated remaining: 53.7s. Rate: 159.7 symbols/min [2025-10-15T22:43:20.765585] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:20.768863] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-15T22:43:20.769099] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-15T22:43:20.771978] [INFO ] [MAIN ] Derivative Progress: 1661/1803 symbols completed. VEL took 1.1s. Estimated remaining: 53.3s. Rate: 159.8 symbols/min [2025-10-15T22:43:20.772209] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:20.796809] [DEBUG] [LOCAL ] VGI: Loaded 5204 existing records from primary storage. [2025-10-15T22:43:20.797138] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:20.798000] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44112 primary records. [2025-10-15T22:43:20.798317] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-15T22:43:20.798090] [INFO ] [MAIN ] VGI: Loaded 5204 primary data records. [2025-10-15T22:43:20.862933] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-15T22:43:20.885955] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-15T22:43:20.923787] [INFO ] [MAIN ] Derivative Progress: 1662/1803 symbols completed. VET took 1.1s. Estimated remaining: 52.9s. Rate: 159.9 symbols/min [2025-10-15T22:43:20.951618] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:21.183907] [DEBUG] [LOCAL ] VGM: Loaded 18563 existing records from primary storage. [2025-10-15T22:43:21.184163] [INFO ] [MAIN ] VGM: Loaded 18563 primary data records. [2025-10-15T22:43:21.185124] [DEBUG] [LOCAL ] VFC: Loaded 53605 existing records from primary storage. [2025-10-15T22:43:21.185324] [INFO ] [MAIN ] VFC: Loaded 53605 primary data records. [2025-10-15T22:43:21.814332] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:21.815490] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5204 primary records. [2025-10-15T22:43:21.815931] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-15T22:43:21.834019] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-15T22:43:21.834539] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-15T22:43:21.837080] [INFO ] [MAIN ] Derivative Progress: 1663/1803 symbols completed. VGI took 1.1s. Estimated remaining: 52.6s. Rate: 159.7 symbols/min [2025-10-15T22:43:21.853896] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:21.854842] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53605 primary records. [2025-10-15T22:43:21.855618] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-15T22:43:21.885791] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:21.885459] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-15T22:43:21.886606] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-15T22:43:21.886559] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18563 primary records. [2025-10-15T22:43:21.886739] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-15T22:43:21.890225] [INFO ] [MAIN ] Derivative Progress: 1664/1803 symbols completed. VFC took 1.1s. Estimated remaining: 52.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:21.905500] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-15T22:43:21.905585] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-15T22:43:21.908308] [INFO ] [MAIN ] Derivative Progress: 1665/1803 symbols completed. VGM took 1.0s. Estimated remaining: 51.8s. Rate: 159.9 symbols/min [2025-10-15T22:43:21.909048] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:21.908975] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:21.909269] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:21.916206] [DEBUG] [LOCAL ] VHI: Loaded 2775 existing records from primary storage. [2025-10-15T22:43:21.916383] [INFO ] [MAIN ] VHI: Loaded 2775 primary data records. [2025-10-15T22:43:22.255970] [DEBUG] [LOCAL ] VIK: Loaded 52471 existing records from primary storage. [2025-10-15T22:43:22.256517] [INFO ] [MAIN ] VIK: Loaded 52471 primary data records. [2025-10-15T22:43:22.339719] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-15T22:43:22.351537] [INFO ] [MAIN ] VICI: Loaded 53653 primary data records. [2025-10-15T22:43:22.954395] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:22.955932] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2775 primary records. [2025-10-15T22:43:22.956138] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-15T22:43:22.972724] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-15T22:43:22.973059] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-15T22:43:22.975428] [INFO ] [MAIN ] Derivative Progress: 1666/1803 symbols completed. VHI took 1.1s. Estimated remaining: 51.5s. Rate: 159.7 symbols/min [2025-10-15T22:43:22.975853] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:22.998616] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:23.002726] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52471 primary records. [2025-10-15T22:43:23.003270] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-15T22:43:23.017806] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:23.026554] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53653 primary records. [2025-10-15T22:43:23.032898] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-15T22:43:23.048901] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-15T22:43:23.049330] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-15T22:43:23.058496] [INFO ] [MAIN ] Derivative Progress: 1667/1803 symbols completed. VIK took 1.1s. Estimated remaining: 51.1s. Rate: 159.8 symbols/min [2025-10-15T22:43:23.066715] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-15T22:43:23.066837] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:23.081557] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-15T22:43:23.084427] [INFO ] [MAIN ] Derivative Progress: 1668/1803 symbols completed. VICI took 1.2s. Estimated remaining: 50.7s. Rate: 159.9 symbols/min [2025-10-15T22:43:23.085890] [DEBUG] [LOCAL ] VIPS: Loaded 51304 existing records from primary storage. [2025-10-15T22:43:23.084720] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:23.086412] [INFO ] [MAIN ] VIPS: Loaded 51304 primary data records. [2025-10-15T22:43:23.420870] [DEBUG] [LOCAL ] VIST: Loaded 46546 existing records from primary storage. [2025-10-15T22:43:23.421497] [INFO ] [MAIN ] VIST: Loaded 46546 primary data records. [2025-10-15T22:43:23.537196] [DEBUG] [LOCAL ] VIV: Loaded 44858 existing records from primary storage. [2025-10-15T22:43:23.543481] [INFO ] [MAIN ] VIV: Loaded 44858 primary data records. [2025-10-15T22:43:23.913585] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:23.959473] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51304 primary records. [2025-10-15T22:43:24.069772] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-15T22:43:24.099154] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-15T22:43:24.100227] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-15T22:43:24.102615] [INFO ] [MAIN ] Derivative Progress: 1669/1803 symbols completed. VIPS took 1.1s. Estimated remaining: 50.3s. Rate: 159.7 symbols/min [2025-10-15T22:43:24.103717] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:24.125437] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:24.130969] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46546 primary records. [2025-10-15T22:43:24.131312] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-15T22:43:24.152614] [DEBUG] [LOCAL ] VKQ: Loaded 17636 existing records from primary storage. [2025-10-15T22:43:24.154422] [INFO ] [MAIN ] VKQ: Loaded 17636 primary data records. [2025-10-15T22:43:24.222953] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:24.243520] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-15T22:43:24.256685] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-15T22:43:24.259912] [INFO ] [MAIN ] Derivative Progress: 1670/1803 symbols completed. VIST took 1.2s. Estimated remaining: 49.9s. Rate: 159.8 symbols/min [2025-10-15T22:43:24.279753] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:24.256610] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44858 primary records. [2025-10-15T22:43:24.283430] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-15T22:43:24.377240] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-15T22:43:24.377342] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-15T22:43:24.426096] [INFO ] [MAIN ] Derivative Progress: 1671/1803 symbols completed. VIV took 1.3s. Estimated remaining: 49.6s. Rate: 159.8 symbols/min [2025-10-15T22:43:24.513758] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:24.545212] [DEBUG] [LOCAL ] VLN: Loaded 30740 existing records from primary storage. [2025-10-15T22:43:24.546791] [INFO ] [MAIN ] VLN: Loaded 30740 primary data records. [2025-10-15T22:43:24.887175] [DEBUG] [MAIN ] VKQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:24.888623] [DEBUG] [LOCAL ] VLO: Loaded 53027 existing records from primary storage. [2025-10-15T22:43:24.888807] [INFO ] [MAIN ] VLO: Loaded 53027 primary data records. [2025-10-15T22:43:24.889629] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17636 primary records. [2025-10-15T22:43:24.900729] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-15T22:43:25.008574] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-15T22:43:25.014608] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-15T22:43:25.016859] [INFO ] [MAIN ] Derivative Progress: 1672/1803 symbols completed. VKQ took 0.9s. Estimated remaining: 49.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:25.022156] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:25.221596] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:25.231850] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 30740 primary records. [2025-10-15T22:43:25.232818] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-15T22:43:25.248413] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-15T22:43:25.249241] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-15T22:43:25.251437] [INFO ] [MAIN ] Derivative Progress: 1673/1803 symbols completed. VLN took 1.0s. Estimated remaining: 48.8s. Rate: 159.8 symbols/min [2025-10-15T22:43:25.251683] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:25.265193] [DEBUG] [LOCAL ] VLRS: Loaded 39730 existing records from primary storage. [2025-10-15T22:43:25.266296] [INFO ] [MAIN ] VLRS: Loaded 39730 primary data records. [2025-10-15T22:43:25.314999] [DEBUG] [LOCAL ] VLT: Loaded 4415 existing records from primary storage. [2025-10-15T22:43:25.328047] [INFO ] [MAIN ] VLT: Loaded 4415 primary data records. [2025-10-15T22:43:25.480229] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:25.533950] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53027 primary records. [2025-10-15T22:43:25.544931] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-15T22:43:25.893242] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-15T22:43:25.893387] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-15T22:43:25.895872] [INFO ] [MAIN ] Derivative Progress: 1674/1803 symbols completed. VLO took 1.4s. Estimated remaining: 48.5s. Rate: 159.7 symbols/min [2025-10-15T22:43:25.896579] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:25.921721] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:25.922617] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 39730 primary records. [2025-10-15T22:43:25.922750] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-15T22:43:25.961872] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:25.964529] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-15T22:43:25.963415] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4415 primary records. [2025-10-15T22:43:25.964686] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-15T22:43:25.964748] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-15T22:43:25.966965] [INFO ] [MAIN ] Derivative Progress: 1675/1803 symbols completed. VLRS took 0.9s. Estimated remaining: 48.1s. Rate: 159.8 symbols/min [2025-10-15T22:43:25.967272] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:25.990198] [DEBUG] [LOCAL ] VLTO: Loaded 46190 existing records from primary storage. [2025-10-15T22:43:25.996318] [INFO ] [MAIN ] VLTO: Loaded 46190 primary data records. [2025-10-15T22:43:25.996927] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-15T22:43:26.017608] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-15T22:43:26.036202] [INFO ] [MAIN ] Derivative Progress: 1676/1803 symbols completed. VLT took 0.8s. Estimated remaining: 47.7s. Rate: 159.9 symbols/min [2025-10-15T22:43:26.054782] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:26.322470] [DEBUG] [LOCAL ] VMI: Loaded 15071 existing records from primary storage. [2025-10-15T22:43:26.323469] [DEBUG] [LOCAL ] VMC: Loaded 42564 existing records from primary storage. [2025-10-15T22:43:26.323624] [INFO ] [MAIN ] VMI: Loaded 15071 primary data records. [2025-10-15T22:43:26.324190] [INFO ] [MAIN ] VMC: Loaded 42564 primary data records. [2025-10-15T22:43:26.959604] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:26.962149] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46190 primary records. [2025-10-15T22:43:26.962664] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-15T22:43:26.983236] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-15T22:43:26.983378] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-15T22:43:26.985545] [INFO ] [MAIN ] Derivative Progress: 1677/1803 symbols completed. VLTO took 1.1s. Estimated remaining: 47.3s. Rate: 159.8 symbols/min [2025-10-15T22:43:26.985990] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:27.007155] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:27.020699] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 42564 primary records. [2025-10-15T22:43:27.025985] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-15T22:43:27.026269] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:27.027723] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15071 primary records. [2025-10-15T22:43:27.028088] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-15T22:43:27.045047] [DEBUG] [LOCAL ] VMO: Loaded 20777 existing records from primary storage. [2025-10-15T22:43:27.058716] [INFO ] [MAIN ] VMO: Loaded 20777 primary data records. [2025-10-15T22:43:27.060386] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-15T22:43:27.063937] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-15T22:43:27.077351] [INFO ] [MAIN ] Derivative Progress: 1678/1803 symbols completed. VMC took 1.1s. Estimated remaining: 46.9s. Rate: 159.8 symbols/min [2025-10-15T22:43:27.172997] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-10-15T22:43:27.173169] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-15T22:43:27.176318] [INFO ] [MAIN ] Derivative Progress: 1679/1803 symbols completed. VMI took 1.1s. Estimated remaining: 46.5s. Rate: 159.9 symbols/min [2025-10-15T22:43:27.378075] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:27.378738] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20777 primary records. [2025-10-15T22:43:27.378801] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-15T22:43:27.393741] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-15T22:43:27.393800] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-15T22:43:27.395771] [INFO ] [MAIN ] Derivative Progress: 1680/1803 symbols completed. VMO took 0.4s. Estimated remaining: 46.1s. Rate: 159.9 symbols/min [2025-10-15T22:43:27.396631] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:27.396774] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:27.396906] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:27.407372] [DEBUG] [LOCAL ] VNCE: Loaded 9018 existing records from primary storage. [2025-10-15T22:43:27.407491] [INFO ] [MAIN ] VNCE: Loaded 9018 primary data records. [2025-10-15T22:43:27.745135] [DEBUG] [LOCAL ] VNT: Loaded 43959 existing records from primary storage. [2025-10-15T22:43:27.745805] [INFO ] [MAIN ] VNT: Loaded 43959 primary data records. [2025-10-15T22:43:27.769140] [DEBUG] [LOCAL ] VNO: Loaded 48956 existing records from primary storage. [2025-10-15T22:43:27.791703] [INFO ] [MAIN ] VNO: Loaded 48956 primary data records. [2025-10-15T22:43:28.400114] [DEBUG] [MAIN ] VNCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:28.401200] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 9018 primary records. [2025-10-15T22:43:28.401848] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-15T22:43:28.418945] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-15T22:43:28.419081] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-15T22:43:28.421336] [INFO ] [MAIN ] Derivative Progress: 1681/1803 symbols completed. VNCE took 1.0s. Estimated remaining: 45.8s. Rate: 159.8 symbols/min [2025-10-15T22:43:28.421734] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:28.442155] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:28.443147] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43959 primary records. [2025-10-15T22:43:28.443418] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-15T22:43:28.448212] [DEBUG] [LOCAL ] VOC: Loaded 9008 existing records from primary storage. [2025-10-15T22:43:28.448459] [INFO ] [MAIN ] VOC: Loaded 9008 primary data records. [2025-10-15T22:43:28.540296] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-15T22:43:28.550855] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-15T22:43:28.583875] [INFO ] [MAIN ] Derivative Progress: 1682/1803 symbols completed. VNT took 1.2s. Estimated remaining: 45.4s. Rate: 159.8 symbols/min [2025-10-15T22:43:28.584120] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:28.584827] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:28.585570] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48956 primary records. [2025-10-15T22:43:28.585991] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-15T22:43:28.794730] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-15T22:43:28.795581] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-15T22:43:28.798519] [INFO ] [MAIN ] Derivative Progress: 1683/1803 symbols completed. VNO took 1.4s. Estimated remaining: 45.0s. Rate: 159.9 symbols/min [2025-10-15T22:43:28.798855] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:28.836261] [DEBUG] [LOCAL ] VOYA: Loaded 42237 existing records from primary storage. [2025-10-15T22:43:28.841872] [INFO ] [MAIN ] VOYA: Loaded 42237 primary data records. [2025-10-15T22:43:28.842700] [DEBUG] [LOCAL ] VPG: Loaded 17178 existing records from primary storage. [2025-10-15T22:43:28.876075] [INFO ] [MAIN ] VPG: Loaded 17178 primary data records. [2025-10-15T22:43:28.899034] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:28.911816] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 9008 primary records. [2025-10-15T22:43:28.952732] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-15T22:43:29.181369] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-15T22:43:29.203096] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-15T22:43:29.223792] [INFO ] [MAIN ] Derivative Progress: 1684/1803 symbols completed. VOC took 0.8s. Estimated remaining: 44.7s. Rate: 159.9 symbols/min [2025-10-15T22:43:29.349106] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:29.485567] [DEBUG] [LOCAL ] VPV: Loaded 5450 existing records from primary storage. [2025-10-15T22:43:29.486257] [INFO ] [MAIN ] VPV: Loaded 5450 primary data records. [2025-10-15T22:43:29.813577] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:29.814717] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17178 primary records. [2025-10-15T22:43:29.814994] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-15T22:43:29.815633] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:29.817406] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42237 primary records. [2025-10-15T22:43:29.824577] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-15T22:43:29.847034] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-15T22:43:29.849216] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-15T22:43:29.849325] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-15T22:43:29.849398] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-15T22:43:29.851617] [INFO ] [MAIN ] Derivative Progress: 1685/1803 symbols completed. VPG took 1.1s. Estimated remaining: 44.3s. Rate: 159.8 symbols/min [2025-10-15T22:43:29.854197] [INFO ] [MAIN ] Derivative Progress: 1686/1803 symbols completed. VOYA took 1.3s. Estimated remaining: 43.9s. Rate: 159.9 symbols/min [2025-10-15T22:43:29.854114] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:29.854857] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:29.873462] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:29.874162] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5450 primary records. [2025-10-15T22:43:29.874342] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-15T22:43:29.898581] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-15T22:43:29.898807] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-15T22:43:29.901498] [INFO ] [MAIN ] Derivative Progress: 1687/1803 symbols completed. VPV took 0.6s. Estimated remaining: 43.5s. Rate: 160.0 symbols/min [2025-10-15T22:43:29.901762] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:29.930570] [DEBUG] [LOCAL ] VRE: Loaded 35289 existing records from primary storage. [2025-10-15T22:43:29.930822] [INFO ] [MAIN ] VRE: Loaded 35289 primary data records. [2025-10-15T22:43:29.978473] [DEBUG] [LOCAL ] VRTS: Loaded 9390 existing records from primary storage. [2025-10-15T22:43:30.004324] [INFO ] [MAIN ] VRTS: Loaded 9390 primary data records. [2025-10-15T22:43:30.120736] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-15T22:43:30.137469] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-15T22:43:30.900263] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:30.900042] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:30.901296] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9390 primary records. [2025-10-15T22:43:30.901914] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35289 primary records. [2025-10-15T22:43:30.901990] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-15T22:43:30.902360] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-15T22:43:30.932981] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-15T22:43:30.933853] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-15T22:43:30.935992] [INFO ] [MAIN ] Derivative Progress: 1688/1803 symbols completed. VRE took 1.1s. Estimated remaining: 43.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:30.943778] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:30.950995] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-15T22:43:30.950932] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:30.951110] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-15T22:43:30.951784] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-15T22:43:30.954200] [INFO ] [MAIN ] Derivative Progress: 1689/1803 symbols completed. VRTS took 1.1s. Estimated remaining: 42.8s. Rate: 159.9 symbols/min [2025-10-15T22:43:30.952016] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-15T22:43:30.955322] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:30.971593] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-15T22:43:30.971794] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-15T22:43:30.974857] [INFO ] [MAIN ] Derivative Progress: 1690/1803 symbols completed. VRT took 1.1s. Estimated remaining: 42.4s. Rate: 160.0 symbols/min [2025-10-15T22:43:30.975150] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:31.028348] [DEBUG] [LOCAL ] VSCO: Loaded 52738 existing records from primary storage. [2025-10-15T22:43:31.029075] [INFO ] [MAIN ] VSCO: Loaded 52738 primary data records. [2025-10-15T22:43:31.142238] [DEBUG] [LOCAL ] VSH: Loaded 48215 existing records from primary storage. [2025-10-15T22:43:31.162682] [INFO ] [MAIN ] VSH: Loaded 48215 primary data records. [2025-10-15T22:43:31.459413] [DEBUG] [LOCAL ] VST: Loaded 53711 existing records from primary storage. [2025-10-15T22:43:31.467559] [INFO ] [MAIN ] VST: Loaded 53711 primary data records. [2025-10-15T22:43:32.020313] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:32.021770] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52738 primary records. [2025-10-15T22:43:32.022129] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-15T22:43:32.054220] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:32.056564] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48215 primary records. [2025-10-15T22:43:32.057221] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-15T22:43:32.069191] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-15T22:43:32.072341] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-15T22:43:32.078169] [INFO ] [MAIN ] Derivative Progress: 1691/1803 symbols completed. VSCO took 1.1s. Estimated remaining: 42.1s. Rate: 159.8 symbols/min [2025-10-15T22:43:32.081543] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:32.084282] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-15T22:43:32.084553] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-15T22:43:32.087823] [INFO ] [MAIN ] Derivative Progress: 1692/1803 symbols completed. VSH took 1.1s. Estimated remaining: 41.7s. Rate: 159.9 symbols/min [2025-10-15T22:43:32.088287] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:32.102827] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:32.103990] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53711 primary records. [2025-10-15T22:43:32.104060] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-15T22:43:32.121482] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-15T22:43:32.121595] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-15T22:43:32.125043] [INFO ] [MAIN ] Derivative Progress: 1693/1803 symbols completed. VST took 1.1s. Estimated remaining: 41.3s. Rate: 160.0 symbols/min [2025-10-15T22:43:32.169296] [DEBUG] [LOCAL ] VSTS: Loaded 48944 existing records from primary storage. [2025-10-15T22:43:32.169449] [INFO ] [MAIN ] VSTS: Loaded 48944 primary data records. [2025-10-15T22:43:32.289204] [DEBUG] [LOCAL ] VTEX: Loaded 42958 existing records from primary storage. [2025-10-15T22:43:32.304942] [INFO ] [MAIN ] VTEX: Loaded 42958 primary data records. [2025-10-15T22:43:32.861264] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:32.862141] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 48944 primary records. [2025-10-15T22:43:32.862530] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-15T22:43:32.879376] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-15T22:43:32.879469] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-15T22:43:32.881467] [INFO ] [MAIN ] Derivative Progress: 1694/1803 symbols completed. VSTS took 0.8s. Estimated remaining: 40.9s. Rate: 159.9 symbols/min [2025-10-15T22:43:32.897389] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:32.898188] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 42958 primary records. [2025-10-15T22:43:32.898282] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-15T22:43:32.913936] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-15T22:43:32.913997] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-15T22:43:32.917462] [INFO ] [MAIN ] Derivative Progress: 1695/1803 symbols completed. VTEX took 0.8s. Estimated remaining: 40.5s. Rate: 160.0 symbols/min [2025-10-15T22:43:32.918291] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:32.918422] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:32.918158] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:32.930040] [DEBUG] [LOCAL ] VTN: Loaded 7008 existing records from primary storage. [2025-10-15T22:43:32.930248] [INFO ] [MAIN ] VTN: Loaded 7008 primary data records. [2025-10-15T22:43:33.010492] [DEBUG] [LOCAL ] VTMX: Loaded 17592 existing records from primary storage. [2025-10-15T22:43:33.015983] [INFO ] [MAIN ] VTMX: Loaded 17592 primary data records. [2025-10-15T22:43:33.289744] [DEBUG] [LOCAL ] VTLE: Loaded 48028 existing records from primary storage. [2025-10-15T22:43:33.323287] [INFO ] [MAIN ] VTLE: Loaded 48028 primary data records. [2025-10-15T22:43:34.007946] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:34.008895] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7008 primary records. [2025-10-15T22:43:34.019559] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-15T22:43:34.025321] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:34.026198] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17592 primary records. [2025-10-15T22:43:34.026346] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-15T22:43:34.048907] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-15T22:43:34.049921] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-15T22:43:34.056222] [INFO ] [MAIN ] Derivative Progress: 1696/1803 symbols completed. VTN took 1.1s. Estimated remaining: 40.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:34.057337] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:34.059718] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-15T22:43:34.059896] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-15T22:43:34.062419] [INFO ] [MAIN ] Derivative Progress: 1697/1803 symbols completed. VTMX took 1.1s. Estimated remaining: 39.8s. Rate: 159.9 symbols/min [2025-10-15T22:43:34.063560] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:34.078711] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:34.079496] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48028 primary records. [2025-10-15T22:43:34.079671] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-15T22:43:34.105485] [DEBUG] [LOCAL ] VTOL: Loaded 19622 existing records from primary storage. [2025-10-15T22:43:34.107029] [INFO ] [MAIN ] VTOL: Loaded 19622 primary data records. [2025-10-15T22:43:34.179986] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-15T22:43:34.204291] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-15T22:43:34.218696] [INFO ] [MAIN ] Derivative Progress: 1698/1803 symbols completed. VTLE took 1.3s. Estimated remaining: 39.4s. Rate: 159.9 symbols/min [2025-10-15T22:43:34.258338] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:34.468790] [DEBUG] [LOCAL ] VTR: Loaded 52778 existing records from primary storage. [2025-10-15T22:43:34.469548] [INFO ] [MAIN ] VTR: Loaded 52778 primary data records. [2025-10-15T22:43:34.782586] [DEBUG] [LOCAL ] VTS: Loaded 29996 existing records from primary storage. [2025-10-15T22:43:34.783053] [INFO ] [MAIN ] VTS: Loaded 29996 primary data records. [2025-10-15T22:43:35.090174] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:35.091474] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19622 primary records. [2025-10-15T22:43:35.091709] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-15T22:43:35.114025] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-15T22:43:35.116066] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-15T22:43:35.118198] [INFO ] [MAIN ] Derivative Progress: 1699/1803 symbols completed. VTOL took 1.1s. Estimated remaining: 39.1s. Rate: 159.8 symbols/min [2025-10-15T22:43:35.119037] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:35.133295] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:35.134887] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52778 primary records. [2025-10-15T22:43:35.135256] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-15T22:43:35.152579] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-15T22:43:35.153140] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-15T22:43:35.155546] [INFO ] [MAIN ] Derivative Progress: 1700/1803 symbols completed. VTR took 1.1s. Estimated remaining: 38.7s. Rate: 159.9 symbols/min [2025-10-15T22:43:35.156174] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:35.182857] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:35.183739] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 29996 primary records. [2025-10-15T22:43:35.183821] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-15T22:43:35.209340] [DEBUG] [LOCAL ] VVR: Loaded 31167 existing records from primary storage. [2025-10-15T22:43:35.209869] [INFO ] [MAIN ] VVR: Loaded 31167 primary data records. [2025-10-15T22:43:35.329585] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-15T22:43:35.334089] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-15T22:43:35.338682] [INFO ] [MAIN ] Derivative Progress: 1701/1803 symbols completed. VTS took 1.1s. Estimated remaining: 38.3s. Rate: 159.9 symbols/min [2025-10-15T22:43:35.357588] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:35.437166] [DEBUG] [LOCAL ] VVV: Loaded 50336 existing records from primary storage. [2025-10-15T22:43:35.542363] [INFO ] [MAIN ] VVV: Loaded 50336 primary data records. [2025-10-15T22:43:35.677539] [DEBUG] [LOCAL ] VVX: Loaded 22934 existing records from primary storage. [2025-10-15T22:43:35.678131] [INFO ] [MAIN ] VVX: Loaded 22934 primary data records. [2025-10-15T22:43:36.225081] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:36.227412] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31167 primary records. [2025-10-15T22:43:36.227665] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-15T22:43:36.246601] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-15T22:43:36.246907] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-15T22:43:36.249841] [INFO ] [MAIN ] Derivative Progress: 1702/1803 symbols completed. VVR took 1.1s. Estimated remaining: 37.9s. Rate: 159.8 symbols/min [2025-10-15T22:43:36.250403] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:36.269171] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:36.270027] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50336 primary records. [2025-10-15T22:43:36.270130] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-15T22:43:36.288957] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-15T22:43:36.289278] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-15T22:43:36.291954] [INFO ] [MAIN ] Derivative Progress: 1703/1803 symbols completed. VVV took 1.1s. Estimated remaining: 37.5s. Rate: 159.9 symbols/min [2025-10-15T22:43:36.305482] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:36.306189] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:36.307313] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 22934 primary records. [2025-10-15T22:43:36.307484] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-15T22:43:36.333785] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-15T22:43:36.334003] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-15T22:43:36.336779] [INFO ] [MAIN ] Derivative Progress: 1704/1803 symbols completed. VVX took 1.0s. Estimated remaining: 37.1s. Rate: 160.0 symbols/min [2025-10-15T22:43:36.337101] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:36.360738] [DEBUG] [LOCAL ] VYX: Loaded 48499 existing records from primary storage. [2025-10-15T22:43:36.360919] [INFO ] [MAIN ] VYX: Loaded 48499 primary data records. [2025-10-15T22:43:36.547796] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-15T22:43:36.586805] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-15T22:43:36.745950] [DEBUG] [LOCAL ] W: Loaded 53435 existing records from primary storage. [2025-10-15T22:43:36.775171] [INFO ] [MAIN ] W: Loaded 53435 primary data records. [2025-10-15T22:43:37.350443] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:37.351606] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48499 primary records. [2025-10-15T22:43:37.351960] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-15T22:43:37.372623] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-15T22:43:37.374699] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-15T22:43:37.391922] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:37.390283] [INFO ] [MAIN ] Derivative Progress: 1705/1803 symbols completed. VYX took 1.1s. Estimated remaining: 36.8s. Rate: 159.8 symbols/min [2025-10-15T22:43:37.392858] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53435 primary records. [2025-10-15T22:43:37.393098] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-15T22:43:37.393259] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:37.407975] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:37.423372] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-15T22:43:37.424152] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-15T22:43:37.425909] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-15T22:43:37.426422] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-15T22:43:37.429961] [INFO ] [MAIN ] Derivative Progress: 1706/1803 symbols completed. W took 1.1s. Estimated remaining: 36.4s. Rate: 159.9 symbols/min [2025-10-15T22:43:37.430744] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:37.453101] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-15T22:43:37.453687] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-15T22:43:37.455793] [INFO ] [MAIN ] Derivative Progress: 1707/1803 symbols completed. VZ took 1.2s. Estimated remaining: 36.0s. Rate: 160.0 symbols/min [2025-10-15T22:43:37.456204] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:37.508533] [DEBUG] [LOCAL ] WAB: Loaded 43966 existing records from primary storage. [2025-10-15T22:43:37.508804] [INFO ] [MAIN ] WAB: Loaded 43966 primary data records. [2025-10-15T22:43:37.637797] [DEBUG] [LOCAL ] WAL: Loaded 45512 existing records from primary storage. [2025-10-15T22:43:37.648891] [DEBUG] [LOCAL ] WAT: Loaded 35821 existing records from primary storage. [2025-10-15T22:43:37.664477] [INFO ] [MAIN ] WAL: Loaded 45512 primary data records. [2025-10-15T22:43:37.654193] [INFO ] [MAIN ] WAT: Loaded 35821 primary data records. [2025-10-15T22:43:38.506459] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:38.512858] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:38.513770] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 43966 primary records. [2025-10-15T22:43:38.514394] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45512 primary records. [2025-10-15T22:43:38.514517] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-15T22:43:38.514605] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-15T22:43:38.552042] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-15T22:43:38.553009] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-15T22:43:38.555343] [INFO ] [MAIN ] Derivative Progress: 1708/1803 symbols completed. WAB took 1.2s. Estimated remaining: 35.7s. Rate: 159.8 symbols/min [2025-10-15T22:43:38.569191] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-15T22:43:38.569573] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-15T22:43:38.569517] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:38.570577] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35821 primary records. [2025-10-15T22:43:38.573365] [INFO ] [MAIN ] Derivative Progress: 1709/1803 symbols completed. WAL took 1.1s. Estimated remaining: 35.3s. Rate: 159.9 symbols/min [2025-10-15T22:43:38.573511] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-15T22:43:38.588958] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-15T22:43:38.589045] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-15T22:43:38.591678] [INFO ] [MAIN ] Derivative Progress: 1710/1803 symbols completed. WAT took 1.1s. Estimated remaining: 34.9s. Rate: 160.0 symbols/min [2025-10-15T22:43:38.592294] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:38.592152] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:38.592208] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:38.608760] [DEBUG] [LOCAL ] WBX: Loaded 10429 existing records from primary storage. [2025-10-15T22:43:38.609003] [INFO ] [MAIN ] WBX: Loaded 10429 primary data records. [2025-10-15T22:43:38.957486] [DEBUG] [LOCAL ] WCC: Loaded 39073 existing records from primary storage. [2025-10-15T22:43:38.959091] [INFO ] [MAIN ] WCC: Loaded 39073 primary data records. [2025-10-15T22:43:38.994211] [DEBUG] [LOCAL ] WBS: Loaded 48740 existing records from primary storage. [2025-10-15T22:43:39.018569] [INFO ] [MAIN ] WBS: Loaded 48740 primary data records. [2025-10-15T22:43:39.602486] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:39.604194] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 10429 primary records. [2025-10-15T22:43:39.604433] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-15T22:43:39.622626] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-15T22:43:39.622822] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-15T22:43:39.625421] [INFO ] [MAIN ] Derivative Progress: 1711/1803 symbols completed. WBX took 1.0s. Estimated remaining: 34.5s. Rate: 159.8 symbols/min [2025-10-15T22:43:39.626549] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:39.641896] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:39.642609] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39073 primary records. [2025-10-15T22:43:39.642992] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-15T22:43:39.659179] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-15T22:43:39.660074] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-15T22:43:39.662942] [INFO ] [MAIN ] Derivative Progress: 1712/1803 symbols completed. WCC took 1.1s. Estimated remaining: 34.2s. Rate: 159.9 symbols/min [2025-10-15T22:43:39.663096] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:39.678446] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:39.679314] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48740 primary records. [2025-10-15T22:43:39.679379] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-15T22:43:39.696009] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-15T22:43:39.696316] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-15T22:43:39.699062] [INFO ] [MAIN ] Derivative Progress: 1713/1803 symbols completed. WBS took 1.1s. Estimated remaining: 33.8s. Rate: 160.0 symbols/min [2025-10-15T22:43:39.709758] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:39.727028] [DEBUG] [LOCAL ] WD: Loaded 23147 existing records from primary storage. [2025-10-15T22:43:39.728075] [INFO ] [MAIN ] WD: Loaded 23147 primary data records. [2025-10-15T22:43:39.785288] [DEBUG] [LOCAL ] WCN: Loaded 48049 existing records from primary storage. [2025-10-15T22:43:39.833480] [INFO ] [MAIN ] WCN: Loaded 48049 primary data records. [2025-10-15T22:43:39.866533] [DEBUG] [LOCAL ] WDH: Loaded 18120 existing records from primary storage. [2025-10-15T22:43:39.891553] [INFO ] [MAIN ] WDH: Loaded 18120 primary data records. [2025-10-15T22:43:40.708123] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:40.709216] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23147 primary records. [2025-10-15T22:43:40.709407] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-15T22:43:40.728004] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-15T22:43:40.728296] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-15T22:43:40.731153] [INFO ] [MAIN ] Derivative Progress: 1714/1803 symbols completed. WD took 1.1s. Estimated remaining: 33.4s. Rate: 159.8 symbols/min [2025-10-15T22:43:40.745533] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:40.746174] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:40.747331] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48049 primary records. [2025-10-15T22:43:40.747473] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-15T22:43:40.773333] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:40.775303] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 18120 primary records. [2025-10-15T22:43:40.775869] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-15T22:43:40.779345] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-15T22:43:40.792665] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-15T22:43:40.798151] [INFO ] [MAIN ] Derivative Progress: 1715/1803 symbols completed. WCN took 1.2s. Estimated remaining: 33.0s. Rate: 159.9 symbols/min [2025-10-15T22:43:40.802835] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-15T22:43:40.801824] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:40.803073] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-15T22:43:40.805775] [INFO ] [MAIN ] Derivative Progress: 1716/1803 symbols completed. WDH took 1.1s. Estimated remaining: 32.6s. Rate: 160.0 symbols/min [2025-10-15T22:43:40.806305] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:40.814149] [DEBUG] [LOCAL ] WDI: Loaded 21237 existing records from primary storage. [2025-10-15T22:43:40.814413] [INFO ] [MAIN ] WDI: Loaded 21237 primary data records. [2025-10-15T22:43:40.883437] [DEBUG] [LOCAL ] WEA: Loaded 7761 existing records from primary storage. [2025-10-15T22:43:40.900488] [INFO ] [MAIN ] WEA: Loaded 7761 primary data records. [2025-10-15T22:43:41.280634] [DEBUG] [LOCAL ] WDS: Loaded 43167 existing records from primary storage. [2025-10-15T22:43:41.295883] [INFO ] [MAIN ] WDS: Loaded 43167 primary data records. [2025-10-15T22:43:41.789804] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:41.791908] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21237 primary records. [2025-10-15T22:43:41.792315] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-15T22:43:41.820345] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:41.822456] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7761 primary records. [2025-10-15T22:43:41.822808] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-15T22:43:41.842897] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-15T22:43:41.843346] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-15T22:43:41.841877] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-15T22:43:41.846537] [INFO ] [MAIN ] Derivative Progress: 1717/1803 symbols completed. WEA took 1.0s. Estimated remaining: 32.3s. Rate: 159.8 symbols/min [2025-10-15T22:43:41.846600] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-15T22:43:41.850182] [INFO ] [MAIN ] Derivative Progress: 1718/1803 symbols completed. WDI took 1.1s. Estimated remaining: 31.9s. Rate: 159.9 symbols/min [2025-10-15T22:43:41.847899] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:41.850451] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:41.867032] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:41.867903] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43167 primary records. [2025-10-15T22:43:41.868060] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-15T22:43:41.887129] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-15T22:43:41.887459] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-15T22:43:41.890885] [INFO ] [MAIN ] Derivative Progress: 1719/1803 symbols completed. WDS took 1.1s. Estimated remaining: 31.5s. Rate: 160.0 symbols/min [2025-10-15T22:43:41.891395] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:41.964788] [DEBUG] [LOCAL ] WEC: Loaded 52174 existing records from primary storage. [2025-10-15T22:43:41.986538] [INFO ] [MAIN ] WEC: Loaded 52174 primary data records. [2025-10-15T22:43:41.986363] [DEBUG] [LOCAL ] WEAV: Loaded 42273 existing records from primary storage. [2025-10-15T22:43:42.007906] [INFO ] [MAIN ] WEAV: Loaded 42273 primary data records. [2025-10-15T22:43:42.208977] [DEBUG] [LOCAL ] WELL: Loaded 52330 existing records from primary storage. [2025-10-15T22:43:42.238042] [INFO ] [MAIN ] WELL: Loaded 52330 primary data records. [2025-10-15T22:43:42.980187] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:42.993949] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:42.996453] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42273 primary records. [2025-10-15T22:43:42.996552] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-15T22:43:42.995722] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52174 primary records. [2025-10-15T22:43:42.997335] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-15T22:43:43.030973] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:43.037536] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-15T22:43:43.042067] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-15T22:43:43.042162] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-15T22:43:43.043229] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-15T22:43:43.043085] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52330 primary records. [2025-10-15T22:43:43.045745] [INFO ] [MAIN ] Derivative Progress: 1720/1803 symbols completed. WEAV took 1.2s. Estimated remaining: 31.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:43.047886] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:43.048012] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-15T22:43:43.048210] [INFO ] [MAIN ] Derivative Progress: 1721/1803 symbols completed. WEC took 1.2s. Estimated remaining: 30.8s. Rate: 159.9 symbols/min [2025-10-15T22:43:43.049411] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:43.066439] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-15T22:43:43.066507] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-15T22:43:43.069264] [INFO ] [MAIN ] Derivative Progress: 1722/1803 symbols completed. WELL took 1.2s. Estimated remaining: 30.4s. Rate: 160.0 symbols/min [2025-10-15T22:43:43.069458] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:43.091251] [DEBUG] [LOCAL ] WF: Loaded 10985 existing records from primary storage. [2025-10-15T22:43:43.091449] [INFO ] [MAIN ] WF: Loaded 10985 primary data records. [2025-10-15T22:43:43.202830] [DEBUG] [LOCAL ] WEX: Loaded 32945 existing records from primary storage. [2025-10-15T22:43:43.219103] [INFO ] [MAIN ] WEX: Loaded 32945 primary data records. [2025-10-15T22:43:43.259532] [DEBUG] [LOCAL ] WES: Loaded 48498 existing records from primary storage. [2025-10-15T22:43:43.274103] [INFO ] [MAIN ] WES: Loaded 48498 primary data records. [2025-10-15T22:43:44.117023] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:44.118081] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10985 primary records. [2025-10-15T22:43:44.118294] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-15T22:43:44.136329] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-15T22:43:44.137518] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-15T22:43:44.140066] [INFO ] [MAIN ] Derivative Progress: 1723/1803 symbols completed. WF took 1.1s. Estimated remaining: 30.0s. Rate: 159.8 symbols/min [2025-10-15T22:43:44.154278] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:44.155271] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48498 primary records. [2025-10-15T22:43:44.157285] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-15T22:43:44.181355] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:44.186615] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 32945 primary records. [2025-10-15T22:43:44.187161] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-15T22:43:44.206802] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-15T22:43:44.206281] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-15T22:43:44.207148] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-15T22:43:44.207066] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-15T22:43:44.210913] [INFO ] [MAIN ] Derivative Progress: 1724/1803 symbols completed. WEX took 1.2s. Estimated remaining: 29.7s. Rate: 159.9 symbols/min [2025-10-15T22:43:44.214032] [INFO ] [MAIN ] Derivative Progress: 1725/1803 symbols completed. WES took 1.2s. Estimated remaining: 29.3s. Rate: 160.0 symbols/min [2025-10-15T22:43:44.214574] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:44.214724] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:44.215076] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:44.243088] [DEBUG] [LOCAL ] WFG: Loaded 24781 existing records from primary storage. [2025-10-15T22:43:44.243341] [INFO ] [MAIN ] WFG: Loaded 24781 primary data records. [2025-10-15T22:43:44.392513] [DEBUG] [LOCAL ] WGO: Loaded 38130 existing records from primary storage. [2025-10-15T22:43:44.398370] [INFO ] [MAIN ] WGO: Loaded 38130 primary data records. [2025-10-15T22:43:44.727913] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-15T22:43:44.744431] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-15T22:43:45.262010] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:45.263718] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24781 primary records. [2025-10-15T22:43:45.264063] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-15T22:43:45.283799] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-15T22:43:45.284811] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-15T22:43:45.287309] [INFO ] [MAIN ] Derivative Progress: 1726/1803 symbols completed. WFG took 1.1s. Estimated remaining: 28.9s. Rate: 159.8 symbols/min [2025-10-15T22:43:45.287476] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:45.302889] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:45.303988] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38130 primary records. [2025-10-15T22:43:45.304160] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-15T22:43:45.325245] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-15T22:43:45.325509] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-15T22:43:45.328021] [INFO ] [MAIN ] Derivative Progress: 1727/1803 symbols completed. WGO took 1.1s. Estimated remaining: 28.5s. Rate: 159.9 symbols/min [2025-10-15T22:43:45.341586] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:45.341738] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:45.342907] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-15T22:43:45.343458] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-15T22:43:45.369738] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-15T22:43:45.369883] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-15T22:43:45.372786] [INFO ] [MAIN ] Derivative Progress: 1728/1803 symbols completed. WFC took 1.2s. Estimated remaining: 28.1s. Rate: 159.9 symbols/min [2025-10-15T22:43:45.373151] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:45.392380] [DEBUG] [LOCAL ] WH: Loaded 45259 existing records from primary storage. [2025-10-15T22:43:45.391606] [DEBUG] [LOCAL ] WHG: Loaded 3153 existing records from primary storage. [2025-10-15T22:43:45.392517] [INFO ] [MAIN ] WHG: Loaded 3153 primary data records. [2025-10-15T22:43:45.392603] [INFO ] [MAIN ] WH: Loaded 45259 primary data records. [2025-10-15T22:43:45.631098] [DEBUG] [LOCAL ] WHD: Loaded 40131 existing records from primary storage. [2025-10-15T22:43:45.651910] [INFO ] [MAIN ] WHD: Loaded 40131 primary data records. [2025-10-15T22:43:46.380320] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:46.381412] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45259 primary records. [2025-10-15T22:43:46.393834] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-15T22:43:46.394191] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:43:46.395532] [INFO ] [MAIN ] WHG: Generated 1793 derivative records from 3153 primary records. [2025-10-15T22:43:46.396095] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-15T22:43:46.412737] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-15T22:43:46.418755] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-15T22:43:46.421035] [INFO ] [MAIN ] Derivative Progress: 1729/1803 symbols completed. WH took 1.1s. Estimated remaining: 27.8s. Rate: 159.8 symbols/min [2025-10-15T22:43:46.427194] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:46.429601] [DEBUG] [LOCAL ] WHG: Derivative data saved (1793 records). [2025-10-15T22:43:46.430129] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-15T22:43:46.437075] [INFO ] [MAIN ] Derivative Progress: 1730/1803 symbols completed. WHG took 1.1s. Estimated remaining: 27.4s. Rate: 159.9 symbols/min [2025-10-15T22:43:46.438328] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:46.453241] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:46.454082] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40131 primary records. [2025-10-15T22:43:46.454266] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-15T22:43:46.472557] [DEBUG] [LOCAL ] WIA: Loaded 5007 existing records from primary storage. [2025-10-15T22:43:46.473053] [INFO ] [MAIN ] WIA: Loaded 5007 primary data records. [2025-10-15T22:43:46.533568] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-15T22:43:46.547529] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-15T22:43:46.557021] [INFO ] [MAIN ] Derivative Progress: 1731/1803 symbols completed. WHD took 1.2s. Estimated remaining: 27.0s. Rate: 159.9 symbols/min [2025-10-15T22:43:46.567527] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:46.794991] [DEBUG] [LOCAL ] WHR: Loaded 48799 existing records from primary storage. [2025-10-15T22:43:46.803755] [INFO ] [MAIN ] WHR: Loaded 48799 primary data records. [2025-10-15T22:43:46.841286] [DEBUG] [LOCAL ] WINN: Loaded 11533 existing records from primary storage. [2025-10-15T22:43:46.865673] [INFO ] [MAIN ] WINN: Loaded 11533 primary data records. [2025-10-15T22:43:47.436252] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:47.437609] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 5007 primary records. [2025-10-15T22:43:47.437724] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-15T22:43:47.459609] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-15T22:43:47.459860] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-15T22:43:47.462967] [INFO ] [MAIN ] Derivative Progress: 1732/1803 symbols completed. WIA took 1.0s. Estimated remaining: 26.7s. Rate: 159.8 symbols/min [2025-10-15T22:43:47.463471] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:47.487135] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-15T22:43:47.500716] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11533 primary records. [2025-10-15T22:43:47.500920] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-15T22:43:47.501168] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:47.503302] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48799 primary records. [2025-10-15T22:43:47.511764] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-15T22:43:47.547692] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-15T22:43:47.547924] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-15T22:43:47.551936] [INFO ] [MAIN ] Derivative Progress: 1733/1803 symbols completed. WINN took 1.0s. Estimated remaining: 26.3s. Rate: 159.9 symbols/min [2025-10-15T22:43:47.552131] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:47.548905] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-15T22:43:47.552366] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-15T22:43:47.555478] [INFO ] [MAIN ] Derivative Progress: 1734/1803 symbols completed. WHR took 1.1s. Estimated remaining: 25.9s. Rate: 160.0 symbols/min [2025-10-15T22:43:47.555972] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:47.575880] [DEBUG] [LOCAL ] WIT: Loaded 52494 existing records from primary storage. [2025-10-15T22:43:47.576156] [INFO ] [MAIN ] WIT: Loaded 52494 primary data records. [2025-10-15T22:43:47.675075] [DEBUG] [LOCAL ] WIW: Loaded 20323 existing records from primary storage. [2025-10-15T22:43:47.684182] [INFO ] [MAIN ] WIW: Loaded 20323 primary data records. [2025-10-15T22:43:47.886617] [DEBUG] [LOCAL ] WK: Loaded 37276 existing records from primary storage. [2025-10-15T22:43:48.029380] [INFO ] [MAIN ] WK: Loaded 37276 primary data records. [2025-10-15T22:43:48.593510] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:48.594889] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52494 primary records. [2025-10-15T22:43:48.595069] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-15T22:43:48.618281] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:48.623417] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20323 primary records. [2025-10-15T22:43:48.624974] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-15T22:43:48.629007] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-15T22:43:48.638030] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-15T22:43:48.640473] [INFO ] [MAIN ] Derivative Progress: 1735/1803 symbols completed. WIT took 1.2s. Estimated remaining: 25.5s. Rate: 159.8 symbols/min [2025-10-15T22:43:48.645248] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:48.651046] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-15T22:43:48.651385] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-15T22:43:48.655149] [INFO ] [MAIN ] Derivative Progress: 1736/1803 symbols completed. WIW took 1.1s. Estimated remaining: 25.1s. Rate: 159.9 symbols/min [2025-10-15T22:43:48.655448] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:48.670166] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:48.671071] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37276 primary records. [2025-10-15T22:43:48.671177] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-15T22:43:48.697204] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-15T22:43:48.697600] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-15T22:43:48.700287] [INFO ] [MAIN ] Derivative Progress: 1737/1803 symbols completed. WK took 1.1s. Estimated remaining: 24.8s. Rate: 160.0 symbols/min [2025-10-15T22:43:48.700742] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:48.717218] [DEBUG] [LOCAL ] WLKP: Loaded 6989 existing records from primary storage. [2025-10-15T22:43:48.717971] [INFO ] [MAIN ] WLKP: Loaded 6989 primary data records. [2025-10-15T22:43:48.770775] [DEBUG] [LOCAL ] WKC: Loaded 34587 existing records from primary storage. [2025-10-15T22:43:48.794835] [INFO ] [MAIN ] WKC: Loaded 34587 primary data records. [2025-10-15T22:43:48.976269] [DEBUG] [LOCAL ] WLK: Loaded 45746 existing records from primary storage. [2025-10-15T22:43:48.987227] [INFO ] [MAIN ] WLK: Loaded 45746 primary data records. [2025-10-15T22:43:49.697997] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:49.702198] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6989 primary records. [2025-10-15T22:43:49.702608] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-15T22:43:49.728176] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:49.732736] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-15T22:43:49.733708] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-15T22:43:49.737709] [INFO ] [MAIN ] Derivative Progress: 1738/1803 symbols completed. WLKP took 1.0s. Estimated remaining: 24.4s. Rate: 159.8 symbols/min [2025-10-15T22:43:49.734030] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34587 primary records. [2025-10-15T22:43:49.738676] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-15T22:43:49.768604] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:49.770493] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45746 primary records. [2025-10-15T22:43:49.771171] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-15T22:43:49.774575] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-15T22:43:49.788030] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-15T22:43:49.794336] [INFO ] [MAIN ] Derivative Progress: 1739/1803 symbols completed. WKC took 1.1s. Estimated remaining: 24.0s. Rate: 159.9 symbols/min [2025-10-15T22:43:49.796014] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-15T22:43:49.796177] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-15T22:43:49.798824] [INFO ] [MAIN ] Derivative Progress: 1740/1803 symbols completed. WLK took 1.1s. Estimated remaining: 23.6s. Rate: 160.0 symbols/min [2025-10-15T22:43:49.799243] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:49.799296] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:49.799504] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:49.843581] [DEBUG] [LOCAL ] WLY: Loaded 29866 existing records from primary storage. [2025-10-15T22:43:49.843877] [INFO ] [MAIN ] WLY: Loaded 29866 primary data records. [2025-10-15T22:43:49.990112] [DEBUG] [LOCAL ] WM: Loaded 51011 existing records from primary storage. [2025-10-15T22:43:50.033767] [INFO ] [MAIN ] WM: Loaded 51011 primary data records. [2025-10-15T22:43:50.109259] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-15T22:43:50.128551] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-15T22:43:50.824874] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:50.825682] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29866 primary records. [2025-10-15T22:43:50.825932] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-15T22:43:50.844563] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-15T22:43:50.845134] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-15T22:43:50.860506] [INFO ] [MAIN ] Derivative Progress: 1741/1803 symbols completed. WLY took 1.1s. Estimated remaining: 23.3s. Rate: 159.8 symbols/min [2025-10-15T22:43:50.858518] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:50.861319] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 51011 primary records. [2025-10-15T22:43:50.861447] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:50.861519] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-15T22:43:50.892070] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:50.891884] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-15T22:43:50.892847] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-15T22:43:50.893001] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-15T22:43:50.893059] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-15T22:43:50.912168] [INFO ] [MAIN ] Derivative Progress: 1742/1803 symbols completed. WM took 1.1s. Estimated remaining: 22.9s. Rate: 159.9 symbols/min [2025-10-15T22:43:50.916604] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:50.921596] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-15T22:43:50.927388] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-15T22:43:50.927786] [DEBUG] [LOCAL ] WMK: Loaded 14729 existing records from primary storage. [2025-10-15T22:43:50.930609] [INFO ] [MAIN ] Derivative Progress: 1743/1803 symbols completed. WMB took 1.1s. Estimated remaining: 22.5s. Rate: 160.0 symbols/min [2025-10-15T22:43:50.930705] [INFO ] [MAIN ] WMK: Loaded 14729 primary data records. [2025-10-15T22:43:50.930857] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:51.263839] [DEBUG] [LOCAL ] WMS: Loaded 39738 existing records from primary storage. [2025-10-15T22:43:51.264311] [INFO ] [MAIN ] WMS: Loaded 39738 primary data records. [2025-10-15T22:43:51.378921] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-15T22:43:51.385750] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-15T22:43:51.948575] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:51.950387] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14729 primary records. [2025-10-15T22:43:51.950480] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-15T22:43:51.972387] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-15T22:43:51.972749] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-15T22:43:51.975458] [INFO ] [MAIN ] Derivative Progress: 1744/1803 symbols completed. WMK took 1.1s. Estimated remaining: 22.2s. Rate: 159.8 symbols/min [2025-10-15T22:43:51.975838] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:51.996604] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:51.997901] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39738 primary records. [2025-10-15T22:43:51.998065] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-15T22:43:52.017457] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-15T22:43:52.019248] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-15T22:43:52.022699] [INFO ] [MAIN ] Derivative Progress: 1745/1803 symbols completed. WMS took 1.1s. Estimated remaining: 21.8s. Rate: 159.9 symbols/min [2025-10-15T22:43:52.023057] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:52.047371] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:52.048066] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-15T22:43:52.048130] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-15T22:43:52.063844] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-15T22:43:52.064704] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-15T22:43:52.067508] [INFO ] [MAIN ] Derivative Progress: 1746/1803 symbols completed. WMT took 1.1s. Estimated remaining: 21.4s. Rate: 160.0 symbols/min [2025-10-15T22:43:52.078880] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:52.080011] [DEBUG] [LOCAL ] WNC: Loaded 38500 existing records from primary storage. [2025-10-15T22:43:52.080272] [INFO ] [MAIN ] WNC: Loaded 38500 primary data records. [2025-10-15T22:43:52.344563] [DEBUG] [LOCAL ] WNS: Loaded 40257 existing records from primary storage. [2025-10-15T22:43:52.445671] [INFO ] [MAIN ] WNS: Loaded 40257 primary data records. [2025-10-15T22:43:52.566268] [DEBUG] [LOCAL ] WOLF: Loaded 53164 existing records from primary storage. [2025-10-15T22:43:52.578602] [INFO ] [MAIN ] WOLF: Loaded 53164 primary data records. [2025-10-15T22:43:53.145462] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:53.146970] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38500 primary records. [2025-10-15T22:43:53.147263] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-15T22:43:53.166105] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-15T22:43:53.166265] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-15T22:43:53.168587] [INFO ] [MAIN ] Derivative Progress: 1747/1803 symbols completed. WNC took 1.2s. Estimated remaining: 21.0s. Rate: 159.8 symbols/min [2025-10-15T22:43:53.169120] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:53.185889] [DEBUG] [MAIN ] WNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:53.188758] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 40257 primary records. [2025-10-15T22:43:53.189024] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-15T22:43:53.209260] [DEBUG] [MAIN ] WOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:53.210991] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53164 primary records. [2025-10-15T22:43:53.213904] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-15T22:43:53.245971] [DEBUG] [LOCAL ] WOR: Loaded 24008 existing records from primary storage. [2025-10-15T22:43:53.245351] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-15T22:43:53.246110] [INFO ] [MAIN ] WOR: Loaded 24008 primary data records. [2025-10-15T22:43:53.258497] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-15T22:43:53.277955] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-15T22:43:53.283203] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-15T22:43:53.286706] [INFO ] [MAIN ] Derivative Progress: 1748/1803 symbols completed. WOLF took 1.2s. Estimated remaining: 20.6s. Rate: 159.8 symbols/min [2025-10-15T22:43:53.322408] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:53.322676] [INFO ] [MAIN ] Derivative Progress: 1749/1803 symbols completed. WNS took 1.3s. Estimated remaining: 20.3s. Rate: 159.9 symbols/min [2025-10-15T22:43:53.339673] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:53.583746] [DEBUG] [LOCAL ] WOW: Loaded 30976 existing records from primary storage. [2025-10-15T22:43:53.584109] [INFO ] [MAIN ] WOW: Loaded 30976 primary data records. [2025-10-15T22:43:53.737322] [DEBUG] [LOCAL ] WPC: Loaded 48267 existing records from primary storage. [2025-10-15T22:43:53.748138] [INFO ] [MAIN ] WPC: Loaded 48267 primary data records. [2025-10-15T22:43:54.104904] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:54.115332] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24008 primary records. [2025-10-15T22:43:54.133809] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-15T22:43:54.333982] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-15T22:43:54.335108] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-15T22:43:54.338051] [INFO ] [MAIN ] Derivative Progress: 1750/1803 symbols completed. WOR took 1.2s. Estimated remaining: 19.9s. Rate: 159.8 symbols/min [2025-10-15T22:43:54.338509] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:54.359946] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:54.361107] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30976 primary records. [2025-10-15T22:43:54.361260] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-15T22:43:54.394892] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-15T22:43:54.395248] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-15T22:43:54.398391] [INFO ] [MAIN ] Derivative Progress: 1751/1803 symbols completed. WOW took 1.1s. Estimated remaining: 19.5s. Rate: 159.9 symbols/min [2025-10-15T22:43:54.395619] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:54.399727] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48267 primary records. [2025-10-15T22:43:54.398829] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:54.417831] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-15T22:43:54.433603] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-15T22:43:54.433803] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-15T22:43:54.436491] [INFO ] [MAIN ] Derivative Progress: 1752/1803 symbols completed. WPC took 1.1s. Estimated remaining: 19.1s. Rate: 159.9 symbols/min [2025-10-15T22:43:54.436744] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:54.460307] [DEBUG] [LOCAL ] WPM: Loaded 52775 existing records from primary storage. [2025-10-15T22:43:54.460717] [INFO ] [MAIN ] WPM: Loaded 52775 primary data records. [2025-10-15T22:43:54.613629] [DEBUG] [LOCAL ] WPP: Loaded 34446 existing records from primary storage. [2025-10-15T22:43:54.628186] [INFO ] [MAIN ] WPP: Loaded 34446 primary data records. [2025-10-15T22:43:54.815500] [DEBUG] [LOCAL ] WRB: Loaded 50783 existing records from primary storage. [2025-10-15T22:43:54.827138] [INFO ] [MAIN ] WRB: Loaded 50783 primary data records. [2025-10-15T22:43:55.487974] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:55.489061] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52775 primary records. [2025-10-15T22:43:55.489670] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-15T22:43:55.507331] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-15T22:43:55.507577] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-15T22:43:55.510318] [INFO ] [MAIN ] Derivative Progress: 1753/1803 symbols completed. WPM took 1.2s. Estimated remaining: 18.8s. Rate: 159.8 symbols/min [2025-10-15T22:43:55.529577] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:55.530704] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50783 primary records. [2025-10-15T22:43:55.530829] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-15T22:43:55.544451] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:55.556721] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34446 primary records. [2025-10-15T22:43:55.560097] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-15T22:43:55.560210] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-15T22:43:55.560274] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-15T22:43:55.563324] [INFO ] [MAIN ] Derivative Progress: 1754/1803 symbols completed. WRB took 1.1s. Estimated remaining: 18.4s. Rate: 159.8 symbols/min [2025-10-15T22:43:55.579050] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-15T22:43:55.579119] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-15T22:43:55.581595] [INFO ] [MAIN ] Derivative Progress: 1755/1803 symbols completed. WPP took 1.2s. Estimated remaining: 18.0s. Rate: 159.9 symbols/min [2025-10-15T22:43:55.582088] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:55.582180] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:55.582344] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:55.610084] [DEBUG] [LOCAL ] WS: Loaded 23373 existing records from primary storage. [2025-10-15T22:43:55.610350] [INFO ] [MAIN ] WS: Loaded 23373 primary data records. [2025-10-15T22:43:55.808831] [DEBUG] [LOCAL ] WSM: Loaded 49101 existing records from primary storage. [2025-10-15T22:43:55.817894] [DEBUG] [LOCAL ] WRBY: Loaded 50726 existing records from primary storage. [2025-10-15T22:43:55.826702] [INFO ] [MAIN ] WSM: Loaded 49101 primary data records. [2025-10-15T22:43:55.828177] [INFO ] [MAIN ] WRBY: Loaded 50726 primary data records. [2025-10-15T22:43:56.683602] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:56.685034] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23373 primary records. [2025-10-15T22:43:56.685135] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-15T22:43:56.702806] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-15T22:43:56.703002] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-15T22:43:56.706557] [INFO ] [MAIN ] Derivative Progress: 1756/1803 symbols completed. WS took 1.1s. Estimated remaining: 17.7s. Rate: 159.7 symbols/min [2025-10-15T22:43:56.707985] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:56.723910] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:56.725992] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49101 primary records. [2025-10-15T22:43:56.726220] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-15T22:43:56.758105] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-15T22:43:56.758598] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-15T22:43:56.758989] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:56.762323] [INFO ] [MAIN ] Derivative Progress: 1757/1803 symbols completed. WSM took 1.2s. Estimated remaining: 17.3s. Rate: 159.8 symbols/min [2025-10-15T22:43:56.771020] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50726 primary records. [2025-10-15T22:43:56.771225] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-15T22:43:56.771353] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:56.798636] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-15T22:43:56.798977] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-15T22:43:56.799461] [DEBUG] [LOCAL ] WSO: Loaded 25670 existing records from primary storage. [2025-10-15T22:43:56.803931] [INFO ] [MAIN ] Derivative Progress: 1758/1803 symbols completed. WRBY took 1.2s. Estimated remaining: 16.9s. Rate: 159.9 symbols/min [2025-10-15T22:43:56.804572] [INFO ] [MAIN ] WSO: Loaded 25670 primary data records. [2025-10-15T22:43:56.804377] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:56.935298] [DEBUG] [LOCAL ] WSR: Loaded 22976 existing records from primary storage. [2025-10-15T22:43:56.946722] [INFO ] [MAIN ] WSR: Loaded 22976 primary data records. [2025-10-15T22:43:57.275629] [DEBUG] [LOCAL ] WST: Loaded 36740 existing records from primary storage. [2025-10-15T22:43:57.292811] [INFO ] [MAIN ] WST: Loaded 36740 primary data records. [2025-10-15T22:43:57.832762] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:57.834096] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 25670 primary records. [2025-10-15T22:43:57.834316] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-15T22:43:57.851512] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-15T22:43:57.855043] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-15T22:43:57.857495] [INFO ] [MAIN ] Derivative Progress: 1759/1803 symbols completed. WSO took 1.1s. Estimated remaining: 16.5s. Rate: 159.7 symbols/min [2025-10-15T22:43:57.857959] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:57.873720] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:57.874922] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22976 primary records. [2025-10-15T22:43:57.875179] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-15T22:43:57.895237] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-15T22:43:57.895512] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-15T22:43:57.898360] [INFO ] [MAIN ] Derivative Progress: 1760/1803 symbols completed. WSR took 1.1s. Estimated remaining: 16.1s. Rate: 159.8 symbols/min [2025-10-15T22:43:57.898616] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:57.912583] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:57.913796] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36740 primary records. [2025-10-15T22:43:57.913873] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-15T22:43:57.931378] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-15T22:43:57.931454] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-15T22:43:57.934233] [INFO ] [MAIN ] Derivative Progress: 1761/1803 symbols completed. WST took 1.1s. Estimated remaining: 15.8s. Rate: 159.9 symbols/min [2025-10-15T22:43:57.934411] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:57.967373] [DEBUG] [LOCAL ] WT: Loaded 48092 existing records from primary storage. [2025-10-15T22:43:57.968847] [INFO ] [MAIN ] WT: Loaded 48092 primary data records. [2025-10-15T22:43:58.130600] [DEBUG] [LOCAL ] WTI: Loaded 44655 existing records from primary storage. [2025-10-15T22:43:58.137206] [DEBUG] [LOCAL ] WTRG: Loaded 50972 existing records from primary storage. [2025-10-15T22:43:58.147812] [INFO ] [MAIN ] WTI: Loaded 44655 primary data records. [2025-10-15T22:43:58.153060] [INFO ] [MAIN ] WTRG: Loaded 50972 primary data records. [2025-10-15T22:43:59.000958] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:59.002123] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 48092 primary records. [2025-10-15T22:43:59.002691] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-15T22:43:59.020163] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-15T22:43:59.020902] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-15T22:43:59.023344] [INFO ] [MAIN ] Derivative Progress: 1762/1803 symbols completed. WT took 1.2s. Estimated remaining: 15.4s. Rate: 159.7 symbols/min [2025-10-15T22:43:59.023702] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:59.052525] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:59.058696] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44655 primary records. [2025-10-15T22:43:59.059101] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:43:59.059238] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-15T22:43:59.065468] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50972 primary records. [2025-10-15T22:43:59.065579] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-15T22:43:59.100549] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-15T22:43:59.101267] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-15T22:43:59.105760] [INFO ] [MAIN ] Derivative Progress: 1763/1803 symbols completed. WTI took 1.2s. Estimated remaining: 15.0s. Rate: 159.8 symbols/min [2025-10-15T22:43:59.106439] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:59.101627] [DEBUG] [LOCAL ] WTS: Loaded 17424 existing records from primary storage. [2025-10-15T22:43:59.106934] [INFO ] [MAIN ] WTS: Loaded 17424 primary data records. [2025-10-15T22:43:59.152847] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-15T22:43:59.200838] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-15T22:43:59.210556] [INFO ] [MAIN ] Derivative Progress: 1764/1803 symbols completed. WTRG took 1.3s. Estimated remaining: 14.6s. Rate: 159.9 symbols/min [2025-10-15T22:43:59.213906] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:43:59.443506] [DEBUG] [LOCAL ] WTTR: Loaded 44606 existing records from primary storage. [2025-10-15T22:43:59.456077] [INFO ] [MAIN ] WTTR: Loaded 44606 primary data records. [2025-10-15T22:43:59.582941] [DEBUG] [LOCAL ] WU: Loaded 53480 existing records from primary storage. [2025-10-15T22:43:59.594334] [INFO ] [MAIN ] WU: Loaded 53480 primary data records. [2025-10-15T22:44:00.075639] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:00.090139] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 17424 primary records. [2025-10-15T22:44:00.090474] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-15T22:44:00.109632] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-15T22:44:00.110564] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-15T22:44:00.113331] [INFO ] [MAIN ] Derivative Progress: 1765/1803 symbols completed. WTS took 1.1s. Estimated remaining: 14.3s. Rate: 159.7 symbols/min [2025-10-15T22:44:00.114133] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:00.135248] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:00.135959] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44606 primary records. [2025-10-15T22:44:00.136081] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-15T22:44:00.163302] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-15T22:44:00.168358] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-15T22:44:00.168596] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:00.171773] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53480 primary records. [2025-10-15T22:44:00.171021] [INFO ] [MAIN ] Derivative Progress: 1766/1803 symbols completed. WTTR took 1.1s. Estimated remaining: 13.9s. Rate: 159.8 symbols/min [2025-10-15T22:44:00.171913] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-15T22:44:00.172409] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:00.199634] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-15T22:44:00.200631] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-15T22:44:00.203562] [INFO ] [MAIN ] Derivative Progress: 1767/1803 symbols completed. WU took 1.0s. Estimated remaining: 13.5s. Rate: 159.9 symbols/min [2025-10-15T22:44:00.203864] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:00.219865] [DEBUG] [LOCAL ] WWW: Loaded 49251 existing records from primary storage. [2025-10-15T22:44:00.220127] [INFO ] [MAIN ] WWW: Loaded 49251 primary data records. [2025-10-15T22:44:00.592955] [DEBUG] [LOCAL ] XFLT: Loaded 29971 existing records from primary storage. [2025-10-15T22:44:00.594409] [INFO ] [MAIN ] XFLT: Loaded 29971 primary data records. [2025-10-15T22:44:00.616191] [DEBUG] [LOCAL ] WY: Loaded 53219 existing records from primary storage. [2025-10-15T22:44:00.632509] [INFO ] [MAIN ] WY: Loaded 53219 primary data records. [2025-10-15T22:44:01.234591] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:01.235463] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49251 primary records. [2025-10-15T22:44:01.235729] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-15T22:44:01.252424] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-15T22:44:01.252561] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-15T22:44:01.255196] [INFO ] [MAIN ] Derivative Progress: 1768/1803 symbols completed. WWW took 1.1s. Estimated remaining: 13.1s. Rate: 159.7 symbols/min [2025-10-15T22:44:01.293620] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:01.293897] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:01.294718] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53219 primary records. [2025-10-15T22:44:01.294799] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-15T22:44:01.295363] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29971 primary records. [2025-10-15T22:44:01.296206] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-15T22:44:01.324830] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-15T22:44:01.326405] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-15T22:44:01.331813] [INFO ] [MAIN ] Derivative Progress: 1769/1803 symbols completed. XFLT took 1.1s. Estimated remaining: 12.8s. Rate: 159.8 symbols/min [2025-10-15T22:44:01.331974] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-15T22:44:01.332315] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-15T22:44:01.336156] [INFO ] [MAIN ] Derivative Progress: 1770/1803 symbols completed. WY took 1.2s. Estimated remaining: 12.4s. Rate: 159.9 symbols/min [2025-10-15T22:44:01.336864] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:01.336768] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:01.337368] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:01.384787] [DEBUG] [LOCAL ] XPER: Loaded 30424 existing records from primary storage. [2025-10-15T22:44:01.384920] [INFO ] [MAIN ] XPER: Loaded 30424 primary data records. [2025-10-15T22:44:01.609459] [DEBUG] [LOCAL ] XHR: Loaded 43603 existing records from primary storage. [2025-10-15T22:44:01.611048] [INFO ] [MAIN ] XHR: Loaded 43603 primary data records. [2025-10-15T22:44:01.610911] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-15T22:44:01.761796] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-15T22:44:02.442715] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:02.444139] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30424 primary records. [2025-10-15T22:44:02.444897] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-15T22:44:02.462219] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-15T22:44:02.462808] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-15T22:44:02.464740] [INFO ] [MAIN ] Derivative Progress: 1771/1803 symbols completed. XPER took 1.1s. Estimated remaining: 12.0s. Rate: 159.7 symbols/min [2025-10-15T22:44:02.464978] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:02.481803] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:02.482525] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43603 primary records. [2025-10-15T22:44:02.482827] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-15T22:44:02.500513] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-15T22:44:02.500672] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-15T22:44:02.503493] [INFO ] [MAIN ] Derivative Progress: 1772/1803 symbols completed. XHR took 1.2s. Estimated remaining: 11.6s. Rate: 159.8 symbols/min [2025-10-15T22:44:02.503786] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:02.517335] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:02.518107] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-15T22:44:02.518170] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-15T22:44:02.534825] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-15T22:44:02.534957] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-15T22:44:02.538794] [INFO ] [MAIN ] Derivative Progress: 1773/1803 symbols completed. XOM took 1.2s. Estimated remaining: 11.3s. Rate: 159.9 symbols/min [2025-10-15T22:44:02.539089] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:02.585921] [DEBUG] [LOCAL ] XPEV: Loaded 53631 existing records from primary storage. [2025-10-15T22:44:02.586311] [INFO ] [MAIN ] XPEV: Loaded 53631 primary data records. [2025-10-15T22:44:02.683596] [DEBUG] [LOCAL ] XPO: Loaded 47630 existing records from primary storage. [2025-10-15T22:44:02.699052] [INFO ] [MAIN ] XPO: Loaded 47630 primary data records. [2025-10-15T22:44:02.758442] [DEBUG] [LOCAL ] XPOF: Loaded 37439 existing records from primary storage. [2025-10-15T22:44:02.770668] [INFO ] [MAIN ] XPOF: Loaded 37439 primary data records. [2025-10-15T22:44:03.630400] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:03.631268] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:03.633624] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47630 primary records. [2025-10-15T22:44:03.632534] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53631 primary records. [2025-10-15T22:44:03.633942] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-15T22:44:03.634670] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-15T22:44:03.662197] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-15T22:44:03.665188] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-15T22:44:03.670222] [INFO ] [MAIN ] Derivative Progress: 1774/1803 symbols completed. XPO took 1.2s. Estimated remaining: 10.9s. Rate: 159.7 symbols/min [2025-10-15T22:44:03.672110] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:03.674032] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-15T22:44:03.676332] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-15T22:44:03.678506] [INFO ] [MAIN ] Derivative Progress: 1775/1803 symbols completed. XPEV took 1.2s. Estimated remaining: 10.5s. Rate: 159.8 symbols/min [2025-10-15T22:44:03.678858] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:03.693431] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:03.694340] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37439 primary records. [2025-10-15T22:44:03.694481] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-15T22:44:03.711834] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-15T22:44:03.712063] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-15T22:44:03.715330] [INFO ] [MAIN ] Derivative Progress: 1776/1803 symbols completed. XPOF took 1.2s. Estimated remaining: 10.1s. Rate: 159.9 symbols/min [2025-10-15T22:44:03.715556] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:03.745564] [DEBUG] [LOCAL ] XYF: Loaded 27851 existing records from primary storage. [2025-10-15T22:44:03.745731] [INFO ] [MAIN ] XYF: Loaded 27851 primary data records. [2025-10-15T22:44:03.870465] [DEBUG] [LOCAL ] XPRO: Loaded 45894 existing records from primary storage. [2025-10-15T22:44:03.907081] [INFO ] [MAIN ] XPRO: Loaded 45894 primary data records. [2025-10-15T22:44:04.192790] [DEBUG] [LOCAL ] XYL: Loaded 47784 existing records from primary storage. [2025-10-15T22:44:04.197787] [INFO ] [MAIN ] XYL: Loaded 47784 primary data records. [2025-10-15T22:44:04.761545] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:04.762736] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 27851 primary records. [2025-10-15T22:44:04.763341] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-15T22:44:04.792122] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-15T22:44:04.792423] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-15T22:44:04.799431] [INFO ] [MAIN ] Derivative Progress: 1777/1803 symbols completed. XYF took 1.1s. Estimated remaining: 9.8s. Rate: 159.7 symbols/min [2025-10-15T22:44:04.799724] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:04.800797] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:04.801818] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45894 primary records. [2025-10-15T22:44:04.801891] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-15T22:44:04.820633] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-15T22:44:04.820967] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-15T22:44:04.824114] [INFO ] [MAIN ] Derivative Progress: 1778/1803 symbols completed. XPRO took 1.2s. Estimated remaining: 9.4s. Rate: 159.8 symbols/min [2025-10-15T22:44:04.824311] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:04.838866] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:04.839603] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47784 primary records. [2025-10-15T22:44:04.839705] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-15T22:44:04.870472] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-15T22:44:04.870617] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-15T22:44:04.873582] [INFO ] [MAIN ] Derivative Progress: 1779/1803 symbols completed. XYL took 1.2s. Estimated remaining: 9.0s. Rate: 159.9 symbols/min [2025-10-15T22:44:04.874018] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:04.887448] [DEBUG] [LOCAL ] YALA: Loaded 36820 existing records from primary storage. [2025-10-15T22:44:04.887620] [INFO ] [MAIN ] YALA: Loaded 36820 primary data records. [2025-10-15T22:44:05.197289] [DEBUG] [LOCAL ] YELP: Loaded 45489 existing records from primary storage. [2025-10-15T22:44:05.210260] [INFO ] [MAIN ] YELP: Loaded 45489 primary data records. [2025-10-15T22:44:05.364290] [DEBUG] [LOCAL ] YETI: Loaded 52503 existing records from primary storage. [2025-10-15T22:44:05.388122] [INFO ] [MAIN ] YETI: Loaded 52503 primary data records. [2025-10-15T22:44:05.854862] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:05.856114] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 36820 primary records. [2025-10-15T22:44:05.856381] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-15T22:44:05.872961] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-15T22:44:05.873256] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-15T22:44:05.876045] [INFO ] [MAIN ] Derivative Progress: 1780/1803 symbols completed. YALA took 1.1s. Estimated remaining: 8.6s. Rate: 159.7 symbols/min [2025-10-15T22:44:05.876209] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:05.894109] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:05.894812] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45489 primary records. [2025-10-15T22:44:05.894999] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-15T22:44:05.913256] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-15T22:44:05.913472] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-15T22:44:05.916047] [INFO ] [MAIN ] Derivative Progress: 1781/1803 symbols completed. YELP took 1.1s. Estimated remaining: 8.3s. Rate: 159.8 symbols/min [2025-10-15T22:44:05.916200] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:05.942165] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:05.942860] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52503 primary records. [2025-10-15T22:44:05.943597] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-15T22:44:05.972954] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-15T22:44:05.973108] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-15T22:44:05.973929] [DEBUG] [LOCAL ] YEXT: Loaded 43180 existing records from primary storage. [2025-10-15T22:44:05.976888] [INFO ] [MAIN ] Derivative Progress: 1782/1803 symbols completed. YETI took 1.1s. Estimated remaining: 7.9s. Rate: 159.9 symbols/min [2025-10-15T22:44:05.977230] [INFO ] [MAIN ] YEXT: Loaded 43180 primary data records. [2025-10-15T22:44:05.977569] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:06.299761] [DEBUG] [LOCAL ] YMM: Loaded 52607 existing records from primary storage. [2025-10-15T22:44:06.313683] [INFO ] [MAIN ] YMM: Loaded 52607 primary data records. [2025-10-15T22:44:06.438595] [DEBUG] [LOCAL ] YOU: Loaded 49670 existing records from primary storage. [2025-10-15T22:44:06.439376] [INFO ] [MAIN ] YOU: Loaded 49670 primary data records. [2025-10-15T22:44:07.011732] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:07.012986] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43180 primary records. [2025-10-15T22:44:07.013834] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-15T22:44:07.034742] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-15T22:44:07.035953] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-15T22:44:07.039492] [INFO ] [MAIN ] Derivative Progress: 1783/1803 symbols completed. YEXT took 1.2s. Estimated remaining: 7.5s. Rate: 159.7 symbols/min [2025-10-15T22:44:07.053229] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:07.054179] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52607 primary records. [2025-10-15T22:44:07.054473] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-15T22:44:07.073766] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-15T22:44:07.073845] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-15T22:44:07.076872] [INFO ] [MAIN ] Derivative Progress: 1784/1803 symbols completed. YMM took 1.2s. Estimated remaining: 7.1s. Rate: 159.8 symbols/min [2025-10-15T22:44:07.089837] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:07.090452] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49670 primary records. [2025-10-15T22:44:07.090515] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-15T22:44:07.106518] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-15T22:44:07.106665] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-15T22:44:07.109677] [INFO ] [MAIN ] Derivative Progress: 1785/1803 symbols completed. YOU took 1.1s. Estimated remaining: 6.8s. Rate: 159.9 symbols/min [2025-10-15T22:44:07.110116] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:07.110197] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:07.110829] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:07.124792] [DEBUG] [LOCAL ] YRD: Loaded 11484 existing records from primary storage. [2025-10-15T22:44:07.124926] [INFO ] [MAIN ] YRD: Loaded 11484 primary data records. [2025-10-15T22:44:07.239294] [DEBUG] [LOCAL ] YSG: Loaded 25514 existing records from primary storage. [2025-10-15T22:44:07.251873] [INFO ] [MAIN ] YSG: Loaded 25514 primary data records. [2025-10-15T22:44:07.460766] [DEBUG] [LOCAL ] YPF: Loaded 50678 existing records from primary storage. [2025-10-15T22:44:07.604161] [INFO ] [MAIN ] YPF: Loaded 50678 primary data records. [2025-10-15T22:44:08.140883] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:08.145245] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 11484 primary records. [2025-10-15T22:44:08.146070] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-15T22:44:08.185020] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-15T22:44:08.182117] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:08.187152] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25514 primary records. [2025-10-15T22:44:08.188222] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-15T22:44:08.188132] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-15T22:44:08.191274] [INFO ] [MAIN ] Derivative Progress: 1786/1803 symbols completed. YRD took 1.1s. Estimated remaining: 6.4s. Rate: 159.7 symbols/min [2025-10-15T22:44:08.193170] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:08.223083] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:08.227741] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50678 primary records. [2025-10-15T22:44:08.229200] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-15T22:44:08.230912] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-15T22:44:08.231926] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-15T22:44:08.241996] [INFO ] [MAIN ] Derivative Progress: 1787/1803 symbols completed. YSG took 1.1s. Estimated remaining: 6.0s. Rate: 159.8 symbols/min [2025-10-15T22:44:08.243764] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:08.251516] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-15T22:44:08.251691] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-15T22:44:08.254341] [INFO ] [MAIN ] Derivative Progress: 1788/1803 symbols completed. YPF took 1.1s. Estimated remaining: 5.6s. Rate: 159.9 symbols/min [2025-10-15T22:44:08.254693] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:08.308710] [DEBUG] [LOCAL ] YUM: Loaded 51170 existing records from primary storage. [2025-10-15T22:44:08.309027] [INFO ] [MAIN ] YUM: Loaded 51170 primary data records. [2025-10-15T22:44:08.467501] [DEBUG] [LOCAL ] YUMC: Loaded 52590 existing records from primary storage. [2025-10-15T22:44:08.469488] [INFO ] [MAIN ] YUMC: Loaded 52590 primary data records. [2025-10-15T22:44:08.488067] [DEBUG] [LOCAL ] ZBH: Loaded 50834 existing records from primary storage. [2025-10-15T22:44:08.544946] [INFO ] [MAIN ] ZBH: Loaded 50834 primary data records. [2025-10-15T22:44:09.404388] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:09.406381] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51170 primary records. [2025-10-15T22:44:09.407492] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-15T22:44:09.437097] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:09.440936] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52590 primary records. [2025-10-15T22:44:09.442388] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-15T22:44:09.442521] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-15T22:44:09.442589] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-15T22:44:09.457785] [INFO ] [MAIN ] Derivative Progress: 1789/1803 symbols completed. YUM took 1.3s. Estimated remaining: 5.3s. Rate: 159.7 symbols/min [2025-10-15T22:44:09.459351] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:09.459507] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:09.460526] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50834 primary records. [2025-10-15T22:44:09.461064] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-15T22:44:09.494111] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-15T22:44:09.498916] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-15T22:44:09.503173] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-15T22:44:09.503252] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-15T22:44:09.506610] [INFO ] [MAIN ] Derivative Progress: 1790/1803 symbols completed. ZBH took 1.3s. Estimated remaining: 4.9s. Rate: 159.7 symbols/min [2025-10-15T22:44:09.510337] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:09.510961] [INFO ] [MAIN ] Derivative Progress: 1791/1803 symbols completed. YUMC took 1.3s. Estimated remaining: 4.5s. Rate: 159.8 symbols/min [2025-10-15T22:44:09.511198] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:09.521016] [DEBUG] [LOCAL ] ZEPP: Loaded 19046 existing records from primary storage. [2025-10-15T22:44:09.521153] [INFO ] [MAIN ] ZEPP: Loaded 19046 primary data records. [2025-10-15T22:44:09.946888] [DEBUG] [LOCAL ] ZGN: Loaded 40869 existing records from primary storage. [2025-10-15T22:44:09.965764] [INFO ] [MAIN ] ZGN: Loaded 40869 primary data records. [2025-10-15T22:44:10.047775] [DEBUG] [LOCAL ] ZETA: Loaded 53617 existing records from primary storage. [2025-10-15T22:44:10.089543] [INFO ] [MAIN ] ZETA: Loaded 53617 primary data records. [2025-10-15T22:44:10.839060] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:10.859965] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 19046 primary records. [2025-10-15T22:44:10.861782] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-15T22:44:10.882431] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-10-15T22:44:10.883404] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-15T22:44:10.887841] [INFO ] [MAIN ] Derivative Progress: 1792/1803 symbols completed. ZEPP took 1.4s. Estimated remaining: 4.1s. Rate: 159.6 symbols/min [2025-10-15T22:44:10.888277] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:10.932688] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:10.946833] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40869 primary records. [2025-10-15T22:44:10.947507] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-15T22:44:10.947400] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:10.949486] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53617 primary records. [2025-10-15T22:44:10.956432] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-15T22:44:10.972872] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-15T22:44:10.985624] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-15T22:44:10.985322] [DEBUG] [LOCAL ] ZH: Loaded 25337 existing records from primary storage. [2025-10-15T22:44:10.988625] [INFO ] [MAIN ] ZH: Loaded 25337 primary data records. [2025-10-15T22:44:10.988234] [INFO ] [MAIN ] Derivative Progress: 1793/1803 symbols completed. ZGN took 1.5s. Estimated remaining: 3.8s. Rate: 159.7 symbols/min [2025-10-15T22:44:10.989141] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:11.073102] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-15T22:44:11.090247] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-15T22:44:11.104898] [INFO ] [MAIN ] Derivative Progress: 1794/1803 symbols completed. ZETA took 1.6s. Estimated remaining: 3.4s. Rate: 159.7 symbols/min [2025-10-15T22:44:11.110914] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:11.355422] [DEBUG] [LOCAL ] ZIM: Loaded 53493 existing records from primary storage. [2025-10-15T22:44:11.356679] [INFO ] [MAIN ] ZIM: Loaded 53493 primary data records. [2025-10-15T22:44:11.453519] [DEBUG] [LOCAL ] ZIP: Loaded 43691 existing records from primary storage. [2025-10-15T22:44:11.464767] [INFO ] [MAIN ] ZIP: Loaded 43691 primary data records. [2025-10-15T22:44:11.796038] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:11.809024] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 25337 primary records. [2025-10-15T22:44:11.820463] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-15T22:44:12.019162] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-15T22:44:12.019462] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-15T22:44:12.021897] [INFO ] [MAIN ] Derivative Progress: 1795/1803 symbols completed. ZH took 1.1s. Estimated remaining: 3.0s. Rate: 159.6 symbols/min [2025-10-15T22:44:12.022588] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:12.046942] [DEBUG] [MAIN ] ZIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:12.047762] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53493 primary records. [2025-10-15T22:44:12.047941] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-15T22:44:12.064887] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-15T22:44:12.074866] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-15T22:44:12.078026] [INFO ] [MAIN ] Derivative Progress: 1796/1803 symbols completed. ZIM took 1.1s. Estimated remaining: 2.6s. Rate: 159.7 symbols/min [2025-10-15T22:44:12.079322] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:12.094563] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:12.095475] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43691 primary records. [2025-10-15T22:44:12.096398] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-15T22:44:12.128636] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-15T22:44:12.128923] [DEBUG] [LOCAL ] ZKH: Loaded 7471 existing records from primary storage. [2025-10-15T22:44:12.130078] [DEBUG] [LOCAL ] ZK: Loaded 39127 existing records from primary storage. [2025-10-15T22:44:12.130442] [INFO ] [MAIN ] ZKH: Loaded 7471 primary data records. [2025-10-15T22:44:12.130495] [INFO ] [MAIN ] ZK: Loaded 39127 primary data records. [2025-10-15T22:44:12.130278] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-15T22:44:12.147186] [INFO ] [MAIN ] Derivative Progress: 1797/1803 symbols completed. ZIP took 1.0s. Estimated remaining: 2.3s. Rate: 159.7 symbols/min [2025-10-15T22:44:12.157672] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:12.758926] [DEBUG] [LOCAL ] ZTO: Loaded 49488 existing records from primary storage. [2025-10-15T22:44:12.760146] [INFO ] [MAIN ] ZTO: Loaded 49488 primary data records. [2025-10-15T22:44:13.129681] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:13.132296] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39127 primary records. [2025-10-15T22:44:13.132463] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-15T22:44:13.164482] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:13.167227] [INFO ] [MAIN ] ZKH: Generated 1794 derivative records from 7471 primary records. [2025-10-15T22:44:13.167334] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-15T22:44:13.170206] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-15T22:44:13.184283] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1794 records). [2025-10-15T22:44:13.184713] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-15T22:44:13.184511] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-15T22:44:13.187100] [INFO ] [MAIN ] Derivative Progress: 1798/1803 symbols completed. ZKH took 1.1s. Estimated remaining: 1.9s. Rate: 159.6 symbols/min [2025-10-15T22:44:13.189944] [INFO ] [MAIN ] Derivative Progress: 1799/1803 symbols completed. ZK took 1.2s. Estimated remaining: 1.5s. Rate: 159.7 symbols/min [2025-10-15T22:44:13.206222] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:13.206899] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49488 primary records. [2025-10-15T22:44:13.206962] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-15T22:44:13.222467] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-15T22:44:13.222525] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-15T22:44:13.226380] [INFO ] [MAIN ] Derivative Progress: 1800/1803 symbols completed. ZTO took 1.1s. Estimated remaining: 1.1s. Rate: 159.7 symbols/min [2025-10-15T22:44:13.226971] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:13.227117] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:13.226907] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-15T22:44:13.251084] [DEBUG] [LOCAL ] ZTR: Loaded 16698 existing records from primary storage. [2025-10-15T22:44:13.251222] [INFO ] [MAIN ] ZTR: Loaded 16698 primary data records. [2025-10-15T22:44:13.467842] [DEBUG] [LOCAL ] ZWS: Loaded 42402 existing records from primary storage. [2025-10-15T22:44:13.541798] [INFO ] [MAIN ] ZWS: Loaded 42402 primary data records. [2025-10-15T22:44:13.637767] [DEBUG] [LOCAL ] ZTS: Loaded 53149 existing records from primary storage. [2025-10-15T22:44:13.646110] [INFO ] [MAIN ] ZTS: Loaded 53149 primary data records. [2025-10-15T22:44:14.243913] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:14.245289] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16698 primary records. [2025-10-15T22:44:14.245994] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-15T22:44:14.265165] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-15T22:44:14.266021] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-15T22:44:14.271593] [INFO ] [MAIN ] Derivative Progress: 1801/1803 symbols completed. ZTR took 1.0s. Estimated remaining: 0.8s. Rate: 159.6 symbols/min [2025-10-15T22:44:14.286687] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:14.287462] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42402 primary records. [2025-10-15T22:44:14.287832] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-15T22:44:14.308430] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-15T22:44:14.308591] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-15T22:44:14.310605] [INFO ] [MAIN ] Derivative Progress: 1802/1803 symbols completed. ZWS took 1.1s. Estimated remaining: 0.4s. Rate: 159.7 symbols/min [2025-10-15T22:44:14.324158] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-15T22:44:14.325043] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53149 primary records. [2025-10-15T22:44:14.325141] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-15T22:44:14.341967] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-15T22:44:14.342102] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-15T22:44:14.346243] [INFO ] [MAIN ] Derivative Progress: 1803/1803 symbols completed. ZTS took 1.1s. Estimated remaining: 0.0s. Rate: 159.7 symbols/min [2025-10-15T22:44:14.347195] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 17s [2025-10-15T22:44:14.347345] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1803/1803 symbols) [2025-10-15T22:44:15.074441] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1803/1803 @ 100.00%)' [2025-10-15T22:44:15.074988] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-15T22:44:15.076267] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-15T22:44:15.076475] [INFO ] [STATE ] Last completion updated: 2025-10-15T22:44:15.076343